Foldable electronic device and method of operating screen thereof

Abstract

An electronic device according to an embodiment may be configured to display a first operation screen on a display by using a first display area in a first state in which a first housing, a second housing, and a third housing are folded relative to each other. An electronic device according to an embodiment may be configured such that: when a first running screen is displayed through a first display area; the first display area is deactivated based on a transition from the first state to the second state when the first and second housings remain folded while the second and third housings are identified to transition from the folded state to a second state in which the second and third housings are unfolded based on data received from the sensing device, and the second display area is deactivated based on a transition from the first state to the second state. And displaying the second running screen on the display through the second display area and the third display area. An electronic device according to an embodiment may be configured such that when a first running screen is displayed through a first display area, the first running screen is displayed through a second display area when a first housing, a second housing, and a third housing are identified to transition from a first state to a third state in which the first housing, the second housing, and the third housing are all expanded based on data received from a sensing device. Based on the transition from the first state to the third state, the first display area is expanded from the first display area to the second and third display areas and then displayed on the display.

Description

Technical Field

[0001] This disclosure relates to a foldable electronic device and a method of operating its screen. Background Technology

[0002] Electronic devices are evolving into structures that expand displays or improve their usability to meet the needs of users who desire newer and more diverse functions. For example, a housing structure in which two housings fold or unfold along a folding axis can be applied to electronic devices (e.g., foldable electronic devices).

[0003] Foldable electronic devices may have two or more folding axes; therefore, the housing and screen may be divided into three or more parts. For example, the electronic device may include a first folding axis implemented in an inward folding manner, a second folding axis implemented in an outward folding manner, and a display, and the screen of the display may be divided into a first display area, a second display area, and a third display area by the first folding axis and the second folding axis.

[0004] The above information is provided as relevant technology for the purpose of aiding understanding of this disclosure. No assertion or determination is made as to whether any of the above descriptions can be used as prior art in relation to this disclosure. Summary of the Invention

[0005] Technical issues

[0006] Compared to electronic devices with a strip-shaped housing structure, foldable electronic devices with at least two folding axes offer users a variety and improved screen availability, beyond simply extending the display screen.

[0007] However, while foldable electronics offer a variety of expansion methods unlike existing devices, they only provide a uniform availability (or environment) where the screen size or application content changes depending on the size of the display, regardless of the altered structure of the electronics.

[0008] The embodiments of this disclosure require support for various extended scenarios in foldable electronic devices, depending on changes in the structure or housing of the electronic device. However, the problems to be solved in this disclosure are not limited to those described above, and can be extended in various ways without departing from the spirit and scope of this disclosure.

[0009] Solution to the problem

[0010] According to an embodiment, the electronic device may include a second housing, a first housing foldably coupled to one side of the second housing, and a third housing foldably coupled to the other side of the second housing.

[0011] According to an embodiment, the electronic device may include a display, which includes a first display area disposed in a first housing, a second display area disposed in a second housing, and a third display area disposed in a third housing.

[0012] According to an embodiment, the electronic device may include a sensing device configured to detect the folded or unfolded state of a first housing, a second housing, and a third housing.

[0013] According to an embodiment, the electronic device may include a memory and a processor configured to store executable instructions.

[0014] According to an embodiment, the instructions, when executed by the processor, can cause the electronic device to display a first operating screen on a display via a first display area in a first state in which the first housing, the second housing, and the third housing are folded relative to each other.

[0015] According to an embodiment, when a first operating screen is displayed in a first display area in a first state, if the electronic device recognizes, based on data received from a sensing device, that the first state has switched to a second state in which the first and second housings are folded and the second and third housings are unfolded, an instruction can cause the electronic device to deactivate the first display area and display a second operating screen on the display through the second and third display areas.

[0016] According to an embodiment, when the first operating screen is displayed in the first display area in the first state, if the electronic device recognizes that the first state has switched to the third state in which the first housing, the second housing, and the third housing are all unfolded based on data received from the sensing device, the instruction can cause the electronic device to display the first operating screen by expanding the first operating screen from the first display area to the second and third display areas.

[0017] According to an embodiment, a method of operating the screen of a foldable electronic device may include displaying a first operating screen on a display via a first display area in a first state in which the first housing, the second housing, and the third housing are folded relative to each other.

[0018] According to an embodiment, a method for operating the screen of a foldable electronic device may include: when a first operating screen is displayed through a first display area in a first state, if the electronic device identifies, based on data received from a sensing device, that the first state has switched to a second state in which the first and second housings are folded and the second and third housings are unfolded, deactivating the first display area and displaying a second operating screen on a display through the second and third display areas.

[0019] According to an embodiment, a method for operating the screen of a foldable electronic device may include: when a first operating screen is displayed through a first display area in a first state, and when the electronic device identifies, based on data received from a sensing device, that the first state has switched to a third state in which the first housing, the second housing, and the third housing are all unfolded, displaying the first operating screen on a display through the first display area, the second display area, and the third display area.

[0020] The electronic device disclosed herein may include a computer-readable recording medium on which programs for implementing various screen operation methods in a foldable electronic device are recorded.

[0021] Beneficial effects of the invention

[0022] Various embodiments can provide electronic devices with improved usability by supporting various extended scenarios based on the state of the electronic devices or the state of the housing structure in the foldable electronic device.

[0023] Various embodiments can facilitate the more efficient use of multiple folds.

[0024] Furthermore, the effects that can be obtained or anticipated through the various embodiments of this document can be disclosed directly or implicitly in the detailed description of the embodiments of this document. Attached Figure Description

[0025] Figure 1 This is a block diagram illustrating an electronic device within a network environment according to an embodiment.

[0026] Figures 2a to 2d The structure of a foldable electronic device according to an embodiment is shown.

[0027] Figure 3 This is a block diagram illustrating an electronic device according to an embodiment.

[0028] Figure 4 This is a diagram illustrating the module configuration of an electronic device according to an embodiment.

[0029] Figure 5 This diagram illustrates operations for different screen extension scenarios based on the structural state of the foldable electronic device, according to an embodiment.

[0030] Figure 6 This is a flowchart illustrating a method for operating the screen of a foldable electronic device according to an embodiment.

[0031] Figures 7a to 7c An example of a screen according to an embodiment is shown, showing the sequence in which the electronic device changes from a first state to a second state and from the second state to a third state.

[0032] Figure 8 An example of a screen is shown, showing the sequence in which the electronic devices change from a first state to a third state.

[0033] Figure 9 This is a screen example illustrating an extension of the screen of an operating electronic device according to an embodiment.

[0034] Figure 10a and Figure 10b An example screen is shown that provides grouped application information based on the state of an electronic device, according to an embodiment. Detailed Implementation

[0035] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, enabling those skilled in the art to readily implement the present disclosure. However, the present disclosure can be implemented in various different forms and is not limited to the embodiments described herein. In conjunction with the description of the accompanying drawings, the same or similar reference numerals may be used for the same or similar components. Furthermore, in the accompanying drawings and related descriptions, descriptions of well-known functions and structures may be omitted for clarity and brevity.

[0036] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments.

[0037] Reference Figure 1 In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with at least one of electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input module 150, sound output module 155, display module 160, audio module 170, sensor module 176, interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of the above components (e.g., connection terminal 178) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components described above (e.g., sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (e.g., display module 160).

[0038] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 120 may store commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to embodiments, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) or an auxiliary processor 123 (e.g., graphics processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor central processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 121. For example, when electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or to be adapted to perform a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or may implement a portion of the main processor 121.

[0039] When the main processor 121 is inactive (e.g., in sleep) state, the auxiliary processor 123 (rather than the main processor 121) can control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 can, together with the main processor 121, control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123. According to embodiments, the auxiliary processor 123 (e.g., a neural processing unit) may include hardware architecture dedicated to artificial intelligence model processing. Artificial intelligence models can be generated through machine learning. For example, such learning can be performed via electronic device 101 where artificial intelligence is performed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple layers of artificial neural networks. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include software structures in addition to hardware structures.

[0040] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0041] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0042] The input module 150 can receive commands or data from outside the electronic device 101 (e.g., a user) that will be used by other components of the electronic device 101 (e.g., processor 120). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (e.g., buttons), or digital pen (e.g., stylus).

[0043] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. According to an embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0044] Display module 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display module 160 may include a touch sensor adapted to detect touch or a pressure sensor adapted to measure the intensity of the force caused by touch.

[0045] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input module 150, or output sound via the sound output module 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0046] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0047] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0048] Connection 178 may include a connector, through which electronic device 101 may be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] The haptic module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to embodiments, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0050] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0051] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0052] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable accumulator, or a fuel cell.

[0053] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 uses user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196 to identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199).

[0054] Wireless communication module 192 can support 5G networks following 4G networks and next-generation communication technologies (e.g., new radio (NR) access technologies). NR access technologies can support enhanced mobile broadband (eMBB), massive machine-type communication (mMTC), or ultra-reliable low-latency communication (URLLC). Wireless communication module 192 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 192 can support various technologies used to ensure the performance of high-frequency bands, such as, for example, beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 192 can support various requirements specified in electronic device 101, external electronic devices (e.g., electronic device 104), or network systems (e.g., second network 199). According to an embodiment, the wireless communication module 192 may support peak data rates (e.g., 20 Gbps or greater) for implementing eMBB, lost coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip) for implementing URLLC.

[0055] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.

[0056] According to various embodiments, antenna module 197 may form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and multiple antennas (e.g., an array antenna), wherein the RFIC is disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and is capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the multiple antennas are disposed on or adjacent to a second surface (e.g., a top or side surface) of the printed circuit board and are capable of transmitting or receiving signals of the specified high-frequency band.

[0057] At least some of the aforementioned components can be interconnected via a peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)) and can communicatively transmit signals (e.g., commands or data) between them.

[0058] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 or electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations to be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform the requested at least portion of the function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, with or without further processing of the result. For this purpose, technologies such as cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing may be used. Electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and / or neural networks. According to embodiments, external electronic device 104 or server 108 may be included in a second network 199. Electronic device 101 can be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology or IoT-related technologies.

[0059] The electronic devices according to the embodiments disclosed in this document can be implemented in various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. The electronic devices according to the embodiments of this document are not limited to the devices described above.

[0060] In the following text, the term "state" may refer to the form or shape of an electronic device or its components (e.g., a display, a foldable housing structure) according to embodiments of the present disclosure.

[0061] Figures 2a to 2dThe structure of a foldable electronic device according to an embodiment is shown.

[0062] Reference Figures 2a to 2d Electronic devices according to embodiments (e.g., Figure 1 The electronic device 101 can be implemented as a multi-foldable electronic device (e.g., a Z-shaped foldable device) with a housing structure including an outward folding mode and an inward folding mode. Figures 2a to 2d The electronic device 101 shown may include Figure 1 The structure and function of the electronic device 101.

[0063] The electronic device 101 according to an embodiment may include a first housing 210, a second housing 220, a third housing 230, a first hinge assembly 240, and a second hinge assembly 250. The first hinge assembly 240 may be configured to couple the first housing 210 and the second housing 220, and allow the first housing 210 to rotate relative to the second housing 220. The second hinge assembly 250 may be configured to couple the second housing 220 and the third housing 230, and allow the third housing 230 to rotate relative to the second housing 220. For example, the first hinge assembly 240 may be implemented to couple the first housing 210 and the second housing 220 in an outward folding manner, and the second hinge assembly 250 may be implemented to couple the second housing 220 and the third housing 230 in an inward folding manner.

[0064] According to an embodiment, the electronic device 101 may include a display 260 disposed within a space formed by a first housing 210, a second housing 220, and a third housing 230. The display 260 may be configured to extend from the first housing 210 to the first hinge assembly 240, the second housing 220, the second hinge assembly 250, and the third housing 230. For example, in this document, a first surface on which the display 260 is disposed may be defined as a front surface, and a second surface opposite the first surface on which the display 260 is not disposed may be defined as a rear surface. Furthermore, a third surface surrounding the space between the first and second surfaces may be defined as a side surface of the electronic device 101.

[0065] The display 260 can be at least partially flexible and can be implemented as a flexible display.

[0066] For example, the display 260 may include a first display area 261 located in the first housing 210, a second display area 262 located in the second housing 220, and a third display area 263 located in the third housing 230.

[0067] In another example, display 260 may be implemented as a first display located in a first housing 210 and a second display located from a second housing 220 to a second hinge assembly 250 and a third housing 230.

[0068] As another example, the display 260 can be implemented as a first display located in a first housing 210, a second display located in a second housing 220, and a third display located in a third housing 230.

[0069] The first hinge assembly 240 can be implemented in an outward folding manner, wherein the first housing 210 and the second housing 220 are folded around the first folding axis A, such that the first display area 261 and the second display area 262 face opposite directions. The second hinge assembly 250 can be implemented in an inward folding manner, wherein the second housing 220 and the third housing 230 are folded around the second folding axis B, such that the second display area 262 and the third display area 263 face each other.

[0070] Figure 2a The structure can be in an intermediate state during the process in which the housings 210, 220 and 230 of the electronic device 101 are all switched from the folded state to the unfolded state.

[0071] Figure 2b The structure can be in a state where the housings 210, 220, and 230 of the electronic device 101 are fully extended. Figure 2b In the structure, the display areas 261, 262, and 263 of the display 260 can be in the first direction. (Or, in the top direction) it is completely exposed to the outside. In this article, the first direction... It can refer to the direction from which the user views the monitor, the second direction. (Or bottom direction) can refer to the first direction The opposite direction.

[0072] like Figure 2a As shown in 2b, when all of the housings 210, 220 and 230 of the electronic device 101 are in an intermediate state or in an unfolded state, the active areas can be defined as the first display area 261, the second display area 262 and the third display area 263.

[0073] Figure 2c The structure can be in a state where the second shell 220 and the third shell 230 are unfolded and the first shell 210 is folded outward relative to the second shell 220. When Figure 2b Structure switch Figure 2c In the structure, the first display area 261 can be viewed from the first direction. Switch to the second direction Furthermore, the second display area 262 and the third display area 263 can be in the first direction. The upper part is exposed to the outside. For example... Figure 2cAs shown, when the first housing 210 is in an outward folded state relative to the second housing 220 and the third housing 230 is in an intermediate state or an unfolded state relative to the second housing 220, the active areas can be defined as the second display area 262 and the third display area 263, and the first display area 261 can be switched to a deactivated state (e.g., by stopping power supply to the first display area 261 in a screen off state, dimming state, power saving state, or touch detection blocking state).

[0074] Figure 2d The structure allows the housings 210, 220, and 230 of the electronic device 101 to be fully folded. Figure 2d In the structure, the first display area 261 can be in the first direction The upper part is exposed to the outside, and the second display area 262 and the third display area 263 can face each other without being exposed to the outside. Figure 2d In the structure, the first display area 261 can be determined as the active area, and the second display area 262 and the third display area 263 can be switched to a deactivated state (e.g., by stopping the power supply to the second display area 262 and the third display area 263 in a screen off state, dimming state, power saving state, sleep mode or touch detection blocking state).

[0075] Figure 3 This is a block diagram illustrating an electronic device according to an embodiment.

[0076] Reference Figure 3 Electronic devices according to embodiments (e.g., Figure 1 Electronic device 101 Figures 2a to 2d The electronic device 101 is a portable electronic device and may have the housing structure of the multiple foldable electronic devices shown in Figure 2. Figure 3 The electronic device 101 shown may include Figure 1 At least some of the construction and functions of the electronic device 101.

[0077] For example, electronic device 101 may include display 310, display controller 315, frame buffer 317, processor (e.g., central processing unit (CPU)) 320, memory 330, communication interface 340, input device 350 and sensing device 360.

[0078] The display 310, processor 320 (e.g., CPU), memory 330, communication interface 340, input device 350, sensing device 360, another electronic device 104, and server device 108 are respectively connected to... Figure 1The display module 160, processor 120, memory 130, communication module 190, input module 150, sensor module 176, another electronic device 104, and server device 108 are implemented in essentially the same way, enabling them to perform the same functions; therefore, redundant descriptions of their functions will be omitted, and in the following descriptions, only those functions will be used. Figure 1 Operations beyond the publicly disclosed structure and functions. Figure 3 or Figure 1 The components shown can send and receive (or communicate, exchange) data with each other via system bus 370.

[0079] The display controller 315 (e.g., a display driver IC (DDI)) controls the display 310 and can receive, for example, video information (e.g., video data or video control signals corresponding to commands for controlling the video data) from another component of the electronic device 101. For example, this information can be received from a central processing unit or processor 320 (e.g., Figure 1 The main processor or application processor) or auxiliary processor (e.g., Figure 1 An auxiliary processor 123 (e.g., a graphics processor) receives video information. The display controller 315 can communicate with the sensing device 360 ​​via a system bus 370. The display controller 315 can, for example, store at least a portion of the video information in a frame buffer 317 or a memory 330 in units of frames.

[0080] The display controller 315 can control the display to output visual information to the display based on video information. The visual information may include graphics, text, icons, videos, images, and combinations thereof.

[0081] According to an embodiment, electronic device 101 can control the driving of display 310 through multiple display controllers (e.g., display driver ICs (DDIs)). For example, when display 310 is implemented as a first display and a second display, electronic device 101 can control the first display through a first DDI and control the second display through a second DDI. As another example, when display 310 includes a first display area 261, a second display area 262, and a third display area 263, such as... Figures 2a to 2d As shown, the electronic device 101 can be implemented to control the first display area 261 via a first DDI, and to control the second display area 262 and the third display area 263 via a second DDI.

[0082] The sensing device 360 ​​may include methods for generating determinations. Figures 2a to 2dSensors are used to obtain data on the folding / unfolding angles between the housings 210, 220, and 230 shown, the state of the electronic devices (or the state of the housing structure), and information on the movement of the electronic devices (e.g., orientation, posture, or position). For example, sensing devices may include a time-of-flight (TOF) sensor 361, a folding sensor 362, a light sensor 363, a Hall sensor 364, a motion sensor 365, and a touchscreen panel (TSP) sensor 366; however, these are merely examples, and some may be omitted, or other sensors may be included besides those shown for determining the state of the electronic devices (or the state of the housing structure) or the movement of the electronic devices 101.

[0083] According to an embodiment, the sensing device 360 ​​may use the Hall sensor 364 and / or the folding sensor 362 to sense the angle (e.g., the folding angle) between the housings 210, 220 and 230, and deliver the sensed angle information to the processor 320.

[0084] According to an embodiment, the folding sensor 362 can calculate the angles of the housings 210, 220, and 230. For example, in the electronic device 101, it is implemented as... Figures 2a to 2d In the case of the multiple foldable housing structures 210, 220, and 230, the folding sensor 362 can use data representing the movement of the first housing 210, the second housing 220, or the third housing 230 to calculate the angle between the housings. The folding sensor 362 can receive data corresponding to the magnetic field strength from the Hall sensor 364 attached to the hinge assembly and use the received data to calculate the angle.

[0085] The folding sensor 362 can identify the structural state or housing structure state of the electronic device 101 (e.g., unfolded state, folded state, or intermediate state) based on a calculated angle. For example, the folding sensor 362 can determine the electronic device (or housing structure) state as folded when the calculated angle is between approximately 0 degrees and approximately 10 degrees, and as unfolded when the calculated angle is approximately 180 degrees. When the angle is between approximately 10 degrees and approximately 179 degrees, the folding sensor 362 can determine the electronic device (or housing structure) state as intermediate.

[0086] According to an embodiment, the Hall sensor 364 can generate data for calculating the direction of force applied to the housing structure and / or the angle between the housing structures, or for determining whether the housing structure is open or closed, and output the data to the folding sensor 362 or the processor 320. For example, the Hall sensor 364 can measure the strength of a magnetic field and generate data corresponding to the measured magnetic field strength. The Hall sensor 364 can be attached to a hinge assembly or disposed within the internal space of the housing.

[0087] For example, in the electronic device 101, it is implemented as Figures 2a to 2d In the case of the multiple foldable housing structures 210, 220, and 230, the Hall sensor 364 may include a first Hall sensor attached to the first hinge assembly 240 and a second Hall sensor attached to the second hinge assembly 250. The processor 320 may determine the angle between the housings based on data received from the Hall sensor 364. The processor 320 may determine whether the foldable housing structure is open or closed and its state based on the determined angle.

[0088] The memory 330 can store various instructions that can be executed by the processor 320. Such instructions may include arithmetic and logical operations, data movement or control commands, such as inputs / outputs that can be recognized by the processor 320.

[0089] The processor 320 may be operatively, functionally and / or electrically connected to each component of the electronic device 101, and may be a component capable of performing computational or data processing in relation to the control and / or communication of each component.

[0090] In an embodiment, the operative connection of the hardware of electronic device 101 may mean establishing a wired or wireless direct or indirect connection between hardware components, such that the second hardware is controlled by the first hardware therein.

[0091] There are no restrictions on the computing and data processing functions that the processor 320 can implement on the electronic device 101, but the following will describe the operation of providing various screen extension scenarios depending on the change of the electronic device structure state or the housing structure in the foldable electronic device.

[0092] The operation of processor 320, which will be described later, can be performed by loading instructions stored in memory 330.

[0093] The electronic device 101 according to the embodiment may include a second housing 220, a first housing 210 foldably coupled to one side of the second housing 220, and a third housing 230 foldably coupled to the other side of the second housing 220.

[0094] The electronic device 101 according to the embodiment may include displays 260 and 310, which include a first display area 261 disposed in a first housing 210, a second display area 262 disposed in a second housing 220, and a third display area 263 disposed in a third housing 230.

[0095] The electronic device 101 according to the embodiment may include a sensing device 360 ​​for detecting the folded or unfolded state of the first housing 210, the second housing 220 and the third housing 230.

[0096] The electronic device 101 according to the embodiment may include memories 130 and 330 for storing executable instructions and processors 120 and 320 for accessing memories 130 and 330 and executing instructions.

[0097] According to an embodiment, processors 120 and 320 can be configured to display a first operating screen on a display using a first display area in a first state in which the first housing 210, the second housing 220 and the third housing 230 are folded relative to each other.

[0098] According to an embodiment, when the first operating screen is displayed through the first display area 261 in the first state, if the processors 120 and 320 identify, based on data received from the sensing device 360, that the first state has switched to a second state in which the first housing 210 and the second housing 220 are folded and the second housing 220 and the third housing 230 are unfolded, the processors 120 and 320 can be configured to deactivate the first display area 261 and display the second operating screen on the display through the second display area 262 and the third display area 263.

[0099] According to an embodiment, when the first operating screen is displayed in the first display area 261 in the first state, if the processors 120 and 320 identify, based on data received from the sensing device 360, that the first state has switched to the third state in which the first housing 210, the second housing 220, and the third housing 230 are all extended, the processors 120 and 320 can be configured to display the first operating screen on the display by extending the first operating screen from the first display area 261 to the second display area 262 and the third display area 263.

[0100] The second running screen can be characterized as a screen different from the first running screen.

[0101] The electronic device 101 according to the embodiment may further include a first hinge assembly 240 and a second hinge assembly 250, wherein the first hinge assembly 240 is configured such that the first housing 210 is folded relative to the second housing 220 in a first direction, and the second hinge assembly 250 is configured such that the third housing is folded relative to the second housing in a second direction opposite to the first direction.

[0102] According to an embodiment, the first hinge assembly 240 can be implemented such that when the first housing 210 and the second housing 220 are folded in an outward folding manner, the first display area and the second display area are opposite to each other, and the second hinge assembly 250 can be implemented such that when the second housing 220 and the third housing 230 are folded in an inward folding manner, the second display area and the third display area face each other.

[0103] According to an embodiment, displays 260 and 310 may include a first display and a second display. The first display includes a first display area 261 disposed in a first housing 210, and the second display includes a second display area 262 disposed in a second housing 220 and a third display area 263 disposed in a third housing 230.

[0104] According to an embodiment, displays 260 and 310 may include: a first display including a first display area 261 disposed in a first housing 210; a second display including a second display area 262 disposed in a second housing 220; and a third display including a third display area 263 disposed in a third housing 230.

[0105] According to an embodiment, the first state may be a state in which the first display area 261 is exposed to the outside in a first direction, and the second state may be a state in which the first display area switches in a second direction opposite to the first direction and the second display area 262 and the third display area 263 are exposed to the outside in the first direction.

[0106] According to an embodiment, as an operation of deactivating the first display area 261 and displaying the second operating screen through the second display area 262 and the third display area 263, the processors 120 and 320 can also be configured to display a preview window corresponding to the first operating screen displayed through the first display area 261 on at least a portion of the second display area 262 and the third display area 263 in a first state.

[0107] According to an embodiment, processors 120 and 320 can be configured to display a preview window corresponding to the first running screen in the form of a notification status window (notification bar or panel) or a picture-in-picture (PIP) pop-up window.

[0108] According to an embodiment, when processors 120 and 320 deactivate the first display area 261 and display the second operating screen through the second display area 262 and the third display area 263 in the second state, and when it is identified based on data received from the sensing device that the second state has switched to the third state in which the housing is fully extended, processors 120 and 320 can be configured to display the first operating screen through the first display area 261 and the second operating screen through the second display area 262 and the third display area 263.

[0109] According to an embodiment, processors 120 and 320 may be configured to group according to the state of the electronic device and store information about applications (or applications, hereinafter referred to as Apps) running in a first state, information about applications running in a second state, and information about applications running in a third state.

[0110] According to an embodiment, as an operation of displaying a first running screen on a first display area 261 and a second running screen on a second display area 262 and a third display area 263, processors 120 and 320 may also be configured to: display the main screen or a list of recent tasks as the first running screen while maintaining the second running screen, in the case that there is no application associated with the first display area 261 and the application associated with the second running screen is initialized or restarted when the resolution changes.

[0111] According to an embodiment, as an operation of displaying a first running screen on a first display area 261 and a second running screen on a second display area 262 and a third display area 263 in a third state, processors 120 and 320 may also be configured to: omit the display of the first running screen when there is no application associated with the first display area 261 and the application associated with the second running screen is not initialized or restarted when the resolution changes, and adjust the size of the second running screen to the size corresponding to the first display area 261, the second display area 262 and the third display area 263 and display the second running screen.

[0112] According to an embodiment, the main screen or recent task list displayed on the first display area can be configured to display at least one of a first type indicator or a second type indicator overlapping the application object. The first type indicator guides the operational electronic device status of each application object, and the second type indicator guides whether the application can be restarted or initialized when switched from the background to the foreground.

[0113] According to an embodiment, processors 120 and 320 can be configured to display applications running in a grouped manner when a list of recent tasks is displayed on a display, in a manner different from the currently identified electronic device state.

[0114] According to an embodiment, processors 120 and 320 may be configured to reconstruct the widget screen or recent app search screen using information about the applications running in the currently identified electronic device state or housing structure state when the widget screen or recent app search screen is displayed on the display, and to display the reconstructed widget screen or recent app search screen on the display.

[0115] Figure 4 This is a diagram illustrating the module configuration of an electronic device according to an embodiment.

[0116] refer to Figure 4 Electronic devices according to embodiments (e.g., Figure 1 , Figures 2a to 2d and Figure 3 The electronic device 101 can be composed of various software modules. Figure 4 The configuration of the electronic device 101 shown can be understood as being powered by a processor (e.g., Figure 1 Processor 120 or Figure 3 The functions performed by the processor 120 (or CPU). The processor 120 can run functions stored in memory (e.g., ...). Figure 1 Memory 130, Figure 3 Instructions in memory 330 are used to implement software modules and control hardware associated with functions (e.g., memory 330). Figure 1 (Communication module 180).

[0117] Figure 4 Some of the modules in the model can be implemented in hardware, while others can be implemented in software. Modules can be categorized into application layer, framework layer, hardware abstraction layer (HAL), kernel driver layer, and / or hardware (HW) layer, and at least some of the components shown can be modified.

[0118] Electronic device 101 may include at least one of the following: application 410, settings manager 415, window manager 420, view system 421, package manager 423, fold status manager 425, sensor manager 426, display manager 427, activity manager 428, event center 430, surface flinger 435, sensor driver 440, or display controller 445 (e.g., display driver IC controller). Electronic device 101 may also include a sensor controller 450 and a display panel 455 in the hardware layer.

[0119] Application 410 may be an application 210 (e.g., app1, app2, app3) stored in the memory of electronic device 101 or that can be run or installed by a processor. Visual information corresponding to application 210 may be displayed on a display via viewing system 421.

[0120] The Settings Manager 415 can determine the layout configuration of the running screen based on system policies and user settings.

[0121] The framework layer can provide various functions to application 210, enabling application 410 to use functions or information provided from one or more resources of the electronic device.

[0122] Window manager 420 can manage graphical user interface (GUI) resources used on the screen. Window manager 420 can construct windows or operating screens to be displayed on display panel 455 based on the electronic device state (or housing structure state) delivered from collapse state manager 425, and provides functions to control the drawing and viewing of windows. Window manager 420 can deliver information about the display area of ​​electronic device 101 to application 410.

[0123] View system 421 may include a set of scalable views for creating an application user interface. For example, view system 421 may be a program for drawing at least one layer based on the resolution of the display area of ​​the monitor.

[0124] Package Manager 423 can manage the installation of application packages, or more simply, manage the installation of applications.

[0125] The folded state manager 425 can analyze sensor events delivered through the sensor manager to determine the electronic device state (or housing structure state) and deliver the electronic device structure state information to the window manager 420. The folded state manager 425 can control the application state based on the electronic device structure state.

[0126] Sensor manager 426 can control the sensors based on the configuration of application 410. For example, in the event of user touch input, sensor manager 426 can control the touch sensors to generate touch data. For example, sensor manager 426 can instruct the sensors to generate touch data corresponding to touch press (touch press, touch down, touch contact) signals, touch drag (touch drag or touch move) signals, and / or touch release (touch up, touch release) signals in response to user touch.

[0127] Display manager 427 can determine whether to activate or deactivate the display, manage the visual information displayed on the display, and define the running screen (or window) to be viewed by the user based on information delivered from the view system (e.g., as a frame-level component, it may be referred to as a logical display).

[0128] Activity Manager 428 can control the lifecycle and activity stack of application 410.

[0129] Event center 430 can be an interface module that standardizes events occurring in touch circuitry and sensors. Event center 430 can be included in the hardware abstraction layer (HAL) between multiple hardware modules and software included in the hardware layer of electronic device 101.

[0130] Surface projector 435 can composite multiple layers and store the composite information in a frame buffer. For example, surface projector 435 can provide data representing the composited multiple layers to display controller 445 (e.g., DDI). Display controller 445 may refer to a graphics display controller or a display driver circuit controller.

[0131] The kernel layer may include various drivers for controlling various hardware modules included in the electronic device 101. For example, the kernel layer may include, but is not limited to, a sensor driver 440 for controlling a sensor controller 450 connected to a sensor, and a display controller 445 for controlling a display panel 455.

[0132] The sensor driver 440 can connect to an operating system and a sensor, and includes information about the sensor's driving method, characteristics, and / or functions. The sensor driver 440 may include an interface module that controls a sensor controller 450 connected to the sensor.

[0133] The display controller 445 can receive data representing multiple layers synthesized by the surface projector 435. The display controller 445 can control the display panel 455 based on data stored in the frame buffer. Graphical information can be displayed via the display panel 455.

[0134] Figure 5 This is a diagram illustrating the operation of a foldable electronic device according to an embodiment, operating in different screen extension scenarios based on outward folding and inward folding modes. In the following figures, the housing in which the first display area 261 is provided can be understood as... Figures 2a to 2d The first housing 210, wherein the housing having the second display area 262 can be understood as the second housing 220, and the housing having the third display area 263 can be understood as the third housing 230.

[0135] Reference Figure 5 According to an embodiment, the electronic device 101 can support the function of applying different screen extension sequences according to the unfolding order or state change order of the multi-shell structure.

[0136] like <501> As shown, the electronic device can switch from a first state in which the housings 210, 220, and 230 are all folded to a second state. <503> The second state, then switch to <505> The third state, or you can directly switch from the first state. <507> The third state.

[0137] In the first state, the electronic device 101 can define the first display area 261, located in the first housing 210, as the active area and display the first operating screen 510 on the first display area 261. The electronic device 101 can render the first operating screen 510 to a size corresponding to the first display area (hereinafter, the first size or the first resolution). In the first state, the second display area 262 and the third display area 263 can be deactivated (e.g., through a screen-off state with power off, a dimming state, a power-saving state, or a sleep mode).

[0138] In some cases, when the electronic device 101 is in the first state, the first display area can also operate in its deactivated sleep mode.

[0139] As a first screen operation method, electronic device 101 can be accessed via... <502> intermediate state from <501> The first state changes to <503> The second state. Electronic device 101 can be based on from <503> Sensing devices (e.g., Figure 1 Sensor module 176 Figure 3 The sensing device 360 ​​receives data to identify a change (or switch) from a first state to a second state. Based on the data received... <503> Upon recognizing the second state, the electronic device 101 can switch the first display area 261 to disabled and determine the second display area 262 and the third display area 263 as active areas. In this second state, the electronic device 101 can display the second operating screen 520 on the second display area 262 and the third display area 263.

[0140] The second running screen 520 may refer to a screen defined by a different layer / window than the first running screen 510. The second running screen 520 may be rendered according to the size (hereinafter, the second size or the second resolution) corresponding to the second display area and the third display area.

[0141] In change to <503> After the second state, the electronic device can... <504> The intermediate state changes to <505> The electronic device 101 can identify that the second state has changed to the third state based on data received from the sensing device, determine the first display area 261 as the active area based on the identification of the third state, and control it to display the first operating screen 510 on the first display area 261, and display the second operating screen 520 on the second display area 262 and the third display area 263.

[0142] As a second screen operation method, electronic device 101 can be accessed via... <506> intermediate state from <501> The first state changed to <507> The third state. Electronic device 101 can identify the change from the first state to the third state based on data received from the sensing device. Based on data received from... <501> Upon transition from the first state to the third state, the electronic device 101 can define the second display area 262 and the third display area 263 as active areas, and display a third-size (or third-resolution) first operating screen 510-1 by expanding the size of the first operating screen 510 to fit the sizes of the first display area 261, the second display area 262, and the third display area 263. The electronic device 101 can render the first operating screen 510-1 according to the third size or the third resolution.

[0143] Figure 6 This is a flowchart illustrating a method for operating the screen of a foldable electronic device according to an embodiment. Figures 7a to 7c An example screen is shown illustrating the sequence in which an electronic device changes from a first state to a second state and from the second state to a third state, according to an embodiment. Figure 8 An example screen shows the sequence in which the electronic device changes from a first state to a third state. Figures 7a to 7c In the middle, first direction This can refer to the direction in which the user views the monitor, and the second direction ( (Or bottom direction) can refer to the first direction The opposite direction.

[0144] In the following embodiments, each operation may be performed sequentially, but not necessarily sequentially. For example, the order of each operation can be changed, and at least two operations can be performed in parallel.

[0145] Reference Figure 6 In operation 610, the processor of the electronic device 101 according to the embodiment (e.g., Figure 1 120 Figure 3 (320) can be based on sensing devices (e.g., Figure 1 Sensor module 176 Figure 3 The sensor 360 receives data to identify a first state in which the housings 210, 220 and 230 of the electronic device 101 are all folded.

[0146] In operation 620, the processor 120 may be identified as having a first state based on the state of the electronic device 101 or the state of the housing structure, and display a first operating screen 710 on the first display area 261.

[0147] For example, such as <701> As shown, the first state can be a state in which the first housing 210 and the second housing 220 are folded outwards and the second housing 220 and the third housing 230 are folded inwards. In the first state, the first display area 261 can be in a first direction (e.g., Figure 2d of The second display area 262 and the third display area 263 are exposed on the surface, and can be positioned to face each other due to the inward folding operation of the second housing 220 and the third housing 230.

[0148] The processor 120 can calculate, based on data received from the sensing device, the angle between the first housing 210 in which the first display area 261 is located and the second housing 220 in which the second display area 262 is located (hereinafter referred to as the "first angle"), and the angle between the second housing in which the second display area is located and the third housing in which the third display area is located (hereinafter referred to as the "second angle"). The processor 120 can identify the state of the electronic device 101 or the state of the housing structure based on at least one of the first angle or the second angle.

[0149] The processor 120 can determine the first display area 261 as an active area based on the recognition of the first state, and disable the second display area 262 and the third display area 263 (e.g., by stopping the power supply to the second display area 262 and the third display area 263 of the display in a screen off state, dimming state, power saving state or touch detection blocking state).

[0150] For example, the first operating screen 710 is a screen defined according to a first size (or first resolution) of the first display area 261, and may be, for example, a main screen or application operating screen according to the configuration of the electronic device. For example, the first operating screen 710 may have a first size.

[0151] In an embodiment, when the electronic device 101 is in a first state, the first running screen 710 may be provided as the running screen of the most recently used application in the foreground, but is not limited thereto.

[0152] According to an embodiment, in Figure 7a In this embodiment, at least a portion of a display is defined as a first display area. However, in some cases, the first display area 261 can be implemented as a first display, and the second display area 262 and the third display area 263 can be implemented as second displays. When the electronic device 101 includes both a first and a second display, when the electronic device 101 is in a first state, the first display can be activated, and the second display can be deactivated (e.g., by stopping power supply to the second display in a screen-off state or sleep mode), thereby deactivating the second display area 262 and the third display area 263.

[0153] In operation 630, processor 120 can determine structural changes of electronic device 101 (or changes in the state of electronic device, changes in the state of display, changes in the structure of housing).

[0154] For example, electronic device 101 can be classified into cases where the state of electronic device 101 or the state of its housing structure changes from a first state to a second state and cases where the state of electronic device 101 or the state of its housing structure changes from a first state to a third state.

[0155] In operation 640, processor 120 can recognize that the structure of electronic device 101 or housing changes from a first state to a second state.

[0156] For example, such as <702> As shown, the processor 120 can identify that the first state has changed to the second state based on the fact that the first angle is maintained at about 0 degrees to about 10 degrees while the second angle changes to a threshold angle value (e.g., about 170 degrees) or greater (or the second housing 220 and the third housing 230 change to an unfolded state while the first housing 210 and the second housing 220 are kept in an outward folded state).

[0157] In operation 650, the processor 120 may, based on the recognition of a second state, deactivate the first display area 261 (e.g., by stopping power supply to at least a portion of the display in a screen-off state, dimming state, power-saving state, or touch detection blocking state), and determine the second display area 262 and the third display area 263 as active areas. The processor 120 may then display a second operating screen 720 on the second display area 262 and the third display area 263, which have been determined to be active areas.

[0158] <702> First direction The orientation of the second operating screen 720 can be the orientation in which the user views the electronic device, and the second orientation... It can be in the first direction The opposite direction can be the bottom of the electronic device, which the user cannot see.

[0159] The second running screen 720 may refer to a screen defined by a different layer / window than the first running screen 710. The second running screen 720 may be a main screen or an application running screen. The second running screen 720 may have a second size or a second resolution, including a second display area 262 and a third display area 263.

[0160] In an embodiment, when the electronic device 101 is in the second state, the second running screen 720 may be provided as the running screen of the most recently used application in the foreground, but is not limited thereto.

[0161] Because its setting location is from <701> The first direction in Switch to <702> The second direction in The first display area 261 is deactivated, thus preventing entry into dimming mode and touch detection, and applications associated with the first running screen 710 can run in the background without being paused.

[0162] According to an embodiment, when the electronic device is in the second state, the electronic device 101 can support the function of providing a first operating screen as a preview window. The preview window can be provided as part of a notification status window (notification bar or panel), but it can also be provided as a picture-in-picture (PIP) pop-up. For example, as... Figure 7b of <703> As shown, the electronic device 101 can be operated by displaying the second operating screen 720 on the second display area 262 and the third display area 263.

[0163] Electronic device 101 can operate the second running screen 720 in a second state, and based on received input requesting the display of the first running screen (e.g., input requesting the display of a notification status window (notification bar or panel) or input dragging from the top to the bottom of the display), invoke the notification status window 730 by overlaying it on the second running screen 720. Electronic device 101 can provide the first running screen 710 as a preview window on the notification status window 730. Electronic device 101 can use the first running screen 710 provided as a preview window to control the application running through the first running screen.

[0164] According to an embodiment, the electronic device 101 can be configured to maintain the task of an application running on the first running screen 710 displayed on the first display area 261 for a pre-configured time period after the first display area is deactivated in the second state, and then terminate the task.

[0165] According to some embodiments, when the electronic device 101 recognizes a change from the second state back to the first state, when the display area exposed in the first direction changes from the second display area 262 and the third display area 263 back to the first display area 261, the electronic device can determine the active area as the first display area 261 and deactivate the second display area 262 and the third display area 263.

[0166] In operation 660, processor 120 can recognize that the structure of electronic device 101 or housing changes from a second state to a third state.

[0167] For example, processor 120 can identify that the second state has switched to the third state based on the fact that while maintaining a second angle threshold angle value (e.g., about 170 degrees) or greater, the first angle changes to a threshold angle value (e.g., about 170 degrees) or greater (or the second housing 220 and the third housing 230 are identified as being in the deployed state, and then the first housing 210 and the second housing 220 change to the deployed state). Figure 7c of <702> As shown, the processor 120 can identify, based on data received from the sensing device, that while the first housing 210 and the second housing 220 remain in an outward folded state, the second housing 220 and the third housing 230 have switched to an unfolded (or intermediate) state.

[0168] In operation 670, the processor 120 can determine the first display area 261 as the active area based on the recognition of the third state, display the first operating screen 710 on the first display area 261, and display the second operating screen 720 on the second display area 262 and the third display area 263.

[0169] like Figure 7c of <703> As shown, the processor 120 can display a first operating screen 710 of a first size on a first display area 261, and a second operating screen 720 of a second size on a second display area 262 and a third display area 263. The first operating screen 710 and the second operating screen 720 can operate independently of each other. The electronic device 101 can control not only the first operating screen 710 through the first display area 261, but also the second operating screen 720 through the second display area 262 and the third display area 263.

[0170] In operation 680, processor 120 may determine that it recognizes a change from a first state to a third state, rather than recognizing a second state. For example, processor 120 may recognize that both the first angle and the second angle change to a threshold angle value (e.g., about 170 degrees) or greater (or that the first housing 210, the second housing 220, and the third housing 230 all change to an unfolded state).

[0171] In operation 690, processor 120 may determine the first display area 261, the second display area 262, and the third display area 263 as active areas based on recognizing the change from the first state to the third state, and display the first operating screen 810 by expanding the first operating screen 810 to a third size according to the size of the second display area 262 and the third display area 263.

[0172] like Figure 8of <801> As shown, the processor 120 can display a first operating screen 810 of a first size on a first display area 261 in a first state in which the housings 210, 220, and 230 of the electronic device 101 are all folded. <802> As shown, the processor 120 can expand the first operating screen 810 to a third size (or third resolution) corresponding to all active areas (e.g., the first display area 261, the second display area 262, and the third display area 263) based on the change from the first state to the third state, and display the first operating screen 810-1 of the third size through the first display area 261, the second display area 262, and the third display area 263.

[0173] Figure 9 This is a screen example illustrating an extension of the screen of an operating electronic device according to an embodiment.

[0174] refer to Figure 9 When the electronic device 101 according to the embodiment changes from the first state to the third state or from the second state to the third state, if there is no application running through the first display area 261 (or there is no running history of the application through the first display area 261), the electronic device can provide different extended layout configurations of the screen according to the application resizing feature.

[0175] If there is a history of applications running through the first display area 261 before the first display area 261 is disabled, the first display area 261 can be disabled, or the first display area 261 can be disabled when the home screen is displayed or the screen is turned off.

[0176] According to an embodiment, the processor 120 can determine whether an application is running on the electronic device 101 through the first display area 261 (or determine whether the application's running history exists through the first display area).

[0177] According to an embodiment, when an application is running through the first display area 261, upon changing from the second state to the third state, the processor 120 can display a first running screen 710 on the first display area 261, and a second running screen 720 on the second display area 262 and the third display area 263, as shown below. Figure 7c As shown.

[0178] According to an embodiment, when the electronic device 101 changes from the second state to the third state, if no application is running through the first display area 261, the processor 120 can identify through the second running screen 920 whether the running application has a resizing feature or a feature that requires a restart when the screen resolution changes.

[0179] For example, in cases where no application is running through the first display area 261 and an application running when the resolution is changed through the second running screen 920 is restarted, such as <901> As shown, the processor 120 can display a second running screen 920 of a second size through the second display area 262 and the third display area 263, and display the home screen or recent task list screen as a first running screen 910 on the first display area 261. In the case of the second running screen 920, by maintaining the current size / resolution (e.g., second size / second resolution), the processor 120 can restart the running application without using the second running screen 920.

[0180] In this case, the home screen or recent tasks list screen may include application objects (e.g., application icons) 930 corresponding to applications that can run on the electronic device.

[0181] The electronic device may include indicators 940 and 941, which guide the operational electronic device state / casing structure state of each application object, or guide the application to be restarted to form the home screen or recent tasks list screen. Indicators 940 and 941 may be displayed to overlap at least a portion of the application object. For example, indicators 940 and 941 may be implemented in a shape or form that guides information about the electronic device state / casing structure state of the last executed application and information about the application being restarted when the corresponding application's task was started, but this is only an example. Users can easily select the application object appropriate to the current electronic device state or casing structure state using the indicators included in the home screen or recent tasks list screen.

[0182] For example, such as <902> As shown, if no application is running through the first display area and the application running through the second display screen 925 does not restart when the resolution changes, the processor 120 can adjust the size of the second display screen 925 from the second size to the third size and display it. The processor 120 can render the second display screen 925 of the second size to the third size (or third resolution) corresponding to all display areas 261, 262, and 263, and display the rendered third-size second display screen 925-1 through the first display area 261, the second display area 262, and the third display area 263.

[0183] Figure 10a and Figure 10b An example screen showing how application information is grouped and provided according to the state of the electronic device, according to an embodiment, is illustrated.

[0184] refer to Figure 10a and Figure 10b According to the embodiment, the electronic device 101 can be grouped by electronic device state or housing structure state, and stores information about applications running in a first state, information about applications running in a second state, and information about applications running in a third state, and provides information about applications grouped by state through various screens.

[0185] For example, when a running application switches from the foreground to the background, electronic device 101 can stop the application's operation and store (or capture) the last running screen (or the display data included in the running screen) as a running screen image. Electronic device 101 can record or store the electronic device state or housing structure state at the time of application switching. The electronic device can include the stored running screen image in the recent tasks list.

[0186] According to an embodiment, when switching the active area of ​​the display based on changes in the state of the electronic device 101 or the state of the housing structure, the electronic device 101 can identify the state of the application running a task therein, and identify whether to restart (or rerun) the application running in an electronic device state different from the current electronic device state. For example, in the case of Android, whether to restart the application can be identified based on attribute values ​​such as "screenLayout", "screenSize", and "smallestScreenSize", but this is only an example and is not limited thereto.

[0187] According to an embodiment, electronic device 101 can display a recent task list of different sizes based on the electronic device state or the housing structure state, and intuitively guide the user through indicator information about the applications included in the recent task list that are running when the structure state is different from the current electronic device state.

[0188] In an embodiment, such as Figure 10aof <1001> As shown, electronic device 101 can display a recent task list 1010 of a first size in a first state. Electronic device 101 can support the function of displaying an indicator in the recent task list that guides application information running in a state other than the current state. For example, electronic device 101 can display a first indicator 1030 that guides application information in application object 1020 running in a third state different from the first state. <1001> Application objects 1020 that do not have an indicator in the recent task list 1010 may be applications with a history of running in the first state. Users can identify applications that can run immediately in the first state without restarting (e.g., application objects not displayed by an indicator) and applications that should run in the third state (e.g., application objects displayed by the first indicator 1030).

[0189] In an embodiment, electronic device 101 can display a recent task list 1013 of a second size (such as...) in a second state. <1002> ), or a third-size list of recent tasks (such as 1015) can be displayed in the third state. <1003> The electronic device 101 may display at least one of the following, depending on the current electronic device state or housing structure state: a second indicator 1031 guiding application information to run in the second state; a third indicator 1032 guiding application information to run in the first state; or a fourth indicator 1040 guiding application information to restart (or initialize) when switching from the background to the foreground. For example, when the electronic device 101 is in the second state, it may display an indicator in the recent tasks list indicating the first or third state to an application that has switched to the background in the first or third state; and when the electronic device 101 is in the third state, it may display an indicator indicating the first or second state to an application that has switched to the background in the first or second state. According to an embodiment, when the electronic device 101 selects... <1003> In the case of the application object of the fourth indicator 1040 shown, the electronic device 101 may display a user interface (UI) window (e.g., a pop-up window) (not shown) that guides the selected application to be restarted or its screen to be initialized when switched from the background to the foreground, and checks whether the user consents (e.g., agrees or disagrees). For example, when the user is in <1003> When an item is selected as agreed upon in the UI window of the recent task list 1015, the electronic device 101 can initialize the application running screen (or application) of the selected application and display the application running screen at a size corresponding to the current display state. When the user selects to reject an item in the user interface, the electronic device 101 can remove the UI window while maintaining the display of the recent task list 1015.

[0190] According to an embodiment, electronic device 101 can provide the function of recommending and displaying applications optimized for each state based on the state of the electronic device or the state of the housing structure, such as... Figure 10b As shown.

[0191] In an embodiment, electronic device 101 can group information about applications operating via electronic device status or housing structure status in a recent task list 1050, such as... <1004> As shown, grouping information is provided in the recent task list. For example, the first group 1051 displayed in the recent task list 1050 may include application objects running in a first state, the second group 1052 may include application objects running in a second state, and the third group 1053 may include application objects running in a third state.

[0192] In embodiments, electronic device 101 can group information about applications operating via electronic device state or housing structure state, and provide the grouped information in a quick run list 1060 (e.g., a border bar) provided in at least a portion of the display, such as... <1005> As shown. For example, the first group 1061 displayed in the quick run list 1060 may include application objects running in a first state, the second group 1062 may include application objects running in a second state, and the third group 1063 may include application objects running in a third state.

[0193] In an embodiment, electronic device 101 can select and provide applications included in the recently run application search screen 1070 as applications that match the current state of the electronic device or the state of its housing structure, such as... <1006> As shown.

[0194] In an embodiment, such as <1007> As shown, the electronic device 101 may also provide window widgets 1081, 1082 and 1083 of various sizes arranged on the window widget screen 1080, depending on the electronic device state or the housing structure state.

[0195] According to an embodiment, the electronic device may include: a first housing 210; a second housing 220; a third housing 230; a first hinge assembly 240 configured to couple the first housing 210 to one side of the second housing 220 and allow the first housing 210 to rotate; a second hinge assembly 250 configured to couple the third housing 230 to the other side of the second housing 220 and allow the third housing 230 to rotate; and displays 260 and 310, which include a first display area 261 disposed in the first housing 210, and a display area 261 disposed in the second housing 220 and which rotates when the first housing 210... The system includes: a second display area 262 facing the opposite direction to the first display area 261 when the second housing 220 and the third housing 230 are folded; a third display area 263 disposed in the third housing 230 and facing the second display area 262 when the second housing 220 and the third housing 230 are folded; a sensing device 360 ​​for detecting the folded or unfolded state of the first housing 210, the second housing 220 and the third housing 230; memories 130 and 330 for storing executable instructions; and processors 120 and 320 for accessing memories 130 and 330 and executing instructions.

[0196] According to an embodiment, processors 120 and 320 can use the first display area 261 to display a first operating screen in a first state in which the first housing 210, the second housing 220, and the third housing 230 are folded relative to each other. Furthermore, when the first operating screen is displayed via the first display area 261, if, based on data received from the sensing device 360, it is determined that the first state has switched to a second state in which the first hinge assembly 240 is in a fixed state and the second housing 220 and the third housing 230 are unfolded from the folded state by rotation of the second hinge assembly 250, processors 120 and 320 can deactivate the first display area 261 based on the switch from the first state to the second state. 61. The second operating screen is displayed through the second display area 262 and the third display area 263. When the first operating screen is displayed through the first display area 261, if the processor 120 and 320 identify, based on the data received from the sensing device, that the first state has been switched to the third state in which the first housing 210, the second housing 220 and the third housing 230 are fully extended by the rotation of the first hinge assembly 240 and the second hinge assembly 250, the processor 120 and 320 may control the display to show the first operating screen by extending the first operating screen from the first display area 261 to the second display area 262 and the third display area 263, based on the switch from the first state to the third state.

[0197] According to an embodiment, as an operation of deactivating the first display area 261 and displaying the second running screen through the second display area 262 and the third display area 263, the processors 120 and 320 may also be configured to display a preview window corresponding to the first running screen running through the deactivated first display area 261 on at least a portion of the second display area 262 and the third display area 263.

[0198] According to an embodiment, when processors 120 and 320 deactivate the first display area 261 and display the second operating screen through the second display area 262 and the third display area 263, if the second state is identified based on data received from the sensing device 360 ​​as having switched to the third state in which the housing is fully deployed, processors 120 and 320 can be configured to display the first operating screen on the first display area 261 and the second operating screen on the second display area 262 and the third display area 263 based on the switch from the second state to the third state.

[0199] According to an embodiment, as an operation of displaying a first running screen on a first display area 261 and a second running screen on a second display area 262 and a third display area 263, processors 120 and 320 may also be configured to: display the main screen or a list of recent tasks as the first running screen while maintaining the second running screen, in the case that no application is running through the first display area 261 and the application displayed on the second running screen is initialized or restarted when the resolution changes.

[0200] According to an embodiment, as an operation of displaying a first running screen on a first display area 261 and a second running screen on a second display area 262 and a third display area 263, processors 120 and 320 may also be configured to: omit the display of the first running screen when there is no application running through the first display area 261 and the application displayed on the second running screen does not restart when the resolution changes, and adjust the size of the second running screen and display it to a size corresponding to the first display area 261, the second display area 262 and the third display area 263.

[0201] According to an embodiment, processors 120 and 320 can be configured to group according to electronic device state or housing structure state, and store information about applications running in a first state, information about applications running in a second state, and information about applications running in a third state, and use information about applications running in the currently identified electronic device state or housing structure state to reconstruct and display the electronic device's widget screen, recent app search screen, or recent task list.

[0202] According to an embodiment, a method of operating the screen of a foldable electronic device may include: displaying a first operating screen on a display using a first display area 261 in a first state in which the first housing 210, the second housing 220 and the third housing 230 are folded relative to each other.

[0203] According to an embodiment, a method of operating the screen of a foldable electronic device may include: when a first operating screen is displayed through a first display area 261, if the electronic device identifies, based on data received from a sensing device 360, that a first state has been switched to a second state in which the first housing 210 and the second housing 220 are folded and the second housing 220 and the third housing 230 are unfolded, deactivating the first display area 261 based on the switch from the first state to the second state, and displaying the second operating screen on a display through a second display area 262 and a third display area 263.

[0204] According to an embodiment, a method of operating the screen of a foldable electronic device may include: when a first operating screen is displayed through a first display area 261, if the electronic device identifies, based on data received from a sensing device 360, that a first state has been switched to a third state in which the first housing 210, the second housing 220, and the third housing 230 are all unfolded, extending the first operating screen from the first display area 261 to the second display area 262 and the third display area 263 based on the switch from the first state to the third state to display the first operating screen on a display.

[0205] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish one component from another and do not limit the components in other respects (e.g., importance or order). It will be understood that, whether or not the terms “operably” or “communically” are used, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.

[0206] As used in connection with various embodiments of this disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms such as "logic," "logic block," "part," or "circuit." A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to embodiments, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0207] The various embodiments set forth herein can be implemented as software (e.g., program 140) including one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0208] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an app store (e.g., the Play Store™), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If distributed online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be stored at least temporarily in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0209] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may perform the one or more functions of each of the multiple components in the same or similar manner as one or more functions performed by a corresponding component of the multiple components prior to integration.

Claims

1. An electronic device comprising: Second shell; A first housing, which is foldably coupled to one side of a second housing; A third housing, which is foldably coupled to the other side of the second housing; The display includes a first display area disposed in a first housing, a second display area disposed in a second housing, and a third display area disposed in a third housing; A sensing device configured to detect the folded or unfolded state of the first housing, the second housing, and the third housing; Memory, configured to store executable instructions; and processor, When an instruction is executed by the processor, the instruction causes the electronic device to: In a first state where the first housing, second housing, and third housing are folded relative to each other, the control display shows the first operating screen through the first display area. When the first operating screen is displayed in the first display area in the first state, if the electronic device recognizes, based on data received from the sensing device, that the first state has switched to a second state in which the first and second housings are folded and the second and third housings are unfolded, it controls the display to deactivate the first display area and display the second operating screen through the second and third display areas. When the first operating screen is displayed in the first display area in the first state, if the electronic device recognizes, based on data received from the sensing device, that the first state has switched to the third state in which the first housing, second housing, and third housing are all fully deployed, the control display extends the first operating screen from the first display area to the second and third display areas to display the first operating screen. The second running screen is a different screen from the first running screen.

2. The electronic device of claim 1, further comprising a first hinge assembly and a second hinge assembly, the first hinge assembly being configured such that the first housing folds relative to the second housing in a first direction, and the second hinge assembly being configured such that the third housing folds relative to the second housing in a second direction opposite to the first direction. in, The first hinge assembly is configured to fold the first and second housings outwards, such that the first and second display areas are opposite to each other, and the second hinge assembly is configured to fold the second and third housings inwards, such that the second and third display areas face each other.

3. The electronic device according to claim 2, wherein, The display is implemented to include a first display and a second display, the first display including a first display area disposed in a first housing, and the second display including a second display area disposed in a second housing and a third display area disposed in a third housing.

4. The electronic device according to claim 2, wherein, The display is implemented to include: A first display includes a first display area disposed in a first housing; The second display includes a second display area disposed in the second housing; and The third display includes a third display area disposed in the third housing.

5. The electronic device according to claim 3 or 4, wherein, The first state is a state in which the first display area is exposed to the outside in the first direction, and The second state is a state in which the first display area switches in a second direction opposite to the first direction and the second and third display areas are exposed to the outside in the first direction.

6. The electronic device according to claim 5, wherein, The instructions cause the electronic device to: This is an operation that disables the first display area and displays the second running screen through the second and third display areas. In the first state, a preview window corresponding to the first running screen displayed through the first display area is displayed on at least a portion of the second and third display areas.

7. The electronic device according to claim 6, wherein, The instruction causes the electronic device to display a preview window as a notification status window (notification bar or panel) or a picture-in-picture (PIP) pop-up window.

8. The electronic device according to claim 5, wherein, The instruction causes the electronic device to: when displaying the second operating screen in the second state, and when the electronic device recognizes, based on data received from the sensing device, that the second state has switched to the third state in which the housing is fully extended, activate the first display area to display the first operating screen on the first display area, and display the second operating screen on the display in the second and third display areas.

9. The electronic device according to claim 8, wherein, The instructions cause the electronic device to group according to its state and store information about the application running in the first state, the application running in the second state, and the application running in the third state.

10. The electronic device according to claim 9, wherein, The instructions cause the electronic device to: This refers to the operation of displaying a first operating screen on a first display area and a second operating screen on both the second and third display areas in the third state. If there are no applications associated with the first running screen and applications associated with the second running screen are initialized or restarted when the resolution changes, the home screen or the list of recent tasks is displayed on the first display area as the first running screen.

11. The electronic device according to claim 10, wherein, The instructions cause the electronic device to: This refers to the operation of displaying a first operating screen on a first display area and a second operating screen on both the second and third display areas in the third state. If there are no applications associated with the first running screen and the applications associated with the second running screen are not initialized or restarted when the resolution changes, the display of the first running screen is omitted, and the size of the second running screen is adjusted to correspond to the size of the first display area, the second display area, and the third display area, and the second running screen is displayed.

12. The electronic device according to claim 10, wherein, The instructions cause the electronic device to: display at least one of a first type indicator or a second type indicator overlapping the application object, the first type indicator guiding the operational electronic device status of each application object in relation to the main screen or recent task list displayed on the first display area, and the second type indicator guiding that the application can be restarted or initialized when switched from the background to the foreground.

13. The electronic device according to claim 12, wherein, The instruction causes the electronic device to display, in a grouped manner, applications running in a different electronic device state than the currently identified electronic device state when the recent task list is displayed in the first display area.

14. The electronic device according to claim 12, wherein, The instruction causes the electronic device to: when displaying a widget screen or a recent app search screen on the display, reconfigure the widget screen or recent app search screen using application information running in the currently identified electronic device state, and display the reconfigured widget screen or recent app search screen on the display.

15. A method of operating the screen of a foldable electronic device, the method comprising: In a first state in which the first housing, the second housing, and the third housing are folded relative to each other, a first operating screen is displayed by a display provided in a first display area in the first housing. When the first operating screen is displayed through the first display area in the first state, if the electronic device recognizes that the first state has been switched to the second state in which the first housing and the second housing are folded and the second housing and the third housing are unfolded, the first display area is deactivated and the second operating screen is displayed through the displays provided in the second display area in the second housing and the third display area provided in the third housing. and When the first operating screen is displayed in the first display area in the first state, and the electronic device recognizes that the first state has been switched to the third state in which the first housing, the second housing, and the third housing are all unfolded, the first operating screen is displayed through the displays of the first display area, the second display area, and the third display area, wherein the second operating screen is a different screen from the first operating screen.

Images