Multi-foldable electronic device that controls execution of application

Abstract

Provided is an electronic device having a multi-foldable housing structure. The electronic device may: display an execution screen of an application on a second display when the application is executed in a state in which a first housing, a second housing, and a third housing are folded; identify that the first housing and the second housing are switched from a folded state to an unfolded state on the basis of data received from a sensor while the application using the second display is being executed; temporarily pause execution of the application on the basis that the first housing and the second housing are switched to the unfolded state; identify that the second housing and the third housing are switched from the folded state to the unfolded state on the basis of data received from the sensor; and execute the temporarily paused application, using a first display, on the basis that the second housing and the third housing are switched to the unfolded state.

Description

A multi-foldable electronic device that controls the execution of applications

[0001] Embodiments of the present disclosure relate to an electronic device for controlling execution of an application in a multi-foldable electronic device.

[0002] An electronic device may have a foldable housing structure divided into two housings centered on a hinge assembly. A first display area of ​​a display (e.g., a flexible display) may be arranged in the first housing, and a second display area of ​​the display may be arranged in the second housing. The hinge assembly may be implemented in an in-folding manner such that the first display area and the second display area face each other when the foldable housing structure is in a folded state. Alternatively, the electronic device may be implemented in an out-folding manner such that the first display area and the second display area face each other when the foldable housing structure is in a folded state.

[0003] An electronic device may have a multi-foldable housing structure. For example, the electronic device may include a first housing, a second housing, a third housing, a first hinge assembly that couples the first housing and the second housing and allows the first housing to rotate relative to the second housing, and a second hinge assembly that couples the third housing and the second housing and allows the third housing to rotate relative to the second housing. Both the first hinge assembly and the second hinge assembly may be implemented in an in-folding manner or an out-folding manner. Alternatively, one of the first hinge assembly and the second hinge assembly may be implemented in an in-folding manner and the other may be implemented in an out-folding manner.

[0004] The above information is provided as background information to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] An electronic device may include a multi-foldable housing structure, a first display (or main display) positioned on the front of the electronic device, and a second display (or sub-display) positioned on the rear of the electronic device. The electronic device may display an application execution screen on the first display or the second display based on the state of the multi-foldable housing structure.

[0006] Embodiments of the present disclosure can provide an electronic device with improved usability by controlling display and sound output when the state of a multi-foldable housing structure changes while an application is running. The technical problems to be solved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which the present invention pertains from the description below.

[0007] According to one embodiment, an electronic device may include a first housing; a second housing; a third housing; a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display disposed in the first housing and disposed in an opposite direction to the first display area; at least one sensor for detecting a first folding state of the first housing and the second housing and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor. The above instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the second display when the application is executed while the first housing, the second housing, and the third housing are folded. The above instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor while the application using the second display is executed, that the first housing and the second housing have transitioned from a folded state to an unfolded state. The above instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application based on the transition of the first housing and the second housing to an unfolded state.The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the second housing and the third housing have transitioned from a folded state to an unfolded state. The instructions, when executed by the processor, may cause the electronic device to execute, using the first display, the paused application based on the transition of the second housing and the third housing to an unfolded state.

[0008] According to one embodiment, an electronic device may include a first housing; a second housing; a third housing; a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display disposed in the first housing and disposed in an opposite direction to the first display area; at least one sensor for detecting a first folding state of the first housing and the second housing and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor. The above instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display when the application is executed in a state in which the first housing, the second housing, and the third housing are unfolded. The above instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor while the application using the second display is executed, that the second housing and the third housing have transitioned from an unfolded state to a folded state. The above instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application based on that the second housing and the third housing have transitioned to a folded state.The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing and the second housing have transitioned from an unfolded state to a folded state. The instructions, when executed by the processor, may cause the electronic device to perform execution of the paused application using the second display based on the transition of the first housing and the second housing to a folded state.

[0009] According to one embodiment, an electronic device may include a first housing; a second housing; a third housing; a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display area disposed in the first housing, a second display area disposed in the second housing, and a first display disposed in the third housing; at least one sensor for detecting a first folding state of the first housing and the second housing and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor. The instructions, when executed by the processor, may cause the electronic device to display a first execution screen of an application in the first display area, the second display area, and the third display area in an unfolded state of the first housing, the second housing, and the third housing. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing and the second housing have transitioned from an unfolded state to a folded state. The instructions, when executed by the processor, may cause the electronic device to reconfigure the layout of the first execution screen based on a size of the third display area to generate a second execution screen and display the second execution screen in the third display area when the first housing and the second housing have transitioned to a folded state.

[0010] According to one embodiment, an electronic device may include a first housing; a second housing; a third housing; a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display disposed in the first housing and disposed in an opposite direction to the first display area; at least one sensor for detecting a first folding state of the first housing and the second housing, and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing and the second housing have transitioned from a folded state to an unfolded state while a first execution screen of an application is displayed on the second display while the first housing, the second housing, and the third housing are in a folded state. The instructions, when executed by the processor, may cause the electronic device to display the first execution screen on the first display area of ​​the first display instead of the second display based on the transition of the first housing and the second housing to an unfolded state.

[0011] According to one embodiment, an electronic device may include a foldable housing including a first housing; a second housing rotatably coupled to the first housing; a third housing rotatably coupled to the second housing; a first hinge assembly configured to rotatably couple the first housing and the second housing; a second hinge assembly configured to rotatably couple the second housing and the third housing; a first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display disposed on a rear surface of the first display and disposed in an opposite direction of the first display area or the second display area; at least one sensor for detecting a folding state of the first housing, the second housing, or the third housing; a memory for storing instructions; and a processor. The instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the second display when the application is executed in a first state in which the first housing, the second housing, and the third housing are folded. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor while the application is executed, that at least one of the first housing, the second housing, or the third housing is transitioned from a folded state to a second state in which it is unfolded. The instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application on the second display based on the transition to the second state.The above instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing, the second housing, and the third housing have transitioned from a folded state to an unfolded third state. The above instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display based on the transition to the third state.

[0012] According to embodiments of the present disclosure, an electronic device can improve usability by controlling display and sound output when the state of a multi-foldable housing structure changes while an application is running. In addition, various effects, directly or indirectly identified through this document, may be provided.

[0013] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0014] FIG. 2 is a block diagram of a display module according to various embodiments.

[0015] FIGS. 3A to 3J illustrate an electronic device having a multi-foldable housing structure in an in-folding manner, according to one embodiment.

[0016] Figure 4 is a block diagram of an electronic device according to one embodiment.

[0017] FIGS. 5A, 5B, and 5C are diagrams illustrating operations of a processor for controlling execution of a media player based on a state change in an electronic device, according to one embodiment.

[0018] FIGS. 6A, 6B, and 6C are diagrams illustrating operations of a processor for controlling execution of a media player based on a state change in an electronic device, according to one embodiment.

[0019] FIGS. 7A and 7B are diagrams illustrating operations of a processor that controls execution of a calling application based on a state change in an electronic device, according to one embodiment.

[0020] FIGS. 8A and 8B are diagrams illustrating operations of a processor that controls execution of a camera application based on a state change in an electronic device, according to one embodiment.

[0021] FIGS. 9A and 9B are diagrams illustrating operations of a processor that reconfigures the layout of a media player execution screen based on a state change of an electronic device, according to one embodiment.

[0022] FIGS. 10A and 10B are diagrams illustrating operations of a processor that allows a user to seamlessly view a media player execution screen when the state of an electronic device changes, according to one embodiment.

[0023] FIGS. 11A, 11B, and 11C are diagrams illustrating operations of a processor that allows a user to seamlessly view a media player execution screen when the state of an electronic device changes, according to one embodiment.

[0024] FIGS. 12A and 12B are diagrams illustrating operations of a processor that allows a user to seamlessly view a media player execution screen when the state of an electronic device changes.

[0025] FIGS. 13A and 13B are diagrams illustrating operations of a processor that changes the display position of a card execution screen based on a change in the state of an electronic device, according to one embodiment.

[0026] FIG. 14 is a flowchart illustrating operations performed by a processor while an electronic device changes from a folded state to an unfolded state, according to one embodiment.

[0027] FIG. 15 is a flowchart illustrating operations performed in an electronic device while the electronic device changes from an unfolded state to a folded state, according to one embodiment.

[0028] FIG. 16 is a flowchart illustrating operations performed in an electronic device when the first foldable housing structure changes from an unfolded state to a folded state, according to one embodiment.

[0029] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0030] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0031] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0032] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0033] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0034] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0035] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0036] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0037] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0038] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0039] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0040] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0041] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0042] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0043] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0044] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0045] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0046] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0047] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0048] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0049] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0050] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0051] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0052] FIG. 2 is a block diagram (200) of a display module (160) according to various embodiments. Referring to FIG. 2, the display module (160) may include a display (210) and a display driver IC (DDI) (230) for controlling the display (210). The DDI (230) may include an interface module (231), a memory (233) (e.g., a buffer memory), an image processing module (235), or a mapping module (237). The DDI (230) may receive image information including, for example, image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device (101) through the interface module (231). For example, according to one embodiment, image information may be received from a processor (120) (e.g., a main processor (121) (e.g., an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit) that operates independently of the function of the main processor (121). The DDI (230) may communicate with a touch circuit (250) or a sensor module (176) through the interface module (231). In addition, the DDI (230) may store at least a part of the received image information in the memory (233), for example, in units of frames. The image processing module (235) may, for example, perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a part of the image data based at least on the characteristics of the image data or the characteristics of the display (210). The mapping module (237) may generate a voltage value or a current value corresponding to the image data that has been preprocessed or postprocessed through the image processing module (135). According to one embodiment, the voltage The generation of the values ​​or current values ​​may be performed based at least in part on properties of the pixels of the display (210), for example, the arrangement of the pixels (RGB stripe or pentile structure), or the size of each of the sub-pixels.At least some pixels of the display (210) may be driven based at least in part on, for example, the voltage value or current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data may be displayed through the display (210).

[0053] According to one embodiment, the display module (160) may further include a touch circuit (250). The touch circuit (250) may include a touch sensor (251) and a touch sensor IC (253) for controlling the same. The touch sensor IC (253) may control the touch sensor (251) to detect, for example, a touch input or a hovering input for a specific location of the display (210). For example, the touch sensor IC (253) may detect a touch input or a hovering input by measuring a change in a signal (e.g., voltage, light quantity, resistance, or charge quantity) for a specific location of the display (210). The touch sensor IC (253) may provide information (e.g., location, area, pressure, or time) regarding the detected touch input or hovering input to the processor (120). According to one embodiment, at least a portion of the touch circuit (250) (e.g., touch sensor IC (253)) may be included as part of the display driver IC (230), or as part of the display (210), or as part of another component (e.g., auxiliary processor (123)) disposed external to the display module (160).

[0054] According to one embodiment, the display module (160) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (176), or a control circuit therefor. In this case, the at least one sensor or the control circuit therefor may be embedded in a part of the display module (160) (e.g., the display (210) or the DDI (230)) or a part of the touch circuit (250). For example, if the sensor module (176) embedded in the display module (160) includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) associated with a touch input through a part of the display (210). As another example, if the sensor module (176) embedded in the display module (160) includes a pressure sensor, the pressure sensor may obtain pressure information associated with a touch input through a part or the entire area of ​​the display (210). According to one embodiment, the touch sensor (251) or sensor module (176) may be positioned between pixels of a pixel layer of the display (210), or above or below the pixel layer.

[0055] An electronic device (e.g., a smart phone, a tablet PC, a notebook PC) (101) may have a multi-foldable housing structure comprising a first housing, a second housing, a third housing, a first hinge assembly, and a second hinge assembly. The first hinge assembly may be configured to couple the first housing and the second housing and allow the first housing to rotate. The second hinge assembly may be configured to couple the third housing and the second housing and allow the third housing to rotate. Both the first hinge assembly and the second hinge assembly may be implemented in an in-folding manner.

[0056] The electronic device (101) may include a multi-foldable housing structure, a first display (or main display) disposed on the front side of the electronic device, and a second display (or sub-display) disposed on the back side of the electronic device. In this document, the side on which the first display is disposed may be defined as the front side of the electronic device (101). In addition, the side opposite the front side, on which the second display is disposed, may be defined as the back side of the electronic device (101). In addition, the side surrounding the space between the front side and the back side may be defined as the side surface of the electronic device (101). Hereinafter, the term “state” may refer to a structural form, shape, or shape of an electronic device or a component thereof (e.g., a display, a foldable housing structure) according to an embodiment of the present disclosure.

[0057] FIGS. 3A to 3J illustrate an electronic device (300) having a multi-foldable housing structure in an in-folding manner, according to one embodiment. Referring to FIGS. 3A to 3J , the electronic device (300) (e.g., the electronic device (101)) may include a first housing (310), a second housing (320), a third housing (330), a first hinge assembly (340), a second hinge assembly (350), a first display (360), a second display (370), and a plurality of cameras (381, 382, ​​383, 384, 385). The first hinge assembly (340) may be configured to couple the first housing (310) to one side of the second housing (320) and allow the first housing (310) to rotate relative to the second housing (320). The second hinge assembly (350) may be configured to couple the third housing (330) to the other side of the second housing (320) and allow the third housing (330) to rotate relative to the second housing (320). The first display (360) and the second display (370) may be arranged within a space formed by the multi-foldable housing structures (310, 320, 330).

[0058] Referring to FIG. 3A, a first display (or, in other words, a main display or front display) (360) may be arranged from a first housing (310) across a first hinge assembly (340), a second housing (320), and a second hinge assembly (350) to a third housing (330). According to one embodiment, the screen of the first display (360) may be visually exposed through the front of the electronic device (300). The first display (360) may be implemented as a flexible display such that a portion positioned above the first hinge assembly (340) and the second hinge assembly (350) may be at least partially bendable. The first display (360) may be divided into a first display area (361) located in the first housing (310), a second display area (362) located in the second housing (320), and a third display area (363) located in the third housing (330), based on the first folding axis (A) of the first hinge assembly (340) and the second folding axis (B) of the second hinge assembly (350). The electronic device (300) may include at least one front camera positioned inside the electronic device (300) such that its lens is visually exposed through the front. For example, the first camera (381) may be positioned below the second display area (362). The lens of the first camera (381) is positioned to face the second display area (362), thereby allowing light to be received from the outside of the electronic device (300) through at least a portion of the second display area (362) or at least one opening formed in the second display area (362). According to one embodiment, the first camera (381) may be referred to as an under display camera (UDC) since it is positioned under the display and receives light through the display.

[0059] Referring to FIG. 3B, a second display (or, alternatively, a sub-display or a rear display) (370) may be positioned in the first housing (310). The screen of the second display (370) may be visually exposed through the rear of the electronic device (300). The electronic device (300) may include at least one rear camera including a lens positioned toward the rear of the electronic device (300). For example, the electronic device (300) may include a second camera (382) positioned in the second housing (320) and including a lens facing the rear of the electronic device (300), and a third camera (383) positioned below the second display (370) and including a lens facing the rear of the electronic device (300). In one embodiment, the electronic device (300) may further include a fourth camera (384) and a fifth camera (385) including lenses facing the rear of the electronic device (300). The fourth camera (384) and the fifth camera (385) may be positioned adjacent to the second camera (382) in the second housing (320). For example, the second camera (382) may include a wide-angle lens, the fourth camera (384) may include an ultra-wide-angle lens, and the fifth camera (385) may include a telephoto lens.

[0060] In one embodiment, a state between two housings may be defined based on an angle formed between the two housings joined by a hinge assembly. For example, if the angle between the two housings is approximately 180 degrees, the state may be defined as an unfolded (flat) or open state. In one embodiment, if the angle between the two housings is less than or equal to approximately 10 degrees, the state may be defined as a folded (closed) state. In one embodiment, if the two housings form an angle that is greater than the angle when they are folded but less than the angle when they are unfolded (e.g., between approximately 10 degrees and 179 degrees), the state may be defined as an intermediate state. Here, the intermediate state may be expressed as a partially folded state or a partially unfolded state.

[0061] Referring to FIGS. 3a, 3c, 3d, and 3e, when the housings (310, 320, 330) are all in an unfolded state (FIG. 3a), the display areas (361, 362, 363) can all face the same direction. According to one embodiment, in this state, the first hinge assembly (340) may rotate (C; FIG. 3c) so that the first foldable housing structure (310, 320) may enter an intermediate state. The first hinge assembly (340) may further rotate (D; FIG. 3d), thereby bringing the first foldable housing structure (310, 320) into a folded state and allowing the first display area (361) to face the second display area (362). As the second hinge assembly (350) rotates (E; FIG. 3e) while the first foldable housing structure (310, 320) is folded, the second foldable housing structure (320, 330) can be in an intermediate state. When the first foldable housing structure (310, 320) is in a folded state and the second hinge assembly (350) is in an unfolded state or an intermediate state, only the third display area (363) can be exposed to the outside.

[0062] Referring to FIGS. 3a, 3f, 3g, 3h, and 3i, when the housings (310, 320, 330) are fully unfolded (FIG. 3a), the second hinge assembly (350) may rotate (F; FIG. 3f) so that the second foldable housing structure (320, 330) may transition to an intermediate state. The second hinge assembly (350) may further rotate (G; FIG. 3g), thereby bringing the second foldable housing structure (320, 330) into a folded state and allowing the third display area (363) to face the second display area (362). When the second foldable housing structure (320, 330) is folded, the first hinge assembly (340) may rotate (H; FIG. 3h). Accordingly, the first foldable housing structure (310, 320) can be converted to an intermediate state. When the second foldable housing structure (320, 330) is in a folded state and the first foldable housing structure (310, 320) is in an unfolded state or an intermediate state, only the first display area (361) can be exposed to the outside. The first hinge assembly (340) can be further rotated (I; FIG. 3i), and thus, all of the housings (310, 320, 330) can be folded into a G shape.

[0063] Referring to FIGS. 3A and 3J, when the housings (310, 320, 330) are fully unfolded (FIG. 3A), the first hinge assembly (340) rotates (J1; FIG. 3J), thereby allowing the first foldable housing structure (310, 320) to enter an intermediate state. When the second hinge assembly (350) rotates (J2; FIG. 3J) in the intermediate state of the first foldable housing structure (310, 320), the second foldable housing structure (320, 330) can enter an intermediate state.

[0064] FIG. 4 is a block diagram of an electronic device (300) according to one embodiment. Referring to FIG. 4, the electronic device (300) may include a wireless communication circuit (410), a display module (420), a camera module (430), a sensing circuit (440), an audio processing circuit (450), a speaker (453), a microphone (455), an angle calculation module (461), a state recognition module (462), a screen manager (463), an application (470), a memory (1288), and a processor (499). The display module (420) may include a first DDI (421) and a first display (360) connected thereto, and a second DDI (423) and a second display (370) connected thereto. The camera module (430) may include cameras (381, 382, ​​383, 384, 385).

[0065] According to one embodiment, the wireless communication circuit (410), the display module (420), the camera module (430), the sensing circuit (440), the audio processing circuit (450), the memory (488), and the processor (499) may be implemented substantially identically to the wireless communication module (192), the display module (160), the sensor module (176), the audio module (170), the memory (130), and the processor (120) of FIG. 1, respectively, thereby performing the same functions. An application (470) (e.g., application (146) of FIG. 1) may include a media player (471) configured to support streaming of music or video through a wireless communication circuit (410) stored in a memory (488), a camera application (472) configured to support shooting using a camera module (430), a call application (473) configured to support voice calls or video calls through a wireless communication circuit (210), and a card application (474) configured to provide various card company-specific card information (250) (e.g., card number, CVC, expiration date, card image) used for online financial services (e.g., payment, internet banking, account transfer) or services related to online finance (e.g., membership subscription, discount).

[0066] In one embodiment, the sensing circuit (440) may generate data necessary to determine where the user is holding the electronic device (300). The sensing circuit (440) may also generate data necessary to determine the angle between the housings and the state of the foldable housing structure. In one embodiment, the sensing circuit (440) may include a grip sensor (441), an inertial sensor (442), and a Hall sensor (443).

[0067] According to one embodiment, the grip sensor (441) may be electrically connected to a conductor formed on a side of the electronic device (300). For example, the grip sensor (441) may generate data (e.g., data indicating a change in electrostatic capacity) necessary to recognize that an external object, such as a user's hand, has contacted the conductor, and output the data to the processor (499). The grip sensor (441) may be placed in an internal space of the electronic device (300) adjacent to the conductor. For example, if the electronic device (300) is formed with the multi-foldable housing structures (310, 320, 330) of FIGS. 3A to 3J and at least a portion of the first housing (310), at least a portion of the second housing (320), and a portion of the third housing (330) include a conductor, the grip sensor (441) may include a first grip sensor disposed adjacent to metal included in the first housing (310), a second grip sensor disposed adjacent to metal included in the second housing (320), and a third grip sensor disposed adjacent to metal included in the third housing (330). The grip sensor (441) may generate data representing a change in electrostatic capacitance and output the data to the processor (499). For example, the processor (499) may determine a location where a user's hand is in contact with the electronic device (300) based on data received from the grip sensor (441).

[0068] According to one embodiment, the inertial sensor (442) may generate data used to calculate the direction in which a force is applied to the foldable housing structure and / or the angle of the foldable housing structure or to determine whether the foldable housing structure is open or closed, and output the data to the processor (499). For example, when the electronic device (300) has the multi-foldable housing structure (310, 320, 330) of FIGS. 3A to 3J, the inertial sensor (442) may include a first inertial sensor (e.g., an acceleration sensor and / or a gyro sensor) disposed in the internal space of the first housing (310) to generate data corresponding to the position and / or movement (e.g., angular velocity and / or acceleration of six or nine axes) of the first housing (310), a second inertial sensor disposed in the internal space of the second housing (320) to generate data corresponding to the position and / or movement of the second housing (320), and a third inertial sensor disposed in the internal space of the third housing (330) to generate data corresponding to the position and / or movement of the third housing (330).

[0069] According to one embodiment, the Hall sensor (443) may generate data used to calculate the direction in which a force applied to the foldable housing structure acts and / or the angle of the foldable housing structure, or to determine whether the foldable housing structure is open or closed, and output the data to the processor (499). For example, the Hall sensor (443) may measure the intensity of a magnetic field and generate data corresponding to the measured magnetic field intensity. The Hall sensor (443) may be attached to the hinge assembly or disposed in the internal space of the housing. For example, when the electronic device (300) has the multiple foldable housing structures (310, 320, 330) of FIG. 3, the Hall sensor (443) may include a first Hall sensor attached to the first hinge assembly (340) and a second Hall sensor attached to the second hinge assembly (350). The processor (499) can determine the angle between the housings based on data received from the inertial sensor (442) and / or the Hall sensor (443). Based on the determined angle, the processor (499) can determine whether the foldable housing structure is open or closed and its state.

[0070] According to one embodiment, the angle calculation module (461) can calculate the angle of the housings based on data received from the sensing circuit (440) (e.g., the inertial sensor (442) and / or the Hall sensor (443)). For example, if the electronic device (300) has the multi-foldable housing structure (310, 320, 330) of FIG. 3, the angle calculation module (461) can receive data indicating the movement of the first housing (310) from the first inertial sensor and can receive data indicating the movement of the second housing (320) from the second inertial sensor. The angle calculation module (461) can calculate the angle using the data received from the two inertial sensors. The angle calculation module (461) can also receive data corresponding to the strength of the magnetic field from the Hall sensor (443) attached to the hinge assembly (340, 350) and calculate the angle using the received data. The angle calculation module (461) can also calculate an angle using data received from an inertial sensor (442) and data received from a Hall sensor (443).

[0071] According to one embodiment, the state recognition module (462) may recognize the state of the foldable housing structure as, for example, an unfolded state, a folded state, or an intermediate state based on the calculated angle. For example, if the calculated angle is between about 0 degrees and 10 degrees, the state recognition module (462) may determine the state of the foldable housing structure as a folded state. If the calculated angle is about 180 degrees, the state recognition module (462) may determine the state of the foldable housing structure as an unfolded state. If the angle is between about 10 degrees and 179 degrees, the state recognition module (462) may determine the state of the foldable housing structure as an intermediate state.

[0072] In one embodiment, the screen manager (463) (e.g., the middleware (144) or the application (146) of FIG. 1) may be configured to determine the components and layout of a screen to be displayed on the display module (420). In one embodiment, the screen manager (463) may determine an active area on which visual information is to be displayed on the display (360, 370) based at least on the state of the electronic device (300). Here, 'at least based' may be interpreted to mean that other elements (e.g., user input) may also be used as the basis. When the electronic device (300) is recognized as being in a state as in FIG. 3i by the state recognition module (462), the screen manager (463) can determine the components and layout of visual information (e.g., an application execution screen (e.g., a home screen, a message screen, a call screen, a playback screen), a status bar for allowing the user to recognize the operating state of the electronic device (300) (e.g., remaining battery level, time), a navigation bar for moving between execution screens) based at least on the size of the second display (370), and display the visual information on the second display (370). As another example, when the electronic device (300) is recognized as being in a state as in FIG. 3a, 3c, 3f, or 3j, the screen manager (463) can determine the components and layout of visual information based at least on the size of the first display (360), and display the visual information on the first display (360). As another example, when the electronic device (300) is recognized as a state as in FIG. 3d or 3e, the screen manager (463) may determine the active area as the third display area (363). As another example, when the electronic device (300) is recognized as a state as in FIG. 3g or 3f, the screen manager (463) may determine the active area as the first display area (361).

[0073] According to one embodiment, the screen manager (463) can control a foreground process (or, top-layer process, non-background process) based on a change in the status of the electronic device (300). Processes residing in volatile memory (e.g., RAM) and running or waiting can be classified into background processes and foreground processes (or, top-layer process, non-background process). For example, a process corresponding to an application execution screen that can be interacted with by a user by being displayed on the display (360 or 370) can be classified as a foreground process. A process that is located hierarchically below the foreground process and thus not displayed on the display (360 or 370) can be classified as a background process.

[0074] According to one embodiment, when the electronic device (300) is in a state such as FIG. 3a, 3c, 3f, or 3j, an execution screen may be displayed on the entire display area of ​​the first display (360) or a portion thereof. According to one embodiment, when the state recognition module (462) recognizes that the second foldable housing structure (320, 330) is in a folded state (FIG. 3g or 3h), the screen manager (463) may stop execution of an application (software) corresponding to the execution screen. For example, execution of a foreground process (e.g., video playback, call reception notification, video recording) corresponding to the execution screen displayed on the first display (360) may be stopped. When it is recognized that the first foldable housing structure (310, 320) is folded as in FIG. 3i after the second foldable housing structure (320, 330) is folded, the screen manager (463) can display the execution screen on the second display (370) instead of the first display (360) and resume execution of the foreground process.

[0075] According to one embodiment, when the electronic device (300) is folded as in FIG. 3i, an execution screen may be displayed on the entire display area of ​​the second display (370) or a portion thereof. When the first foldable housing structure (310, 320) is switched to an intermediate state or an unfolded state (see FIGS. 3g and 3h), the screen manager (463) may stop the execution of an application (e.g., a foreground process) corresponding to the execution screen displayed on the second display (370). When it is recognized that the second foldable housing structure (320, 330) is switched to an intermediate state or an unfolded state (see FIGS. 3a, 3c, 3f, and 3j) after the first foldable housing structure (310, 320) is switched to an intermediate state or an unfolded state, the screen manager (463) may display the execution screen on the first display (360) instead of the second display (370) and resume the execution of the application (e.g., a foreground process).

[0076] The above-described angle calculation module (461), state recognition module (462), and screen manager (463) may be stored in memory (488) as software and executed by a processor (499). Below, the operation of the processor (499) according to an embodiment of the present disclosure will be described in detail. Reference may be made to FIG. 4 to understand the operations described below.

[0077] FIGS. 5A, 5B, and 5C are diagrams illustrating operations of a processor (499 of FIG. 4) that controls execution of a media player based on a state change in an electronic device (300) according to one embodiment.

[0078] Referring to FIG. 5A, while the electronic device (300) is in a folded state, the processor (499) can display a first execution screen (510) of the media player (471) on a second display (370) located in the first housing (310). According to one embodiment, the processor (499; see FIG. 4) can control the second DDI (423; see FIG. 4) to play a video through the first execution screen (510) and control the audio processing circuit (450) to play audio corresponding to the video being played through the speaker (453) (or an external audio output device connected to the electronic device (300) through the wireless communication circuit (410).

[0079] Referring to FIG. 5B, the processor (499) may recognize that the first foldable housing structure (310, 320) has transitioned to an unfolded (or intermediate) state based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has increased to a first threshold angle value or greater (e.g., approximately 179 degrees). Based on the fact that the first foldable housing structure (310, 320) has transitioned from a folded state to an unfolded or intermediate state (or that the angle between the first housing (310) and the second housing (320) is greater than the first threshold angle value), the processor (499) may control the audio processing circuit (450) and the second DDI (423) to pause playback (play back or regenerate) of audio and video. Accordingly, the output of the audio signal through the speaker (453) and the change (in other words, refresh) of the video frame to be displayed on the second display (370) can be paused. If the audio output device for playback is an external audio output device (e.g., a headset) connected to the electronic device (300) through a wireless communication circuit (410) instead of the speaker (453), the processor (499) can pause the output of the audio signal to the external audio output device through the wireless communication circuit (410).

[0080] Referring to FIG. 5c, the processor (e.g., 499 of FIG. 4) may recognize that the second foldable housing structure (320, 330) has transitioned to an unfolded (or intermediate) state based on data received from a sensing circuit (e.g., 440 of FIG. 4). Alternatively, the processor (499) may recognize that the angle between the second housing (320) and the third housing (330) has increased to a first threshold angle value or greater. Based on whether the second foldable housing structure (320, 330) has transitioned from a folded state to an unfolded or intermediate state (or, the angle between the second housing (320) and the third housing (330) is greater than or equal to a first threshold angle value), the processor (499) can deactivate the second display (370) (e.g., turn off the screen by cutting off power to the second display (370)) and display the second execution screen (520) of the media player (471) on the first display (360). The processor (499) can control the first DDI (421) to resume video playback through the second execution screen (520) and control the audio processing circuit (450) to resume playback of audio corresponding to the video being played through the speaker (453) (or, an external audio output device connected to the electronic device through the wireless communication circuit (410).

[0081] FIGS. 6A, 6B, and 6C are diagrams illustrating operations of a processor (499) that controls execution of a media player based on a state change in an electronic device (300), according to one embodiment.

[0082] Referring to FIG. 6A, while the electronic device (300) is in an unfolded state (or partially unfolded state as in FIG. 3C, 3F, or 3J), the processor (499) can display a first execution screen (610) of the media player (471) on at least a portion of the first display (360). The processor (499) can control the first DDI (421) to play a video through the first execution screen (610) and control the audio processing circuit (450) to play audio corresponding to the played video through the speaker (453) (or an external audio output device connected to the electronic device via the wireless communication circuit (410).

[0083] Referring to FIG. 6B, the processor (499) may recognize that the second foldable housing structure (320, 330) has been converted to a folded state based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the second housing (320) and the third housing (330) has been reduced to a second threshold angle value (e.g., approximately 10 degrees) or less based on data received from the sensing circuit (440). Based on the fact that the second foldable housing structure (320, 330) has been converted to a folded state (or the angle between the second housing (320) and the third housing (330) is less than or equal to the second threshold angle value), the processor (499) may control the audio processing circuit (450) and the first DDI (421) to temporarily pause playback (play back or regenerate) of audio and video. Accordingly, the output of the audio signal through the speaker (453) and the change (in other words, refresh) of the video frame to be displayed on the first display (360) can be paused. If the audio output device for playback is an external audio output device (e.g., a headset) connected to the electronic device (300) through a wireless communication circuit (410) instead of the speaker (453), the processor (499) can pause the output of the audio signal to the external audio output device through the wireless communication circuit (410).

[0084] Referring to FIG. 6C, the processor (499) may recognize that the first foldable housing structure (310, 320) has been converted to a folded state based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has decreased below a second threshold angle value. Based on the fact that the first foldable housing structure (310, 320) is converted to a folded state (or, the angle between the first housing (310) and the second housing (320) is less than or equal to a second threshold angle value), the processor (499) can deactivate the first display (360) (e.g., turn off the screen by cutting off the power supply to the first display (360) or maintain the power supply to the first display (360) but no visual information is displayed on the display (360)) and display the second execution screen (620) of the media player (471) on the second display (370). The processor (499) can control the second DDI (423) to resume video playback through the second execution screen (520) and control the audio processing circuit (450) to resume audio playback corresponding to the video being played through the speaker (453) (or an external audio output device connected to the electronic device through the wireless communication circuit (410).

[0085] According to one embodiment, the processor (499) may provide a settings menu via the display (360 or 370) that allows the user to determine whether to execute a pause of playback when the state is switched. If the pause is disabled via the settings menu, the processor (499) may maintain playback even if the first foldable housing structure (310, 320) is switched from a folded state to an unfolded (or intermediate) state (see FIG. 5b) or the second foldable housing structure (320, 330) is switched from an unfolded (or intermediate) state to a folded state (see FIG. 6b). If the pause is disabled via the settings menu, an embodiment described below with reference to FIGS. 10 to 12 may be executed.

[0086] FIGS. 7A and 7B are diagrams illustrating operations of a processor (499) that controls execution of a calling application based on a state change in an electronic device (300) according to one embodiment.

[0087] Referring to FIG. 7A, while the electronic device (300) is in an unfolded state (or partially unfolded state as in FIG. 3C, 3F, or 3J), the processor (499) can display the first execution screen (710) of the call application (473) through at least a portion of the first display (360). According to one embodiment, the processor (499) can control the audio processing circuit (450) to output a sound notifying of an incoming call through the speaker (453) (or an external sound output device connected to the electronic device through the wireless communication circuit (410).

[0088] According to one embodiment, the processor (499) may recognize that the second foldable housing structure (320, 330) has transitioned to a folded state (see FIG. 3g) based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the second housing (320) and the third housing (330) has decreased below a designated second threshold angle value (e.g., about 10 degrees) based on data received from the sensing circuit (440). Based on the fact that the second foldable housing structure (320, 330) has transitioned to a folded state (or the angle between the second housing (320) and the third housing (330) is below the second threshold angle value), the processor (499) may stop outputting sound to the speaker (453) (or the wireless communication circuit (410)). In one embodiment, when the electronic device (300) is vibrating to notify the user of an incoming call, the processor (499) may stop driving the vibration motor (e.g., the haptic module (179)).

[0089] Referring to FIG. 7B, the processor (499) may recognize that the first foldable housing structure (310, 320) has been converted to a folded state based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has become smaller than or equal to a second threshold angle value. Based on the fact that the first foldable housing structure (310, 320) has been converted to a folded state (or that the angle between the first housing (310) and the second housing (320) is smaller than or equal to the second threshold angle value), the processor (499) may deactivate the first display (360) (e.g., turn off the screen by cutting off power to the first display (360)) and display the second execution screen (720) of the call application (473) on the second display (370). In addition, based on the fact that the first foldable housing structure (310, 320) is converted to a folded state without user input (or, the angle between the first housing (310) and the second housing (320) is less than or equal to a second threshold angle value), the processor (499) may receive a voice signal from the external electronic device of the call counterpart through the wireless communication circuit (410) and output the voice signal to the speaker (453) (or, an external audio output device connected to the electronic device through the wireless communication circuit (410). If the call is a video call, the processor (499) may receive a video signal from the external electronic device through the wireless communication circuit (410) and display a video call screen corresponding to the video signal on the second execution screen (720) through at least a portion of the second display (370).

[0090] FIGS. 8A and 8B are diagrams illustrating operations of a processor (499) that controls execution of a camera application based on a state change in an electronic device (300) according to one embodiment.

[0091] Referring to FIG. 8A, while the electronic device (300) is in a folded state, the processor (499) may display a first execution screen (810) of a camera application (472) on a second display (370) located in the first housing (310). According to one embodiment, the processor (499) may receive an image from the second camera (382) (additionally, the fourth camera (384) and / or the fifth camera (385)) or the third camera (383) and process (e.g., reduce the resolution) the image to generate a preview image (811), and include the preview image (811) in the first execution screen (810) and display it on the second display (370). If video recording is selected (e.g., based on the touch of the capture button (813)), the processor (499) may perform recording and audio recording using the corresponding camera and audio processing circuit (450) used for the image preview. For example, the processor (499) may generate a video file by processing (e.g., compressing) an original image (e.g., an image received from a corresponding camera) corresponding to the preview image (811) and store the video file in the memory (488). Additionally, the processor (499) may control the audio processing circuit (450) to receive and process (e.g., encode) an audio signal from a microphone (455) and store an audio file received from the audio processing circuit (450) as a result of the audio processing in the memory (488) together with the video file.

[0092] The processor (499) may recognize, based on the data received from the sensing circuit (440), that the first foldable housing structure (310, 320) has transitioned to an intermediate state (see FIG. 3h) or an unfolded state (see FIG. 3g). Alternatively, the processor (499) may recognize, based on the data received from the sensing circuit (440), that the angle between the first housing (310) and the second housing (320) has increased to a first threshold angle value or greater (e.g., approximately 179 degrees). Based on the fact that the first foldable housing structure (310, 320) has transitioned to the intermediate state or the unfolded state (or that the angle between the first housing (310) and the second housing (320) is greater than the first threshold angle value), the image preview through the second display (370) may be stopped. Additionally, the processor (499) may stop video recording and audio recording.

[0093] Referring to FIG. 8B, the processor (499) may recognize that the second foldable housing structure (320, 330) has transitioned to an intermediate state (see FIGS. 3F, 3J) or an unfolded state (see FIGS. 3A, 3C) based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the second housing (320) and the third housing (330) has increased to a first threshold angle value (e.g., approximately 179 degrees) or greater based on data received from the sensing circuit (440). Based on whether the second foldable housing structure (320, 330) has transitioned from a folded state to an unfolded or intermediate state (or, whether the angle between the second housing (320) and the third housing (320) is greater than or equal to a first threshold angle value), the processor (499) may display the second execution screen (820) of the camera application (472) on the display (360). According to one embodiment, the processor (499) may receive and process an image (e.g., lower the resolution) to generate a preview image (821), and include the preview image (821) in the second execution screen (820) to display on the first display (360). If video recording and audio recording were being performed before the state transition, the processor (499) may resume the recording and audio recording by using the corresponding camera and audio processing circuit (450) used for the image preview. For example, if the camera used for recording in the folded state of the electronic device (300) (Fig. 8a) is the third camera (383), when the electronic device (300) switches to the unfolded state (Fig. 8c), the processor (499) can resume recording using the first camera (381) instead of the third camera (383).

[0094] The processor (499) can perform the same operation as described above even when the electronic device (300) is switched from an unfolded state (Fig. 8b) to a folded state (Fig. 8a).

[0095] FIGS. 9A and 9B are diagrams for explaining operations of a processor (499) that reconfigures the layout of a media player execution screen based on a state change of an electronic device (300), according to one embodiment.

[0096] Referring to FIG. 9A, while the electronic device (300) is in an unfolded state (or partially unfolded state as in FIG. 3C, 3F, or 3J), the processor (499) may display a portion of the first execution screen (910) of the media player (471) in a first display area (361) of the first display (360), another portion in a second display area (362), and another portion in a third display area (363). According to one embodiment, the processor (499) may control the first DDI (421) to play a video through the first execution screen (910) and control the audio processing circuit (450) to play audio corresponding to the played video through the speaker (453) (or an external audio output device connected to the electronic device via the wireless communication circuit (410).

[0097] Referring to FIG. 9B, the processor (499) may recognize that the first foldable housing structure (310, 320) has been converted to a folded state (see FIG. 3D) based on the data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has become smaller than or equal to a second threshold angle value (e.g., about 10 degrees) based on the data received from the sensing circuit (440). When the first foldable housing structure (310, 320) has been converted to a folded state or the angle between the first housing (310) and the third housing (320) is smaller than or equal to the second threshold angle value, the processor (499) may generate a second execution screen (920) based on the size of the third display area (363) and display it in the third display area (363). For example, the processor (499) may generate the second execution screen (920) by reducing the size of the first execution screen (910) to fit the size of the third display area (363). According to one embodiment, the processor (499) may generate the second execution screen (920) by omitting some elements (911) from among the user interface (UI) elements for interaction with the user in the first execution screen (910) and reducing the play bar (912).

[0098] FIGS. 10A and 10B are diagrams illustrating operations of a processor (499) that allows a user to seamlessly view a media player execution screen when the state of an electronic device (300) changes, according to one embodiment.

[0099] Referring to FIG. 10A, while the electronic device (300) is in a folded state, the processor (499) can display the execution screen (1010) of the media player (471) on the second display (370) located in the first housing (310). The processor (499) can recognize the posture of the electronic device (300) based on data received from the sensing circuit (440), configure the execution screen (1010) to correspond to the recognized posture, and display the configuration on the second display (370). For example, when the recognized posture is a first posture corresponding to a first display mode (e.g., landscape mode) as illustrated, the processor (499) can configure the execution screen (1010) in the first display mode and display it on the second display (370). According to one embodiment, if the recognized posture is a second posture corresponding to a second display mode (e.g., portrait mode), the processor (499) may configure the execution screen of the media player (471) in the portrait mode (e.g., corresponding to the second execution screen (920) of FIG. 9) and display it on the second display (370). The processor (499) may control the second DDI (423) to play a video through the execution screen (1010) and control the audio processing circuit (450) to play audio corresponding to the played video through the speaker (453) (or an external audio output device connected to the electronic device through the wireless communication circuit (410). According to one embodiment, even if the recognized posture is the first posture, if automatic mode conversion is not set, the processor (499) may configure the execution screen in the second display mode and display it on the second display (370). Even if the recognized posture is the second posture, if the execution screen of the media player (471) is set to be maximized, the processor (499) may configure the execution screen in the first display mode and display it on the second display (370).

[0100] Referring to FIG. 10B, the processor (499) may recognize that the first foldable housing structure (310, 320) has transitioned from a folded state to an intermediate state (see FIG. 3H) based on the data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has increased to a second threshold angle value (e.g., about 10 degrees) or greater based on the data received from the sensing circuit (440). According to one embodiment, the processor (499) may recognize that the user is holding the electronic device (400) and the electronic device (400) has transitioned from a folded state (portable mode) to an intermediate state (desktop mode) when the user is not holding the electronic device (400). According to one embodiment, when the first foldable housing structure (310, 320) is switched from a folded state to an intermediate state (see FIG. 3h), or when the angle between the first housing (310) and the second housing (320) becomes greater than a second threshold angle value, or when the electronic device (400) is switched from a portable mode to a desktop mode, the processor (499) may display the execution screen (1010) on at least a portion of the first display area (361). The processor (499) may adjust the size of the execution screen (1010) to fit the size of the first display area (361) while maintaining the layout of the execution screen (1010) as is.

[0101] FIGS. 11A, 11B, and 11C are diagrams illustrating operations of a processor (499) that allows a user to seamlessly view a media player execution screen when the state of an electronic device (300) changes, according to one embodiment.

[0102] Referring to FIG. 11A, while the electronic device (300) is in a folded state, the processor (499) can display the first execution screen (1110) of the media player (471) on the second display (370) located in the first housing (310). The processor (499) can recognize the posture of the electronic device (300) based on data received from the sensing circuit (440), configure the first execution screen (1110) to correspond to the recognized posture, and display it on the second display (370). For example, when the recognized posture is the second posture, the processor (499) can configure the first execution screen (1110) in a second display mode and display it on the second display (370). The processor (499) can control the second DDI (423) to play a video through the first execution screen (1110) and control the audio processing circuit (450) to play audio corresponding to the video being played through the speaker (453) (or an external audio output device connected to the electronic device through the wireless communication circuit (410).

[0103] Referring to FIG. 11B, the processor (499) may recognize that the first foldable housing structure (310, 320) has transitioned from a folded state to an intermediate state (see FIG. 3H) or an unfolded state (see FIG. 3G) based on the data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has increased to a first threshold angle value (e.g., approximately 179 degrees) or greater based on the data received from the sensing circuit (440). When the first foldable housing structure (310, 320) has transitioned from a folded state to an intermediate state (or an unfolded state) or the angle between the first housing (310) and the second housing (320) is greater than the first threshold angle value, the processor (499) may display the first execution screen (1110) on the first display area (361). The processor (499) can adjust the size of the first execution screen (1110) to fit the size of the first display area (361) while maintaining the layout of the first execution screen (1110).

[0104] Referring to FIG. 11C, the processor (499) may recognize, based on data received from the sensing circuit (440), that the second foldable housing structure (320, 330) has transitioned from a folded state to an intermediate state (see FIG. 3F or 3J) or an unfolded state (see FIG. 3A or 3C). Alternatively, the processor (499) may recognize, based on data received from the sensing circuit (440), that the angle between the second housing (320) and the third housing (330) has increased to a first threshold angle value (e.g., about 179 degrees) or greater. When the second foldable housing structure (320, 330) is switched from a folded state to an intermediate state (or an unfolded state) or when the angle between the second housing (320) and the third housing (330) is greater than or equal to a first threshold angle value, the processor (499) may generate a second execution screen (1120) based on the size of the first display (360) and display it on the first display (360). For example, the processor (499) may generate the second execution screen (1120) by enlarging the size of the first execution screen (1110) to fit the size of the first display (360) while maintaining the layout of the first execution screen (1110) as it is. The processor (499) may generate the second execution screen (1120) by adding a UI (1131) for user interaction to the first execution screen (1110) and enlarging a play bar (1132) on the second execution screen (1120).

[0105] FIGS. 12a and 12b are drawings for explaining the operations of a processor (499) that allows a user to seamlessly view a media player execution screen when the state of an electronic device (300) changes.

[0106] Referring to FIG. 12A, the processor (499) can recognize that the electronic device (300) is in a second posture in a folded state based on data received from the sensing circuit (440). Based on the fact that the electronic device (300) is in a folded state and that the posture of the electronic device (300) is the second posture, the processor (499) can configure the first execution screen (1210) of the media player (471) to correspond to the first display mode and display it on the second display (370) located in the first housing (310). The processor (499) can control the second DDI (423) to play a video through the first execution screen (1210) and control the audio processing circuit (450) to play audio corresponding to the video being played through the speaker (453) (or an external audio output device connected to the electronic device through the wireless communication circuit (410).

[0107] Referring to FIG. 12B, the processor (499) may recognize that the first foldable housing structure (310, 320) has transitioned to an intermediate state (see FIG. 3F or 3J) or an unfolded state (see FIG. 3A or 3C) based on data received from the sensing circuit (440). Alternatively, the processor (499) may recognize that the angle between the first housing (310) and the second housing (320) has increased to a first threshold angle value (e.g., approximately 179 degrees) or greater based on data received from the sensing circuit (440). When the first foldable housing structure (310, 320) is switched from a folded state to an intermediate state (or an unfolded state) or when the angle between the first housing (310) and the second housing (320) is greater than or equal to a first threshold angle value, the processor (499) may reconfigure the first execution screen (1210) based on the size of the first display area (361) to generate a second execution screen (1220) and display it on the first display area (361). For example, the processor (499) may generate the second execution screen (1220) by adjusting the size of the first execution screen (1210) to fit the size of the first display area (361) while maintaining the layout of the first execution screen (1110) as it is.

[0108] Referring to FIG. 12C, the processor (499) may recognize, based on data received from the sensing circuit (440), that the second foldable housing structure (320, 330) has transitioned from a folded state to an intermediate state (see FIG. 3F or 3J) or an unfolded state (see FIG. 3A or 3C). Alternatively, the processor (499) may recognize, based on data received from the sensing circuit (440), that the angle between the second housing (320) and the third housing (330) has increased to a first threshold angle value (e.g., about 179 degrees) or greater. Based on whether the second foldable housing structure (320, 330) is switched from a folded state to an intermediate state (or an unfolded state) or whether the angle between the second housing (320) and the third housing (330) is greater than or equal to a first threshold angle value, the processor (499) may change the display position of the second execution screen (1220). For example, the processor (499) may move the second execution screen (1220) to the second display area (362) and display it.

[0109] FIGS. 13A and 13B are diagrams for explaining operations of a processor (499) that changes the display position of a card execution screen based on a change in the state of an electronic device (300), according to one embodiment.

[0110] Referring to FIG. 131a, while the electronic device (300) is in a folded state, the processor (499) can display an execution screen (1310) of a card application (474) on a second display (370) located in the first housing (310). For example, the processor (499) can include a UI element (1311) for fingerprint recognition, a UI element (1312) for entering a password, and a card image (1313) on the execution screen (1310) and display them on the second display (370).

[0111] Referring to FIG. 13B, the processor (499) may recognize, based on data received from the sensing circuit (440), that the first foldable housing structure (310, 320) has transitioned from a folded state to an intermediate state (see FIG. 3H) or an unfolded state (see FIG. 3G). Alternatively, the processor (499) may recognize, based on data received from the sensing circuit (440), that the angle between the first housing (310) and the second housing (320) has increased to a first threshold angle value (e.g., approximately 179 degrees) or more while the portrait mode is maintained. When the first foldable housing structure (310, 320) is switched from a folded state to an intermediate state (or an unfolded state) or when the angle between the first housing (310) and the second housing (320) is greater than or equal to a first threshold angle value, the processor (499) can display the execution screen (1310) on the first display area (361). The processor (499) can adjust the size of the execution screen (1310) to fit the size of the first display area (361) while maintaining the layout of the execution screen (1310) as is.

[0112] FIG. 14 is a flowchart illustrating operations performed by a processor (499) while an electronic device (300) changes from a folded state to an unfolded state, according to one embodiment.

[0113] At operation 1410, the processor (499) may control the second DDI (423) to output video to a second display (370; see FIG. 5a) and control the audio processing circuit (450) to output audio to a speaker (453).

[0114] While video and audio are being output, at operation 1420, the processor (499) can recognize that the first foldable housing structure (310, 320) has transitioned from a folded state to an intermediate state or an unfolded state based on data received from the sensing circuit (440).

[0115] At operation 1430, the processor (499) may control the second DDI (423) and the audio processing circuit (450) to stop outputting video and audio based on the state transition recognized at operation 1420.

[0116] While the video and audio output is stopped, at operation 1440, the processor (499) can recognize that the second foldable housing structure (320, 330) has transitioned from a folded state to an intermediate state or an unfolded state based on data received from the sensing circuit (440).

[0117] At operation 1450, the processor (499) may control the first DDI (421) to output video to the first display (360; see FIG. 5c) and control the audio processing circuit (450) to output audio to the speaker (453), based on the state transition recognized at operation 1440.

[0118] In one embodiment, in operations 1410 and 1450, the processor (499) may output audio to an external audio output device connected to the electronic device (300) via the wireless communication circuit (410), instead of the speaker (453).

[0119] In one embodiment, operation 1430 may be performed when the first foldable housing structure (310, 320) transitions from a folded state to an intermediate state or when an angle between the first housing (310) and the second housing (320) is greater than or equal to a first threshold angle value (e.g., about 179 degrees). Operation 1450 may be performed when the second foldable housing structure (320, 330) transitions from a folded state to an intermediate state or when an angle between the second housing (320) and the third housing (330) is greater than or equal to a first threshold angle value.

[0120] FIG. 15 is a flowchart illustrating operations performed in an electronic device (300) while the electronic device (300) changes from an unfolded state to a folded state, according to one embodiment.

[0121] At operation 1510, the processor (499) may control the first DDI (421) to output video to the first display (360; see FIG. 6a) and control the audio processing circuit (450) to output audio to the speaker (453).

[0122] While video and audio are being output, at operation 1520, the processor (499) can recognize that the second foldable housing structure (320, 330) has transitioned from an unfolded state to a folded state based on data received from the sensing circuit (440).

[0123] At operation 1530, the processor (499) may control the first DDI (421) and the audio processing circuit (450) to stop outputting video and audio based on the state transition recognized at operation 1520.

[0124] While the video and audio output is stopped, at operation 1540, the processor (499) can recognize that the first foldable housing structure (310, 320) has transitioned from an unfolded state to a folded state based on data received from the sensing circuit (440).

[0125] At operation 1550, the processor (499) may control the second DDI (423) to output video to at least a portion of at least a portion of the second display (370; see FIG. 6c) and control the audio processing circuit (450) to output audio to the speaker (453), based on the state transition recognized at operation 1540.

[0126] In one embodiment, in operations 1510 and 1550, the processor (499) may output audio to an external audio output device connected to the electronic device (300) via the wireless communication circuit (410), instead of the speaker (453).

[0127] In one embodiment, operation 1530 may be performed when the second foldable housing structure (320, 330) transitions from an unfolded state to an intermediate state or when the angle between the second housing (320) and the third housing (330) is less than or equal to a second threshold angle value (e.g., about 10 degrees). Operation 1450 may be performed when the first foldable housing structure (310, 320) is in a folded state after the second foldable housing structure (320, 330) is in a folded state or when the angle between the first housing (310) and the second housing (320) is less than or equal to a second threshold angle value.

[0128] FIG. 16 is a flowchart illustrating operations performed in an electronic device (300) when the first foldable housing structure (310, 320) changes from an unfolded state to a folded state, according to one embodiment.

[0129] At operation 1610, the processor (499) may control the first DDI (421) to output video to the first display (360; see FIG. 9a) and control the audio processing circuit (450) to output audio to the speaker (453).

[0130] While video and audio are being output, at operation 1620, the processor (499) can recognize that the first foldable housing structure (310, 320) has transitioned from an unfolded state to a folded state based on data received from the sensing circuit (440).

[0131] At operation 1630, the processor (499) may control the first DDI (421) to output the video to at least a portion of the third display area (363; see FIG. 9b) based on the state transition recognized at operation 1620.

[0132] According to one embodiment, an electronic device (e.g., electronic device (300)) includes a first housing (e.g., first housing (310)); a second housing (e.g., second housing (320)); a third housing (e.g., third housing (330)); a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display (e.g., first display (360)) including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display (e.g., second display (370)) disposed in the first housing and arranged in an opposite direction to the first display area; The electronic device may include at least one sensor for detecting a first folding state of the first housing and the second housing and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor (e.g., processor 499). The instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the second display when the application is executed while the first housing, the second housing, and the third housing are in a folded state. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor while the application is executed, that the first housing and the second housing are transitioned from a folded state to an unfolded state. The instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application based on the transition of the first housing and the second housing to an unfolded state.The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the second housing and the third housing have transitioned from a folded state to an unfolded state. The instructions, when executed by the processor, may cause the electronic device to execute, using the first display, the paused application based on the transition of the second housing and the third housing to an unfolded state.

[0133] The above instructions, when executed by the processor, may cause the electronic device to perform an operation of pausing execution of the application, such that video is stopped from being output to the second display, and audio is stopped from being output to a speaker of the electronic device or to an external electronic device via a wireless communication circuit of the electronic device. The above instructions, when executed by the processor, may cause the electronic device to perform an operation of performing execution of the application using the first display, such that video is output to the first display, and audio is output to the speaker or the external electronic device.

[0134] The above commands, when executed by the processor, may cause the electronic device to suspend execution of the application, thereby causing a sound notifying an incoming call to be output to a speaker of the electronic device or to be output to an external electronic device via a wireless communication circuit of the electronic device. The above commands, when executed by the processor, may cause the electronic device to display an execution screen of the call application on the first display, thereby causing the electronic device to execute the application using the first display.

[0135] The above instructions, when executed by the processor, may cause the electronic device to stop displaying an image acquired from a camera of the electronic device on the second display as an operation of pausing execution of the application. The above instructions, when executed by the processor, may cause the electronic device to stop recording using the camera as an operation of pausing execution of the application. The above instructions, when executed by the processor, may cause the electronic device to display an image acquired from the camera on the first display and resume recording using the camera as an operation of performing execution of the application using the first display. The camera may include a first camera disposed in the second housing, a second camera disposed in the second housing, and a third camera disposed in the first housing. The lens of the first camera may face in the same direction as the direction in which the second display area faces, the lens of the second camera may face in a direction opposite to the direction in which the second display area faces, and the lens of the third camera may face in the same direction as the direction in which the second display faces. The instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application, thereby stopping displaying an image acquired from the third camera on the second display and stopping recording using the third camera. The instructions, when executed by the processor, may cause the electronic device to display an image acquired from the first camera on the first display and resume recording using the first camera, thereby performing execution of the application using the first display.

[0136] According to one embodiment, an electronic device (e.g., electronic device (300)) includes a first housing (e.g., first housing (310)); a second housing (e.g., second housing (320)); a third housing (e.g., third housing (330)); a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display (e.g., first display (360)) including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display (e.g., second display (370)) disposed in the first housing and arranged in an opposite direction to the first display area; The device may include at least one sensor for detecting a first folding state of the first housing and the second housing and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor (e.g., processor (499)). The instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display when the application is executed in a state in which the first housing, the second housing, and the third housing are unfolded. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor while the application using the second display is executed, that the second housing and the third housing are transitioned from an unfolded state to a folded state. The instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application based on the transition of the second housing and the third housing to a folded state.The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing and the second housing have transitioned from an unfolded state to a folded state. The instructions, when executed by the processor, may cause the electronic device to perform execution of the paused application using the second display based on the transition of the first housing and the second housing to a folded state.

[0137] The above instructions, when executed by the processor, may cause the electronic device to perform an operation of pausing execution of the application, such that video is stopped from being output to the first display, and audio is stopped from being output to a speaker of the electronic device or to an external electronic device via a wireless communication circuit of the electronic device. The above instructions, when executed by the processor, may cause the electronic device to perform an operation of performing execution of the application using the second display, such that video is output to the second display, and audio is output to the speaker or the external electronic device.

[0138] The above commands, when executed by the processor, may cause the electronic device to stop displaying an image acquired from a camera of the electronic device on the first display as an operation of pausing execution of the application. The above commands, when executed by the processor, may cause the electronic device to stop recording using the camera as an operation of pausing execution of the application. The above commands, when executed by the processor, may cause the electronic device to display an image acquired from the camera on the second display and resume recording using the camera as an operation of performing execution of the application using the second display.

[0139] According to one embodiment, an electronic device (e.g., electronic device (300)) may include a first housing (e.g., first housing (310)); a second housing (e.g., second housing (320)); a third housing (e.g., third housing (330)); a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display area disposed in the first housing, a second display area disposed in the second housing, and a first display (e.g., first display (360)) disposed in the third housing; at least one sensor for detecting a first folding state of the first housing and the second housing and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor (e.g., processor (499)). The instructions, when executed by the processor, may cause the electronic device to display a first execution screen of an application in the first display area, the second display area, and the third display area when the first housing, the second housing, and the third housing are unfolded. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing and the second housing have transitioned from an unfolded state to a folded state. The instructions, when executed by the processor, may cause the electronic device to reconfigure a layout of the first execution screen based on a size of the third display area to generate a second execution screen and to display the second execution screen in the third display area when the first housing and the second housing have transitioned to a folded state.

[0140] The above commands, when executed by the processor, may cause the electronic device to generate the second execution screen, reduce the size of the first execution screen to fit the size of the third display area, and omit some of the UI (user interface) elements for user interaction included in the first execution screen.

[0141] According to one embodiment, an electronic device (e.g., electronic device (300)) includes a first housing (e.g., first housing (310)); a second housing (e.g., second housing (320)); a third housing (e.g., third housing (330)); a first hinge assembly configured to couple the first housing to one side of the second housing and to allow the first housing to rotate; a second hinge assembly configured to couple the third housing to the other side of the second housing and to allow the third housing to rotate; a first display (e.g., first display (360)) including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display (e.g., second display (370)) disposed in the first housing and arranged in an opposite direction to the first display area; The electronic device may include at least one sensor for detecting a first folding state of the first housing and the second housing, and a second folding state of the second housing and the third housing; a memory for storing instructions; and a processor (e.g., processor (499)). The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing and the second housing have transitioned from a folded state to an unfolded state while a first execution screen of an application is displayed on the second display in a folded state of the first housing, the second housing, and the third housing. The instructions, when executed by the processor, may cause the electronic device to display the first execution screen on the first display area of ​​the first display, instead of the second display, based on the transition of the first housing and the second housing to an unfolded state.

[0142] The above instructions, when executed by the processor, may cause the electronic device to identify that the second housing and the third housing have transitioned from a folded state to an unfolded state. The above instructions, when executed by the processor, may cause the electronic device to generate a second execution screen of the application and display it in the first display area, the second display area, and the third display area based on the transition of the second housing and the third housing to an unfolded state.

[0143] The above instructions, when executed by the processor, may cause the electronic device to recognize that the second housing and the third housing have transitioned from a folded state to an unfolded state. The above instructions, when executed by the processor, may cause the electronic device to display the first execution screen in the second display area based on the transition of the second housing and the third housing to an unfolded state.

[0144] According to one embodiment, an electronic device (e.g., electronic device (300)) comprises: a foldable housing including a first housing (e.g., a first housing (310)); a second housing (e.g., a second housing (320)) rotatably coupled to the first housing; a third housing (e.g., a third housing (330)) rotatably coupled to the second housing; a first hinge assembly configured to rotatably couple the first housing and the second housing; a second hinge assembly configured to rotatably couple the second housing and the third housing; a first display (e.g., a first display (360)) including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; a second display (e.g., a second display (370)) disposed on a rear surface of the first display and disposed in an opposite direction of the first display area or the second display area; The device may include at least one sensor for detecting a folding state of the first housing, the second housing, or the third housing; a memory for storing instructions; and a processor (e.g., processor (499)). The instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the second display when the application is executed in a first state in which the first housing, the second housing, and the third housing are folded. The instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor while the application is executed, that at least one of the first housing, the second housing, or the third housing is transitioned from a folded state to a second state in which the application is unfolded.The above instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application on the second display based on the transition to the second state. The above instructions, when executed by the processor, may cause the electronic device to identify, based on data received from the at least one sensor, that the first housing, the second housing, and the third housing have transitioned from a folded state to an unfolded third state. The above instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display based on the transition to the third state.

[0145] The above instructions, when executed by the processor, may cause the electronic device to perform an operation of pausing execution of the application, such that video is stopped from being output to the second display, and audio is stopped from being output to a speaker of the electronic device or to an external electronic device via a wireless communication circuit of the electronic device. The above instructions, when executed by the processor, may cause the electronic device to perform an operation of performing execution of the application using the first display, such that video is output to the first display, and audio is output to the speaker or the external electronic device.

[0146] The above commands, when executed by the processor, may cause the electronic device to suspend execution of the application, thereby stopping a sound indicating an incoming call from being output to a speaker of the electronic device or to be output to an external electronic device via a wireless communication circuit of the electronic device. The above commands, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display, thereby displaying an execution screen of the call application on the first display.

[0147] The above commands, when executed by the processor, may cause the electronic device to stop displaying an image acquired from a camera of the electronic device on the second display as an operation of pausing execution of the application. The above commands, when executed by the processor, may cause the electronic device to stop recording using the camera as an operation of pausing execution of the application. The above commands, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display as an operation of displaying an image acquired from the camera on the first display and to resume recording using the camera. The camera may include a first camera disposed in the second housing, a second camera disposed in the second housing, and a third camera disposed in the first housing. The lens of the first camera may face in the same direction as the direction in which the second display area faces, the lens of the second camera may face in a direction opposite to the direction in which the second display area faces, and the lens of the third camera may face in the same direction as the direction in which the second display faces. The instructions, when executed by the processor, may cause the electronic device to temporarily suspend execution of the application, thereby stopping displaying an image acquired from the third camera on the second display and stopping recording using the third camera. The instructions, when executed by the processor, may cause the electronic device to display an execution screen of the application on the first display, thereby displaying an image acquired from the first camera on the first display and resuming recording using the first camera.

[0148] The at least one sensor may include a first sensor for detecting a first folding state of the first housing and the second housing, and a second sensor for detecting a second folding state of the second housing and the third housing.

[0149] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0150] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0151] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. In one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0152] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0153] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0154] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, A foldable housing comprising: a first housing; a second housing rotatably coupled with the first housing; and a third housing rotatably coupled with the second housing; A first hinge assembly configured to rotatably connect the first housing and the second housing; A second hinge assembly configured to rotatably couple the second housing and the third housing; A first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; A second display disposed on the back surface of the first display and positioned in an opposite direction to the first display area or the second display area; At least one sensor for detecting a folding state of the first housing, the second housing or the third housing; memory for storing instructions; and Contains a processor, The above instructions, when executed by the processor, cause the electronic device to: When the application is executed in the first state where the first housing, the second housing, and the third housing are folded, the execution screen of the application is displayed on the second display, While the application is running, based on data received from the at least one sensor, identifying that at least one of the first housing, the second housing or the third housing is transitioned from a folded state to an unfolded second state; Based on the transition to the second state, execution of the application on the second display is paused, Based on data received from at least one sensor, identifying that the first housing, the second housing and the third housing are transitioned from a folded state to an unfolded third state; An electronic device that displays the execution screen of the application on the first display based on the transition to the third state.

2. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to suspend execution of the application. Stops the video from being output to the second display, An electronic device that stops said audio from being output to a speaker of said electronic device or to an external electronic device via a wireless communication circuit of said electronic device.

3. In the second paragraph, the instructions, when executed by the processor, cause the electronic device to perform an operation of executing the application using the first display. Output the above video to the first display, An electronic device that outputs said audio to said speaker or said external electronic device.

4. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to suspend execution of the application. An electronic device that stops a sound indicating an incoming call from being output to a speaker of said electronic device or to an external electronic device through a wireless communication circuit of said electronic device.

5. In the fourth paragraph, the instructions, when executed by the processor, cause the electronic device to display the execution screen of the application on the first display. An electronic device that displays the execution screen of a calling application on the first display.

6. In the first paragraph, the instructions, when executed by the processor, cause the electronic device to suspend execution of the application. An electronic device that stops an image acquired from a camera of said electronic device from being displayed on said second display.

7. In the 6th paragraph, the instructions, when executed by the processor, cause the electronic device to suspend execution of the application. An electronic device that stops recording using the above camera.

8. In the 7th paragraph, the instructions, when executed by the processor, cause the electronic device to display the execution screen of the application on the first display. Displaying an image acquired from the above camera on the first display, An electronic device that enables recording to be resumed using said camera.

9. In the 8th paragraph, the camera includes a first camera arranged in the second housing, a second camera arranged in the second housing, and a third camera arranged in the first housing. The lens of the first camera faces in the same direction as the direction in which the second display area faces, the lens of the second camera faces in a direction opposite to the direction in which the second display area faces, and the lens of the third camera faces in the same direction as the direction in which the second display faces. The above instructions, when executed by the processor, cause the electronic device to suspend execution of the application, thereby stopping the image acquired from the third camera from being displayed on the second display and stopping recording using the third camera. The above instructions, when executed by the processor, cause the electronic device to display an execution screen of the application on the first display, display an image acquired from the first camera on the first display, and resume recording using the first camera.

10. In the first paragraph, at least one sensor, A first sensor for detecting the first folding state of the first housing and the second housing, and An electronic device comprising a second sensor for detecting a second folding state of the second housing and the third housing.

11. In electronic devices, A foldable housing comprising: a first housing; a second housing rotatably coupled with the first housing; and a third housing rotatably coupled with the second housing; A first hinge assembly configured to rotatably connect the first housing and the second housing; A second hinge assembly configured to rotatably couple the second housing and the third housing; A first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; A second display disposed on the back surface of the first display and positioned in an opposite direction to the first display area or the second display area; At least one sensor for detecting a folding state of the first housing, the second housing or the third housing; memory for storing instructions; and Contains a processor, The above instructions, when executed by the processor, cause the electronic device to: When the application is executed while the first housing, the second housing, and the third housing are unfolded, the execution screen of the application is displayed on the first display, While the application is running, based on data received from the at least one sensor, identifying that the second housing and the third housing are transitioning from an unfolded state to a folded state, Based on the transition of the second housing and the third housing to the folded state, execution of the application is suspended, Based on data received from at least one sensor, identifying that the first housing and the second housing are transitioning from an unfolded state to a folded state; An electronic device that performs execution of the paused application using the second display based on the transition of the first housing and the second housing into a folded state.

12. In the 11th paragraph, the instructions, when executed by the processor, cause the electronic device to suspend execution of the application. Stops the video from being output to the first display, An electronic device that stops said audio from being output to a speaker of said electronic device or to an external electronic device via a wireless communication circuit of said electronic device.

13. In the 11th paragraph, the instructions, when executed by the processor, cause the electronic device to suspend execution of the application. An electronic device that stops an image acquired from a camera of said electronic device from being displayed on said first display.

14. In electronic devices, A foldable housing comprising: a first housing; a second housing rotatably coupled with the first housing; and a third housing rotatably coupled with the second housing; A first hinge assembly configured to rotatably connect the first housing and the second housing; A second hinge assembly configured to rotatably couple the second housing and the third housing; A first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; A second display disposed on the back surface of the first display and positioned in an opposite direction to the first display area or the second display area; At least one sensor for detecting a folding state of the first housing, the second housing or the third housing; memory for storing instructions; and Contains a processor, The above instructions, when executed by the processor, cause the electronic device to: In a state where the first housing, the second housing, and the third housing are unfolded, the first execution screen of the application is displayed in the first display area, the second display area, and the third display area, Based on data received from at least one sensor, identifying that the first housing and the second housing are transitioning from an unfolded state to a folded state; An electronic device that, when the first housing and the second housing are switched to a folded state, reconfigures the layout of the first execution screen based on the size of the third display area to generate a second execution screen and displays the second execution screen in the third display area.

15. In electronic devices, A foldable housing comprising: a first housing; a second housing rotatably coupled with the first housing; and a third housing rotatably coupled with the second housing; A first hinge assembly configured to rotatably connect the first housing and the second housing; A second hinge assembly configured to rotatably couple the second housing and the third housing; A first display including a first display area disposed in the first housing, a second display area disposed in the second housing, and a third display area disposed in the third housing; A second display disposed on the back surface of the first display and positioned in an opposite direction to the first display area or the second display area; At least one sensor for detecting a folding state of the first housing, the second housing or the third housing; memory for storing instructions; and Contains a processor, The above instructions, when executed by the processor, cause the electronic device to: While the first housing, the second housing, and the third housing are in a folded state and the first execution screen of the application is displayed on the second display, based on data received from the at least one sensor, identifying that the first housing and the second housing are transitioning from a folded state to an unfolded state, An electronic device that displays the first execution screen on the first display area of ​​the first display instead of the second display based on the transition of the first housing and the second housing into an unfolded state.

Images