Method for operating display on basis of folding state and foldable electronic device supporting same
The method and device configuration for detecting folding states in multi-foldable electronic devices enable dynamic display control, enhancing user convenience and usability by adapting display operations to different folding states.
Patent Information
- Application Number
- PCT/KR2024/010569
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-11
- Filing Date
- 2024-07-22
- Publication Date
- 2025-01-23
AI Technical Summary
Current foldable electronic devices lack an efficient method to dynamically adjust their display operations based on different folding states, limiting user convenience and flexibility in using multi-foldable devices.
A method and device configuration that detects specific folding angles and states to control the operation mode of a multi-foldable electronic device's display, allowing for switching between display areas on or off, and adjusting the display content accordingly.
Enhances user convenience by improving the usability of multi-foldable electronic devices, providing a new user experience by dynamically adapting the display based on the device's folding state, allowing for optimized use in various configurations.
Smart Images

Figure KR2024010569_23012025_PF_FP_ABST
Abstract
Description
A display operating method based on a folding state and a foldable electronic device supporting the same
[0001] Embodiments of the present disclosure provide a method for controlling the operation of a display according to a folded state (or an unfolded state) and a foldable electronic device supporting the same.
[0002] With the advancement of digital technology, various types of electronic devices, such as smartphones, digital cameras, and / or wearable devices, are becoming widely used. The hardware and / or software components of these electronic devices are continuously being developed to support and enhance their functionality.
[0003] Recent electronic devices may adopt new form factors, such as multi-display (e.g., dual display) devices (e.g., foldable electronic devices). Foldable electronic devices feature a display that can be folded (or bent) (e.g., foldable display or flexible display) and can be used when folded or unfolded. For example, foldable devices may support calls (e.g., regular calls or video calls) while in either the unfolded or folded state.
[0004] Portable electronic devices (hereinafter referred to as "electronic devices"), such as smartphones, have become equipped with a variety of functions. These devices include touchscreen-based displays that allow users to easily access various functions, and can display screens for various applications.
[0005] Electronic devices are evolving beyond the traditional bar form factor and taking on a variety of shapes. Recently, displays have evolved beyond bendable forms to include foldable displays, or displays that can be expanded into sliding or rolling forms. Electronic devices incorporating these displays can offer improved usability depending on the display's state and the device's position.
[0006] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0007] In one embodiment of the present disclosure, a method for detecting a folding state in a specified operating state of a multi-foldable electronic device and providing a different display surface (or display area) for displaying an execution screen (e.g., switching the display area on or off) in response to the folding state of the multi-foldable electronic device and a multi-foldable electronic device supporting the same are provided.
[0008] In one embodiment of the present disclosure, a method for detecting a folding state (e.g., a first folding state and a second folding state) in a specified operating state of a multi-foldable electronic device based on at least two folding angles (e.g., the first folding angle and the second folding angle), and controlling an operating mode of a display surface based on the detected folding state, and an electronic device supporting the same are provided.
[0009] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention belongs from the description below.
[0010] A multi-foldable electronic device according to one embodiment of the present disclosure may include a housing including a first housing, a second housing, and a third housing, a first hinge structure disposed between the first housing and the second housing, a second hinge structure disposed between the second housing and the third housing, a flexible display including a first display area, a second display area, and a third display area, a first sensor detecting a first folding angle between the first housing and the second housing, a second sensor detecting a second folding angle between the second housing and the third housing, at least one processor including processing circuitry, and a memory storing instructions (or commands). In one embodiment, the memory may store instructions that, when individually and / or collectively executed by at least one processor, cause the electronic device to perform an operation.
[0011] According to one embodiment, the instructions, when executed by the at least one processor, may cause the electronic device to detect the start of operation of the multi-foldable electronic device. The instructions, when executed by the at least one processor, may cause the electronic device to determine a designated operational state of the multi-foldable electronic device based on detecting the start of operation. The instructions, when executed by the at least one processor, may cause the electronic device to detect a first folding state between the first housing and the second housing using the first sensor based on determining the designated operational state of the multi-foldable electronic device. The instructions, when executed by the at least one processor, may cause the electronic device to detect a second folding state between the second housing and the third housing using the second sensor based on determining the designated operational state of the multi-foldable electronic device. The instructions, when executed by the at least one processor, may cause the electronic device to turn on or off the first display area, the second display area, or the third display area of the flexible display based on the first folding state and the second folding state.
[0012] A method for operating a multi-foldable electronic device according to one embodiment of the present disclosure may include an operation for detecting the start of operation of the multi-foldable electronic device. The method may include an operation for determining a designated operation state of the multi-foldable electronic device based on the detection of the start of operation. The method may include an operation for detecting a first folding state between a first housing and a second housing using a first sensor based on the determination of the designated operation state of the multi-foldable electronic device. The method may include an operation for detecting a second folding state between a second housing and a third housing using a second sensor based on the determination of the designated operation state of the multi-foldable electronic device. The method may include an operation for controlling a first display area, a second display area, or a third display area of a flexible display to be turned on or off based on the first folding state and the second folding state.
[0013] In order to solve the above-described problem, various embodiments of the present disclosure may include a computer-readable recording medium having recorded thereon a program for executing the method on a processor.
[0014] According to one embodiment, a non-transitory computer-readable recording medium (or storage medium or computer program product) storing one or more programs is described. According to one embodiment, the one or more programs may include instructions that, when executed by at least one processor of a multi-foldable electronic device, perform the following operations: detecting a start of operation of the multi-foldable electronic device; determining a designated operation state of the multi-foldable electronic device based on the detection of the start of operation; detecting a first folding state between a first housing and a second housing using a first sensor based on the determination of the designated operation state of the multi-foldable electronic device; detecting a second folding state between a second housing and a third housing using a second sensor based on the determination of the designated operation state of the multi-foldable electronic device; and controlling a first display area, a second display area, or a third display area of a flexible display to be turned on or off based on the first folding state and the second folding state.
[0015] Further scope of the applicability of the present disclosure will become apparent from the detailed description below. However, since various modifications and variations within the spirit and scope of the present disclosure will readily become apparent to those skilled in the art, it should be understood that the detailed description and specific examples, such as preferred embodiments of the present disclosure, are given by way of example only.
[0016] According to an electronic device, an operating method thereof, and a recording medium according to one embodiment of the present disclosure, a folding state in a specified operating state of the electronic device can be detected, and a display area (or display surface) for a screen can be differently provided (e.g., the display area can be switched on or off) in response to the folding state of the electronic device. According to one embodiment, a folding state in a specified operating state of the electronic device can be detected based on at least two folding angles, and an operating mode of the display surface can be controlled based on the detected folding state, thereby promoting user convenience and improving the usability of the electronic device (e.g., a multi-foldable electronic device) for the user. According to one embodiment, a user's needs for using a multi-foldable electronic device can be satisfied, and a new user experience (UX) according to the use of the multi-foldable electronic device can be provided to the user.
[0017] In addition, various effects may be directly or indirectly realized through this document. The effects obtained through this disclosure are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains, based on the description below.
[0018] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
[0019] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0020] FIG. 2 is a block diagram of a display module according to one embodiment of the present disclosure.
[0021] FIGS. 3A to 3G are drawings illustrating examples of the structure and folding state of an electronic device according to one embodiment of the present disclosure.
[0022] FIG. 4 is a diagram illustrating an example of the structure and operation of an electronic device according to one embodiment of the present disclosure.
[0023] FIG. 5 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0024] FIG. 6 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0025] FIGS. 7A, 7B, 7C, and 7D are diagrams illustrating examples of various folding states of an electronic device according to an embodiment of the present disclosure.
[0026] FIG. 8 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0027] FIG. 9 is a diagram illustrating an example of displaying a designated screen in an intermediate state of an electronic device according to one embodiment of the present disclosure.
[0028] FIG. 10 is a diagram illustrating an example of displaying a designated screen in an intermediate state of an electronic device according to one embodiment of the present disclosure.
[0029] FIG. 11 is a diagram illustrating an example of displaying a designated screen in an intermediate state of an electronic device according to one embodiment of the present disclosure.
[0030] FIG. 12 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.
[0031] FIG. 13 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.
[0032] FIG. 14 is a diagram illustrating an example of supporting screen transition in an electronic device according to one embodiment of the present disclosure.
[0033] FIG. 15 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.
[0034] FIG. 16 is a diagram illustrating an example of a state change in an electronic device according to one embodiment of the present disclosure.
[0035] FIGS. 17A and 17B are diagrams illustrating examples of state changes in an electronic device according to one embodiment of the present disclosure.
[0036] FIG. 18 is a diagram illustrating an example of an operation of operating a display based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0037] FIG. 19 is a flowchart illustrating an operating method of an electronic device according to one embodiment of the present disclosure.
[0038] FIGS. 20A, 20B, 20C, and 20D are diagrams illustrating examples of providing an input interface in an electronic device according to one embodiment of the present disclosure.
[0039] FIG. 21 is a flowchart illustrating an operating method of an electronic device according to one embodiment of the present disclosure.
[0040] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.
[0041] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.
[0042] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0043] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0044] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0045] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0046] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).
[0047] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0048] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0049] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0050] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0051] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0052] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0053] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0054] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0055] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0056] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0057] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0058] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0059] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimizing terminal power and connecting multiple terminals (mMTC, massive machine type communications), or high reliability and low latency communications (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0060] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0061] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0062] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0063] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0064] FIG. 2 is a block diagram (200) of a display module according to one embodiment of the present disclosure.
[0065] Referring to FIG. 2, the display module (160) may include a display (210) and a display driver IC (DDI) (230) for controlling the display (210). The DDI (230) may include an interface module (231), a memory (233) (e.g., a buffer memory), an image processing module (235), or a mapping module (237).
[0066] The DDI (230) may receive, for example, image information including image data or an image control signal corresponding to a command for controlling the image data from another component of the electronic device (101) through the interface module (231). For example, the image information may be received from the processor (120) (e.g., the main processor (121) (e.g., an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit)) that operates independently of the function of the main processor (121). The DDI (230) may communicate with the touch circuit (250) or the sensor module (176) through the interface module (231). In addition, the DDI (230) may store at least a portion of the received image information in the memory (233), for example, on a frame basis.
[0067] The image processing module (235) may, for example, perform pre-processing or post-processing (e.g., resolution, brightness, or size adjustment) on at least a portion of the image data based on at least the characteristics of the image data or the characteristics of the display (210).
[0068] The mapping module (237) can generate a voltage value or a current value corresponding to the image data pre-processed or post-processed through the image processing module (235). According to one embodiment, the generation of the voltage value or the current value can be performed at least in part based on the properties of the pixels of the display (210) (e.g., the arrangement of the pixels (RGB stripe or pentile structure), or the size of each sub-pixel). At least some pixels of the display (210) can be driven at least in part based on the voltage value or the current value, so that visual information (e.g., text, an image, or an icon) corresponding to the image data can be displayed through the display (210).
[0069] According to one embodiment, the display module (160) may further include a touch circuit (250). The touch circuit (250) may include a touch sensor (251) and a touch sensor IC (253) for controlling the same. The touch sensor IC (253) may control the touch sensor (251) to detect, for example, a touch input or a hovering input for a specific location of the display (210). For example, the touch sensor IC (253) may detect a touch input or a hovering input by measuring a change in a signal (e.g., voltage, light quantity, resistance, or charge quantity) for a specific location of the display (210). The touch sensor IC (253) may provide information (e.g., location, area, pressure, or time) regarding the detected touch input or hovering input to the processor (120). According to one embodiment, at least a portion of the touch circuit (250) (e.g., touch sensor IC (253)) may be included as part of the DDI (230), or as part of the display (210), or as part of another component (e.g., auxiliary processor (123)) disposed external to the display module (160).
[0070] According to one embodiment, the display module (160) may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module (176), or a control circuit therefor. In this case, the at least one sensor or the control circuit therefor may be embedded in a part of the display module (160) (e.g., the display (210) or the DDI (230)) or a part of the touch circuit (250). For example, if the sensor module (176) embedded in the display module (160) includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) associated with a touch input through a part of the display (210). As another example, if the sensor module (176) embedded in the display module (160) includes a pressure sensor, the pressure sensor may obtain pressure information associated with a touch input through a part or the entire area of the display (210). According to one embodiment, the touch sensor (251) or sensor module (176) may be positioned between pixels of a pixel layer of the display (210), or above or below the pixel layer.
[0071] Before describing various embodiments of the present disclosure, an electronic device (101) to which an embodiment of the present disclosure can be applied will be described.
[0072] FIGS. 3A to 3G are drawings illustrating examples of the structure and folding state of an electronic device according to one embodiment of the present disclosure.
[0073] Referring to FIGS. 3A to 3G , an electronic device (300) (e.g., the electronic device (101) of FIG. 1 ) may include housings (e.g., foldable housings) (e.g., a first housing, a second housing, and a third housing) that are rotatably coupled to each other to face each other and fold based on a first hinge structure (e.g., a hinge device or a hinge module) and that are rotatably coupled to each other to fold against each other based on a second hinge structure. In one embodiment, the hinge structures may be arranged in the x-axis direction or the y-axis direction. In one embodiment, two or more hinge structures may be arranged to fold in the same direction or in different directions. In one embodiment, the electronic device (300) may include a display (310) (e.g., a flexible display) (e.g., the display module (160) of FIG. 1 or 2 ) that is arranged in an area formed by the housing. In one embodiment, the first housing and the second housing may be disposed on opposite sides about a first folding axis (e.g., the A-axis) and may have a shape that is substantially symmetrical with respect to the first folding axis (e.g., the A-axis). In one embodiment, the second housing and the third housing may be disposed on opposite sides about a second folding axis (e.g., the B-axis) and may have a shape that is substantially symmetrical with respect to the second folding axis (e.g., the B-axis). In one embodiment, the angles or distances between the first housing, the second housing, and the third housing may vary depending on whether the state of the electronic device (300) is a flat state (or unfolded state), a folded state, or an intermediate state.
[0074] In one embodiment, the housing may include a first housing coupled with a first hinge structure (e.g., a first housing structure), a second housing coupled with the first hinge structure and the second hinge structure (e.g., a second housing structure), and a third housing coupled with the second hinge structure (e.g., a third housing structure).
[0075] In one embodiment, the first housing, in an unfolded state, may include a first surface facing a first direction (e.g., a front direction) (e.g., a z-axis direction) and a second surface facing a second direction (e.g., a rear direction) (e.g., a -z-axis direction) opposite the first surface. In one embodiment, the second housing, in an unfolded state, may include a third surface facing a first direction (e.g., a z-axis direction) and a fourth surface facing a second direction (e.g., a -z-axis direction). In one embodiment, the third housing, in an unfolded state, may include a fifth surface facing a first direction (e.g., a z-axis direction) and a sixth surface facing a second direction (e.g., a -z-axis direction).
[0076] In one embodiment, the electronic device (300) can be operated such that, in an unfolded state, a first surface of the first housing, a third surface of the second housing, and a fifth surface of the third housing face substantially the same first direction (e.g., the z-axis direction). In one embodiment, the electronic device (300) can be operated such that, in a folded state, a second surface of the first housing and a fourth surface of the second housing face each other, and a third surface of the second housing and a fifth surface of the third housing face each other.
[0077] In one embodiment, the electronic device (300) may be operated such that, in an unfolded state, the second side of the first housing, the fourth side of the second housing, and the sixth side of the third housing face substantially the same second direction (e.g., the -z-axis direction). In one embodiment, the electronic device (300) may be operated such that, in a folded state, the first side of the first housing and the third side of the second housing face opposite directions, and the fourth side of the second housing and the sixth side of the third housing face opposite directions. For example, in a folded state, the second side and the sixth side may face the second direction (e.g., the -z-axis direction), and the fourth side may face the first direction (e.g., the z-axis direction).
[0078] According to one embodiment, the housings (e.g., the first housing, the second housing, and the third housing) are not limited to the shapes and combinations shown, and may be implemented by other shapes or combinations and / or combinations of parts.
[0079] According to one embodiment, a display (310) (e.g., a flexible display) (e.g., a display module (160) of FIG. 1 or FIG. 2) may be arranged to extend from a first side of the first housing across the first hinge structure and the second hinge structure to at least a portion of a fifth side of the third housing. For example, the display (310) may include a first portion (311) (or first display area) substantially corresponding to a first side (e.g., a first display surface (311)), a second portion (312) (or second display area) corresponding to a third side (e.g., a second display surface (312)), a third portion (313) (or third display area) corresponding to a fifth side (e.g., a third display surface (313), a fourth portion (e.g., a first bendable area) connecting the first portion (311) and the second portion (312) and corresponding to a first hinge structure, and a fifth portion (e.g., a second bendable area) connecting the second portion (312) and the third portion (313) and corresponding to a second hinge structure.
[0080] In one embodiment, the display (310) may be arranged so that, in a folded state, the first display surface (311) is visible from the outside, and the second display surface (312) and the third display surface (313) are not visible from the outside. In one embodiment, the display (310) may be arranged so that, in an intermediate state, at least one of the first display surface (311), the second display surface (312), and the third display surface (313) is at least partially visible from the outside. In one embodiment, the display (301) may be arranged so that, in an unfolded state, the front surfaces of the first display surface (311), the second display surface (312), and the third display surface (313) are visible from the outside.
[0081] According to one embodiment, the camera devices (320, 330) (e.g., the camera module (180) of FIG. 1) may include a first camera device (320) (e.g., a front camera device) disposed on a first surface of a first housing and a second camera device (330) (e.g., a rear camera device) disposed on a sixth surface of a third housing. The electronic device (300) may further include a flash (not shown) disposed near the second camera device. In one embodiment, the camera devices (320, 330) may include one or more lenses, an image sensor, and / or an image signal processor (ISP). The flash may include a luminous element, such as, for example, a light emitting diode (LED), an infrared (IR) LED, a semiconductor laser diode (LD), and / or a xenon lamp. In one embodiment, the camera devices (320, 330) may be arranged such that two or more lenses (e.g., a wide-angle lens, an ultra-wide-angle lens, and / or a telephoto lens) and image sensors are positioned on at least one side (e.g., a first side, a second side, a third side, a fourth side, a fifth side, or a sixth side) of the electronic device (300). In one embodiment, the camera devices (320, 330) may also include lenses and / or image sensors for time of flight (TOF).
[0082] Although not shown, in one embodiment, the electronic device (300) may include at least one of an input device (e.g., a microphone), an audio output device, a sensor module, a key input device, and / or a connector port. In one embodiment, the input device (e.g., a microphone), an audio output device, a sensor module, a camera device (320, 330), a key input device, and / or a connector port may be disposed inside the electronic device (300) and include substantial electronic components that operate through holes or shapes.
[0083] In one embodiment, the input device may include at least one microphone disposed in the housing. In one embodiment, the input device may include a plurality of microphones disposed to detect the direction of sound. In one embodiment, the plurality of microphones may be disposed at appropriate locations in the first housing, the second housing, and / or the third housing. In one embodiment, the audio output device may include speakers. In one embodiment, at least one connector port may be used to transmit and receive power and / or data to and from an external electronic device. In one embodiment, at least one connector port (e.g., an ear jack hole) may accommodate a connector (e.g., an ear jack) for transmitting and receiving audio signals to and from the external electronic device. In one embodiment, the input device, the audio output device, and the connector port may be disposed in a space provided in the first housing, the second housing, and / or the third housing of the electronic device (300), and may be exposed to the external environment through at least one hole formed in the first housing, the second housing, and / or the third housing.
[0084] According to one embodiment, the sensor module may generate an electrical signal or data value corresponding to an internal operating state of the electronic device (300) or an external environmental state. The sensor module may detect an external environment, for example, through a first surface of the first housing. In one embodiment, the electronic device (300) may further include at least one sensor module arranged to detect an external environment through a sixth surface of the third housing. In one embodiment, the sensor module (e.g., an illuminance sensor) may be arranged under the display (310) to detect an external environment through the display (310). In one embodiment, the sensor module may include at least one of a gesture sensor, a gyro sensor, a barometer sensor, a magnetic sensor, an acceleration sensor, a hall sensor, a grip sensor, a color sensor (e.g., a red, green, blue (RGB) sensor), an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, an illuminance sensor (or ambient light sensor (ALS)), a proximity sensor, and / or an ultrasonic sensor.
[0085] According to one embodiment, a key input device (e.g., a key button) may be positioned on at least one side of the first housing and / or the third housing. In one embodiment, the electronic device (300) may not include some or all of the key input devices, and the key input devices that are not included may be implemented in another form, such as a soft key, on the display (310). In one embodiment, the key input device may be implemented using a pressure sensor included in the display (310).
[0086] According to one embodiment, some of the camera devices (320, 330) (e.g., the first camera device (320)) and / or the sensor module may be arranged to be exposed through the display (310). For example, the first camera device (320) and / or the sensor module may be arranged to be in contact with the external environment through an opening (e.g., a through hole) at least partially formed in the display (310) in the internal space of the electronic device (300). For example, some of the sensor modules may be arranged to perform their functions without being visually exposed through the display (310) in the internal space of the electronic device (300). For example, in this case, the opening may be omitted from the area of the display (310) that faces the sensor module.
[0087] According to one embodiment, the electronic device (300) may be operated to maintain an intermediate state through a hinge structure (e.g., a first hinge structure and / or a second hinge structure). In this case, the electronic device (300) may control the display (310) to display different contents on a first display area (e.g., a first display area (311)) corresponding to a first side of a first housing, a second display area (e.g., a second display area (312)) corresponding to a third side of a second housing, and / or a third display area (e.g., a third display area (313)) corresponding to a fifth side of a third housing. In one embodiment, the electronic device (300) may be operated in a substantially unfolded state and / or a substantially folded state based on a predetermined inflection angle (e.g., an angle between the first housing and the second housing and / or an angle between the second display surface (312) and the third display surface (313) when in an intermediate state) via a hinge structure. For example, the electronic device (300) may be operated to transition to an unfolded state when a pressure is applied in the unfolding direction from an intermediate state in which the electronic device is unfolded at a predetermined inflection angle via the hinge structure. For example, the electronic device (300) may be operated to transition to a folded state when a pressure is applied in the folding direction from an intermediate state in which the electronic device is unfolded at a predetermined inflection angle via the hinge structure. In one embodiment, the electronic device (300) may also be operated to maintain an unfolded state (not shown) at various angles via the hinge structure.
[0088] Referring to FIG. 3A, an electronic device (300) according to one embodiment (e.g., the electronic device (101) of FIG. 1) may include a first housing, a second housing, a third housing, and a display (310). According to one embodiment, the electronic device (101) may include at least a portion of the structure and / or function of the electronic device (101) of FIG. 1. In one embodiment, the first housing, the second housing, and the third housing may correspond to individual housings of the housing structure, and may be folded around at least one axis (e.g., the A-axis and the B-axis of FIG. 3A) so that at least a portion thereof overlaps.
[0089] In one embodiment, the first housing may include a first side and a second side. In one embodiment, the second housing may include a third side and a fourth side. In one embodiment, the third housing may include a fifth side and a sixth side. For example, when the display (310) (e.g., a flexible display) (e.g., the display module (160) of FIG. 1 or 2) of the electronic device (300) is folded (e.g., out-folded) based on a first folding axis (e.g., A-axis), the first side of the first housing may face the third side of the second housing, and the second side of the first housing and the fourth side of the second housing may face each other and be folded. For example, when the display (310) of the electronic device (300) is folded (e.g., in-folded) based on a second folding axis (e.g., B-axis), the third side of the second housing and the fifth side of the third housing may face each other, and the fourth side of the second housing and the sixth side of the third housing may face each other and be folded.
[0090] In one embodiment, the unfolded state may mean an open state, an open state, or a flat state. In one embodiment, the unfolded state may mean a state in which the first housing, the second housing, and the third housing are arranged side by side, and the electronic device (300) is completely unfolded. In one embodiment, the unfolded state may mean an angle between the first housing, the second housing, and the third housing is approximately 180 degrees, and the first side of the first housing, the third side of the second housing, and the fifth side of the third housing may be arranged to face the same direction (e.g., the first direction).
[0091] In one embodiment, the folded state may mean a closed state or a closed state. In one embodiment, the folded state may mean a state in which the first housing (e.g., the second side of the first housing) and the second housing (e.g., the fourth side of the second housing) are arranged to face each other, and the second display surface (312) and the third display surface (313) are arranged to face each other, and the electronic device (300) is completely folded. In one embodiment, the folded state may indicate a state in which the electronic device (300) is completely folded based on the first folding axis (e.g., the A axis) and the second folding axis (e.g., the B axis). In one embodiment, the folded state is such that the first housing and the second housing are folded (e.g., out-folded) about a first folding axis (e.g., A-axis) and the angle between the first housing and the second housing forms a specified angle (e.g., a narrow angle, from about 0 degrees to about 5 degrees), such that the second side of the first housing and the fourth side of the second housing can face each other. In one embodiment, the folded state is such that the second display surface (312) and the third display surface (313) are folded (e.g., in-folded) about a second folding axis (e.g., B-axis) and the angle between the second display surface (312) and the third display surface (313) forms a specified angle (e.g., a narrow angle, from about 0 degrees to about 5 degrees), such that the second display surface (312) and the third display surface (313) can face each other.
[0092] In one embodiment, the intermediate state is a state in which the first housing and the second housing are arranged at a certain angle, and / or the second housing and the third housing are arranged at a certain angle, and the electronic device (300) may not be in an unfolded or folded state. In one embodiment, the intermediate state may mean a state in which the second side of the first housing and the fourth side of the second housing form a certain angle (e.g., about 6 degrees to about 179 degrees), or a state in which the third side of the second housing (e.g., the second display side (312)) and the fifth side of the third housing (e.g., the third display side (313)) form a certain angle (e.g., about 6 degrees to about 179 degrees).
[0093] In one embodiment, the intermediate state may include a state that is folded about a first folding axis (e.g., the A-axis) and unfolded about a second folding axis (e.g., the B-axis). In one embodiment, the intermediate state may include a state that is not folded about the first folding axis (e.g., the A-axis) and folded only about the second folding axis (e.g., the B-axis). In one embodiment, the intermediate state may include a state that is at least partially unfolded about the first folding axis (e.g., the A-axis) and the second folding axis (e.g., the B-axis).
[0094] In one embodiment, the first housing may be positioned to the left with respect to the first folding axis (e.g., the A-axis), and the second housing may be positioned to the right with respect to the first folding axis (e.g., the A-axis). In one embodiment, the second housing may be positioned to the left with respect to the second folding axis (e.g., the B-axis), and the third housing may be positioned to the right with respect to the second folding axis (e.g., the B-axis). In one embodiment, the first housing and the second housing may be designed to fold relative to each other, and the second housing and the third housing may be designed to fold relative to each other.
[0095] According to one embodiment, hinges may be formed between the first housing and the second housing and between the second housing and the third housing, respectively. According to one embodiment, the first housing, the second housing, and the third housing of the electronic device (300) may be folded or unfolded by the hinges formed between the individual housings (e.g., the first housing, the second housing, and the third housing) of the housing structure, respectively. In one embodiment, the housing structure in which the electronic device (300) is arranged left and right with respect to the folding axis (e.g., the A-axis and the B-axis) is merely an example, and the electronic device (300) may have housings arranged up and down with respect to the folding axis.
[0096] According to one embodiment, the electronic device (300) (e.g., a foldable electronic device) may include a form factor (e.g., a multi-foldable electronic device) that includes three display surfaces (e.g., a first display surface (311), a second display surface (312), and a third display surface (313)) (or three housings) based on two folding axes (e.g., an A-axis and a B-axis). Various embodiments are not limited to this, and this is exemplary, and the number of folding axes that the electronic device (300) may have is not limited. According to one embodiment, the electronic device (300) may be folded or unfolded in various ways (e.g., an in-folding manner, an out-folding manner, or an in / out folding manner) depending on the implementation form of the display (310) (e.g., the display module (160) of FIG. 1). According to one embodiment, the electronic device (300) may include a multi-foldable electronic device comprising N (e.g., N is a natural number greater than or equal to 2) hinge structures (e.g., N folding axes) and N+1 housings.
[0097] According to one embodiment, the unfolded state (e.g., unfolded state) of the display (310) may mean a state in which the first housing, the second housing, and the third housing are arranged side by side, and the electronic device (300) is completely unfolded. For example, the electronic device (300) may form the display (310) on the first side, the third side, and the fifth side, which are the front sides of the electronic device (300). The display (310) may be formed entirely on the front side (e.g., the first direction of the electronic device (300). In one embodiment, the display (310) may include a flexible display in which at least a portion of the display may be transformed into a flat or curved surface. According to one embodiment, the display (310) may be folded left and right or up and down based on the folding axis. According to one embodiment, the display (300) may include a first display surface (311) corresponding to the first side, a second display surface (312) corresponding to the third side, and a third display surface (313) corresponding to the fifth side.
[0098] According to one embodiment, the unfolded state (e.g., partially unfolded state) of the display (310) may include an intermediate state in which the display (310) is only partially unfolded. The intermediate state in which the display (310) is only partially unfolded may include a state in which the second housing and the third housing are arranged side by side, and the first housing and the second housing are folded. According to one embodiment, the intermediate state in which the display (310) is only partially unfolded may include a state in which the second housing and the third housing are folded, and the first housing and the second housing are unfolded at a certain angle. According to one embodiment, the intermediate state in which the display (310) is only partially unfolded may include a state in which the first housing and the second housing are unfolded at a certain angle, and the second housing and the third housing are unfolded at a certain angle.
[0099] According to one embodiment, FIGS. 3B to 3F may illustrate various examples of a posture (e.g., an intermediate state) of an electronic device (300) (e.g., a foldable electronic device) according to one embodiment. According to one embodiment, FIG. 3G may illustrate an example of a posture (e.g., an unfolded state) of an electronic device (300) (e.g., a foldable electronic device) according to one embodiment. According to one embodiment, the electronic device (300) may sense a folding angle of the electronic device (300) (e.g., a folding angle of the display (310)) through an angle detection sensor (e.g., a first sensor for detecting a first folding angle and a second sensor for detecting a second folding angle).
[0100] Referring to FIG. 3B, the intermediate state illustrated in FIG. 3B may represent, for example, a state in which the in-folding angle of the electronic device (300) is about 90 degrees or more and about 135 degrees or less with respect to the second folding axis (e.g., B-axis) and the out-folding angle is about 10 degrees or more and about 90 degrees or less with respect to the first folding axis (e.g., A-axis). According to one embodiment, when the electronic device (300) is in the intermediate state illustrated in FIG. 3B, the first display surface (311) of the display (310) may be turned off (or deactivated), and the second display surface (312) may be turned on (or activated). According to one embodiment, the third display surface (313) may be arranged to face the first direction (e.g., z-axis direction) and may be selectively turned on / off. In one embodiment, the third display surface (313) may be turned on when proximity (e.g., hovering) of an object (e.g., a user's hand or a digital pen) is detected, and turned off when proximity of an object is not detected.
[0101] According to one embodiment, the electronic device (300) can determine whether the third display surface (313) of the display (310) faces upward (e.g., in the first direction) (or whether the sixth surface faces downward (e.g., in the second direction)) when in the intermediate state illustrated in FIG. 3B. For example, the electronic device (101) can determine the result of sensing the posture of the electronic device (300) through a gravity sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (300) can operate to determine whether the results of determining the folding angle and the posture of the electronic device (300) match a pre-stored state.
[0102] Referring to FIG. 3C, the intermediate state illustrated in FIG. 3C may represent, for example, a state in which the in-folding angle of the electronic device (300) is about 90 degrees or more and about 179 degrees or less with respect to the second folding axis (e.g., B-axis), and the out-folding angle is about 180 degrees with respect to the first folding axis (e.g., A-axis). According to one embodiment, when the electronic device (300) is in the intermediate state illustrated in FIG. 3C, the first display surface (311) and the second display surface (312) of the display (310) may be turned on (or activated). According to one embodiment, the third display surface (313) may be arranged to face the first direction (e.g., z-axis direction) and may be selectively turned on / off.
[0103] According to one embodiment, the electronic device (300) can determine whether the third display surface (313) of the display (310) faces upward (e.g., in the first direction) (or whether the sixth surface faces downward (e.g., in the second direction)) when in the intermediate state illustrated in FIG. 3C. For example, the electronic device (300) can determine the result of sensing the posture of the electronic device (300) through a gravity sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (300) can operate to determine whether the results of determining the folding angle and the posture of the electronic device (300) match a specified state.
[0104] Referring to FIG. 3D, the intermediate state illustrated in FIG. 3D may be, for example, an in-folding angle of the electronic device (300) of about 180 degrees and an out-folding angle of about 1 degree or more and 90 degrees or less with respect to the second folding axis (e.g., B-axis). According to one embodiment, in the intermediate state illustrated in FIG. 3D, the first display surface (311) of the display (310) may be arranged to face the second direction (e.g., -z-axis direction) and may be turned off (or deactivated). According to one embodiment, the second display surface (312) and the third display surface (313) may be turned on (or activated).
[0105] According to one embodiment, the electronic device (300) can determine whether the first display surface (311) of the display (310) faces downward (e.g., in the second direction) (or whether the second surface faces upward (e.g., in the first direction)) when in the intermediate state illustrated in FIG. 3D. For example, the electronic device (300) can determine the result of sensing the posture of the electronic device (300) through a gravity sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (300) can operate to determine whether the results of determining the folding angle and the posture of the electronic device (300) match a specified state.
[0106] Referring to FIG. 3E, the intermediate state illustrated in FIG. 3E may represent, for example, an example of a state in which the in-folding angle of the electronic device (300) is about 90 degrees or more and about 135 degrees or less with respect to the second folding axis (e.g., B-axis). According to one embodiment, when the electronic device (300) is in the intermediate state illustrated in FIG. 3E, the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) may be turned on (or activated). According to one embodiment, the first display surface (311) and the second display surface (312) may be arranged to face a first direction (e.g., z-axis direction).
[0107] According to one embodiment, the electronic device (300) can determine whether the first display surface (311) and the second display surface (312) of the display (310) are facing upward (e.g., in the first direction) (or whether the second surface and the fourth surface are facing downward (e.g., in the second direction)) when in the intermediate state illustrated in FIG. 3E. For example, the electronic device (300) can determine the result of sensing the posture of the electronic device (300) through a gravity sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (300) can operate to determine whether the result of checking the folding angle and the posture of the electronic device (300) matches a pre-stored state.
[0108] Referring to FIG. 3F, the intermediate state illustrated in FIG. 3F may represent, for example, a state in which the in-folding angle of the electronic device (300) is about 180 degrees with respect to the second folding axis (e.g., B-axis) and the out-folding angle is about 0 degrees with respect to the first folding axis (e.g., A-axis). According to one embodiment, when the electronic device (300) is in the intermediate state illustrated in FIG. 3F, the first display surface (311) of the display (310) may be off (or deactivated), and the second display surface (312) and the third display surface (313) may be on (or activated). According to one embodiment, the second display surface (312) and the third display surface (313) may be arranged to face a first direction (e.g., z-axis direction), and the first display surface (311) may be arranged to face a second direction (e.g., -z-axis direction).
[0109] According to one embodiment, the electronic device (300) can determine whether the first display surface (311) of the display (310) faces downward (e.g., in the second direction) (or whether the second surface faces upward (e.g., in the first direction)) when in the intermediate state illustrated in FIG. 3F. For example, the electronic device (300) can determine the result of sensing the posture of the electronic device (300) through a gravity sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (300) can operate to determine whether the results of determining the folding angle and the posture of the electronic device (300) match a pre-stored state.
[0110] Referring to FIG. 3G, the folding state illustrated in FIG. 3G may represent, for example, an unfolded state. For example, the unfolded state may represent a state in which the out-folding angle of the electronic device (101) is about 180 degrees with respect to the first folding axis (e.g., the A-axis) and the in-folding angle of the electronic device (101) is about 180 degrees with respect to the second folding axis (e.g., the B-axis). According to one embodiment, when the electronic device (300) is in the unfolded state illustrated in FIG. 3G, the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) may be turned on (or activated). According to one embodiment, the first display surface (311), the second display surface (312), and the third display surface (313) may be arranged to face a first direction (e.g., the z-axis direction).
[0111] According to one embodiment, the electronic device (300) can determine whether the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) are facing upward (e.g., in the first direction) or downward (e.g., in the second direction) when in the unfolded state illustrated in FIG. 3g. For example, the electronic device (300) can determine the result of sensing the posture of the electronic device (300) through a gravity sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (300) can operate to determine whether the results of determining the folding angle and the posture of the electronic device (300) match a specified state.
[0112] According to one embodiment, when the electronic device (101) is in a folded state, the first display surface (311) of the display (310) may be turned on (or activated), and the second display surface (312) and the third display surface (313) may be turned off (or deactivated). According to one embodiment, when no user input (e.g., touch, button selection) is detected for a certain period of time (e.g., about 5 seconds, about 10 seconds, about 1 minute) while the first display surface (311) is turned on, the electronic device (300) may turn off the first display surface (311). According to one embodiment, when a user input (e.g., touch, button selection) is detected on the first display surface (311) while the first display surface (311) is turned off, the electronic device (300) may turn on the first display surface (311). According to one embodiment, the first display surface (311) can be turned on based on a user input or a specified action of the electronic device (300) (e.g., a video capturing action) when the electronic device (300) is in a folded state.
[0113] According to one embodiment of the present disclosure, the electronic device (300) may display a display screen of the display (310) in a divided manner in response to a specified state that matches a change in the state of the display (310) and a confirmation result regarding the posture of the electronic device (310). For example, the electronic device (300) may display a running screen (e.g., UI (user interface) / UX (user experience)) of a specified application in a divided manner based on a folding axis (e.g., A-axis and / or B-axis). According to one embodiment, the electronic device (300) may display a running screen based on a display surface corresponding to a user's gaze direction on the display (310), and may operate to display an input device (e.g., an input screen of a keypad for inputting message content) related to the running screen on a display surface facing a first direction (e.g., z-axis direction).
[0114] Although the electronic device (300) according to the embodiment disclosed in this document (e.g., the electronic device (101) of FIG. 1) is described as an example of a foldable electronic device (e.g., a smart phone) having a foldable form factor, the electronic device (101) according to one embodiment and its operation are not limited thereto. For example, the electronic device (300) may be various types of electronic devices, such as a tablet PC (personal computer), a laptop PC (personal computer), and / or a display device (e.g., a TV and / or a monitor) having a foldable form factor, and may also be operated by the same. In one embodiment, the electronic device (300) may be capable of folding and unfolding operations based on at least two hinge structures, may have a folded state, an intermediate state, and an unfolded state, and may include various form factors in which a flexible display is arranged. For example, the electronic device (300) may include a multi-foldable electronic device composed of N (e.g., N is a natural number greater than or equal to 2) hinge structures (e.g., N folding axes) and N+1 housings.
[0115] FIG. 4 is a diagram illustrating an example of the structure and operation of an electronic device according to one embodiment of the present disclosure.
[0116] According to one embodiment, FIG. 4 may illustrate an example of changing the shape (e.g., folding state) of a display (310) in an electronic device (101) according to one embodiment. According to one embodiment, as in the example illustrated in FIG. 4, the electronic device (101) may have the display (310) folded and unfolded in various ways depending on the implementation form of the electronic device (101).
[0117] The example of the electronic device (101) illustrated in FIG. 4 may represent an example in which the electronic device (101) has two folding axes. For example, FIG. 4 may represent an example of changing the shape of the display (310) in an electronic device (101) including three display surfaces (e.g., a first display surface (311), a second display surface (312), and a third display surface (313)). Various embodiments are not limited to this, and this is an example, and the number of folding axes that the electronic device (101) may have is not limited.
[0118] According to one embodiment, the electronic device (101) may include a foldable electronic device capable of being folded and unfolded. According to one embodiment, the electronic device (101) may be equipped with a foldable (or bendable) display (310) (e.g., a foldable display or a flexible display) and may be used by folding or unfolding.
[0119] According to one embodiment, the electronic device (101) may be an in / out-folding type electronic device (101) (e.g., a multi-foldable electronic device) that individually or simultaneously supports an in-folding type and an out-folding type. According to one embodiment, the in / out-folding type electronic device (101) may be in a closed state such that when folded (e.g., a folded state based on the shape of FIG. 4), at least a portion of a first part (e.g., a first housing) and a second part (e.g., a second housing) of a housing may be in contact with each other based on a first point (e.g., a first folding axis) at which the device is folded (e.g., an out-folding), and at least a portion of a second display surface (312) (or a second region) and a third display surface (313) (or a third region) of a display (310) may be in contact with each other based on a second point (e.g., a second folding axis) at which the device is folded (e.g., an in-folding).
[0120] According to one embodiment, when the electronic device (101) is unfolded (e.g., in an unfolded state), the electronic device (101) may provide all display surfaces (or areas) of the display (310) as one surface (or the entire surface) to enable the display to be used in a relatively large size. According to one embodiment, when the electronic device (101) is partially unfolded (e.g., in an intermediate state), the electronic device (101) may provide at least one display surface (or area) of the display (310) as a display area. According to one embodiment, FIG. 4 may represent a folding state corresponding to an intermediate state in which the display (310) of the electronic device (101) is folded by less than a certain angle (e.g., about 180 degrees) with respect to a folding axis (or hinge axis) (e.g., a first folding axis and a second folding axis).
[0121] According to one embodiment, an electronic device (101) such as the example of FIG. 4 may include a processor (e.g., processor (120) of FIG. 1) and a display driver IC (DDI) (e.g., DDI (230) of FIG. 2) operatively or electrically connected to a display (310). For example, a first display surface (311), a second display surface (312), and a third display surface (313) may be connected to a single DDI.
[0122] Embodiments of the present disclosure are not limited thereto, and the electronic device (101) may include a first DDI operatively or electrically connected to a first display surface (311) (or a first display), a second DDI operatively or electrically connected to a second display surface (312) (or a second display), and a third DDI operatively or electrically connected to a third display surface (313) (or a third display). In one embodiment, the first display surface (311), the second display surface (312), and the third display surface (313) may be operatively or electrically connected to each other and may be formed by a single display (310) (e.g., a foldable display or a flexible display).
[0123] According to one embodiment of the present disclosure, the electronic device (101) may have a display (310) that can be folded or unfolded in various ways (e.g., in-folding, out-folding, or in / out folding) depending on the implementation form.
[0124] Referring to FIG. 4, the electronic device (101) may include a housing (450) (e.g., a first housing (451), a second housing (453), and a third housing (455)) that secures a display (310) including a first display surface (311) (or a first region), a second display surface (312) (or a second region), and a third display surface (313) (or a third region). According to one embodiment, the housing (450) may include a foldable structure (e.g., a hinge structure). When the electronic device (101) is folded, the first part (401) and the third part (405) may face away from each other in opposite directions from the second part (403), and the first part (401) and the third part (405) may face in the same direction. When the electronic device (101) is in an unfolded state, the first part (401), the second part (403), and the third part (405) can be formed to face the same direction.
[0125] According to one embodiment, FIG. 4 may illustrate an example of an electronic device (101) including two folding axes (490, 495) (e.g., an A-axis and a B-axis). In FIG. 4, the two folding axes (490, 495) may be employed to divide the electronic device (101) (or display (310)) into three equal parts. The electronic device (101) may be folded, unfolded, or bent about the folding axes (490, 495). According to one embodiment, FIG. 4 may represent a configuration in which a first display surface (311) of a display (310) of an electronic device (101) is folded outward so as to be visually exposed to the outside of the electronic device (101) (e.g., an out-folding configuration), and a second display surface (312) and a third display surface (313) of the display (310) are folded inward so as not to be exposed to the outside of the electronic device (101) (e.g., an in-folding configuration). In one embodiment, the electronic device (101) illustrated in FIG. 4 may represent an example of a Z-type foldable electronic device, and may represent an intermediate state (e.g., a partially folded state or a partially unfolded state) when viewed from the front of the electronic device (101) and a folded state when viewed from the side of the electronic device (101).
[0126] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 4, when the electronic device (101) is completely folded (e.g., in a folded state or a folded state), it may mean that any two parts included in the display (310) of the electronic device (101) face each other (or face each other) so that the two parts become completely parallel or nearly parallel, and any two parts included in the housing (450) face each other (or face each other) so that the two parts become completely parallel or nearly parallel. For example, when the electronic device (101) is completely folded, it may mean that two parts of the electronic device (101) do not necessarily have to be in contact, but are arranged in close proximity.
[0127] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 4, the electronic device (101) being fully unfolded (e.g., in an unfolded state or an unfolded state) may indicate a state in which a first display surface (311) of a display (310) of the electronic device (101), a second display surface (312) of the display (310), and a third display surface (313) of the display (310) are visually exposed to the outside and form a flat surface like a single display (310), and the area of the display (310) exposed to the outside is the largest or close to the largest area.
[0128] As illustrated in FIG. 4, the electronic device (101) may be folded or bent in different directions based on each folding axis (490, 495). This is exemplary, and the electronic device (101) may be folded or bent in the same direction based on each folding axis (490, 495). According to one embodiment, the electronic device (101) may be folded such that the first display surface (311) of the display (310) is exposed to the outside, the back surface (e.g., the first housing (451)) of the first display surface (311) and the back surface (e.g., the second housing (453)) of the second display surface (312) and the third display surface (313) of the display (310) face each other.
[0129] According to one embodiment, depending on where the two folding axes (490, 495) are employed on the electronic device (101), the electronic device (101) may be folded or bent asymmetrically with respect to each folding axes (490, 495), and even when the electronic device (101) is completely folded with respect to the folding axes (490, 495), each display surface (or each area) of the electronic device (101) defined by the folding axes (490, 495) may not completely overlap. According to one embodiment, even when the electronic device (101) is provided with the folding axes (490, 495) as illustrated in FIG. 4, the display (310) may be employed on the front and / or back of the electronic device (101).
[0130] According to one embodiment, the electronic device (101) can detect a folding state (or degree of folding) (e.g., a folded state, an intermediate state, or an unfolded state) of the electronic device (101). According to one embodiment, the electronic device (101) can detect the folding state based on a first folding angle based on a folding axis of a first hinge structure and a second folding angle based on a folding axis of a second hinge structure. According to one embodiment, the electronic device (101) can detect the folding state and activate or deactivate at least a portion of the display surface (or a portion of the display surface) of the display (310).
[0131] According to one embodiment, when the electronic device (101) detects a folded state, it may deactivate all display surfaces (e.g., the first display surface (311), the second display surface (312), and the third display surface (313)) of the display (310). According to one embodiment, when the electronic device (101) detects a folded state, it may activate a display surface used by the electronic device (101) (e.g., the first display surface (311)) and deactivate display surfaces not used (e.g., the second display surface (312) and the third display surface (313)). According to one embodiment, when the electronic device (101) detects an intermediate state, it may activate / deactivate at least one display surface (e.g., the first display surface (311), the second display surface (312), and / or the third display surface (313)) of the display (310) depending on the folded state of the electronic device (101).
[0132] According to one embodiment, the electronic device (101) can detect a change in shape (e.g., folding or unfolding) of the display (210) based on various methods.
[0133] According to one embodiment, the electronic device (101) may include a state detection sensor and an angle detection sensor based on at least one sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (101) may determine a posture (or operation mode) of the electronic device (101) based on first sensor data sensed by the state detection sensor. According to one embodiment, the electronic device (101) may determine a folding angle (or folding state) of the electronic device (101) based on second sensor data sensed by the angle detection sensor.
[0134] According to one embodiment, the electronic device (101) may include a first sensor (e.g., a first angle detection sensor) that detects a first folding angle of a first folding axis (or a first hinge structure) and a second sensor (e.g., a second angle detection sensor) that detects a second folding angle of a second folding axis (or a second hinge structure). For example, the electronic device (101) may determine a first folding angle between the first housing (451) and the second housing (453) with respect to the first folding axis (e.g., the A-axis) based on sensor data sensed by the first sensor. For example, the electronic device (101) may determine a second folding angle between the second housing (453) and the third housing (455) (or between the second display surface (312) and the third display surface (313)) with respect to the second folding axis (e.g., the B-axis) based on sensor data sensed by the second sensor.
[0135] In one embodiment, the state detection sensor may include at least one or a combination of a grip sensor, an inertial sensor, a proximity sensor, an ambient light sensor, a magnetic sensor, a Hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, or an infrared camera. In one embodiment, the angle detection sensor may include at least one or a combination of an inertial sensor, a Hall sensor, a magnetic sensor, or a bending sensor. According to one embodiment, an angle detection sensor may be positioned on any side of the electronic device (101) (e.g., the folding axis, the housing end, the bottom of the display (310) (e.g., under the panel, and / or the bezel of the display (310)) to measure a folding angle of the electronic device (101). The folding angle may represent an angle formed by two display surfaces of the electronic device (101) divided by the folding axis with the folding axis. According to one embodiment, the electronic device (101) may measure the folding angle to determine whether the electronic device (101) is in a fully folded state, a fully unfolded state, or an intermediate state unfolded (or folded) at a certain angle.
[0136] According to one embodiment, the electronic device (101) may determine that the display (310) of the electronic device (101) is fully unfolded (e.g., in an unfolded state) when the folding angle (or folding angle or unfolding angle) measured by the electronic device (101) is approximately 180 degrees or an angle close thereto. According to one embodiment, the electronic device (101) may determine that the display (310) of the electronic device (101) is fully folded (e.g., in a folded state) when the folding angle measured by the electronic device (101) is approximately 0 degrees or an angle close thereto.
[0137] According to one embodiment, the electronic device (101) may determine that the display (310) of the electronic device (101) is in a partially folded (or partially unfolded) intermediate state when the first folding angle and / or the second folding angle measured by the electronic device (101) is equal to or greater than a first specified angle (e.g., an angle at which a user's field of view is guaranteed in an intermediate state (e.g., about 90 degrees)) and less than a second specified angle (e.g., about 180 degrees). For example, the electronic device (101) may determine that the display (310) of the electronic device (101) is folded, bent, or unfolded to a predetermined degree when the measured folding angle is within a predetermined angle range (e.g., the first specified angle (e.g., about 90 degrees) ≤ folding angle < the second specified angle (e.g., about 180 degrees)) based on sensor data acquired from at least one sensor of the angle detection sensor (e.g., the first sensor or the second sensor).
[0138] FIG. 5 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0139] Referring to FIG. 5, an electronic device (101) according to one embodiment of the present disclosure may include a display (310) (e.g., the display module (160) of FIG. 1), a sensor circuit (550) (e.g., the sensor module (176) of FIG. 1), a memory (130) (e.g., the memory (130) of FIG. 1), and / or a processor (120) (e.g., the processor (120) of FIG. 1). According to one embodiment, the electronic device (101) may include all or at least a part of the components of the electronic device (101) as described in the description with reference to FIG. 1.
[0140] According to one embodiment, the display (310) may include a configuration identical or similar to the display module (160) of FIG. 1 or 2. According to one embodiment, the display (310) may include a first display surface (311), a second display surface (312), and a third display (313), and may visually provide various information to the outside of the electronic device (101) (e.g., a user) through at least one display surface based on a folding state. According to one embodiment, the display (310) may, under the control of the processor (120), visually provide an application being executed (e.g., the application (146) of FIG. 1) and various screens related to the use thereof (e.g., a contents screen, an application execution screen, and / or a function execution screen).
[0141] According to one embodiment, the display (310) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of a touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic stylus pen. According to one embodiment, the display (310) may detect a touch input, an air gesture input, and / or a hovering input (or a proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge) for a specific location of the display (310) based on the touch sensor, the pressure sensor, and / or the touch panel. According to one embodiment, the display (310) may include a liquid crystal display (LCD), an organic light emitting diode (OLED), and / or an active matrix organic light emitting diode (AMOLED). According to one embodiment, the display (310) may include a flexible display.
[0142] According to one embodiment, the sensor circuit (550) may correspond to the sensor module (176) of FIG. 1. According to one embodiment, the sensor circuit (550) may include a first sensor circuit (560) and a second sensor circuit (570).
[0143] According to one embodiment, the first sensor circuit (560) may include a state detection sensor that detects a posture (or operational state) of the electronic device (101). In one embodiment, the state detection sensor may include, for example, at least one or a combination of a grip sensor, an inertial sensor, a proximity sensor, an illuminance sensor, a magnetic sensor, a hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, or an infrared camera. According to one embodiment, the first sensor circuit (560) may be located on any one side of the electronic device (101) (e.g., at the bottom of the display (e.g., under the panel) and / or the housing) to measure the posture of the electronic device (101). According to one embodiment, the processor (120) of the electronic device (101) can determine a specified state (e.g., portrait mode, grip state, desk mode, and / or resting state) of the electronic device (101) based on sensor data (e.g., posture information) using the first sensor circuit (560) (e.g., state detection sensor).
[0144] In one embodiment, the second sensor circuit (570) may include an angle detection sensor that detects a folding state (or folding angle) of the electronic device (101). In one embodiment, the angle detection sensor may include, for example, at least one or a combination of an inertial sensor, a Hall sensor, a magnetic sensor, or a bending sensor.
[0145] According to one embodiment, the angle detection sensor may include a first sensor for detecting a first folding angle between the first housing and the second housing (e.g., the first hinge structure) and a second sensor for detecting a second folding angle between the second housing and the third housing (e.g., the second hinge structure). According to one embodiment, the second sensor circuit (570) may be located on any one side of the electronic device (101) (e.g., the folding axis, the housing end, the bottom of the display (e.g., under the panel), and / or the bezel of the display (310)) to measure the folding angle (or folding state) of the electronic device (101). According to one embodiment, the processor (120) of the electronic device (101) can determine a specified state (e.g., a folding state) of the electronic device (101) based on sensor data (e.g., a first folding angle and a second folding angle) using a second sensor circuit (570) of the sensor circuit (550) (e.g., an angle detection sensor).
[0146] According to one embodiment, the memory (130) may correspond to the memory (130) of FIG. 1. According to one embodiment, the memory (130) may store various data used by the electronic device (101). In one embodiment, the data may include, for example, input data or output data for an application (e.g., a program (140) of FIG. 1) and commands related to the application.
[0147] In one embodiment, the data may include state information related to a folding state of the electronic device (101). For example, the state information may include a specified angular range for executing an operation mode (or screen mode) corresponding to each of the display surfaces (311, 312, 313) of the display (310) based on the folding state. In one embodiment, the data may include information regarding various settings for supporting the electronic device (101) to control the operation of at least one display surface according to the specified folding state.
[0148] In one embodiment, the data may include various sensor data (e.g., acceleration sensor data, gyro sensor data, angle data, and / or Hall sensor data) obtained from the sensor circuit (550). In one embodiment, the data may include various reference data set in the memory (130) to identify a specified state (e.g., unfolded state, intermediate state, and folded state) of the electronic device (101).
[0149] In one embodiment, the data may include various learning data and / or parameters acquired based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) for supporting operations related to the operation of the display surface in a specified folding state.
[0150] For example, a scheme for supporting operations related to the operation of a display surface according to a folding state may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolution neural network (CNN), a region with convolution neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a deconvolution network, a deep belief network (DBN), a restricted Boltzman machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and / or a fully convolutional network. According to one embodiment, the type of the neural network model is not limited to the examples described above.
[0151] According to one embodiment, the memory (130) may store instructions that, when executed, cause the processor (120) to operate. For example, the application may be stored as software (e.g., the program (140) of FIG. 1) on the memory (130) and may be executable by the processor (120). According to one embodiment, the application may be a variety of applications that may provide various functions (or services) (e.g., a video capturing function, a call function, a message function, a messenger function, a media playback function, a game function, and / or a wireless communication function) in the electronic device (101).
[0152] According to one embodiment, the processor (120) may perform an application layer processing function requested by a user of the electronic device (101). According to one embodiment, the processor (120) may provide control and commands of functions for various blocks of the electronic device (101). According to one embodiment, the processor (120) may perform operations or data processing related to control and / or communication of each component of the electronic device (101). For example, the processor (120) may include at least some of the configurations and / or functions of the processor (120) of FIG. 1. According to one embodiment, the processor (120) may be operatively connected to the components of the electronic device (101). According to one embodiment, the processor (120) may load commands or data received from other components of the electronic device (101) into the memory (130), process the commands or data stored in the memory (130), and store result data.
[0153] In one embodiment, the processor (120) may include processing circuitry and / or executable program elements. In one embodiment, the processor (120) may control (or process) the overall operation related to controlling the switching of distinct display areas of the display (310) in the electronic device (101) to on or off based on the processing circuitry and / or executable program elements.
[0154] According to one embodiment, the processor (120) may perform an operation of determining a specified operation state of the electronic device (101) based on detecting the start of operation of the electronic device (101). According to one embodiment, the processor (120) may perform an operation of determining a folding state (e.g., a folding state based on a first folding angle and a second folding angle) of the display (310) (e.g., a flexible display) using the sensor circuit (550) based on determining a specified operation state for the electronic device (101).
[0155] According to one embodiment, the processor (120) may perform an operation of detecting a first folding state between the first housing and the second housing using a first sensor (e.g., a sensor that detects a first folding angle between the first housing and the second housing) of an angle detection sensor (e.g., a second sensor circuit (570)) based on determining a specified operating state for the electronic device (101). According to one embodiment, the processor (120) may perform an operation of detecting a second folding state between the second housing and the third housing using a second sensor (e.g., a sensor that detects a second folding angle between the second housing and the third housing) of an angle detection sensor (e.g., a second sensor circuit (570)) based on determining a specified operating state for the electronic device (101). According to one embodiment, the processor (120) may perform an operation to control the first display area, the second display area, or the third display area of the display (310) to be turned on or off based on the first folding state and the second folding state.
[0156] According to one embodiment, the processor (120) may perform an operation of determining distinct display areas (e.g., a first display surface (311), a second display surface (312), and a third display surface (313)) of the display (310) based on a folding state (e.g., a first folding state and a second folding state). According to one embodiment, the processor (120) may perform an operation of determining an operation mode (or role) (e.g., a screen mode (e.g., a main screen mode or a sub screen mode), a hidden screen mode, an input screen mode) corresponding to each of the distinct display areas. According to one embodiment, the processor (120) may perform an operation of controlling an operation corresponding to each of the distinct display areas based on the determined operation mode.
[0157] According to one embodiment, the detailed operation of the processor (120) of the electronic device (101) is described with reference to the drawings described below.
[0158] According to one embodiment, the processor (120) may be an application processor (AP). According to one embodiment, the processor (120) may be a system semiconductor that is responsible for the operation and multimedia driving functions of the electronic device (101). According to one embodiment, the processor (120) may be configured in the form of a system-on-chip (SoC), and may include a technology-intensive semiconductor chip that integrates various semiconductor technologies into one and implements system blocks into a single chip. According to one embodiment, the processor (120) may operate individually and / or collectively.
[0159] According to one embodiment, the system blocks of the processor (120) may include a graphics processing unit (GPU) (510), an image signal processor (ISP) (515), a central processing unit (CPU) (520), a neural processing unit (NPU) (525), a digital signal processor (530), a modem (535), a connectivity (540), and / or a security (545) block, as illustrated in FIG. 5.
[0160] In one embodiment, the GPU (510) may be responsible for graphics processing. In one embodiment, the GPU (510) may receive commands from the CPU (520) and perform graphics processing to express the shape, position, color, shading, movement, and / or texture of objects (or objects) on the display.
[0161] In one embodiment, the ISP (515) may be responsible for image processing and correction of images and videos. In one embodiment, the ISP (515) may correct raw data (e.g., raw data) transmitted from an image sensor of a camera (e.g., the camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. In one embodiment, the ISP (515) may perform post-processing, such as adjusting partial brightness of an image and emphasizing detailed parts. For example, the ISP (515) may independently perform a process of tuning and correcting the image quality of an image acquired through a camera to generate a result preferred by the user.
[0162] According to one embodiment, the ISP (515) may support artificial intelligence (AI)-based image processing technology. According to one embodiment, the ISP (515) may support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of a scene being captured in conjunction with the NPU (525). For example, the ISP (515) may include a function that processes objects such as the sky, bushes, and / or skin by applying different parameters to them. According to one embodiment, the ISP (515) may detect and display a human face during image capture using the AI function, or adjust the brightness, focus, and / or color of the image using the coordinates and information of the face.
[0163] According to one embodiment, the CPU (520) may perform a role corresponding to the processor (120). According to one embodiment, the CPU (520) may decode a user's command, perform arithmetic and logical operations, and / or data processing. For example, the CPU (520) may be responsible for functions such as memory, interpretation, calculation, and control. According to one embodiment, the CPU (520) may control the overall functions of the electronic device (101). For example, the CPU (520) may execute all software (e.g., applications) of the electronic device (101) on top of an operating system (OS) and control hardware devices.
[0164] According to one embodiment, the CPU (520) may include a single processor core or multiple processor cores (multi-core). According to one embodiment, the CPU (520) may control the overall operation of the processor (120) to execute an application and perform neural network-based tasks required according to the execution of the application.
[0165] According to one embodiment, the NPU (525) may be responsible for processing optimized for artificial intelligence deep-learning algorithms. According to one embodiment, the NPU (525) is a processor optimized for deep-learning algorithm operations (e.g., artificial intelligence operations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (525) may be mainly used for artificial intelligence operations. According to one embodiment, the NPU (525) may recognize objects, environments, and / or people in the background when taking a video through a camera and automatically adjust the focus, automatically switch the shooting mode of the camera module (180) to food mode when taking a picture of food, and / or be responsible for processing only the deletion of unnecessary subjects from the taken result.
[0166] According to one embodiment, the electronic device (101) can support integrated machine learning processing by interacting with all processors such as the GPU (510), the ISP (515), the CPU (520), and the NPU (525).
[0167] In one embodiment, the DSP (530) may represent an integrated circuit that facilitates rapid processing of digital signals. In one embodiment, the DSP (530) may perform the function of converting analog signals into digital signals and performing high-speed processing.
[0168] According to one embodiment, the modem (535) may perform a role that enables the use of various communication functions in the electronic device (101). For example, the modem (535) may support communications such as phone calls and data transmission and reception by exchanging signals with a base station. According to one embodiment, the modem (535) may include an integrated modem (e.g., a cellular modem, an LTE modem, a 5G modem, a 5G-Advanced modem, and a 6G modem) that supports communication technologies such as long term evolution (LTE) and 2G to 5G. According to one embodiment, the modem (535) may include an artificial intelligence modem that applies an artificial intelligence algorithm.
[0169] In one embodiment, the connectivity (540) may support wireless data transmission based on IEEE 802.11. In one embodiment, the connectivity (540) may support communication services based on IEEE 802.11 (e.g., Wi-Fi) and / or 802.15 (e.g., Bluetooth, ZigBee, UWB). For example, the connectivity (540) may support communication services targeting an unspecified number of people in a localized area, such as indoors, using an unlicensed band.
[0170] According to one embodiment, security (545) may provide an independent security execution environment between data or services stored in the electronic device (101). According to one embodiment, security (545) may play a role in preventing external hacking through software and hardware security during the process of user authentication when providing services such as biometrics, mobile identification, and / or payment of the electronic device (101). For example, security (545) may provide an independent security execution environment for device security for reinforcing the security of the electronic device (101) itself and for security services based on user information such as mobile identification, payment, and car keys in the electronic device (101).
[0171] According to one embodiment, the operations performed by the processor (120) may be implemented by executing instructions stored in a recording medium (or a computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium having recorded thereon a program for executing various operations performed by the processor (120).
[0172] The embodiments described in the present disclosure may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. In a hardware implementation, the operations described in one embodiment may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, micro-controllers, microprocessors, and / or other electrical units for performing functions.
[0173] In one embodiment, a computer-readable recording medium (or computer program product or storage medium) is provided, which records a program for causing an electronic device (101) to perform (or execute) various operations.
[0174] The above operations include: an operation of determining a designated operation state of the electronic device (101) based on detecting the start of operation of the electronic device (101); an operation of detecting (or identifying) a first folding state (e.g., a folding state detected (or identified) based on a first folding angle between the first housing and the second housing) of the display (310) (e.g., a flexible display) using a sensor circuit (550) (e.g., a first sensor of an angle detection sensor) based on determining a designated operation state of the electronic device (101); an operation of detecting a second folding state (e.g., a folding state detected (or identified) based on a second folding angle between the second housing and the third housing) of the display (310) using a sensor circuit (550) (e.g., a second sensor of an angle detection sensor) based on determining a designated operation state of the electronic device (101); and an operation of determining a first display of the display (310) based on the first folding state and the second folding state. It may include an action to control turning on or off an area (e.g., a first display surface (311)), a second display area (e.g., a second display surface (312)), or a third display area (e.g., a third display surface (313)).
[0175] The above operations may include an operation of determining a distinct display area (e.g., a first display surface (311), a second display surface (312), and a third display surface (313)) based on a folding state (e.g., a first folding state and a second folding state) of the electronic device (101), an operation of determining an operation mode (or role) (e.g., a screen mode, a hidden screen mode, an input screen mode) corresponding to each of the distinct display areas, and an operation of controlling an operation corresponding to each of the distinct display areas based on the determined operation mode.
[0176] An electronic device (101) (e.g., a multi-foldable electronic device) according to one embodiment of the present disclosure may include a housing including a first housing, a second housing, and a third housing, a first hinge structure disposed between the first housing and the second housing, a second hinge structure disposed between the second housing and the third housing, a flexible display (e.g., a display (310)) including a first display area, a second display area, and a third display area, a first sensor (e.g., a first angle detection sensor of a second sensor circuit (570)) for detecting a first folding angle between the first housing and the second housing, a second sensor (e.g., a second angle detection sensor of a second sensor circuit (570)) for detecting a second folding angle between the second housing and the third housing, a memory (130) for storing executable instructions, and a processing circuitry, and may include at least one processor (e.g., a processor (120)) for accessing the memory (130) and executing the instructions. According to one embodiment, the memory (130) may store instructions that, when individually and / or collectively executed by at least one processor (120), cause the electronic device (101) to perform operations.
[0177] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect the start of operation of the electronic device (101). According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine a designated operational state of the electronic device (101) based on detecting the start of operation. According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect (or identify) a first folding state between the first housing and the second housing using the first sensor based on determining a designated operational state for the electronic device (101). According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect (or identify) a second folding state between the second housing and the third housing using the second sensor. According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to turn on or off the first display area (e.g., the first display surface (311)), the second display area (e.g., the second display surface (312)), or the third display area (e.g., the third display surface (313)) of the flexible display based on the first folding state and the second folding state.
[0178] According to one embodiment, the flexible display may be divided into a first display area (e.g., a first display surface (311)) and a second display area (e.g., a second display surface (312)) based on a folding axis (e.g., a first folding axis) between the first housing and the second housing. According to one embodiment, the flexible display may be divided into a second display area (e.g., a second display surface (312)) and a third display area (e.g., a third display surface (313)) based on a folding axis (e.g., a second folding axis) between the second housing and the third housing.
[0179] According to one embodiment, the first display area, the second display area, and the third display area may be formed to extend from each other by being partially folded or unfolded in a flat form, depending on the first folding angle between the first housing and the second housing and the second folding angle between the second housing and the third housing.
[0180] According to one embodiment, the electronic device (101) may include a state detection sensor (e.g., a first sensor circuit (560)) that detects an operating state of the electronic device (101).
[0181] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine an operating state of the electronic device (101) using the state detection sensor based on detecting the start of operation of the electronic device (101). According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine a first folding state and a second folding state of the flexible display using the first sensor and the second sensor based on determining a specified operating state for the electronic device (101).
[0182] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect the start of operation of the electronic device (101) based on detection of a folding motion, detection of an unfolding motion, or detection of activation of the flexible display.
[0183] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine the first folding state based on the first folding angle between the first housing and the second housing. According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine the second folding state based on the second folding angle between the second housing and the third housing.
[0184] According to one embodiment, the folding state of the electronic device (101) may include an intermediate state in which the first folding angle and the second folding angle have a specified angle range.
[0185] According to one embodiment, the intermediate state of the electronic device (101) may include a first state in which the first folding angle includes a first angle range designated so that the first display area operates as a main screen, and the second folding angle includes a second angle range designated so that the second display area operates as a hidden screen.
[0186] According to one embodiment, the intermediate state of the electronic device (101) may include a second state in which the first folding angle includes the first angle range and the second folding angle includes a third angle range designated so that the second display area operates as a sub-screen.
[0187] According to one embodiment, the intermediate state of the electronic device (101) may include a third state in which the first folding angle includes a fourth angle range designated so that the first display area operates as a hidden screen, and the second folding angle includes a fifth angle range designated so that the second display area operates as a main screen.
[0188] According to one embodiment, the intermediate state of the electronic device (101) may include a fourth state in which the first folding angle includes a sixth angle range in which the first display area and the second display area form a plane, and the second folding angle includes a seventh angle range.
[0189] According to one embodiment, the folding state of the electronic device (101) may include a folding state in which the first folding angle and the second folding angle include an eighth angle range in which the first display area, the second display area, and the third display area are folded in parallel.
[0190] According to one embodiment, the folding state of the electronic device (101) may include an unfolding state in which the first folding angle and the second folding angle include a ninth angle range in which the first display area, the second display area, and the third display area form a plane.
[0191] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to provide an input interface in the third display area based on detecting proximity of an external object through the third display area in the intermediate state.
[0192] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to activate the third display area based on detecting proximity of the external object through the third display area in the intermediate state, and to provide an input interface corresponding to an attribute of a running application through the third display area.
[0193] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine, in the first state, a property of a first application provided through the first display area based on detecting proximity of the external object through the third display area, and to call an input interface corresponding to the property of the first application and display it through the third display area.
[0194] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine an attribute of a second application provided through the second display area based on detecting proximity of the external object through the third display area in the second state or the third state, and to call an input interface corresponding to the attribute of the second application and display it through the third display area.
[0195] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device, in the fourth state, to determine an attribute of a third application provided through the first display area and the second display area based on detecting proximity of the external object through the third display area, and to call an input interface corresponding to the attribute of the third application and display it through the third display area.
[0196] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect a state change to the second state while operating the first display area as a main screen in the first state, activate the second display area based on detecting the state change, and operate the second display area as a sub-screen while maintaining the main screen based on the first display area.
[0197] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect a state change to the third state while operating the first display area as a main screen in the first state, and, based on detecting the state change, activate the second display area and deactivate the first display area, and operate the second display area as a main screen to display an execution screen of a specified application.
[0198] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect a state change from the second state to the third state, and based on detecting the state change, deactivate the first display area and operate the second display area as a main screen while maintaining an execution screen being displayed through the second display area.
[0199] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to detect a notification event while operating in the first state or the second state, provide a notification corresponding to the notification event through a first display area, detect a state change from the first state or the second state to the third state, and display an execution screen corresponding to the notification event through the second display area based on detecting the state change.
[0200] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to determine the display area in operation when detecting a state change to the fourth state. According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to control the flexible display to expand and display an execution screen of the first display area or the second display area when the display area in operation is the first display area or the second display area. According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to control the flexible display to expand and display an execution screen of the second display area when the display area in operation is the first display area and the second display area.
[0201] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to display an execution screen of the main screen by expanding it through the first display area and the second display area when the state changes from the first state to the third state. According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to display an execution screen of the sub screen by expanding it through the first display area and the second display area when the state changes from the second state to the third state.
[0202] According to one embodiment, the instructions, when executed by the at least one processor (120), may cause the electronic device to receive a user input while displaying an execution screen of an application through a display area in the intermediate state, and to switch an application to be provided through the display area based on the reception of the user input. According to one embodiment, the application switching may include switching between recently executed applications, switching between preset applications, and / or switching between recommended applications associated with the applications.
[0203] According to one embodiment, the electronic device (101) may include a multi-foldable electronic device comprising N hinge structures and N+1 housings. According to one embodiment, N may include a natural number greater than or equal to 2.
[0204] According to one embodiment, the electronic device (101), in a folded state, may be folded based on a folding axis between the first housing and the second housing (e.g., the first hinge structure), the first housing and the second housing may be arranged to face each other, and the first display area may be exposed to the outside. According to one embodiment, the electronic device (101), in a folded state, may be folded based on a folding axis between the second housing and the third housing (e.g., the second hinge structure), and the second display area and the third display area may be arranged to face each other. According to one embodiment, the electronic device (101) may, in an intermediate state, unfold based on a folding axis between the first housing and the second housing to form the first folding angle, and / or the second display area and the third display area may form the second folding angle based on a folding axis between the second housing and the third housing. According to one embodiment, the electronic device (101) may, in an unfolded state, be formed such that the first display area, the second display area, and the third display area are unfolded in a flat shape and face a first direction, and the first housing, the second housing, and the third housing are unfolded in a flat shape and face a second direction opposite to the first direction.
[0205] Hereinafter, the operating method of the electronic device (101) according to various embodiments will be described in detail. The operations performed in the electronic device (101) according to various embodiments may be executed by the processor (120) including various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, the operations performed in the electronic device (101) may be stored as instructions in the memory (130) and individually and / or collectively executed by the processor (120).
[0206] FIG. 6 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0207] According to one embodiment, FIG. 6 may illustrate an example of an operation for controlling a display (310) according to a folding state in an electronic device (101) according to one embodiment.
[0208] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 6. The flowchart illustrated in FIG. 6 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed or performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 601 to 611 may be performed by at least one processor of the electronic device (101) (e.g., the processor 120 of FIG. 1 or 5).
[0209] As illustrated in FIG. 6, an operation method performed by an electronic device (101) according to one embodiment may include an operation (601) of detecting the start of operation of the electronic device (101), an operation (603) of determining a specified operation state of the electronic device (101) based on the detection of the start of operation of the electronic device (101), an operation (605) of determining a folding state of the display (310) using a sensor circuit based on the determination of the specified operation state for the electronic device (101), an operation (607) of determining distinct display surfaces of the display (310) based on the folding state, an operation (609) of determining an operation mode corresponding to each distinct display surface, and an operation (611) of controlling an operation corresponding to each distinct display surface based on the determined operation mode.
[0210] Referring to FIG. 6, in operation 601, the processor (120) of the electronic device (101) may detect the start of operation of the electronic device (101). According to one embodiment, the processor (120) may detect a trigger for changing the state of the display (310) by folding or unfolding, or a trigger for turning on the display (310). According to one embodiment, the processor (120) may determine the start of operation of the electronic device (101) based on detecting the trigger. For example, the processor (1230) may operate to detect the start of operation of the electronic device (101) based on detecting a folding motion, detecting an unfolding motion, and / or detecting activation of the display (310).
[0211] In operation 603, the processor (120) may determine a designated operating state of the electronic device (101) based on detecting the start of operation of the electronic device (101). According to one embodiment, the processor (120) may determine the designated operating state of the electronic device (101) using a state detection sensor (e.g., the first sensor circuit (560) of FIG. 5) that detects the operating state of the electronic device (101) based on detecting the start of operation of the electronic device (101). According to one embodiment, the designated operating state may include an operating state based on a portrait mode of the electronic device (101) or a desk mode (or flex mode) in which the electronic device (101) is used in a state (or a resting state) in which the electronic device is placed on a floor surface such as a desk. For example, a specified operating state of the electronic device (101) may include a condition in which the electronic device (101) is held by a user and operates in a portrait mode while the electronic device (101) is at least partially unfolded. For example, a specified operating state of the electronic device (101) may include a condition in which the electronic device (101) is at least partially unfolded while the rear housing of the electronic device (101) (e.g., the third housing (455) of FIG. 4) is placed on the floor.
[0212] In operation 605, the processor (120) may determine a folding state (e.g., a folding angle) of the display (310) using the sensor circuit (550) based on determining a specified operating state for the electronic device (101). According to one embodiment, the processor (120) may determine a folding state of the display (310) using an angle detection sensor (e.g., the second sensor circuit (570) of FIG. 5) based on determining a specified operating state (e.g., a portrait mode or a desk mode) for the electronic device (101). According to one embodiment, the processor (120) may obtain sensor data (e.g., a first folding angle and a second folding angle) corresponding to a first folding angle (e.g., an out-folding angle) based on a first folding axis of a first hinge structure (e.g., an out-folding hinge structure) and a second folding angle (e.g., an in-folding angle) based on a second folding axis of a second hinge structure (e.g., an in-folding hinge structure) from angle detection sensors (e.g., a first sensor and a second sensor). According to one embodiment, the processor (120) may operate to determine a folding state of the electronic device (101) based on the first folding angle and the second folding angle.
[0213] According to one embodiment, the processor (120) can determine whether a first folding angle of a first hinge structure (e.g., an out-folding hinge structure) connecting a first housing (451) and a second housing (453) is within a certain range (e.g., about ±45 degrees), and whether a second folding angle of a second hinge structure (e.g., an in-folding hinge structure) connecting a second housing (453) and a third housing (455) is within a certain range (e.g., about ±90 degrees). In one embodiment, the first folding angle and the second folding angle may be, for example, set values for directing the first display surface (311) of the display (310) toward a general viewing direction of the user, and the first folding angle and the second folding angle may vary depending on the size of the electronic device (101). In one embodiment, the exemplary description of the folding angle is not an exact numerical value, and can be set to be applicable in a wide range even if the physical characteristics of the user are different by applying a certain range condition.
[0214] According to one embodiment, the folding state may include an intermediate state in which the first folding angle and the second folding angle have a specified angle range. According to one embodiment, the intermediate state may include the first state illustrated in FIG. 7 a, the second state illustrated in FIG. 7 b, the third state illustrated in FIG. 7 c, and the fourth state illustrated in FIG. 7 d. According to one embodiment, examples of the intermediate state are described below with reference to FIGS. 7 a to 7 d.
[0215] In operation 607, the processor (120) may determine distinct display surfaces (e.g., a first display surface (311), a second display surface (312), and a third display surface (313)) of the display (310) based on the folding state. According to one embodiment, the processor (120) may determine activation / deactivation (e.g., on / off) of the distinct display surfaces of the display (310) corresponding to the first state, the second state, the third state, or the fourth state of the intermediate state. According to one embodiment, the display (310) (e.g., a flexible display) may be divided into a first display surface (311) and a second display surface (312) based on the folding axis of the first hinge structure. According to one embodiment, the display (310) may be divided into a second display surface (312) and a third display surface (313) based on the folding axis of the second hinge structure.
[0216] According to one embodiment, the first display surface (311), the second display surface (312), and the third display surface (313) may be formed to be partially folded or unfolded in a flat form and extend from each other, depending on a first folding angle of the first hinge structure and a second folding angle of the second hinge structure. According to one embodiment, the processor (120) may obtain the first folding angle of the first hinge structure and the second folding angle of the second hinge structure from angle detection sensors (e.g., the first sensor and the second sensor). According to one embodiment, the processor (120) may determine activation / deactivation (e.g., on / off) of the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) based on a folding state corresponding to the first folding angle and the second folding angle. For example, the processor (120) can determine which display surface among the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) will operate in a folded state.
[0217] According to one embodiment, the processor (120) may determine to activate the first display surface (311) and deactivate the second display surface (312) and the third display surface (313) when the first folding angle of the first hinge structure is within a first specified angular range in which the first display surface (311) is activated and the second folding angle of the second hinge structure is less than a second specified angular range in which the second display surface (311) is activated (e.g., the first state). According to one embodiment, the processor (120) may determine to activate the first display surface (311) and the second display surface (312) and deactivate the third display surface (313) when the first folding angle of the first hinge structure is within a first specified angular range and the second folding angle of the second hinge structure is within a second specified angular range (e.g., the second state or the fourth state). According to one embodiment, the processor (120) may determine to activate / deactivate the first display surface (311) according to a specified setting, activate the second display surface (312), and deactivate the third display surface (313) when the first folding angle of the first hinge structure is less than the first specified angle range and the second folding angle of the second hinge structure is within the second specified angle range (e.g., the third state).
[0218] In operation 609, the processor (120) may determine an operating mode corresponding to each of the separated display surfaces. According to one embodiment, the processor (120) may determine (or assign) an operating mode (or role) for the corresponding display surface based on the activation / deactivation of each display surface of the display (310). In one embodiment, the operating mode corresponding to each of the display surfaces may include a mode in which, in a designated operating state, each display surface of the display (310) operates as a main screen (e.g., main screen mode), a sub screen (e.g., sub screen mode), a hidden screen (e.g., hidden screen mode), or an input screen (e.g., input screen mode) depending on the folding state. According to one embodiment, the processor (120) may determine an operating mode for the first display surface (311), the second display surface (312), and / or the third display surface (313) based on the activation / deactivation depending on the folding state.
[0219] In operation 611, the processor (120) may control operations corresponding to each of the distinguished display surfaces based on the determined operation mode. According to one embodiment, the processor (120) may control the display (310) to display a designated screen on a display surface (e.g., the first display surface (311) and / or the second display surface (312)) that operates as a main screen. According to one embodiment, the processor (120) may control the display (310) to sense, through a related sensor circuit, the proximity of an object from the outside on a display surface (e.g., the third display surface (313)) that operates as an input screen.
[0220] FIGS. 7A, 7B, 7C, and 7D are diagrams illustrating examples of various folding states of an electronic device according to an embodiment of the present disclosure.
[0221] Referring to FIG. 7A, a first state may represent a state in which a first folding angle includes a first angle range designated so that a first display (e.g., a first display surface (311)) operates in a screen mode (or a main screen mode), and a second folding angle includes a second angle range designated so that a second display (e.g., a second display surface (312)) operates in a hidden screen mode. According to one embodiment, in the first state, the first display surface (311) may be activated, and the second display surface (312) and the third display surface (313) may be deactivated. According to one embodiment, the processor (120) may operate to display a designated screen (e.g., a contents screen, an application execution screen, and / or a function execution screen) based on the first display surface (311) in the first state.
[0222] In one embodiment, the main screen mode may be a mode in which at least one display surface (e.g., the first display surface (311) and / or the second display surface (312)) of the display (310) is activated to display a designated screen in a state in which the folding state operated based on the first hinge structure and the second hinge structure can be positioned in the direction of the user's gaze. In one embodiment, the designated screen may include, for example, an execution screen of a designated application, a display screen of a designated function, or a display screen of designated content.
[0223] In one embodiment, the hidden screen mode may be a mode in which at least one display surface (e.g., the first display surface (311) or the second display surface (312)) of the display (310) is deactivated when the folding state operated based on the first hinge structure and the second hinge structure is not positioned in the direction of the user's gaze (e.g., is out of the user's field of vision). In one embodiment, the display surface of the hidden screen mode of the display (310) may be an area that is deactivated (or turned off). In one embodiment, the display surface of the hidden screen mode may be activated when the folding state (e.g., the first folding angle and / or the second folding angle) is changed and exposed to the user's field of vision.
[0224] Referring to FIG. 7B, the second state may represent a state in which the first folding angle includes a first angle range designated so that the first display (e.g., the first display surface (311)) operates in a screen mode, and the second folding angle includes a third angle range designated so that the second display (e.g., the second display surface (312)) operates in a sub-screen mode. According to one embodiment, in the second state, the first display surface (311) and the second display surface (312) may be activated, and the third display surface (313) may be deactivated. According to one embodiment, the processor (120) may operate to display a first designated screen based on the first display surface (311) in the second state, and may operate to display a second designated screen based on the second display surface (312).
[0225] In one embodiment, the sub-screen mode may be a mode in which a designated screen is displayed in a state in which a display surface (e.g., a first display surface (311)) operating in the main screen mode and another display surface (e.g., a second display surface (312)) operating in the display (310) in the folding state operated based on the first hinge structure and the second hinge structure can be positioned together in the direction of the user's gaze.
[0226] In one embodiment, the designated screen may be associated with, for example, the first designated screen displayed in the main screen mode, or may be a second designated screen different from the first designated screen. For example, the second designated screen may include a screen that displays an expanded function (e.g., a function of a first application) of the first designated screen through the second display surface (312) while maintaining the display of the first designated screen through the first display surface (311). For example, the second designated screen may include a screen that displays an execution screen of a second application (or function) associated with the first application of the first designated screen through the second display surface (312) while maintaining the display of the first designated screen through the first display surface (311). For example, the second designated screen may include a screen (e.g., an execution screen of a designated third application) that is displayed independently from the first designated screen while maintaining the display of the first designated screen through the first display surface (311).
[0227] Referring to FIG. 7C, the third state may represent a state in which the first folding angle includes a fourth angle range designated so that the first display (e.g., the first display surface (311)) operates in a hidden screen mode, and the second folding angle includes a fifth angle range designated so that the second display (e.g., the second display surface (312)) operates in a screen mode (e.g., the main screen mode). According to one embodiment, in the third state, the first display surface (311) may be deactivated, the second display surface (312) may be activated, and the third display surface (313) may be deactivated. According to one embodiment, the processor (120) may operate to display a designated screen based on the second display surface (312) in the third state. According to one embodiment, in the third state, the first display surface (311) may be deactivated or activated according to a designated setting (e.g., a setting regarding whether to maintain a screen when the first display surface (311) operates in a hidden screen mode). In one embodiment, in the third state, the third display surface (313) may be deactivated or activated depending on a specified setting (e.g., a setting regarding whether to activate when there is no object proximity during input screen mode operation of the third display surface (313).
[0228] Referring to FIG. 7D, the fourth state may represent a state in which the first folding angle includes a sixth angle range in which the first display surface (311) and the second display surface (312) form a plane, and the second folding angle includes a seventh angle range. According to one embodiment, in the fourth state, the first display surface (311) and the second display surface (312) may be activated, and the third display surface (313) may be deactivated. According to one embodiment, the processor (120) may operate to display a designated screen based on the first display surface (311) and the second display surface (312) in the fourth state. According to one embodiment, the designated screen may be an extended screen of the first designated screen of the first display surface (311) or an extended screen of the second designated screen of the second display surface (312).
[0229] According to one embodiment, the folding state may include a folded state and an unfolded state. In one embodiment, the folded state may indicate a state in which the first folding angle and the second folding angle include an eighth angle range in which the first display surface (311), the second display surface (312), and the third display surface (313) are folded parallel (e.g., a range in which the first folding angle and the second folding angle are each about 0 degrees). In one embodiment, the unfolded state may indicate a state in which the first folding angle and the second folding angle include a ninth angle range in which the first display surface (311), the second display surface (312), and the third display surface (313) form a plane (e.g., a range in which the first folding angle and the second folding angle are each about 180 degrees).
[0230] FIG. 8 is a flowchart illustrating a method of operating an electronic device according to one embodiment of the present disclosure.
[0231] According to one embodiment, FIG. 8 may illustrate an example of an operation for controlling a display (310) according to a folding state in an electronic device (101) according to one embodiment.
[0232] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 8. The flowchart illustrated in FIG. 8 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed or performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 801 to 811 may be performed by at least one processor of the electronic device (101) (e.g., the processor 120 of FIG. 1 or 5).
[0233] According to one embodiment, the operations described in FIG. 8 may be performed heuristically, for example, in combination with the operations described in FIGS. 6 to 7d, or heuristically performed by replacing at least some of the operations described and combining with at least some other operations, or heuristically performed as detailed operations of at least some of the operations described.
[0234] As illustrated in FIG. 8, an operation method performed by an electronic device (101) according to an embodiment may include an operation (801) of detecting the start of operation of the electronic device (101), an operation (803) of determining whether the electronic device (101) is in a specified operation state (or posture), an operation (805) of determining a state (e.g., a folding angle) of the electronic device (101) based on sensor data based on determining the specified operation state, an operation (807) of determining at least one target display to be operated based on the state of the electronic device (101) (or assigning an operation mode (or role) to each display surface), an operation (809) of displaying a specified screen (e.g., an application screen, a content screen, a function screen) based on the at least one target display, and an operation (811) of processing the execution of the corresponding operation based on determining that the operation state is not specified.
[0235] Referring to FIG. 8, in operation 801, the processor (120) of the electronic device (101) may detect the start of operation of the electronic device (101). According to one embodiment, the processor (120) may detect a trigger for folding or unfolding, which changes the state of the display (310), or a trigger for turning on the display (310). According to one embodiment, the processor (120) may determine the start of operation of the electronic device (101) based on detecting the trigger. For example, the processor (120) may operate to detect the start of operation of the electronic device (101) based on detecting a folding motion, detecting an unfolding motion, and / or detecting activation of the display (310).
[0236] At operation 803, the processor (120) may determine whether the electronic device (101) is operating in a specified operating state based on detecting the start of operation of the electronic device (101). According to one embodiment, the processor (120) may determine the specified operating state of the electronic device (101) using a state detection sensor (e.g., the first sensor circuit (560) of FIG. 5) that detects the operating state of the electronic device (101) based on detecting the start of operation of the electronic device (101). According to one embodiment, the specified operating state may include an operating state based on a portrait mode of the electronic device (101) or a desk mode (or flex mode) used when the electronic device (101) is placed on a floor surface such as a desk (or in a standing state). For example, a specified operating state of the electronic device (101) may include a condition in which the electronic device (101) is held by a user and operates in a portrait mode while the electronic device (101) is at least partially unfolded. For example, a specified operating state of the electronic device (101) may include a condition in which the electronic device (101) is at least partially unfolded while the rear housing of the electronic device (101) (e.g., the third housing (455) of FIG. 4) is placed on the floor.
[0237] At operation 803, the processor (120) may determine that the specified operation state is not reached (e.g., 'No' at operation 803), and at operation 811, the processor may process the execution of the corresponding operation. According to one embodiment, the electronic device (101) may start operation in an operation state other than the specified operation state (e.g., a landscape mode or a folded state) (e.g., a portrait mode or a desk mode). According to one embodiment, when the start of operation of the electronic device (101) in another operation state is detected, the processor (120) may control operation (e.g., activation and screen display) of at least one display surface of the display (310) based on sensor data acquired from a state detection sensor and / or an angle detection sensor.
[0238] For example, the processor (120) may activate the first display surface (311) in response to the folded state and operate to display a related screen through the first display surface (311).
[0239] For example, the processor (120) may activate the second display surface (312) and the third display surface (313) and display a related screen through the second display surface (312) and the third display surface (313) when the first folding angle of the first hinge structure is less than the first specified angle range (e.g., about 0 degrees) and the second folding angle of the second hinge structure is greater than the second specified angle range (e.g., about 180 degrees) (e.g., when only the first display surface (311) is folded in an out-folding manner).
[0240] For example, when the first folding angle of the first hinge structure is in a first specified angle range in the landscape mode and the second folding angle of the second hinge structure is in a second specified angle range, the processor (120) may activate the first display surface (311), the second display surface (312), and the third display surface (313), and operate to display a related screen (e.g., an extended screen or a split screen) through the first display surface (311), the second display surface (312), and the third display surface (313).
[0241] At operation 803, the processor (120) may determine a state of the electronic device (101) (e.g., a folding state based on a folding angle) based on sensor data based on determining a specified operating state (e.g., 'yes' in operation 803), at operation 805. According to one embodiment, the processor (120) may determine the folding state of the display (310) using a sensor angle detection sensor (e.g., the second sensor circuit (570) of FIG. 5). According to one embodiment, the processor (120) may obtain sensor data (e.g., a first folding angle and a second folding angle) corresponding to a first folding angle (e.g., an out-folding angle) based on a first folding axis of a first hinge structure (e.g., an out-folding hinge structure) and a second folding angle (e.g., an in-folding angle) based on a second folding axis of a second hinge structure (e.g., an in-folding hinge structure) from angle detection sensors (e.g., a first sensor and a second sensor). According to one embodiment, the processor (120) may determine a folding state of the electronic device (101) based on the first folding angle and the second folding angle.
[0242] In operation 807, the processor (120) may determine at least one target display to be operated based on a state of the electronic device (101). According to one embodiment, the processor (120) may determine activation / deactivation (e.g., on / off) of distinct display surfaces (e.g., a first display surface (311), a second display surface (312), and a third display surface (313)) of the display (310) in response to a first state, a second state, a third state, or a fourth state of an intermediate state. According to one embodiment, the processor (120) may obtain a first folding angle of the first hinge structure and a second folding angle of the second hinge structure from angle detection sensors (e.g., a first sensor and a second sensor). According to one embodiment, the processor (120) may determine activation / deactivation (e.g., on / off) of the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) based on the folding state corresponding to the first folding angle and the second folding angle. For example, the processor (120) may determine which of the first display surface (311), the second display surface (312), and the third display surface (313) of the display (310) will operate in the folding state.
[0243] According to one embodiment, the processor (120) may determine the first display surface (311) as a display surface that operates in screen mode based on the first state. According to one embodiment, the processor (120) may determine the first display surface (311) as a display surface that operates in main screen mode and the second display surface (312) as a display surface that operates in sub screen mode based on the second state. According to one embodiment, the processor (120) may determine the first display surface (311) and the second display surface (312) as display surfaces that operate in screen mode (e.g., main screen mode) based on the fourth state. According to one embodiment, the processor (120) may determine the first display surface (311) as a display surface that operates in screen mode or hidden screen mode according to a specified setting based on the third state, and the second display surface (312) as a display surface that operates in screen mode (e.g., main screen mode).
[0244] In operation 809, the processor (120) may display a designated screen (e.g., an application screen, a content screen, a function screen) based on at least one target display. According to one embodiment, the processor (120) may control the display (310) to display the designated screen based on a display surface (e.g., a first display surface (311) and / or a second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode). According to one embodiment, an example of displaying a designated screen based on at least one target display will be described with reference to the drawings below.
[0245] FIG. 9 is a diagram illustrating an example of displaying a designated screen in an intermediate state of an electronic device according to one embodiment of the present disclosure.
[0246] According to one embodiment, the example of FIG. 9 may illustrate an example in which the electronic device (101) operates the first display surface (311) in a screen mode and the second display surface (312) in a hidden screen mode in a designated folding state (e.g., the first state of FIG. 7A). According to one embodiment, the electronic device (101) may activate the first display surface (311) in the first state and deactivate the second display surface (312) and the third display surface (313). According to one embodiment, the electronic device (101) may operate to display a designated screen through the first display surface (311) in the first state.
[0247] According to one embodiment, a designated screen displayed through a display surface (e.g., the first display surface (311)) operating in screen mode may represent, for example, a screen displayed when entering a designated folding state (e.g., the first state). According to one embodiment, the electronic device (101) may store a list (e.g., an application list) of applications and / or functions of a screen to be displayed through a designated display surface (e.g., the first display surface (311)) according to a folding state in a memory (130). According to one embodiment, the list may include information about previously running applications (e.g., recent applications), applications preset in the electronic device (101), functions (e.g., widget functions such as a clock widget, a weather widget, and / or a calendar widget), and / or content (e.g., media content).
[0248] According to one embodiment, when the electronic device (101) detects a specified folding state (e.g., a first state) in a specified operating state, the electronic device (101) may execute a specified application (e.g., a preset application or function, an application currently in use, or a set content) on the first display surface (311) and display the execution screen through the first display surface (311).
[0249] According to one embodiment, the designated application to be initially executed may be determined based on the settings of the electronic device (101) for the designated folding state. According to one embodiment, the designated application to be initially executed may be an application with a priority among a plurality of applications set in a list (e.g., the first application in the list, or an application suitable for a location or environment recognized based on contextual awareness). According to one embodiment, the designated application may include an application whose resolution and / or size is optimized for the display surface of the screen mode and / or an application set by the user.
[0250] According to one embodiment, a user may manipulate the first display surface (311) to face the user's gaze direction while the electronic device (101) is in portrait mode and placed on a table or desk. For example, the user may manipulate the electronic device (101) to have a first state. According to one embodiment, when the electronic device (101) detects entry into the first state from a specified operating state, the electronic device (101) may determine a specified application for the first display screen (311) and display the specified screen through the first display screen (311).
[0251] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a video player) through the first display surface (311) and display a related media screen (e.g., a video playback screen) through the first display surface (311).
[0252] According to one embodiment, the electronic device (101) may execute a second designated application (e.g., a music player) through the first display surface (311) and display a related media screen (e.g., a music playback screen) through the first display surface (311).
[0253] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a dashboard) through the first display surface (311) and display related interface screens (e.g., a clock screen and a weather screen) through the first display surface (311).
[0254] FIG. 10 is a diagram illustrating an example of displaying a designated screen in an intermediate state of an electronic device according to one embodiment of the present disclosure.
[0255] According to one embodiment, the example of FIG. 10 may illustrate an example in which the electronic device (101) operates the first display surface (311) in a first screen mode (e.g., main screen mode) and operates the second display surface (312) in a second screen mode (e.g., sub screen mode) in a designated folding state (e.g., the second state of FIG. 7B). According to one embodiment, the electronic device (101) may activate the first display surface (311) and the second display surface (312) in the second state, and deactivate the third display surface (313). According to one embodiment, the electronic device (101) may operate to display a first designated screen through the first display surface (311) and to display a second designated screen through the second display surface (312) in the second state.
[0256] According to one embodiment, the first designated screen and the second designated screen may represent screens to be displayed on the first display surface (311) and the second display surface (312), respectively, for example, when entering a designated folding state (e.g., the second state). According to one embodiment, the electronic device (101) may store in the memory (130) a list of applications and / or functions to be displayed on the screens on the designated display surfaces (e.g., the first display surface (311) and the second display surface (312)) according to the folding state (e.g., an application list for each designated display surface). For example, the electronic device (101) may include a first list of applications and settings for a display surface (e.g., the first display surface (311) or the second display surface (312)) operating in a main screen mode and a second list of applications and settings for a display surface (e.g., the second display surface (312)) operating in a sub-screen mode according to the folding state. According to one embodiment, the lists (e.g., the first list and the second list) may include information about previously running applications (e.g., recent applications, applications preset on the electronic device (101), functions (e.g., widget functions such as a clock widget, a weather widget, and / or a calendar widget), and / or content (e.g., media content).
[0257] According to one embodiment, when the electronic device (101) detects a designated folding state (e.g., a second state) in a designated operating state, the electronic device (101) may execute a first designated application (e.g., a preset application or function, a currently used application, or a set content) on the first display surface (311) and display the corresponding execution screen (e.g., the first designated screen) through the first display surface (311). According to one embodiment, when the electronic device (101) detects a designated folding state (e.g., a second state) in a designated operating state, the electronic device (101) may maintain the display of the first designated screen on the first display surface (311) while executing a second designated application (e.g., a preset application or function, a currently used application, or a set content) on the second display surface (312) and display the corresponding execution screen (e.g., the second designated screen) through the second display surface (312).
[0258] According to one embodiment, a first designated application initially executed on a first display surface (311) operating in the main screen mode may be determined based on a setting of the electronic device (101) for a designated folding state. According to one embodiment, the first designated application initially executed may be an application having a priority among a plurality of applications set in a first list (e.g., a first application in the list, or an application suitable for a location or environment recognized based on contextual awareness). According to one embodiment, the first designated application may include an application whose resolution and / or size corresponding to the display surface of the main screen mode is optimized and / or an application set by a user.
[0259] According to one embodiment, the second designated application initially executed on the second display surface (312) operating in the sub-screen mode may be determined based on a setting of the electronic device (101) for the designated folding state. According to one embodiment, the second designated application initially executed may be an application having a priority among a plurality of applications set in the second list (e.g., the first application in the list, or an application suitable for a location or environment recognized based on contextual awareness). According to one embodiment, the second designated application may include an application whose resolution and / or size corresponding to the display surface of the sub-screen mode is optimized and / or an application set by a user.
[0260] According to one embodiment, the user can manipulate the first display surface (311) and the second display surface (312) to face the user's gaze direction in the portrait mode of the electronic device (101) while the device is in a holding or desk-mounted state. For example, the user can manipulate the electronic device (101) to have a second state. According to one embodiment, when the electronic device (101) detects entry into the second state from a specified operation state, the electronic device (101) can determine a first designated application for the first display screen (311) and a second designated application for the second display screen (312). According to one embodiment, the electronic device (101) can display a first designated screen through the first display screen (311) and a second designated screen through the second display screen (312).
[0261] According to one embodiment, the applications of the second list for the display surface operating in the sub-screen mode may be set so as not to overlap with the applications of the first list. According to one embodiment, the second list may include settings regarding the display method of the second designated screen to be displayed on the display surface operating in the sub-screen mode. For example, the second designated screen may include a screen that expands an additional function (e.g., a sub-function that does not require constant operation) screen of the first designated application operating in response to the first display surface (311) operating in the main screen mode, an execution screen of a second designated application linked to the first designated application, an execution screen of an application linked to an event (e.g., a notification event), or an execution screen of an application with a priority set in the second list.
[0262] According to one embodiment, the electronic device (101) can, in a second state, simultaneously provide a first designated screen and a second designated screen in multitasking based on a first display surface (311) and a second display surface (312).
[0263] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a live broadcasting application) through a first display surface (311) in a first state, and display a related media screen (e.g., a live broadcasting video playback screen) through the first display surface (311). According to one embodiment, a user may change the state from the first state to the second state by manipulating the electronic device (101) while watching a live broadcast. According to one embodiment, when the electronic device (101) detects entry into the second state, the electronic device (101) may execute a sub-function (e.g., a real-time comment function) of the first designated application (e.g., a live broadcasting application) through a second display surface (312), and display a related execution screen (e.g., a real-time comment screen) through the second display surface (312). For example, while a user is watching a live broadcast through the first display surface (311) in a first state, the user can change the state to a second state by adjusting the folding angle of the electronic device (101) so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, the user can check real-time comments through the second display surface (312) while watching a live broadcast through the first display surface (311) in the second state. According to one embodiment, the user can also activate the third display surface (313) and write a comment based on an input interface (e.g., a keypad) provided through the third display surface (313). According to one embodiment, providing an input interface based on the third display surface (313) will be described with reference to the drawings described below.
[0264] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a media player (or an over-the-top (OTT) application)) through the first display surface (311) in a first state, and display a related media screen (e.g., a video playback screen) through the first display surface (311). According to one embodiment, a user may change the state from the first state to the second state by manipulating the electronic device (101) while watching a video (e.g., a movie or a drama). According to one embodiment, when the electronic device (101) detects entry into the second state, the electronic device (101) may execute a sub-function (e.g., a subtitle function) of the first designated application (e.g., a media player) through the second display surface (312), and display a related execution screen (e.g., a subtitle screen) through the second display surface (312). For example, while a user is watching a video through the first display surface (311) in a first state, the user can change the state to a second state by adjusting the folding angle of the electronic device (101) so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, the user can check subtitles through the second display surface (312) while watching a video through the first display surface (311) in the second state. According to one embodiment, the user can activate the third display surface (313) to check episode information and move to another episode based on an input interface (e.g., episode information and episode switching controller) provided through the third display surface (313). According to one embodiment, providing an input interface based on the third display surface (313) will be described with reference to the drawings described below.
[0265] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a stock application) through a first display surface (311) in a first state, and display a related execution screen (e.g., a chart screen) through the first display surface (311). According to one embodiment, the user may change the state from the first state to the second state by manipulating the electronic device (101) while checking the chart. According to one embodiment, when the electronic device (101) detects entry into the second state, the electronic device (101) may execute a sub-function (e.g., a buy / sell function) of the first designated application (e.g., a stock application) through a second display surface (312), and display a related execution screen (e.g., a buy / sell screen) through the second display surface (312). For example, while a user is checking a chart through the first display surface (311) in a first state, the user can change the state to a second state by adjusting the folding angle of the electronic device (101) so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, the user can check buy / sell information through the second display surface (312) while checking a chart through the first display surface (311) in the second state. According to one embodiment, the user can also activate the third display surface (313) and make a buy / sell based on an input interface (e.g., a keypad) provided through the third display surface (313). According to one embodiment, providing an input interface based on the third display surface (313) will be described with reference to the drawings described below.
[0266] According to one embodiment, the electronic device (101) can display a widget associated with a first designated application on the first display surface (311) of the main screen mode or a designated screen of a second application through the second display surface (312) of the sub screen mode. For example, the electronic device (101) can provide not only an extension of the first application, but also a preset associated widget or a designated screen of another application. In one embodiment, the associated application (e.g., the second application) can be automatically paired with the first designated application or can be designated by the user.
[0267] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a planner) through a first display surface (311) in a first state, and display a related execution screen (e.g., a schedule screen) through the first display surface (311). According to one embodiment, the user may change the state from the first state to the second state by manipulating the electronic device (101) while checking the schedule through the schedule screen. According to one embodiment, when the electronic device (101) detects entry into the second state, the electronic device (101) may execute a second designated application (e.g., a to-do list application or function) linked to the first designated application (e.g., a planner) through a second display surface (312), and display a related execution screen (e.g., a to-do list screen) through the second display surface (312).
[0268] For example, while the user is checking the schedule through the first display surface (311) in the first state, the user can change the state to the second state by adjusting the folding angle of the electronic device (101) so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, while the user is checking the schedule through the first display surface (311) in the second state, the user can check the to-do list through the second display surface (312). According to one embodiment, when there is content to be added to the to-do list while the user is checking the to-do list, the user can activate the third display surface (313) and input (or add) the to-do list based on an input interface (e.g., a keypad) provided through the third display surface (313). According to one embodiment, providing an input interface based on the third display surface (313) will be described with reference to the drawings described below.
[0269] According to one embodiment, the electronic device (101) may execute a second application independently (or separately) from a first designated application on the first display surface (311) of the main screen mode, and display a designated screen of the second application through the second display surface (312) of the sub-screen mode. For example, the electronic device (101) may operate the second display surface (312) independently from the first display surface (311) (e.g., operate in the main screen mode) in consideration of a general use case, rather than an extension or linked application of the first application, to provide the same usability as the first display surface (311).
[0270] According to one embodiment, the electronic device (101) may execute a first designated application (e.g., a dashboard) through the first display surface (311) in a first state, and display related execution screens (e.g., a clock screen and a weather screen) through the first display surface (311). According to one embodiment, the user may change the state from the first state to the second state by manipulating the electronic device (101) while using the dashboard. According to one embodiment, when the electronic device (101) detects entry into the second state, the electronic device (101) may execute a second designated application (e.g., a music player) through the second display surface (312), and display related execution screens (e.g., a music playback screen) through the second display surface (312). For example, while the user is using the dashboard through the first display surface (311) in the first state, the electronic device (101) may change the state to the second state by adjusting the folding angle of the electronic device (101), so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, the user can use the dashboard through the first display surface (311) in the second state while checking the music playback screen through the second display surface (312). According to one embodiment, the user can also activate the third display surface (313) to control functions related to music playback based on an input interface (e.g., a media controller) provided through the third display surface (313). According to one embodiment, providing an input interface based on the third display surface (313) will be described with reference to the drawings described below.
[0271] FIG. 11 is a diagram illustrating an example of displaying a designated screen in an intermediate state of an electronic device according to one embodiment of the present disclosure.
[0272] According to one embodiment, the example of FIG. 11 may illustrate an example in which the electronic device (101) operates the second display surface (312) in a screen mode and operates the first display surface (311) in a hidden screen mode in a designated folding state (e.g., the third state of FIG. 7C). According to one embodiment, the electronic device (101) may activate the second display surface (312) in the third state and deactivate the first display surface (311) and the third display surface (313). According to one embodiment, the electronic device (101) may operate to display a designated screen through the second display surface (312) in the third state. According to one embodiment, the first display surface (311) may be activated or deactivated according to a setting of the electronic device (101) in the third state.
[0273] According to one embodiment, a designated screen displayed through a display surface (e.g., the second display surface (312)) operating in screen mode may represent, for example, a screen displayed when entering a designated folding state (e.g., the third state). According to one embodiment, the electronic device (101) may store a list (e.g., an application list) of applications and / or functions of a screen to be displayed through a designated display surface (e.g., the second display surface (312)) according to a folding state in a memory (130). According to one embodiment, the list may include information about previously running applications (e.g., recent applications, applications preset in the electronic device (101), functions (e.g., widget functions such as a clock widget, a weather widget, and / or a calendar widget), and / or content (e.g., media content).
[0274] According to one embodiment, when the electronic device (101) detects a designated folding state (e.g., a third state) in a designated operating state, the electronic device (101) may execute a designated application (e.g., a preset application or function, an application currently in use, or a set content) for the second display surface (312) and display the corresponding execution screen through the second display surface (312). According to one embodiment, the designated application to be initially executed may be determined based on the settings of the electronic device (101) for the designated folding state. According to one embodiment, the designated application to be initially executed may be an application having a priority among a plurality of applications set in a list (e.g., the first application in the list, or an application suitable for a place or environment recognized based on contextual awareness). According to one embodiment, the designated application may include an application whose resolution and / or size corresponding to the display surface of the screen mode is optimized and / or an application set by the user.
[0275] According to one embodiment, the user can manipulate the second display surface (312) to face the user's gaze direction while the electronic device (101) is in portrait mode and is placed on a table or desk. For example, the user can manipulate the electronic device (101) to have a third state. According to one embodiment, when the electronic device (101) detects entry into the third state from a specified operating state, the electronic device (101) can determine a specified application for the second display screen (312) and display the specified screen through the second display screen (312).
[0276] According to one embodiment, the electronic device (101) may execute a designated application (e.g., a media player) through the second display surface (312) in the third state and display a related media screen (e.g., a video playback screen) through the second display surface (312). According to one embodiment, the electronic device (101) may execute a designated application (e.g., a dashboard) through the second display surface (312) in the third state and display a related execution screen (e.g., a clock screen and a weather screen) through the second display surface (312).
[0277] FIG. 12 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.
[0278] According to one embodiment, FIG. 12 may illustrate an example of an operation for controlling a display (310) according to a folding state in an electronic device (101) according to one embodiment.
[0279] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 12. The flowchart illustrated in FIG. 12 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 1201 to 1205 may be performed by at least one processor of the electronic device (101) (e.g., the processor 120 of FIG. 1 or 5).
[0280] According to one embodiment, the operations described in FIG. 12 may be heuristically performed in combination with the operations described in FIGS. 6 to 11, for example, or may be heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or may be heuristically performed as a detailed operation of at least some of the operations described.
[0281] As illustrated in FIG. 12, an operation method performed by an electronic device (101) according to one embodiment may include an operation (1201) of displaying a specified screen based on a specified display, an operation (1203) of detecting a user interaction, and an operation (1205) of controlling a related function based on the user interaction.
[0282] Referring to FIG. 12, in operation 1201, the processor (120) of the electronic device (101) may display a designated screen based on a designated display. According to one embodiment, the processor (120) may display a designated screen (e.g., an application screen, a content screen, a function screen) based on at least one designated display (e.g., a first display surface (311) and / or a second display surface (312)) determined based on a folding state of the display (310). According to one embodiment, the processor (120) may control the display (310) to display a designated screen based on a display surface (e.g., a first display surface (311) and / or a second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode).
[0283] In operation 1203, the processor (120) may detect a user interaction. In one embodiment, the user interaction may represent, for example, an interaction with a user in a specified folding state (e.g., a first state, a second state, a third state, or a fourth state) in a specified operational state of the electronic device (101) (e.g., a grip state in portrait mode or a desk-mounted state).
[0284] According to one embodiment, the user interaction may include a first interaction related to a user input based on a designated display surface (e.g., the first display surface (311) and / or the second display surface (312)), a second interaction related to a state change of the electronic device (101), a third interaction related to object proximity (e.g., hovering) based on a designated display surface (e.g., the third display surface (313)), and / or a fourth interaction related to releasing a designated operating state (or a designated folding state). According to one embodiment, the user interactions (e.g., the first to fourth interactions) may be performed randomly by the user, performed sequentially, or performed independently (or individually). According to one embodiment, examples of performing actions based on user interactions are described with reference to the drawings described below.
[0285] In operation 1205, the processor (120) may control a related function based on a user interaction. According to one embodiment, the processor (120) may detect a first interaction, a second interaction, a third interaction, or a fourth interaction, and, based on a designated display surface, execute and provide a function corresponding to the detected user interaction, or may cancel (e.g., stop) the operation of the electronic device (101). According to one embodiment, examples of performing related operations for each user interaction are described with reference to the drawings described below.
[0286] FIG. 13 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.
[0287] According to one embodiment, FIG. 13 may illustrate an example of an operation for controlling a related function based on a first interaction related to a user input in an electronic device (101) according to one embodiment.
[0288] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 13. The flowchart illustrated in FIG. 13 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 1301 to 1305 may be performed by at least one processor of the electronic device (101) (e.g., the processor 120 of FIG. 1 or 5).
[0289] According to one embodiment, the operations described in FIG. 13 may be heuristically performed in combination with the operations described in FIGS. 6 to 12, for example, or heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or heuristically performed as a detailed operation of at least some of the operations described.
[0290] As illustrated in FIG. 13, an operation method performed by an electronic device (101) according to one embodiment may include an operation (1301) of displaying a specified screen based on a specified display, an operation (1303) of detecting a specified user input based on the specified display, and an operation (1205) of switching a screen within a specified display surface.
[0291] Referring to FIG. 13, in operation 1301, the processor (120) of the electronic device (101) may display a designated screen based on a designated display. According to one embodiment, the processor (120) may display a designated screen based on at least one designated display (e.g., the first display surface (311) and / or the second display surface (312)) determined based on a folding state (e.g., the first state, the second state, the third state, or the fourth state) of the display (310). According to one embodiment, the processor (120) may control the display (310) to display a designated screen based on a display surface (e.g., the first display surface (311) and / or the second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode).
[0292] In operation 1303, the processor (120) may detect a specified user input based on a specified display. In one embodiment, the specified user input may include a specified touch gesture (e.g., a flick, a swipe, or a drag) input by a user through a specified display surface (e.g., a first display surface (311) and / or a second display surface (312)) of the display (310).
[0293] In operation 1305, the processor (120) may switch screens within a designated display based on a designated user input. In one embodiment, the processor (120) may receive a user input (e.g., a left / right swipe) based on a designated display surface that is displaying the designated screen. In one embodiment, the processor (120) may control the switching of screens within the designated display surface based on the user input. In one embodiment, an example of controlling the switching of screens based on the user input is illustrated in FIG. 14.
[0294] FIG. 14 is a diagram illustrating an example of supporting screen transition in an electronic device according to one embodiment of the present disclosure.
[0295] According to one embodiment, the example of FIG. 14 may illustrate an example in which the electronic device (101) operates the first display surface (311) in a screen mode and the second display surface (312) in a hidden screen mode in a designated folding state (e.g., the first state of FIG. 7A). According to one embodiment, the electronic device (101) may activate the first display surface (311) in the first state and deactivate the second display surface (312) and the third display surface (313). According to one embodiment, the electronic device (101) may operate to display a designated screen through the first display surface (311) in the first state.
[0296] Referring to FIG. 14, the electronic device (101) can display a first execution screen (1410) of a first application through a first display surface (311). According to one embodiment, while the electronic device (101) displays the first execution screen (1410), the electronic device (101) can receive a specified user input (1400) based on the first display surface (311). For example, the user can input a specified touch gesture (e.g., a left swipe) for switching screens displayed on a specified display surface (e.g., the first display surface (311)).
[0297] According to one embodiment, the electronic device (101) may switch and display a first execution screen (1410) of a second application to a second execution screen (1420) based on detecting a specified user input (1400) based on a specified display surface (e.g., a first display surface (311)). For example, the electronic device (101) may support switching between preset applications (e.g., applications within an application list) based on a user input based on a specified display surface.
[0298] According to one embodiment, the electronic device (101) may receive a user input through the display surface while displaying an execution screen of an application through the display surface in an intermediate state (e.g., a first state, a second state, a third state, or a fourth state). According to one embodiment, the electronic device (101) may switch an application to be provided through the display surface based on receiving the user input. According to one embodiment, the application switching may include switching between recently executed applications, switching between preset applications, and / or switching between recommended applications associated with an application.
[0299] FIG. 15 is a flowchart illustrating an operation method of an electronic device according to one embodiment of the present disclosure.
[0300] FIG. 16 is a diagram illustrating an example of a state change in an electronic device according to one embodiment of the present disclosure.
[0301] According to one embodiment, FIG. 15 may illustrate an example of an operation for controlling a related function based on a second interaction related to a state change of the electronic device (101) in an electronic device (101) according to one embodiment.
[0302] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 15. The flowchart illustrated in FIG. 15 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 1501 to 1509 may be performed by at least one processor of the electronic device (101) (e.g., the processor 120 of FIG. 1 or 5).
[0303] According to one embodiment, the operations described in FIG. 15 may be heuristically performed in combination with the operations described in FIGS. 6 to 14, for example, or heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or heuristically performed as a detailed operation of at least some of the operations described.
[0304] As illustrated in FIG. 15, an operation method performed by an electronic device (101) according to one embodiment may include an operation (1501) of displaying a designated screen based on a first designated display, an operation (1503) of detecting a state change, an operation (1505) of determining a state of the electronic device (101) based on sensor data, an operation (1507) of determining a display to operate based on the state change, and an operation (1509) of displaying a designated screen based on a second designated display.
[0305] Referring to FIG. 15, in operation 1501, the processor (120) of the electronic device (101) may display a designated screen based on a first designated display. According to one embodiment, the processor (120) may display a designated screen based on at least one designated display (e.g., the first display surface (311) and / or the second display surface (312)) determined based on a folding state (e.g., the first state, the second state, the third state, or the fourth state) of the display (310). According to one embodiment, the processor (120) may control the display (310) to display a designated screen based on a display surface (e.g., the first display surface (311) and / or the second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode).
[0306] In operation 1503, the processor (120) may detect a state change. According to one embodiment, the processor (120) may detect the state change based on changes in the first folding angle and the second folding angle acquired through angle detection sensors (e.g., the first sensor and the second sensor). An example of this is illustrated in FIG. 16.
[0307] Referring to FIG. 16, the electronic device (101) can be reciprocally changed between a first state (1610), a second state (1620), a third state (1630), and a fourth state (1640) based on a user's manipulation of changing the folding state (or folding angle). According to one embodiment, the electronic device (101) can be changed from the first state (1610) to the second state (1620), the third state (1630), or the fourth state (1640). According to one embodiment, the electronic device (101) can be changed from the second state (1620) to the first state (1610), the third state (1630), or the fourth state (1640). According to one embodiment, the electronic device (101) may change states from a third state (1630) to a first state (1610), a second state (1620), or a fourth state (1640). According to one embodiment, the electronic device (101) may change states from a fourth state (1640) to a first state (1610), a second state (1620), or a third state (1630).
[0308] For example, the electronic device (101) may display an execution screen (e.g., a first designated screen) of a first designated application through the first display surface (311) in a first state (1610). According to one embodiment, a user may manipulate the electronic device (101) to change the state from the first state (1610) to the second state (1620).
[0309] Referring back to FIG. 15, in operation 1505, the processor (120) may determine a state of the electronic device (101) based on sensor data (e.g., a first folding angle and a second folding angle). According to one embodiment, when the processor (120) detects a state change of the electronic device (101) based on a change in the folding angle, the processor (120) may determine a state of the electronic device (101) whose state has changed based on the first folding angle and the second folding angle obtained from angle detection sensors (e.g., a first sensor and a second sensor).
[0310] At operation 1507, the processor (120) may determine which display to operate based on the state change.
[0311] According to one embodiment, the processor (120) may detect a state change to a second state (1620) while operating the first display surface (311) as the main screen in the first state (1610), and activate the second display surface (312) based on the detection of the state change. According to one embodiment, the processor (120) may operate the second display surface (312) as a sub-screen while maintaining the main screen.
[0312] According to one embodiment, the processor (120) may detect a state change to a third state (1630) while operating the first display surface (312) as the main screen in the first state (1610), and based on the detection of the state change, activate the second display surface (312) and deactivate the first display surface (311). According to one embodiment, the processor (120) may cause the second display surface (312) to operate as the main screen to display an execution screen of a specified application.
[0313] According to one embodiment, the processor (120) can detect a state change from the second state (1620) to the third state (1630), and based on detecting the state change, can deactivate the first display surface (311). According to one embodiment, the processor (120) can operate the second display surface (312) as the main screen while maintaining the screen being displayed through the second display surface (312).
[0314] In operation 1509, the processor (120) may display a designated screen based on a second designated display. According to one embodiment, the processor (120) may display a designated screen based on at least one designated display (e.g., the first display surface (311) and / or the second display surface (312)) determined based on a changed folding state (e.g., the first state (1610), the second state (1620), the third state (1630), or the fourth state (1640)). According to one embodiment, the processor (120) may control the display (310) to display a designated screen based on a display surface (e.g., the first display surface (311) and / or the second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode).
[0315] According to one embodiment, when the electronic device (101) detects a state change from the first state (1610) to the second state (1620), the electronic device (101) may execute a second designated application (e.g., a music player) through the second display surface (312) and display a related execution screen (e.g., a music playback screen) through the second display surface (312). For example, while the user is using the dashboard through the first display surface (311) in the first state (1610), the user may change the state to the second state by adjusting the folding angle of the electronic device (101) so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, while the user is using the dashboard through the first display surface (311) in the second state (1620), the user may check the music playback screen through the second display surface (312).
[0316] FIGS. 17A and 17B are diagrams illustrating examples of state changes in an electronic device according to one embodiment of the present disclosure.
[0317] According to one embodiment, the example of FIG. 17A may illustrate an example of changing states from a first state (1610) in which the first display surface (311) operates in screen mode and the second display surface (312) operates in hidden screen mode to a fourth state (1640) in which the first display surface (312) and the second display surface (313) operate in screen mode. According to one embodiment, the electronic device (101) may activate the first display surface (311) in the first state (1610) and deactivate the second display surface (312) and the third display surface (313). According to one embodiment, the electronic device (101) may operate to display a first designated screen (1710) through the first display surface (311) in the first state (1610).
[0318] According to one embodiment, the example of FIG. 17B may illustrate an example of changing states from a second state (1620) in which the first display surface (311) operates in a main screen mode and the second display surface (312) operates in a sub screen mode to a fourth state (1640) in which the first display surface (311) and the second display surface (312) operate in a screen mode. According to one embodiment, the electronic device (101) may activate the first display surface (311) and the second display surface (312) in the second state (1620), and deactivate the third display surface (313). According to one embodiment, the electronic device (101) may operate to display a first designated screen (1710) through the first display surface (311) and to display a second designated screen (1720) through the second display surface (312) in the second state (1610).
[0319] According to one embodiment, the electronic device (101) may expand and display a designated screen of any one display surface operating in screen mode when changing a state from a folding state other than the fourth state (e.g., any one of the first to third states) to the fourth state (1640).
[0320] According to one embodiment, the electronic device (101) may change to a fourth state (1640) while displaying a first designated screen (1710) (e.g., an execution screen of a first application) through the first display surface (311) according to the first state (1610), as in the example of FIG. 17A. According to one embodiment, the electronic device (101) may display the first designated screen (1710) by expanding it based on the first display surface (311) and the second display surface (312) in the fourth state (1640). For example, when only the first display surface (311) is activated, the electronic device (101) may expand the execution screen (e.g., the first designated screen (1710)) of the first application running on the first display surface (311). For example, when the electronic device (101) changes from the first state (1610) to the fourth state (1640), the execution screen of the main screen (e.g., the first designated screen (1710)) can be expanded and displayed through the first display surface (311) and the second display surface (312).
[0321] According to one embodiment, the electronic device (101) may display a first designated screen (1710) (e.g., an execution screen of a first application) through the first display surface (311) according to the second state (1620), as in the example of FIG. 17b, and may change to a fourth state (1640) while displaying a second designated screen (1720) (e.g., an execution screen of a second application) through the second display surface (312). According to one embodiment, the electronic device (101) may display an expanded second designated screen (1720) based on the first display surface (311) and the second display surface (312) in the fourth state (1640). For example, when the first display surface (311) and the second display surface (312) are activated, the electronic device (101) can expand the execution screen (e.g., the second designated screen (1720)) of the second application running on the second display surface (312). For example, when the electronic device (101) changes the state from the second state (1620) to the fourth state (1640), the electronic device (101) can expand and display the execution screen (e.g., the second designated screen (1720)) of the sub-screen through the first display surface (311) and the second display surface (312).
[0322] According to one embodiment, when the electronic device (101) detects a state change to the fourth state (1640), it can determine the display surface that is in operation. According to one embodiment, when the display surface that is in operation is the first display surface (311) or the second display surface (312), the electronic device (101) can determine to expand and display the execution screen of the corresponding display surface. According to one embodiment, when the display surfaces that are in operation are the first display surface (311) and the second display surface (312), the electronic device (101) can determine to expand and display the execution screen of the second display surface (312).
[0323] FIG. 18 is a diagram illustrating an example of an operation of operating a display based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0324] Referring to Fig. 18, an example <1810> In the first state, the electronic device (101) can execute a first application (e.g., a media player or a game application) through a first display surface (311), and display a related first execution screen (e.g., a video playback screen or a game screen) through the first display surface (311).
[0325] example <1820> In , the electronic device (101) may receive an event (e.g., a notification event such as a messenger, mail, or chat message) from an external source (e.g., a server or another electronic device) while displaying the first execution screen. According to one embodiment, when a notification event is received while displaying the first execution screen, the electronic device (101) may display a notification object (1825) corresponding to the notification event on the first execution screen of the first display surface (311).
[0326] example <1830> In , the electronic device (101) may detect a state change while a notification event is received and a related notification object (1825) is displayed on the first execution screen. For example, the electronic device (101) may detect a state change from a first state to a second state or a third state in which the second display surface (312) is activated. According to one embodiment, a user may change the state from the first state to the second state or the third state by manipulating the electronic device (101) (e.g., changing the folding state based on a change in the folding angle). In one embodiment, FIG. 18 may illustrate an example of a state change from the first state to the third state.
[0327] Essie <1830> In this case, when the electronic device (101) changes its state from the first state to the third state, it may execute a second application (e.g., an application related to a notification event) through the second display surface (312) and display a related second execution screen (e.g., a message screen, a mail screen, or a chat screen) through the second display surface (312). According to one embodiment, when the electronic device (101) detects a state change to the third state, it may call and execute a second application capable of processing a notification event and display a screen related to the notification event executed by the second application. For example, when a notification event occurs, the user may change the state to the third state by adjusting the folding angle of the electronic device (101) so that the second display surface (312) is positioned within the user's field of vision. According to one embodiment, the user may immediately check the content of the notification event through the second display surface (312) in the third state.
[0328] example <1840> In the third state, the electronic device (101) can detect the proximity (e.g., hovering) of an external object (1860) (e.g., a user's hand or a digital pen) through the third display surface (313). According to one embodiment, when the electronic device (101) detects the proximity of the external object (1860), the electronic device (101) can activate the third display surface (313) and provide a designated input interface (1845) through the third display surface (313). According to one embodiment, when the proximity of the external object (1860) is detected through the third display surface (313) operating in the input screen mode, the electronic device (101) can call and execute the input interface (1845) (e.g., a keypad) and provide the input interface (1845) (e.g., a keypad) through the third display surface (313). In one embodiment, a user may input information on the second execution screen based on an input interface (1845) provided via the third display surface (313). For example, if the notification event is a chat message and the second execution screen is thus a chat screen, the user may input the chat message using the input interface (1845).
[0329] example <1850> In , the electronic device (101) can detect a state change. For example, the electronic device (101) can detect a state change from a third state to a first state or a second state. According to one embodiment, a user can change a state from the third state to the first state or the second state by manipulating the electronic device (101) (e.g., changing a folding state based on a change in a folding angle). In one embodiment, FIG. 18 illustrates a state change from a third state to a first state (e.g., an example <1810> An example of a case where the original position is returned can be shown.
[0330] example <1850> In the case where the electronic device (101) changes state from the third state to the first state, the second execution screen of the first application can be continuously provided in the previous state through the first display surface (311). For example, the user can continuously watch a video that was previously being watched. For example, the electronic device (101) can generally provide the user with a video by playing it from the part where it was stopped playing just before the state change to the third state.
[0331] According to one embodiment, the electronic device (101) may detect a notification event while operating in a first state or a second state. According to one embodiment, the electronic device (101) may provide a notification corresponding to the notification event through a first display surface (311). According to one embodiment, while providing a notification corresponding to the notification event, the electronic device (101) may detect a state change from the first state or the second state to a third state. According to one embodiment, the electronic device (101) may display an execution screen corresponding to the notification event through a second display surface (312) based on detecting the state change.
[0332] FIG. 19 is a flowchart illustrating an operating method of an electronic device according to one embodiment of the present disclosure.
[0333] According to one embodiment, FIG. 19 may illustrate an example of an operation for controlling a related function based on a third interaction related to object proximity (e.g., hovering) based on a designated display surface (e.g., a third display surface (313)) in an electronic device (101) according to one embodiment.
[0334] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 19. The flowchart illustrated in FIG. 19 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 1901 to 1911 may be performed by at least one processor (e.g., processor 120 of FIG. 1 or 5) of the electronic device (101).
[0335] According to one embodiment, the operations described in FIG. 19 may be heuristically performed in combination with the operations described in FIGS. 6 to 18, for example, or heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or heuristically performed as a detailed operation of at least some of the operations described.
[0336] As illustrated in FIG. 19, an operation method performed by an electronic device (101) according to one embodiment may include an operation (1901) of displaying a designated screen based on a first designated display (e.g., a first display surface (311) and / or a second display surface (312)), an operation (1903) of detecting object proximity based on a second designated display (e.g., a third display surface (313)), an operation (1905) of displaying an input interface through the second designated display, an operation (1907) of controlling a screen within the first designated display based on a user input, an operation (1909) of detecting object proximity release, and an operation (1911) of deactivating the second designated display based on detecting object proximity release.
[0337] Referring to FIG. 19, in operation 1901, the processor (120) of the electronic device (101) may display a designated screen based on a first designated display (e.g., the first display surface (311) and / or the second display surface (312)). According to one embodiment, the processor (120) may display a designated screen based on at least one designated display (e.g., the first display surface (311) and / or the second display surface (312)) determined based on a folding state (e.g., the first state, the second state, the third state, or the fourth state) of the display (310). According to one embodiment, the processor (120) may control the display (310) to display a designated screen based on a display surface (e.g., the first display surface (311) and / or the second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode).
[0338] In operation 1903, the processor (120) may detect proximity of an object based on a second designated display (e.g., a third display surface (313)). In one embodiment, the processor (120) may detect proximity of an external object (e.g., a user's hand, a digital pen) through the third display surface (313) (e.g., hovering detection) when the electronic device (101) is in an intermediate, folded state.
[0339] In operation 1905, the processor (120) may display an input interface through the second designated display. In one embodiment, the processor (120) may activate (or turn on) the third display surface (313) based on detecting proximity of an external object through the third display surface (313) in an intermediate state. In one embodiment, when providing the input interface, the processor (120) may provide (e.g., display) an input interface corresponding to an attribute of an application (e.g., an application of the first designated display) through the third display surface (313).
[0340] According to one embodiment, the processor (120) may determine the properties of the first application provided through the first display surface (311) based on detecting the proximity of an external object through the third display surface (313) in the first state. According to one embodiment, the processor (120) may call a first input interface corresponding to the properties of the first application and display it through the third display surface (313). According to one embodiment, the processor (120) may determine the properties of the second application provided through the second display surface (312) based on detecting the proximity of an external object through the third display surface (313) in the second state or the third state. According to one embodiment, the processor (120) may call a second input interface corresponding to the properties of the second application and display it through the third display surface (313).
[0341] In one embodiment, the input interface may include, for example, a text keypad (e.g., a native language keypad, an English keypad), a number keypad, a game / media controller, a drawing pad, a calculator pad, and / or a notepad (memo). An example of providing an input interface based on application properties of a given display surface is described below with reference to the drawings, according to one embodiment.
[0342] In operation 1907, the processor (120) may control a screen within a first designated display based on a user input. In one embodiment, the processor (120) may receive the user input through an input interface of a second designated display. In one embodiment, the processor (120) may process an operation (or function) corresponding to the user input based on the screen within the first designated display, and display the result of the processing through the screen within the first designated display. For example, the processor (120) may update the screen within the first designated display based on a user input based on the input interface.
[0343] At operation 1909, the processor (120) may determine (or monitor) whether an object proximity (e.g., hovering) is released. In one embodiment, the processor (120) may display an input interface via a second designated display (e.g., a third display surface (313)) while the object is hovering over the second designated display, and monitor whether there is use of the input interface (e.g., whether hovering is continuously detected).
[0344] At operation 1909, if object proximity release is not detected (e.g., 'No' at operation 1909), the processor (120) may proceed to operation 1905 and perform operations below operation 1905.
[0345] At operation 1909, if an object proximity (e.g., hovering) release is detected (e.g., 'yes' of operation 1909), at operation 1911, the processor (120) may deactivate the second designated display based on detecting the object proximity release. According to one embodiment, while displaying the input interface through the second designated display, if there is no use of the input interface (e.g., if object proximity (e.g., hovering) is not detected), the processor (120) may deactivate (e.g., turn off) the second designated display (e.g., the third display surface (131)) after a specified period of time (e.g., N seconds, where N is a specified natural number) has elapsed. According to one embodiment, the processor (120) may deactivate (or remove) the input interface upon deactivation of the second designated display.
[0346] FIGS. 20A, 20B, 20C, and 20D are diagrams illustrating examples of providing an input interface in an electronic device according to one embodiment of the present disclosure.
[0347] According to one embodiment, when a situation requiring user input occurs while the user is using the electronic device (101) in a folding state (e.g., a first state, a second state, a third state, or a fourth state) based on a specified folding angle in a specified operating state, the user may call up an input interface by bringing the user's hand or a digital pen close to (e.g., hovering) the third display surface (313). According to one embodiment, the electronic device (101) may recognize the proximity (e.g., hovering) of an object corresponding to the user's hand or digital pen based on the third display surface (313).
[0348] According to one embodiment, the electronic device (101) may activate (e.g., turn on) the third display surface (313) based on recognizing proximity of an object through the third display surface (313) in an intermediate state, and provide an input interface corresponding to (or suitable or optimized for) the properties of a running application (e.g., properties of an application on the first display surface (311) or the second display surface (312)) through the third display surface (313).
[0349] According to one embodiment, the electronic device (101) may provide an input interface (e.g., a text keypad (e.g., a native language keypad, an English keypad), a numeric keypad, a game controller, a media controller, a drawing pad, a calculator pad, and / or a notepad (or memo pad)) optimized for the usage situation of an application of a given display surface based on detecting proximity (e.g., hovering detection) of an external object (e.g., a user's hand, a digital pen) through the third display surface (313) in an intermediate state (e.g., a first state, a second state, a third state, or a fourth state).
[0350] According to one embodiment, the example of FIG. 20A may illustrate an example of providing a first input interface (2010) in a first state in which the first display surface (311) operates in screen mode and the second display surface (312) operates in hidden screen mode. According to one embodiment, the electronic device (101) may activate the first display surface (311) in the first state and deactivate the second display surface (312) and the third display surface (313). According to one embodiment, the electronic device (101) may display an execution screen of a first application through the first display surface (311) in the first state.
[0351] According to one embodiment, the electronic device (101) may detect proximity (e.g., hovering) of an external object through the third display surface (313) in a first state. According to one embodiment, the electronic device (101) may determine an attribute of a first application provided through the first display surface (311) based on detecting the proximity of the external object. According to one embodiment, the electronic device (101) may call a first input interface (2010) corresponding to the attribute of the first application and display the first input interface (2010) through the third display surface (313).
[0352] For example, if the first application is a planner, the electronic device (101) may provide a first input interface (2010) (e.g., a keypad) capable of supporting adding a schedule. According to one embodiment, while checking a schedule through the first display surface (311) in the first state, the user may call up the first input interface (2010) by hovering on the third display surface (313). According to one embodiment, the user may add a schedule using the first input interface (2010).
[0353] For example, if the first application is a game application, the electronic device (101) may provide a first input interface (2010) (e.g., a game controller) capable of supporting game control. According to one embodiment, a user may call up the first input interface (2010) by hovering on a third display surface (313) while playing a game through the first display surface (311) in a first state. According to one embodiment, the user may operate the game using the first input interface (2010).
[0354] For example, if the first application is an Internet lecture application, the electronic device (101) may provide a first input interface (201) (e.g., a notepad) capable of supporting note input (or handwriting input). According to one embodiment, while watching an Internet lecture through the first display surface (311) in a first state, the user may call up the first input interface (2010) by hovering on the third display surface (313). According to one embodiment, the user may input a note (or handwriting) using the first input interface (2010).
[0355] According to one embodiment, the example of FIG. 20b may illustrate an example of providing a second input interface (2020) in a second state in which the first display surface (311) and the second display surface (312) operate in screen mode. According to one embodiment, the electronic device (101) may activate the first display surface (311) and the second display surface (312) in the second state, and deactivate the third display surface (313). According to one embodiment, the electronic device (101) may display an execution screen of a first application through the first display surface (311) in the second state, and may display an execution screen of a second application through the second display surface (312).
[0356] According to one embodiment, the electronic device (101) may detect proximity (e.g., hovering) of an external object through the third display surface (313) in the second state. According to one embodiment, the electronic device (101) may determine an attribute of a second application provided through the second display surface (312) based on detecting the proximity of the external object. According to one embodiment, the electronic device (101) may call a second input interface (2020) corresponding to the attribute of the second application and display the second input interface (2020) through the third display surface (313).
[0357] According to one embodiment, the operation example of providing a second input interface (2020) corresponding to the properties of the second application may operate similarly to various operation examples of providing a first input interface (2010) corresponding to the properties of the first application of FIG. 20A. For example, the electronic device (101) may provide various second input interfaces (2020) to the user in a similar manner as described in the description section referring to FIG. 20A.
[0358] According to one embodiment, the example of FIG. 20c may illustrate an example of providing a third input interface (2030) in a third state in which the first display surface (311) operates in a hidden screen mode and the second display surface (312) operates in a screen mode. According to one embodiment, the electronic device (101) may activate the second display surface (312) in the third state and deactivate the first display surface (311) and the third display surface (313). According to one embodiment, the electronic device (101) may display an execution screen of a third application through the second display surface (312) in the third state.
[0359] According to one embodiment, the electronic device (101) may detect proximity (e.g., hovering) of an external object through the third display surface (313) in the third state. According to one embodiment, the electronic device (101) may determine an attribute of a third application provided through the second display surface (312) based on detecting the proximity of the external object. According to one embodiment, the electronic device (101) may call a third input interface (2030) corresponding to the attribute of the third application and display the third input interface (2030) through the third display surface (313).
[0360] According to one embodiment, an example of an operation of providing a third input interface (2030) corresponding to an attribute of a third application may operate similarly to various examples of an operation of providing a first input interface (2010) corresponding to an attribute of a first application of FIG. 20A. For example, the electronic device (101) may provide various third input interfaces (2030) to the user in a similar manner as described in the description section referring to FIG. 20A.
[0361] According to one embodiment, the example of FIG. 20d may illustrate an example of providing a fourth input interface (2040) in a fourth state in which the first display surface (311) and the second display surface (312) operate in an extended screen mode. According to one embodiment, the electronic device (101) may activate the first display surface (311) and the second display surface (312) in the fourth state, and deactivate the third display surface (313). According to one embodiment, the electronic device (101) may expand and display the execution screen of the fourth application through the first display surface (311) and the second display surface (312) in the fourth state.
[0362] According to one embodiment, the electronic device (101) may detect proximity (e.g., hovering) of an external object through the third display surface (313) in the fourth state. According to one embodiment, the electronic device (101) may determine the properties of a fourth application provided through the first display surface (311) and the second display surface (312) based on detecting the proximity of the external object. According to one embodiment, the electronic device (101) may call a fourth input interface (2040) corresponding to the properties of the fourth application and display the fourth input interface (2040) through the third display surface (313).
[0363] According to one embodiment, an example of an operation of providing a fourth input interface (2040) corresponding to an attribute of a fourth application may operate similarly to various examples of an operation of providing a first input interface (2010) corresponding to an attribute of a first application of FIG. 20A. For example, the electronic device (101) may provide various fourth input interfaces (2040) to the user in a similar manner as described in the description section referring to FIG. 20A.
[0364] FIG. 21 is a flowchart illustrating an operating method of an electronic device according to one embodiment of the present disclosure.
[0365] According to one embodiment, FIG. 13 may illustrate an example of an operation for controlling a related function based on a fourth interaction related to releasing a specified operating state (or a specified folding state) in an electronic device (101) according to one embodiment.
[0366] An operation method supported by an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to a flowchart illustrated in FIG. 21. The flowchart illustrated in FIG. 21 is an example according to one embodiment of an operation of the electronic device (101), and the order of at least some operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some operations. According to one embodiment of the present disclosure, operations 2101 to 2105 may be performed by at least one processor of the electronic device (101) (e.g., the processor 120 of FIG. 1 or 5).
[0367] According to one embodiment, the operations described in FIG. 21 may be heuristically performed in combination with the operations described in FIGS. 6 to 20d, for example, or heuristically performed as a replacement for at least some of the operations described and combined with at least some other operations, or heuristically performed as a detailed operation of at least some of the operations described.
[0368] As illustrated in FIG. 21, an operation method performed by an electronic device (101) according to one embodiment may include an operation (2101) of displaying a specified screen based on a specified display, an operation (2103) of detecting release of an operation, and an operation (2105) of executing a specified operation.
[0369] Referring to FIG. 21, in operation 2101, the processor (120) of the electronic device (101) may display a designated screen based on a designated display. According to one embodiment, the processor (120) may display a designated screen based on at least one designated display (e.g., the first display surface (311) and / or the second display surface (312)) determined based on a folding state (e.g., the first state, the second state, the third state, or the fourth state) of the display (310). According to one embodiment, the processor (120) may control the display (310) to display a designated screen based on a display surface (e.g., the first display surface (311) and / or the second display surface (312)) operating in a screen mode (or a main screen mode and a sub-screen mode).
[0370] In operation 2103, the processor (120) may detect a release of the operation. According to one embodiment, the release of the operation may include a condition for releasing a specified operation state. For example, the release of the operation of the specified operation state may include at least one condition, such as a first condition in which the electronic device (101) changes from a portrait mode to a landscape mode, a second condition in which the electronic device (101) is released from a cradle state (e.g., removed from a desk), a third condition in which the folding state of the electronic device (101) changes to a folded state, and / or a fourth condition in which the folding state of the electronic device (101) changes to an unfolded state. According to one embodiment, the processor (120) may determine a release of the operation for the specified operation state of the electronic device (101) based on detecting the first condition, the second condition, the third condition, and / or the fourth condition while the electronic device (101) is operating in the specified operation state.
[0371] At operation 1305, the processor (120) may execute a designated operation based on detecting the release of the operation. According to one embodiment, the processor (120) may terminate the operation based on the designated operation state. For example, the processor (120) may release the operation mode of the display (310) according to the designated folding state (e.g., the operation mode assigned to each display surface) and deactivate (e.g., turn off) at least one display surface that is operating (or activated). For example, the processor (120) may release the operation mode of the display (310) according to the designated folding state and operate to display an execution screen through the full screen of the display (310).
[0372] According to one embodiment, when the processor (120) is operating in a designated operating state, if the folding state (e.g., folding angle) is included in the operation release condition (or if it deviates from the execution condition of the designated operating state), the processor (120) may operate to maintain the designated operating state for a designated period of time without immediately releasing the designated operating state. According to one embodiment, when the processor (120) is switched from portrait mode to landscape mode or is removed from the cradle state while operating in the designated operating state, since the user may intend to move the position of the electronic device (101), the processor (120) may not immediately release the designated operating state but may maintain the designated operating state for a designated period of time (e.g., N seconds). According to one embodiment, the processor (120) may maintain the designated operating state when the folding state changes other than a fully folded state or a fully unfolded state. For example, since the operation in the designated operating state is for the usability of adjusting the folding angle, the processor (120) may operate to maintain the designated operating state when there is an adjustment of a folding state other than a folded state or an unfolded state after the execution of the designated operating state.
[0373] An operating method performed in an electronic device (101) (e.g., a multi-foldable electronic device) according to one embodiment of the present disclosure may include an operation of detecting the start of an operation of the electronic device (101). According to one embodiment, the operating method may include an operation of determining a specified operating state of the electronic device (101) based on detecting the start of the operation. According to one embodiment, the operating method may include an operation of detecting (or identifying) a first folding state between a first housing and a second housing using the first sensor (e.g., a first angle detection sensor of the second sensor circuit (570)) based on determining a specified operating state of the electronic device (101). According to one embodiment, the operating method may include an operation of detecting (or identifying) a second folding state between the second housing and the third housing using the second sensor (e.g., a second angle detection sensor of the second sensor circuit (570)) based on determining a specified operating state of the electronic device (101). According to one embodiment, the operating method may include an operation of controlling the first display area (e.g., the first display surface (311)), the second display area (e.g., the second display surface (312)), or the third display area (e.g., the third display surface (313)) of the flexible display (e.g., the display (310)) to be turned on or off based on the first folding state and the second folding state.
[0374] According to one embodiment, the flexible display may be divided into a first display area (e.g., a first display surface (311)) and a second display area (e.g., a second display surface (312)) based on a folding axis (e.g., a first folding axis) between the first housing and the second housing. According to one embodiment, the flexible display may be divided into a second display area (e.g., a second display surface (312)) and a third display area (e.g., a third display surface (313)) based on a folding axis (e.g., a second folding axis) between the second housing and the third housing.
[0375] According to one embodiment, the first display area, the second display area, and the third display area may be formed to extend from each other by being partially folded or unfolded in a flat form, depending on the folding angle between the first housing and the second housing and the second folding angle between the second housing and the third housing.
[0376] According to one embodiment, the electronic device (101) may include a state detection sensor (e.g., a first sensor circuit (560)) that detects an operating state of the electronic device (101).
[0377] According to one embodiment, the operating method may include an operation of determining an operating state of the electronic device (101) using the state detection sensor based on detecting the start of operation of the electronic device (101). According to one embodiment, the operating method may include an operation of determining the first folding state and the second folding state of the flexible display using the first sensor and the second sensor based on determining a specified operating state for the electronic device (101).
[0378] According to one embodiment, the operating method may include an operation of detecting the start of operation of the electronic device (101) based on detection of a folding operation, detection of an unfolding operation, or detection of activation of the flexible display.
[0379] In one embodiment, the operating method may include an operation of determining the first folding state based on the first folding angle between the first housing and the second housing. In one embodiment, the operating method may include an operation of determining the second folding state based on the second folding angle between the second housing and the third housing.
[0380] According to one embodiment, the folding state of the electronic device (101) may include an intermediate state in which the first folding angle and the second folding angle have a specified angle range.
[0381] According to one embodiment, the intermediate state of the electronic device (101) may include a first state in which the first folding angle includes a first angle range designated so that the first display area operates as a main screen, and the second folding angle includes a second angle range designated so that the second display area operates as a hidden screen.
[0382] According to one embodiment, the intermediate state of the electronic device (101) may include a second state in which the first folding angle includes the first angle range and the second folding angle includes a third angle range designated so that the second display area operates as a sub-screen.
[0383] According to one embodiment, the intermediate state of the electronic device (101) may include a third state in which the first folding angle includes a fourth angle range designated so that the first display area operates as a hidden screen, and the second folding angle includes a fifth angle range designated so that the second display area operates as a main screen.
[0384] According to one embodiment, the intermediate state of the electronic device (101) may include a fourth state in which the first folding angle includes a sixth angle range in which the first display area and the second display area form a plane, and the second folding angle includes a seventh angle range.
[0385] According to one embodiment, the folding state of the electronic device (101) may include a folding state in which the first folding angle and the second folding angle include an eighth angle range in which the first display area, the second display area, and the third display area are folded in parallel.
[0386] According to one embodiment, the folding state of the electronic device (101) may include an unfolding state in which the first folding angle and the second folding angle include a ninth angle range in which the first display area, the second display area, and the third display area form a plane.
[0387] According to one embodiment, the operating method may include, in the intermediate state, providing an input interface to the third display area based on detecting proximity of an external object through the third display area.
[0388] According to one embodiment, the operating method may include an operation of activating the third display area based on detecting proximity of the external object through the third display area in the intermediate state. According to one embodiment, the operating method may include an operation of providing an input interface corresponding to a property of a running application through the third display area.
[0389] According to one embodiment, the operating method may include, in the first state, an operation of determining an attribute of a first application provided through the first display area based on detecting proximity of the external object through the third display area, and an operation of calling an input interface corresponding to the attribute of the first application and displaying it through the third display area.
[0390] According to one embodiment, the operating method may include, in the second state or the third state, an operation of determining an attribute of a second application provided through the second display area based on detecting proximity of the external object through the third display area, and an operation of calling an input interface corresponding to the attribute of the second application and displaying it through the third display area.
[0391] According to one embodiment, the operating method may include, in the fourth state, an operation of determining an attribute of a third application provided through the first display area and the second display area based on detecting proximity of the external object through the third display area, and an operation of calling an input interface corresponding to the attribute of the third application and displaying it through the third display area.
[0392] According to one embodiment, the operating method may include an operation of detecting a state change to the second state while operating the first display area as a main screen in the first state, an operation of activating the second display area based on detecting the state change, and an operation of operating the second display area as a sub-screen while maintaining the main screen based on the first display area.
[0393] According to one embodiment, the operating method may include an operation of detecting a state change to the third state while operating the first display area as a main screen in the first state, an operation of activating the second display area and deactivating the first display area based on detecting the state change, and an operation of displaying an execution screen of a specified application by operating the second display area as a main screen.
[0394] According to one embodiment, the operating method may include an operation of detecting a state change from the second state to the third state, an operation of deactivating the first display area based on detecting the state change, and an operation of operating the second display area as a main screen while maintaining an execution screen being displayed through the second display area.
[0395] According to one embodiment, the operating method may include an operation of detecting a notification event while operating in the first state or the second state, an operation of providing a notification corresponding to the notification event through a first display area, an operation of detecting a state change from the first state or the second state to the third state, and an operation of displaying an execution screen corresponding to the notification event through the second display area based on detecting the state change.
[0396] According to one embodiment, the operating method may include an operation of determining an operating display area when a state change to the fourth state is detected. According to one embodiment, the operating method may include an operation of controlling the flexible display to expand and display an execution screen of the corresponding display area when the operating display area is a first display area or a second display area. According to one embodiment, the operating method may include an operation of controlling the flexible display to expand and display an execution screen of the second display area when the operating display areas are the first display area and the second display area.
[0397] According to one embodiment, the operating method may include an operation of displaying an execution screen of the main screen by expanding it through the first display area and the second display area when the state changes from the first state to the third state. According to one embodiment, the operating method may include an operation of displaying an execution screen of the sub screen by expanding it through the first display area and the second display area when the state changes from the second state to the third state.
[0398] According to one embodiment, the operating method may include an operation of receiving a user input while displaying an execution screen of an application through a display area in the intermediate state, and an operation of switching an application to be provided through the display area based on the reception of the user input. According to one embodiment, the application switching may include switching between recently executed applications, switching between preset applications, and / or switching between recommended applications associated with the application.
[0399] According to one embodiment, the electronic device (101) may include a multi-foldable electronic device comprising N hinge structures and N+1 housings. According to one embodiment, N may include a natural number greater than or equal to 2.
[0400] A non-transitory computer-readable recording medium storing instructions that, when executed by a processor (120) of an electronic device (101) according to one embodiment of the present disclosure, cause the processor (120) to perform operations, wherein the instructions, when executed by the processor (120), cause the electronic device (101) to: detect the start of operation of the electronic device (101); determine a designated operation state of the electronic device (101) based on detecting the start of operation; detect (or identify) a first folding state between a first housing and a second housing using a first sensor (e.g., a first angle detection sensor of a second sensor circuit (570)) based on determining the designated operation state of the electronic device (101); and determine a first folding state between the second housing and a third housing using a second sensor (e.g., a second angle detection sensor of a second sensor circuit (570)). The recording medium may include an operation for detecting (or identifying) a second folding state between the housings, and an operation for controlling a first display area (e.g., a first display surface (311)), a second display area (e.g., a second display surface (312)), or a third display area (e.g., a third display surface (313)) of a flexible display (e.g., a display (310)) to be switched on or off based on the first folding state and the second folding state.
[0401] It will be appreciated that the above-described embodiments and their technical features may be combined with each other in any and all combinations, as long as there is no potential conflict between the two embodiments or features. For example, any and all combinations of two or more of the above-described embodiments may be envisioned and incorporated within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment, providing a corresponding advantage or advantages.
[0402] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0403] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0404] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0405] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0406] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0407] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0408] The various embodiments of the present disclosure disclosed in this specification and drawings are merely specific examples to facilitate easy explanation of the technical content of the present disclosure and aid understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concepts of the present disclosure, in addition to the embodiments disclosed herein.
Claims
1. In a multi-foldable electronic device, A housing comprising a first housing, a second housing and a third housing; A first hinge structure disposed between the first housing and the second housing; A second hinge structure disposed between the second housing and the third housing; A flexible display comprising a first display area, a second display area, and a third display area; A first sensor detecting a first folding angle between the first housing and the second housing; A second sensor for detecting a second folding angle between the second housing and the third housing; At least one processor comprising processing circuitry; and Contains memory, The above memory, when executed by the at least one processor, causes the electronic device to: Detecting the start of operation of the above multi-foldable electronic device, Based on detecting the start of the above operation, determining a specified operation state of the multi-foldable electronic device, Based on determining a designated operating state for the multi-foldable electronic device, a first folding state between the first housing and the second housing is detected using the first sensor, Detecting a second folding state between the second housing and the third housing using the second sensor, and A multi-foldable electronic device storing instructions for controlling turning on or off the first display area, the second display area, or the third display area of the flexible display based on the first folding state and the second folding state.
2. In the first paragraph, the multi-foldable electronic device includes a state detection sensor that detects the operating state of the multi-foldable electronic device, The above instructions, when executed by the at least one processor, cause the electronic device to: Based on detecting the start of operation of the multi-foldable electronic device, the operating state of the multi-foldable electronic device is determined using the state detection sensor, A multi-foldable electronic device, wherein the first folding state and the second folding state of the flexible display are determined using the first sensor and the second sensor based on determining a designated operating state of the multi-foldable electronic device.
3. In the first paragraph, the folding state of the multi-foldable electronic device is: The first folding angle and the second folding angle include an intermediate state having a specified angle range, The above intermediate state is, A first state in which the first folding angle includes a first angle range designated so that the first display area operates as a main screen, and the second folding angle includes a second angle range designated so that the second display area operates as a hidden screen; A second state in which the first folding angle includes the first angle range and the second folding angle includes a third angle range designated so that the second display area operates as a sub-screen; a third state in which the first folding angle includes a fourth angle range designated so that the first display area operates as a hidden screen, and the second folding angle includes a fifth angle range designated so that the second display area operates as a main screen, and A multi-foldable electronic device comprising a fourth state in which the first folding angle includes a sixth angle range in which the first display area and the second display area form a plane, and the second folding angle includes a seventh angle range.
4. In the third paragraph, the folding state of the multi-foldable electronic device is: A folding state in which the first folding angle and the second folding angle include an eighth angle range in which the first display area, the second display area, and the third display area are folded in parallel, and A multi-foldable electronic device comprising an unfolded state in which the first folding angle and the second folding angle include a ninth angle range in which the first display area, the second display area, and the third display area form a plane.
5. In the third paragraph, when the instructions are executed by the at least one processor, the electronic device, In the above intermediate state, based on detecting the proximity of the external object through the third display area, the third display area is activated, A multi-foldable electronic device providing an input interface corresponding to properties of a running application in said third display area.
6. In the fifth paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: In the first state, based on detecting the proximity of the external object through the third display area, the property of the first application provided through the first display area is determined, and an input interface corresponding to the property of the first application is called and displayed through the third display area. In the second state or the third state, based on detecting proximity of the external object through the third display area, determining the property of the second application provided through the second display area, and calling an input interface corresponding to the property of the second application and displaying it through the third display area, A multi-foldable electronic device that, in the fourth state, determines the properties of a third application provided through the first display area and the second display area based on detecting the proximity of the external object through the third display area, and calls an input interface corresponding to the properties of the third application to display it through the third display area.
7. In the third paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: While operating the first display area as the main screen in the first state, detecting a state change to the second state, Based on detecting the above state change, activating the second display area, A multi-foldable electronic device that operates the second display area as a sub-screen while maintaining the main screen based on the first display area.
8. In the third paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: While operating the first display area as the main screen in the first state, detecting a state change to the third state, Based on detecting the above state change, activating the second display area and deactivating the first display area, A multi-foldable electronic device that operates the second display area as a main screen to display the execution screen of a designated application.
9. In the third paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: Detecting a state change from the second state to the third state, Based on detecting the above state change, disabling the first display area, A multi-foldable electronic device that operates the second display area as a main screen while maintaining the running screen displayed through the second display area.
10. In the third paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: Detecting a notification event while operating in the first state or the second state, Provide a notification corresponding to the above notification event through the first display area, Detecting a state change from the first state or the second state to the third state, A multi-foldable electronic device that displays an execution screen corresponding to the notification event through the second display area based on detecting the change in the state.
11. In the third paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: When detecting a state change to the above 4th state, determine the display area that is in operation, If the display area in operation is the first display area or the second display area, control the flexible display to expand and display the execution screen of the corresponding display area; A multi-foldable electronic device that controls the flexible display to display an expanded execution screen of the second display area when the display areas in operation are the first display area and the second display area.
12. In the 11th paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: When the state changes from the first state to the third state, the execution screen of the main screen is displayed by extending it through the first display area and the second display area, A multi-foldable electronic device that, when changing a state from the second state to the third state, displays the execution screen of the sub-screen by expanding it through the first display area and the second display area.
13. In the first paragraph, the instructions, when executed by the at least one processor, cause the electronic device to: In the above intermediate state, user input is received while displaying the application's execution screen through the display area, To switch the application to be provided through the display area based on receiving the user input; A multi-foldable electronic device wherein the application switching includes switching between recently executed applications, switching between preset applications, and / or switching between recommended applications associated with the application.
14. In a method of operating a multi-foldable electronic device, An action to detect the start of operation of a multi-foldable electronic device; An operation of determining a designated operational state of the multi-foldable electronic device based on detecting the start of said operation; An operation of detecting a first folding state between the first housing and the second housing using a first sensor based on determining a designated operating state of the multi-foldable electronic device; An operation of detecting a second folding state between the second housing and the third housing using a second sensor; and A method including an operation of controlling to turn on or off a first display area, a second display area, or a third display area of a flexible display based on the first folding state and the second folding state.
15. A non-transitory computer-readable medium storing instructions that, when executed by a processor of an electronic device, cause the processor to perform operations, The above instructions, when executed by the processor, cause the electronic device to: Action to detect the start of operation of an electronic device; An action of determining a specified operational state of the electronic device based on detecting the start of said operation, An operation of detecting a first folding state between a first housing and a second housing using a first sensor based on determining a specified operating state of the electronic device; An operation of detecting a second folding state between the second housing and the third housing using a second sensor, and A recording medium that performs an operation of controlling a first display area, a second display area, or a third display area of a flexible display to be turned on or off based on the first folding state and the second folding state.
Citation Information
Patent Citations
Melt emulsion extrusion methods for producing thermoplastic polymer particles
KR1020210030201A
KR20200131662A
KR20210102010A
KR20220078437A
KR20220104471A