Method, electronic device, and recording medium for displaying information according to folding state
The electronic device adjusts display elements based on folding states to ensure important information is always visible, addressing the challenge of optimal information display in foldable devices.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-09-26
- Publication Date
- 2026-04-02
AI Technical Summary
Existing electronic devices with foldable displays struggle to efficiently adjust and display important information based on their folding states, leading to suboptimal user experience.
An electronic device with multiple housings, hinges, and sensors detects folding operations and adjusts the display of important information to exposed areas based on folding states, using processors to analyze and move high-importance information to visible display areas.
Enhances user experience by continuously providing important information in response to folding states, maintaining intuitive access and improving usability.
Smart Images

Figure KR2025015239_02042026_PF_FP_ABST
Abstract
Description
Method, electronic device, and recording medium for displaying information according to folding state
[0001] Embodiments of the present disclosure provide an electronic device that displays information based on a folding state of an electronic device (e.g., a multi-foldable electronic device), a method of operation thereof, and a recording medium.
[0002] With the development of digital technology, various types of electronic devices such as smartphones, tablet PCs (personal computers), and / or wearable devices are widely used. To support and enhance the functionality of these electronic devices, the hardware and / or software parts of the devices are continuously being developed.
[0003] For example, portable electronic devices (hereinafter referred to as "electronic devices"), such as smartphones, have become capable of incorporating various functions. Electronic devices include touchscreen-based displays to allow users easy access to various functions, and can provide screens for various applications through the display.
[0004] Recently, electronic devices have been moving beyond the bar shape and evolving into various forms. Moving beyond bendable forms, devices are being developed to feature foldable displays or displays that can expand in a slide or rolling format. Electronic devices incorporating such displays can provide convenience of use depending on the state of the display and the orientation of the device.
[0005] For example, electronic devices may have new form factors such as multi-display devices (e.g., dual display devices) or foldable electronic devices. Foldable electronic devices are equipped with a foldable (or bendable) display (e.g., foldable display or flexible display) and can be used by folding or unfolding. For example, in the case of a foldable electronic device, various information can be visually provided through the display (or display area) exposed in the unfolded or folded state.
[0006] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0007] In one embodiment of the present disclosure, an electronic device that displays information based on the folding state of an electronic device (e.g., a multi-foldable electronic device), a method of operation thereof, and a recording medium are provided.
[0008] In one embodiment of the present disclosure, an electronic device that adjusts and provides the position of information displayed according to the folding state of a multi-foldable electronic device, a method of operation thereof, and a recording medium are provided.
[0009] In one embodiment of the present disclosure, an electronic device, a method of operation, and a recording medium are provided that adjust and provide exposure (e.g., position and / or size) according to the importance of information when a multi-foldable electronic device is in a half-folded state.
[0010] The technical problems intended to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0011] According to an embodiment of the present disclosure, an electronic device (e.g., a multi-foldable electronic device) that supports various folding states is provided. The electronic device may include a display, a memory that stores one or more computer programs, one or more processors including processing circuitry that are communicatively coupled to the display and memory. The electronic device may include a housing comprising a first housing, a second housing, and a third housing, a first hinge structure disposed between the first housing and the second housing, a second hinge structure disposed between the second housing and the third housing, a display comprising a first display area, a second display area, and a third display area, a first sensor that detects a first angle between the first housing and the second housing, and a second sensor that detects a second angle between the second housing and the third housing. When one or more computer programs are executed individually or collectively by one or more processors, they may include instructions (e.g., computer-executable instructions) that cause an electronic device to perform the following:
[0012] According to one embodiment, instructions, when executed individually or collectively by a processor, may cause an electronic device (e.g., a multi-foldable electronic device) to detect the start of a folding operation in which the folding state of the multi-foldable electronic device changes from a first designated state (e.g., an unfolded state) to a second designated state (e.g., an intermediate state or a half-fold state in which one of the first or third display areas is exposed). According to one embodiment, instructions, when executed individually or collectively by a processor, may cause an electronic device (e.g., a multi-foldable electronic device) to analyze screen elements of the current screen being displayed based on the start of the folding operation. According to one embodiment, instructions, when executed individually or collectively by a processor, may cause an electronic device (e.g., a multi-foldable electronic device) to identify important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements. According to one embodiment, when instructions are executed individually or collectively by a processor, an electronic device (e.g., a multi-foldable electronic device) may be able to move the important information to an exposed display area and display it in response to the change in the folding state.
[0013] A method of operation of an electronic device (e.g., a multi-foldable electronic device) according to an embodiment of the present disclosure may include an operation of detecting the start of a folding operation in which the folding state of the multi-foldable electronic device changes from a first designated state (e.g., an unfolded state) to a second designated state (e.g., an intermediate state or a half-fold state in which one of the first display area or the third display area is exposed). The method of operation may include an operation of analyzing screen elements of a current screen being displayed based on the start of the folding operation. The method of operation may include an operation of identifying important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements. The method of operation may include an operation of moving the important information to the exposed display area and displaying it in response to the change in the folding state.
[0014] In order to solve the above problems, various embodiments of the present disclosure may include a computer-readable recording medium that records a program for executing the method on a processor.
[0015] According to one embodiment, one or more non-transitory computer-readable recording media are provided for storing computer-executable instructions that cause one or more processors of an electronic device (e.g., a multi-foldable electronic device) to perform operations when one or more processors are executed individually or collectively.
[0016] According to one embodiment, the operations may include: an operation of detecting the start of a folding operation in which a folding state is changed from a first designated state (e.g., unfolded state) of a multi-foldable electronic device to a second designated state (e.g., an intermediate state or a half-fold state in which one of the first display area or the third display area is exposed); an operation of analyzing screen elements of a current screen being displayed based on the start of the folding operation; an operation of identifying important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements; and an operation of moving the important information to the exposed display area and displaying it in response to the change in the folding state.
[0017] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples.
[0018] According to the electronic device, the method of operation, and the recording medium according to the embodiments of the present disclosure, the convenience of a user's use of an electronic device (e.g., a multi-foldable electronic device) can be improved. According to one embodiment, based on the detection of a state change of the multi-foldable electronic device, the position of at least some of the screen elements can be adjusted while maintaining the main screen, and continuously displayed through the exposed display area, thereby providing intuitiveness for the user to check important information. According to one embodiment, a screen element of high importance in the multi-foldable electronic device can be continuously provided in response to a change in the folding state, thereby providing a new UX (user experience) / UI (user interface) to the user.
[0019] In addition, various effects that can be understood directly or indirectly through this document may be provided. The effects obtainable from this disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which this disclosure pertains from the description below.
[0020] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0021] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0022] FIG. 2 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0023] FIG. 3 is a drawing illustrating a display according to one embodiment of the present disclosure.
[0024] FIG. 4 is a drawing illustrating an example of the structure and folding state of an electronic device according to one embodiment of the present disclosure.
[0025] FIG. 5 is a drawing illustrating an example of the structure and folding state of an electronic device according to one embodiment of the present disclosure.
[0026] FIG. 6 is a drawing illustrating an example of the structure and folding state of an electronic device according to one embodiment of the present disclosure.
[0027] FIG. 7 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0028] FIG. 8 is a drawing illustrating an example of providing information displayed in an electronic device according to one embodiment of the present disclosure according to a change in folding state.
[0029] FIG. 9 is a drawing illustrating an example of providing information displayed in an electronic device according to one embodiment of the present disclosure according to a change in folding state.
[0030] FIG. 10 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0031] FIG. 11 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0032] FIG. 12 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0033] FIG. 13 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0034] FIG. 14 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0035] FIG. 15 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0036] FIG. 16 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0037] FIG. 17 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0038] FIG. 18 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0039] FIG. 19 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0040] FIG. 20 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0041] FIG. 21 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0042] FIG. 22 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0043] FIG. 23 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0044] FIG. 24 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0045] FIG. 25a is a drawing illustrating an example of providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0046] FIG. 25b is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0047] FIG. 25c is a drawing illustrating an example of providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0048] FIG. 25d is a drawing illustrating an example of providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0049] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0050] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.
[0051] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0052] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0053] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0054] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0055] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).
[0056] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0057] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0058] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0059] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0060] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0061] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0062] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0063] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0064] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0065] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0066] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0067] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a WAN (wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0068] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and connection of multiple terminals (mMTC, massive machine type communications), or high reliability and low-latency (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0069] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0070] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0071] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0072] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0073] FIG. 2 is a diagram schematically illustrating the configuration of an electronic device according to one embodiment of the present disclosure.
[0074] According to one embodiment, FIG. 2 may show a block diagram of an exemplary electronic device (200) (e.g., the electronic device (101) of FIG. 1) capable of performing the operations described in this document.
[0075] Referring to FIG. 2, the electronic device (200) may be one of various forms of electronic devices, such as a notebook (290), smartphones (291) having various form factors (e.g., a bar-type smartphone (291-1), a foldable-type smartphone (291-2), or a sliderable (or rollable)-type smartphone (291-3)), a tablet (292), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 2 are illustrative only and are not intended to limit the implementations described or claimed herein. The electronic device (200) may be referred to as a mobile device, a user device, a multifunction device, a portable device, or a server.
[0076] According to one embodiment, the electronic device (200) may include all or at least some of the components of the electronic device (101) as described in the description with reference to FIG. 1. For example, in various embodiments of this document, some of the illustrated components may be omitted or substituted. The electronic device (200) may include at least some of the components and / or functions of the electronic device (101) of FIG. 1. At least some of each component of the illustrated (or unillustrated) electronic device (200) may be operatively, functionally, and / or electrically connected.
[0077] The electronic device (200) may include components comprising at least one processor (210) (e.g., processor (120) of FIG. 1) (hereinafter referred to as processor (210)), at least one memory (220) (e.g., memory (130) of FIG. 1) (hereinafter referred to as memory (220)), at least one display (240) (e.g., display module (160) of FIG. 1) (hereinafter referred to as display (240)), at least one image sensor (250) (hereinafter referred to as image sensor (250)), at least one communication circuit (260) (e.g., communication module (190) of FIG. 1) (hereinafter referred to as communication circuit (260)), and / or at least one sensor (270) (hereinafter referred to as sensor (270)). The components are merely exemplary. For example, the electronic device (200) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuit, antenna, rechargeable battery, or input / output interface). For example, some components may be omitted from the electronic device (200). For example, some components may be integrated into a single component.
[0078] The processor (210) can perform application layer processing functions required by the user of the electronic device (200). According to one embodiment, the processor (210) can provide control and commands for functions for various blocks of the electronic device (200). According to one embodiment, the processor (210) can perform operations or data processing regarding the control and / or communication of each component of the electronic device (200). For example, the processor (210) may include at least some of the configuration and / or functions of the processor (120) of FIG. 1. According to one embodiment, the processor (210) may be operatively connected to the components of the electronic device (200). According to one embodiment, the processor (210) may load commands or data received from other components of the electronic device (200) into memory (220), process commands or data stored in memory (220), and store result data.
[0079] The processor (210) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (210) may include at least one electrical circuit and may individually and / or collectively process instructions (or programs, data, etc.) stored in memory (220). The processor (210) may include a processor assembly comprising one or more processing circuitries and / or executable program elements.
[0080] The processor (210) may include any processing circuit that is operative to control the performance and operation of one or more components of the electronic device (200) (e.g., memory (220), display (240), image sensor (250), communication circuit (260), and / or sensor (270)). For example, the processor (210) may be an application processor (AP). For example, the processor (210) may be a system semiconductor responsible for the computation and multimedia driving functions of the electronic device (200). The processor (210) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (210) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (210) may include one or more processing circuits. For example, the processor (210) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (210) may be included in a first chip of the electronic device (200), and at least another portion of the processor (210) may be included in a second chip of the electronic device (200) that is different from the first chip of the electronic device (200).
[0081] For example, the processor (210) may include a central processing unit (CPU) (211), a graphics processing unit (GPU) (212), a neural processing unit (NPU) (213), an image signal processor (ISP) (214), a display controller (215), a memory controller (216), a storage controller (217), a communication processor (CP) (218), and / or a sensor interface (219). These components of the processor (210) are merely exemplary. For example, the processor (210) may include other components. For example, some components of the processor (210) may be omitted from the processor (210). For example, some components of the processor (210) may be included as separate components of the electronic device (200) outside the processor (210). For example, some components of the processor (210) (e.g., memory controller (216)) may be included within other components (e.g., at least part of memory (220), an interface (e.g. available for connection to at least one component of the electronic device (200)), a display (240) and / or an image sensor (250)).
[0082] The processor (210) can cause other components of the electronic device (200) to perform various operations by executing instructions stored in memory (220).
[0083] The CPU (211) (or central processing circuit) may be configured to control the components of the processor (210) based on the execution of instructions stored in memory (220) (e.g., volatile memory (221) and / or non-volatile memory (222)). The CPU (211) may decode user commands and perform arithmetic and logical operations, and / or data processing operations. For example, the CPU (211) may be responsible for the functions of memory, interpretation, operation, and control. The CPU (211) may execute all software of the electronic device (200) (e.g., application (146) of FIG. 1) on an operating system (OS) and control hardware devices.
[0084] The CPU (211) can store instructions or data in the volatile memory (221) of the memory (220) (e.g., the volatile memory (132) of FIG. 1) as at least part of the data processing or operation, process the instructions or data stored in the volatile memory (221), and store the result data in the non-volatile memory (222) of the memory (220) (e.g., the non-volatile memory (134) of FIG. 1).
[0085] The CPU (211) may include a single processor core or multiple processor cores. The CPU (211) may be a programmable processor capable of storing executable instructions (e.g., instructions capable of performing operations on the CPU (211)) and executing the instructions.
[0086] The CPU (211) may operate in a multi-domain environment. The CPU (211) may operate in a domain of a normal world (e.g., a non-secure world, a framework, or a non-secure environment) and a multi-domain environment of a secure world (e.g., a security framework or a security environment). In one embodiment, the domain of the secure world may include one or more domains (e.g., a trusted OS, a Trustzone, and / or a virtualization framework).
[0087] The GPU (212) (or graphics processing circuit) may be configured to perform parallel operations (e.g., rendering). The GPU (212) may be responsible for graphics processing. The GPU (212) may receive instructions from the CPU (211) and perform graphics processing to represent the shape, position, color, shade, movement, and / or texture of objects (or things) on the display (240).
[0088] The NPU (213) (or neural processing circuit, or AI (artificial intelligence) chip) can be configured to execute computations (e.g., convolution computations) for artificial intelligence models. The NPU (213) can perform processing optimized for deep-learning algorithms of artificial intelligence. The NPU (213) is a processor optimized for deep-learning algorithm computations (e.g., artificial intelligence computations) and can process big data quickly and efficiently like a human neural network. For example, the NPU (213) can be primarily used for artificial intelligence computations. The NPU (213) can perform processing such as automatically adjusting the focus by recognizing objects, environments, and / or people in the background when capturing video through a camera, automatically switching the camera's shooting mode to food mode when taking food photos, and / or removing only unnecessary subjects from the captured results. The NPU (213) can perform processing to generate response content based on given information (e.g., natural language).
[0089] The ISP (214) (or image signal processing circuit) may be configured to process a raw image acquired through an image sensor (250) into a format suitable for components within the electronic device (200) or components of the processor (210). For example, the ISP (214) may be responsible for image processing and correction of images and videos. The ISP (214) may correct unprocessed data (e.g., raw data) transmitted from the image sensor (250) of a camera (e.g., camera module (180) of FIG. 1) to generate an image in a form more preferred by the user. The ISP (214) may perform post-processing such as adjusting the partial brightness of the image and emphasizing detailed parts. For example, the ISP (214) may independently undergo a process of image quality tuning and correction of the image acquired through the camera to generate a result preferred by the user.
[0090] The ISP (214) can support artificial intelligence-based image processing technology. The ISP (214) can support scene segmentation (e.g., image segmentation) technology that recognizes and / or classifies parts of the scene being captured in conjunction with the NPU (213). For example, the ISP (214) may include a function to process objects such as the sky, bushes, and / or skin by applying different parameters. The ISP (214) can detect and display a human face during video capture using artificial intelligence functions, or use the coordinates and information of the face to adjust the brightness, focus, and / or color of the image.
[0091] According to one embodiment, the electronic device (200) can support integrated machine learning processing by interacting with all processors such as a CPU (211), GPU (212), NPU (213), and ISP (214).
[0092] A display controller (215) (or display control circuit, or DPU (display processing unit)) may be configured to process an image obtained from a CPU (211), GPU (212), ISP (214), or memory (220) (e.g., volatile memory (221)) into a format suitable for display (240).
[0093] The memory controller (216) (or memory control circuit) may be configured to control reading data from the volatile memory (221) and writing data to the volatile memory (221).
[0094] The storage controller (217) (or storage control circuit) may be configured to control reading data from non-volatile memory (222) and writing data to non-volatile memory (222).
[0095] The CP (218) (or communication processing circuit) may be configured to process data obtained from a component of the processor (210) into a format suitable for transmitting to another electronic device via the communication circuit (260), or to process data obtained from another electronic device via the communication circuit (260) into a format suitable for processing by the component of the processor (210). For example, the communication circuit (260) may include one or more communication circuits.
[0096] The sensor interface (219) (or sensing data processing circuit, sensor hub) may be configured to process data regarding the state of the electronic device (200) and / or the state around the electronic device (200), obtained through the sensor (270), into a format suitable for the components of the processor (210).
[0097] According to one embodiment, the processor (210) can control (or process) overall operations related to providing information (or screen elements or objects) by adjusting (e.g., position or position and size) based on the folding state of the electronic device (200) based on processing circuits and / or executable program elements.
[0098] According to one embodiment, a processor (210) can detect the start of a folding operation in which the folding state of an electronic device (200) (hereinafter referred to as a multi-foldable electronic device) changes from a first designated state (e.g., unfolded state) to a second designated state (e.g., an intermediate state or half-folded state in which one of the first display area or the third display area is exposed). According to one embodiment, the processor (210) can analyze screen elements of the current screen being displayed based on the start of the folding operation. According to one embodiment, the processor (210) can identify important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements. According to one embodiment, the processor (210) can move the important information to the exposed display area and display it in response to the change in the folding state.
[0099] According to one embodiment, the processor (210) can readjust the size of the important information in response to a change in the size of the exposed display area while the important information is moved to the exposed display area.
[0100] According to one embodiment, the processor (210) can identify specific information corresponding to elements such as real-time notifications and / or a system controller in the information displayed on the current screen as important information.
[0101] According to one embodiment, the processor (210) analyzes the importance of information displayed on the current screen (e.g., analysis of the characteristics of a widget or icon) and may include some information having importance in the important information.
[0102] According to one embodiment, the processor (210) can display the important information by moving and positioning it based on an exposure area corresponding to the first display area or the third display area.
[0103] According to one embodiment, the processor (210) identifies a focused important information among a plurality of important information as an adjustment target, and can adjust the position and / or size of the focused important information among the plurality of important information in response to a change in the folding state.
[0104] According to one embodiment, the display may be divided into a first display area and a second display area based on a first folding axis between the first housing and the second housing, and may be divided into a second display area and a third display area based on a second folding axis between the second housing and the third housing.
[0105] According to one embodiment, the first display area, the second display area, and the third display area may be formed to extend each other by being partially folded or unfolded into a flat shape, depending on the first angle between the first housing and the second housing and the second angle between the second housing and the third housing.
[0106] According to one embodiment, the multi-foldable electronic device may include an electronic device composed of N hinge structures and N+1 housings. According to one embodiment, N may include a natural number greater than or equal to 2.
[0107] According to one embodiment, the processor (210) can identify the folding state of the display using the first sensor or the second sensor based on detecting the start of the folding operation of the multi-foldable electronic device.
[0108] According to one embodiment, the processor (210) can provide important information to the exposed display area among the first display area or the third display area in the second designated state.
[0109] According to one embodiment, the processor (210) can adjust the position and / or size of a predetermined screen element among the screen elements of the current screen based on the change from the first designated state to the second designated state, or the change in the folding state from the second designated state to the first designated state, and place and display it in a portion corresponding to the change in the folding state.
[0110] According to one embodiment, the processor (210) can move and display important information in real time in response to the folding state change based on the change from the first designated state to the second designated state, or the change from the second designated state to the first designated state.
[0111] According to one embodiment, the important information may include user preference information based on learning, preset information, information updated in real time, and / or a system controller.
[0112] According to one embodiment, the processor (210) can detect a state change to the second designated state while the first designated state, the second display area, and the third display area are operating as the main screen. According to one embodiment, based on the state change detection, the processor (210) can continuously display through the exposed display area among the first display area or the third display area by adjusting the position of at least some of the screen elements while maintaining the main screen.
[0113] According to one embodiment, the processor (210) may detect a notification event while operating in the first designated state or the second designated state. According to one embodiment, the processor (210) may provide a notification corresponding to the notification event through a designated portion of the current screen. According to one embodiment, the processor (210) may display the notification corresponding to the notification event through an exposed display area (e.g., a first display area or a third display area) based on a folding state change.
[0114] According to one embodiment, the processor (210) can learn user preference information (e.g., important screen elements, important information, important objects) based on machine learning or artificial intelligence. According to one embodiment, the processor (210) can select (or identify) important screen elements on the current screen based on the learning results. According to one embodiment, the processor (210) can display the identified preference information through at least a portion of the display (240) (e.g., an exposed display area).
[0115] According to one embodiment, the processor (210) can reconfigure and provide the position and / or size of a screen element in response to a changing screen size of the display (240).
[0116] According to one embodiment, the detailed operation of the processor (210) (e.g., processor (120) of FIG. 1) of the electronic device (200) (e.g., electronic device (101) of FIG. 1) is described with reference to the drawings described below.
[0117] According to one embodiment, operations performed by the processor (210) may be implemented by executing instructions (e.g., computer-executable instructions) stored in a recording medium (or computer program product or storage medium). For example, the recording medium may include a non-transitory computer-readable recording medium that records a program for executing various operations performed by the processor (210).
[0118] The embodiments described in this disclosure may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof. According to a hardware implementation, the operations described in one embodiment may be implemented using at least one of application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and / or other electrical units for performing functions.
[0119] In one embodiment, a computer-readable recording medium (or computer program product) is provided that records a program to perform (or execute) various operations in an electronic device (200).
[0120] The above operations may include: an operation to detect the start of a folding operation in which the folding state of a multi-foldable electronic device changes from a first designated state (e.g., unfolded state) to a second designated state (e.g., an intermediate state or half-fold state in which one of the first or third display areas is exposed); an operation to analyze screen elements of the current screen being displayed based on the start of the folding operation; an operation to identify important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements; and an operation to move the important information to the exposed display area and display it in response to the change in the folding state.
[0121] The memory (220) includes at least some of the configuration and / or functions of the memory (130) of FIG. 1 and can store software (e.g., the program (140) of FIG. 1 and / or the application (146) of FIG. 1). The memory (220) may include one or more storage media (or one or more storage devices). For example, the memory (220) may include a memory assembly comprising one or more storage media. For example, the one or more storage media may include a hard drive, a flash memory, a permanent memory such as ROM (read-only memory) (e.g., non-volatile memory (222)), a semi-permanent memory such as RAM (random access memory) (e.g., volatile memory (221)), any other suitable type of storage (or storage assembly), or any combination thereof.
[0122] The memory (220) may include a cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (200). As an example, but not limited to, the cache memory may be included within the processor (210).
[0123] The memory (220) can be fixedly embedded in the electronic device (200) or incorporated into one or more suitable types of components (e.g., a SIM (subscriber identity module) card and / or an SD (secure digital) card) that can be repeatedly inserted into and removed from the electronic device (200).
[0124] For example, memory (220) may store one or more software applications, such as operating system (OS) (or system) software applications, firmware software applications, driver software applications, plugin (e.g., add-in, add-on, and / or applet) software applications, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (210). For example, memory (220) may store instructions that can be called by an application programming interface (API). For example, memory (220) may store instructions within a library.
[0125] The memory (220) can store various data used by at least one component of the electronic device (200) (e.g., processor (210)). In one embodiment, the data may include software (e.g., program (140) of FIG. 1) (e.g., operating system (142), middleware (144), and / or application (146) of FIG. 1) and input data or output data for commands associated with the software.
[0126] The memory (220) may include a volatile memory (221) (e.g., the volatile memory (132) of FIG. 1) or a non-volatile memory (222) (e.g., the non-volatile memory (134) of FIG. 1). The memory (220) may store instructions or data received from the processor (210) in the volatile memory (221), and may store result data processed by the processor (210) from the instructions or data stored in the volatile memory (221) in the non-volatile memory (222).
[0127] In one embodiment, the data stored in the memory (220) may include preference information for the user's screen elements, placement information for the screen elements (e.g., default position setting information), and a defined condition for detecting the folding state (e.g., a specified threshold value).
[0128] In one embodiment, the data may include various learning data and / or parameters obtained based on the user's learning through interaction with the user. In one embodiment, the data may include various schemas (or algorithms, models, networks, or functions) to support artificial intelligence-based operations.
[0129] In one embodiment, the fields in which artificial intelligence technology is applied may be diverse. For example, it may consist of technology fields of linguistic understanding, visual understanding, reasoning / prediction, knowledge representation, and / or motion control. Linguistic understanding is a technology that recognizes and applies / processes human language / characters, and may include natural language processing, machine translation, dialogue systems, question answering, and / or speech recognition / synthesis. Visual understanding is a technology that recognizes and processes objects like human vision, and may include object recognition, object tracking, image search, person recognition, scene understanding, spatial understanding, and / or image enhancement. Reasoning / prediction is a technology that logically reasones and predicts by judging information, and may include knowledge / probability-based reasoning, optimization prediction, preference-based planning, and / or recommendation. Knowledge representation is a technology that automatically processes human experience information into knowledge data, and may include knowledge construction (e.g., data generation / classification) and / or knowledge management (e.g., data utilization). Motion control is a technique for controlling the movement of an electronic device (200) and may include motion control and / or operation control (e.g., behavior control).
[0130] In one embodiment, a schema for supporting artificial intelligence-based operation in an electronic device (200) may include a neural network. In one embodiment, the neural network may include a neural network model based on at least one of an artificial neural network (ANN), a convolutional neural network (CNN), a region with convolutional neural network (R-CNN), a region proposal network (RPN), a recurrent neural network (RNN), a stacking-based deep neural network (S-DNN), a state-space dynamic neural network (S-SDNN), a Deconvolution Network, a deep belief network (DBN), a restricted Boltzmann machine (RBM), a long short-term memory (LSTM) network, a classification network, a plain residual network, a dense network, a hierarchical pyramid network, and / or a fully convolutional network. According to one embodiment, the types of neural network models are not limited to the examples described above.
[0131] According to one embodiment, the memory (220) can store instructions that cause the electronic device (200) to perform an operation when executed individually and / or collectively by the processor (210).
[0132] According to one embodiment, the memory (220) may store instructions that, when executed individually and / or collectively by the processor (210), the electronic device (200) detects the start of a folding operation in which the folding state of the multi-foldable electronic device changes from a first designated state (e.g., unfolded state) to a second designated state (e.g., intermediate state or half-fold state in which one of the first display area or third display area is exposed), analyzes screen elements of the current screen being displayed based on the start of the folding operation, identifies important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements, and moves the important information to the exposed display area in response to the change in the folding state to display it.
[0133] Instructions can be stored as software (e.g., program (140) of FIG. 1) in memory (220) and can be executed by a processor (210). For example, instructions may include control commands such as arithmetic and logical operations, data movement, and / or input / output that can be recognized by the processor (210). According to one embodiment, the software may include various applications (e.g., application (146) of FIG. 1) that can provide various functions (or services) (e.g., interactive service function, call function, message function, messenger function, email function, social networking service (SNS) function, search function, media (e.g., video and / or music) playback function, game function, and / or wireless communication function) in the electronic device (200).
[0134] The display (240) may include a configuration identical or similar to the display module (160) of FIG. 1. The display (240) may display various images provided by the processor (210). Under the control of the processor (210), the display (240) may visually provide various screens related to an application being executed (e.g., the application (146) of FIG. 1) and its use (e.g., contents screen, application execution screen, menu screen, and / or function execution screen).
[0135] According to one embodiment, the display (240) may have a screen size that changes according to the form factor of the electronic device (200) (e.g., a bar-type smartphone (291-1), a foldable-type smartphone (291-2), a sliderable (or rollable)-type smartphone (291-3), a tablet (292)). For example, the display (240) may be configured to provide a first state having a first screen size and a second state having a second screen size larger than the first screen size.
[0136] According to one embodiment, the electronic device (200) may include an electronic device of the form of a foldable electronic device (e.g., a foldable type smartphone (291-2)) (e.g., including a multi-foldable electronic device). For example, the electronic device (200) may be a foldable electronic device of various forms such as a G-type, Z-type, or e-type. According to one embodiment, if the electronic device (200) is in the form of a multi-foldable electronic device, the electronic device (200) may include a first housing, a second housing, and a third housing. According to one embodiment, the electronic device (200) may provide different information displays depending on the state of the display (240) of the electronic device (200) (or the size of the displayed screen (or screen display area)) (e.g., flex state (or intermediate mode)), such as when the first housing is folded or when the first housing and the third housing are folded together.
[0137] The display (240) may be combined with a touch sensor, a pressure sensor capable of measuring the intensity of the touch, and / or a touch panel (e.g., a digitizer) that detects a magnetic field-based stylus pen. The display (240) may detect touch input, air gesture input, and / or hovering input (or proximity input) by measuring a change in a signal (e.g., voltage, light intensity, resistance, electromagnetic signal, and / or charge quantity) at a specific location on the display (240) based on the touch sensor, pressure sensor, and / or touch panel. For example, the display (240) may include a touchscreen that detects touch and / or proximity touch (or hovering) input using a part of the user's body (e.g., a finger) or an input device (e.g., a stylus pen).
[0138] The display (240) may include, but is not limited to, a liquid crystal display (LCD), a light-emitting diode (LED) display, an organic light-emitting diode (OLED) display, and / or an active matrix OLED (AMOLED) display, a micro electro mechanical systems (MEMS) display, or an electronic paper display. According to one embodiment, the display (240) may include a flexible display.
[0139] The communication circuit (260) can support the establishment of a designated wireless communication channel (e.g., short-range communication such as Bluetooth communication and / or BLE communication) and the performance of communication through the established wireless communication channel. For example, the communication circuit (260) can perform designated communication (e.g., Bluetooth communication and / or BLE communication) with an external device. The communication circuit (260) can support wireless communication with an external device using cellular wireless communication (e.g., 4G LTE, 5G NR) and / or short-range wireless communication (e.g., Wi-Fi). For example, the electronic device (200) can use the communication circuit (260) to communicate with an external server (e.g., a generative artificial intelligence server) that provides artificial intelligence-based functions (e.g., conversational services or assistant services or AI agents) over a network. According to one embodiment, the communication circuit (260) can transmit data generated from the electronic device (200) to an external server and receive data transmitted from the external server. The communication circuit (260) may include at least some of the configuration and / or functions of the communication module (190) of FIG. 1.
[0140] In one embodiment, the electronic device (200) may include an artificial intelligence-based function (e.g., a conversational service or an assistant service or an AI agent) within an AI module (e.g., including a processing circuit) within the electronic device (200). For example, the AI module may be operatively coupled with at least one processor of the electronic device (200) (e.g., processor (120) or processor (210)). For example, the AI module may be operatively coupled with a sensor of the electronic device (200) for one or more sensors within the electronic device (200) (e.g., sensor module (176), sensor (270), or sensor interface (219)).
[0141] FIG. 3 is a drawing illustrating a display according to one embodiment of the present disclosure.
[0142] Referring to FIG. 3, the display (240) may include a display having a fixed shape and / or a deformable display such as a foldable display or a rollable (or slideable) display. The components, their relationships, and their functions illustrated in FIG. 3 are merely exemplary and are not intended to limit the implementations described or claimed herein.
[0143] The display (240) may include components such as a display panel (310), a display driver integrated circuitry (DDI) (330) (or a display driver circuitry (330)), and / or a touch circuitry (350). These components are merely exemplary. For example, the display (240) may include other components (e.g., a circuitry for controlling a digitizer and / or a sensor (270)). For example, some components may be omitted from the display (240).
[0144] The display panel (310) may include a plurality of pixels and a plurality of thin film transistors (TFTs) that control the plurality of pixels. For example, the plurality of TFTs may include p-channel metal-oxide semiconductor (PMOS) transistors and / or n-channel metal-oxide semiconductor (NMOS) transistors. Each of the plurality of pixels may include a set of subpixels (e.g., a subpixel for providing red light, a subpixel for providing blue light, a subpixel for providing green light, and / or a subpixel for providing white light). For example, the plurality of pixels in the display panel (310) may be driven based on a voltage (or current) provided to the TFTs through (or from) a display driving circuit (330).
[0145] A display driving circuit (330) can provide visual information (or a screen) (or one or more images) through a display panel (310) (or through a display area of the display panel (310)) based on image data received from a processor (210) and / or a command for controlling the operation of subcomponents of the display driving circuit (330). The display driving circuit (330) may include subcomponents such as an interface controller (331) (e.g., including an interface control circuit), a timing controller (332) (e.g., including a timing control circuit), a command controller (333) (e.g., including a command control circuit), a GRAM (graphics random access memory) controller (334) (e.g., including a GRAM control circuit), a GRAM (335), a source driver (338), and / or a gate driver (339). The display driving circuit (330) may be configured to receive data (e.g., frame data) from the processor (210) and to control the display panel (310) to display visual information using the data. The display driving circuit (330) may be described as a display peripheral.
[0146] The above sub-components are exemplary. For example, the display driving circuit (330) may further include other sub-components (e.g., a self-drawing engine (or any suitable circuit for self-drawing)). For example, some sub-components (e.g., a GRAM controller (334) and a GRAM (335)) may be omitted from the display driving circuit (330). For example, some sub-components (e.g., a source driver (338), a gate driver (339)) may be placed as components separate from the display driving circuit (330).
[0147] The interface controller (331) may provide image data obtained from the processor (210) (e.g., display controller (215)) to the GRAM (335) and provide commands obtained from the processor (210) to the command controller (333). For example, the interface controller (331) may be used for one or more interfaces (e.g., MIPI (mobile industry processor interface), MDDI (mobile display digital interface), SPI (serial peripheral interface), I2C (inter-integrated circuit), I3C (improved inter-integrated circuit), and / or CDP (compact display port)). In one embodiment, the image data may be stored in the GRAM (335). In one embodiment, storing the image data in the GRAM (335) may be bypassed. If the storage of the above image data is bypassed, the image data may be provided to an image processing circuit (not shown) or a source driver (338) within the display driving circuit (330) via the interface controller (331).
[0148] The timing controller (332) may provide a synchronization signal (or timing signal) to the GRAM controller (334), the source driver (338), and / or the gate driver (339). In one embodiment, the synchronization signal is generated by the timing controller (332), and the synchronization signal generated by the timing controller (332) may be provided from the timing controller (332) to the GRAM controller (334), the source driver (338), the gate driver (339), and / or the touch circuit (350). In one embodiment, the synchronization signal is generated by a synchronization signal generating circuit located outside the display driving circuit (330), and may be provided from the synchronization signal generating circuit to the timing controller (332).
[0149] The synchronization signal provided from the synchronization signal generation circuit may be provided from the timing controller (332) to the GRAM controller (334), the source driver (338), and / or the gate driver (339). For example, the synchronization signal may include a display synchronization signal (e.g., a display vertical synchronization signal and a display horizontal synchronization signal). For example, the display vertical synchronization signal and the display horizontal synchronization signal may be used for reference timing to switch the source driver (338) and the gate driver (339), respectively. For example, the synchronization signal may include a touch synchronization signal (e.g., a touch vertical synchronization signal and a touch horizontal synchronization signal). For example, the touch vertical synchronization signal and the touch horizontal synchronization signal may each be provided to the touch circuit (350). As an example, but not limited to, the frequency of the display synchronization signal may be different from the frequency of the touch synchronization signal.
[0150] The command controller (333) can provide the command to the GRAM controller (334) and / or the timing controller (332).
[0151] The GRAM controller (334) can provide the image data recorded in the GRAM (335) to the source driver (338) by scanning the image data based on the synchronization signal obtained from the timing controller (332) and the command obtained from the command controller (333). In one embodiment, before the image data is provided to the source driver (338), it can be processed based on the command provided to the image processing circuit from the command controller (333) through an image processing circuit (not shown) located between the GRAM (335) and the source driver (338).
[0152] The source driver (338) can provide color through a set of subpixels based on the display vertical synchronization signal and the image data. For example, the source driver (338) can provide a data voltage corresponding to the input image data to a plurality of pixels.
[0153] The gate driver (339) can turn on or turn off the set of subpixels based on the display horizontal synchronization signal and the light emission signal.
[0154] The touch circuit (350) may include a touch sensor controller (351) and a touch sensor (352).
[0155] A touch sensor controller (351) can control a touch sensor (352) based on a touch synchronization signal (e.g., a touch vertical synchronization signal and / or a touch horizontal synchronization signal) to obtain information about an input on a display panel (310) (e.g., a touch input or a hovering input on the display panel (310)). The touch sensor controller (351) can provide the information obtained based on the touch synchronization signal to a processor (210) or a display driving circuit (330).
[0156] The touch sensor (352) may be positioned in relation to the display panel (310). For example, the touch sensor (352) may be positioned within the display panel (310) or on the display panel (310).
[0157] Examples of electronic devices (101, 200) to which embodiments of the present disclosure may be applied will be described.
[0158] FIGS. 4, FIGS. 5 and FIGS. 6 are drawings illustrating examples of the structure and folding state of an electronic device according to one embodiment of the present disclosure.
[0159] According to one embodiment, FIG. 4, FIG. 5, or FIG. 6 may illustrate an example of changing the shape (e.g., folding state) of a display (240) (e.g., display module (160) of FIG. 1 or display (240) of FIG. 2 or FIG. 3) (e.g., display (240)) according to one embodiment (e.g., folding state). According to one embodiment, FIG. 4, FIG. 5, or FIG. 6 may illustrate an example of changing the shape (e.g., folding state) of a display (240) in an electronic device (101) (e.g., multi-foldable electronic device) that includes a foldable (or bendable) display (240) (e.g., foldable display or flexible display). According to one embodiment, as illustrated in the example in FIG. 4, FIG. 5 or FIG. 6, the electronic device (101) may be implemented in various forms, and depending on the implementation form of the electronic device (101), the display (240) may be folded and unfolded in various ways.
[0160] According to one embodiment, an example of an electronic device (101) illustrated in FIG. 4, FIG. 5, or FIG. 6 may show an example in which the electronic device (101) has two folding axes (e.g., hinge axes, hinge structures, or hinge modules). For example, FIG. 4, FIG. 5, or FIG. 6 may show an example of changing the form of a display (240) in an electronic device (101) that includes three display areas (e.g., a first display area (410, 510, 610), a second display area (420, 520, 620), and a third display area (430, 530, 630)). Various embodiments are not limited thereto and are exemplary, and the number of folding axes that the electronic device (101) may have is not limited. According to one embodiment, the electronic device (101) may include a multi-foldable electronic device composed of N (e.g., N is a natural number greater than or equal to 2) folding axes (e.g., N hinge structures) and N+1 housings (or display areas).
[0161] According to one embodiment, the electronic device (101) may include a foldable electronic device capable of being folded and unfolded. According to one embodiment, the electronic device (101) may be equipped with a foldable (or bendable) display (240) (e.g., a foldable display or a flexible display) and may be used in a folded state (e.g., phone mode) or unfolded state (e.g., tablet mode). In one embodiment, the phone mode may include a mode of use in which, for example, at least a portion of the multi-foldable housing is in a folded state (e.g., at least two housings are in contact with each other). In one embodiment, the tablet mode may include a mode of use in which, for example, the multi-foldable housing is unfolded into a flat shape and formed to extend each other.
[0162] According to one embodiment, the electronic device (101) may be an in / out-folding electronic device (101) that supports an in-folding method and an out-folding method individually or simultaneously (e.g., a multi-foldable electronic device).
[0163] According to one embodiment, the electronic device (101) illustrated in FIG. 4 may represent an example of an in / out folding type multi-foldable electronic device (e.g., a Z-type foldable electronic device). According to one embodiment, when the electronic device (101) is in a folded state (e.g., a folded state based on the shape of FIG. 4), at least a portion of a first part (e.g., a first housing (415)) and a second part (e.g., a second housing (425)) of a housing (or multi-foldable housing) (450) (e.g., a cover) are in contact with each other based on a first point (or first folding axis) (e.g., A-axis) that is folded (e.g., out-folding), and at least a portion of a second display area (420) and a third display area (430) of a display (240) are in contact with each other based on a second point (or second folding axis) (e.g., B-axis) that is folded (e.g., in-folding).
[0164] According to one embodiment, when the electronic device (101) is in an unfolded state (e.g., an unfolded state based on the shape of FIG. 4), all display areas of the display (240) (e.g., a first display area (410), a second display area (420), a third display area (430)) are provided as one side (or the entire side), so that the display (240) can be used in a relatively large size. According to one embodiment, when the electronic device (101) is partially unfolded (e.g., an intermediate state), at least one display area of the display (240) can be provided as an area for displaying visual information (or a screen) (or one or more images). According to one embodiment, in FIG. 4, the display (240) of the electronic device (101) may display a folding state corresponding to a partially folded state (e.g., intermediate state) with respect to a folding axis (or hinge axis or hinge structure) (e.g., first folding axis and second folding axis) at an angle (e.g., about 180 degrees).
[0165] Referring to FIG. 4, the electronic device (101) may include a housing (450) (e.g., a first housing (415), a second housing (425), and a third housing (435)) that fixes a display (240) including a first display area (410), a second display area (420), and a third display area (430). According to one embodiment, the housing (450) may include a foldable structure (e.g., a hinge structure). When the electronic device (101) is in a folded state, the first part (401) and the third part (405) may face away from each other with respect to the second part (403), and the first part (401) and the third part (405) may face away from each other. When the electronic device (101) is in an unfolded state, the first part (401), the second part (403), and the third part (405) may be formed to face in the same direction.
[0166] According to one embodiment, FIG. 4 may illustrate an example of an electronic device (101) comprising two folding axes (e.g., a first folding axis and a second folding axis) (e.g., an A-axis and a B-axis). In FIG. 4, the two folding axes (A-axis and B-axis) may each be employed to divide the display (240) into three parts. The electronic device (101) may be folded, unfolded, or bent along the folding axes (A-axis and B-axis). According to one embodiment, FIG. 4 may illustrate a configuration in which the first display area (410) of the display (240) of the electronic device (101) is folded outward so that it is visually exposed to the outside of the electronic device (101) (e.g., out-folding method), and the second display area (420) and the third display area (430) of the display (240) are folded inward so that they are not exposed to the outside of the electronic device (101) (e.g., in-folding method). In one embodiment, the electronic device (101) illustrated in FIG. 4 may represent an example of a Z-type foldable electronic device, and may represent an intermediate state (e.g., partially folded state or partially unfolded state) viewed from the front of the electronic device (101) and a folded state viewed from the back (or bottom) of the electronic device (101).
[0167] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 4, the electronic device (101) being completely folded (e.g., in a folded state or in a folded state) may mean that any two parts included in the display (240) of the electronic device (101) (e.g., a second display area (420) and a third display area (430)) are facing each other so that the two parts are completely parallel or nearly parallel, and any two parts included in the housing (450) (e.g., a first housing (415) and a second housing (425)) are facing each other so that the two parts are completely parallel or nearly parallel. For example, the electronic device (101) being completely folded may mean that the two parts of the electronic device (101) do not necessarily have to be in contact but are positioned in close proximity.
[0168] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 4, the electronic device (101) being fully unfolded (e.g., unfolded state or unfolded state) may indicate a state in which the first display area (410), the second display area (420) of the display (240), and the third display area (430) of the display (240) of the electronic device (101) are visually exposed to the outside and form a flat plane like a single display (240), and the area of the display (240) exposed to the outside is the largest or approaches the largest area.
[0169] The electronic device (101) as exemplified in FIG. 4 may have different directions of folding or bending with respect to each folding axis (A axis, B axis). This is exemplary, and the electronic device (101) may have the same direction of folding or bending with respect to each folding axis (A axis, B axis). According to one embodiment, the electronic device (101) may have a first display area (410) of the display (240) exposed to the outside, and the back surface of the first display area (410) (e.g., first housing (415)) and the back surface of the second display area (420) (e.g., second housing (425)) facing each other and folded, and the second display area (420) and the third display area (430) of the display (240) facing each other and folded.
[0170] According to one embodiment, depending on the position where two folding axes (A-axis, B-axis) are employed on the electronic device (101), the electronic device (101) may be folded or bent asymmetrically with respect to each folding axis (A-axis, B-axis), and even when the electronic device (101) is completely folded with respect to the folding axis (A-axis, B-axis), each display area (410, 420, 430) of the electronic device (101) separated by the folding axes (A-axis, B-axis) may not completely overlap. According to one embodiment, even when the electronic device (101) as exemplified in FIG. 4 is provided with folding axes (A-axis, B-axis), a display (240) may be employed on the front and / or rear of the electronic device (101).
[0171] According to one embodiment, the electronic device (101) can detect the folding state (or degree of folding) of the electronic device (101) (e.g., folded state, intermediate state, or unfolded state). According to one embodiment, the electronic device (101) can detect the folding state based on a first folding angle based on a folding axis of a first hinge structure (e.g., a first folding axis or an A-axis) and a second folding angle based on a folding axis of a second hinge structure (e.g., a second folding axis or a B-axis). According to one embodiment, the electronic device (101) can detect the folding state and enable or disable at least some display area of the display (240).
[0172] According to one embodiment, when the electronic device (101) detects a folded state, it may disable all display areas of the display (240) (e.g., a first display area (410), a second display area (420), and a third display area (430)). According to one embodiment, when the electronic device (101) detects a folded state, it may enable the display area used by the electronic device (101) (e.g., a first display area (410)) and disable the display area not used (e.g., a second display area (420) and a third display area (430)). According to one embodiment, when the electronic device (101) detects an intermediate state, it may enable / disable at least one display area of the display (240) (e.g., a first display area (410), a second display area (420), and / or a third display area (430)) depending on the folding state of the electronic device (101).
[0173] According to one embodiment, the electronic device (101) illustrated in FIG. 5 may represent an example of an in-folding multi-foldable electronic device (e.g., a G-type foldable electronic device). According to one embodiment, when the electronic device (101) is in a folded state (e.g., a folded state based on the shape of FIG. 5), at least a portion of the second display area (520) and the third display area (530) of the display (240) are in contact with each other based on a second point (or second folding axis) (e.g., B-axis) that is folded (e.g., in-folding), and at least a portion of the first display area (510) of the display (240) and the third portion of the housing (e.g., the third housing (535)) are in contact with each other based on a first point (or first folding axis) (e.g., B-axis), so that they are in a closed state.
[0174] According to one embodiment, when the electronic device (101) is in an unfolded state (e.g., an unfolded state based on the shape of FIG. 5), all display areas of the display (240) (e.g., a first display area (510), a second display area (520), a third display area (530)) are provided as one side (or the entire side), so that the display (240) can be used in a relatively large size. According to one embodiment, when the electronic device (101) is partially unfolded (e.g., an intermediate state), at least one display area of the display (240) can be provided as an area for displaying visual information (or a screen) (or one or more images). According to one embodiment, in FIG. 5, the display (240) of the electronic device (101) may exhibit a folding state corresponding to a partially folded state (e.g., an intermediate state) with respect to a folding axis (or hinge axis or hinge structure) (e.g., a first folding axis and a second folding axis) at an angle less than a certain angle (e.g., about 180 degrees).
[0175] Referring to FIG. 5, the electronic device (101) may include a housing (550) (or multi-foldable housing) (e.g., a first housing (515), a second housing (525), and a third housing (535)) that secures a display (240) including a first display area (510), a second display area (520), and a third display area (530). According to one embodiment, the housing (550) may include a foldable structure (e.g., a hinge structure). When the electronic device (101) is in a folded state, the first part (501) and the third part (505) may face in opposite directions to the second part (503), and the first part (501) and the third part (505) may face in the same direction. When the electronic device (101) is in an unfolded state, the first part (501), the second part (503), and the third part (505) may be formed to face in the same direction.
[0176] According to one embodiment, FIG. 5 may illustrate an example of an electronic device (101) comprising two folding axes (e.g., a first folding axis and a second folding axis) (e.g., an A-axis and a B-axis). In FIG. 5, the two folding axes (A-axis and B-axis) may each be employed to trisect the display (240). The electronic device (101) may be folded, unfolded, or bent along the folding axes (A-axis and B-axis). According to one embodiment, FIG. 5 may illustrate a form in which the first display area (510), the second display area (520), and the third display area (530) of the display (240) of the electronic device (101) are folded inward (e.g., an in-folding method) so that they are not exposed to the outside of the electronic device (101). In one embodiment, the electronic device (101) illustrated in FIG. 5 may represent an example of a G-type foldable electronic device, and may represent an intermediate state (e.g., partially folded state or partially unfolded state) viewed from the front of the electronic device (101) and a folded state viewed from the back (or bottom) of the electronic device (101).
[0177] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 5, the electronic device (101) being completely folded (e.g., in a folded state or in a folded state) may mean that any two parts included in the display (240) of the electronic device (101) (e.g., a second display area (520) and a third display area (530)) are facing each other so that the two parts are completely parallel or nearly parallel, and any part of the display (240) (e.g., a first display area (510)) and any part included in the housing (550) (e.g., a third housing (535)) are facing each other so that the two parts are completely parallel or nearly parallel. For example, the electronic device (101) being completely folded may mean that the two parts of the electronic device (101) do not necessarily have to be in contact but are positioned in close proximity.
[0178] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 5, the electronic device (101) being fully unfolded (e.g., unfolded state or unfolded state) may indicate a state in which the first display area (510), the second display area (520) of the display (240), and the third display area (530) of the display (240) of the electronic device (101) are visually exposed to the outside and form a flat plane like a single display (240), and the area of the display (240) exposed to the outside is the largest or approaches the largest area.
[0179] The electronic device (101) as exemplified in FIG. 5 may have different directions of folding or bending with respect to each folding axis (A axis, B axis). This is exemplary, and the electronic device (101) may have the same direction of folding or bending with respect to each folding axis (A axis, B axis).
[0180] According to one embodiment, in the example of FIG. 5, the electronic device (101) may be a multi-foldable electronic device of the G-type. According to one embodiment, when the electronic device (101) is a multi-foldable electronic device of the G-type, in the folded state, the second display area (520) and the third display area (530) of the display (240) are arranged facing each other, and the first display area (510) may be arranged on the uppermost side (e.g., the opposite side of the second display area (520) is in contact with the bottom surface) facing the housing (e.g., the third housing (535)) on the opposite side of the third display area (530). For example, the third display area (530) may be arranged between the first display area (510) and the second display area (520), and the folded state may be formed in the shape of a “”. This is not limited to, and the electronic device (101) exemplified in FIG. 5 may include a form in which it is folded in an out-folding manner.
[0181] According to one embodiment, the electronic device (101) may include an e-type multi-foldable electronic device that can be folded in a manner similar to the example of FIG. 5. In the case of an e-type multi-foldable electronic device, the third display area (530) of FIG. 5 may be referenced as the first display area, and the first display area (510) may be referenced as the second display area. According to one embodiment, if the electronic device (101) is a multi-foldable electronic device of the e-type, in a folded state, a first display area (510) (e.g., may be referred to as a third display area in the case of an e-type) and a second display area (520) are arranged facing each other, and a third display area (530) (e.g., may be referred to as a first display area in the case of an e-type) may be arranged at the lowest side (e.g., in a state where the opposite side of the third display area (530) is in contact with the bottom surface) facing the housing on the opposite side of the first display area (510) (e.g., may be referred to as a third display area in the case of an e-type). For example, the first display area (510) may be arranged between the second display area (520) and the third display area (530), and the folded state may be formed in the shape of an “e”.
[0182] According to one embodiment, an e-type multi-foldable electronic device and a G-type multi-foldable electronic device may be distinguished based on whether the shape in the folded state has an “e” shape or a “G” shape. According to one embodiment, the electronic device (101) may have different folding sequences and shapes between housings depending on the form factor (e.g., e-type or G-type), and the positions where a cover display (not shown) and a camera (not shown) are placed on the rear of the electronic device (101) may differ.
[0183] According to one embodiment, if the electronic device (101) is an e-type multi-foldable electronic device, the cover display may be positioned opposite the second display area (520). According to one embodiment, if the electronic device (101) is a G-type multi-foldable electronic device, the cover display may be positioned opposite the third display area (530). According to one embodiment, the cover display may be a flat display. According to one embodiment, a camera (e.g., the camera module (180) of FIG. 1 and / or the image sensor (250) of FIG. 2) may be mounted in one area of the cover display.
[0184] According to one embodiment, depending on the position where two folding axes (A-axis, B-axis) are employed on the electronic device (101), the electronic device (101) may be folded or bent asymmetrically with respect to each folding axis (A-axis, B-axis), and even when the electronic device (101) is completely folded with respect to the folding axis (A-axis, B-axis), each display area (510, 520, 530) of the electronic device (101) separated by the folding axes (A-axis, B-axis) may not completely overlap. According to one embodiment, even when the electronic device (101) is provided with folding axes (A-axis, B-axis) as exemplified in FIG. 5, a display (240) may be employed on the front and / or rear of the electronic device (101), and the display (240) may be activated or deactivated in a similar manner as described in the description section with reference to FIG. 4 above.
[0185] According to one embodiment, the electronic device (101) illustrated in FIG. 6 may represent an example of an in-folding multi-foldable electronic device (e.g., a C-type foldable electronic device). According to one embodiment, when the electronic device (101) is in a folded state (e.g., a folded state based on the shape of FIG. 6), at least a portion of the first display area (610) and the second display area (620) of the display (240) are in contact with each other based on a first point (or first folding axis) (e.g., A-axis) that is folded (e.g., in-folding), and at least a portion of the third display area (630) and the second display area (620) of the display (240) are in contact with each other based on a second point (or second folding axis) (e.g., B-axis), so that they are in a closed state.
[0186] According to one embodiment, when the electronic device (101) is in an unfolded state (e.g., an unfolded state based on the shape of FIG. 6), all display areas of the display (240) (e.g., a first display area (610), a second display area (620), a third display area (630)) are provided as one side (or the entire side), so that the display (240) can be used in a relatively large size. According to one embodiment, when the electronic device (101) is partially unfolded (e.g., an intermediate state), at least one display area of the display (240) can be provided as an area for displaying visual information (or a screen) (or one or more images). According to one embodiment, in FIG. 6, the display (240) of the electronic device (101) may exhibit a folding state corresponding to a partially folded state (e.g., an intermediate state) with respect to a folding axis (or hinge axis or hinge structure) (e.g., a first folding axis and a second folding axis) at an angle less than a certain angle (e.g., about 180 degrees).
[0187] Referring to FIG. 6, the electronic device (101) may include a housing (650) (or multi-foldable housing) (e.g., a first housing (615), a second housing (625), and a third housing (635)) that secures a display (240) including a first display area (610), a second display area (620), and a third display area (630). According to one embodiment, the housing (650) may include a foldable structure (e.g., a hinge structure). When the electronic device (101) is in a folded state, the first part (601) and the third part (605) may face in opposite directions to the second part (603), and the first part (601) and the third part (605) may face in the same direction. When the electronic device (101) is in an unfolded state, the first part (601), the second part (603), and the third part (605) may be formed to face in the same direction.
[0188] According to one embodiment, FIG. 6 may illustrate an example of an electronic device (101) comprising two folding axes (e.g., a first folding axis and a second folding axis) (e.g., an A-axis and a B-axis). In FIG. 6, the two folding axes (A-axis and B-axis) may each be employed to trisect the display (240). The electronic device (101) may be folded, unfolded, or bent along the folding axes (A-axis and B-axis). According to one embodiment, FIG. 6 may illustrate a form in which the first display area (610), the second display area (620), and the third display area (630) of the display (240) of the electronic device (101) are folded inward (e.g., an in-folding method) so that they are not exposed to the outside of the electronic device (101). In one embodiment, the electronic device (101) illustrated in FIG. 6 may represent an example of a C-type foldable electronic device and may show an intermediate state (e.g., partially folded state or partially unfolded state) viewed from the front of the electronic device (101) and a folded state viewed from the back (or bottom) of the electronic device (101).
[0189] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 6, the electronic device (101) being completely folded (e.g., in a folded state or in a folded state) may mean that all parts included in the display (240) of the electronic device (101) (e.g., a first display area (610) and a second display area (620), and a second display area (620) and a third display area (630)) are facing each other, so that the two parts are completely parallel or nearly parallel. For example, the electronic device (101) being completely folded may mean that the two parts of the electronic device (101) do not necessarily have to be in contact, but are positioned nearly close to each other.
[0190] According to one embodiment, in the form of the electronic device (101) illustrated in FIG. 6, the electronic device (101) being fully unfolded (e.g., unfolded state or unfolded state) may indicate a state in which the first display area (610), the second display area (620) of the display (240), and the third display area (630) of the display (240) of the electronic device (101) are visually exposed to the outside and form a flat plane like a single display (240), and the area of the display (240) exposed to the outside is the largest or approaches the largest area.
[0191] The electronic device (101) as exemplified in FIG. 6 may have different directions of folding or bending with respect to each folding axis (A axis, B axis). This is exemplary, and the electronic device (101) may have the same direction of folding or bending with respect to each folding axis (A axis, B axis). According to one embodiment, the electronic device (101) may be folded such that the first display area (610) and the second display area (620) of the display (240) face each other, and the second display area (620) and the third display area (630) face each other. This is not limited to, but if the electronic device (101) exemplified in FIG. 6 is in a form that folds in an out-folding manner, the first display area (610), the second display area (620), and the third display area (630) are exposed to the outside, and the back surface of the first display area (610) (e.g., the first housing (615)) and the back surface of the second display area (620) (e.g., the second housing (625)) are folded facing each other, and the back surface of the second display area (620) (e.g., the second housing (625)) and the back surface of the third display area (630) (e.g., the third housing (635)) are folded facing each other.
[0192] According to one embodiment, depending on the position where two folding axes (A-axis, B-axis) are employed on the electronic device (101), the electronic device (101) may be folded or bent asymmetrically with respect to each folding axis (A-axis, B-axis), and even when the electronic device (101) is completely folded with respect to the folding axis (A-axis, B-axis), each display area (610, 620, 630) of the electronic device (101) separated by the folding axes (A-axis, B-axis) may not completely overlap. According to one embodiment, even when the electronic device (101) is provided with folding axes (A-axis, B-axis) as exemplified in FIG. 6, a display (240) may be employed on the front and / or rear of the electronic device (101), and the display (240) may be activated or deactivated in a similar manner as described in the description section with reference to FIG. 4 above.
[0193] According to one embodiment, the electronic device (101) can detect a change in the shape of the display (240) (e.g., folding or unfolding) based on various methods.
[0194] According to one embodiment, the electronic device (101) may include a state sensing sensor and / or an angle sensing sensor based on at least one sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the electronic device (101) may determine the posture (or operation mode) (e.g., portrait mode or landscape mode) of the electronic device (101) based on first sensor data sensed by the state sensing sensor. According to one embodiment, the electronic device (101) may determine the folding angle (or folding state) of the electronic device (101) based on second sensor data sensed by the angle sensing sensor. In one embodiment, the posture of the electronic device (101) may include a portrait mode or a landscape mode used in an operation mode (e.g., phone mode or tablet mode). In one embodiment, the portrait mode may be a mode in which the electronic device (101) is used in portrait mode in an unfolded state (e.g., fully unfolded state or intermediate state). In one embodiment, the landscape mode may be a mode in which the electronic device (101) is used horizontally in an unfolded state (e.g., fully unfolded state or intermediate state). According to one embodiment, the electronic device (101) may be changed from a portrait mode to a landscape mode, or from a landscape mode to a portrait mode, based on a change in the posture (e.g., rotation) of the electronic device (101).
[0195] According to one embodiment, the electronic device (101) may include a first sensor (e.g., a first angle sensing sensor) that detects a first folding angle of a first folding axis (or a first hinge structure) and a second sensor (e.g., a second angle sensing sensor) that detects a second folding angle of a second folding axis (or a second hinge structure). For example, the electronic device (101) may determine a first folding angle between a first housing (415, 515, 615) and a second housing (425, 525, 625) (or between a first display area (410, 510, 610) and a second display area (420, 520, 620)) based on sensor data sensed by the first sensor (e.g., an A-axis). For example, the electronic device (101) can determine a second folding angle between the second housing (425, 525, 625) and the third housing (435, 535, 635) (or between the second display area (420, 520, 620) and the third display area (430, 530, 630)) based on sensor data sensed by the second sensor (e.g., B-axis).
[0196] According to one embodiment, the state sensing sensor may include at least one of a grip sensor, an inertial sensor, a proximity sensor, an illuminance sensor, a magnetic sensor, a Hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, or an infrared camera, or a combination thereof. According to one embodiment, the angle sensing sensor may include at least one of an inertial sensor, a Hall sensor, a magnetic sensor, or a bending sensor, or a combination thereof. According to one embodiment, an angle sensing sensor may be positioned on one side of the electronic device (101) (e.g., a folding axis, a housing end, a bottom of the display (240) (e.g., under panel, and / or a bezel of the display (240)) to measure the folding angle of the electronic device (101). The folding angle may represent the angle formed by the two display areas separated by the folding axis of the electronic device (101) with the folding axis. According to one embodiment, the electronic device (101) may measure the folding angle to determine whether the electronic device (101) is in a fully folded state, a fully unfolded state, or an intermediate state in which it is unfolded (or folded) at a certain angle.
[0197] According to one embodiment, the electronic device (101) may determine that the display (240) of the electronic device (101) is fully unfolded (e.g., unfolded state) if the folding angle (or folding angle or unfolding angle) measured by the electronic device (101) is approximately 180 degrees or an angle close thereto. According to one embodiment, the electronic device (101) may determine that the display (240) of the electronic device (101) is fully folded (e.g., folded state) if the folding angle measured by the electronic device (101) is approximately 0 degrees or an angle close thereto.
[0198] According to one embodiment, the electronic device (101) may determine that the display (240) of the electronic device (101) is in an intermediate state that is partially folded (or partially unfolded) if the first folding angle and / or the second folding angle measured by the electronic device (101) is greater than or equal to the first designated angle (e.g., an angle at which the user's field of view is guaranteed in an intermediate state (e.g., about 90 degrees)) and less than the second designated angle (e.g., about 180 degrees). For example, the electronic device (101) may determine that the display (240) of the electronic device (101) is folded, bent, or unfolded to a predetermined degree if the measured folding angle is within a predetermined angle range (e.g., first designated angle (e.g., about 90 degrees) ≤ folding angle < second designated angle (e.g., about 180 degrees)) based on sensor data obtained from at least one sensor of the angle detection sensor (e.g., first sensor or second sensor).
[0199] According to one embodiment, an electronic device (101), such as the example in FIG. 4, FIG. 5 and FIG. 6, may include a processor (e.g., the processor (120, 210) of FIG. 1 or FIG. 2) and a display driver IC (DDI, display driver IC) (e.g., the DDI (330) of FIG. 3) that is operatively or electrically connected to a display (240). For example, a first display area (410, 510, 610), a second display area (420, 520, 620), and a third display area (430, 530, 630) may be connected to a single DDI.
[0200] Embodiments of the present disclosure are not limited thereto, and the electronic device (101) may include a first DDI operatively or electrically connected to a first display area (410, 510, 610), a second DDI operatively or electrically connected to a second display area (420, 520, 620), and a third DDI operatively or electrically connected to a third display area (430, 530, 630). According to one embodiment, the first display area (410, 510, 610), the second display area (420, 520, 620), and the third display area (430, 530, 630) may be operatively or electrically connected to each other and may be formed by a single display (240) (e.g., a foldable display or a flexible display).
[0201] According to one embodiment, the electronic device (101) may have a display (240) that can be folded or unfolded in various ways (e.g., in-folding, out-folding, or in / out folding) depending on the implementation form.
[0202] According to one embodiment, in the embodiment of FIG. 4, FIG. 5, or FIG. 6, the hinge structure may be arranged in the x-axis direction or in the y-axis direction. In one embodiment, two or more hinge structures may be arranged to fold in the same direction or in different directions. In one embodiment, the electronic device (101) may include a display (240) (e.g., a flexible display) placed in an area formed by a housing (450, 550, 650). In one embodiment, the first housing (415, 515, 615) and the second housing (425, 525, 625) are arranged on both sides of a first folding axis (e.g., A-axis) and may have a shape that is substantially symmetric or asymmetric with respect to the first folding axis (e.g., A-axis). In one embodiment, the second housing (425, 525, 625) and the third housing (435, 535, 635) are positioned on both sides of the second folding axis (e.g., B-axis) and may have a shape that is substantially symmetric or asymmetric with respect to the second folding axis (e.g., B-axis). In one embodiment, the angle or distance between the first housing (415, 515, 615), the second housing (425, 525, 625), and the third housing (435, 535, 635) may differ depending on whether the state of the electronic device (101) is in a flat state (or unfolded state), a folded state, or an intermediate state.
[0203] According to one embodiment, the housing (450, 550, 650) may include a first housing (415, 515, 615) (e.g., a first housing structure) coupled to a first hinge structure, a second housing (425, 525, 625) (e.g., a second housing structure) coupled to the first hinge structure and a second hinge structure, and a third housing (435, 535, 635) (e.g., a third housing structure) coupled to the second hinge structure.
[0204] According to one embodiment, the housings (450, 550, 650) (e.g., first housing (415, 515, 615), second housing (425, 525, 625) and third housing (435, 535, 635)) are not limited to the illustrated forms and combinations and may be implemented by other shapes or combinations and / or combinations of parts.
[0205] According to one embodiment, a display (240) (e.g., a flexible display) may be positioned to extend from a first display area (410, 510, 610) of a first housing (415, 515, 615) across a first hinge structure and a second hinge structure to at least a portion of a third display area (430, 530, 630) of a third housing (435, 535, 635). For example, the display (240) may substantially connect the first display area (410, 510, 610), the second display area (420, 520, 620), and the third display area (430, 530, 630).
[0206] Although not illustrated in FIGS. 4, 5 and 6, according to one embodiment, the electronic device (101) may include at least one of an input device (e.g., a microphone), an acoustic output device, a camera device, a sensor module, a key input device, and / or a connector port. In one embodiment, the input device (e.g., a microphone), the acoustic output device, the sensor module, the camera device, the key input device, and / or the connector port may include a substantial electronic component that is disposed inside the electronic device (101) and operates through a hole or shape.
[0207] According to one embodiment, the input device may include at least one microphone disposed in the housing. In one embodiment, the input device may include a plurality of microphones disposed to detect the direction of sound. In one embodiment, the plurality of microphones may be disposed in appropriate locations in the first housing, the second housing, and / or the third housing. In one embodiment, the acoustic output device may include speakers. In one embodiment, at least one connector port may be used to transmit and receive power and / or data with an external electronic device. In one embodiment, at least one connector port (e.g., an ear jack hole) may accommodate a connector (e.g., an ear jack) for transmitting and receiving audio signals with an external electronic device. In one embodiment, the input device, the acoustic output device, and the connector port are disposed in a space provided in the first housing, the second housing, and / or the third housing of the electronic device (101) and may be exposed to the external environment through at least one hole formed in the first housing, the second housing, and / or the third housing.
[0208] According to one embodiment, the sensor module may generate an electrical signal or data value corresponding to an internal operating state of the electronic device (101) or an external environmental state. The sensor module may detect the external environment, for example, through a first surface of a first housing. In one embodiment, the electronic device (101) may further include at least one sensor module positioned to detect the external environment through a sixth surface of a third housing. In one embodiment, the sensor module (e.g., an illuminance sensor) may be positioned below the display (240) to detect the external environment through the display (240). In one embodiment, the sensor module may include at least one of a gesture sensor, a gyro sensor, a barometer sensor, a magnetic sensor, an acceleration sensor, a Hall sensor, a grip sensor, a color sensor (e.g., an RGB (red, green, blue) sensor), an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, an illumination sensor (or ALS (ambient light sensor)), a proximity sensor, and / or an ultrasonic sensor.
[0209] According to one embodiment, a key input device (e.g., a key button) may be disposed on at least one side of the first housing and / or third housing. In one embodiment, the electronic device (101) may not include some or all of the key input devices, and the key input device not included may be implemented in another form, such as a soft key, on the display (240). In one embodiment, the key input device may be implemented using a pressure sensor included in the display (240).
[0210] According to one embodiment, some camera devices and / or sensor modules among the camera devices may be positioned to be exposed through the display (240). For example, the camera devices and / or sensor modules may be positioned in the internal space of the electronic device (101) to come into contact with the external environment through an opening (e.g., a through hole) formed at least partially in the display (240). For example, some sensor modules may be positioned in the internal space of the electronic device (101) to perform their functions without being visually exposed through the display (240). For example, in this case, the opening may be omitted in the area of the display (240) facing the sensor modules.
[0211] According to one embodiment, the electronic device (101) may be operated to maintain an intermediate state through a hinge structure (e.g., a first hinge structure and / or a second hinge structure). In this case, the electronic device (101) may also control the display (240) so that different content is displayed in a first display area corresponding to a first housing, a second display area corresponding to a second housing, and / or a third display area corresponding to a third housing. In one embodiment, the electronic device (101) may be operated through a hinge structure to be substantially unfolded and / or substantially folded based on a certain inflection angle (e.g., the angle between the first housing and the second housing and / or the angle between the second display area and the third display area (or the angle between the second housing and the third housing). For example, the electronic device (101) may be operated through the hinge structure to transition to an unfolded state when a pressure is applied in the direction of unfolding from an intermediate state unfolded at a certain inflection angle. For example, the electronic device (101) may be operated through the hinge structure to transition to a folded state when a pressure is applied in the direction of folding from an intermediate state unfolded at a certain inflection angle. In one embodiment, the electronic device (101) may be operated through the hinge structure to maintain an unfolded state at various angles.
[0212] In one embodiment, the unfolded state may mean an open state or a flat state. In one embodiment, the unfolded state may mean a state in which the first housing, the second housing, and the third housing are arranged side by side, and the electronic device (101) is fully unfolded. In one embodiment, the unfolded state may be such that the angle between the first housing, the second housing, and the third housing is approximately 180 degrees, and one side of the first housing, the second housing, and the third housing may be arranged to face the same direction (e.g., the first direction).
[0213] In one embodiment, the folded state may mean a closed state. In one embodiment, the folded state may indicate a state in which the electronic device (101) is fully folded with respect to a first folding axis (e.g., A axis) and a second folding axis (e.g., B axis).
[0214] In one embodiment, the intermediate state is a state in which the first housing and the second housing are positioned at a certain angle, and / or the second housing and the third housing are positioned at a certain angle, such that the electronic device (101) may not be in an unfolded state or a folded state. In one embodiment, the intermediate state may mean a state in which the first housing and the second housing form a certain angle (e.g., about 6 degrees to about 179 degrees), and / or a state in which the second housing and the third housing form a certain angle (e.g., about 6 degrees to about 179 degrees).
[0215] In one embodiment, the intermediate state may include a state that is folded with respect to a first folding axis (e.g., A-axis) and not folded with respect to a second folding axis (e.g., B-axis). In one embodiment, the intermediate state may include a state that is not folded with respect to the first folding axis (e.g., A-axis) and is folded only with respect to the second folding axis (e.g., B-axis). In one embodiment, the intermediate state may include a state that is at least partially not folded with respect to the first folding axis (e.g., A-axis) and the second folding axis (e.g., B-axis).
[0216] According to one embodiment, the first housing may be located to the left with respect to the first folding axis (e.g., A-axis), and the second housing may be located to the right with respect to the first folding axis (e.g., A-axis). According to one embodiment, the second housing may be located to the left with respect to the second folding axis (e.g., B-axis), and the third housing may be located to the right with respect to the second folding axis (e.g., B-axis). According to one embodiment, the first housing and the second housing may be designed to fold relative to each other, and the second housing and the third housing may be designed to fold relative to each other.
[0217] According to one embodiment, hinges may be formed between the first housing (or first display area) and the second housing (or second display area), and between the second housing (or second display area) and the third housing (or third display area). According to one embodiment, the first housing, the second housing, and the third housing of the electronic device (101) may be folded or unfolded by hinges formed between the individual housings (e.g., first housing, second housing, and third housing) of the housing structure. In one embodiment, the housing structure in which the electronic device (101) is positioned to the left and right with respect to the folding axis (e.g., A-axis and B-axis) is merely an example, and the electronic device (101) may have a housing positioned to the top and bottom with respect to the folding axis.
[0218] According to one embodiment, an electronic device (101) (e.g., a multi-foldable electronic device) may include a form factor comprising three display areas based on two folding axes (e.g., A-axis and B-axis). Various embodiments are not limited thereto and are exemplary, and the number of folding axes that the electronic device (101) may have is not limited. According to one embodiment, depending on the implementation form, the electronic device (101) may have a display (240) (e.g., the display module (160) of FIG. 1) that can be folded or unfolded in various ways (e.g., in-folding, out-folding, or in / out folding). According to one embodiment, the electronic device (101) may include a multi-foldable electronic device composed of N (e.g., N is a natural number greater than or equal to 2) folding axes (e.g., N hinge structures) and N+1 housings (or display areas).
[0219] According to one embodiment, the unfolded state (e.g., unfolded state) of the display (240) may mean a state in which the first housing, the second housing, and the third housing are arranged side by side, and the electronic device (101) is fully unfolded. For example, the electronic device (101) may form the display (240) on the front of the electronic device (101). The display (240) may be formed entirely on the front (e.g., the first direction of the electronic device (101)). In one embodiment, the display (240) may include a flexible display in which at least some area may be deformed into a flat or curved surface. According to one embodiment, the display (240) may be folded left, right, up, or down with respect to a folding axis. According to one embodiment, the display (240) may include a first display area, a second display area, and a third display area.
[0220] According to one embodiment, the electronic device (101) may operate in a first designated operating state (e.g., phone mode) while in a folded state. According to one embodiment, the electronic device (101) may operate in a second designated operating state (e.g., tablet mode) while in an unfolded state. According to one embodiment, the electronic device (101) may provide different display screen operation of the display area in response to the posture of the electronic device (101) (e.g., portrait mode or landscape mode) in the first designated operating state or the second designated operating state.
[0221] The electronic device (101) according to the embodiments disclosed in this document is described as an example of a foldable electronic device (e.g., a smartphone) having a foldable form factor, but the electronic device (101) and its operation according to one embodiment are not limited thereto. For example, the electronic device (101) may be operated by various types of electronic devices such as a tablet PC (personal computer), a laptop PC (personal computer), and / or a display device (e.g., a TV and / or monitor) having a foldable form factor. In one embodiment, the electronic device (101) may include various form factors in which folding and unfolding operations are possible based on at least two hinge structures, and in which a flexible display is positioned, having a folded state, an intermediate state, and an unfolded state.
[0222] An electronic device according to one embodiment of the present disclosure (e.g., the electronic device (101, 200) of FIG. 1, FIG. 2, FIG. 4, FIG. 5 or FIG. 6) (hereinafter referred to as the electronic device (101)) may include a display (e.g., the display module (160) of FIG. 1 or the display (240) of FIG. 2 or FIG. 3) (hereinafter referred to as the display (160)), at least one processor (e.g., the processor (120, 210) of FIG. 1 or FIG. 2) (hereinafter referred to as the processor (120)) including processing circuitry, and a memory (e.g., the memory (130, 220) of FIG. 1 or FIG. 2) (hereinafter referred to as the memory (130)). In one embodiment, the memory (130) can store instructions that cause the electronic device (101) to perform an operation when executed individually and / or collectively by the processor (120).
[0223] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may detect the start of a folding operation in which the folding state of the multi-foldable electronic device changes from a first designated state to a second designated state. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may analyze screen elements of the current screen being displayed based on the start of the folding operation. When the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may identify important information of high importance from the screen elements based on the analysis of the screen elements. When the above instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be able to move the important information to an exposed display area and display it in response to a change in the folding state.
[0224] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be provided through a basic designated portion without adjusting important information while the folding angle between the first display area and the second display area is below a predetermined threshold value.
[0225] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be able to adjust and provide important information when the folding angle between the first display area and the second display area exceeds a predetermined threshold value.
[0226] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be able to adjust the positional movement of the important information at the point when the folding angle exceeds a predetermined threshold value after the start of the folding operation.
[0227] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be positioned in a third display direction facing the first display area and the second display area, corresponding to a distance proportional to the folding angle between the first display area and the second display area.
[0228] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be adjusted to display the location of important information in a second designated state, each positioned in a designated part of the display area exposed thereto.
[0229] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be able to resize the important information in response to a change in the size of the exposed display area while the important information is moved to the exposed display area.
[0230] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may identify as important information a predetermined information corresponding to a real-time notification and / or system controller element in the information displayed on the current screen.
[0231] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may analyze the importance of information displayed on the current screen and include some information having importance in the important information.
[0232] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may identify a focused important information among a plurality of important information as an adjustment target and adjust the position and / or size of the focused important information among the plurality of important information in response to a change in the folding state.
[0233] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be configured to display the important information by moving and positioning it based on an exposure area corresponding to the first display area or the third display area.
[0234] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may identify the folding state of the display using the first sensor or the second sensor based on detecting the start of the folding operation of the multi-foldable electronic device.
[0235] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be configured to adjust the position and / or size of a predetermined screen element among the screen elements of the current screen based on the change in the folding state from the first designated state to the second designated state, or the change in the folding state from the second designated state to the first designated state, and to place and display it in a portion corresponding to the change in the folding state.
[0236] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may be able to move and display important information in real time in response to the change in folding state based on the change in folding state from the first designated state to the second designated state, or the change in folding state from the second designated state to the first designated state.
[0237] According to one embodiment, the important information may include user preference information based on learning, preset information, information updated in real time, and / or a system controller.
[0238] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may detect a state change to the second designated state while the first display area, the second display area, and the third display area are operating as the main screen in the first designated state.
[0239] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may adjust the position of at least some of the screen elements while maintaining the main screen based on the state change detection, so as to continuously display through the exposed display area of the first display area or the third display area.
[0240] According to one embodiment, when the instructions are executed individually and / or collectively by at least one processor (120), the electronic device (101) (e.g., multi-foldable electronic device) may detect a notification event while operating in the first designated state or the second designated state, provide a notification corresponding to the notification event through a designated portion of the current screen, and display the notification corresponding to the notification event through an exposed display area based on a change in the folding state.
[0241] According to one embodiment, the display (160) is divided into a first display area and a second display area based on a first folding axis between the first housing and the second housing, and is divided into a second display area and a third display area based on a second folding axis between the second housing and the third housing, and the first display area, the second display area and the third display area may be formed to be partially folded or unfolded into a flat shape and extended to each other according to the first angle between the first housing and the second housing and the second angle between the second housing and the third housing.
[0242] According to one embodiment, the sperm device (101) (e.g., multi-foldable electronic device) may include an electronic device composed of N hinge structures and N+1 housings. According to one embodiment, N may include a natural number greater than or equal to 2.
[0243] Hereinafter, the operation method of an electronic device (101, 200) (hereinafter referred to as electronic device (101)) of various embodiments will be described in detail. Operations performed in the electronic device (101) according to various embodiments may be executed by at least one processor (120, 210) (hereinafter referred to as processor (120)) comprising various processing circuitry and / or executable program elements of the electronic device (101). According to one embodiment, operations performed in the electronic device (101) may be stored as instructions in memory (130, 220) (hereinafter referred to as memory (130)) and may be performed (or executed) individually and / or collectively by the processor (120).
[0244] FIG. 7 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0245] According to one embodiment, FIG. 7 may illustrate an example of a method for adjusting and providing information (or screen elements) based on a folding state in an electronic device (101) (e.g., a multi-foldable electronic device) according to one embodiment.
[0246] A method of operation performed in an electronic device (101) (e.g., a multi-foldable electronic device) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 7. The flowchart illustrated in FIG. 7 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 701 through 707 may be performed in at least one processor (120) of the electronic device (101).
[0247] As illustrated in FIG. 7, the operation method performed by an electronic device (101) according to one embodiment may include: an operation (701) of detecting the start of a folding operation in which the folding state changes from a first designated state (e.g., unfolded state) of the electronic device (101) (e.g., multi-foldable electronic device) to a second designated state (or intermediate state or half-folded state) (e.g., a state in which one of the first display area or the third display area is exposed); an operation (703) of analyzing screen elements of the current screen being displayed based on the start of the folding operation; an operation (705) of identifying important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements; and an operation (707) of moving the important information to the exposed display area in response to the change in the folding state and displaying it.
[0248] Referring to FIG. 7, in operation 701, the processor (120) of the electronic device (101) (e.g., multi-foldable electronic device) can detect the start of a folding operation in which the folding state of the electronic device (101) (e.g., multi-foldable electronic device) changes from a first designated state to a second designated state.
[0249] According to one embodiment, the first designated state may include, for example, an unfolded state of the electronic device (101). For example, the first designated state may include a state in which the first display area, the second display area, and the third display area of the display (160) of the electronic device (101) are visually exposed to the outside and form a plane like a single display (160). For example, the first designated state may be a state in which the area of the display (160) exposed to the outside is the largest, or is close to the largest area.
[0250] According to one embodiment, the second designated state may include, for example, an intermediate state or a half-folded state. For example, the second designated state may include a partially folded state or a partially unfolded state of the display (160). For example, the second designated state may include a state in which at least one display area of the display (240) is provided as an area for displaying visual information (or a screen) (or one or more images). According to one embodiment, the second designated state may include a state in which one of the first display area or the third display area is exposed, depending on the form factor of the electronic device (101) (e.g., a multi-foldable electronic device of G-type, Z-type, or e-type). Examples of the first designated state and the second designated state according to one embodiment are described with reference to the drawings described below.
[0251] According to one embodiment, the processor (120) can identify a change in the folding state (or change in state) of the display (160) and the start of a folding operation based on various methods. According to one embodiment, the electronic device (101) may include a state detection sensor and / or an angle detection sensor based on at least one sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the processor (120) can detect the start of a folding operation in which the folding state of the electronic device (101) changes based on first sensor data sensed by the state detection sensor. According to one embodiment, the state detection sensor may include at least one of a grip sensor, an inertial sensor, a proximity sensor, an illuminance sensor, a magnetic sensor, a Hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, or an infrared camera, or a combination thereof. According to one embodiment, the processor (120) can determine the folding angle (or folding state) of the electronic device (101) based on second sensor data sensed by the angle detection sensor. According to one embodiment, the angle sensing sensor may include at least one of an inertial sensor, a Hall sensor, a magnetic sensor, or a bending sensor, or a combination thereof.
[0252] According to one embodiment, the electronic device (101) may include a first sensor (e.g., a first angle sensing sensor) that detects a first folding angle of a first folding axis (or a first hinge structure) and a second sensor (e.g., a second angle sensing sensor) that detects a second folding angle of a second folding axis (or a second hinge structure). For example, the processor (120) may determine a first folding angle between a first display area and a second display area based on a first folding axis (e.g., an A-axis) based on sensor data sensed by the first sensor. For example, the processor (120) may determine a second folding angle between a second display area and a third display area based on a second folding axis (e.g., a B-axis) based on sensor data sensed by the second sensor. In one embodiment, the folding angle may represent the angle formed by two display areas separated by the folding axis with the folding axis. According to one embodiment, the electronic device (101) can measure the folding angle to identify the state change and the degree of the state change.
[0253] In operation 703, the processor (120) can analyze screen elements of the current screen being displayed based on the start of the folding operation. According to one embodiment, the processor (120) can analyze screen elements (or information) being displayed through the display (160) in a first designated state. In one embodiment, the screen element may include various screens (or first element) displayed on the display (160) (e.g., home screen, media playback screen, and / or application launch screen) (e.g., elements of the screen such as text, icons, images and / or videos), an indicator (or second element) (e.g., various notification indicators or information within an indicator bar (or status bar), a system controller (or third element) (e.g., a navigation bar or software buttons on the navigation bar), notification information (or fourth element) (e.g., an information window and / or pop-up window related to the notification), and / or content (or fifth element) included in the screen (e.g., home screen) (e.g., widgets and / or icons).
[0254] In operation 705, the processor (120) can identify important information (or important screen elements or designated screen elements or important objects) from the screen elements based on the analysis of the screen elements. According to one embodiment, the processor (120) analyzes the importance of the screen elements (or information) displayed on the current screen and can identify the elements designated by the electronic device (101) among the screen elements as important information. According to one embodiment, the processor (120) can identify the screen elements (or information) according to the designated elements as important information with high importance. In one embodiment, the important information may include user preference information based on learning, preset information (e.g., indicators and / or system controllers), and / or information that is updated in real time (e.g., heads-up notifications, ongoing tasks, notification pop-ups, notification-related indicators, and / or indicators related to the current time). Various examples of important information according to one embodiment are described with reference to the drawings described below.
[0255] In operation 707, the processor (120) can move and display important information to an exposed display area in response to a change in the folding state. According to one embodiment, the processor (120) can display identified important information by adjusting its position in response to a change in the state of the display (160). According to one embodiment, the processor (120) can move the position of important information to an exposed display area rather than a folding display area in response to a change in the folding state. According to one embodiment, the processor (120) can display important information by moving its position in real time in a direction opposite to the folding display area, corresponding to a distance proportional to the folding state. According to one embodiment, the processor (120) can display the identified important information by adjusting its size as needed. According to one embodiment, if the processor (120) needs to adjust the size of the important information in response to the movement of the important information's position, the processor (120) can display the important information while adjusting its size in real time (e.g., resizing) in proportion to the size of the exposed display area along with the movement of the important information's position. Various examples of adjusting important information (e.g., position or position and size adjustment) according to a change in folding state, according to one embodiment, are described with reference to the drawings described below.
[0256] According to an embodiment of the present disclosure, in response to a change in the folding state of the electronic device (101) (e.g., a multi-foldable electronic device) from an unfolded state to an intermediate state (or half-fold state), or a change in the folding state from an intermediate state (or half-fold state) to an unfolded state (or unfolded state), the electronic device (101) may provide information with an exposure level adjusted according to the importance of the information displayed. For example, the electronic device (101) may provide the location (or location and size) of designated information according to importance among the information displayed on the display (160) by adjusting it according to the change in the folding state.
[0257] For example, conventionally, a foldable electronic device may simply provide a function to reduce or enlarge information (e.g., content) based on the screen size. Consequently, the foldable electronic device may not be suitable for the specific situation of a multi-foldable electronic device having an intermediate state (or half-fold state), and unnecessary information may remain in the intermediate state. Below, various examples of adjusting important information (e.g., position or position and size adjustment) according to changes in the folding state are described with reference to the drawings.
[0258] FIGS. 8 and 9 are drawings illustrating an example of providing information displayed in an electronic device according to an embodiment of the present disclosure in accordance with a change in the folding state.
[0259] According to one embodiment, most current electronic devices (e.g., foldable electronic devices) operate by simply reducing or enlarging content based on screen size, which can result in unnecessary information remaining in an intermediate state (or half-fold state). Accordingly, the present disclosure proposes providing a method for adjusting the screen exposure level in an intermediate state according to the user's intent and the importance of the information, as illustrated in FIG. 8 and / or FIG. 9.
[0260] As illustrated in FIGS. 8 and 9, when an electronic device (101) (e.g., a multi-foldable electronic device) changes from a full screen (or a first designated state) (e.g., an unfolded state or an unfolded state) to a folding state (e.g., an intermediate state where only one side is folded or a half-fold state) in which at least a portion of the full screen is obscured, it may select and move information of high importance (or important information or important screen elements) among the displayed information (e.g., an indicator of an indicator bar (or status bar), a system controller (e.g., a navigation bar or a software button of a navigation bar), a notification pop-up, a widget, and / or the content of a configured application) so that the user can continue to access it. In one embodiment, the information of high importance may be defined information selected by automatic analysis in the electronic device (101), or may include defined information pre-set by the user.
[0261] According to one embodiment, the electronic device (101) may provide specific information of high importance, such as an indicator, a system controller, a notification pop-up, a widget, and / or content, to be continuously displayed in accordance with changes in the folding state. For example, the electronic device (101) may display the information of high importance by moving it to a visible (or exposed) display area where the display (160) is not folded, in response to changes in the folding state. For example, the electronic device (101) may enable the display of specific information to be continuous (or sustained or continued) through the exposed display area in accordance with changes in the folding state.
[0262] According to one embodiment, referring to FIGS. 8 and FIGS. 9, an example screen <801> class <901> indicates an example of the first specified state (e.g., expanded state or unfolded state), and the example screen <803> class <905> indicates an example of the second specified state (e.g., intermediate state or half-fold state), and the example screen <903> It may represent an example of an intermediate operation state (e.g., a state in progress of folding) in which the folding state changes from a first designated state to a second designated state (hereinafter referred to as the third designated state).
[0263] According to one embodiment, when a user folds the electronic device (101) from an unfolded state (or unfolded state) to an intermediate state (or half-folded state), some information (or screen elements) displayed on the screen (e.g., content playback screen (800)) (e.g., first information that is deemed unnecessary to the user) (hereinafter referred to as first information (800)) may no longer be of focus to the user, and such first information (800) may be maintained in its original state without separate optimization (e.g., position and / or resizing). According to one embodiment, information (or important information or important screen elements) (e.g., specific information of high importance or second information) (hereinafter referred to as second information) that is deemed to be of high importance to the user may be optimized (e.g., position and / or resizing) and continuously displayed through the exposed display area.
[0264] According to one embodiment, the second information may include information that is updated in real time (e.g., heads-up notifications, ongoing tasks, notification popups, current time) and information such as a system controller (e.g., a navigation bar). According to one embodiment, in the example of FIGS. 8 and 9, the second information may include an indicator (810) located in an area obscured by folding on an indicator bar (or status bar), a system controller (820) of the navigation bar, and a notification popup (830). According to one embodiment, the electronic device (101) may respond to the start of a folding operation from a first designated state to a second designated state, so that important elements such as the second information (810, 820, 830) are automatically positioned and resized to fit the aspect ratio of a third designated state (e.g., intermediate operation state) or a second designated state (e.g., intermediate state or half-fold state) and continuously provided to the user as necessary information.
[0265] For example, as illustrated in FIGS. 8 and 9, the electronic device (101) can detect a change in hardware configuration (e.g., a change in folding state) and change the interface, and can separate important information (e.g., second information (810, 820, 830)) and non-important information (e.g., first information (800)) within the screen to select and optimize important information (or important screen elements). According to one embodiment, the electronic device (101) can determine the importance of various elements displayed within the screen and select and optimize only the important information.
[0266] According to one embodiment, the electronic device (101) can reduce unnecessary context load by not optimizing information (e.g., first information (800)) that is deemed unnecessary to the user at the start of the folding operation to the changed screen size, and can select only information (e.g., second information (810, 820, 830)) that is deemed important to the user and automatically adjust its position and size to match the screen ratio of the intermediate state (or half-fold state), thereby supporting the user to continuously access important information (e.g., second information (810, 820, 830)). For example, the electronic device (101) can provide information that is deemed to have high importance (e.g., second information (810, 820, 830)) by optimizing it to match the folding state.
[0267] As illustrated in FIGS. 8 and 9, the user places the electronic device (101) in an unfolded state (or a first designated state) (e.g., example screen of FIG. 8). <801> or example screen of Fig. 9 <901> Watch a video in ), and while watching the video, start folding the electronic device (101) to an intermediate state (or half-fold state or a second designated state) (e.g., example screen of FIG. 8). <803> or example screen of Fig. 9 <905> It can be switched to ). According to one embodiment, the electronic device (101) detects the start of a folding operation and can identify specific information (810, 820, 830) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the start of the folding operation. For example, the electronic device (101) can identify an indicator (810), a system controller (820), and a notification pop-up (830) (e.g., a call reception notification). According to one embodiment, the electronic device (101) can move the specific information (810, 820, 830) to an exposed display area and provide it in response to a change in the folding state. For example, the electronic device (101) can adjust the positions of the indicator (810), system controller (820), and notification popup (830) to match the folding state (e.g., half-fold state), and the video information (800) (e.g., content screen) can maintain its original display state (e.g., position, aspect ratio, and / or layout) without adjustment. For example, the electronic device (101) can maintain the position of the information (800) in the application area the same as in the unfolded state, and can also maintain the execution state of the application (e.g., video playback state).
[0268] In this way, the present disclosure reduces unnecessary context loading by not optimizing information deemed unnecessary to the user at the time of unfolding for the changed screen size, and continuously provides information deemed important to the user by automatically adjusting its position and size to match the screen ratio of the half-fold state, thereby improving the convenience of accessing important information for the user.
[0269] FIG. 10 is a flowchart illustrating a method of operation of an electronic device according to one embodiment of the present disclosure.
[0270] According to one embodiment, FIG. 10 may illustrate an example of a method for adjusting and providing information (or screen elements) based on a folding state in an electronic device (101) (e.g., a multi-foldable electronic device).
[0271] A method of operation performed in an electronic device (101) according to one embodiment of the present disclosure may be performed, for example, according to the flowchart illustrated in FIG. 10. The flowchart illustrated in FIG. 10 is an example according to one embodiment of the operation of the electronic device (101), and at least some of the operations may be changed, performed in parallel, performed as independent operations, or at least some other operations may be performed complementarily to at least some of the operations. According to one embodiment of the present disclosure, operations 1001 to 1023 may be performed in at least one processor (120) of the electronic device (101).
[0272] According to one embodiment, the operation described in FIG. 10 may be performed heuristically in combination with the operations described in FIG. 7 to 9, for example, replaced at least some of the operations described and performed heuristically in combination with at least some other operations, or performed heuristically as a detailed operation of at least some of the operations described.
[0273] As illustrated in FIG. 10, the operation method performed by an electronic device (101) according to one embodiment comprises: an operation of displaying a screen through the entire display area in a first designated state (operation 1001); an operation of detecting the start of a folding operation (operation 1003); an operation of identifying a folding state (operation 1005); an operation of identifying whether the folding state exceeds reference information (or threshold value) (operation 1007); an operation of processing a function corresponding to user input if the folding state does not exceed the reference information (operation 1009); an operation of identifying screen elements included on the screen if the folding state exceeds the reference information (operation 1011); an operation of extracting screen elements with a predetermined condition among the screen elements as adjustment target elements (operation 1013); an operation of moving the adjustment target elements by a distance proportional to the folding state in a direction facing the folding display area (operation 1015); an operation of identifying whether size adjustment is required (operation 1017); and if size adjustment is required, moving the adjustment target elements and adjusting the size proportionally to the size of the exposed display area. It may include an operation to adjust (operation 1019), an operation to identify whether a second designated state is reached while adjusting the adjustment target element (operation 1021), and if the second designated state is not reached, to proceed to operation 1015 to perform the operation below, and if the second designated state is reached, to display the adjustment target element through a display area that is exposed (operation 1023).
[0274] Referring to FIG. 10, in operation 1001, the processor (120) of the electronic device (101) can display a screen through the entire display area in a first designated state. According to one embodiment, the first designated state may include, for example, an unfolded state of the electronic device (101). For example, the first designated state may include a state in which the first display area, the second display area, and the third display area of the display (160) of the electronic device (101) are visually exposed to the outside and form a plane like a single display (160). For example, the first designated state may be a state in which the area of the display (160) exposed to the outside is the largest, or is close to the largest area.
[0275] In operation 1003, the processor (120) can detect the start of a folding operation. According to one embodiment, the processor (120) can detect the start of folding while operating in a first designated state (e.g., unfolded state) (e.g., while displaying screen elements on the display (160)). According to one embodiment, the processor (120) can identify a change in the folding hinge angle based on sensor data from a designated sensor (e.g., angle sensing sensor and / or state sensing sensor). According to one embodiment, the processor (120) can detect the start of folding based on a change in the folding hinge angle.
[0276] According to one embodiment, the processor (120) can detect the start of a folding operation in which the folding state of the electronic device (101) (e.g., multi-foldable electronic device) changes from a first designated state to a second designated state. According to one embodiment, the second designated state may include, for example, an intermediate state or a half-folded state. For example, the second designated state may include a partially folded state or a partially unfolded state of the display (160). For example, the second designated state may include a state in which at least one display area of the display (240) is provided as an area for displaying visual information (or a screen) (or one or more images). According to one embodiment, the second designated state may include a state in which one of the first display area or the third display area is exposed, depending on the form factor of the electronic device (101) (e.g., a G-type, Z-type, or e-type multi-foldable electronic device).
[0277] According to one embodiment, the processor (120) can identify a change in the folding state (or change in state) of the display (160) and the start of a folding operation based on various methods. According to one embodiment, the electronic device (101) may include a state detection sensor and / or an angle detection sensor based on at least one sensor (e.g., the sensor module (176) of FIG. 1). According to one embodiment, the processor (120) can detect the start of a folding operation in which the folding state of the electronic device (101) changes based on first sensor data sensed by the state detection sensor. According to one embodiment, the state detection sensor may include at least one of a grip sensor, an inertial sensor, a proximity sensor, an illuminance sensor, a magnetic sensor, a Hall sensor, a gesture sensor, a bending sensor, an infrared sensor, a touch sensor, a pressure sensor, or an infrared camera, or a combination thereof. According to one embodiment, the processor (120) can determine the folding angle (or folding state) of the electronic device (101) based on second sensor data sensed by the angle detection sensor. According to one embodiment, the angle sensing sensor may include at least one of an inertial sensor, a Hall sensor, a magnetic sensor, or a bending sensor, or a combination thereof.
[0278] In operation 1005, the processor (120) can identify a folding state. According to one embodiment, the electronic device (101) may include a first sensor (e.g., a first angle sensing sensor) that detects a first folding angle of a first folding axis (or a first hinge structure) and a second sensor (e.g., a second angle sensing sensor) that detects a second folding angle of a second folding axis (or a second hinge structure). According to one embodiment, the processor (120) can determine a folding state (e.g., a first folding angle) between a first display area and a second display area based on a first folding axis (e.g., an A-axis) based on sensor data sensed by the first sensor. According to one embodiment, the processor (120) can determine a folding state (e.g., a second folding angle) between a second display area and a third display area based on a second folding axis (e.g., a B-axis) based on sensor data sensed by the second sensor. In one embodiment, the folding angle may represent the angle formed by two display areas separated by a folding axis with the folding axis. According to one embodiment, the electronic device (101) can measure the folding angle to identify the folding state (e.g., a change in state and the degree of change in state).
[0279] In operation 1007, the processor (120) can identify whether the folding state exceeds reference information (or threshold value). According to one embodiment, the processor (120) can determine whether the start of the folding operation is detected and whether the folding state (e.g., a first folding angle between a first display area and a second display area) satisfies a defined condition in which it exceeds reference information (or threshold value or threshold angle).
[0280] In operation 1007, if the folding state does not exceed reference information (e.g., 'No' in operation 1007), the processor (120) may process a function corresponding to the user's input in operation 1009. According to one embodiment, the processor (120) may stop the operation of detecting (or monitoring) the folding state change in response to the user's folding operation stop (or pause) and maintain the current display state of the display. According to one embodiment, the processor (120) may maintain the operation in the first designated state in response to the user's input to switch the electronic device (101) to the first designated state (or unfolded state) (e.g., restore it). According to one embodiment, the processor (120) may process a function related to the screen element in response to the user's input regarding the screen element displayed on the display (e.g., operation of a function button or selection of an icon).
[0281] In operation 1007, the processor (120) can identify screen elements included on the screen in operation 1011 when the folding state exceeds reference information (e.g., 'Yes' of operation 1007). According to one embodiment, the processor (120) can analyze screen elements included on the current screen when the folding state (e.g., a first folding angle between a first display area and a second display area) satisfies a defined condition (e.g., folding exceeding a threshold). According to one embodiment, the processor (120) can identify screen elements (or information) displayed on the display (160), real-time notifications, and / or system controller elements.
[0282] According to one embodiment, the processor (120) may identify various screen elements included in the current screen and identify (or extract) screen elements among the identified screen elements that correspond to a defined condition (e.g., screen elements of high importance or important information or important objects). In one embodiment, screen elements corresponding to the defined condition may include, for example, information that is updated in real time (e.g., heads-up notifications, ongoing tasks, notification pop-ups, notifications on an indicator bar (or status bar), time and / or weather indicators), a system controller (e.g., a navigation bar or a software button on a navigation bar), a configured widget, and / or the content of a configured application. In one embodiment, screen elements corresponding to the defined condition (e.g., information of high importance) may include defined information selected by automatic analysis in the electronic device (101) or defined information that is pre-set by the user.
[0283] In operation 1013, the processor (120) may extract screen elements that meet a predetermined condition among the screen elements as elements to be adjusted. According to one embodiment, the processor (120), based on a screen analysis of the current screen, may extract screen elements that need to be adjusted (or reconfigured) (e.g., repositioned or repositioned and resized) to match the folding state (or change in folding state) if there are screen elements among the screen elements included in the screen that correspond to a predetermined condition. According to one embodiment, if the processor (120) determines that there are no screen elements corresponding to a predetermined condition (e.g., high-importance information or important information), it may cause the screen elements to maintain the size and position of a first designated state (e.g., unfolded state).
[0284] In operation 1015, the processor (120) can move the adjustment target element in a direction facing the folding display area by a distance proportional to the folding state. According to one embodiment, the processor (120) can move the adjustment target element to the exposed display area in response to a change in the folding state and display it. According to one embodiment, the processor (120) can display the identified adjustment target element by adjusting its position in response to a change in the folding state of the display (160). According to one embodiment, the processor (120) can move the position of the adjustment target element to the exposed display area rather than the folding display area in response to a change in the folding state and display it. According to one embodiment, the processor (120) can display the adjustment target element while moving its position in real time in a direction facing the folding display area (e.g., a first display area and a part of the second display area) by a distance proportional to the folding state.
[0285] In operation 1017, the processor (120) can identify whether resizing is required. According to one embodiment, while moving the element to be adjusted to an exposed display area, the processor (120) can compare the size of the element to be adjusted with the size (or size change) of the remaining displayable area (or width (W) of the displayable area) of the exposed display area (e.g., width (W1) of a part of the second display area + width (W2) of the third display area), and can identify whether the element to be adjusted is resized based on the size comparison.
[0286] In operation 1017, if the processor (120) identifies that scaling is not required (e.g., 'No' in operation 1017), it may proceed to operation 1021 and perform operations 1021 and below.
[0287] In operation 1017, if the processor (120) identifies that resizing is required (e.g., 'yes' in operation 1017), in operation 1019, the size of the element to be adjusted may be adjusted in proportion to the size of the exposed display area along with the repositioning of the element to be adjusted. According to one embodiment, if the processor (120) determines that resizing of the element to be adjusted is required due to the repositioning of the element to be adjusted, the size of the element to be adjusted may be displayed while resizing (e.g., resizing) in real time in proportion to the size of the exposed display area along with the repositioning of the element to be adjusted. According to one embodiment, the processor (120) may adjust (e.g., change) the size of the element to be adjusted (e.g., change) to match the size of the display area along with the repositioning in the direction of the exposed display area according to the change in the folding state.
[0288] In operation 1021, the processor (120) can identify whether a second designated state (e.g., intermediate state or half-fold state) is reached while adjusting the adjustment target element. According to one embodiment, the processor (120) can determine a folding state (e.g., first folding angle) between a first display area and a second display area based on a first folding axis (e.g., A-axis) based on sensor data sensed by a first sensor. According to one embodiment, the processor (120) can determine whether the folding angle (e.g., first folding angle) between the first display area and the second display area satisfies a defined condition of reaching reference information (or threshold value or threshold angle). According to one embodiment, the processor (120) can determine that a second designated state has been reached when the first display area and the second display area included in the display (160) face each other (or are facing each other), and the two parts become completely parallel or nearly parallel. For example, the processor (120) can determine that the second designated state is when the folding angle between the first display area and the second display image is approximately 0 degrees or an angle close to it.
[0289] In operation 1021, if the processor (120) identifies that the second designated state has not been reached (e.g., 'No' in operation 1021), it may proceed to operation 1015 and perform operations 1015 and below.
[0290] In operation 1021, if the processor (120) identifies reaching a second designated state (e.g., 'yes' in operation 1021), in operation 1023, the adjustment target element may be displayed through an exposed display area. According to one embodiment, the processor (120) may display the adjustment target element (e.g., high-importance information or important information) by moving its position in the direction of the exposed display area according to the folding state change and resizing (e.g., changing) its size to fit the size of the display area.
[0291] FIG. 11 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0292] According to one embodiment, FIG. 11 is a drawing illustrating an example of moving information of a status bar (e.g., an indicator related to clock information and task information) (hereinafter referred to as an indicator (1110)) and information of a navigation bar (e.g., a system controller (1120)) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as a system controller (1120)) to a display area exposed in response to a change in the folding state.
[0293] According to one embodiment, FIG. 11 may show an example in which the default position setting of the system controller (1120) is set to the center. According to one embodiment, an example screen in FIG. 11 <1101> indicates an example of the first specified state (e.g., unfolded state), and the example screen <1105> indicates an example of the second specified state (e.g., intermediate state or half-fold state), and the example screen <1103> It may represent an example of an intermediate operation state (e.g., a state in progress of folding) where the folding state changes from a first specified state to a second specified state.
[0294] According to one embodiment, as illustrated in FIG. 11, the user places the electronic device (101) in an unfolded state (or a first designated state) (e.g., the example screen of FIG. 11). <1101> Watch a video in ), and while watching the video, start folding the electronic device (101) to an intermediate state (e.g., a second designated state or a half-fold state) (e.g., the example screen of FIG. 11). <1105> It can be switched to ). According to one embodiment, the electronic device (101) can detect the start of a folding operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle.
[0295] According to one embodiment, the electronic device (101) can identify specific information (1110, 1120) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (1110) and a system controller (1120). According to one embodiment, the electronic device (101) can move the specific information (1110, 1120) to an exposed display area and provide it in response to a change in the folding state. According to one embodiment, the electronic device (101) can adjust the positions of the indicator (1110) and the system controller (1120) in response to a change in the folding state, and the video information (1100) (e.g., content screen) can maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) can be adjusted so that the indicator (1110) and the system controller (1120) are respectively positioned in designated parts of the display area where they are exposed (e.g., the left area of the status bar, the center area of the navigation bar), excluding the screen that is obscured by the folding hinge angle according to the folding state change.
[0296] According to one embodiment, the electronic device (101) can adjust the indicator (1110) to be positioned at a set position on the status bar (e.g., left area) and the system controller (1120) to be positioned at a set position on the navigation bar (or a designated position according to placement information) (e.g., left portion or center portion). In one embodiment, the electronic device (101) can adjust the position change of the important information (1110, 1120) based on the placement information to which the important information (1110, 1120) is set by default. For example, the electronic device (101) can adjust the important information, such as the system controller (1120) and / or a notification pop-up (not shown), to be positioned at the center portion of the remaining displayable area of the exposed display area (or based on the width (W) of the displayable area).
[0297] According to one embodiment, when the folding state change to a folding state (e.g., intermediate state or half-fold state) is completed, the electronic device (101) can adjust the positions of an indicator (1110) (e.g., status bar information) and a system controller (1120) (e.g., navigation bar information) to be respectively positioned in a designated part of the exposed display area to match the folding state (e.g., half-fold state or a second designated state). For example, the electronic device (101) can maintain the position (and / or aspect ratio, layout, etc.) of information in the application area (e.g., content screen (1100)) in the same way as in the unfolded state.
[0298] FIG. 12 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0299] According to one embodiment, FIG. 12 is a drawing illustrating an example of moving information of a status bar (e.g., an indicator (1110) of FIG. 11) and information of a navigation bar (e.g., a system controller (1220)) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as the system controller (1220)) to a display area exposed in response to a change in the folding state.
[0300] According to one embodiment, FIG. 12 may show an example in which the default position setting of the system controller (1220) is set to the left. According to one embodiment, an example screen in FIG. 12 <1201> indicates an example of the first specified state (e.g., unfolded state), and the example screen <1205> indicates an example of the second specified state (e.g., intermediate state or half-fold state), and the example screen <1203> It may represent an example of an intermediate operation state (e.g., a state in progress of folding) where the folding state changes from a first specified state to a second specified state.
[0301] According to one embodiment, as illustrated in FIGS. 11 and 12, the electronic device (101) can provide the position or position and size of the system controller (1120, 1220) in response to a change in the folding state, regardless of the position (e.g., center or left) according to the basic position setting of the system controller (1120, 1220), by an operation corresponding to that described in the description part with reference to FIG. 11.
[0302] FIG. 13 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0303] According to one embodiment, FIG. 13 is a drawing illustrating an example of moving information of a status bar (e.g., an indicator related to clock information and task information) (hereinafter referred to as an indicator (1310)) and information of a navigation bar (e.g., a system controller (1320)) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as a system controller (1320)) to a display area exposed in response to a change in the folding state.
[0304] According to one embodiment, FIG. 13 may show an example in which a system controller (1320) (e.g., a navigation bar) is set as a gesture navigation bar and the default position setting of the gesture navigation bar information is set to the center.
[0305] As illustrated in FIG. 13, the user can watch a video with the electronic device (101) in an unfolded state (or a first designated state) and, while watching the video, start folding the electronic device (101) to transition to an intermediate state (e.g., a second designated state or a half-fold state). According to one embodiment, the electronic device (101) can detect the start of a folding operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle.
[0306] According to one embodiment, the electronic device (101) can identify specific information (1310, 1320) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (1310) and a system controller (1320) (e.g., a gesture navigation bar). According to one embodiment, the electronic device (101) can move the specific information (1310, 1320) to an exposed display area to provide it in response to a change in the folding state. According to one embodiment, the electronic device (101) can adjust the position of the indicator (1310) and the system controller (1320) in response to a change in the folding state, and the video information (1300) (e.g., content screen) can maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) can be adjusted so that the indicator (1310) and the system controller (1320) are positioned in the center of the display area where the displayable remaining area (or based on the width (W) of the displayable area) is exposed, excluding the screen that is obscured by the folding hinge angle according to the folding state change.
[0307] According to one embodiment, when the electronic device (101) completes a folding state change to a folding state (e.g., intermediate state, half-fold state, or a second designated state), the position of the indicator (1310) and the system controller (1320) (e.g., gesture navigation bar information) can be adjusted to be located in the right part (e.g., the exposed display area) from the center part of the exposed display area. For example, the electronic device (101) can maintain the position (and / or aspect ratio) of the information in the application area (e.g., the content screen (1300) currently being played) as in the unfolded state.
[0308] According to one embodiment, as illustrated in FIGS. 11, 12 and 13, the electronic device (101) can provide the position or position and size of the system controller (1120, 1220, 1320) in response to a change in the folding state, regardless of the position (e.g., center or left) and / or type (e.g., button type system controller or gesture type system controller) according to the basic position setting of the system controller (1120, 1220, 1320), by an operation corresponding to that described in the description part with reference to FIG. 11.
[0309] FIG. 14 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0310] According to one embodiment, FIG. 14 is a drawing illustrating an example of moving information of a status bar (e.g., a clock information related indicator (1410)) (hereinafter referred to as indicator (1410)), information of a navigation bar (e.g., a system controller (1420)) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as system controller (1420)), and a notification pop-up (1430) (e.g., head-up notification information) to a display area exposed in response to a change in the folding state.
[0311] According to one embodiment, FIG. 14 may show an example in which an electronic device (101) is operating in an unfolded state (e.g., a first designated state) and then folds into an intermediate state (e.g., a second designated state or a half-fold state) after the notification occurs.
[0312] According to one embodiment, an example screen <1401> As exemplified in [Image], the electronic device (101) can display a screen containing information (or screen elements) that do not require persistence (e.g., an application screen (e.g., a content screen (1400)) and information that requires persistence (e.g., important information) (e.g., an indicator (1410), a system controller (1420)) depending on the folding state change in the unfolded state.
[0313] According to one embodiment, an example screen <1401> As exemplified in [Image], the electronic device (101) may detect the occurrence of a notification (e.g., when a notification occurs) while operating in the unfolded state and provide a relevant notification popup (1430) (or notification information) (e.g., a heads-up notification) corresponding to the notification based on a designated area (e.g., a popup display). In one embodiment, the electronic device (101) may identify the notification popup (1430) corresponding to the occurrence of a notification as information requiring persistence (e.g., important information) depending on the change in the folding state.
[0314] According to one embodiment, while the user is using an application with the electronic device (101) in an unfolded state, the user can confirm the occurrence of a notification through a notification pop-up (1430), and after the occurrence of a notification (e.g., message reception notification, reminder notification, call reception notification), the user starts folding the electronic device (101), and example screen <1403> As exemplified in [here], it can be transitioned to an intermediate state (e.g., a second specified state or a half-fold state).
[0315] According to one embodiment, an example screen <1403> As exemplified in [Image], when the folding state change to a folding state (e.g., intermediate state or half-fold state) is completed, the electronic device (101) can adjust the positions of the indicator (1410), system controller (1420), and notification popup (1430) to correspond to the folding state (e.g., half-fold state or a second designated state) in a designated part of the exposed display area (e.g., the left part of the status bar, the center part of the navigation bar, the center part of the application area). For example, the electronic device (101) can provide the information in the application area (e.g., the screen of content currently playing (1400)) in the same position as in the unfolded state, and adjust the position of important information (1410, 1420, 1430) so that it is displayed through the exposed display area.
[0316] According to one embodiment, an example screen <1401> and example screen <1403> As exemplified in [Image], the electronic device (101) can detect the start of a folding operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle. According to one embodiment, the electronic device (101) can identify specific information (1410, 1420, 1430) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (1410), a system controller (1420), and a notification pop-up (1430) (e.g., head-up notification information). According to one embodiment, the electronic device (101) can move the specific information (1410, 1420, 1430) to an exposed display area and provide it in response to a change in the folding state. According to one embodiment, the electronic device (101) adjusts the positions of the indicator (1410), system controller (1420), and notification popup (1430) in response to a change in the folding state, and the application screen (1400) can maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) can adjust the indicator (1410), system controller (1420), and notification popup (1430) to be positioned in a designated part (e.g., the center part) of the display area where they are exposed, excluding the screen that is obscured by the folding hinge angle due to the change in the folding state.
[0317] According to one embodiment, when the electronic device (101) completes a folding state change to a folding state (e.g., an intermediate state, a half-fold state, or a second designated state), the positions of the indicator (1410), system controller (1420), and notification popup (1430) can be adjusted to be located in the central part of the exposed display area to match the folding state. For example, the electronic device (101) can maintain the position (and / or aspect ratio) of the information in the application area (e.g., application screen (1400)) as in the unfolded state.
[0318] According to one embodiment, when the important information (1410, 1420, 1430) is moved in response to a change in the folding state, the electronic device (101) can adjust the size of the important information (1410, 1420, 1430) (e.g., screen size or aspect ratio) in response to the size of the area (e.g., exposed display area) where the important information (1410, 1420, 1430) is moved (e.g., resizing the width of the important information) so that it is all included and displayed within the exposed display area.
[0319] According to one embodiment, an example screen <1403> As exemplified in [Image], the user may perform input based on the notification popup (1430) (e.g., touch the notification popup (1430)) to confirm a notification according to the notification popup (1430) in an intermediate state (e.g., a second designated state or a half-fold state) after a change in the folding state. According to one embodiment, when the electronic device (101) receives input from the user based on the notification popup (1430) in an intermediate state, it may execute a task related to the notification popup (1430) (e.g., display a message screen) in response to the input.
[0320] For example, example screen <1405> As exemplified in the example, the electronic device (101) can display a task execution screen (1440) related to a notification popup (1430) through an exposed display area. According to one embodiment, the electronic device (101) can display important information (e.g., an indicator (1410) and a system controller (1420)) in a fixed manner, and provide the task execution screen (1440) related to the notification popup (1430) in a popup format by overlapping it onto an application screen (1400) that was displayed in the exposed display area. According to one embodiment, when executing a task based on the notification popup (1430), the electronic device (101) can display the task execution screen (1440) by adjusting it to fit the size of the exposed display area (e.g., screen size or aspect ratio).
[0321] According to one embodiment, an example screen <1407> As exemplified in [here], the user can change from an intermediate state (e.g., a second designated state or a half-fold state) to an unfolded state (e.g., a first designated state) by changing the folding state. According to one embodiment, in response to the unfolded state, the electronic device (101) may display important information (e.g., an indicator (1410) and a system controller (1420)) displayed through the display area exposed in the intermediate state by moving the position (e.g., restoring it to its original position) in response to the change in the folding state, and may maintain the task execution screen (1440) (e.g., a message screen) that was displayed at the size (e.g., screen size or aspect ratio) of the display area exposed in the intermediate state in the form of a pop-up window, and may provide the application screen (1400) that was provided at the large screen ratio (e.g., full screen ratio) in the unfolded state while maintaining the existing state (e.g., size and / or aspect ratio).
[0322] FIG. 15 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0323] According to one embodiment, FIG. 15 illustrates an example of providing information on a status bar (e.g., a clock information indicator (1510)) (hereinafter referred to as the indicator (1510)), information on a navigation bar (e.g., a system controller (1520) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as the system controller (1520)) and a notification popup (1530) (e.g., an incoming call notification popup) by moving them to a display area exposed in response to a change in the folding state. According to one embodiment, FIG. 15 may illustrate an example of providing at least one important information by adjusting the size (and / or content) of the important information in response to the size of the display area exposed.
[0324] According to one embodiment, FIG. 15 may illustrate an example in which an electronic device (101) is operating in an unfolded state (e.g., a first designated state) when a notification occurs, and is folded into an intermediate state (e.g., a second designated state or a half-fold state) after the notification occurs. According to one embodiment, an example screen in FIG. 15 <1501> indicates an example of the first specified state (e.g., unfolded state), and the example screen <1505> indicates an example of the second specified state (e.g., intermediate state or half-fold state), and the example screen <1503> can represent an example of an intermediate operation state (e.g., a state in progress of folding) where the folding state changes from a first designated state to a second designated state. According to one embodiment, an example screen <1501> As exemplified in [Image], the electronic device (101) can display a screen containing information (or screen elements) that do not require persistence (e.g., a screen of an application (e.g., a content screen (1500)) and information that requires persistence (e.g., important information) (e.g., an indicator (1510), a system controller (1520), and a notification pop-up (1530)) in the unfolded state, depending on the change in the folding state.
[0325] According to one embodiment, an example screen <1501> As exemplified in [Image], the electronic device (101) may detect a notification occurrence (e.g., incoming call reception) while operating in the unfolded state and provide a relevant notification popup (1530) (e.g., incoming call popup) corresponding to the notification based on a designated area (e.g., popup display). In one embodiment, the electronic device (101) may identify the notification popup (1530) corresponding to the notification occurrence as information requiring persistence (e.g., important information) according to the change in the folding state.
[0326] According to one embodiment, while the user is using an application (e.g., a weather application) with the electronic device (101) in an unfolded state, the user can confirm the occurrence of a notification through a notification pop-up (1530), and after the notification occurs, start folding the electronic device (101), and example screen <1503> As exemplified in [here], it can be transitioned to an intermediate state (e.g., a second specified state or a half-fold state).
[0327] According to one embodiment, an example screen <1503> As exemplified in [Image], when the folding state change to a folding state (e.g., intermediate state or half-fold state) is completed, the electronic device (101) can adjust the positions of the indicator (1510), system controller (1520), and notification popup (1530) to be located in the central part of the exposed display area to match the folding state (e.g., half-fold state or a second designated state). For example, the electronic device (101) can maintain the position of information in the application area (e.g., content screen currently playing (1500)) in the same position as in the unfolded state, and adjust the position of important information (1510, 1520, 1530) so that it is displayed through the exposed display area.
[0328] According to one embodiment, an example screen <1501> and example screen <1503> As exemplified in [Image], the electronic device (101) can detect the start of a folding operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle. According to one embodiment, the electronic device (101) can identify specific information (1510, 1520, 1530) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (1510), a system controller (1520), and a notification pop-up (1530) (e.g., incoming call information). According to one embodiment, the electronic device (101) can move the specific information (1510, 1520, 1530) to an exposed display area and provide it in response to a change in the folding state. According to one embodiment, the electronic device (101) adjusts the positions of the indicator (1510), system controller (1520), and notification popup (1530) in response to a change in the folding state, and the application screen (1500) can maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) can adjust the position so that the indicator (1510), system controller (1520), and notification popup (1530) are located in the central part of the display area where they are exposed, excluding the screen that is obscured by the folding hinge angle according to the change in the folding state.
[0329] According to one embodiment, an example screen <1505> As exemplified in [Image], when the electronic device (101) completes a folding state change to a folding state (e.g., intermediate state or half-fold state or a second designated state), it can adjust the positions of the indicator (1510), system controller (1520), and notification popup (1530) to be located in the exposed display area to match the folding state. For example, the electronic device (101) can maintain the position (and / or aspect ratio) of the information in the application area (e.g., application screen (1500)) as in the unfolded state.
[0330] According to one embodiment, an example screen <1505> As exemplified in [Image], the electronic device (101) can provide that when important information (1510, 1520, 1530) is moved in response to a change in the folding state, at least one piece of important information (e.g., notification popup (1530)) among the important information (1510, 1520, 1530) that requires resizing (e.g., resizing the width of the important information (e.g., notification popup (1530))) is resized to correspond to the size (e.g., screen size or aspect ratio) of the area (e.g., exposed display area) where the important information (1510, 1520, 1530) is moved, so that it is all included and displayed within the exposed display area.
[0331] According to one embodiment, a user may perform input based on a notification popup (1530) (e.g., touching the notification popup (1530)) to confirm a notification based on the notification popup (1530) in an intermediate state (or half-fold state) after changing the folding state. According to one embodiment, when the electronic device (101) receives input from the user based on the notification popup (1530) in the intermediate state, it may execute a task related to the notification popup (1530) (e.g., a call connection popup or a call connection screen display) in response to the input. According to one embodiment, when executing a task based on the notification popup (1530), the electronic device (101) may display a task execution screen that fits the size of the exposed display area (e.g., screen size or aspect ratio).
[0332] FIG. 16 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0333] According to one embodiment, FIG. 16 is a drawing illustrating an example of moving information of a status bar (e.g., a clock information related indicator (1610)) (hereinafter referred to as indicator (1610)), information of a navigation bar (e.g., a system controller (1620)) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as system controller (1620)), and a notification popup (1630) (e.g., a device connection popup) to a display area exposed in response to a change in the folding state.
[0334] According to one embodiment, FIG. 16 may show another example of a notification popup (1630) (e.g., a device connection popup). According to one embodiment, the electronic device (101) displays important information (e.g., an indicator (1610), a system controller (1620), and a notification popup (1630)) by adjusting (e.g., moving the position) to be located in a display area exposed according to the folding state, in an operation corresponding to that described in the description section with reference to FIG. 15, and the information in the application area (e.g., a content screen (1600) currently being displayed (e.g., a gallery screen)) may maintain the same display state (e.g., position and aspect ratio) as in the unfolded state.
[0335] FIG. 17 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0336] According to one embodiment, FIG. 17 is a drawing illustrating an example of moving information of a status bar (e.g., a clock information related indicator (1710)) (hereinafter referred to as indicator (1710)), information of a navigation bar (e.g., a system controller (1720) (e.g., a navigation button or a navigation menu or a software button) (hereinafter referred to as system controller (1720)), and a notification popup (1730) (e.g., a device connection popup) to a display area exposed in response to a change in the folding state.
[0337] According to one embodiment, FIG. 17 may show an example in which a notification occurs while operating in an unfolded state (e.g., a first designated state), and after the notification occurs, the device is folded into an intermediate state (e.g., a second designated state or a half-fold state). According to one embodiment, FIG. 17 may show an example in which an application screen (1700) is a home screen and an example of operation on the home screen is shown.
[0338] According to one embodiment, as illustrated in FIG. 17, the electronic device (101) may detect the occurrence of a notification (e.g., a device connection notification) while operating in an unfolded state and provide (e.g., a popup display) a related notification popup (1730) (e.g., a device connection popup) corresponding to the occurrence of the notification based on a designated area. In one embodiment, the electronic device (101) may identify the notification popup (1730) corresponding to the occurrence of the notification as information requiring persistence (e.g., important information) depending on the change in the folding state.
[0339] According to one embodiment, while the user is using the home screen (1700) with the electronic device (101) in an unfolded state, the user can confirm the occurrence of a notification through a notification pop-up (1730), and after the notification occurs, the user can start folding the electronic device (101) to transition to an intermediate state (e.g., a second designated state or a half-fold state).
[0340] According to one embodiment, the electronic device (101) can detect the start of a folding operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle. According to one embodiment, the electronic device (101) can identify specific information (1710, 1720, 1730) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (1710), a system controller (1730), and a notification pop-up (1750) (e.g., device connection information). According to one embodiment, the electronic device (101) can move the specific information (1710, 1720, 1730) to an exposed display area and provide it in response to a change in the folding state. According to one embodiment, the electronic device (101) can adjust the positions of the indicator (1710), system controller (1720), and notification popup (1730) in response to a change in the folding state, and the home screen (1700) (or information in the home screen area, e.g., application launch icon, search bar, widget, etc.) can maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) can adjust the indicator (1710), system controller (1720), and notification popup (1730) to be positioned in designated parts of the display area where they are exposed (e.g., the central part of the application area, the left area of the status bar, the central area of the navigation bar), respectively, excluding the screen that is obscured by the folding hinge angle according to the change in the folding state.
[0341] According to one embodiment, the electronic device (101) can adjust the notification pop-up (1730) to be positioned in the center, the system controller (1720) can adjust the navigation bar to be positioned at a set position (or a designated position according to placement information) (e.g., left part or center part), and the indicator (1710) can be positioned at a set position on the status bar (e.g., left part). In one embodiment, the electronic device (101) can adjust the position change of the important information (1710, 1720, 1730) based on the placement information to which the important information (1710, 1720, 1730) is set by default.
[0342] According to one embodiment, when the electronic device (101) completes a folding state change to a folding state (e.g., intermediate state, half-fold state, or a second designated state), the position of the indicator (1710), system controller (1720), and notification popup (1730) can be adjusted to be positioned in the exposed display area to match the folding state. For example, the electronic device (101) can maintain the position (and / or aspect ratio) of the information in the application area (e.g., home screen (1700)) as in the unfolded state.
[0343] According to one embodiment, when important information (1710, 1720, 1730) is moved in response to a change in the folding state, the electronic device (101) can adjust the size of at least one piece of important information (1710, 1720, 1730) that requires size adjustment (e.g., resizing the width of the important information) in response to the size (e.g., screen size or aspect ratio) of the area (e.g., exposed display area) where the important information (1710, 1720, 1730) is moved, so that it is all included and displayed within the exposed display area.
[0344] According to one embodiment, as illustrated in FIG. 17, while the folding state of the electronic device (101) is changing, the home screen (1700) maintains its original display state (e.g., position and aspect ratio) without adjustment, and can adjust predetermined information such as an indicator (1710), a system controller (1720), and a notification pop-up (1730). According to one embodiment, as an example not limited to, when the folding state change is completed (e.g., half-fold state or a second designated state), the electronic device (101) may rearrange and provide the home screen (1700) (or information in the home screen (1700) area, e.g., application launch icon, search bar, widget, etc.) along with adjusting the position of the indicator (1710), the system controller (1720), and the notification pop-up (1730). For example, for a background screen such as the content screen (1600) of FIG. 16 or the home screen (1700) of FIG. 17, while the folding state change is in progress, the full screen display state of the background screen is maintained, and the predetermined information is displayed by gradually adjusting (e.g., moving the position), and when the folding state change is completed (e.g., half-fold state or a second designated state), the background screen may also be repositioned along with the adjustment of the predetermined information (e.g., important information).
[0345] FIG. 18 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0346] According to one embodiment, FIG. 18 is a diagram illustrating an example in which important information (1810, 1820, 1830) is moved and provided in response to a change in the folding state. According to one embodiment, FIG. 18 may show an example in which the location of important information (1810, 1820, 1830) is moved and provided in response to a change in the folding state (e.g., change from a folded state to an unfolded state) in an out-folding type electronic device (101) (e.g., a multi-foldable electronic device). For example, while changing from a folded state to an unfolded state (e.g., change to an unfolded state), an example may be shown in which important information (1810, 1820, 1830) is moved and provided in real time in response to the change in the folding state.
[0347] According to one embodiment, an example screen <1801> As exemplified in [Image], the electronic device (101) can operate in a folded state. According to one embodiment, while the electronic device (101) is operating in a folded state, it may detect the occurrence of a notification (e.g., a device connection notification) and provide (e.g., a popup display) a relevant notification popup (1830) (e.g., a device connection popup) corresponding to the occurrence of the notification based on a designated area. In one embodiment, the electronic device (101) may identify the notification popup (1830) corresponding to the occurrence of the notification as information requiring persistence (e.g., important information) depending on the change in the folded state.
[0348] According to one embodiment, an example screen <1801> As exemplified in [Image], while the user is using the home screen (1800) with the electronic device (101) in a folded state, the user can check for notifications through a notification pop-up (1830), and example screen <1803> As exemplified in [Image], after a notification occurs, the electronic device (101) can be started to be unfolded and switched to an unfolded state.
[0349] According to one embodiment, the electronic device (101) can detect the start of a folding (or unfolding) operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle. According to one embodiment, the electronic device (101) can identify specific information (1810, 1820, 1830) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (1810), a system controller (1820), and a notification pop-up (1830). According to one embodiment, the electronic device (101) can provide the position of the specific information (1810, 1820, 1830) by adjusting (e.g., moving) it in response to a change in the folding state. According to one embodiment, the electronic device (101) adjusts the positions of the indicator (1810), system controller (1820), and notification popup (1830) in response to a change in the folding state, and the home screen (1800) (or information in the home screen area, e.g., application launch icon, search bar, widget, etc.) may maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) may adjust the position of the indicator (1810), system controller (1820), and notification popup (1830) to each be located in a designated part of the display area where they are exposed (e.g., the central part of the application area, the left area of the status bar, the central area of the navigation bar) in response to a change in the folding (or unfolding) state.
[0350] According to one embodiment, the electronic device (101) can adjust the notification pop-up (1830) to be positioned in the center portion, the system controller (1820) can be adjusted to be positioned in a set position of the navigation bar (or a designated position according to placement information) (e.g., left portion or center portion), and the indicator (1810) can be adjusted to be positioned in a set position of the status bar (e.g., both end portions (or left and right portions)). In one embodiment, the electronic device (101) can adjust the position change of the important information (1810, 1820, 1830) based on the placement information to which the important information (1810, 1820, 1830) is set by default.
[0351] According to one embodiment, an example screen <1805> As exemplified in [Image], when the electronic device (101) completes the folding (or unfolding) state change to the unfolded state, it can adjust the positions of the indicator (1810), system controller (1820), and notification popup (1830) to be located in the exposed display area to match the unfolded state. For example, the electronic device (101) can maintain the position (and / or aspect ratio) of the information in the application area (e.g., home screen (1800)) in the same way as in the folded state.
[0352] FIG. 19 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0353] According to one embodiment, FIG. 19 is a diagram illustrating an example of adjusting a portion of important information (1910, 1920, 1930, 1940) (e.g., some important information (1910, 1920, 1930)) in response to a change in folding state by considering the priority among a plurality of important information (1910, 1920, 1930, 1940). According to one embodiment, example screen <1901> As illustrated in FIG. 19, an example may be shown in which multiple notification popups (e.g., a first notification popup (1930) and a second notification popup (1940)) (e.g., a popup window) are included in important information (1910, 1920, 1930, 9140).
[0354] According to one embodiment, FIG. 19 may show an example in which a plurality of notifications occur while the electronic device (101) is operating in an unfolded state, and the device is folded into an intermediate state (or half-folded state) after the occurrence of a plurality of notifications. According to one embodiment, the electronic device (101) may selectively adjust at least one important information in response to a change in the folding state.
[0355] According to one embodiment, while the user is using an application with the electronic device (101) in an unfolded state, the user can confirm the occurrence of a notification through a notification pop-up (1930, 1940), and after the notification occurs, start folding the electronic device (101), and example screen <1903> As exemplified in [here], it can be switched to an intermediate state.
[0356] According to one embodiment, an example screen <1903> As exemplified in [Image], when the folding state change of the electronic device (101) to an intermediate state (or half-fold state) is completed, the positions of the indicator (1910), system controller (1920), and notification popup (e.g., first notification popup (1930)) can be adjusted to be located in a designated part of the exposed display area, respectively, to match the intermediate state.
[0357] According to one embodiment, when an electronic device (101) includes a plurality of notification popups (e.g., a first notification popup (1930) and a second notification popup (1940)), it can identify a notification popup (e.g., a first notification popup (1930)) that has priority (e.g., has focus) among the plurality of notification popups (1930, 1940) as a target for adjustment. According to one embodiment, the electronic device (101) can display the notification popup (e.g., a first notification popup (1930)) that has priority (e.g., has focus) among the plurality of notification popups (1930, 1940) through an exposed display area by adjusting its position and / or size in response to a change in the folding state.
[0358] FIG. 20 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0359] According to one embodiment, FIG. 20 may illustrate an example in which an electronic device (101) operates in an intermediate state (e.g., a second designated state or a half-fold state). According to one embodiment, FIG. 20 may illustrate an example in which a screen (2000) of an application area (e.g., a home screen, an application screen, a content screen, etc.) is moved based on user input (2050) (e.g., a left or right swipe) in an intermediate state (e.g., a second designated state or a half-fold state).
[0360] According to one embodiment, as illustrated in FIG. 20, when the folding state change to an intermediate state (or half-fold state) is completed, the electronic device (101) can adjust and display the location of important information (e.g., an indicator (2010), a system controller (2020)) to be positioned in a designated part of the exposed display area to match the intermediate state.
[0361] According to one embodiment, the electronic device (101) may receive user input (2050) (e.g., left / right swipe) based on the application area of the display area (e.g., third display area) exposed in an intermediate state. According to one embodiment, the electronic device (101) may, in response to the input, provide general information of the screen (2000) (e.g., home screen, application screen, content screen, etc.) of the application area within the exposed display area by moving it left / right (e.g., left / right scrolling) according to the user input (2050) (e.g., left / right swipe). For example, the electronic device (101) may, in response to the user input, provide information that is not exposed in the display area by displaying it through the movement of the screen (2000).
[0362] FIG. 21 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0363] According to one embodiment, FIG. 21 is a diagram illustrating an example in which important information (2110, 2120, 2130) is identified according to the attributes (e.g., whether it is required) of information (or screen elements), and the identified important information (2110, 2120, 2130) is moved and provided according to a change in the folding state. According to one embodiment, FIG. 21 may show an example in which a widget or icon that is not designated as important information (e.g., fixed information) is identified as important information according to the attributes (e.g., whether it is required), and adjusted to correspond to a change in the folding state.
[0364] According to one embodiment, an example screen <2101> As exemplified in, it operates in the unfolded state and based on user input, the example screen <2103> As exemplified in [here], the state may be changed to an intermediate state. According to one embodiment, the electronic device (101) may identify specific important information (2110, 2120) when it detects the start of a folding operation. According to one embodiment, the electronic device (101) may identify information of a target to be adjusted to be included as important information (e.g., widget information (2130)) according to the attributes of a widget or icon. According to one embodiment, the electronic device (101) may additionally include the identified information (2130) in the important information. According to one embodiment, the electronic device (101) may include the specific important information (2110, 2120) and the identified information (2130) as important information (2110, 2120, 2130) in response to a change in the folding state, and may display them fixedly through a display area exposed by adjusting the position and / or size.
[0365] FIG. 22 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0366] According to one embodiment, FIG. 22 may illustrate an example of applying an exception to a fixed setting of an application screen in an electronic device (101). For example, the electronic device (101) may support adjusting the display position and / or aspect ratio of the screen when changing state to an intermediate state (or half-fold state). For example, the electronic device (101) may provide a setting interface related to half-fold state operation to the user. For example, the setting interface may provide an on / off setting for an application that is to be used with an optimized aspect ratio in the half-fold state.
[0367] According to one embodiment, the user can cancel the application that is desired to be used in the half-fold state, or the application selected to be used, through a settings interface. For example, FIG. 22 may show a state where “App D” is set on (2200) to optimize the screen ratio in the half-fold state by the user, and “App A”, “App B” and “App C” are set off to maintain the screen ratio without optimizing it in the half-fold state.
[0368] According to one embodiment, depending on the settings based on the setting interface, for example, in the case of an application screen in the setting-on state (2200), the position, aspect ratio, and / or interface may be reconfigured to fit the exposed display area depending on the change in the folding state. According to one embodiment, depending on the settings based on the setting interface, in the case of an application screen in the setting-off state, the original display state (e.g., position and aspect ratio) may be maintained without adjustment when the folding state is changed.
[0369] FIG. 23 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0370] According to one embodiment, FIG. 23 may illustrate an example in which, for example, a user can adjust and provide the screen of an application (e.g., “App D” of FIG. 22) with important information, which is set to optimize the screen ratio in a half-fold state through the setting interface of FIG. 23.
[0371] According to one embodiment, the electronic device (101) can identify specific important information (2310, 2320) when it detects the start of a folding operation in an unfolded state. According to one embodiment, the electronic device (101) can identify an application that is set to be optimized in a half-fold state and identify whether an application in an application area (e.g., a currently displayed content screen (2300)) corresponds to an application that is set to be optimized.
[0372] According to one embodiment, the electronic device (101) can identify the designated important information (2310, 2320) and the screen (2300) of the application area as adjustment targets in response to the start of a folding operation. According to one embodiment, the electronic device (101) can adjust and provide the designated important information (2310, 2320) and the screen (2300) of the application area to fit the exposed display area in response to a change in the folding state.
[0373] According to one embodiment, the electronic device (101) may display specific important information (2310, 2320) through an exposed display area by adjusting its position and / or size. According to one embodiment, the electronic device (101) may reconfigure the screen (2300) of an application to fit the exposed display area (e.g., adjusting the aspect ratio, reconfiguring the screen interface (or layout), etc.), such as an example <2350> As shown in the example of the screen (or interface), it can be displayed through the exposed display area of the intermediate state (or half-fold state).
[0374] FIG. 24 is a drawing illustrating an example of adjusting and providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0375] According to one embodiment, FIG. 24 illustrates an example of providing a visual cue (2450) based on a base color (or representative color). According to one embodiment, FIG. 24 may illustrate an example of providing a visual cue (2450) through a designated area that indicates that the screen (e.g., content) of an application is being maintained (or displayed) in a display area (e.g., a first display area and a second display area) that is covered by a folding state change (e.g., an intermediate state).
[0376] According to one embodiment, an example screen in FIG. 24 <2401> indicates an example of the first specified state (e.g., unfolded state), and the example screen <2405> indicates an example of the second specified state (e.g., intermediate state or half-fold state), and the example screen <2403> It may represent an example of an intermediate operation state (e.g., a state in progress of folding) where the folding state changes from a first specified state to a second specified state.
[0377] According to one embodiment, as illustrated in FIG. 24, the user places the electronic device (101) in an unfolded state (or a first designated state) (e.g., the example screen of FIG. 24). <2401> Watch a video in ), and while watching the video, start folding the electronic device (101) to an intermediate state (e.g., a second designated state or a half-fold state) (e.g., the example screen of FIG. 24). <2405> It can be switched to ). According to one embodiment, the electronic device (101) can detect the start of a folding operation. For example, the electronic device (101) can detect the start of a folding operation based on a change in the folding hinge angle.
[0378] According to one embodiment, the electronic device (101) can identify specific information (2410, 24120) (e.g., important information) among the information (or screen elements) displayed on the screen in response to the detection of the start of a folding operation. For example, the electronic device (101) can identify an indicator (2410) and a system controller (2420). According to one embodiment, the electronic device (101) can move the specific information (2410, 2420) to an exposed display area and provide it in response to a change in the folding state. According to one embodiment, the electronic device (101) can adjust the positions of the indicator (2410) and the system controller (2420) in response to a change in the folding state, and the video information (2400) (e.g., content screen) can maintain its original display state (e.g., position and aspect ratio) without adjustment. For example, the electronic device (101) can be adjusted so that the indicator (2410) and the system controller (2420) are each positioned in a designated part of the display area where they are exposed, excluding the screen that is obscured by the folding hinge angle according to the folding state change.
[0379] According to one embodiment, when the folding state change to a folding state (e.g., intermediate state or half-fold state) is completed, the electronic device (101) can adjust the positions of an indicator (2410) (e.g., status bar information) and a system controller (2420) (e.g., navigation bar information) to be respectively positioned in a designated part of the exposed display area to match the folding state (e.g., half-fold state or a second designated state). For example, the electronic device (101) can maintain the position (and / or aspect ratio, layout, etc.) of information in the application area (e.g., content screen (2400)) in the same way as in the unfolded state.
[0380] According to one embodiment, an example screen <2405> As exemplified in [Image], the electronic device (101) can identify a dominant color (or representative color) in a folding state (e.g., intermediate state or half-fold state) and provide a dominant color-based visual cue (2450). According to one embodiment, the electronic device (101) can provide a dominant color-based visual cue (2450) through a designated area that indicates that the screen (2400) (e.g., content screen) of an application is being maintained (or displayed) in a display area (e.g., a first display area and a second display area) that is obscured by a change in folding state (e.g., intermediate state).
[0381] In one embodiment, the designated area may include, for example, an interface (or boundary area) where a housing (e.g., a first housing) and an exposed display area (e.g., a third display area) meet depending on the folding state. According to one embodiment, the electronic device (101) may extract a dominant color (or representative color) based on a color analysis (or detection) technique that analyzes the main color of the content, and may determine a color for a visual cue (2450) using the extracted dominant color. According to one embodiment, the electronic device (101) may provide the visual cue (2450) with the determined color (e.g., dominant color) in the designated area (e.g., boundary area) through software-induced luminescence (e.g., applying a graphic effect of the dominant color (e.g., gradient or highlighting effect) on an additional layer).
[0382] FIGS. 25a, FIGS. 25b, FIGS. 25c, and FIGS. 25d are drawings illustrating an example of providing information based on a folding state in an electronic device according to one embodiment of the present disclosure.
[0383] According to one embodiment, FIGS. 25a, FIGS. 25b, FIGS. 25c, and FIGS. 25d may illustrate examples of usage scenarios (or operation screens) in which important information (or screen elements) (e.g., status bar information, navigation bar information, notification information, and / or pop-up information) is provided by adjusting (e.g., changing or reconfiguring) the position or position and size in response to a folding state change proceeding from a first designated state (or unfolded state) to a second designated state (or half-folded state) in an electronic device (101) according to one embodiment.
[0384] Referring to FIGS. 25a, 25b, 25c, and 25d, according to one embodiment, an example screen <2501> It may represent an example of a first designated state (e.g., unfolded state). In one embodiment, the electronic device (101) may display a full screen (e.g., a screen through the entire surface of a first display area, a second display area, and a third display area) in the first designated state.
[0385] According to one embodiment, an example screen <2503> It may show an example in which a notification popup (2530) is displayed for a notification that occurred while operating in the first designated state.
[0386] According to one embodiment, an example screen <2505> , example screen <2507> , example screen <2509> , example screen <2511> , example screen <2513> , example screen <2515> , and example screen <2517> It may represent an example of an intermediate operation state (e.g., folding in progress state) in which the folding state changes from a first specified state to a second specified state after a notification occurs (e.g., after a notification popup (2530) is displayed).
[0387] According to one embodiment, an example screen <2505> , example screen <2507> , example screen <2509> This may represent an example of a state before the display area (e.g., a first display area) is completely obscured from the user's field of vision after the start of the folding operation. According to one embodiment, before the first display area is completely obscured (e.g., a state where the folding angle between the first display area and the second display area is below a predetermined threshold), important information (e.g., an indicator (2510), a system controller (2520), a notification popup (2530)) may not be adjusted and may be provided through a default designated part.
[0388] According to one embodiment, the electronic device (101) can provide important information (2510, 2520, 2530) without adjusting it through a basic designated part while the folding angle between the first display area and the second display area is below a predetermined threshold value.
[0389] According to one embodiment, an example screen <2511> , example screen <2513> , example screen <2515> , and example screen <2517> This may represent an example of a state in which a display area (e.g., a first display area) is completely obscured from the user's field of vision after the start of a folding operation. According to one embodiment, after the first display area is completely obscured (e.g., when the folding angle between the first display area and the second display area exceeds a predetermined threshold value), important information (2510, 2520, 2530) may be provided in a positional adjustment. For example, the important information (2510, 2520, 2530) may be moved at the point in time when the folding angle exceeds a predetermined threshold value after the start of the folding operation. According to one embodiment, the important information (2510, 2520, 2530) may be moved in a direction opposite to the obscured display area (e.g., the first display area and the second display area) and in a position corresponding to a distance proportional to the folding angle between the first display area and the second display area.
[0390] According to one embodiment, the electronic device (101) can adjust and provide important information (2510, 2520, 2530) when the folding angle between the first display area and the second display area exceeds a predetermined threshold value. According to one embodiment, the electronic device (101) can adjust the positional movement of the important information (2510, 2520, 2530) at the point when the folding angle exceeds a predetermined threshold value after the start of the folding operation. According to one embodiment, the electronic device (101) can adjust the positional movement in the direction of the third display opposite the first display area and the second display area, corresponding to a distance proportional to the folding angle between the first display area and the second display area.
[0391] According to one embodiment, an example screen <2519> can represent an example of a second designated state (e.g., a half-fold state). In one embodiment, the electronic device (101) may adjust and display the location of important information (e.g., an indicator (2510), a system controller (2520), a notification pop-up (2530)) in the second designated state so that they are each located in a designated part of the exposed display area. In one embodiment, the electronic device (101) may provide the information of the application area (e.g., a screen of content being played) while proceeding to the second designated state and in the second designated state, while maintaining the display state (e.g., position, aspect ratio, and / or layout) of the first designated state, and adjust (or reconfigure) the location of the important information (2510, 2520, 530) so that they are displayed through the exposed display area. For example, the electronic device (101) can be adjusted to be positioned in a designated part of a display area (e.g., a third display area) where an indicator (2510), a system controller (2520), and a notification popup (2530) are exposed (e.g., the central part of the application area, the left part of the status bar, the central part of the navigation bar), respectively.
[0392] According to one embodiment, the electronic device (101) can adjust the notification pop-up (2530) to be positioned in the center part, the system controller (2520) can be adjusted to be positioned in a set position (or a designated position according to placement information) of the navigation bar (e.g., left part or center part), and the indicator (2510) can be adjusted to be positioned in a set position (e.g., left part) of the status bar. In one embodiment, the electronic device (101) can adjust the position change of the important information (2510, 2520, 2530) based on the placement information to which the important information (2510, 2520, 2530) is set by default.
[0393] A method of operation performed in an electronic device (101) (e.g., a multi-foldable electronic device) according to one embodiment of the present disclosure may include an operation of detecting the start of a folding operation in which the folding state of the multi-foldable electronic device changes from a first designated state to a second designated state. According to one embodiment, the method of operation may include an operation of analyzing screen elements of a current screen being displayed based on the start of the folding operation. According to one embodiment, the method of operation may include an operation of identifying important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements. According to one embodiment, the method of operation may include an operation of moving the important information to an exposed display area and displaying it in response to the change in the folding state.
[0394] According to one embodiment, the operation method may include: detecting the start of a folding operation in which a folding state is changed from a first designated state to a second designated state of a multi-foldable electronic device; analyzing screen elements of a current screen being displayed based on the start of the folding operation; identifying important information of high importance from the screen elements based on the analysis of the screen elements; and moving the important information to an exposed display area in response to the change in the folding state to display it.
[0395] According to one embodiment, the operation method may include an operation of providing important information through a default designated part without adjusting it while the folding angle between the first display area and the second display area is below a predetermined threshold value.
[0396] According to one embodiment, the operation method may include an operation of adjusting and providing important information when the folding angle between the first display area and the second display area exceeds a predetermined threshold value.
[0397] According to one embodiment, the operation method may include an operation to adjust the positional movement of the important information at the point when the folding angle exceeds a predetermined threshold value after the start of the folding operation.
[0398] According to one embodiment, the operation method may include an operation of moving to a position corresponding to a distance proportional to the folding angle between the first display area and the second display area in a third display direction facing the first display area and the second display area.
[0399] According to one embodiment, the operation method may include an operation of adjusting and displaying the location of important information in a second designated state so that it is positioned in a designated part of the exposed display area.
[0400] According to one embodiment, the operation method may include an operation of readjusting the size of important information in response to a change in the size of the exposed display area while the important information is moved to the exposed display area.
[0401] According to one embodiment, the operation method may include an operation of identifying predetermined information corresponding to a real-time notification and / or system controller element in the information displayed on the current screen as the important information.
[0402] According to one embodiment, the operation method may include an operation of analyzing the importance of information displayed on the current screen, and an operation of including some information having importance in the important information.
[0403] According to one embodiment, the operation method may include an operation of identifying important information with focus among a plurality of important information as an adjustment target, and an operation of adjusting the position and / or size of important information with focus among a plurality of important information in response to a change in the folding state.
[0404] According to one embodiment, the operation method may include an operation of moving and positioning the important information based on an exposure area corresponding to the first display area or the third display area to display it.
[0405] According to one embodiment, the operation method may include an operation of identifying the folding state of the display using the first sensor or the second sensor based on detecting the start of a folding operation of the multi-foldable electronic device.
[0406] According to one embodiment, the operation method may include, based on the folding state changing from the first designated state to the second designated state, or the folding state changing from the second designated state to the first designated state, adjusting the position and / or size of a predetermined screen element among the screen elements of the current screen and placing it in a part corresponding to the folding state change to display it.
[0407] According to one embodiment, the operation method may include an operation of moving and displaying important information in real time in response to a change in the folding state, based on the folding state changing from the first designated state to the second designated state, or the folding state changing from the second designated state to the first designated state.
[0408] According to one embodiment, the important information may include user preference information based on learning, preset information, information updated in real time, and / or a system controller.
[0409] According to one embodiment, the operation method may include, while operating the first display area, the second display area, and the third display area as a main screen in the first designated state, an operation of detecting a state change to the second designated state, and based on the state change detection, an operation of adjusting the position of at least a portion of the screen elements while maintaining the main screen, so as to continuously display through the exposed display area among the first display area or the third display area.
[0410] According to one embodiment, the operation method may include detecting a notification event while operating in the first designated state or the second designated state, providing a notification corresponding to the notification event through a designated part of the current screen, and displaying the notification corresponding to the notification event through an exposed display area based on a change in the folding state.
[0411] According to one embodiment, the display is divided into a first display area and a second display area based on a first folding axis between the first housing and the second housing, and is divided into a second display area and a third display area based on a second folding axis between the second housing and the third housing, and the first display area, the second display area, and the third display area may be formed to be partially folded or unfolded into a flat shape and extended to each other according to the first angle between the first housing and the second housing and the second angle between the second housing and the third housing.
[0412] According to one embodiment, the multi-foldable electronic device may include an electronic device composed of N hinge structures and N+1 housings. According to one embodiment, N may include a natural number greater than or equal to 2.
[0413] A non-transitory computer-readable medium storing instructions that cause the processor (120) to perform operations when executed by the processor of an electronic device (101) (e.g., a multi-foldable electronic device) according to one embodiment of the present disclosure, wherein the instructions may include, when executed by the processor, the electronic device performing the following operations: detecting the start of a folding operation in which the folding state of the multi-foldable electronic device changes from a first designated state to a second designated state; analyzing screen elements of a current screen being displayed based on the start of the folding operation; identifying important information (or important objects) of high importance from the screen elements based on the analysis of the screen elements; and moving the important information to an exposed display area and displaying it in response to the change in the folding state.
[0414] It will be understood that the foregoing embodiments and their technical features may be combined with one another in any combination, provided there is no conflict between the two embodiments or features. For example, any combination of two or more of the foregoing embodiments may be conceived and included within the present disclosure. One or more features from any embodiment may be incorporated into any other embodiment and may provide corresponding advantages or benefits.
[0415] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0416] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0417] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0418] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (or recording medium) (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-transient' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0419] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium (or recording medium), such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0420] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0421] The various embodiments of the present disclosure disclosed in this specification and drawings are provided as specific examples to facilitate the explanation of the technical content of the present disclosure and to aid in understanding the present disclosure, and are not intended to limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concept of the present disclosure, in addition to the embodiments disclosed herein.
Claims
1. In a multi-foldable electronic device (101, 200), A housing comprising a first housing, a second housing and a third housing; A first hinge structure disposed between the first housing and the second housing; A second hinge structure disposed between the second housing and the third housing; A display including a first display area, a second display area, and a third display area; A first sensor for detecting a first angle between the first housing and the second housing; A second sensor for detecting a second angle between the second housing and the third housing; processor; and It includes memory for storing instructions, When the above instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, Detecting the start of a folding operation in which the folding state of a multi-foldable electronic device changes from a first designated state to a second designated state, and Based on the start of the above folding operation, analyze the screen elements of the current screen being displayed, and Based on the analysis of the above screen elements, important information of high importance is identified from the screen elements, and A multi-foldable electronic device that moves the above important information to an exposed display area and displays it in response to a change in the folding state.
2. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, In a state where the folding angle between the first display area and the second display area is below a predetermined threshold value, important information is provided through the default designated part without adjustment, and A multi-foldable electronic device that adjusts and provides important information when the folding angle between a first display area and a second display area exceeds a predetermined threshold value.
3. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that adjusts the positional movement of the important information at the point when the folding angle exceeds a predetermined threshold value after the start of the folding operation.
4. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that moves to a position corresponding to a distance proportional to the folding angle between the first display area and the second display area in a third display direction opposite to the first display area and the second display area.
5. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that adjusts and displays the location of important information in a second designated state so that it is positioned in a designated part of the exposed display area.
6. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that readjusts the size of important information in response to a change in the size of the exposed display area while the important information moves to the exposed display area.
7. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that identifies defined information corresponding to real-time notifications and / or system controller elements from the information displayed on the current screen as important information.
8. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, Analyze the importance of the information displayed on the current screen above, and A multi-foldable electronic device that includes some information having importance in the said important information.
9. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, Identify the important information with focus among multiple pieces of important information as the adjustment target, and A multi-foldable electronic device that adjusts the position and / or size of a focused important information among multiple important information in response to a change in folding state.
10. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that displays important information by moving and positioning it based on an exposure area corresponding to the first display area or the third display area.
11. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that identifies the folding state of the display using the first sensor or the second sensor based on detecting the start of a folding operation of the multi-foldable electronic device.
12. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that, based on the change of the folding state from the first designated state to the second designated state, or the change of the folding state from the second designated state to the first designated state, adjusts the position and / or size of a predetermined screen element among the screen elements of the current screen and places it in a portion corresponding to the change in the folding state to display it.
13. In paragraph 1, when the instructions are executed individually and / or collectively by the processor, the multi-foldable electronic device, A multi-foldable electronic device that moves and displays important information in real time in response to a change in folding state, based on a change in folding state from the first designated state to the second designated state, or a change in folding state from the second designated state to the first designated state.
14. In Paragraph 1, The above important information includes user preference information based on learning, preset information, information updated in real time, and / or a system controller, in a multi-foldable electronic device.
15. A method of operating a multi-foldable electronic device (101, 200), An operation to detect the start of a folding operation in which the folding state of a multi-foldable electronic device changes from a first designated state to a second designated state; An operation to analyze screen elements of the current screen being displayed based on the start of the above folding operation; An operation to identify important information (or important objects) of high importance from the screen elements based on the analysis of the above screen elements; and A method comprising the operation of moving the above important information to an exposed display area and displaying it in response to a change in the folding state.
Citation Information
Patent Citations
Display apparatus
KR1020160108705A
Method for automationg the operation and management of flea market and server performing the same
KR1020220037023A
Annealing apparatus and method using induced heating coil
KR102529074B1
Transporting Apparatus For Tray And System For Automatic Dividing Ceramic Substrate Including Thereof
KR102637352B1
KR20230054227A