Multi-window control method of electronic equipment and electronic equipment

Abstract

An electronic device disclosed in this document may include a housing, a display mounted in the housing, a sensor module, and a processor operably connected to the display and the sensor module. The processor may: display a multi-window including a plurality of windows by dividing a screen of the display; identifying a state of the electronic device based on a sensor value of the sensor module; an object for selecting one of a plurality of windows is displayed in a designated area of a screen of a display based on a state of the electronic device.

Description

Technical Field

[0001] Various embodiments disclosed in this document relate to multi-window control of an electronic device, for example, display control of multiple windows in an electronic device. Background Art

[0002] As technology develops, the demand for using electronic devices to provide various information at the same time is gradually increasing. For example, electronic devices can run a multi-window function that divides a display into multiple windows and provides information for each window separately.

[0003] The above information is provided as background information only to assist in understanding the present disclosure. No determination has been made, and no assertion has been made, as to whether any of the above content is applicable as prior art to the present disclosure. Summary of the invention

[0004] The electronic device may individually control each window among multiple windows provided through the display.

[0005] According to various embodiments disclosed in this document, an electronic device may include a housing, a display installed in the housing, a sensor module, and a processor operably connected to the display and the sensor module, wherein the processor is configured to: display a multi-window including a plurality of windows by dividing a display screen; identify a state of the electronic device based on a sensor value of the sensor module; display an object for selecting one of the plurality of windows on a designated area of ​​the display screen based on the state of the electronic device; identify whether a first window among the plurality of windows is selected by the object displayed on the designated area; identify whether the first window is selected and whether an application switching function is selected; if the application switching function is selected, provide a second window including an optional object for running at least one application on the display; in response to selection of a specific object, run an application corresponding to the specific object displayed on the second window; and display an application running screen on the selected first window.

[0006] A method of an electronic device according to various embodiments disclosed in this document may include: displaying a multi-window including a plurality of windows by dividing a display screen of the electronic device; identifying a state of the electronic device based on a sensor value of a sensor module of the electronic device; displaying an object for selecting one of the plurality of windows on a designated area of ​​the display screen based on the state of the electronic device; identifying whether a first window among the plurality of windows is selected by the object displayed on the designated area; identifying whether the first window is selected and whether an application switching function is selected; if the application switching function is selected, providing a second window including an optional object for running at least one application on the display; in response to selection of a specific object, running an application corresponding to the specific object displayed on the second window; and displaying an application running screen on the selected first window.

[0007] According to various embodiments, a user interface capable of individually controlling each window among multiple windows provided through a display of an electronic device may be provided.

[0008] Furthermore, various effects directly or indirectly embodied through this document can be provided.

[0009] The technical problems, technical features, and effects to be achieved in the present disclosure are not limited to the above-mentioned technical problems, technical features, and effects, and ordinary technicians in the technical field to which the present invention belongs will clearly understand other technical problems, technical features, and effects not mentioned through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In conjunction with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0011] Figure 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0012] Figure 2 is a block diagram of an electronic device according to various embodiments.

[0013] Figure 3 Examples of format specifications of electronic devices according to various embodiments are shown.

[0014] Figure 4 The appearance of a foldable electronic device according to various embodiments is shown.

[0015] Figure 5 Examples of multiple windows of an electronic device according to various embodiments are illustrated.

[0016] Figure 6 is a diagram illustrating multi-window control of an electronic device according to various embodiments.

[0017] Figure 72 is a diagram illustrating a bent state of an electronic device according to various embodiments.

[0018] Figure 8 is a diagram illustrating multi-window control of an electronic device in a bent state according to various embodiments.

[0019] Figures 9a to 9c is a diagram illustrating multi-window control of an electronic device in a bent state according to various embodiments.

[0020] Fig.10 is a diagram illustrating multi-window control of an electronic device in a bent state according to various embodiments.

[0021] Fig.11 is a diagram illustrating a popup window including a selectable object for executing an application of an electronic device according to various embodiments.

[0022] Fig.12 is a diagram illustrating multi-window control of an electronic device according to various embodiments.

[0023] Fig.13 is a flowchart illustrating a multi-window control operation of an electronic device according to various embodiments. DETAILED DESCRIPTION

[0024] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160).

[0025] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented as a separate part from the main processor 121, or as part of the main processor 121.

[0026] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated through machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0027] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0028] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0029] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0030] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0031] The display module 160 may visually provide information to the outside (e.g., user) of the electronic device 101. The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0032] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0033] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0034] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0035] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0036] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.

[0037] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0038] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0039] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0040] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0041] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less for a round trip).

[0042] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiation element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiation element may be additionally formed as a part of the antenna module 197.

[0043] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high frequency band.

[0044] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.

[0045] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be run on the electronic device 101 may be run on one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically perform a function or service or should perform a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to perform at least part of the function or service instead of running the function or service, or the electronic device 101 may request the one or more external electronic devices to perform at least part of the function or service in addition to running the function or service. The one or more external electronic devices that receive the request may perform the requested at least part of the function or service, or perform another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or health care) based on 5G communication technology or IoT-related technologies.

[0046] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0047] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for the corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “coupled with another element (e.g., the second element)”, “coupled to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” with or without the terms “operably” or “communicatively” being used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0048] As used herein, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0049] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0050] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be published in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be published (e.g., downloaded or uploaded) online via an application store (e.g., ), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0051] According to various embodiments, each of the above-mentioned components (e.g., a module or a program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., a module or a program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding one of the multiple components performing one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.

[0052] Figure 2 is a block diagram of an electronic device according to various embodiments.

[0053] Reference Figure 2 , the electronic device 200 (for example, Figure 1 The electronic device 101 may include a display 210 (eg, Figure 1 display module 160 and input module 150), a processor 220 (eg, Figure 1 processor 120), memory 230 (e.g., Figure 1 Memory 130) and / or sensor module 240 (e.g., Figure 1 The electronic device 200 may include a sensor module 176. Figure 1 At least some of the configurations and / or functions of the electronic device 101.

[0054] According to one embodiment, the display 210 may display a screen corresponding to one or more applications (or programs) run by the user. For example, when two or more applications are run simultaneously, the display 210 may divide the screen within the display 210 into a plurality of regions, and display windows corresponding to the run screens of the two or more applications in each of the divided regions.

[0055] According to one embodiment, the display 210 may be configured with at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED), a light emitting diode (LED), an active matrix organic LED (AMOLED), a flexible display, and a three-dimensional display. In addition, some of these displays may be configured to be transparent or light-transmissive so that the outside can be seen through the display. This may be configured in the form of a transparent display including a transparent OLED (TOLED). Hereinafter, the display is referred to as a flexible display 210, but the display according to various embodiments is not limited thereto. The flexible display 210 according to one embodiment may include Figure 1 At least some of the structures and / or functions of the display module 160 .

[0056] According to one embodiment, the flexible display 210 may visually provide information to the outside of the electronic device 200. The flexible display 210 may include a touch screen that detects a touch or hovering input. The flexible display 210 may include Figure 1 The configuration and / or function of the display module 160 may include at least a portion of Figure 1 The flexible display 210 of the electronic device 200 may include a structure capable of changing shape according to movement or deformation of a housing of the electronic device 200.

[0057] According to one embodiment, the electronic device 200 may include a structure in which the flexible display 210 can be folded or bent, and is not limited to a specific manner. For example, the electronic device 200 may be folded inward and / or outward in a folding manner, and may be folded up and down and / or left and right relative to a folding axis, and may include one or more folding axes.

[0058] According to one embodiment, the electronic device 200 may include a structure in which the flexible display 210 can be rolled (e.g., slid), but is not limited to a specific manner. For example, a portion of the flexible display 210 of the electronic device 200 can be rolled or folded within the housing, and can be unfolded left and right or up and down by at least one roller structure.

[0059] According to one embodiment, the flexible display 210 may be a main display of the electronic device 200 , and may be located on a front surface or a rear surface of a housing of the electronic device 200 .

[0060] According to one embodiment, the flexible display 210 may be an auxiliary display of the electronic device, and may be located on a front surface or a rear surface of a housing of the electronic device 200 .

[0061] According to one embodiment, the processor 220 is a configuration capable of controlling components of the electronic device 200 and / or performing operations or data processing on the display 210, and may include Figure 1 The processor 220 may be functionally, operatively and / or electrically connected to internal components of the electronic device 200 including the flexible display 210 and the sensor module 240.

[0062] According to one embodiment, the memory 230 may include a known volatile memory and a non-volatile memory and is not limited to a specific implementation example. The memory 230 may include Figure 1 At least a portion of the configuration and / or functionality of the memory 130. In addition, the memory 230 may store Figure 1 at least a portion of procedure 140 .

[0063] In one embodiment, the memory 230 is functionally, operatively and / or electrically connected to the processor 220 and may store various instructions that, when executed, may be executed by the processor 220. Such instructions may include various control commands that may be recognized by the processor 220, including arithmetic and logical operations, data movement and / or input / output.

[0064] According to one embodiment, the sensor module 240 may generate a sensor value for identifying a state (eg, shape and / or posture) of the electronic device 200 .

[0065] According to one embodiment, the shape of the electronic device 200 may be a shape formed by a housing of the electronic device 200 equipped with the flexible display 210. The shape of the flexible display 210 may be changed depending on the shape formed by the housing of the electronic device 200. The shape of the electronic device 200 may be, for example, a shape formed by the flexible display 210 depending on movement or deformation of the housing of the electronic device 200.

[0066] According to one embodiment, the posture of the electronic device 200 may be, for example, a direction and / or angle formed by the electronic device 200. The posture of the electronic device 200 may be understood as an angle and / or phase of the electronic device 200 or some components of the electronic device 200 relative to the gravity direction.

[0067] According to one embodiment, the sensor module 240 may include various sensors for detecting the state (e.g., shape and / or posture) of the electronic device 200. For example, the sensor module 240 may include various sensors such as an angle sensor (not shown), a magnetic sensor (not shown), a gravity sensor (not shown), an acceleration sensor (not shown), and / or a gyroscope sensor (not shown) that can detect the unfolding / folding state (e.g., a foldable display), a folding angle, a rolled-up state (e.g., a slidable display), a rolled-up degree, and / or a posture (e.g., an angle and / or phase of at least one shell relative to the gravity direction) of the electronic device 200. The sensor module 240 may be located inside and / or on one side of the shell of the electronic device 200, or in a hinge.

[0068] Figure 3 is a diagram showing format specifications of electronic devices according to various embodiments.

[0069] Reference Figure 3 , according to various embodiments, the electronic device 300 (eg, Figure 1 Electronic equipment 101 or Figure 2 The electronic device 200) can be implemented with various forms of specifications (or housings). For example, the electronic device 300 may include at least one of a slidable electronic device 310, a rollable electronic device 320, a first foldable electronic device 330, a second foldable electronic device 340, and a third foldable electronic device 350. Figure 3 The various forms of formats (or housings) shown in are examples of the formats of the electronic device 300, the electronic device 300 is not limited thereto, and various types of formats or modifications thereof are possible.

[0070] According to one embodiment, the first foldable electronic device 330 may include at least two hinge structures, and the second foldable electronic device 340 and the third foldable electronic device 350 may include one hinge structure.

[0071] According to one embodiment, the first foldable electronic device 330, the second foldable electronic device 340, and the third foldable electronic device 350 are equipped with a foldable (or bendable) display (e.g., a foldable display or a flexible display) and can be used by folding or unfolding based on a hinge structure.

[0072] Figure 4 are examples of structural and shape changes of an electronic device with a flexible display according to various embodiments.

[0073] Reference Figure 4 , the electronic device 400 (eg, Figure 2The electronic device 200 may be a foldable electronic device. According to various embodiments, the display 410 of the electronic device 400 may include Figure 1 At least some of the structures and / or functions of the display module 160 .

[0074] The foldable electronic device 400 according to various embodiments may include two housings (eg, a first housing 401 and a second housing 402 ) based on a folding axis (eg, an A axis), a flexible display 410 (eg, Figure 1 display module 160, a first display), a front camera 420 (eg, Figure 1 camera module 180), auxiliary display 430 (eg, Figure 1 display module 160, second display) and rear camera 440 (eg, Figure 1 camera module 180), and may include Figure 1 At least a part of the structure and / or function of the electronic device 101. The two shells may be covered by a hinge structure and may be folded and overlapped around at least one axis.

[0075] According to one embodiment, among the two shells constituting the shell of the electronic device 400, the first shell 401 may include a first surface and a second surface, and the second shell 402 may include a third surface and a fourth surface. For example, the form in which the display 410 of the electronic device 400 is folded relative to the A axis may be a form in which the first surface of the first shell 401 and the third surface of the second shell 402 face each other and are covered. Here, the form in which the electronic device 400 is folded may be a form in which the angle (e.g., angle B) formed by the first surface of the first shell 401 and the third surface of the second shell 402 forms a narrow angle (e.g., 0 to 5 degrees). For example, the form in which the electronic device 400 is folded may include a closed state or a fully folded state. The display 410 may be divided into a first area 411 and a second area 412 as physically folded and divided areas, and the first area 411 may be located on the first surface of the first shell 401, and the second area 412 may be located on the third surface of the second shell 402. The first shell 401 and the second shell 402 may be arranged on both sides relative to the folding axis (e.g., the A axis) as the center, and may have an overall symmetrical shape relative to the folding axis.

[0076] Reference Figure 4 , the first shell 401 may be located on the left side relative to the folding axis, and the second shell 402 may be located on the right side relative to the folding axis. The first shell 401 and the second shell 402 may be designed to be folded relative to each other, and may overlap so that the first surface of the first shell 401 and the third surface of the second shell 402 face each other in a folded form or a stacked form.

[0077] According to various embodiments, a hinge may be formed between the first housing 401 and the second housing 402 so that the first housing 401 and the second housing 402 of the electronic device 400 may be folded on top of each other. However, the housing structure of the electronic device 400 arranged left and right based on the folding axis is only an example, and the electronic device 400 may have a housing arranged up and down based on the folding axis (e.g., Figure 3 A second foldable electronic device 340).

[0078] According to one embodiment, depending on whether the electronic device 400 is in an unfolded state (or an open state), a folded state (or a closed state), or an intermediate state, the first housing 401 and the second housing 402 may have different angles (e.g., angle B) or distances therebetween. The unfolded state of the display 410 may include an open state (open state) or a flat state. For example, the unfolded state may include a state in which the first housing 401 and the second housing 402 of the electronic device 400 are arranged on the same plane at an angle of approximately 180 degrees, so that the display 410 is exposed in a flat state.

[0079] According to one embodiment, the electronic device 400 may have an auxiliary display 430 (eg, Figure 1 160). Figure 4 The auxiliary display may be formed on at least a portion of the second surface of the first housing 401 of the electronic device 400. The auxiliary display 430 may also be provided on the fourth surface of the second housing 402, and may be formed across a portion or all of the second surface of the first housing 401 and the fourth surface of the second housing 402. The auxiliary display may include Figure 1 at least a portion of the structure and / or function of the display module 160 .

[0080] According to one embodiment, the form of the electronic device 400 may be an intermediate state, for example, a form in which the display 410 is in a partially opened state (partially opened state) and the first housing 401 and the second housing 402 of the electronic device 400 are set in a specified angle range (for example, 80 to 130 degrees) so that the display 410 is exposed. The intermediate state may be, for example, a form in which the angle (for example, angle B) formed by the first surface of the first housing 401 and the third surface of the second housing 402 is within a specified angle range (for example, 80 to 130 degrees).

[0081] According to one embodiment, a processor (eg, Figure 2 The processor 220 can be based on the sensor module (for example, Figure 2The sensor value of the sensor module 240 in the embodiment of the present invention is used to identify that the electronic device 400 is in a flex state 403. For example, the flex state may represent a state in which the shape of the electronic device 400 is the above-mentioned intermediate shape and the posture of the electronic device 400 is a state in which one of the first shell 401 or the second shell 402 (for example, the first shell 401) is substantially horizontal to the ground surface.

[0082] Figure 5 Examples of multiple windows of an electronic device according to various embodiments are illustrated.

[0083] According to one embodiment, an electronic device (e.g., Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The electronic device 400) can divide the display screen into multiple windows through the multi-window function, and provide separate information through each of the multiple window screens. The multi-window screen can provide various windows in various division methods. For example, screen 501 can display two multi-windows divided left and right, and screen 502 can display two sub-windows divided up and down. For example, screen 503 can display three multi-windows: a left window, a right window, and a right window further divided up and down divided from left to right. For example, screen 504 can display three multi-windows: a right window, a left window, and a left window further divided up and down divided from left to right. For example, screen 505 can display three multi-windows: a lower window, an upper window, and an upper window further divided from left to right divided from top to bottom. For example, screen 506 can display three multi-windows: an upper window, a lower window, and a lower window further divided from left to right divided from top to bottom.

[0084] Figure 6 is a diagram illustrating multi-window control of an electronic device according to various embodiments.

[0085] Reference Figure 6 , electronic devices (e.g. Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the figure may be configured to display a display (eg, the display 210 or Figure 4The entire screen of the display 410 in the electronic device is divided into a plurality of sub-screens, and a multi-window of separate information is provided through each sub-screen. For example, the electronic device may provide a multi-window consisting of three sub-screens on the screen 601 of the display 410. For example, the electronic device may display a multi-window divided into three windows, namely, a window 611, a window 612, and a window 613, on the display 410. For example, the window 611, the window 612, and the window 613 may display the running screens of application A, application B, and application C, respectively.

[0086] According to one embodiment, the processor 220 may control display of the window according to a touch event corresponding to one window among the multiple windows.

[0087] According to one embodiment, the processor 220 may provide a menu including at least one object for controlling the execution screen of the application displayed through the corresponding window according to a touch event corresponding to one window in the multi-windows.

[0088] According to one embodiment, a touch event corresponding to any one of the multiple windows may include one or more touch (or hovering) inputs to the corresponding window, one or more touch (or hovering) inputs to a menu including an object for controlling the corresponding window, or a combination thereof.

[0089] According to one embodiment, the electronic device may receive a touch input 615 from the user on at least one area (eg, the top) of a window 613 in the multi-window screen 601 as a touch event.

[0090] According to one embodiment, in response to receiving touch input 615 , the electronic device may display a control menu (eg, multi-window handler) 627 for window 613 in at least one area (eg, top) of window 613 as shown in multi-window screen 602 .

[0091] For example, the control menu 627 may include an application switching object 627-1. The application switching object 627-1 may be a visual object for switching an execution screen of an application provided through the corresponding window 613 to an execution screen of another application.

[0092] In one embodiment, the electronic device may activate (focus) window 613 upon detecting a touch input 615 to window 613. The focus may move in response to the touch input 615 to activate the selected window 613, thereby indicating that window 613 is selected by color, effect, and / or text. In addition, the color, effect, and / or text of the selected window 613 may also be applied to the control menu 627 to distinguish it from the control menus of unselected windows.

[0093] According to one embodiment, when the electronic device receives an input (e.g., a touch input) 625 for selecting an application switching object 627-1 from a control menu 627, the electronic device may display a window 637 overlapping therewith, for example, in a pop-up form, on the multi-window screen 603, and the window 637 includes optional objects (e.g., icons or folders) for running various applications for application switching through touch events. For example, the window 637 including optional objects for running various applications may include optional objects that are the same or similar to the main screen, and may include a screen with the same or similar arrangement structure. For example, the optional objects displayed on the window 637 may be optional objects that are the same or similar to the main screen constructed by the user, and the same or similar arrangement structure may be provided.

[0094] According to one embodiment, one object 639 among selectable objects for executing various applications displayed in the window 637 may be selected through various touch input and / or hovering input methods, such as a touch input or drag and drop.

[0095] According to one embodiment, referring to the multi-window screen 604, an application (e.g., application D) corresponding to the selected object 639 may be executed, and the executed application screen 647 may be displayed in the corresponding sub-window 613. Thus, the application (e.g., application C) displayed in the sub-window 613 may be switched or changed to another application (e.g., application D).

[0096] Figure 7 2 is a diagram illustrating a bent state of an electronic device according to various embodiments.

[0097] According to one embodiment, an electronic device (e.g., Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the embodiment may be based on a sensor module (e.g., Figure 2 The state of the electronic device can be identified based on the sensor value of the sensor module 240. For example, the state of the electronic device can be identified as a bending state (for example, Figure 4 The bending state 403).

[0098] According to one embodiment, the sensor module 240 may include various sensors for detecting the state (e.g., shape and / or posture) of the electronic device. For example, the sensor module 240 may include various sensors such as an angle sensor (not shown), a magnetic sensor (not shown), a gravity sensor (not shown), an acceleration sensor (not shown), and / or a gyroscope sensor (not shown) that can detect the unfolding / folding state (e.g., a foldable display), a folding angle, a rolled-up state (e.g., a slidable display), a rolled-up degree, and / or a posture (e.g., an angle and / or phase of at least one housing relative to the direction of gravity) of the electronic device.

[0099] The bent state may indicate that the form of the electronic device is an intermediate form, and the posture of the electronic device is that the two shells (eg, Figure 4 The state in which one of the first housing 401 or the second housing 402 (for example, the first housing 401) is substantially horizontal to the ground surface. The intermediate form may represent the state in which the two housings of the electronic device (for example, Figure 4 The first housing 401 and the second housing 402 are arranged in a specified angle range (eg, 80 degrees to 130 degrees) so that the display (eg, Figure 4 The display 410) is exposed in the form. Again referring to Figure 4 , the intermediate form may indicate that the angle (eg, angle B) formed by the first surface of the first shell 401 and the third surface of the second shell 402 forms a specified angle range (eg, 80 to 130 degrees).

[0100] According to one embodiment, when the electronic device is identified as being in a bent state, the processor 220 of the electronic device may provide a user interface according to the bending mode through the display. Figure 7 , the bending modes can include bending patterns based on the folding axis (e.g. Figure 4 The function of separating the upper screen 711 and the lower screen 712 in the bending state identification symbol 701 drawn by the A axis of the electronic device is to provide an application screen on the upper screen 711, and provide a control screen for the application provided on the upper screen 711 on the lower screen 712. For example, among the applications running on the electronic device, the application that supports the bending mode according to the application attribute information can provide the bending mode by separating the upper screen and the lower screen when the electronic device is switched to the bending state, as illustrated by the drawn identification symbol 701. For example, among the applications running on the electronic device, the application that does not support the bending mode according to the application attribute information can provide the application running screen through the entire screen even in the bending state, as shown by the drawn identification symbol 702.

[0101] Figure 8 is a diagram illustrating multi-window control of an electronic device in a bent state according to various embodiments.

[0102] According to one embodiment, an electronic device (e.g., Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the figure may identify whether the state of the electronic device is a bent state based on a sensor value of a sensor module (eg, the sensor module 240 in the figure).

[0103] According to one embodiment, when the electronic device is identified as being in a bent state, the processor 220 of the electronic device may provide a user interface function according to the bent state. For example, when the electronic device is providing multiple windows and recognizes that it has switched to a bent state based on the sensor value of the sensor module, a user interface function according to the bent state may be provided through the screen 802 or the screen 804 in the bent state.

[0104] According to one embodiment, when the electronic device is in the expanded state, the multi-window screen 801 may display two windows 812 and 813 at the top of the display of the electronic device, and may display a single window 811 at the bottom. According to one embodiment, the electronic device may provide control menus (e.g., multi-window handlers) 815, 817, and 819 for each of the bottom window 811 and the two top windows 812 and 813 of the multi-window screen 801 and / or 802, and these menus include objects for separately controlling each window through the corresponding windows 811, 812, and 813. For example, the window 812 may perform various control functions, including the ability to switch between running applications in the window 812 through the control menu 817 provided for the window 812.

[0105] According to one embodiment, when the electronic device is in the unfolded state, the multi-window screen 803 may separately display one window 821 at the bottom of the display of the electronic device and one window 822 at the top.

[0106] According to one embodiment, the electronic device may provide a control menu (e.g., a multi-window handler) 825 and 827 including objects for separately controlling each window through the corresponding windows 821 and 822, for each of the bottom window 821 and the top window 822 of the multi-window screen 803 and / or 804. For example, the window 822 may perform various control functions, including the ability to switch between running applications in the corresponding window 822 through the control menu 827 provided for the corresponding window 822.

[0107] Figures 9a to 9c is a diagram illustrating multi-window control of an electronic device in a bent state according to various embodiments.

[0108] Reference Figure 9a , electronic devices (e.g. Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the embodiment may be configured to display the display (e.g., Figure 2 The display 210 or Figure 4 The entire screen of the display 410 in FIG. 4 is divided into a plurality of sub-screens and a multi-window of separate information is provided through each sub-screen. For example, the screen 901 of the display may provide a multi-window consisting of three sub-screens. For example, the display may display a multi-window divided into three, namely, window 911, window 912, and window 913.

[0109] According to one embodiment, the processor 220 may control display of the window according to a touch event corresponding to one window among the multiple windows.

[0110] According to one embodiment, the processor 220 may provide a menu including an object for controlling an application displayed in the corresponding window in response to a touch event corresponding to one of the plurality of windows.

[0111] In one embodiment, the touch event corresponding to any one of the plurality of windows may include one or more touch inputs to the corresponding window, one or more touch inputs to a menu for controlling the corresponding window, or a combination thereof.

[0112] According to one embodiment, the processor 220 of the electronic device may be based on a sensor module (eg, Figure 2 The sensor module 240) uses a sensor value to identify whether the state of the electronic device is a bent state.

[0113] According to one embodiment, when the state of the electronic device (e.g., the shape of the display and / or the posture of the electronic device) is recognized as a bent state, the processor 220 of the electronic device can provide a user interface function according to the bent state. For example, when the electronic device is providing multiple windows and recognizes that it has switched to a bent state based on the sensor value of the sensor module, a user interface function according to the bent state can be provided through the screen 902 in the bent state.

[0114] According to one embodiment, when the electronic device is recognized as being in a bent state, the multi-window screen 902 provided through the display in the bent state may provide a menu (e.g., objects 921, 922, and 923 including respective window selection icons) for individually controlling each single window of each of the lower window (first window 911) and the two upper windows (second window 912 and third window 913) folded in the middle form. For example, when the electronic device is recognized as being in a bent state, objects 921, 922, and 923 including a plurality of respective window selection icons may be provided for individually selecting and / or controlling each of the plurality of windows in a designated area of ​​the display in the bent state.

[0115] The respective window selection icons 921, 922, and 923 of each of the three sub-windows 911, 912, and 913 provided by division according to the multi-window function may be provided through a designated display area, for example, an area at the bottom of the display, for example, at least one area (for example, the task bar 915) overlapping with the sub-window 911 displayed at the bottom of the display. For example, by selecting an object 922 including a respective window selection icon for selecting the second window 912 in a control menu provided through at least one area overlapping with the first window 911 displayed at the bottom of the display, a control function for the second window 912 may be provided. Objects 921, 922, and 923 including a respective window selection icon for selecting each of the three sub-windows 911, 912, and 913 provided in a division manner according to the multi-window function may be provided through another area at the bottom of the display, for example, at least another area displayed at the bottom of the display that does not overlap with the sub-window 911. The task bar 915 may be provided in an expanded state or in a bent state.

[0116] According to one embodiment, when another window (e.g., the second window 912) is selected by respective window selection icons 922 provided in a specific area of ​​the display (e.g., the area at the bottom of the display) for multiple windows of the multi-window screen 902, a control function for controlling the other window (e.g., the second window 912) may be executed.

[0117] According to one embodiment, in order to execute a control function for another window (e.g., the second window 912) among the multiple windows of the multi-window screen 902, the other window (e.g., the second window 912) can be selected through an object 922, and the object 922 includes respective window selection icons provided through a designated area, for example, an area other than the second window 912 (e.g., the area 915 at the bottom of the display).

[0118] In one embodiment, the processor 220 of the electronic device may display a control menu (eg, a multi-window handler) 927 for the selected window 912 in an area other than the selected window 912 (eg, an area at the bottom of the display) in response to selection of the selection icon 922 .

[0119] For example, the control menu 927 may include an application switching object 927-1. The application switching object 927-1 may be a visual object for switching an execution screen of an application provided through the selected window 912 to an execution screen of another application.

[0120] When the application switching object 927-1 is selected after the second window 912 is selected by selecting the icon 922, as shown in FIG. Figure 9a As shown in the multi-window screen 903, a list of various applications that can be switched from the running screen of the selected second window 912 can be provided through the screen 937, for example, in a floating or pop-up manner.

[0121] Reference Figure 9b In addition to selection icons 941, 942, and 943 for selecting one of the multiple windows by providing an area at the bottom of the display screen where a control menu is located (e.g., task bar 915), the multi-window screen 905 may also provide an application switching object 947. The task bar 915 may provide application icons 946 fixedly set in a favorite form, recently run application icons 948, and / or a navigation bar 949.

[0122] Figure 9b The task bar 915 is provided in one area of ​​the display screen, and is different from, for example, an edge operation menu provided by a touch input to a specific area (eg, an edge area) of the display screen. Fig.9c The edge operation menu 963, 964, or 965 may be displayed in response to a touch input to an edge region of the display screen (e.g., a slide 962 after a touch 961 to the edge region). The edge operation menu 963, 964, or 965 may provide a specified number of objects, such as a specified number of application lists, and may be displayed by a touch input to the left or right edge of the display screen.

[0123] exist Figure 9b In the multi-window screen 905, when the second window 912 is selected by selecting the icon 942 and then the application switching object 947 is selected, a list of various applications that can be switched from the running screen of the selected second window 912 can be provided through the screen 937 located on the bottom surface, for example, in a pop-up manner, such as Figure 9a As shown in the multi-window screen 903.

[0124] exist Figure 9aIn the multi-window screen 903, a specific application 939 can be selected through a screen 937 providing a list of various applications. The previous application displayed in the selected second window 912 can be switched to the newly selected specific application 939, and the running screen 942 of the specific application 939 can be displayed through the second window 912 as shown in the multi-window screen 904. Fig.10 is a diagram illustrating multi-window control of an electronic device in a bent state according to various embodiments.

[0125] According to one embodiment, an electronic device (e.g., Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the multi-window screen 1002 can individually control each window (e.g., the first window 911, the second window 912, and the third window 913) of the multi-window screen 1002 through each of the control menus (e.g., top menus 931, 932, and 933) provided for each window.

[0126] According to one embodiment, control functions including selecting and controlling a specific window 911 and other windows (eg, a second window 912 or a third window 913 ) may be performed through a control menu (eg, a bottom taskbar menu 915 ) provided by any area of ​​the multi-window screen 1002 .

[0127] Reference Fig.10 , control functions of a specific window 911 and another window (e.g., the second window 912 or the third window 913) can be performed through a control menu provided by a specific position on the screen (e.g., the bottom screen located at the bottom when the display is bent) among the multiple windows of the multi-window screen 1002, or an area overlapping or not overlapping with the specific window (e.g., the first window 911).

[0128] According to one embodiment, the multi-window screen 1002 may provide a control menu for controlling each individual window (eg, the first window 911 , the second window 912 , or the third window 913 ) through an area overlapping or not overlapping with a specific window (eg, the first window 911 ).

[0129] According to one embodiment, when the electronic device is identified as being in a bent state, the multi-window screen 1001 provided by the display in the bent state may provide respective window selection icons 921, 922, and 923 for individually selecting respective windows for each of the lower window (first window 911) and the two upper windows (second window 912 and third window 913) folded in an intermediate state through an area at the bottom of the display (e.g., a taskbar 915).

[0130] According to one embodiment, when a selection menu 921 of a lower window (first window 911) is selected, for example, by touch input, from respective window selection menus (e.g., an object including icons) provided through a control menu (e.g., a task bar 915) at the bottom of the display in the multi-window screen 1002 in a bent state, the lower window (first window 911) may provide a control menu 927 for controlling the lower window (first window 911) through an area overlapping or non-overlapping with the lower window (first window 911) of the display.

[0131] When the lower window 911 is selected through the window selection menu 921, the control menu 927 provided through the lower window 911 may provide a function for controlling the lower window 911. For example, when the lower window 911 is selected through the window selection menu 921, the control menu 927 provided through the lower window may include an application switching object 927-1 for executing a function for switching an application running in the lower window 911.

[0132] According to one embodiment, when the lower window 911 is selected through the window selection menu 921, the selected lower window 911 may be activated (focused) and displayed to be distinguished from other windows by color, image effects and / or text to indicate that the window 911 is selected.

[0133] When a touch event to one window (e.g., 912) in the multi-window 1002 or a touch input to a respective window selection icon 922 on the taskbar for selecting the corresponding window is detected, the window to be activated may be changed. Thus, the focus moves so that the newly selected window 912 is activated (focused), and the selected window 912 may be displayed to be distinguished from other windows by color, image effects, and / or text, as shown in the multi-window screen 1003, thereby indicating that the window 912 is selected. According to one embodiment, when the window selection menu 922 for the upper left window (second window 912) is selected from the window selection menu provided by the lower window (first window 911) in the multi-window screen 1003 in a bent state, for example, by a touch input, the lower window (first window 911) may provide a control menu 927 for controlling the upper left window (second window 912) through an area overlapping with the lower window (first window 911) or other areas that do not overlap, for example, in a floating or pop-up form. When the upper left window 912 is selected through the window selection menu 922, the control menu 927 provided through the lower window may provide a function for controlling the upper left window 912. For example, when the upper left window 912 is selected through the window selection menu 922, the control menu 927 provided through the lower window 911 may include an application switching object 927-1 for executing a function of switching an application running in the upper left window 912.

[0134] When a window selection menu 923 for an upper right window (third window 913) is selected, for example, by a touch input from a window selection menu provided through a lower window (first window 911) in the multi-window screen 1004 in a bent state, the lower window (first window 911) may provide a control menu 927 for controlling the upper right window (third window 913) through the lower window (first window 911). When the upper right window 913 is selected through the window selection menu 923, the control menu 927 provided through the lower window 911 may provide a function for controlling the upper right window 913. For example, when the upper right window 913 is selected through the window selection menu 923, the control menu 927 provided through the lower window 911 may include an application switching object 927-1 for executing a function of switching an application running in the upper right window 913.

[0135] Reference again Figure 9a , when the respective window selection icons 922 for selecting the upper left (a) window (second window 912) are selected and the upper left (a) window 912 is selected, when an application switching object 927-1 is selected in a control menu 927 for the upper left (a) window 912 provided through an area overlapping with the lower (b) window 911, a screen 937 including selectable objects representing selectable applications may be provided.

[0136] According to one embodiment, when the processor 220 detects an input from a user as a touch event for selecting a window 912 by touching at least one area of ​​the window 912 or by selecting a selection menu 922 provided by another window 911 on the multi-window screen 902, the processor 220 may provide a control menu 927 for the selected window 912 on the display in a floating or pop-up form. The processor 220 may detect a user input for selecting one of the control menus 927 for the selected window 912 (e.g., the application switching object 927-1).

[0137] According to one embodiment, the processor 220 may control the display to display a window 937 including selectable objects (eg, icons or folders) for running various applications for application switching through a touch event, for example, in a pop-up form, on the multi-window screen 903 .

[0138] According to one embodiment, when a selection menu 922 for selecting the second window 912 is input, for example, by touch, and an application switching function for the second window 912 is selected, a window 937 including a selectable object for selecting an application that can be executed through the second window 912 may be provided on the multi-window screen 903 of the display. The window 937 including the selectable object for selecting an application may be displayed, for example, in a pop-up form, on an upper layer of the multi-window screen 903. The window 937 including the selectable object for selecting an application may be provided, for example, through a specific window (for example, the first window 911) among the multiple windows. The window 937 including the selectable object for selecting an application may be displayed, for example, in a pop-up form, on an upper layer of a specific window (for example, the first window 911) among the multiple windows.

[0139] The window 937 including optional objects for running various applications may include optional objects that are the same or similar to the main screen, and may include a screen with the same or similar arrangement structure. For example, the optional objects displayed on the window 937 may be provided as optional objects that are the same or similar to the main screen constructed by the user, and have the same or similar arrangement structure.

[0140] According to one embodiment, the processor 220 may detect that one object 939 (eg, D application icon) among selectable objects (eg, icons) for executing various applications is selected through various touch methods such as touch input or drag and drop.

[0141] According to one embodiment, referring to the multi-window screen 904, an application (e.g., D application) corresponding to the selected object 939 may be executed, and the executed application screen 942 may be displayed on the selected window 912. Thus, the application displayed on the window 912 may be switched or changed to another application.

[0142] Fig.11 is a diagram illustrating a popup window including a selectable object for executing an application of an electronic device according to various embodiments.

[0143] Reference Fig.11 , electronic devices (e.g. Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the figure may be configured to make the display (eg, the display 210 or the display 210 in the figure) Figure 4 The entire screen of the display 410 in the image processing apparatus is divided into a plurality of sub-screens and multiple windows of separate information are provided through each sub-screen.

[0144] According to one embodiment, the processor 220 may provide a menu for controlling an application displayed in a corresponding window according to a touch event corresponding to one of the plurality of windows.

[0145] In one embodiment, the touch event corresponding to any one of the plurality of windows may include one or more touch inputs to the corresponding window, one or more touch inputs to a menu for controlling the corresponding window, or a combination thereof.

[0146] According to one embodiment, in response to a touch event, when an application switching function is selected by a touch event of a window corresponding to one of the multiple windows on the multi-window screen 1101 displayed on the display of the electronic device in the expanded state, the processor 220 may enable a window 1117 including an optional object (e.g., icon) 1119 for application selection for running various applications to be displayed on the multi-window screen 1101. For example, the window 1117 including the optional objects for running various applications may be displayed in an upper layer of the multi-window screen 1101, for example, in a pop-up form. For example, the optional objects displayed on the window 1117 may be the same or similar optional objects as the main screen constructed by the user, and may have the same or similar configuration structure. For example, the optional objects displayed on the window 1117 may be the same or similar optional objects as the main screen constructed by the user, and may provide the same or similar arrangement structure.

[0147] According to one embodiment, in response to a touch event, when an application switching function is selected by a touch event corresponding to one of the multiple sub-windows 1111, 1112, and 1113 of the multi-window screen 1102 displayed on the display of the electronic device in a bent state, a window 1127 including an optional object 1129 for selecting an application that can be run through the window 1113 may be provided on the display. The window 1127 including the optional object for selecting an application may be displayed through one of the windows (e.g., the lower window 1111) in the multi-window screen. For example, the window 1127 including the optional object for selecting an application may be displayed in an upper layer of the lower window 1111 in a pop-up form.

[0148] The window 1127 including optional objects for running various applications may include optional objects that are the same or similar to the main screen, and may include a screen having the same or similar configuration structure. For example, the optional objects displayed on the window 1127 may be optional objects that are the same or similar to the main screen constructed by the user, and may have the same or similar configuration structure.

[0149] Fig.12 is a diagram illustrating multi-window control of an electronic device according to various embodiments.

[0150] Reference Fig.12 , electronic devices (e.g. Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the figure may be configured to display a display (eg, the display 210 or Figure 4 The entire screen of the display 410 in FIG. 1201 is divided into a plurality of sub-screens and a multi-window of separate information is provided through each sub-screen. For example, the display screen 1201 may provide a multi-window consisting of three sub-screens. For example, the display may display a multi-window divided into three, namely, window 1211, window 1212, and window 1213.

[0151] According to one embodiment, the processor 220 may control the display of one window (e.g., window 1211) in the multi-window according to a touch event corresponding to the corresponding window. For example, the processor 220 may display a control menu (e.g., a multi-window processor) 1215 for controlling the window 1211 according to a touch event corresponding to the window 1211.

[0152] According to one embodiment, the processor 220 may provide a menu for selecting an application to be displayed in a window (eg, window 1211 ) based on a touch event corresponding to one of the plurality of windows.

[0153] According to one embodiment, the processor 220 may change an application (A) previously displayed on the window 1211 to another selected application (D) through a menu for selecting an application displayed on the window (e.g., window 1211) based on a touch event corresponding to one window (e.g., window 1211) on the multi-window screen 1201.

[0154] According to one embodiment, when another application (D) is selected according to the application switching function for the corresponding window 1211, the processor 220 may identify attribute information of the other application (D). For example, the application attribute information may include various application-related information, such as the type of the corresponding application (e.g., a messenger application, a video application, or an Internet application), a package name, an operating state (e.g., paused or resumed), or application screen configuration information (e.g., aspect ratio or screen size).

[0155] According to one embodiment, the processor 220 may identify application-related information of another application (D) switched in the window 1211 displaying the running screen of the application (A), such as screen configuration information, and may modify the size of the window 1221 displaying the running screen of the other application software (D) according to the identified screen configuration information, such as the horizontal or vertical screen ratio, and display it. According to the application switching of the window 1211, the window 1211 in the multi-window screen 1202 may be changed to a window 1221 having a different screen ratio (e.g., the screen ratio of the D application) displaying the running screen of the other application (D), and the existing other windows 1212 and 1213 may also be changed to windows 1222 and 1223 having different screen ratios.

[0156] According to one embodiment, screen configuration information (e.g., screen ratio and / or size) may be information previously stored as application attribute information. For example, in the case of a video application, if it is produced in an aspect ratio of 21:9 and the screen configuration is not supported according to this, the screen may be configured to a 16:9 ratio with black borders (black screen), or the vertical length may be reduced while maintaining the number of pixels, which may result in a resolution mismatch. For example, a game may be configured to an aspect ratio of 16:9, and if the screen configuration is not supported, black frames may be added to both sides of the screen as filler frames (black borders) on a 21:9 screen, which may result in a resolution mismatch with the aspect ratio, or may hinder the effective use of the display screen.

[0157] According to one embodiment, the processor 220 may display a control menu (e.g., a multi-window handler) 1235 according to a touch event corresponding to one window (e.g., window 1231) in the multi-window screen 1203, the control menu including a menu for selecting an application to be run in the window (e.g., window 1231). Through the menu for selecting an application included in the control menu 1235, an application (A) previously displayed in the window 1231 may be changed to another selected application (D).

[0158] According to one embodiment, when another application (D) is selected according to the application switching function of the corresponding window 1231, the processor 220 may identify attribute information of the other application. For example, the application attribute information may include various application-related information, such as the type of the corresponding application (e.g., messenger application, video application, Internet application), package name, running state (pause, resume), or application screen configuration information (e.g., aspect ratio, screen size).

[0159] According to one embodiment, the processor 220 may identify application-related information of another application (D) switched in the window 1231 displaying the application (A), such as screen configuration information, and may modify and display the size of the window 1241 displaying the other application (D), such as the horizontal or vertical screen ratio, according to the identified screen configuration information. When identifying the size of the window 1241 displaying the other application (D), such as the horizontal or vertical size or ratio, the processor 220 may consider the size of the area 1231 occupied by the target application (A) in the multi-window screen 1203, such as the horizontal or vertical length and ratio. For example, when the horizontal length of the area 1231 occupied by the application (A) is identified, the vertical length of the window 1241 displaying the switched other application (D) may be adjusted to modify the screen ratio, such as in the multi-window screen 1204. In contrast, when the vertical length of the area 1211 occupied by the application (A) is identified, as in the multi-window screen 1201 , the horizontal length of a window 1221 displaying another application (D) switched may be adjusted to modify the aspect ratio, as in the multi-window screen 1202 .

[0160] According to application switching of window 1231 , window 1231 displaying application (A) in multi-window screen 1203 may change to a screen ratio displaying another application (D) in window 1241 , and thus, other windows 1232 and 1233 may also change to windows 1242 and 1243 of different screen ratios.

[0161] According to one embodiment, the screen configuration information may be stored in a memory (eg, Figure 2 The memory 230 of the operating system is used as screen configuration information including the screen ratio and / or size according to the previous operation history. For example, when there is information according to the previous operation history, the screen configuration information may be applied first, and when the screen configuration information is configured as application attribute information, the information may be applied second, but the present disclosure is not limited thereto, and the priority may be changed and applied.

[0162] According to one embodiment, when the processor 220 cannot identify application-related information (such as screen configuration information) of another application (D) switched from the window 1211 displaying the application (A), the processor 220 may configure and / or display the multi-window according to a default configuration or a previously configured multi-window screen boundary line.

[0163] According to various embodiments, electronic devices (eg, Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The electronic device 400 may include a housing (eg, Figure 4 housing 401 and / or 402), a display installed in the housing ( Figure 2 Display 210), sensor module ( Figure 2 sensor module 240), and a processor ( Figure 2 A processor 220 is provided, the processor being operatively connected to the display and the sensor module, wherein the processor displays a multi-window including a plurality of windows by dividing the display screen, identifies the state of the electronic device based on the sensor value of the sensor module, identifies an object for selecting one of the plurality of windows in a designated area of ​​the display screen based on the state of the electronic device, identifies whether a first window in the plurality of windows is selected by an object displayed in the designated area, identifies whether the first window is selected and whether an application switching function is selected, and runs at least one application if the application switching function is selected. A second window including selectable objects may be provided on the display, and an application corresponding to the selected specific object may be run in response to a specific object displayed in the second window, and an application running screen may be displayed on the selected first window.

[0164] According to various embodiments, the object displayed in the designated area may be configured to include a plurality of icons corresponding to each of the plurality of windows.

[0165] According to various embodiments, the processor may be configured to, when recognizing that the first window is selected, change at least one of a color, an image effect, and a text of the first window to display it so as to be distinguished from other windows.

[0166] According to various embodiments, the processor may be configured to provide the second window in a floating form or a pop-up form on the multi-window.

[0167] According to various embodiments, the designated area may be configured to include a lower edge area of ​​the display.

[0168] According to various embodiments, the processor may be configured to provide a control menu including an object for selecting an application switching function through a designated area.

[0169] According to various embodiments, the shell may include a first shell and a second shell rotatable relative to the first shell, the display may include a first area corresponding to the first shell and a second area corresponding to the second shell, and the processor may be configured to, when the state of the electronic device is identified based on the sensor value of the sensor module as the first shell being substantially horizontal to the ground surface, the second shell being folded at an angle within a specified range relative to the first shell, and the first window being identified as being displayed in the second area, provide an object for selecting the first window through an area overlapping with a third window displayed in the first area.

[0170] According to various embodiments, the processor may be configured to, when the first window is selected through the object displayed in the designated area, provide a control menu including an object for selecting an application switching function through an area overlapping with the third window.

[0171] According to various embodiments, the processor may be configured to provide the second window in a floating form or a pop-up form through an area overlapped with the third window when the object for selecting the application switching function is selected.

[0172] According to various embodiments, the processor may be configured to identify information related to an application corresponding to a specific object, and adjust a screen ratio of a first window displaying an application execution screen based on the information.

[0173] Fig.13 is a flowchart illustrating a multi-window control operation of an electronic device according to various embodiments.

[0174] refer to Fig.13 In operation 1301, an electronic device (eg, Figure 2 Electronic equipment 200, Figure 3 Electronic equipment 300 or Figure 4 The processor of the electronic device 400 (eg, Figure 2 The processor 220 in the embodiment may be configured to display the display (e.g., Figure 2 The display 210 or Figure 4 The multi-window screen may include, for example, a plurality of windows divided into two or more windows.

[0175] According to one embodiment, in operation 1302, the processor 220 may generate a signal based on a signal from a sensor module (eg, Figure 2 The state of the electronic device is identified by using the sensor value received by the sensor module 240 of the display screen, and based on the identified state of the electronic device, an object for selecting one of the multiple windows is displayed on a designated area of ​​the display screen. For example, if the state of the electronic device is a bent state, the object for selecting one of the multiple windows may be displayed at the bottom of the screen located on the bottom surface.

[0176] According to one embodiment, in operation 1303, the processor 220 may identify which window among the multiple windows is selected. For example, one of the multiple windows may be selected according to a touch event of a designated window. The processor 220 may provide a control menu for controlling the selected window in response to the selection of one of the multiple windows. The touch event of the designated one of the multiple windows may include one or more touch inputs for the corresponding window, one or more touch outputs through a menu for controlling the corresponding window, or a combination thereof.

[0177] According to one embodiment, in operation 1305, the processor 220 may identify whether the application switching function is selected. For example, the application switching function may be selected through a control menu provided for controlling one of the selected windows among the plurality of windows. For example, the application switching function may be selected by selecting one of the control menus (e.g., Figure 6 The application switching function is selected by a touch event of the application switching object 627-1).

[0178] According to one embodiment, in operation 1307, the processor 220 may provide a window including selectable objects (e.g., icons) for running various applications for application switching on the display. The window including selectable objects for running various applications may be displayed, for example, in a pop-up form, on an upper layer on the multi-window screen. The window including selectable objects for running applications may be displayed, for example, in a pop-up form, on an upper layer of one window or another window in the multiple windows. The window including selectable objects for running various applications may include selectable objects that are the same or similar to the main screen, and may include a screen having the same or similar configuration structure.

[0179] In one embodiment, the processor 220 may identify whether one of the selectable objects for executing various applications is selected in operation 1309. The selectable object may be selected by various touch methods such as touch input or drag and drop.

[0180] According to one embodiment, in operation 1311, the processor 220 may run an application corresponding to the selected specific object and display the application running screen in the selected window. Thus, the information displayed in the selected window may be switched from the previous application running screen information to the newly selected application running screen information.

[0181] The embodiments disclosed in this document are presented as examples only to facilitate the explanation of the technical content and to help understanding, and are not intended to limit the scope of the technology disclosed in this document. Therefore, the scope of the technology disclosed in this document should be interpreted as including all modifications or variations based on the technical ideas of the various embodiments disclosed in this document in addition to the embodiments disclosed herein.

Claims

1. An electronic device, comprising: case; a display, the display being mounted in the housing; Sensor module; as well as a processor operably connected to the display and the sensor module, wherein The processor is configured to: displaying a multi-window including a plurality of windows by dividing a display screen; Based on the sensor value of the sensor module, identifying the state of the electronic device; Based on the state of the electronic device, displaying an object for selecting one of the plurality of windows on a designated area of ​​the display screen; identifying whether a first window among the plurality of windows is selected by the object displayed on the designated area; Identifying whether the first window is selected and whether an application switching function is selected; If the application switching function is selected, providing a second window including a selectable object for running at least one application on the display; In response to a selection of a specific object displayed on the second window, executing an application corresponding to the specific object; as well as The application running screen is displayed on the selected first window.

2. The electronic device according to claim 1, wherein: The object displayed in the designated area is configured to include a plurality of icons corresponding to each of the plurality of windows.

3. The electronic device according to claim 2, wherein: The processor is configured to, when recognizing that the first window is selected, change at least one of a color, an image effect, and a text of the first window to display it so as to be distinguished from other windows.

4. The electronic device according to claim 1, wherein: The processor is configured to provide the second window in a floating form or a pop-up form on the multi-window.

5. The electronic device according to claim 1, wherein: The designated area is configured to include a lower edge area of ​​the display.

6. The electronic device according to claim 1, wherein The processor is configured to provide a control menu including an object for selecting the application switching function through the designated area.

7. The electronic device according to claim 1, wherein The housing comprises a first housing and a second housing rotatable relative to the first housing; The display includes a first area corresponding to the first housing and a second area corresponding to the second housing; and The processor is configured to, when identifying based on the sensor value of the sensor module that the state of the electronic device is that the first shell is substantially horizontal with the ground surface, the second shell is folded at an angle within a specified range relative to the first shell, and identifying that the first window is displayed in the second area, provide an object for selecting the first window through an area overlapping with a third window displayed in the first area.

8. The electronic device according to claim 7, wherein: The processor is configured to, when the first window is selected through the object displayed in the designated area, provide a control menu including an object for selecting the application switching function through an area overlapped with the third window.

9. The electronic device according to claim 8, wherein: The processor is configured to, when the object for selecting the application switching function is selected, provide the second window in a floating form or a pop-up form through an area overlapped with the third window.

10. The electronic device according to claim 1, wherein: The processor is configured to identify information related to the application corresponding to the specific object, and adjust a screen ratio of the first window displaying the application execution screen based on the information.

11. A method of an electronic device, the method comprising: Displaying a multi-window including a plurality of windows by dividing a display screen of the electronic device; identifying a state of the electronic device based on a sensor value of a sensor module of the electronic device; Based on the state of the electronic device, displaying an object for selecting one of the plurality of windows in a designated area of ​​the display screen; identifying whether a first window among the plurality of windows is selected by the object displayed in the designated area; Identifying whether the first window is selected and whether an application switching function is selected; If the application switching function is selected, providing a second window including a selectable object for running at least one application on the display; In response to a selection of a specific object displayed in the second window, executing an application corresponding to the specific object; as well as The application running screen is displayed on the selected first window.

12. The method according to claim 11, wherein: The object displayed in the designated area includes a plurality of icons corresponding to each of the plurality of windows.

13. The method according to claim 12, further comprising, when it is recognized that the first window is selected, changing at least one of a color, an image effect, and a text of the first window to distinguish it from other windows.

14. The method according to claim 11, wherein: Providing the second window is providing the second window in a floating form or a pop-up form on the multi-window.

15. The method according to claim 11, wherein: The designated area includes a lower edge area of ​​the display.

Images