Electronic device and method for multi-window, and non-transitory computer-readable recording medium
The electronic device facilitates seamless switching from full-screen to reduced-screen modes by recognizing sustained touch inputs, addressing the inconvenience of current methods and maintaining application continuity.
Patent Information
- Application Number
- PCT/KR2025/006457
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-10-15
- Filing Date
- 2025-05-13
- Publication Date
- 2026-01-15
AI Technical Summary
Existing electronic devices require significant user input to switch from a full-screen mode to a reduced-screen mode, such as split-screen or pop-up screen, which is inconvenient for users.
An electronic device is designed to switch from a full-screen mode to a reduced-screen mode, such as a split-screen or pop-up screen, by recognizing a specific touch input maintained for a specified period, allowing for minimal user interaction and maintaining the application's activity in the foreground to ensure seamless transitions and continuous operation.
Enables convenient switching between full-screen and reduced-screen modes with minimal user input, ensuring continuous application operation and reducing the need for additional user interaction.
Smart Images

Figure KR2025006457_15012026_PF_FP_ABST
Abstract
Description
Electronic device, method, and non-transitory computer-readable recording medium for multi-window
[0001] The following descriptions relate to electronic devices, methods, and non-transitory computer-readable recording media for multi-windowing.
[0002] Electronic devices provide a multi-tasking function that executes two or more tasks, and a multi-window function that divides the display screen into two or more areas and displays the screens of two or more tasks (e.g., running screens of applications) simultaneously. The multi-window function may be a screen splitting function that divides the display area where visual information is displayed into multiple partitions and displays different screens in the multiple partitions.
[0003] An electronic device is disclosed. The electronic device may include a display, at least one processor including a processing circuit; and a memory storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a first screen of an application in a full-screen display area of the display through the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to receive, through the display, an input for displaying the first screen in a split view while the first screen is displayed in the full screen. The input may be an input directed toward the first screen on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a second screen of the application in a split area indicated by another input that is continuous from the input among a plurality of split areas within the display area of the display.
[0004] A method is disclosed. The method can be performed in an electronic device including a display. The method can include an operation of displaying a first screen of an application in full screen in a display area of the display through the display. The method can include an operation of receiving an input through the display for displaying the first screen according to a split view while the first screen is displayed in full screen. The input can be an input directed toward the first screen on the display. The method can include an operation of displaying a second screen of the application in a split area indicated by another input that is continuous from the input among a plurality of split areas within the display area of the display.
[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by at least one processor of an electronic device including a display, can cause the electronic device to display a first screen of an application in a full-screen manner in a display area of the display through the display. The instructions, when individually or collectively executed by the at least one processor, can cause the electronic device to receive, through the display, an input for displaying the first screen according to a split view while the first screen is displayed in the full-screen manner. The input can be an input directed toward the first screen on the display. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a second screen of the application in a partition area of the display area of the display in which another input consecutive from the input is indicated.
[0006] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.
[0007] FIG. 2 is a block diagram of an electronic device according to one embodiment.
[0008] FIG. 3A is a diagram illustrating a home screen displayed through a display according to one embodiment.
[0009] FIG. 3b is a drawing illustrating a screen of an application displayed through a display according to one embodiment.
[0010] FIG. 3c is a drawing illustrating a screen of an application displayed through a display according to one embodiment.
[0011] FIG. 3D is a diagram illustrating an activity stack for screens of an application, according to one embodiment.
[0012] FIG. 3e is a diagram illustrating layer depths for screens of an application according to one embodiment.
[0013] FIG. 4A is a diagram illustrating segmented areas within a display area of a display according to one embodiment.
[0014] FIG. 4b is a diagram illustrating segmented areas within a display area of a display according to one embodiment.
[0015] FIG. 5A is a diagram illustrating input to a screen of an application according to one embodiment.
[0016] FIG. 5b is a diagram illustrating a state in which an electronic device displays an image representing a screen of an application, according to one embodiment.
[0017] FIG. 5c is a drawing illustrating a state in which the display of the screen of an application is changed while the image is positioned in the right partition area according to the movement of the input, according to one embodiment.
[0018] FIG. 5d is a drawing illustrating a state in which the display of the screen of an application is changed while the image is positioned in the left partition area according to the movement of the input, according to one embodiment.
[0019] FIG. 5e is a diagram illustrating a state in which the display of the screen of an application is changed while the image is positioned in the lower partition area according to the movement of the input, according to one embodiment.
[0020] FIG. 5f is a drawing illustrating a state in which the display of the screen of an application is changed while the image is positioned in the upper partition area according to the movement of the input, according to one embodiment.
[0021] FIG. 5G is a diagram illustrating a state in which an electronic device simultaneously displays screens of an application in split areas according to one embodiment.
[0022] FIG. 5h is a diagram illustrating a state in which an electronic device displays the screen of an application on the screen of another application, according to one embodiment.
[0023] FIG. 6 is a diagram illustrating layer depths for screens of an application according to one embodiment.
[0024] FIG. 7A is a diagram illustrating a state in which an electronic device displays an image representing a screen of an application, according to one embodiment.
[0025] FIG. 7b is a diagram illustrating a state in which the display of the screen of an application is changed while the image is positioned in the upper partition area according to the movement of the input, according to one embodiment.
[0026] FIG. 7c is a diagram illustrating a state in which an electronic device simultaneously displays screens of an application in split areas according to one embodiment.
[0027] FIG. 7D is a diagram illustrating a state in which an electronic device displays the screen of an application on top of the screen of another application, according to one embodiment.
[0028] FIG. 8 is a diagram illustrating layer depths for screens of an application according to one embodiment.
[0029] FIG. 9A is a diagram illustrating a state in which an electronic device displays an image representing a screen of an application, according to one embodiment.
[0030] FIG. 9b is a drawing illustrating a state in which the display of the screen of an application has been changed according to one embodiment.
[0031] FIG. 9c is a diagram illustrating a state in which an electronic device displays a screen of an application according to one embodiment.
[0032] FIG. 9D is a diagram illustrating a state in which an electronic device displays the screen of an application on top of the screen of another application, according to one embodiment.
[0033] FIG. 10A is a diagram illustrating a state in which an electronic device receives an input requesting execution of an application, according to one embodiment.
[0034] FIG. 10b is a diagram illustrating a state in which an electronic device displays a screen of an application according to one embodiment.
[0035] FIG. 10c is a diagram illustrating input to a screen of an application according to one embodiment.
[0036] FIG. 10d is a drawing illustrating a state in which the display of the screen of an application is changed while the image is positioned in the upper partition area according to the movement of the input, according to one embodiment.
[0037] FIG. 11 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0038] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.
[0039] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0040] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0041] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0042] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).
[0043] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0044] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0045] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0046] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0047] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0048] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0049] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0050] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0051] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0052] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0053] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0054] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0055] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0056] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, a loss coverage (e.g., 664 dB or less) for realizing mMTC, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 6 ms or less for round trip) for realizing URLLC.
[0057] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0058] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0059] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0060] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0061] FIG. 2 is a block diagram of an electronic device according to an embodiment. FIG. 3a is a diagram illustrating a home screen displayed through a display according to an embodiment. FIG. 3b is a diagram illustrating a screen of an application displayed through a display according to an embodiment. FIG. 3c is a diagram illustrating a screen of an application displayed through a display according to an embodiment. FIG. 3d is a diagram illustrating an activity stack for screens of an application according to an embodiment. FIG. 3e is a diagram illustrating a layer depth for screens of an application according to an embodiment. FIG. 4a is a diagram illustrating segmented areas within a display area of a display according to an embodiment. FIG. 4b is a diagram illustrating segmented areas within a display area of a display according to an embodiment.
[0062] In one embodiment, referring to FIG. 2, the electronic device (101) may include a processor (120), a memory (130), and a display (260). In one embodiment, the processor (120) may correspond to the processor (120) of FIG. 1. In one embodiment, the memory (130) may correspond to the memory (130) of FIG. 1. In one embodiment, the display (260) may correspond to the display module (160) of FIG. 1.
[0063] In one embodiment, the processor (120) can display a screen through the display (260). In one embodiment, the processor (120) can display the screen of the application in full screen.
[0064] In one embodiment, displaying a screen in full screen may include displaying an application screen in a portion of the display area of the display (260). For example, the display area may include a system bar (or notification area), a navigation area, and a body area. For example, displaying a screen in full screen may include displaying an application screen in a body area of the display area of the display (260). For example, referring to FIG. 3A, the home screen (310) may include a system bar (or notification area) (301), a navigation area (303), and a body area (305). For example, displaying the home screen (310) in full screen may include displaying the home screen (310) in the body area (305) among the notification area (301), the navigation area (303), and the body area (305). However, the present invention is not limited thereto. For example, displaying a screen in full screen may include displaying an application screen as immersive content. For example, displaying a screen as immersive content may include displaying the screen in all display areas of the display (260), such as the notification area (301), the navigation area (303), and the body area (305).
[0065] In one embodiment, the processor (120) may display a home screen (310) through the display (260). For example, referring to FIG. 3D, the processor (120) may add an activity (361) of an application for the home screen (310) to the activity stack (341). For example, the processor (120) may add the activity (361) as a top-level activity to the activity stack (341) so that the application for the home screen (310) operates in the foreground (351).
[0066] In one embodiment, referring to FIG. 3e, the processor (120) may display the home screen (310) such that the home screen (310) has the highest depth. In one embodiment, the home screen (310) may have the highest depth within the layer depth (371).
[0067] In one embodiment, the processor (120) may receive input to execute an application while displaying a home screen (310) via the display (260).
[0068] In one embodiment, referring to FIG. 3B, the processor (120) may display a screen (320) of an application corresponding to the input on the home screen (310) based on receiving an input for executing an application. For example, the processor (120) may add an activity of the application corresponding to the input as a top-level activity to the activity stack. For example, referring to FIG. 3D, the processor (120) may add an activity (363) of the application corresponding to the input on the activity stack (343) above an activity (361) of the application for the home screen (310). For example, the processor (120) may add an activity (363) of the application corresponding to the input as a top-level activity to the activity stack (343) so that the application corresponding to the input operates in the foreground (351) and the application for the home screen (310) operates in the background (355).
[0069] In one embodiment, the processor (120) may display the screen (320) of the application on the home screen (310) such that the depth of the screen (320) of the application corresponding to the input is higher than the depth of the home screen (310). In one embodiment, referring to FIG. 3B, the electronic device (101) may display the screen (320) of the browser application on the home screen (310), so that the home screen (310) may not be visible to the user. In one embodiment, the screen (320) may include a content area (321) and a control area (325).
[0070] In one embodiment, referring to FIG. 3e, the processor (120) may display the screen (320) such that the screen (320) has the highest depth. In one embodiment, the screen (320) may have a higher depth than the home screen (310) within the layer depth (373).
[0071] In one embodiment, the processor (120) may receive input to execute a content playback application (e.g., a video playback application, a music playback application) while displaying a screen (320) through the display (260).
[0072] In one embodiment, referring to FIG. 3C, the processor (120) may display a screen (330) of an application corresponding to the input on the screen (320) based on receiving an input for executing an application. In one embodiment, the screen (330) may include an area where content (331) is displayed and / or an area where a visual object indicating a playback point of the content (e.g., a progress bar (335)) is displayed.
[0073] For example, the processor (120) may add an activity of an application corresponding to the input as a top-level activity to the activity stack. For example, referring to FIG. 3D, the processor (120) may add an activity (365) of an application corresponding to the input above an activity (363) in the activity stack (345). For example, the processor (120) may add an activity (363) of an application corresponding to the input as a top-level activity to the activity stack (345) so that the application corresponding to the input operates in the foreground (351) and applications for the screens (310, 320) operate in the background (355).
[0074] In one embodiment, the processor (120) may display the screen (330) of the application on the screen (320) such that the depth of the screen (330) of the application corresponding to the input is higher than the depth of the screen (320). In one embodiment, referring to FIG. 3c, the electronic device (101) may display the screen (330) of the content playback application on the screen (320), thereby making the screen (320) invisible to the user.
[0075] In one embodiment, referring to FIG. 3e, the processor (120) may display the screen (330) such that the screen (330) has the highest depth. In one embodiment, the screen (330) may have a higher depth than the screen (320) within the layer depth (375).
[0076] In one embodiment, the processor (120) can display two or more screens simultaneously in the display area of the display (260). In one embodiment, the processor (120) can display two or more screens simultaneously in each of two or more partition areas that divide the display area of the display (260). However, the present invention is not limited thereto. For example, the processor (120) can display two or more screens simultaneously by displaying the screen of an application on top of the screen of another application that is displayed in full screen in the display area of the display (260). For example, displaying the screen of an application on top of the screen of another application that is displayed in full screen may include displaying the screen of the application in a movable manner on top of the screen of another application that is displayed in full screen. For example, displaying the screen of an application on top of the screen of another application that is displayed in full screen may include displaying the screen of the application in a pop-up state on the screen of another application that is displayed in full screen. Hereinafter, a screen displayed in a partition area may be referred to as a split screen. Hereinafter, a screen displayed in a pop-up state may be referred to as a pop-up screen. Hereinafter, split screens and pop-up screens may be referred to as reduced screens. Depending on the embodiment, a pop-up screen may be referred to as a freeform screen, as its size can be adjusted based on user input. Depending on the embodiment, a pop-up screen may be referred to as a floating screen, as its display location can be moved on the screen of another application within the display area of the display (260) based on user input.
[0077] For example, referring to FIG. 4A, the processor (120) may simultaneously display two screens in each of the divided areas (411, 415) according to a divided view (410) that divides the display area of the display (260) into upper and lower parts. For example, referring to FIG. 4B, the processor (120) may simultaneously display two screens in each of the divided areas (421, 425) according to a divided view (420) that divides the display area of the display (260) into left and right parts. According to an embodiment, the processor (120) may simultaneously display three or more screens in each of the divided areas according to a divided view that divides the display area of the display (260) into three or more parts.
[0078] As described above, in electronic devices, in order to display a full-screen screen in a reduced-screen format (e.g., a split-screen or pop-up screen), the user must first access a screen that lists recently launched applications and then request the display of the reduced-screen version of the full-screen screen. This requires a significant amount of user input to switch from a full-screen screen to a reduced-screen version, which can be inconvenient for the user. Therefore, a method for switching from a full-screen screen to a reduced-screen version with minimal user input is needed. Specifically, in electronic devices, in order to display a full-screen screen in a split-view mode, the user must first access a screen that lists recently launched applications and then request the display of the full-screen screen in a split-screen format. This requires a significant amount of user input to switch from a full-screen screen to a split-screen version, which can be inconvenient for the user. Therefore, a method for switching from a full-screen screen to a split-screen version with minimal user input is needed.
[0079] Hereinafter, with reference to FIGS. 5A to 10D, an operation of an electronic device (101) switching a screen displayed in full screen to a reduced screen (e.g., a split screen or a pop-up screen) through a user's input may be described.
[0080] FIG. 5A is a diagram illustrating an input to a screen of an application according to an embodiment. FIG. 5B is a diagram illustrating a state in which an electronic device displays an image representing a screen of an application according to an embodiment. FIG. 5C is a diagram illustrating a state in which the display of an application screen changes while an image is positioned in a right-side partition area in response to movement of an input according to an embodiment. FIG. 5D is a diagram illustrating a state in which the display of an application screen changes while an image is positioned in a left-side partition area in response to movement of an input according to an embodiment. FIG. 5E is a diagram illustrating a state in which the display of an application screen changes while an image is positioned in a lower-side partition area in response to movement of an input according to an embodiment. FIG. 5F is a diagram illustrating a state in which the display of an application screen changes while an image is positioned in an upper-side partition area in response to movement of an input according to an embodiment. FIG. 5G is a diagram illustrating a state in which an electronic device simultaneously displays screens of an application in different partition areas according to an embodiment. FIG. 5h is a diagram illustrating a state in which an electronic device displays the screen of an application over the screen of another application, according to one embodiment. FIG. 6 is a diagram illustrating layer depths for screens of an application, according to one embodiment.
[0081] Figures 5a to 6 can be explained with reference to Figures 1 to 4b.
[0082] Referring to FIG. 5A, the electronic device (101) can receive a touch input (510) directed toward a screen (330) of an application displayed in full screen through the display (260). For example, the electronic device (101) can receive a touch input (510) directed toward a navigation area (303) in which the screen (330) of the application is displayed among the system bar (301), the navigation area (303), and the body area (305). For example, the electronic device (101) can receive a touch input (510) directed toward a designated area (e.g., a content area) among the screen (330) of the application displayed in full screen.
[0083] In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for a screen (330) that is displayed in full screen mode based on a touch input (510). In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) based on the touch input (510) being maintained for a specified period of time or longer. In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) based on the touch input (510) being maintained in a fixed (or substantially fixed) state for a specified period of time or longer. In one embodiment, the electronic device (101) can identify that a display in a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) is requested based on the touch input (510) being maintained in a fixed (or substantially fixed) state for a specified period of time. In one embodiment, the electronic device (101) can identify that a display in a split screen for the screen (330) is requested based on the touch input (510) being a specified type of input (e.g., a long-press input, a pressure input).
[0084] In one embodiment, the electronic device (101) may stop displaying the screen (330) based on a touch input (510) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may stop displaying the screen (330) based on identifying a request for the screen (330) to be displayed in full screen. In one embodiment, the electronic device (101) may stop displaying the screen (330) by setting the screen (330) to an invisible state based on the touch input (510). In one embodiment, stopping displaying the screen (330) may include hiding the screen (330). In one embodiment, stopping displaying the screen (330) may include adjusting the transparency (or opacity) of the screen (330) so that the screen (330) is not visible to the user. In one embodiment, stopping the display of the screen (330) may include making the screen (330) transparent so that the screen (320) located in the layer following the layer on which the screen (330) is displayed is displayed.
[0085] In one embodiment, the electronic device (101) can stop displaying the screen (330) by applying a graphic effect specified to the screen (330) (e.g., fade out, gradual size reduction, gradual alpha value increase).
[0086] In one embodiment, referring to FIG. 5B, when the display of the screen (330) is stopped, the screen (320) located in the next layer of the screen (330) may be displayed to the user. In one embodiment, when the display of the screen (330) is stopped, the electronic device (101) may not adjust the order of the activities (365) so that the activity (365) of the application related to the screen (330) is executed in the foreground (351). In one embodiment, when the display of the screen (330) is stopped, the electronic device (101) may maintain the activity (365) of the application related to the screen (330) as the top activity. In one embodiment, the electronic device (101) may maintain the application's activity (365) as the top-level activity to maintain the lifecycle of the application associated with the screen (330) (or to prevent a pause command (onPause()) and / or a stop command (onStop()) for the application from being issued).
[0087] For example, maintaining the application's activity (365) as the top-level activity may include maintaining the execution of the application. For example, if the application is a content playback application, maintaining the execution of the application may include maintaining the playback of the content being played without stopping. For example, by maintaining the activity (365) as the top-level activity, while playing video content, the electronic device (101) may maintain the playback of the video content. For example, while playing video content by maintaining the activity (365) as the top-level activity, as the display of the screen (330) is stopped, the display of the video through the display (260) is stopped, and an audio signal corresponding to the video may be output through an audio output module (e.g., 155 of FIG. 1).
[0088] In one embodiment, the electronic device (101) may generate an image (520) representing the screen (330) based on a touch input (510) maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may generate an image (520) representing the screen (330) based on an identification of a request for the screen (330) to be displayed in full screen. In one embodiment, the electronic device (101) may generate an image (520) to replace the screen (330) based on an identification of a request for the screen (330) to be displayed in full screen. In one embodiment, the electronic device (101) may generate an image (520) representing the screen (330) based on a cessation of displaying the screen (330). In one embodiment, the image (520) may be referred to as a drag image (or drag surface).
[0089] In one embodiment, the image (520) representing the screen (330) may be a reduced image from the screen (330). In one embodiment, the image (520) representing the screen (330) may be an image summarizing the screen (330). In one embodiment, the image (520) summarizing the screen (330) may be an image including some of the plurality of contents within the screen (330). In one embodiment, the image (520) summarizing the screen (330) may be an image including some of the UI (user interface) elements within the screen (330). In one embodiment, the image (520) representing the screen (330) may represent the contents within the screen (330). In one embodiment, the image (520) representing the screen (330) may be an image (or a portion of an image) captured from the screen (330) that includes content being played at the time (or within a specified time period from the time) when an input requesting display in a split screen is received. However, the present invention is not limited thereto. In one embodiment, the electronic device (101) may generate a visual object (e.g., an icon of the application) related to the application of the screen (330) based on the identification of a request for the screen (330) to be displayed in a full screen.
[0090] In one embodiment, the electronic device (101) may display an image (520) instead of the screen (330) based on a touch input (510) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may display the image (520) so as to have a depth higher than the depth of the screen (330) where the display is stopped (or, the highest depth). In one embodiment, the image (520) has a size that is displayed within a portion of the display area of the display (260), so that the screen (320) located in the next layer of the screen (330) may be visible to the user in an area other than the area occupied by the image (520). In one embodiment, the electronic device (101) may display the image (520) so that the image (520) appears to the user as a pop-up on the screen (320), having a depth higher than the depth of the screen (330) where the display is stopped (or, the topmost depth).
[0091] In one embodiment, the electronic device (101) can display the image (520) instead of the screen (330) by applying a graphic effect (e.g., fade in, gradual size enlargement) specified to the image (520).
[0092] In one embodiment, the electronic device (101) can identify the movement of the touch input (510). In one embodiment, the electronic device (101) can identify the movement of the touch input (510) while it is being maintained. In one embodiment, the electronic device (101) can identify the movement of the touch input (510) while the image (520) is displayed. In one embodiment, the electronic device (101) can identify the movement of the touch input (510) as a drag location event. In one embodiment, the electronic device (101) can identify the coordinates of the touch input (510) whenever the touch input (510) is moved based on the identification of the drag location event (ACTION_DRAG_LOCATION event). In one embodiment, the movement of the touch input (510) may be a drag input, but is not limited thereto.
[0093] In one embodiment, the electronic device (101) can move the image (520) based on the movement of the touch input (510). For example, the electronic device (101) can move the image (520) to correspond to the movement of the touch input (510). In one embodiment, the electronic device (101) can move the image (520) to a location corresponding to the identified coordinates based on the identification of a drag location event (ACTION_DRAG_LOCATION event).
[0094] In one embodiment, the electronic device (101) can identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) can identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) can identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510).
[0095] In one embodiment, the electronic device (101) can identify the split screen as the form in which the application is to be displayed based on whether the location of the image (520) is within the area for displaying the application in a split screen. In one embodiment, the electronic device (101) can identify the pop-up screen as the form in which the application is to be displayed based on whether the location of the image (520) is within the area for displaying the application in a pop-up screen.
[0096] In one embodiment, the electronic device (101) can identify one of the plurality of segmented areas (411, 415, 421, 425) based on the movement of the image (520) according to the movement of the touch input (510).
[0097] In one embodiment, the electronic device (101) can change the display of the identified split area based on the movement of the image (520). In one embodiment, the electronic device (101) can change the display of the identified split area so that the application guides the split area to be displayed as a split screen.
[0098] For example, referring to FIG. 5C, the electronic device (101) can identify a split area (425) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) to the right. For example, the electronic device (101) can identify a split area (425) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) to the right.
[0099] For example, the electronic device (101) can change the display of the identified segmented area (425) by moving the image (520) to the right. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the screen (320) located in the identified segmented area (425) by moving the image (520) to the right.
[0100] For example, as the image (520) is moved to the right, a portion (523) that is outside the display area of the display (260) may not be displayed through the display (260). For example, only a portion (521) that is not outside the display area of the display (260) may be displayed through the display (260).
[0101] For example, referring to FIG. 5D, the electronic device (101) can identify a split area (421) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) to the left. For example, the electronic device (101) can identify a split area (421) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) to the left.
[0102] For example, the electronic device (101) can change the display of the identified segmented area (421) by moving the image (520) to the left. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the screen (320) located in the identified segmented area (421) by moving the image (520) to the left.
[0103] For example, as the image (520) is moved to the left, a portion (525) that is outside the display area of the display (260) may not be displayed through the display (260). For example, only a portion (527) that is not outside the display area of the display (260) may be displayed through the display (260).
[0104] For example, referring to FIG. 5E, the electronic device (101) can identify the split area (415) among the plurality of split areas (411, 415, 421, 425) as the split area in which the application will be displayed as a split screen by moving the image (520) downward. For example, the electronic device (101) can identify the split area (415) among the plurality of split areas (411, 415, 421, 425) as the split area in which the application will be displayed as a split screen by moving the image (520) downward.
[0105] For example, the electronic device (101) can change the display of the identified segmented area (415) by moving the image (520) downward. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the screen (320) located in the identified segmented area (415) by moving the image (520) downward.
[0106] For example, as the image (520) is moved downward, a portion that is outside the display area of the display (260) may not be displayed through the display (260). For example, only a portion that is not outside the display area of the display (260) may be displayed through the display (260).
[0107] For example, referring to FIG. 5F, the electronic device (101) can identify a split area (411) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) upward. For example, the electronic device (101) can identify a split area (411) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) upward.
[0108] For example, the electronic device (101) can change the display of the identified segmented area (411) by moving the image (520) upward. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the screen (320) located in the identified segmented area (411) by moving the image (520) upward.
[0109] For example, as the image (520) is moved upward, a portion that is outside the display area of the display (260) may not be displayed through the display (260). For example, only a portion that is not outside the display area of the display (260) may be displayed through the display (260).
[0110] In one embodiment, the electronic device (101) may display a visual object (530) capable of stopping the display of the split screen at a designated location based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) may display a visual object (530) capable of stopping the display of the split screen at a lower portion of the display area of the display (260), referring to FIGS. 5C to 5F .
[0111] In one embodiment, the electronic device (101) may display the screen (330) of the application that was displayed before the touch input (510) in full screen again based on the touch input (510) being released over the visual object (530). For example, the electronic device (101) may not display the screen (330) of the application in split screen based on the touch input (510) being released over the visual object (530).
[0112] In one embodiment, referring to FIG. 5G, the electronic device (101) may display the screen (540) of the application in a split screen based on the release of the touch input (510) at a location other than the visual object (530). In one embodiment, the electronic device (101) may display the screen (540) of the application in a selected split area based on the release of the touch input (510).
[0113] In one embodiment, the electronic device (101) may adjust the activity (365) of the application displaying the screen (330) to have the lowest priority based on the release of the touch input (510). In one embodiment, the electronic device (101) may prevent the screen (330) from being displayed in full screen for a short period of time when the touch input (510) is released by adjusting the activity (365) of the application to have the lowest priority (e.g., executing the moveTaskToBack method). In one embodiment, the moveTaskToBack method may be a command for moving the activity to the background (355).
[0114] In one embodiment, the electronic device (101) may display the screen (540) as a split screen instead of the image (520) based on the release of the touch input (510). In one embodiment, the electronic device (101) may display the screen (540) as a split screen so that the screen (540) has the highest depth. In one embodiment, as the electronic device (101) displays the screen (540) as a split screen, the electronic device (101) may simultaneously display a screen (550) having the next depth of the screen (540) in another split area (415) that is not occupied by the screen (540).
[0115] In one embodiment, the screen (540) displayed in the partition area (411) may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (540) displayed in the partition area (411) may reflect the execution result of the application during the time between the time when the display of the screen (540) is initiated after the touch input (510) is received. For example, reflecting the execution result may include reflecting the screen of the application that has changed as the execution of the application is executed without being stopped while the display of the screen (330) is stopped. For example, reflecting the execution result may include reflecting the screen of the application that is running as the activity (365) is maintained as the top activity while the display of the screen (330) is stopped. For example, the content within the screen (540) may represent a video played during the time between the time the image (520) is generated and the time the touch input (510) is released. For example, the content within the screen (540) may be played for an amount of time longer than the content within the screen (330) between the time the image (520) is generated and the time the touch input (510) is released.
[0116] For example, the screen (540) displayed in the partition area (411) may be at least partially different from the screen (330) before the touch input (510). For example, the image frame indicated by the content (331) in the screen (330) before the touch input (510) is input may be different from the image frame indicated by the content (331) in the screen (540) after the touch input (510) is released. For example, the image frame indicated by the content (331) in the screen (540) may have a difference in image frames from the image frame indicated by the content (331) in the screen (330) by a specified amount of time (e.g., the time from when the touch input (510) is input until it is released). For example, the progress bar (335) in the screen (330) before the touch input (510) is input may be different from the progress bar (335) in the screen (540) after the touch input (510) is released. For example, the progress bar (335) in the screen (540) may indicate a difference of a specified time (e.g., the time from when the touch input (510) is input to when it is released) from the progress bar (335) in the screen (330).
[0117] According to an embodiment, the electronic device (101) may identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) may identify the form in which the application is to be displayed as a pop-up screen, not a split screen, based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) may identify the form in which the application is to be displayed as a pop-up screen, not a split screen, based on the fact that the image (520) is located in an area other than an area for displaying the application as a split screen (or an area for displaying the application as a pop-up screen).
[0118] In one embodiment, referring to FIG. 5h, the electronic device (101) may display the screen (560) of the application as a pop-up screen based on the release of the touch input (510) while the image (520) is positioned in the area for displaying the application as a pop-up screen. In one embodiment, the electronic device (101) may display the screen (560) of the application in a pop-up form based on the release of the touch input (510). For example, the electronic device (101) may display the screen (560) of the application on the screen (320) based on the release of the touch input (510) while the image (520) is positioned in the area for displaying the application as a pop-up screen.
[0119] In one embodiment, the screen (560) displayed as a pop-up screen may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (560) displayed as a pop-up screen may reflect the execution result of the application during the time between the time when the display of the screen (560) is initiated after the touch input (510) is received.
[0120] In one embodiment, based on additional user input (e.g., touch input and / or drag input) to the screen (560) displayed as a pop-up screen, the electronic device (101) can move the screen (560) over the screen (320).
[0121] FIG. 6 is a diagram illustrating layer depths for screens of an application according to one embodiment.
[0122] Figure 6 can be explained with reference to Figures 1 to 5g.
[0123] Referring to FIG. 6, the layer depth (610) may represent the layer depth before the touch input (510) is received. In one embodiment, the layer depth (610) may be displayed in the layer closest to the user in the order of screen (310), screen (320), and screen (330).
[0124] In one embodiment, the layer depth (630) may represent the layer depth while the image (520) is displayed after the touch input (510) is received. In one embodiment, the layer depth (630) may be displayed in a layer closer to the user in the following order: screen (310), screen (320), screen (330), and image (520).
[0125] In one embodiment, while the image (520) is displayed, the screen (330) may be adjusted to be transparent. Accordingly, the screen (320) may be visible to the user through an area not occupied by the image (520).
[0126] In one embodiment, the layer depth (650) may represent the layer depth while the screen (540) is displayed instead of the image (520) after the touch input (510) is released. In one embodiment, the layer depth (650) may be displayed in the layer closest to the user in the order of screen (310), screen (550), and screen (540). In one embodiment, screen (550) and screen (320) may be screens of the same application. In one embodiment, screen (550) may include a screen changed from screen (320).
[0127] In one embodiment, while the screen (540) is displayed, the transparency (or opacity) of the screen (540) may be the same as the transparency (or opacity) of the screen (330) before the touch input (510) is input. Accordingly, the screen of the next layer of the screen (540) may not be visible to the user through the area occupied by the non-transparent (or opaque) screen (540). In one embodiment, while the screen (540) is displayed in a split area, the screen (550) may be displayed in another split area.
[0128] FIG. 7A is a diagram illustrating a state in which an electronic device displays an image representing an application screen, according to an embodiment. FIG. 7B is a diagram illustrating a state in which the display of an application screen changes while an image is positioned in an upper split area according to movement of an input, according to an embodiment. FIG. 7C is a diagram illustrating a state in which an electronic device simultaneously displays application screens in split areas, according to an embodiment. FIG. 7D is a diagram illustrating a state in which an electronic device displays an application screen on top of a screen of another application, according to an embodiment.
[0129] FIGS. 7A to 7C may be described with reference to FIGS. 1 to 4B . Compared to FIGS. 5A to 5G , FIGS. 7A to 7C may illustrate a situation in which a screen (330) is displayed after a home screen (310). For example, FIGS. 7A to 7C may illustrate a situation in which a screen (320) is not included in the layer depth and an activity (363) is not included in the activity stack.
[0130] In one embodiment, the electronic device (101) may receive a touch input (510) directed toward a screen (330) of an application displayed in full screen through the display (260). For example, the electronic device (101) may receive a touch input (510) directed toward a designated area (e.g., a content area) of the screen (330) of the application displayed in full screen.
[0131] In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for a screen (330) that is displayed in full screen mode based on a touch input (510). In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) based on the touch input (510) being maintained for a specified period of time or longer. In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) based on the touch input (510) being maintained in a fixed (or substantially fixed) state for a specified period of time or longer.
[0132] In one embodiment, referring to FIG. 7A, the electronic device (101) may stop displaying the screen (330) based on a touch input (510) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may stop displaying the screen (330) by setting the screen (330) to an invisible state based on the touch input (510). In one embodiment, stopping displaying the screen (330) may include hiding the screen (330). In one embodiment, stopping displaying the screen (330) may include adjusting the transparency (or opacity) of the screen (330) so that the screen (330) is not visible to the user. In one embodiment, stopping the display of the screen (330) may include making the screen (330) transparent so that the home screen (310), which is located in the layer following the layer on which the screen (330) is displayed, is displayed.
[0133] In one embodiment, when the display of the screen (330) is stopped, the home screen (310) located in the next layer of the screen (330) may be displayed to the user. In one embodiment, when the display of the screen (330) is stopped, the electronic device (101) may not adjust the order of the activities (365) so that the activity (365) of the application related to the screen (330) is executed in the foreground (351). In one embodiment, when the display of the screen (330) is stopped, the electronic device (101) may maintain the activity (365) of the application related to the screen (330) as the top activity. For example, maintaining the activity (365) of the application as the top activity may include maintaining the execution of the application. For example, when the application is a content playback application, maintaining the execution of the application may include maintaining the playback of the content being played without stopping.
[0134] In one embodiment, the electronic device (101) may generate an image (520) representing the screen (330) based on a touch input (510) maintained for a specified period of time or longer. In one embodiment, the image (520) representing the screen (330) may be a reduced image from the screen (330). In one embodiment, the image (520) representing the screen (330) may be an image summarizing the screen (330).
[0135] In one embodiment, the electronic device (101) may display an image (520) instead of the screen (330) based on a touch input (510) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may display the image (520) so as to have a depth higher than the depth of the screen (330) where the display is stopped (or, the highest depth). In one embodiment, the image (520) has a size that is displayed within a portion of the display area of the display (260), so that the home screen (310) located in the next layer of the screen (330) may be visible to the user in an area other than the area occupied by the image (520).
[0136] In one embodiment, the electronic device (101) can identify the movement of the touch input (510). In one embodiment, the electronic device (101) can identify the movement of the touch input (510) that is being maintained. In one embodiment, the electronic device (101) can identify the movement of the touch input (510) while the image (520) is displayed. In one embodiment, the movement of the touch input (510) may be a drag input, but is not limited thereto.
[0137] In one embodiment, the electronic device (101) can move the image (520) based on the movement of the touch input (510). For example, the electronic device (101) can move the image (520) to correspond to the movement of the touch input (510).
[0138] In one embodiment, the electronic device (101) can identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) can identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) can identify the form in which the application is to be displayed based on the movement of the image (520) according to the movement of the touch input (510).
[0139] In one embodiment, the electronic device (101) can identify the split screen as the form in which the application is to be displayed based on whether the location of the image (520) is within the area for displaying the application in a split screen. In one embodiment, the electronic device (101) can identify the pop-up screen as the form in which the application is to be displayed based on whether the location of the image (520) is within the area for displaying the application in a pop-up screen.
[0140] In one embodiment, the electronic device (101) can identify one of the plurality of segmented areas (411, 415, 421, 425) based on the movement of the image (520) according to the movement of the touch input (510).
[0141] In one embodiment, the electronic device (101) can change the display of the identified split area based on the movement of the image (520). In one embodiment, the electronic device (101) can change the display of the identified split area so that the application guides the split area to be displayed as a split screen.
[0142] For example, referring to FIG. 7B, the electronic device (101) can identify a split area (411) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) upward. For example, the electronic device (101) can identify a split area (411) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (520) upward.
[0143] For example, the electronic device (101) can change the display of the identified segmented area (411) by moving the image (520) upward. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the home screen (310) located in the identified segmented area (411) by moving the image (520) upward.
[0144] In one embodiment, the electronic device (101) may display a visual object (530) capable of stopping the display of the split screen at a designated location based on the movement of the image (520) according to the movement of the touch input (510). For example, referring to FIG. 7B, the electronic device (101) may display a visual object (530) capable of stopping the display of the split screen at a lower portion of the display area of the display (260).
[0145] In one embodiment, the electronic device (101) may display the screen (330) of the application that was displayed before the touch input (510) in full screen again based on the touch input (510) being released over the visual object (530). For example, the electronic device (101) may not display the screen (330) of the application in split screen based on the touch input (510) being released over the visual object (530).
[0146] In one embodiment, referring to FIG. 7c, the electronic device (101) may display the screen (540) of the application in a split screen based on the release of the touch input (510) at a location other than the visual object (530). In one embodiment, the electronic device (101) may display the screen (540) of the application in a selected split area based on the release of the touch input (510).
[0147] In one embodiment, the electronic device (101) may display the screen (540) as a split screen instead of the image (520) based on the release of the touch input (510). In one embodiment, the electronic device (101) may display the screen (540) as a split screen so that the screen (540) has the highest depth. In one embodiment, the electronic device (101) may display a screen (710) for selecting one or more applications based on the screen having the next depth of the screen (540) being the home screen (310) in another split area (415) not occupied by the screen (540). In one embodiment, the screen (710) may display icons of multiple selectable applications. In one embodiment, the screen (710) may be referred to as an app selection screen.
[0148] In one embodiment, based on an input for selecting one of the icons of multiple applications included in the screen (710), the electronic device (101) can display the screen of the application corresponding to the selected icon in the split area (415).
[0149] In one embodiment, the screen (540) displayed in the partition area (411) may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (540) displayed in the partition area (411) may reflect the execution result of the application during the time between the time when the display of the screen (540) is initiated after the touch input (510) is received.
[0150] According to an embodiment, the electronic device (101) may identify a pop-up screen, not a split screen, as the form in which the application is to be displayed, based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) may identify a pop-up screen, not a split screen, as the form in which the application is to be displayed, based on the fact that the image (520) is located in an area other than an area for displaying the application in a split screen (or an area for displaying the application in a pop-up screen).
[0151] In one embodiment, referring to FIG. 7D, the electronic device (101) may display the screen (560) of the application as a pop-up screen based on the release of the touch input (510) while the image (520) is positioned in the area for displaying the application as a pop-up screen. In one embodiment, the electronic device (101) may display the screen (560) of the application in a pop-up form based on the release of the touch input (510). For example, the electronic device (101) may display the screen (560) of the application on the screen (310) based on the release of the touch input (510) while the image (520) is positioned in the area for displaying the application as a pop-up screen.
[0152] In one embodiment, the screen (560) displayed as a pop-up screen may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (560) displayed as a pop-up screen may reflect the execution result of the application during the time between the time when the display of the screen (560) is initiated after the touch input (510) is received.
[0153] In one embodiment, based on additional user input (e.g., touch input and / or drag input) to the screen (560) displayed as a pop-up screen, the electronic device (101) can move the screen (560) over the screen (310).
[0154] FIG. 8 is a diagram illustrating layer depths for screens of an application according to one embodiment.
[0155] Figure 8 can be explained with reference to Figures 1 to 5g.
[0156] Referring to FIG. 8, the layer depth (810) may represent the layer depth before the touch input (510) is received. In one embodiment, the layer depth (810) may be displayed in a layer closer to the user in the order of the home screen (310) and the screen (330).
[0157] In one embodiment, the layer depth (830) may represent the layer depth while the image (520) is displayed after the touch input (510) is received. In one embodiment, the layer depth (830) may be displayed in the layer closest to the user in the order of the home screen (310), the screen (330), and the image (520).
[0158] In one embodiment, while the image (520) is displayed, the screen (330) may be adjusted to be transparent. Accordingly, the home screen (310) may be visible to the user through the area not occupied by the image (520).
[0159] In one embodiment, the layer depth (850) may represent the layer depth while the screen (540) is displayed instead of the image (520) after the touch input (510) is released. In one embodiment, the layer depth (850) may be displayed in the layer closest to the user in the order of the screen (310), the screen (710), and the screen (540). In one embodiment, the screen (710) may be a screen displayed instead of the home screen (310).
[0160] In one embodiment, while the screen (540) is displayed, the transparency (or opacity) of the screen (540) may be the same as the transparency (or opacity) of the screen (330) before the touch input (510) is input. Accordingly, the screen of the next layer of the screen (540) may not be visible to the user through the area occupied by the non-transparent (or opaque) screen (540). In one embodiment, while the screen (540) is displayed in a split area, the screen (710) may be displayed in another split area.
[0161] FIG. 9A is a diagram illustrating a state in which an electronic device displays an image representing an application screen, according to one embodiment. FIG. 9B is a diagram illustrating a state in which the display of an application screen has been changed, according to one embodiment. FIG. 9C is a diagram illustrating a state in which an electronic device displays an application screen, according to one embodiment. FIG. 9D is a diagram illustrating a state in which an electronic device displays an application screen on top of another application screen, according to one embodiment.
[0162] FIGS. 9A to 9D may be described with reference to FIGS. 1 to 4B. FIGS. 9A to 9D may, compared to FIGS. 5A to 5G, illustrate a situation in which displaying the screen of an application corresponding to the screen (330) in a split screen is restricted.
[0163] In one embodiment, the electronic device (101) may receive a touch input (510) directed toward a screen (330) of an application displayed in full screen through the display (260). For example, the electronic device (101) may receive a touch input (510) directed toward a designated area (e.g., a content area) of the screen (330) of the application displayed in full screen.
[0164] In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for a screen (330) that is displayed in full screen mode based on a touch input (510). In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) based on the touch input (510) being maintained for a specified period of time or longer. In one embodiment, the electronic device (101) can identify that a request is made to display a reduced screen (e.g., a split screen or a pop-up screen) for the screen (330) based on the touch input (510) being maintained in a fixed (or substantially fixed) state for a specified period of time or longer.
[0165] In one embodiment, referring to FIG. 9A, the electronic device (101) may stop displaying the screen (330) based on a touch input (510) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may stop displaying the screen (330) by setting the screen (330) to an invisible state based on the touch input (510). In one embodiment, stopping displaying the screen (330) may include hiding the screen (330). In one embodiment, stopping displaying the screen (330) may include adjusting the transparency (or opacity) of the screen (330) so that the screen (330) is not visible to the user. In one embodiment, stopping the display of the screen (330) may include making the screen (330) transparent so that the screen (320) located in the layer following the layer on which the screen (330) is displayed is displayed.
[0166] In one embodiment, when the display of the screen (330) is stopped, the screen (320) located in the next layer of the screen (330) may be displayed to the user. In one embodiment, when the display of the screen (330) is stopped, the electronic device (101) may not adjust the order of the activities (365) so that the activity (365) of the application related to the screen (330) is executed in the foreground (351). In one embodiment, when the display of the screen (330) is stopped, the electronic device (101) may maintain the activity (365) of the application related to the screen (330) as the top activity. For example, maintaining the activity (365) of the application as the top activity may include maintaining the execution of the application. For example, when the application is a content playback application, maintaining the execution of the application may include maintaining the playback of the content being played without stopping.
[0167] In one embodiment, the electronic device (101) may generate an image (520) representing the screen (330) based on a touch input (510) maintained for a specified period of time or longer. In one embodiment, the image (520) representing the screen (330) may be a reduced image from the screen (330). In one embodiment, the image (520) representing the screen (330) may be an image summarizing the screen (330).
[0168] In one embodiment, the electronic device (101) may display an image (520) instead of the screen (330) based on a touch input (510) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may display the image (520) so as to have a depth higher than the depth of the screen (330) where the display is stopped (or, the highest depth). In one embodiment, the image (520) has a size that is displayed within a portion of the display area of the display (260), so that the screen (320) located in the next layer of the screen (330) may be visible to the user in an area other than the area occupied by the image (520).
[0169] In one embodiment, the electronic device (101) can identify the movement of the touch input (510). In one embodiment, the electronic device (101) can identify the movement of the touch input (510) that is being maintained. In one embodiment, the electronic device (101) can identify the movement of the touch input (510) while the image (520) is displayed. In one embodiment, the movement of the touch input (510) may be a drag input, but is not limited thereto.
[0170] In one embodiment, the electronic device (101) can move the image (520) based on the movement of the touch input (510). For example, the electronic device (101) can move the image (520) to correspond to the movement of the touch input (510).
[0171] In one embodiment, the electronic device (101) can identify an area capable of displaying an application corresponding to the image (520) based on the movement of the image (520) according to the movement of the touch input (510). In one embodiment, the area capable of displaying the application can be determined according to the settings of the application. In one embodiment, the settings of the application can indicate at least one of the types of screens that the application can display (e.g., full screen, split screen, and / or pop-up screen (or floating screen)).
[0172] In one embodiment, the electronic device (101) can identify an area on the entire screen that can display an application corresponding to the image (520) based on the movement of the image (520) according to the movement of the touch input (510).
[0173] In one embodiment, the electronic device (101) can change the display of an identified area (or an area according to the full screen) (e.g., a body area (305)) based on the movement of the image (520). In one embodiment, the electronic device (101) can change the display of the body area (305) so that the application guides the body area (305) to be displayed in the full screen. For example, referring to FIG. 9B, the electronic device (101) can identify the body area (305) as an area for the application as the image (520) is moved. For example, the electronic device (101) can change the display of the body area (305) as the image (520) is moved. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the screen (320) located in the identified body area (305) by moving the image (520).
[0174] In one embodiment, referring to FIG. 9c, the electronic device (101) may display the screen (540) of the application in a split screen based on the release of the touch input (510) at a location other than the visual object (530). In one embodiment, the electronic device (101) may display the screen (540) of the application in a selected split area based on the release of the touch input (510).
[0175] In one embodiment, the electronic device (101) may display the screen (540) in full screen instead of the image (520) based on the release of the touch input (510). In one embodiment, the electronic device (101) may display the screen (540) in full screen so that the screen (540) has the highest depth. In one embodiment, the electronic device (101) may not display the screen (320) having the next depth of the screen (540) as the screen (540) occupies the entire body area (305).
[0176] In one embodiment, the screen (540) displayed in full screen may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (540) displayed in full screen may reflect the execution result of the application during the time between the time when the touch input (510) is received and the time when the display of the screen (540) is initiated.
[0177] According to an embodiment, the electronic device (101) may identify a pop-up screen, not a full screen, as the form in which the application is to be displayed, based on the movement of the image (520) according to the movement of the touch input (510). For example, the electronic device (101) may identify a pop-up screen, not a full screen, as the form in which the application is to be displayed, based on the position of the image (520) in the area for displaying the application as a pop-up screen.
[0178] In one embodiment, referring to FIG. 9D, the electronic device (101) may display the screen (560) of the application as a pop-up screen based on the release of the touch input (510) while the image (520) is positioned in the area for displaying the application as a pop-up screen. In one embodiment, the electronic device (101) may display the screen (560) of the application in a pop-up form based on the release of the touch input (510). For example, the electronic device (101) may display the screen (560) of the application on the screen (320) based on the release of the touch input (510) while the image (520) is positioned in the area for displaying the application as a pop-up screen.
[0179] In one embodiment, the screen (560) displayed as a pop-up screen may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (560) displayed as a pop-up screen may reflect the execution result of the application during the time between the time when the display of the screen (560) is initiated after the touch input (510) is received.
[0180] In one embodiment, based on additional user input (e.g., touch input and / or drag input) to the screen (560) displayed as a pop-up screen, the electronic device (101) can move the screen (560) over the screen (320).
[0181] FIG. 10A is a diagram illustrating a state in which an electronic device receives an input requesting the execution of an application, according to an embodiment. FIG. 10B is a diagram illustrating a state in which an electronic device displays a screen of an application, according to an embodiment. FIG. 10C is a diagram illustrating an input to a screen of an application, according to an embodiment. FIG. 10D is a diagram illustrating a state in which the display of an application screen changes while an image is positioned in an upper partition area according to movement of an input, according to an embodiment.
[0182] Figures 10a to 10d can be explained with reference to Figures 1 to 4b.
[0183] FIGS. 10A to 10D, compared to FIGS. 5A to 5G, can illustrate a situation in which the screen (330) is displayed in full screen while the screen of another application is displayed in full screen.
[0184] Referring to FIG. 10A, the electronic device (101) can receive a touch input (1010) while the screen (330) of the application is displayed in full screen through the display (260). For example, the electronic device (101) can receive a touch input (1010) that starts in an area other than the body area (305) among the system bar (301), the navigation area (303), and the body area (305). For example, the electronic device (101) can receive a touch input (1010) directed from the navigation area (303) to the body area (305). However, the present invention is not limited thereto. For example, the electronic device (101) can receive a touch input directed from the system bar (301) to the body area (305).
[0185] In one embodiment, the processor (120) may identify the touch input (1010) as an input for executing a specified application based on receiving the specified touch input (1010) while displaying the screen (330) through the display (260).
[0186] In one embodiment, referring to FIG. 10B, the processor (120) may display a screen (1020) of an application corresponding to the touch input (1010) on the screen (330) based on receiving a touch input (1010). In one embodiment, the screen (1020) may include an area where contents (1023, 1025) are displayed and / or a background area (1021). In one embodiment, the background area (1021) may have transparency (or opacity) that allows a layer behind the screen (1020) to be visible. In one embodiment, as the background area (1021) has transparency (or opacity), a screen (330) located in the next layer of the screen (1020) may be visible to the user.
[0187] For example, the processor (120) may add an activity of an application corresponding to a touch input (1010) to the activity stack as a top-level activity. For example, the processor (120) may add an activity of an application corresponding to a touch input (1010) to the activity stack as a top-level activity so that the application corresponding to the touch input (1010) operates in the foreground (351).
[0188] In one embodiment, the processor (120) may display the screen (1020) of the application on the screen (330) such that the depth of the screen (1020) of the application corresponding to the touch input (1010) is higher than the depth of the screen (330).
[0189] Referring to FIG. 10c, the electronic device (101) can receive a touch input (1030) directed toward a screen (1020) of an application displayed in full screen through the display (260). For example, the electronic device (101) can receive a touch input (1030) directed toward a body area (305) where the screen (1020) of the application is displayed among the system bar (301), the navigation area (303), and the body area (305). For example, the electronic device (101) can receive a touch input (1030) directed toward a designated area (e.g., a content area (1023, 1025)) among the screen (1020) of the application displayed in full screen.
[0190] In one embodiment, the electronic device (101) can identify that a split screen display is requested for a full-screen screen (1020) based on a touch input (1030). In one embodiment, the electronic device (101) can identify that a split screen display is requested for the screen (1020) based on the touch input (1030) being maintained for a specified period of time or longer. In one embodiment, the electronic device (101) can identify that a split screen display is requested for the screen (1020) based on the touch input (1030) being maintained in a fixed (or substantially fixed) state for a specified period of time or longer. In one embodiment, the electronic device (101) can identify that a split screen display is requested for the screen (1020) based on the touch input (1030) being maintained in a fixed (or substantially fixed) state for a specified period of time or longer. In one embodiment, the electronic device (101) may identify that a split screen display is requested for the screen (1020) based on the touch input (1030) being a specified type of input (e.g., long-press input, pressure input).
[0191] In one embodiment, the electronic device (101) may stop displaying the screen (1020) based on a touch input (1030) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may stop displaying the screen (1020) based on a request for the screen (1020) to be displayed in full screen mode is identified.
[0192] In one embodiment, the electronic device (101) can stop displaying the screen (1020) by applying a graphic effect specified to the screen (1020) (e.g., fade out, gradual size reduction, gradual alpha value increase).
[0193] In one embodiment, when the electronic device (101) stops displaying the screen (1020), the electronic device (101) may not adjust the order of activities so that the activity of the application related to the screen (1020) runs in the foreground (351). In one embodiment, when the electronic device (101) stops displaying the screen (1020), the electronic device (101) may maintain the activity of the application related to the screen (1020) as the top activity. In one embodiment, the electronic device (101) may maintain the activity of the application as the top activity in order to maintain the lifecycle of the application related to the screen (1020) (or to prevent a pause command (onPause()) and / or a stop command (onStop()) for the application from being issued).
[0194] In one embodiment, the electronic device (101) may generate an image (1040) representing the screen (1020) based on a touch input (1030) maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may generate an image (1040) representing the screen (1020) based on an identification of a request for the screen (1020) to be displayed in full screen.
[0195] In one embodiment, the image (1040) representing the screen (1020) may be a reduced image from the screen (1020). In one embodiment, the image (1040) representing the screen (1020) may be an image summarizing the screen (1020). In one embodiment, the image (1040) representing the screen (1020) may be one of the content areas (1023, 1025) within the screen (1020) (e.g., content area (1023)).
[0196] In one embodiment, the electronic device (101) may display an image (1040) instead of the screen (1020) based on a touch input (1030) that is maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may display the image (1040) so as to have a depth higher than the depth of the screen (1020) where the display is stopped (or, the highest depth). In one embodiment, the image (1040) has a size that is displayed within a portion of the display area of the display (260), so that the screen (330) located in the next layer of the screen (1020) may be visible to the user in an area other than the area occupied by the image (1040). In one embodiment, the electronic device (101) may display the image (1040) so that it has a depth (or top depth) higher than the depth of the screen (1020) where the display is stopped, so that the image (1040) appears to the user in a pop-up state on the screen (330).
[0197] In one embodiment, the electronic device (101) can display the image (1040) instead of the screen (1020) by applying a graphic effect (e.g., fade in, gradual size enlargement) specified to the image (1040).
[0198] In one embodiment, the electronic device (101) can identify the movement of the touch input (1030). In one embodiment, the electronic device (101) can identify the movement of the touch input (1030) that is being maintained. In one embodiment, the electronic device (101) can identify the movement of the touch input (1030) while the image (1040) is displayed. In one embodiment, the electronic device (101) can identify the movement of the touch input (1030) as a drag location event. In one embodiment, the electronic device (101) can identify the coordinates of the touch input (1030) whenever the touch input (1030) is moved based on the identification of the drag location event (ACTION_DRAG_LOCATION event). In one embodiment, the movement of the touch input (1030) may be a drag input, but is not limited thereto.
[0199] In one embodiment, the electronic device (101) can move the image (1040) based on the movement of the touch input (1030). For example, the electronic device (101) can move the image (1040) to correspond to the movement of the touch input (1030). In one embodiment, the electronic device (101) can move the image (1040) to a location corresponding to the identified coordinates based on the identification of a drag location event (ACTION_DRAG_LOCATION event).
[0200] In one embodiment, the electronic device (101) can identify one of the plurality of segmented areas (411, 415, 421, 425) based on the movement of the image (1040) according to the movement of the touch input (1030).
[0201] In one embodiment, the electronic device (101) can change the display of the identified split area based on the movement of the image (1040). In one embodiment, the electronic device (101) can change the display of the identified split area so that the application guides the split area to be displayed as a split screen.
[0202] For example, referring to FIG. 10D, the electronic device (101) can identify a split area (411) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (1040) upward. For example, the electronic device (101) can identify a split area (411) among the plurality of split areas (411, 415, 421, 425) as a split area in which an application is to be displayed as a split screen by moving the image (1040) upward.
[0203] For example, the electronic device (101) can change the display of the identified segmented area (411) by moving the image (1040) upward. For example, the electronic device (101) can apply a graphic effect (e.g., blur, color change) to the screen (330) located in the identified segmented area (411) by moving the image (1040) upward.
[0204] In one embodiment, referring to FIG. 10d, the electronic device (101) may display the screen of an application in a split screen based on the release of the touch input (1030). In one embodiment, the electronic device (101) may display the screen of the application in a selected split area based on the release of the touch input (1030).
[0205] In one embodiment, the electronic device (101) can simultaneously display a split screen corresponding to the screen (330) in another split area (415) that is not occupied by the screen of the application, as the screen of the application is displayed as a split screen in the split area (411).
[0206] FIG. 11 is a flowchart illustrating the operation of an electronic device according to one embodiment.
[0207] Figure 11 can be explained with reference to Figures 1 to 10d.
[0208] Referring to FIG. 11, in operation 1110, the electronic device (101) can display the screen (330) of the application in full screen.
[0209] In operation 1120, the electronic device (101) may receive an input for displaying a split screen or a pop-up screen. In one embodiment, the electronic device (101) may identify the touch input (510) as an input for displaying a split screen or a pop-up screen based on the touch input (510) directed toward the screen (330) of the application displayed in full screen through the display (260) being maintained for a specified period of time or longer. In one embodiment, the electronic device (101) may identify the touch input (510) as an input for displaying a split screen or a pop-up screen based on the touch input (510) being a specified type of input (e.g., a long press).
[0210] In operation 1130, the electronic device (101) may display an image (520) that replaces the screen (330).
[0211] In one embodiment, the electronic device (101) may generate an image (520) representing a screen (330) based on a touch input (510). In one embodiment, the electronic device (101) may generate an image (520) to replace the screen (330) based on a touch input (510) for a screen (330) displayed in full screen. In one embodiment, the image (520) may be referred to as a drag image (or drag surface).
[0212] In one embodiment, the electronic device (101) can stop displaying the screen (330) based on a touch input (510). In one embodiment, the electronic device (101) can stop displaying the screen (330) based on a touch input (510). In one embodiment, the electronic device (101) can set the screen (330) to an invisible state based on the touch input (510). In one embodiment, the electronic device (101) can display an image (520) instead of the screen (330) based on the touch input (510). In one embodiment, the electronic device (101) can display the image (520) so that it has a higher depth (or, a top depth) than the depth of the screen (330).
[0213] In operation 1140, the electronic device (101) may display another screen that replaces the image in the input-released split area or pop-up area.
[0214] In one embodiment, referring to FIG. 5G, the electronic device (101) may display the screen (540) of the application in a split screen or pop-up area instead of the image (520) based on the release of the touch input (510). In one embodiment, the electronic device (101) may display the screen (540) of the application in a selected split area (411) or pop-up area based on the release of the touch input (510).
[0215] In one embodiment, the screen (540) displayed in the split area (411) or the pop-up area may reflect the execution result of the application during the time between the time when the image (520) is generated by the touch input (510) and the time when the touch input (510) is released. In one embodiment, the screen (540) displayed in the split area (411) or the pop-up area may reflect the execution result of the application during the time between the time when the display of the screen (540) is initiated after the touch input (510) is received. For example, reflecting the execution result may include reflecting the screen of the application that has changed as the execution of the application is executed without being stopped while the display of the screen (330) is stopped. For example, reflecting the execution result may include reflecting the screen of the application that is running as the activity (365) is maintained as the top activity while the display of the screen (330) is stopped. For example, the content within the screen (540) may represent a video played during the time between the time the image (520) is generated and the time the touch input (510) is released. For example, the content within the screen (540) may be played for an amount of time longer than the content within the screen (330) between the time the image (520) is generated and the time the touch input (510) is released.
[0216] For example, the screen (540) displayed in the split area (411) or pop-up area may be at least partially different from the screen (330) before the touch input (510). For example, the image frame indicated by the content (331) in the screen (330) before the touch input (510) is input may be different from the image frame indicated by the content (331) in the screen (540) after the touch input (510) is released. For example, the image frame indicated by the content (331) in the screen (540) may have a difference in image frames from the image frame indicated by the content (331) in the screen (330) by a specified amount of time (e.g., the time from when the touch input (510) is input until it is released). For example, the progress bar (335) in the screen (330) before the touch input (510) is input may be different from the progress bar (335) in the screen (540) after the touch input (510) is released. For example, the progress bar (335) in the screen (540) may indicate a difference of a specified time (e.g., the time from when the touch input (510) is input to when it is released) from the progress bar (335) in the screen (330).
[0217] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.
[0218] As described above, the electronic device (101) may include a display (260), at least one processor (120) including a processing circuit; and a memory (130) storing instructions and including one or more storage media. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display a first screen (330) of an application in a full-screen manner in a display area of the display (260) through the display (260). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive, through the display (260), an input (510) for displaying the first screen (330) according to a split view while the first screen (330) is displayed in the full-screen manner. The input (510) may be an input directed toward the first screen (330) on the display (260). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display the second screen (540) of the application in a partition area indicated by another input consecutive from the input (510) among a plurality of partition areas (411, 415, 421, 425) within the display area of the display (260). In one embodiment, the other input may be an input consecutive from the input (510) (e.g., an input (510) illustrated through FIGS. 5C to 5F) (e.g., a drag input for moving an image (520).
[0219] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to: stop displaying the first screen (330) based on receiving the input (510). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display an image (520) representing the first screen (330) that was displayed at the time the input (510) was received. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to move the image (520) as the other input moves.
[0220] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to stop displaying the image (520) based on the other input being released. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display the second screen (540) in the partition corresponding to the location where the image (520) was displayed when the other input was released.
[0221] The second screen (540) may reflect the execution result of the application during the time between the time when the input (510) is received and the time when the display of the second screen (540) is initiated.
[0222] The above instructions, when executed individually or collectively by the at least one processor (120), may cause the electronic device (101) to stop displaying the first screen (330) by setting the first screen (330) to be transparent so that another screen (310, 320) located in a layer subsequent to the layer on which the first screen (330) is displayed is displayed.
[0223] The above instructions, when executed individually or collectively by the at least one processor (120), may cause the electronic device (101) to display the second screen (540) in the partition area and simultaneously display the other screen (310, 320) in a partition area other than the partition area among the plurality of partition areas (411, 415, 421, 425).
[0224] The above instructions, when executed individually or collectively by the at least one processor (120), may cause the electronic device (101) to display the second screen (540) in the partition area and, at the same time, to display a screen (710) showing icons of a plurality of applications that are distinct from the other screens in a partition area other than the partition area among the plurality of partition areas (411, 415, 421, 425).
[0225] The first screen (330) may include a user interface (UI) for controlling playback of audio content. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to maintain audio output while the display of the first screen (330) is stopped, based on the input (510) being received while outputting audio based on the audio content through the speaker. The above instructions, when executed individually or collectively by the at least one processor (120), may cause the electronic device (101) to display the second screen (540) including the UI in which the position of the indicator (335) indicating the playback time of the audio content in the split area is changed from a first position displayed on the first screen (330) to a second position based on maintaining the output of the audio while the display of the first screen (330) is stopped.
[0226] The above instructions, when executed individually or collectively by the at least one processor (120), may cause the electronic device (101) to keep the activity of the application at the top while the display of the first screen (330) is stopped.
[0227] The first screen (330) may include a transparent background area so that another screen located in a layer following the layer on which the first screen (330) is displayed is displayed.
[0228] The above first screen (330) can be displayed in the system bar (301), the navigation area (303), and the main text area (305).
[0229] The above first screen (330) can be displayed in the body area among the system bar (301), the navigation area (303), and the body area (305).
[0230] The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to receive an input (510) requesting execution of the application starting from a designated location while displaying another screen of the application in full screen mode. The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to replace the other screen with the first screen (330) based on receiving the input (510) requesting execution of the application.
[0231] As described above, the method can be performed in an electronic device (101) including a display (260). The method can include an operation of displaying a first screen (330) of an application in full screen in a display area of the display (260) through the display (260). The method can include an operation of receiving, through the display (260), an input (510) for displaying the first screen (330) according to a split view while the first screen (330) is displayed in full screen. The input (510) can be an input (510) directed toward the first screen (330) on the display (260). The method may include an operation of displaying a second screen (540) of the application in a divided area indicated by another input consecutive to the input (510) among a plurality of divided areas (411, 415, 421, 425) within the display area of the display (260).
[0232] The method may include an action of stopping the display of the first screen (330) based on the reception of the input (510). The method may include an action of displaying an image (520) representing the first screen (330) displayed at the time the input (510) was received. The method may include an action of moving the image (520) as the other input is moved.
[0233] The method may include an action of stopping the display of the image (520) based on the release of the other input. The method may include an action of displaying the second screen (540) in the partition area corresponding to the location where the image (520) was displayed when the other input was released.
[0234] The method may include an operation of stopping the display of the first screen (330) by setting the first screen (330) to be transparent so that another screen located in a layer following the layer on which the first screen (330) is displayed is displayed.
[0235] The above method may include an operation of displaying the second screen (540) in the divided area and simultaneously displaying the other screen in a divided area other than the divided area among the plurality of divided areas (411, 415, 421, 425).
[0236] The first screen (330) may include a user interface (UI) for controlling playback of audio content. The method may include an operation of maintaining audio output while the display of the first screen (330) is stopped, based on receiving the input (510) while audio based on the audio content is output through the speaker. The method may include an operation of displaying the second screen (540) including the UI, in which the position of an indicator indicating a playback time of the audio content in the split area is changed from a first position displayed on the first screen (330) to a second position, based on maintaining the audio output while the display of the first screen (330) is stopped.
[0237] The method may include an operation of receiving an input (510) requesting execution of the application starting from a specified location while displaying another screen of another application in full screen. The method may include an operation of replacing the other screen with the first screen (330) based on receiving the input (510) requesting execution of the application.
[0238] As described above, a non-transitory computer readable storage medium can store a program including instructions. The instructions, when individually or collectively executed by at least one processor (120) of an electronic device (101) including a display (260), can cause the electronic device (101) to display a first screen (330) of an application in a full-screen manner in a display area of the display (260) through the display (260). The instructions, when individually or collectively executed by the at least one processor (120), can cause the electronic device (101) to receive, through the display (260), an input (510) for displaying the first screen (330) according to a split view while the first screen (330) is displayed in the full-screen manner. The input (510) may be an input directed toward the first screen (330) on the display (260). The instructions, when individually or collectively executed by the at least one processor (120), may cause the electronic device (101) to display the second screen (540) of the application in a partition area indicated by another input consecutive to the input (510) among a plurality of partition areas (411, 415, 421, 425) within the display area of the display (260).
[0239] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned will be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains.
[0240] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0241] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0242] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0243] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0244] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., by download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0245] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101), Display (260), At least one processor (120) comprising a processing circuit; and A memory (130) storing instructions and including one or more storage media, wherein the instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Through the above display (260), the first screen (330) of the application is displayed in full screen in the display area of the above display (260), While the first screen (330) is displayed in full screen, an input (510) for displaying the first screen (330) according to a split view is received through the display (260), and the input (510) is an input directed toward the first screen (330) on the display (260). Causing the second screen (540) of the application to be displayed in a partition area indicated by another input consecutive from the input (510) among a plurality of partition areas (411, 415, 421, 425) within the display area of the display (260). Electronic devices.
2. In claim 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the above input (510) being received: Stop displaying the first screen (330) above, Displaying an image (520) representing the first screen (330) displayed at the time the above input (510) is received, causing the image (520) to move as the other input moves, Electronic devices.
3. In claim 1 or claim 2, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Based on the above other inputs being released: Stop displaying the above image (520), When the other input is released, causing the second screen (540) to be displayed in the divided area corresponding to the location where the image (520) was displayed. Electronic devices.
4. In any one of claims 1 to 3, The second screen (540) reflects the execution result of the application during the time between the time when the input (510) is received and the time when the display of the second screen (540) is initiated. Electronic devices.
5. In any one of claims 1 to 4, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: By setting the first screen (330) to be transparent, another screen (310, 320) located in the layer following the layer in which the first screen (330) is displayed is displayed, thereby causing the display of the first screen (330) to be stopped. Electronic devices.
6. In any one of claims 1 to 5, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Causing the second screen (540) to be displayed in the above-mentioned divided area and at the same time causing the other screen (310, 320) to be displayed in a divided area other than the divided area among the plurality of divided areas (411, 415, 421, 425). Electronic devices.
7. In any one of claims 1 to 6, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: Causing a screen (710) to be displayed in a partition area other than the partition area among the plurality of partition areas (411, 415, 421, 425) while simultaneously displaying the second screen (540) in the partition area, which displays icons of a plurality of applications that are distinct from the other screens. Electronic devices.
8. In any one of claims 1 to 7, Includes speakers, The above first screen (330) includes a UI (user interface) for controlling playback of audio content, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: While outputting audio based on the audio content through the speaker, based on the input (510) being received, while the display of the first screen (330) is stopped, the output of the audio is maintained, Based on the fact that the output of the audio is maintained while the display of the first screen (330) is stopped, the second screen (540) including the UI in which the position of the indicator (335) indicating the playback time of the audio content in the split area is changed from the first position displayed on the first screen (330) to the second position is displayed. Electronic devices.
9. In any one of claims 1 to 8, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: While the display of the first screen (330) is stopped, causing the activity of the application to be kept at the top. Electronic devices.
10. In any one of claims 1 to 9, The first screen (330) includes a transparent background area so that another screen located in the layer following the layer on which the first screen (330) is displayed is displayed. Electronic devices.
11. In any one of claims 1 to 10, The first screen (330) is displayed in the system bar (301), the navigation area (303) and the main text area (305). Electronic devices.
12. In any one of claims 1 to 11, The first screen (330) is displayed in the body area among the system bar (301), the navigation area (303) and the body area (305). Electronic devices.
13. In any one of claims 1 to 12, The above instructions, when individually or collectively executed by the at least one processor (120), cause the electronic device (101) to: While displaying another screen of another application in full screen, receiving an input (510) requesting execution of said application starting from a specified location, Based on receiving the input (510) requesting the execution of the application, causing the other screen to be replaced with the first screen (330). Electronic devices.
14. In a method of an electronic device (101) including a display (260), An operation of displaying the first screen (330) of the application in full screen in the display area of the display (260) through the display (260). An operation of receiving an input (510) for displaying the first screen (330) according to a split view through the display (260) while the first screen (330) is displayed in the full screen, the input (510) being an input (510) directed toward the first screen (330) on the display (260), and An operation of displaying a second screen (540) of the application in a divided area indicated by another input consecutive from the input (510) among a plurality of divided areas (411, 415, 421, 425) within the display area of the display (260) is included. method.
15. In claim 14, Based on the above input (510) being received: An action to stop displaying the first screen (330) above, An operation of displaying an image (520) representing the first screen (330) displayed at the time the above input (510) is received, and An operation of moving the image (520) as the other input moves, method.
Citation Information
Patent Citations
Multi-tasking operating method and terminal supporting same
KR1020140098904A
Electronic device including touch sensitive display and method for operating the same
KR1020160025905A
Device and method for displaying image
KR1020160026670A
Mobile terminal and method for controlling the same
KR1020180067855A
Self-generating system for rotational scale
KR1020230135818A