Electronic device, method, and computer-readable medium for displaying visual object
The electronic device addresses the challenge of managing multiple visual objects by using a processor to move and reorder them based on user input, adjusting opacity and size, resulting in an intuitive user interface for managing visual stacks.
Patent Information
- Application Number
- PCT/KR2024/007266
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-07
- Filing Date
- 2024-05-28
- Publication Date
- 2025-01-23
AI Technical Summary
Existing electronic devices struggle to effectively display and manage multiple visual objects stacked according to sort order, particularly in responding to user inputs by moving and reordering them while maintaining intuitive visual cues such as opacity and size adjustments.
The electronic device includes a processor and memory to execute instructions that display the highest visual object first, allowing it to move in response to user input while other visual objects follow its movement path, adjusting opacity and size based on their sort order, and repositioning them accordingly.
This approach provides an intuitive and visually clear method for users to interact with and manage multiple visual objects, enhancing user experience by maintaining a clear representation of the object stack and movement dynamics.
Smart Images

Figure KR2024007266_23012025_PF_FP_ABST
Abstract
Description
Electronic device, method, and computer-readable medium for displaying visual objects
[0001] The present disclosure relates to electronic devices, methods, and computer-readable media for displaying visual objects.
[0002] An electronic device can run an application. The electronic device can display the screen of the running application through a display. The electronic device can display at least a portion of the screen of the application through a pop-up window on the display.
[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.
[0004] In embodiments, an electronic device is provided. The electronic device may include a memory storing instructions, a processor, and a display. The instructions, when executed by the processor, may cause the electronic device to display a first visual object at a first position among a plurality of visual objects stacked in a sort order, through the display, while the first visual object is displayed to move in response to a user input for the first visual object, display one or more visual objects other than the first visual object among the plurality of visual objects through the display, and after the user input, display the first visual object through the display at a second position according to the user input. The one or more visual objects may be displayed to follow a movement path of the first visual object sequentially according to the sort order while the first visual object is displayed to move.
[0005] In embodiments, a method performed by an electronic device is provided. The method may include an operation of displaying a first visual object at a first point, which is at the top, from among a plurality of visual objects stacked according to a sorting order. The method may include an operation of displaying one or more visual objects other than the first visual object from among the plurality of visual objects, from among the first visual object, through the display while the first visual object is displayed to move in response to a user input for the first visual object. The method may include an operation of displaying the first visual object through the display at a second point according to the user input after the user input. The one or more visual objects may be displayed to follow a movement path of the first visual object sequentially according to the sorting order while the first visual object is displayed to move.
[0006] In embodiments, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium may include instructions. The non-transitory computer-readable medium may include a memory. The instructions, when executed by a processor, may cause an electronic device to display a first visual object at a first position among a plurality of visual objects stacked in a sort order, and, while the first visual object is displayed to move in response to a user input for the first visual object, display one or more visual objects other than the first visual object among the plurality of visual objects through the display, and, after the user input, display the first visual object through the display at a second position according to the user input. While the first visual object is displayed to move, the one or more visual objects may be displayed to follow a movement path of the first visual object sequentially in the sort order.
[0007] Figure 1 is a block diagram of an electronic device within a network environment.
[0008] Figure 2 shows an example of stacked visual objects.
[0009] Figures 3a and 3b show examples of movement of visual objects.
[0010] Figure 4 shows an example of movement of a visual object according to the attitude of an electronic device.
[0011] Figure 5 shows an example of a stack of visual objects associated with pop-up windows.
[0012] Figure 6 shows an example of reordering of visual objects.
[0013] Figure 7 shows an example of movement of container objects and visual objects.
[0014] Figure 8 shows an example of changing the orientation of container objects and visual objects.
[0015] Figures 9a and 9b illustrate examples of preview windows of applications associated with visual objects.
[0016] Figures 10a and 10b show examples of display of pop-up windows.
[0017] Figures 11a and 11b show examples of alignment of pop-up windows.
[0018] Figures 12a and 12b illustrate examples of minimizing aligned pop-up windows.
[0019] Figures 13a and 13b illustrate examples of movement of stacked visual objects.
[0020] Figures 14a and 14b illustrate examples of data movement between applications.
[0021] Figure 15 shows an example of the display of pop-up windows.
[0022] Figure 16 shows an example of displaying pop-up windows according to pinch out.
[0023] Figure 17 shows an example of a visual object for displaying pop-up windows.
[0024] The terms used in this disclosure are used only to describe specific embodiments and may not be intended to limit the scope of other embodiments. The singular expression may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by those of ordinary skill in the art described in this disclosure. Terms defined in general dictionaries among the terms used in this disclosure may be interpreted as having the same or similar meaning in the context of the relevant technology, and shall not be interpreted in an idealized or overly formal sense unless explicitly defined in this disclosure. In some cases, even if a term is defined in this disclosure, it cannot be interpreted to exclude embodiments of the present disclosure.
[0025] The various embodiments of the present disclosure described below illustrate a hardware-based approach as an example. However, since the various embodiments of the present disclosure include techniques utilizing both hardware and software, the various embodiments of the present disclosure do not exclude a software-based approach.
[0026] In the following description, terms referring to signals (e.g., signal, information, message, signaling), terms referring to screens (e.g., screen, window, mini window, pop-up window, window), terms referring to parameters related to stacking order (e.g., z-order, z-index, sort order, stack order, sort value, stack value), terms referring to parameters related to transparency (e.g., opacity, transparency), terms for operation states (e.g., step, operation, procedure), terms referring to network entities, terms referring to components of devices, etc. are examples for convenience of description. Therefore, the present disclosure is not limited to the terms described below, and other terms having equivalent technical meanings may be used.
[0027] In addition, in the present disclosure, expressions such as "more than" or "less than" may be used to determine whether a specific condition is satisfied or fulfilled, but this is merely a description for expressing an example and does not exclude descriptions such as "more than" or "less than." A condition described as "more than" may be replaced with "more than," a condition described as "less than" may be replaced with "less than," and a condition described as "more than and less than" may be replaced with "more than and less than." In addition, hereinafter, "A" to "B" mean at least one of elements from A (including A) to B (including B). hereinafter, "C" and / or "D" mean at least one of "C" or "D," that is, including {"C", "D", "C" and "D"}.
[0028] FIG. 1 is a block diagram of an electronic device within a network environment according to embodiments.
[0029] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).
[0030] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.
[0031] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0032] The memory (130) can store various data used by at least one component (e.g., a processor (120) or a sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., a program (140)) and input data or output data for commands related thereto. The memory (130) can include a volatile memory (132) or a non-volatile memory (134).
[0033] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0034] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0035] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0036] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0037] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).
[0038] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0039] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0040] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0041] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0042] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0043] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).
[0044] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0045] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).
[0046] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.
[0047] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).
[0048] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.
[0049] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0050] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0051] FIG. 2 illustrates an example of stacked visual objects. The stacking of the visual objects may mean that the visual objects are stacked in a direction perpendicular to a surface of a display (e.g., a display module (160)) (e.g., a z-axis direction). For example, an electronic device (e.g., an electronic device (101)) may display only the topmost visual object to display the stacked visual objects. For example, the electronic device (e.g., an electronic device (101)) may arrange the visual objects in a stacking order (hereinafter, referred to as a stacking order) to display the stacked visual objects, and may display the arranged visual objects.
[0052] Referring to FIG. 2, in the first screen (201), the electronic device (101) may display a visual object (e.g., a first visual object (211)) located at the top among the plurality of stacked visual objects through a display (e.g., a display module (160)). The plurality of visual objects may include a first visual object (211), a second visual object (212), and a third visual object (213). For example, each visual object of the visual objects may include an icon for representing an application (hereinafter, “app icon”). The app icon may be referred to as an application icon, an app object, an execution object, or a term having an equivalent technical meaning thereto in addition to the app icon. Although not shown in FIG. 2, the electronic device (101) may display a pop-up window of an application. The execution screen of the application may be displayed through the pop-up window. In response to a size reduction input, the size of the displayed pop-up window may be minimized. The electronic device (101) can display app icons corresponding to the application. To display app icons corresponding to multiple applications in a single area, the app icons can be stacked in a direction perpendicular to the display (e.g., along the z-axis).
[0053] The electronic device (101) can stack visual objects. For example, the electronic device (101) can display a first pop-up window of a first application associated with a first visual object (211). The electronic device (101) can display a second pop-up window of a second application associated with a second visual object (212). The electronic device (101) can display a third pop-up window of a third application associated with a third visual object (213). The electronic device (101) can stack the third visual object (213) in response to a reduction input of the third pop-up window (e.g., a pop-up window minimization input). The electronic device (101) can stack the second visual object (212) in response to a reduction input of the second pop-up window. The electronic device (101) can stack the first visual object (211) in response to a reduction input of the first pop-up window. Stacking visual objects may refer to stacking the visual objects in a container for a pop-up window. The container may be used to allow a user to easily display a pop-up window from an app icon. The container may be referred to as a palette, a tray, a receiving object, a receiving container, a minimizing tray, a control pad, a receiving object, a container object, or a term having an equivalent technical meaning thereto. For example, a third visual object (213), a second visual object (212), and a first visual object (211) may be stacked in the container in this order. Meanwhile, the stacking of the visual objects may be performed in accordance with a predetermined input (e.g., a home button, a recent button, a predetermined gesture button) while the pop-up windows are displayed, in addition to the zoom-out input of each pop-up window in the above example.
[0054] The electronic device (101) can receive a user input (205) for a first visual object (211). For example, the user input (205) can include a tap input, a double-tap input, a press input, a drag input, a fling input, or a designated gesture input. Hereinafter, embodiments are described based on the user input (205) being the tap input. The electronic device (101) can display a container (e.g., a container object (210)) for the first visual object (211) based on the user input (205). The electronic device (101) can display one or more visual objects (e.g., a second visual object (212) and a third visual object (213)) stacked together with the first visual object (211) based on the user input (205). For example, upon receiving the user input (205), the electronic device (101) can display a second screen (202).
[0055] In the second screen (202), the electronic device (101) can display a container object (210) and a plurality of visual objects (e.g., a first visual object (211), a second visual object (212), a third visual object (213)) through a display (e.g., a display module (160)). The container object (210) can represent a container for a pop-up window. The container object (210) can be used to represent each of the stacked visual objects. In addition, the container object (210) can be used to display a pop-up window of an application associated with the visual object based on a user input (e.g., a touch input) for the visual object. The stacked visual objects are arranged on the container object (210). For example, the electronic device (101) may display the stacked visual objects arranged in the order of the first visual object (211), the second visual object (212), and the third visual object (213) on the container object (210). Each of the stacked visual objects is arranged according to the stacking order. For example, the order in which the stacked visual objects are arranged (hereinafter, referred to as the sorting order) may indicate the stacking order of the visual objects. According to one embodiment, the electronic device (101) may terminate the stacking function of the visual objects. The container object (210) may further include a termination button (220) for terminating the stack. For example, based on a user input for the termination button (220), the electronic device (101) may not display the container object (210). Based on a user input for the termination button (220), the electronic device (101) may not display the first visual object (211) stacked at the top. Based on user input to the end button (220), the electronic device (101) can stop displaying the container object (210) and terminate or stop applications for the stacked visual objects.Additionally, according to one embodiment, the electronic device (101) may terminate display of the container object (210) and display the first visual object (211) as in the previous screen (e.g., the first screen (301)). For example, the electronic device (101) may receive a user input in an area other than the container object (210). Based on the user input, the electronic device (101) may terminate display of the container object (210). Based on the user input, the electronic device (101) may display the first visual object (211) stacked at the top among the plurality of visual objects.
[0056] As illustrated in FIG. 2, a first visual object (211), a second visual object (212), and a third visual object (213) can be stacked. The electronic device (101) can set stack information for each visual object in order to control the stacked visual objects. For example, the stack information can include a z-index. The z-index can indicate a depth (e.g., a z-axis value) with respect to a screen (e.g., an xy plane) of a display. Hereinafter, the z-index of the present disclosure is described based on the fact that the (+) z-axis direction is the opposite direction to the direction in which the display faces, but this direction is exemplary. A z-index in which the (+) z-axis direction is set in the direction in which the display faces can also be understood as an embodiment of the present disclosure. The stacking order of the visual objects can be determined according to the z-indexes of the stacked visual objects. The electronic device (101) can set a z-index for a visual object. For example, the stack information may include a priority value. The priority may include a value for indicating a sorting order. The stacking order of the visual objects may be determined according to the priority values of the stacked visual objects. The electronic device (101) may set priorities for the visual objects. The electronic device (101) may obtain stack information of each visual object to sort the stacked visual objects according to the stacking order. The electronic device (101) may sort the visual objects based on the stack information of each visual object. The electronic device (101) may display the sorted visual objects.
[0057] Figures 3a and 3b illustrate examples of movement of visual objects. The visual objects may be stacked. To explain the movement of the stacked visual objects, reference may be made to the descriptions of Figure 2.
[0058] Referring to FIG. 3a, on the first screen (301), the electronic device (101) can display a first visual object (211).
[0059] The electronic device (101) may, while displaying the first visual object (211), be running in the background applications related to visual objects stacked under the first visual object (211) (e.g., the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215). In addition to the first visual object (211), applications related to other visual objects are running on the electronic device (101), but the user cannot know how many visual objects are stacked under the first visual object (211). Therefore, the electronic device (101) may display one or more visual objects stacked under the first visual object (211) based on the movement of the first visual object (211).
[0060] The electronic device (101) may receive a user input (310) for moving a first visual object (211). For example, the user input (310) may include a drag input to the first visual object (211). For example, the user input (310) may include a fling input to the first visual object (211). The fling input may indicate a motion of moving and then flicking an input object (e.g., a finger or a pen). The electronic device (101) may display a plurality of visual objects stacked on the electronic device (101) based on the user input (310). The plurality of visual objects may include a first visual object (211), a second visual object (212), a third visual object (213), a fourth visual object (214), and a fifth visual object (215). The above plurality of visual objects may be stacked in the following order: a fifth visual object (215), a fourth visual object (214), a third visual object (213), a second visual object (212), and a first visual object (211). The first visual object (211) may be located at the top. For example, the z-index of the first visual object (211) may be the smallest, and the z-index of the fifth visual object (215) may be the largest. The electronic device (101) may display movement of the first visual object (211) based on a user input (310). While the first visual object (211) is displayed to move, the electronic device (101) may display other visual objects (e.g., the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215)) to follow the movement path of the first visual object. Hereinafter, for convenience of explanation, the other visual object, i.e., the visual object that follows the top-most visual object, may be referred to as a subsequent visual object.
[0061] The above subsequent visual objects may be arranged along the movement path of the first visual object (211) according to the sorting order. For example, the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215) may be arranged in that order along the movement path of the first visual object (211). Through the visual objects arranged along the movement path, the user may check the visual objects stacked under the first visual object (211). For example, the electronic device (101) may display the second screen (302) based on a user input (310).
[0062] According to one embodiment, the electronic device (101) may control the opacity of a visual object. The opacity of the visual object may indicate the degree of opacity of the visual object compared to the background screen on the display shown to the user. For example, the higher the opacity, the less the background screen may be displayed behind the visual object. The lower the opacity, the more clearly the background screen may be displayed behind the visual object. For example, the opacity may have a value of 0 or more and 1 or less, where 0 represents transparency and 1 represents complete opacity. In addition to opacity, the opacity may be referred to by terms having equivalent technical meanings, such as the degree of fade, transparency, degree of blur, and sharpness. In order to intuitively express the order of other visual objects according to the movement path of the first visual object (211), the electronic device (101) may control the opacity of each visual object. For example, the electronic device (101) may display a second visual object (212), a third visual object (213), a fourth visual object (214), and a fifth visual object (215) in decreasing opacity according to the sorting order. As the visual objects progress in the order of the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215), each visual object may become progressively more transparent. The opacity of the second visual object (212) may be set higher than the opacity of the third visual object (213). The opacity of the third visual object (213) may be set higher than the opacity of the fourth visual object (214). The opacity of the fourth visual object (214) may be set higher than the opacity of the fifth visual object (215). For example, the electronic device (101) can control the opacity of a visual object based on stack information (e.g., z-index, priority) of the visual object.The electronic device (101) may set the opacity of a visual object to be higher when the priority value of the visual object is higher or the z-index is lower. For example, since the z-index of the second visual object (212) is lower than the z-index of the third visual object (213), the opacity of the second visual object (212) may be set to be lower than the opacity of the third visual object (213). The electronic device (101) may set the opacity of a visual object to be lower when the priority value of the visual object is lower or the z-index is higher. For example, since the z-index of the fourth visual object (214) is higher than the z-index of the first visual object (211), the opacity of the fourth visual object (214) may be set to be lower than the opacity of the first visual object (211).
[0063] According to one embodiment, the electronic device (101) may control the scaling of a visual object. Scaling of the visual object may refer to increasing or decreasing the size of the visual object. A scale value for the scaling may be set for the visual object. The visual object may be displayed within an area corresponding to the set scale value. For example, the higher the scale value, the larger the visual object may be displayed. The lower the scale value, the smaller the visual object may be displayed. For example, the scale value of each visual object in the second screen (202) may be the same. The size of each visual object in the second screen (202) may be the same. By adjusting the scale value, the size of each visual object may be adjusted. The scale value of the first visual object (211) in the first screen (301) may be a default value (e.g., 1). In order to intuitively express the order of other visual objects according to the movement path of the first visual object (211), the electronic device (101) can control the scale value of each visual object. For example, the electronic device (101) can display the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215) so that the scale value decreases according to the sorting order. As the order of the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215) increases, each visual object can gradually become smaller. The size of the second visual object (212) can be larger than the size of the third visual object (213). The size of the third visual object (213) can be larger than the size of the fourth visual object (214). The size of the fourth visual object (214) can be larger than the size of the fifth visual object (215).For example, the electronic device (101) can control the scale value of the visual object based on the stack information (e.g., z-index, priority) of the visual object. The electronic device (101) can set the scale value of the visual object to be larger when the priority value of the visual object is higher or the z-index is lower. For example, since the z-index of the second visual object (212) is smaller than the z-index of the third visual object (213), the scale value of the second visual object (212) can be set to be larger than the scale value of the third visual object (213). The size of the second visual object (212) can be larger than the size of the third visual object (213).
[0064] On the third screen (303), the electronic device (101) may display the first visual object (211). After the movement of the first visual object (211) is completed, subsequent visual objects (e.g., the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215)) may no longer be displayed. The electronic device (101) may display the first visual object (211) at a changed position according to a user input (310). For example, the position of the first visual object (211) on the first screen (301) (hereinafter, the first position) may be different from the position of the second visual object (hereinafter, the second position) on the third screen (303). The electronic device (101) may display the first visual object (211) at the second position based on a drag input from the first position to the second position. The electronic device (101) can display a first visual object (211) at a second location based on a fling input from the first location.
[0065] In FIG. 3A, the visual objects following the first visual object (211) are illustrated to become smaller in size or have lower opacity according to the sorting order, but the embodiments of the present disclosure are not limited thereto. According to one embodiment, the visual objects following the first visual object (211) have lower opacity according to the sorting order, but the size of the visual object following the first visual object (211) and the first visual object (211) may be the same. According to another embodiment, the visual objects following the first visual object (211) have smaller sizes according to the sorting order, but the opacity of the visual object following the first visual object (211) may be the same as the opacity of the first visual object (211). According to yet another embodiment, the opacity and size of the visual object following the first visual object (211) may be the same as the opacity and size of the first visual object (211), respectively.
[0066] FIG. 3A illustrates an example of displaying multiple stacked visual objects using opacity and scaling. The electronic device (101) can not only vary the effects of subsequent visual objects, but also display characteristics of a set of stacked visual objects (hereinafter, "stack set") to the user. For example, the electronic device (101) can display the number of visual objects included in the stack set to the user. FIG. 3B illustrates an example of three stacked visual objects.
[0067] Referring to FIG. 3B, in the first screen (351), the electronic device (101) may display a first visual object (211). In the second screen (352), the electronic device (101) may receive a user input (310) for moving the first visual object (211). For example, the user input (310) may include a drag input for the first visual object (211). For example, the user input (310) may include a fling input for the first visual object (211). The electronic device (101) may display a plurality of visual objects stacked on the electronic device (101) based on the user input (310). The plurality of visual objects may include a first visual object (211), a second visual object (212), and a third visual object (213). The electronic device (101) may display a second visual object (212) and a third visual object (213) to follow the first visual object (211) according to the movement path of the first visual object (211). On the third screen (353), the electronic device (101) may display the first visual object (211). After the movement of the first visual object (211) is completed, subsequent visual objects (e.g., the second visual object (212) and the third visual object (213)) may no longer be displayed. The electronic device (101) may display the first visual object (211) at a changed location according to a user input (310).
[0068] The electronic device (101) can control the movement speed of one or more visual objects (e.g., the second visual object (212) and the third visual object (213) in FIG. 3A, and the second visual object (212), the third visual object (213), the fourth visual object (214), and the fifth visual object (215) in FIG. 3B) following the first visual object (211) based on the number of stacked visual objects (e.g., five in FIG. 3A, three in FIG. 3B). Hereinafter, for convenience of explanation, a visual object following a visual object located at the top may be referred to as a subsequent visual object. The above movement speed may represent the speed at which an individual visual object moves, the tracking speed at which a subsequent visual object follows a higher-order visual object, or the time at which the movement of all subsequent visual objects along the movement path of the highest-order visual object is completed (e.g., the interval from the time at which the first visual object (211) starts moving to the time at which the last subsequent visual object (e.g., the fifth visual object (215) of FIG. 3a or the third visual object (213) of FIG. 3b) ends its movement).
[0069] According to one embodiment, the electronic device (101) may display subsequent visual objects through spring animation. The electronic device (101) may set parameters (e.g., stiffness, damping ratio) for the spring animation based on the number of stacked visual objects. For example, the damping ratio may be set to be large so that the user of the electronic device (101) feels that the object is moving faster when the number of stacked visual objects is small. The damping ratio may be set to be small so that the user of the electronic device (101) feels that the object is moving slower when the number of stacked visual objects is large. For example, the stiffness may be set to be low so that the number of stacked visual objects is small. The stiffness may be set to be high so that the number of stacked visual objects is large.
[0070] According to one embodiment, the electronic device (101) may control the movement time of a subsequent visual object based on the number of stacked visual objects. As the number of stacked visual objects decreases, the electronic device (101) may set the movement time of the subsequent visual object closer to the time at which the movement of the visual object located at the highest position is initiated, so that the user of the electronic device (101) feels that the movement is faster. As the number of stacked visual objects increases, the electronic device (101) may set the movement time of the subsequent visual object further away from the time at which the movement of the visual object located at the highest position is indicated, so that the user of the electronic device (101) feels that the movement is slower.
[0071] Comparing the second screen (302) of FIG. 3A and the second screen (352) of FIG. 3B, five visual objects are stacked in the second screen (302) and three visual objects are stacked in the second screen (352). In both cases, the second visual object (212) can move along the movement path of the first visual object (211). The number of visual objects stacked in the second screen (302) is greater than the number of visual objects stacked in the second screen (302). Therefore, based on the point in time when the first visual object (211) is moved to the second position, the position of the second visual object (212) in the second screen (352) can be earlier than the position of the second visual object (212) in the second screen (302). Comparing the second screen (302) and the second screen (352), the movement speed of each subsequent visual object in the second screen (302) may be slower than the movement speed of each subsequent visual object in the second screen (352). Accordingly, the distance between stacked visual objects in the second screen (302) may be longer than the distance between stacked visual objects in the second screen (352).
[0072] In FIGS. 3A and 3B, examples of indicating the number of stacked visual objects through the movement of the stacked visual objects are described. However, embodiments of the present disclosure are not limited thereto. In order to indicate the properties of the stacked visual objects, the electronic device (101) may display explicit information. For example, the electronic device (101) may display a value indicating the number of stacked visual objects next to the first visual object (211). As an example, in FIG. 3A, the electronic device (101) may display a '5' around the first visual object (211). As an example, in FIG. 3B, the electronic device (101) may display a '3' around the first visual object (211). For example, while the first visual object (211) moves along a movement path according to a user input (310), the electronic device (101) may display a value indicating the number of stacked visual objects next to the movement path. Subsequent visual objects (e.g., second visual object (212), third visual object (213)) may be displayed with the above values.
[0073] FIG. 4 illustrates an example of movement of a visual object according to the attitude of an electronic device (e.g., electronic device (101)). According to one embodiment, the gravity effect according to the attitude of the electronic device (101) may be expressed through the movement of the visual object. Here, the gravity effect does not indicate the gravity actually acting on the first visual object (211), but may indicate a change in the movement path so that the user of the electronic device (101) feels the gravitational pull due to the direction of gravity on the displayed screen. In order to explain the movement of the stacked visual objects, reference may be made to the descriptions of FIGS. 2 to 3B.
[0074] Referring to FIG. 4, the electronic device (101) can display a first visual object (211). The electronic device (101) can receive a user input (410) for moving the first visual object (211) in a certain direction (e.g., the (+) x-axis direction). For example, the user input (410) can include a drag input or a fling input. Hereinafter, embodiments are described based on the user input (410) being the fling input.
[0075] In the first posture (411) of the electronic device (101), the direction in which the display of the electronic device (101) faces may be substantially parallel to the ground. The electronic device (101) may obtain an inclination (e.g., about 90 degrees) of the electronic device (101) through at least one sensor (e.g., a sensor module (176), a gyro sensor). The electronic device (101) may determine a first gravity magnitude (421) based on the inclination. Referring to the first screen (401), the first visual object (211) may move along a first movement path (441) based on a user input (410). The first movement path (441) may be determined based on the first gravity magnitude (421). The electronic device (101) may additionally move the first visual object (211) a predetermined distance in the direction of gravity (e.g., in the (-) y-axis direction) to indicate the influence of gravity. The predetermined distance may be determined based on the first gravity magnitude (421).
[0076] In the second posture (412) of the electronic device (101), the direction in which the display of the electronic device (101) faces may form a certain angle (e.g., about 30 degrees) with the ground. The electronic device (101) may obtain an inclination (e.g., about 60 degrees) of the electronic device (101) through at least one sensor (e.g., a sensor module (176), a gyro sensor). The electronic device (101) may determine a second gravity magnitude (422) based on the inclination. Referring to the second screen (402), the first visual object (211) may move along a second movement path (442) based on a user input (410). The second movement path (442) may be determined based on the second gravity magnitude (422). The electronic device (101) may additionally move the first visual object (211) downward (e.g., in the (-) y-axis direction) by a predetermined distance to indicate the influence of gravity. The predetermined distance may be determined based on the second gravity magnitude (422). In order to indicate that gravity acts less in the second posture (412) than in the first posture (411), the predetermined distance in the (-) y-axis direction of the first movement path (441) may be shorter than the predetermined distance in the (-) y-axis direction of the second movement path (442).
[0077] In the third posture (413) of the electronic device (101), the direction in which the display of the electronic device (101) faces may be substantially parallel to the ground. The electronic device (101) may obtain an inclination (e.g., about 0 degrees) of the electronic device (101) through at least one sensor (e.g., a sensor module (176), a gyro sensor). The electronic device (101) may determine a third gravity magnitude (423) based on the inclination. As an example, the third gravity magnitude (423) may be '0'. Referring to the third screen (403), based on a user input (410), the first visual object (211) may move along a third movement path (443). The third movement path (443) may be determined based on the third gravity magnitude (423). In the third posture (413), since the movable space (e.g., xy plane) of the first visual object (211) is perpendicular to the direction of gravity (e.g., z-axis), the electronic device may not move the first visual object (211) in a downward direction (e.g., (-) y-axis direction). The first visual object (211) may only move in the (+) x-axis direction according to the user input (410).
[0078] Although the movement of the first visual object (211) in a state where multiple visual objects are stacked is described as an example in FIG. 4, the embodiments of the present disclosure are not limited thereto. Not only in a state where multiple visual objects are stacked, but also in a state where a single visual object is stacked in a container, the electronic device (101) can exhibit the effect of gravity of FIG. 4 with respect to the movement of the single visual object. The electronic device (101) can determine the movement path of the single visual object in response to a user input based on the inclination of the electronic device (101).
[0079] Figure 5 illustrates an example of a stack of visual objects related to pop-up windows. A pop-up window may represent an execution screen displayed as a pop-up. The pop-up window may be used to use another application while using the home screen or an application screen. The pop-up window may be referred to as a window, a mini window, a spare window, an over window, a sliding window, a slide-over window, and / or terms having equivalent technical meanings, in addition to the pop-up window. Figure 5 illustrates an example of a procedure for stacking the visual objects of Figure 2.
[0080] Referring to FIG. 5, the electronic device (101) may display a plurality of pop-up windows on the first screen (501). For example, the electronic device (101) may display a first pop-up window (510). For example, the first pop-up window (510) may represent an execution screen of a first application (e.g., a calculator application). The electronic device (101) may display a second pop-up window (520). For example, the second pop-up window (520) may represent an execution screen of a second application (e.g., a phone application). The electronic device (101) may display a third pop-up window (530). For example, the third pop-up window (530) may represent an execution screen of a third application (e.g., a settings application). Each pop-up window may include a handle for movement and / or control. For example, the first pop-up window (510) may include a first handle (511). The second pop-up window (520) may include a second handle (521). The third pop-up window (530) may include a third handle (531). When a user of the electronic device (101) uses a specific pop-up window or a function related to a specific pop-up window is executed, a specific pop-up window among the plurality of pop-up windows may be activated. The activation may be referred to as focusing, recently used, or other technical terms equivalent thereto. The handle may indicate the activated pop-up window. For example, among the first pop-up window (510), the second pop-up window (520), and the third pop-up window (530), the second pop-up window (520) may be activated. The electronic device (101) may receive a user input for the second handle (521). For example, the user input may include a tap input. Based on user input to the second handle (521), the electronic device (101) can display a second screen (502).
[0081] In the second screen (502), the electronic device (101) may display control options for controlling the second pop-up window (520). For example, the displayed control options may include a symbol (522a) for pinning the top of the control option, a symbol (522b) for a split view of the second pop-up window (520), a symbol (522c) for adjusting the opacity of the second pop-up window (520), a symbol (522d) for minimizing the second pop-up window (520), and / or a symbol (522e) for maximizing the second pop-up window (520). The electronic device (101) may receive a user input for the symbol (522d) for minimizing the second pop-up window (520). Based on the user input for the symbol (522d), the electronic device (101) may display the third screen (503).
[0082] In the third screen (503), the electronic device (101) can display a second visual object (523) related to the second pop-up window (520). For example, the second visual object (523) can include an app icon of a second application (e.g., a phone application) of the second pop-up window (520). Since there are no other visual objects stacked besides the second visual object (523), the second visual object (523) can be positioned at the top. Accordingly, the electronic device (101) can display the second visual object (523). The electronic device (101) can receive a user input for a minimization operation of the first pop-up window (510), such as a minimization operation of the second pop-up window (520) in the first screen (501) and the second screen (502). Based on the user input for minimizing the first pop-up window (510), the electronic device (101) can display the fourth screen (504).
[0083] In the fourth screen (504), the electronic device (101) may display a first visual object (513) associated with the first pop-up window (510). For example, the first visual object (513) may include an app icon of a first application (e.g., a calculator application) of the first pop-up window (510). The first visual object (513) may be stacked on top of a second visual object (523). For example, since the first pop-up window (510) has been used more recently than the second pop-up window (520), the electronic device (101) may stack the first visual object (513) associated with the first pop-up window (510) on top of the second visual object (523). Since the first visual object (513) is located at the top among the stacked visual objects, the electronic device (101) may display the first visual object (513). As the first visual object (513) is stacked, the electronic device (101) may stop displaying the second visual object (523). While displaying the first visual object (513), the electronic device (101) may be running an application (e.g., a phone application) related to the second visual object (523) stacked below the first visual object (513) in the background. The electronic device (101) may receive a user input for a minimization operation of the third pop-up window (530), such as a minimization operation of the first pop-up window (510). Based on the user input for the minimization operation of the third pop-up window (530), the electronic device (101) may display a fifth screen (505).
[0084] In the fifth screen (505), the electronic device (101) may display a third visual object (533) associated with the third pop-up window (530). For example, the third visual object (533) may include an app icon of a third application (e.g., a settings application) of the third pop-up window (530). The third visual object (533) may be stacked on top of the first visual object (513). For example, since the third pop-up window (530) has been used more recently than the first pop-up window (510), the electronic device (101) may stack the third visual object (533) associated with the third pop-up window (530) on top of the first visual object (513). Since the third visual object (533) is located at the top among the stacked visual objects, the electronic device (101) may display the third visual object (533). As the third visual object (533) is stacked, the electronic device (101) may stop displaying the first visual object (513). While displaying the third visual object (533), the electronic device (101) may be running in the background an application (e.g., a calculator application) associated with the first visual object (513) stacked below the third visual object (533) and an application (e.g., a phone application) associated with the second visual object (523).
[0085] When the operations of FIG. 5 are performed, multiple visual objects can be stacked. For example, a second visual object (523), a first visual object (513), and a third visual object (533) can be sequentially stacked. Since the third visual object (533) is positioned at the top, the electronic device (101) can display the third visual object (533). Through the operations of FIG. 5, the stacked visual objects described in FIG. 2 can be configured.
[0086] Although FIG. 5 illustrates an example of stacking visual objects through a control option of an individual pop-up window (e.g., a symbol (522d) for minimizing), embodiments of the present disclosure are not limited thereto. The visual objects may be stacked through various inputs. In one embodiment, the electronic device (101) may convert a specific pop-up window into an app icon through a user input (e.g., a drag input) that moves one end of the pop-up window (e.g., the upper right) to the opposite end (e.g., the lower left). The electronic device (101) may minimize the pop-up window through the user input instead of the symbol of the control option. In response to the minimization of the pop-up window, a visual object associated with the pop-up window may be stacked. The visual objects may be stacked through the minimization operation of FIG. 5 and / or the minimization operation using the user input. According to one embodiment, when the electronic device (101) receives a user input (e.g., a tap input) for a designated button (e.g., a home button (571), a recently executed app button (572)) while a plurality of pop-up windows are displayed (e.g., a first screen (501)), the electronic device may stack a plurality of visual objects related to the plurality of pop-up windows. The electronic device (101) may determine a stacking order according to an activation order (or a focused order) of the plurality of pop-up windows. The electronic device (101) may stack the plurality of visual objects according to the stacking order. According to one embodiment, when the electronic device (101) detects a designated gesture (e.g., a gesture related to a home view function, a gesture related to a recently executed app view function) while a plurality of pop-up windows are displayed (e.g., a first screen (501)), the electronic device may stack a plurality of visual objects related to the plurality of pop-up windows. The electronic device (101) may determine a stacking order according to an activation order of the plurality of pop-up windows.The electronic device (101) can stack the plurality of visual objects according to the stacking order.
[0087] Figure 6 illustrates an example of reordering visual objects. The visual objects may be stacked. Depending on the stacking order of the visual objects (hereinafter, referred to as stacking order), the visual objects may be arranged within a container. The reordering may indicate a change in the stacking order or the sorted order (hereinafter, referred to as sorting order). To explain the stacked visual objects, reference may be made to the descriptions of Figures 2 to 5.
[0088] Referring to FIG. 6, on a first screen (601), an electronic device (101) can display a first visual object (211). The electronic device (101) can receive a user input (610) for the first visual object (211). For example, the user input (610) can include a tap input, a double tap input, a press input, a drag input, a fling input, or a designated gesture input. Hereinafter, embodiments are described based on the user input (610) being the tap input. The electronic device (101) can display a second screen (602) based on the user input (610).
[0089] In the second screen (602), the electronic device (101) can display a container object (210) and a plurality of visual objects (e.g., a first visual object (211), a second visual object (212), a third visual object (213), and a fourth visual object (214)). The container object (210) can represent a container for a pop-up window. The container object (210) can be used to represent each of the stacked visual objects. The container object (210) can be used to display a pop-up window of an application associated with the visual object based on a user input (e.g., a touch input) for the visual object. The stacked visual objects can be arranged on the container object (210). The first visual object (211), the second visual object (212), the third visual object (213), and the fourth visual object (214) can be stacked. For example, a first visual object (211) may include an app icon for a photo application. A second visual object (212) may include an app icon for a settings application. A third visual object (213) may include an app icon for a calculator application. A fourth visual object (214) may include an app icon for a phone application. The visual objects may be stacked in the following order: the fourth visual object (214), the third visual object (213), the second visual object (212), and the first visual object (211). The electronic device (101) may display the stacked visual objects arranged in the following order: the first visual object (211), the second visual object (212), the third visual object (213), and the fourth visual object (214) on a container object (210). The order in which the stacked visual objects are arranged may indicate a stacking order of the visual objects.
[0090] The electronic device (101) can change the sorting order. For example, a user of the electronic device (101) may want to place the first visual object (211) located at the top to be located at the second top, and the second visual object (212) to be located at the top. In the third screen (603), the electronic device (101) can receive a user input (620) (e.g., press, drag and drop) for the first visual object (211). For example, the electronic device (101) can select the first visual object (211) through a press input of the user input (620), and move the first visual object (211) between the second visual object (212) and the third visual object (213) in the container object (210) through a drag and drop of the user input (620). In the fourth screen (604), the electronic device (101) can display a space (609) between the second visual object (212) and the third visual object (213) in the container object (210) based on the user input (620). The electronic device (101) can change the sorting order by moving the selected first visual object (211) to the space (609). The sorting order of the first visual object (211), the second visual object (212), the third visual object (213), and the fourth visual object (214) can be changed to the sorting order of the second visual object (212), the first visual object (211), the third visual object (213), and the fourth visual object (214). The electronic device (101) can display the fifth screen (605) based on the user input (620).
[0091] In the fifth screen (605), the electronic device (101) can display a plurality of visual objects and containers. The plurality of visual objects can be arranged in the following order: a second visual object (212), a first visual object (211), a third visual object (213), a fourth visual object (214), and a fifth visual object (215).
[0092] FIG. 7 illustrates an example of movement of a container object (e.g., a container object (210)) and visual objects (e.g., a first visual object (211), a second visual object (212), and a third visual object (213)). To explain the stacked visual objects, reference may be made to the descriptions of FIGS. 2 to 6.
[0093] Referring to FIG. 7, in a first screen (701), an electronic device (101) can display a first visual object (211). The electronic device (101) can receive a user input (710) for the first visual object (211). For example, the user input (710) can include a tap input, a double tap input, a press input, a drag input, a fling input, or a designated gesture input. Hereinafter, embodiments are described based on the user input (710) being the tap input. The electronic device (101) can display a second screen (702) based on the user input (710).
[0094] In the second screen (702), the electronic device (101) can display a container object (210) and a plurality of visual objects (e.g., a first visual object (211), a second visual object (212), a third visual object (213), and a fourth visual object (214)). The container object (210) can represent a container for a pop-up window. The stacked visual objects are arranged on the container object (210). The first visual object (211), the second visual object (212), the third visual object (213), and the fourth visual object (214) can be stacked. For example, the first visual object (211) can include an app icon for a photo application. The second visual object (212) can include an app icon for a settings application. The third visual object (213) can include an app icon for a calculator application. The fourth visual object (214) can include an app icon for a phone application.
[0095] The electronic device (101) can move the container object (210) and the stacked visual objects on the display. For example, the user of the electronic device (101) may want to move the stacked visual objects and the container from their current location to another location at once. On the second screen (702), the electronic device (101) can receive a user input (720). For example, the user input (720) may include a multi-touch input, a double-tap input, a press input, a drag input, a fling input, or a designated gesture input. The multi-touch input may indicate an input (e.g., a drag, a fling, a press, a rotation) performed by simultaneously touching the screen with multiple pointers (e.g., fingers, pens). For example, the user input (720) may include a drag input using two fingers. The electronic device (101) can display a third screen (703) based on the user input (720). In the third screen (703), the electronic device (101) can display a container object (210) and stacked visual objects at different locations from each location of the second screen (702). Each of the container object (210) and the stacked visual objects can move to a location according to a user input (720). For example, the electronic device (101) can display a container object (210) displayed at a first location at a second location based on the user input (720). As the container object (210) moves, a plurality of visual objects displayed on the container object (210) can move together.
[0096] In the fourth screen (704), the electronic device (101) can receive a user input in a different area from the container object (210) displayed in the second location. Based on the user input, the electronic device (101) can terminate the display of the container object (210). Based on the user input, the electronic device (101) can display the first visual object (211) stacked at the top among the plurality of visual objects.
[0097] Fig. 8 illustrates an example of changing the orientation of a container object and visual objects. Stacked visual objects can be arranged according to the stacking order. The arranged visual objects can be aligned based on one direction (e.g., the (+) x-axis direction). However, the direction in which the visual objects are aligned (hereinafter, referred to as the alignment direction) can be changed according to user input. To explain the stacked visual objects, reference may be made to the descriptions of Figs. 2 to 7.
[0098] Referring to FIG. 8, in the first screen (801), the electronic device (101) may display a container object (210) and a plurality of visual objects (e.g., a first visual object (211), a second visual object (212), a third visual object (213), and a fourth visual object (214)). For example, the first visual object (211) may include an app icon for a photo application. The second visual object (212) may include an app icon for a settings application. The third visual object (213) may include an app icon for a calculator application. The fourth visual object (214) may include an app icon for a phone application. The electronic device (101) may move the container object (210) and the stacked visual objects on the display. For example, a user of the electronic device (101) may want to change the direction in which the visual objects are aligned from a first direction (e.g., an x-axis direction) to a second direction (e.g., a y-axis direction). In the first screen (801), the electronic device (101) can receive a user input (820). For example, the user input (820) can include a multi-touch input, a double-tap input, a press input, a drag input, a fling input, or a designated gesture input. The multi-touch input can indicate an input (e.g., a drag, a fling, a press, a rotation) performed by simultaneously touching the screen with multiple pointers (e.g., fingers, pens). For example, the user input (720) can include a rotation input using two fingers. The electronic device (101) can display a second screen (802) based on the user input (820).
[0099] In the second screen (802), the electronic device (101) can display a container object (210) and stacked visual objects that are being rotated. For example, the container object (210) and stacked visual objects can be rotated based on a fixed point at which a user input (820) is initiated. Based on the user input (820), the stacked visual objects can be moved in addition to simply changing their alignment direction. As the container object (210) moves, a plurality of visual objects displayed on the container object (210) can move together.
[0100] In the third screen (803), the electronic device (101) can display stacked visual objects aligned in a second direction (e.g., y-axis direction) different from the first direction (e.g., x-axis direction) of the first screen (801). For example, the second direction can be substantially perpendicular to the first direction. The shape of the container object (210) can be displayed in a state rotated with respect to the second direction. For example, the electronic device (101) can display a plurality of visual objects aligned in the second direction and the container object (210) rotated along the second direction based on a user input (820).
[0101] Figures 9a and 9b illustrate examples of preview windows of applications associated with visual objects. The preview windows may represent at least a portion of the application's execution screen. Based on user input regarding the visual object, a preview window of the application associated with the visual object may be provided. To explain the visual objects, reference may be made to the descriptions of Figures 2 to 8.
[0102] Referring to FIG. 9A, in the first screen (901), the electronic device (101) may display a container object (210) and a plurality of visual objects (e.g., a first visual object (211), a second visual object (212), a third visual object (213), and a fourth visual object (214)). The container object (210) may represent a container for a pop-up window. The stacked visual objects are arranged on the container object (210). The first visual object (211), the second visual object (212), the third visual object (213), and the fourth visual object (214) may be stacked. For example, the first visual object (211) may include an app icon for a photo application. The second visual object (212) may include an app icon for a settings application. The third visual object (213) may include an app icon for a calculator application. The fourth visual object (214) may include an app icon for a phone application. An electronic device (101) can display a preview window of an application associated with a visual object. For example, a user of the electronic device (101) may want to know in advance the execution screen of an application associated with a visual object. The electronic device (101) can receive a user input (910) for the preview. For example, the user input (910) may include a hovering input using a stylus pen, a double-tap input, a press input, a drag input, a fling input, or a designated gesture input. Hereinafter, embodiments are described based on the user input (910) being the hovering input.
[0103] In the second screen (902), the electronic device (101) may display a preview window (932) of an application (e.g., a settings application) associated with the second visual object (212) based on a user input (910) for the second visual object (212). For example, the electronic device (101) may display an execution screen of the settings application associated with the second visual object (212) through the preview window (932) based on detecting a hovering input on the second visual object (212). The hovering input may be provided via a stylus pen. In the third screen (903), the electronic device (101) may display a preview window (933) of an application (e.g., a calculator application) associated with the third visual object (213) based on a user input (910) for the third visual object (213). For example, the electronic device (101) may display an execution screen of a calculator application associated with the third visual object (213) through a preview window (933) based on detecting a hovering input on the third visual object (213). The hovering input may be provided through a stylus pen.
[0104] FIG. 9a illustrates an example in which a preview window of an application associated with a visual object is displayed in response to a user input (e.g., a hovering input) on an individual visual object. However, even in a situation in which multiple visual objects are stacked, a user of the electronic device (101) may want to check the execution screen of each visual object without unfolding the stacked visual objects. FIG. 9b illustrates an example in which the electronic device (101) displays a preview window on a screen in which multiple visual objects are stacked.
[0105] Referring to FIG. 9B, on the first screen (951), the electronic device (101) may display a first visual object (211). For example, the first visual object (211) may include an app icon for a phone application. Although not displayed on the first screen (951), a plurality of visual objects may be stacked. For example, the first visual object (211), a second visual object associated with a calculator application, and a third visual object associated with a settings application may be stacked. Since the first visual object (211) is located at the top of the plurality of visual objects, the electronic device (101) may display the first visual object (211). The electronic device (101) may display a preview window of an application associated with each visual object of the stacked visual objects. For example, a user of the electronic device (101) may want to know all of the applications associated with the visual objects stacked under the first visual object (211). The electronic device (101) can receive a user input (920). For example, the user input (920) may include a hovering input using a stylus pen, a double-tap input, a press input, a drag input, a fling input, or a designated gesture input. Hereinafter, embodiments are described based on the user input (920) being the hovering input.
[0106] On the second screen (952), the electronic device (101) can display preview windows of applications associated with the stacked visual objects. The electronic device (101) can identify the stacked visual objects. The electronic device (101) can identify an application of each visual object of the stacked visual objects. The electronic device (101) can display a preview window of each of the identified applications. For example, the electronic device (101) can identify a first visual object (211), a second visual object (212), and a third visual object (213). The electronic device (101) can identify a phone application associated with the first visual object (211), a calculator application associated with the second visual object (212), and a settings application associated with the third visual object (213). The electronic device (101) can display a preview window (960) of the phone application, a preview window (970) of the calculator application, and a preview window (980) of the settings application. For example, the electronic device (101) can display the preview window (960), the preview window (970), and the preview window (980) around the first visual object (211), respectively.
[0107] Although FIG. 9B describes that preview windows of all visual objects are displayed, embodiments of the present disclosure are not limited thereto. According to one embodiment, the electronic device (101) may display a specified number of preview screens (e.g., three). For example, in a situation where four visual objects are stacked, the electronic device (101) may receive a user input (920). Based on the user input (920), the electronic device (101) may display preview screens of applications associated with the top three visual objects. The electronic device (101) may not display a preview screen of the application of the fourth visual object.
[0108] Although hovering input using a stylus pen is exemplified in FIGS. 9A and 9B , embodiments of the present disclosure are not limited thereto. For example, the user input (910) and / or the user input (920) may be a multi-touch input using two fingers. For example, the user input (910) and / or the user input (920) may include a designated gesture. For example, the user input (910) and / or the user input (920) may include a voice command indicating the display of a preview. For example, the user input (910) and / or the user input (920) may include an input of a designated button (e.g., a home button, a recently run app button, a volume button, a power button).
[0109] Figures 10a and 10b illustrate examples of displaying pop-up windows. A pop-up window may represent an execution screen displayed as a pop-up. The pop-up window may be used to access other applications while using the home screen or an application screen. To explain stacked visual objects and pop-up windows, reference may be made to the descriptions of Figures 2 through 9b.
[0110] Referring to FIG. 10A, on the first screen (1001), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the first screen (1001), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212) associated with a calculator application, and a third visual object (213) associated with a settings application may be stacked. For example, the visual objects may be stacked in the following order: the second visual object (212), the first visual object (211), and the third visual object (213). Since the second visual object (212) is located at the top among the plurality of visual objects, the electronic device (101) may display the second visual object (212). The electronic device (101) can display a pop-up window of an application associated with each visual object of the stacked visual objects. For example, a user of the electronic device (101) may want to know all applications associated with the visual objects stacked under the second visual object (212). The electronic device (101) can receive a user input (1010). For example, the user input (1010) can include a shaking input, a tap input, a double-tap input, a press input (or a long press input (e.g., an input of maintaining a touch input for a certain period of time)), a drag input, a fling input, or a designated gesture input. The electronic device (101) can display a second screen (1002) based on the user input (1010).
[0111] On the second screen (1002), the electronic device (101) can display a plurality of pop-up windows. For example, the electronic device (101) can display a first pop-up window (510). For example, the first pop-up window (510) can represent an execution screen of a first application (e.g., a calculator application). The electronic device (101) can display a second pop-up window (520). For example, the second pop-up window (520) can represent an execution screen of a second application (e.g., a phone application). The electronic device (101) can display a third pop-up window (530). For example, the third pop-up window (530) can represent an execution screen of a third application (e.g., a settings application).
[0112] Referring to FIG. 10B, on the first screen (1051), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the first screen (1051), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212) associated with a calculator application, and a third visual object (213) associated with a settings application may be stacked. For example, the visual objects may be stacked in the following order: the second visual object (212), the first visual object (211), and the third visual object (213). Since the second visual object (212) is located at the top among the plurality of visual objects, the electronic device (101) may display the second visual object (212). Unlike the user input (1010) illustrated in FIG. 10A, the electronic device (101) can display a second screen (1052) through a pinch-out input (1060) (or zoom-out input). Through the pinch-out input (1060), pop-up windows corresponding to the stacked visual objects can be displayed more intuitively. In the second screen (1052), the electronic device (101) can display a plurality of pop-up windows. For example, the electronic device (101) can display a first pop-up window (510). For example, the first pop-up window (510) can represent an execution screen of a first application (e.g., a calculator application). The electronic device (101) can display a second pop-up window (520). For example, the second pop-up window (520) can represent an execution screen of a second application (e.g., a phone application). The electronic device (101) may display a third pop-up window (530). For example, the third pop-up window (530) may display an execution screen of a third application (e.g., a settings application).
[0113] Examples of displaying pop-up windows are described in FIGS. 10A and 10B. After the pop-up windows are displayed, the electronic device (101) can stack visual objects by sequentially minimizing the pop-up windows, as described in FIG. 5. Furthermore, after the pop-up windows are displayed, the electronic device (101) can display the pop-up windows so that they overlap within a designated area. Examples of overlapping pop-up windows are described through FIGS. 11A and 11B.
[0114] Figures 11a and 11b show examples of alignment of pop-up windows.
[0115] Referring to FIG. 11A, on the first screen (1101), the electronic device (101) may display a plurality of pop-up windows. For example, the electronic device (101) may display a first pop-up window (510). For example, the first pop-up window (510) may represent an execution screen of a first application (e.g., a calculator application). The electronic device (101) may display a second pop-up window (520). For example, the second pop-up window (520) may represent an execution screen of a second application (e.g., a phone application). The electronic device (101) may display a third pop-up window (530). For example, the third pop-up window (530) may represent an execution screen of a third application (e.g., a settings application). Each pop-up window may include a handle for movement and / or control. For example, the first pop-up window (510) may include a first handle (511). The second pop-up window (520) may include a second handle (521). The third pop-up window (530) may include a third handle (531). The electronic device (101) may receive a user input (1110). For example, the user input (1110) may include a shake input, a tap input, a double-tap input, a press input (or a long press input), a drag input, a fling input, or a designated gesture input. The electronic device (101) may receive a user input (1110) for the second handle (521). Based on the user input (1110) for the second handle (521), the electronic device (101) may align a plurality of pop-up windows based on the second pop-up window (520) having the second handle (521). The electronic device (101) can display a second screen (1102) based on user input (1110).
[0116] On the second screen (1102), the electronic device (101) can display a plurality of aligned pop-up windows. The electronic device (101) can arrange the pop-up windows according to a predetermined order (e.g., the sorting order or stacking order of the visual objects). For example, referring to the example illustrated in FIG. 10A, the visual objects can be stacked in the order of the third visual object (213), the first visual object (211), and the second visual object (212). In addition to the second visual object (212) provided in the user input (1110), the third visual object (213) can be stacked followed by the first visual object (211). The electronic device (101) can display the second pop-up window (520) at the top based on the user input (1110). The electronic device (101) can display the second screen (1102) so that the first pop-up window (510) is overlapped on the third pop-up window (530) and the second pop-up window (520) is overlapped on the first pop-up window (510). For example, the z-index of the second pop-up window (520) can be 1. The z-index of the first pop-up window (510) can be 10. The z-index of the third pop-up window (530) can be 15. The pop-up windows can be arranged in order of increasing z-index size. The electronic device (101) can display other pop-up windows by overlapping them within an area including the second pop-up window (520). The other pop-up windows may include pop-up windows of applications (e.g., calculator application, settings application) related to visual objects (e.g., first visual object (211), third visual object (213)) stacked together with the second visual object (212). Since at least a portion of the first pop-up window (510) overlaps with the second pop-up window (520), the electronic device (101) may display an area of the first pop-up window (510) that does not overlap with the second pop-up window (520).Since at least a portion of the third pop-up window (530) overlaps with the first pop-up window (510) and the second pop-up window (520), the electronic device (101) can display an area of the third pop-up window (530) that does not overlap with the first pop-up window (510) and the second pop-up window (520).
[0117] Referring to FIG. 11B, in the first screen (1151), the electronic device (101) may display a plurality of pop-up windows. For example, the electronic device (101) may display a first pop-up window (510). For example, the first pop-up window (510) may represent an execution screen of a first application (e.g., a calculator application). The electronic device (101) may display a second pop-up window (520). For example, the second pop-up window (520) may represent an execution screen of a second application (e.g., a phone application). The electronic device (101) may display a third pop-up window (530). For example, the third pop-up window (530) may represent an execution screen of a third application (e.g., a settings application). Each pop-up window may include a handle for movement and / or control. For example, the first pop-up window (510) may include a first handle (511). The second pop-up window (520) may include a second handle (521). The third pop-up window (530) may include a third handle (531). Unlike the user input (1110) illustrated in FIG. 11A, the electronic device (101) may display the second screen (1152) through a pinch-in input (1160) (or zoom-in input). For example, the electronic device (101) may receive a pinch-in input (1160) for the second handle (521). Based on the pinch-in input (1160) for the second handle (521), the electronic device (101) may align a plurality of pop-up windows based on the second pop-up window (520) having the second handle (521). The electronic device (101) can display a second screen (1152) based on a pinch-in input (1160).
[0118] On the second screen (1152), the electronic device (101) can display a plurality of aligned pop-up windows. The electronic device (101) can arrange the pop-up windows according to a predetermined order (e.g., the sorting order or stacking order of the visual objects). For example, referring to the example illustrated in FIG. 10B, the visual objects can be stacked in the order of the third visual object (213), the first visual object (211), and the second visual object (212). In addition to the second visual object (212) provided in the user input (1020), the third visual object (213) can be stacked followed by the first visual object (211). The electronic device (101) can display the second pop-up window (520) at the top based on the pinch-in input (1160). The electronic device (101) can display a second screen (1152) such that a first pop-up window (510) is overlapped on a third pop-up window (530) and a second pop-up window (520) is overlapped on the first pop-up window (510). For a description of the alignment of the pop-up windows, reference may be made to FIG. 11A.
[0119] Although not illustrated in FIGS. 11A and 11B , a user of the electronic device (101) may desire to move a particular pop-up window (e.g., a first pop-up window (510)). The electronic device (101) may move the first pop-up window (510) from its current location to a different location based on a user input (e.g., a drag) to the first handle (511) of the first pop-up window (510). As the first pop-up window (510) is displayed in a different area, the pop-up windows may no longer be aligned.
[0120] Figures 12a and 12b illustrate examples of minimizing aligned pop-up windows.
[0121] Referring to FIG. 12A, on the first screen (1201), the electronic device (101) can display a plurality of aligned pop-up windows. The electronic device (101) can arrange the pop-up windows according to a predetermined order (e.g., an arrangement order or a stacking order of visual objects). The electronic device (101) can display the second pop-up window (520) at the top. The electronic device (101) can display the first screen (1201) such that the first pop-up window (510) is overlapped on the third pop-up window (530), and the second pop-up window (520) is overlapped on the first pop-up window (510). For a description of the aligned pop-up windows, reference may be made to FIGS. 11A and 11B.
[0122] The electronic device (101) can receive a user input (1210). For example, the user input (1210) can include a shake input, a tap input, a double-tap input, a press input (or a long press input), a drag input, a fling input, or a designated gesture input. The electronic device (101) can receive a user input (1210) for a second handle (521). Based on the user input (1210) for the second handle (521), the electronic device (101) can stack visual objects. The electronic device (101) can stack visual objects associated with applications of pop-up windows displayed on the display. For example, the first visual object (211) can include an app icon associated with a calculator application of the first pop-up window (510). The second visual object (212) can include an app icon associated with a phone application of the second pop-up window (520). The third visual object (213) may include an app icon associated with a settings application of the third pop-up window (530). The electronic device (101) may identify applications of the pop-up windows displayed on the display. For example, the electronic device (101) may identify the calculator application, the phone application, and the settings application. The electronic device (101) may identify a visual object associated with an application that is located at the top of the stack order among the applications. For example, the electronic device (101) may identify a second visual object (212) associated with the phone application. The electronic device (101) may display a second screen (1202) based on a user input (1210).
[0123] On the second screen (1202), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the second screen (1202), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212), and a third visual object (213) associated with a calculator application may be stacked. Since the second visual object (212) is located at the top of the plurality of visual objects, the electronic device (101) may display the second visual object (212). While the electronic device (101) displays the second visual object (212), applications of the visual objects stacked below the second visual object (212) (e.g., a calculator application, a settings application) may be running in the background. The applications running in the background may be in a pause state.
[0124] Referring to FIG. 12B, on the first screen (1251), the electronic device (101) can display a plurality of aligned pop-up windows. The electronic device (101) can arrange the pop-up windows according to a predetermined order (e.g., an arrangement order or a stacking order of visual objects). The electronic device (101) can display the second pop-up window (520) at the top. The electronic device (101) can display the first screen (1251) such that the first pop-up window (510) is overlapped on the third pop-up window (530), and the second pop-up window (520) is overlapped on the first pop-up window (510). For a description of the aligned pop-up windows, reference may be made to FIG. 11A or FIG. 11B. Unlike the user input (1210) illustrated in FIG. 12A, the electronic device (101) can display a second screen (1252) through a pinch-in input (1260) (or zoom-in input). The electronic device (101) can receive a pinch-in input (1260) for the second handle (521). Through the pinch-in input (1260), stacking of visual objects can be performed more intuitively. The electronic device (101) can stack visual objects associated with applications of pop-up windows displayed on the display. The electronic device (101) can identify a visual object associated with an application (e.g., a phone application of the second pop-up window (520)) that is located at the top in stacking order among the applications. For example, the electronic device (101) can identify a second visual object (212) associated with the phone application. The electronic device (101) can display a second screen (1252) through a pinch-in input (1260).
[0125] On the second screen (1252), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the second screen (1252), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212) associated with a calculator application, and a third visual object (213) associated with a settings application may be stacked. Since the second visual object (212) is located at the top of the plurality of visual objects, the electronic device (101) may display the second visual object (212). While the electronic device (101) displays the second visual object (212), applications of the visual objects stacked below the second visual object (212) (e.g., a calculator application, a settings application) may be running in the background. For an explanation of minimizing the above-mentioned sorted pop-up windows, reference may be made to FIG. 12a.
[0126] Figures 13a and 13b illustrate examples of movement of stacked visual objects.
[0127] Referring to FIG. 13A, on a first screen (1301), the electronic device (101) may display a plurality of app icons (e.g., APP 1, APP 2, ..., APP 20). The stack of visual objects described through FIGS. 2 to 12B may be applied not only to app icons corresponding to minimized pop-up windows, but also to an operation of moving a plurality of app icons. A user of the electronic device (101) may want to move app icons on the screen (1301). For example, a user of the electronic device (101) may want to move a first app icon (1311) (APP 9), a second app icon (1312) (APP 10), and a third app icon (1313) (APP 11). The electronic device (101) may receive user inputs for selecting the first app icon (1311), the second app icon (1312), and the third app icon (1313). The electronic device (101) can receive a user input (1310) while the first app icon (1311), the second app icon (1312), and the third app icon (1313) are activated. For example, the user input (1310) can include a shake input, a tap input, a double-tap input, a press input (or a long press input), a drag input, a fling input, or a designated gesture input. For example, the electronic device (101) can receive a user input (1310) for the first app icon (1311). The electronic device (101) can display app icons stacked in the order of the first app icon (1311), the second app icon (1312), and the third app icon (1313) according to the user input (1310). The app icons can be arranged according to the position of the user input (1310) and / or the order in which they are arranged within the screen (1301). If a user input (1310) for the second app icon (1312) is received, the second app icon (1312), the first app icon (1311), and the third app icon (1313) may be stacked in that order.
[0128] On the second screen (1302), the electronic device (101) may display stacked app icons (e.g., a first app icon (1311), a second app icon (1312), and a third app icon (1313)) in response to a user input (1310). The stacked app icons may move together as the user input (1310) moves.
[0129] In one embodiment, the opacity of each app icon may vary depending on the arrangement order of the stacked app icons. For example, the opacity may gradually decrease from the topmost stacked app icon to the bottommost stacked app icon. For example, the opacity of the first app icon (1311) may be higher than the opacity of the second app icon (1312). For example, the opacity of the second app icon (1312) may be higher than the opacity of the third app icon (1313).
[0130] In one embodiment, the size of the app icons may vary depending on the arrangement order of the stacked app icons. For example, the sizes of the app icons may gradually decrease in order from the topmost stacked app icon to the bottommost stacked app icon. For example, the size of the second app icon (1312) may be smaller than the size of the first app icon (1311). For example, the size of the third app icon (1313) may be smaller than the size of the second app icon (1312).
[0131] According to one embodiment, the movement speed may vary depending on the number of stacked app icons. The electronic device (101) may control the movement speed of one or more app icons (e.g., a second app icon (1312), a third app icon (1313)) following the topmost app icon (e.g., a first app icon (1311)) based on the number of stacked app icons. For example, the movement speed corresponding to a case where the number of stacked app icons is five may be slower than the movement speed corresponding to a case where the number of stacked app icons is three.
[0132] Control of the movement speed may be performed through the relationship between the upper app icon and subsequent app icons. According to one embodiment, the electronic device (101) may display subsequent app icons through spring animation. The electronic device (101) may set parameters (e.g., stiffness, damping ratio) for the spring animation based on the number of stacked app icons. For example, the damping ratio may be set to be large so that the user of the electronic device (101) feels that the icon is moving faster as the number of stacked app icons decreases. The damping ratio may be set to be small so that the user of the electronic device (101) feels that the icon is moving slower as the number of stacked app icons increases. For example, the stiffness may be set to be low so that the number of stacked app icons decreases. The stiffness may be set to be high so that the user of the electronic device (101) feels that the icon is moving more slowly. In the present disclosure, stiffness and damping ratio are exemplified to represent the spring effect, but the embodiments of the present disclosure are not limited thereto. Tension and friction may be used to represent the spring effect. The tension represents the strength of the spring, and the higher the value of the tension, the more strongly the object can move like a spring. Meanwhile, the friction represents the frictional force of the spring. The higher the value of the friction, the slower the movement can be due to the frictional force of the spring. According to another embodiment, the electronic device (101) may control the movement timing of the subsequent app icon based on the number of stacked app icons. When the number of stacked app icons is smaller, the electronic device (101) may set the movement timing of the subsequent app icon closer to the time when the movement of the top-positioned app icon is initiated so that the user of the electronic device (101) feels that the icons are moving faster.As the number of stacked app icons increases, the electronic device (101) may set the movement point of subsequent app icons to be further away from the movement point of the top-most app icon so that the user of the electronic device (101) feels that the icons are moving more slowly.
[0133] At the position where the user input (1310) ends, the stacked app icons may be moved. Thereafter, the electronic device (101) may display the app icons on the grid of the screen (1302) in the order in which the app icons are stacked. For example, the electronic device (101) may display the first app icon (1311), the second app icon (1312), and the third app icon (1313) after the app icon of 'APP 20'.
[0134] Although FIG. 13A illustrates a situation in which app icons are stacked when moving them, embodiments of the present disclosure are not limited thereto. In addition to minimizing pop-up windows or moving app icons, stacks and effects within the stacks according to embodiments of the present disclosure (e.g., speed based on the number of stacked visual objects, display of opacity of stacked visual objects) can be applied to stacked visual objects. In one embodiment, this can be applied to a situation in which images are moved in a gallery application. A detailed example is described with reference to FIG. 13B.
[0135] Referring to FIG. 13B, on the first screen (1351), the electronic device (101) can execute a gallery application. The electronic device (101) can display multiple images. The stack of visual objects described through FIGS. 2 to 12B can be applied not only to images corresponding to minimized pop-up windows, but also to an operation of moving multiple images. A user of the electronic device (101) may want to move images at once on the screen (1351). For example, a user of the electronic device (101) may want to move a first image (1361), a second image (1362), a third image (1363), and a fourth image (1364). The electronic device (101) can receive user inputs selecting the first image (1361), the second image (1362), the third image (1363), and the fourth image (1364). The electronic device (101) can receive a user input (1360) while the first image (1361), the second image (1362), the third image (1363), and the fourth image (1364) are selected. For example, the user input (1360) can include a shake input, a tap input, a double tap input, a press input (or a long press input), a drag input, a fling input, or a designated gesture input. For example, the electronic device (101) can receive the user input (1360) on the first image (1311). The electronic device (101) can display images stacked in the order of the first image (1361), the second image (1362), the third image (1363), and the fourth image (1364) according to the user input (1360). The above images may be arranged according to the location of the user input (1360) and / or the order in which they are arranged within the screen (1351).
[0136] On the second screen (1352), the electronic device (101) can display stacked images (e.g., a first image (1311), a second image (1312), a third image (1313), and a fourth image (1314)) in response to a user input (1360). The stacked images can move together according to the movement of the user input (1360).
[0137] In one embodiment, the opacity of each image may vary depending on the sorting order of the stacked images. For example, the opacity may gradually decrease from the topmost stacked image to the bottommost stacked image. For example, the opacity of a first image (1361) may be higher than the opacity of a second image (1362). For example, the opacity of a second image (1362) may be higher than the opacity of a third image (1363). For example, the opacity of a third image (1363) may be higher than the opacity of a fourth image (1364).
[0138] In one embodiment, the image sizes may vary depending on the sorting order of the stacked images. For example, the sizes of the images may become progressively smaller in order from the topmost stacked image to the bottommost stacked image. For example, the size of the second image (1362) may be smaller than the size of the first image (1361). For example, the size of the third image (1363) may be smaller than the size of the second image (1362). For example, the size of the fourth image (1364) may be smaller than the size of the third image (1363).
[0139] According to one embodiment, the movement speed may vary depending on the number of stacked images. The electronic device (101) may control the movement speed of one or more images (e.g., a second image (1362), a third image (1363), a fourth image (1364)) following the topmost image (e.g., a first image (1361)) based on the number of stacked images. For example, when the number of stacked images is five, the corresponding movement speed may be slower than the corresponding movement speed when the number of stacked images is three.
[0140] Control of the movement speed may be performed through the relationship between the upper image and subsequent images. According to one embodiment, the electronic device (101) may display subsequent images through spring animation. The electronic device (101) may set parameters (e.g., stiffness, damping ratio) for the spring animation based on the number of stacked images. For example, the damping ratio may be set to be large so that the user of the electronic device (101) feels that the device is moving faster as the number of stacked images decreases. The damping ratio may be set to be small so that the user of the electronic device (101) feels that the device is moving slower as the number of stacked images increases. For example, the stiffness may be set to be low so that the number of stacked images decreases. The stiffness may be set to be high so that the number of stacked images increases. In the present disclosure, stiffness and damping ratio are exemplified to represent the spring effect, but embodiments of the present disclosure are not limited thereto. To represent the spring effect, tension and friction can be used. The tension represents the strength of the spring, and the higher the value of the tension, the stronger the object can move like a spring. Meanwhile, the friction represents the frictional force of the spring. The higher the value of the friction, the slower the movement can be due to the frictional force of the spring. According to another embodiment, the electronic device (101) can control the movement time of the subsequent image based on the number of the stacked images. When the number of stacked images is small, the electronic device (101) can set the movement time of the subsequent image closer to the time when the movement of the image located at the top is started so that the user of the electronic device (101) feels that the image is moving faster.As the number of stacked images increases, the electronic device (101) can set the movement point of subsequent images to be further away from the movement point of the image at the top, so that the user of the electronic device (101) feels that the movement is slower.
[0141] At the position where the user input (1360) ends, the stacked images can be moved. Thereafter, the electronic device (101) can display the images on the array of the screen (1352) according to the stacked order of the images.
[0142] Figures 14a and 14b illustrate examples of data movement between applications.
[0143] Referring to FIG. 14A, the electronic device (101) may be running multiple applications. For example, the electronic device (101) may be running a first application (e.g., an Internet application) and a second application (e.g., a note application). The descriptions of FIGS. 2 through 13B may also be applied to the movement of data (e.g., images, links, text) between applications.
[0144] The electronic device (101) can display a first window (1411a) corresponding to the first application and a second window (1411b) corresponding to the second application on the first screen (1401). While displaying the first window (1411a) and the second window (1411b), the electronic device (101) can receive a user input (1410). The electronic device (101) can receive a user input (1410) for a first image (1421). For example, the user input (1410) can include a dragging action of the first image (1421) in one direction (e.g., from the left to the right) or a fling input (e.g., a motion of moving an input object (e.g., a finger or a pen) and then flicking the first image (1421). For example, the user input (1410) may include an action specifying a first image (1421) to be moved and / or an action (e.g., dragging, flinging) to move the specified first image (1421).
[0145] The electronic device (101) may display a selected visual object (1420) in response to a user input (1410). The visual object (1420) may be associated with a first image (1421). The visual object (1420) may be the first image (1421) or an image modified from the first image (1421). For example, the size of the visual object (1420) may be smaller than the size of the first image (1421). For example, the transparency of the visual object (1420) may be higher than the transparency of the first image (1421). The electronic device (101) may display a second screen (1402) in response to completion of the user input (1410). The electronic device (101) can display a first window (1411a) corresponding to the first application and a second window (1411b) corresponding to the note application on the second screen (1402). While displaying the first window (1411a) and the second window (1411b), the electronic device (101) can display a second image (1422) corresponding to the user input (1410). The second image (1422) can correspond to the first image (1421). The electronic device (101) can display the second image (1422) on the second window (1411b) so that the first image (1421) of the first application (e.g., an Internet application) can be used in the second application (e.g., a note application). For example, as a result of copying and pasting the first image (1421), the electronic device (101) may display the second image (1422) on the second window (1411b). According to one embodiment, the electronic device (101) may copy data of the first image (1421) to a clipboard based on a user input (1410). The electronic device (101) may extract the first image (1421) from the clipboard and display the second image (1422) corresponding to the extracted first image (1421) on the second window (1411b).
[0146] While FIG. 14A illustrates an example of a single visual object (e.g., a first image (1421)) moving, embodiments of the present disclosure are not limited thereto. For example, an Internet link corresponding to the image or other data associated with the image (e.g., a thumbnail image) may move to a second application. In another example, an app icon may move. A preview window corresponding to the application of the app icon may be displayed on the second application.
[0147] Although FIG. 14A illustrates an example of a single visual object (e.g., a first image (1421)) moving, embodiments of the present disclosure are not limited thereto. The embodiments described with reference to FIGS. 2 to 13B can be applied not only to a single visual object moving, but also to a movement of multiple visual objects between two applications. In one embodiment, when images on a first application (e.g., an Internet application) are selected and moved at once, the images can be stacked. Through a user input (1410) (e.g., a drag input or a fling input), the images can be displayed on a second window (1411b) of a second application (e.g., a note application).
[0148] Referring to FIG. 14b, the electronic device (101) may be running multiple applications. For example, the electronic device (101) may be running a first application (e.g., an Internet application) and a second application (e.g., a note application). The descriptions of FIGS. 2 to 13b may also be applied to the movement of data (e.g., images, links, text) between applications.
[0149] The electronic device (101) can display a first window (1461a) corresponding to the first application and a second window (1461b) corresponding to the second application on the first screen (1451). The electronic device (101) is displaying a second image (1422) on the second window (1461b) of the first screen (1451). While displaying the first window (1461a) and the second window (1461b), the electronic device (101) can receive a user input (1460). The electronic device (101) can receive a user input (1460) for the first text (1471). For example, the user input (1410) may include a dragging of the first text (1471) in one direction (e.g., from left to right) or a fling input (e.g., a motion of moving the first text (1471) with an input object (e.g., a finger, a pen) and then flicking it). For example, the user input (1460) may include a motion of specifying the first text (1471) as a movement target and / or a motion of moving the specified first text (1471) (e.g., dragging, flinging).
[0150] The electronic device (101) can display a selected visual object (1470) in response to a user input (1460). The visual object (1470) can be associated with a first text (1471). The visual object (1470) can be the first text (1471). In response to completion of the user input (1460), the electronic device (101) can display a second screen (1452). The electronic device (101) can display a first window (1462a) corresponding to the first application and a second window (1462b) corresponding to the second application on the second screen (1452). While displaying the first window (1462a) and the second window (1462b), the electronic device (101) can display a second text (1472) corresponding to the user input (1460). The second text (1472) may be identical to the first text (1471). The electronic device (101) may display the second text (1472) on a second window (1462b) so that the first text (1471) of the first application can be used in a second application (e.g., a note application). For example, as a result of copying and pasting the first text (1471), the electronic device (101) may display the second text (1472) on the second window (1462b). In one embodiment, the electronic device (101) may copy data of the first text (1471) to a clipboard based on a user input (1460). The electronic device (101) can extract a first text (1471) from the clipboard and display a second text (1472) corresponding to the extracted first text (1471) on a second window (1462b).
[0151] While FIG. 14B illustrates an example of a single visual object (e.g., first text (1471)) moving, embodiments of the present disclosure are not limited thereto. For example, an Internet link containing text or data associated with the text (e.g., a thumbnail image) may move to a second application. In another example, an app icon may move. A preview window corresponding to the application of the app icon may be displayed on the second application.
[0152] Although FIG. 14B illustrates an example of a single visual object (e.g., second text (1472)) moving, embodiments of the present disclosure are not limited thereto. The embodiments described with reference to FIGS. 2 to 13B can be applied not only to a case where a single visual object moves, but also to a case where multiple visual objects move between two applications (e.g., texts move, images move, or different types of objects such as text and images move together). According to one embodiment, when an image and text on a first application (e.g., an Internet application) are selected at the same time, the text and image can be stacked based on a user input (e.g., a touch, a fling, a drag). The user input can move the selected image and the text. Unlike what is illustrated in FIGS. 14A and 14B, the first image (1421) and the first text (1471) can move together. For example, the first text (1471) can be stacked on the first image (1421). When the user input is complete, a second text (1472) corresponding to the first text (1471) and a second image (1422) corresponding to the first image (1421) may be displayed on a second window (1462b) of the second application, according to the stacked order (e.g., first text (1471), first image (1421)).
[0153] Figure 15 shows an example of the display of pop-up windows.
[0154] Referring to FIG. 15, on the first screen (1501), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the first screen (1501), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212) associated with a calculator application, and a third visual object (213) associated with a settings application may be stacked. For example, the visual objects may be stacked in the following order: the second visual object (212), the first visual object (211), and the third visual object (213). Since the second visual object (212) is located at the top among the plurality of visual objects, the electronic device (101) may display the second visual object (212).
[0155] The electronic device (101) may display a pop-up window of an application associated with each visual object of the stacked visual objects. For example, a user of the electronic device (101) may want to know all applications associated with the visual objects stacked under the second visual object (212). The electronic device (101) may receive a user input (1510). The user input (1510) may be an input that maintains a touch input for a certain period of time (hereinafter, referred to as a long press input). While the user input (1510) is maintained on a visual object located above, the stacked visual objects may be sequentially displayed. For example, in response to the user input (1510), the electronic device (101) may sequentially display a second screen (1502), a third screen (1503), a fourth screen (1504), and a fifth screen (1505).
[0156] In the second screen (1502), the electronic device (101) may display a second pop-up window (520). The second pop-up window (520) may represent an execution screen of a second application (e.g., a phone application). While the second pop-up window (520) is displayed, a first visual object (211) stacked next to the second visual object (212) may be displayed. The first visual object (211) may be displayed at the location where the second visual object (212) was located on the first screen (1501). The user input (1510) may be being input at the location where the first visual object (211) is located. In the third screen (1503), the electronic device (101) may display a first pop-up window (510). The first pop-up window (510) may represent an execution screen of the first application (e.g., a calculator application). While the first pop-up window (510) and the second pop-up window (520) are displayed, a third visual object (213) stacked next to the first visual object (211) may be displayed. The third visual object (213) may be displayed at the location where the first visual object (211) was located on the second screen (1502). The location where the first visual object (211) was located on the second screen (1502) may be the same as the location where the second visual object (212) was located on the first screen (1501). The user input (1510) may be being input at the location where the third visual object (213) is located. On the fourth screen (1503), the electronic device (101) may display a third pop-up window (530). The third pop-up window (530) may indicate an execution screen of a third application (e.g., a settings application). The electronic device (101) may determine that there are no more stacked visual objects. In response to the determination, the electronic device (101) may identify a third visual object (213), which is the last visual object among the stacked visual objects.The electronic device (101) may display a visual object (1577) with a visual effect (e.g., displayed transparently) applied to the third visual object (213). The visual object (1577) may be displayed while the first pop-up window (510), the second pop-up window (520), and the third pop-up window (530) are displayed. Thereafter, in the fifth screen (1505), the electronic device (101) may display the first pop-up window (510), the second pop-up window (520), and the third pop-up window (530). The visual object (1577) may no longer be displayed in the third screen (1505). For example, if a certain period of time (e.g., 3 seconds) elapses after displaying the pop-up window (e.g., the third pop-up window (530)) of the last stacked visual object (e.g., the third visual object (213)), the visual object (1577) may not be displayed. For example, when a user input (1510) for a visual object (1577) is released, the electronic device (101) may display a first pop-up window (510), a second pop-up window (520), and a third pop-up window (530) and may no longer display the visual object (1577).
[0157] In FIG. 15, an example is described in which the user input (1510) is maintained until all pop-up windows corresponding to the stacked visual objects are displayed, but embodiments of the present disclosure are not limited thereto. For example, the user input (1510) may be released on the second screen (1502). If the press input, which is the user input (1510), is released while the first visual object (211) is displayed, the electronic device (101) may display the second pop-up window (520) and no longer perform additional operations (e.g., the third screen (1503), the fourth screen (1504), and the fifth screen (1505)). For example, the user input (1510) may be released on the third screen (1503). While the third visual object (213) is displayed, if the press input, which is the user input (1510), is released, the electronic device (101) may display the first pop-up window (510) and the second pop-up window (520) and may no longer perform any additional actions (e.g., the fourth screen (1504), the fifth screen (1505)).
[0158] Figure 16 shows an example of displaying pop-up windows according to pinch out.
[0159] Referring to FIG. 16, on the first screen (1601), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the first screen (1601), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212) associated with a calculator application, and a third visual object (213) associated with a settings application may be stacked. For example, the visual objects may be stacked in the following order: the second visual object (212), the first visual object (211), and the third visual object (213). Since the second visual object (212) is located at the top among the plurality of visual objects, the electronic device (101) may display the second visual object (212). The electronic device (101) may receive a pinch-out input (1610) (or zoom-out input) on the second visual object (212). Through the pinch-out input (1610), pop-up windows corresponding to the stacked visual objects may be displayed more intuitively. The pinch-out input (1610) may include a motion of spreading two fingers apart. For example, the electronic device (101) may detect touches at a first point (1611a) and a second point (1611b), and determine that the touch at the first point (1611a) is distant from the touch at the second point (1611b). According to one embodiment, each pop-up window may be displayed at a location corresponding to a point where the pinch-out input (1610) ends. For example, the position of each pop-up window can be determined based on the point at which a touch started at the first point (1611a) ends and the point at which a touch started at the second point (1611b) ends.
[0160] On the second screen (1602), the electronic device (101) can display a plurality of pop-up windows. For example, the electronic device (101) can display the plurality of pop-up windows in a first arrangement. Through a pinch-out input (1610), a touch initiated at a first point (1611a) can be positioned at a third point (1612a). Through a pinch-out input (1610), a touch initiated at a second point (1611b) can be positioned at a fourth point (1612b). The electronic device (101) can display a plurality of pop-up windows within an area corresponding to the third point (1612a) and the fourth point (1612b). The electronic device (101) can display a first pop-up window (510). For example, the first pop-up window (510) can represent an execution screen of a first application (e.g., a calculator application). The electronic device (101) can display a second pop-up window (520). For example, the second pop-up window (520) can represent an execution screen of a second application (e.g., a phone application). The electronic device (101) can display a third pop-up window (530). For example, the third pop-up window (530) can represent an execution screen of a third application (e.g., a settings application). If the touches are not released in the pinch-out input (1610), the electronic device (101) can change the positions of the pop-up windows by adjusting the distance between the touches. For example, the pinch-out input (1610) can be in an input state. The electronic device (101) can display each pop-up window (e.g., a preview window) in a preview form on the second screen (1602) and display the third screen (1603). On the third screen (1603), the electronic device (101) can display a plurality of pop-up windows. For example, the electronic device (101) can display the plurality of pop-up windows in the second array.Through pinch-out input (1610), a touch started at a first point (1611a) can be located at a fifth point (1615a). Through pinch-out input (1610), a touch started at a second point (1611b) can be located at a sixth point (1615b). The electronic device (101) can display a plurality of pop-up windows within an area corresponding to the fifth point (1615a) and the sixth point (1615b). An area covering a plurality of pop-up windows according to the second arrangement can be wider than an area covering a plurality of pop-up windows (or preview windows) according to the first arrangement.
[0161] In FIG. 16, an example is described in which a second screen (1602) and a third screen (1603) are sequentially displayed through a single pinch-out input (1610), but embodiments of the present disclosure are not limited thereto. For example, when the touches of the pinch-out input (1610) are released at the third point (1612a) and the fourth point (1612b), the electronic device (101) may display a plurality of pop-up windows at the third point (1612a) and the fourth point (1612b). For example, the electronic device (101) may display a plurality of pop-up windows in a normal form (e.g., a form with an opacity of 1) instead of the preview windows displayed in a preview form (e.g., a form with an opacity of less than 1). According to one embodiment, the electronic device (101) may display a plurality of pop-up windows when the distance between the touches in the pinch-out input (1610) is greater than or equal to a threshold distance. For example, the electronic device (101) may display preview windows corresponding to stacked visual objects in response to a pinch-out input (1610). The preview windows may be displayed within an area according to the distance between touches of the pinch-out input (1610). When the pinch-out input (1610) ends (e.g., when the touches are released), if the distance between the touches is less than a threshold distance, the electronic device (101) may end the display of the preview windows and display the second visual object (212). The electronic device (101) may display the stacked visual objects. For example, when the distance between the touches is less than the threshold distance, the electronic device (101) may display the first screen (1601). When the distance between the touches is greater than or equal to the threshold distance, the electronic device (101) may display a plurality of pop-up windows. For example, the electronic device (101) can display a third screen (1603) when the distance between the touches is greater than a threshold distance.
[0162] Figure 17 shows an example of a visual object for displaying pop-up windows.
[0163] Referring to FIG. 17, on the first screen (1701), the electronic device (101) may display a second visual object (212). For example, the second visual object (212) may include an app icon for a phone application. Although not displayed on the first screen (1701), a plurality of visual objects may be stacked. For example, a first visual object (211), a second visual object (212) associated with a calculator application, and a third visual object (213) associated with a settings application may be stacked. For example, the visual objects may be stacked in the following order: the second visual object (212), the first visual object (211), and the third visual object (213). Since the second visual object (212) is located at the top among the plurality of visual objects, the electronic device (101) may display the second visual object (212). The electronic device (101) may further display a visual object (1705) to indicate the number of stacked visual objects. The visual object (1705) may be displayed on or adjacent to the second visual object (212). For example, the visual object (1705) may be displayed in the form of a badge of the second visual object (212).
[0164] The electronic device (101) can receive a user input for the first visual object (211). For example, the user input can include a tap input, a double-tap input, a press input, a drag input, a fling input, or a designated gesture input. Based on the user input (205), the electronic device (101) can display a container (210) for the first visual object (211). The electronic device (101) can display one or more visual objects (e.g., a second visual object (212) and a third visual object (213)) stacked together with the first visual object (211). For example, the electronic device (101) can display a second screen (1702). In the second screen (1702), the electronic device (101) can display a container object (210) and a plurality of visual objects (e.g., a first visual object (211), a second visual object (212), a third visual object (213)) through a display (e.g., a display module (160)). For a description of the container object (210), the descriptions of FIG. 2 may be referenced. The electronic device (101) can display a pop-up button (1715) through the container object (210). The pop-up button (1715) can be used to display pop-up windows of the stacked visual objects, respectively. For example, the electronic device (101) can receive a user input on the pop-up button (1715). In response to the user input, the electronic device (101) can display the third screen (1703). In response to the above user input, the electronic device (101) can display a first pop-up window (510), a second pop-up window (520), and a third pop-up window (530).
[0165] In embodiments, an electronic device is provided. The electronic device may include a memory storing instructions, a processor, and a display. The instructions, when executed by the processor, may cause the electronic device to display a first visual object at a first position among a plurality of visual objects stacked in a sort order, through the display, while the first visual object is displayed to move in response to a user input for the first visual object, display one or more visual objects other than the first visual object among the plurality of visual objects through the display, and after the user input, display the first visual object through the display at a second position according to the user input. The one or more visual objects may be displayed to follow a movement path of the first visual object sequentially according to the sort order while the first visual object is displayed to move.
[0166] In one embodiment, the user input may include a drag input or a fling input. Each visual object of the plurality of visual objects may include an icon of an app running on the electronic device.
[0167] In one embodiment, while the first visual object is displayed at the first point or the second point, the other visual objects may not be displayed.
[0168] In one embodiment, the opacity of the first visual object may be greater than the opacity of each visual object of the one or more visual objects. The size of the first visual object may be greater than the size of each visual object of the one or more visual objects.
[0169] According to one embodiment, the one or more visual objects may include a second visual object and a third visual object. The third visual object may be positioned below the second visual object according to the sorting order. The opacity of the third visual object may be set to be lower than the opacity of the second visual object. The size of the third visual object may be smaller than the size of the first visual object.
[0170] In one embodiment, while the first visual object is displayed to move, the movement speed of the one or more visual objects displayed to follow the movement path of the first visual object may be determined based on the number of the plurality of visual objects.
[0171] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display a plurality of pop-up windows through the display and to display the first visual object based on receiving at least one user input for reducing each pop-up window of the plurality of pop-up windows to an icon. The first visual object may represent an application corresponding to a most recently used pop-up window among the plurality of pop-up windows.
[0172] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display a container object and the plurality of visual objects on the container object through the display based on a first user input with respect to the first visual object. The plurality of visual objects may be arranged in a specified direction on the container object according to the sort order. The first user input may include a tap input.
[0173] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to receive a second user input for moving one of the plurality of visual objects to another area on the container while the plurality of visual objects and the container object are displayed, and to display the plurality of visual objects based on the sorting order that changes in response to the second user input. The second user input may include a drag input.
[0174] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display the container object and the plurality of visual objects at a location indicated by the third user input based on a third user input with respect to the container object while the plurality of visual objects and the container object are displayed. The plurality of visual objects may be arranged in the designated direction on the container object according to the sorting order after the third user input. The third user input may include a drag input using multi-touch.
[0175] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display the container object and the plurality of visual objects at a location indicated by the fourth user input based on a fourth user input with respect to the container object while the plurality of visual objects and the container object are displayed. The plurality of visual objects may be arranged in a direction substantially perpendicular to the designated direction according to the alignment order on the container object after the fourth user input. The fourth user input may include a rotation input using multi-touch.
[0176] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display, through the display, a preview window of an application associated with a visual object among the plurality of visual objects, based on a fifth user input with respect to the visual object. The fifth user input may include a hovering input using a stylus pen.
[0177] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to receive a sixth user input for the first visual object at the top of the stacked plurality of visual objects, and to display, through the display, a plurality of pop-up windows associated with the plurality of visual objects based on the sixth user input.
[0178] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to receive a seventh user input for a handle of a designated pop-up window among the plurality of pop-up windows, and include the designated pop-up window based on the seventh user input. The instructions may cause the display to display the plurality of pop-up windows so that the plurality of pop-up windows overlap within an area. The designated pop-up window may be displayed on top of the plurality of overlapping pop-up windows.
[0179] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to receive an eighth user input for a handle of the designated pop-up window, and, based on the eighth user input, display a visual object of an application corresponding to the designated pop-up window through the display without displaying the plurality of overlapping pop-up windows. The plurality of visual objects may be stacked based on the first visual object positioned at the top.
[0180] In one embodiment, the instructions, when executed by the processor, may cause the electronic device to display, through the display, a plurality of preview windows associated with the plurality of visual objects based on a ninth user input with respect to the first visual object.
[0181] In embodiments, a method performed by an electronic device is provided. The method may include an operation of displaying a first visual object at a first point, which is at the top, from among a plurality of visual objects stacked according to a sorting order. The method may include an operation of displaying one or more visual objects other than the first visual object from among the plurality of visual objects, from among the first visual object, through the display while the first visual object is displayed to move in response to a user input for the first visual object. The method may include an operation of displaying the first visual object through the display at a second point according to the user input after the user input. The one or more visual objects may be displayed to follow a movement path of the first visual object sequentially according to the sorting order while the first visual object is displayed to move.
[0182] In one embodiment, the user input may include a drag input or a fling input. Each visual object of the plurality of visual objects may include an icon of an app running on the electronic device.
[0183] In one embodiment, while the first visual object is displayed at the first point or the second point, the other visual objects may not be displayed.
[0184] In one embodiment, the opacity of the first visual object may be greater than the opacity of each visual object of the one or more visual objects. The size of the first visual object may be greater than the size of each visual object of the one or more visual objects.
[0185] In one embodiment, while the first visual object is displayed to move, the movement speed of the one or more visual objects displayed to follow the movement path of the first visual object may be determined based on the number of the plurality of visual objects.
[0186] In embodiments, a non-transitory computer-readable medium is provided. The non-transitory computer-readable medium may include instructions. The non-transitory computer-readable medium may include a memory. The instructions, when executed by a processor, may cause an electronic device to display a first visual object at a first position among a plurality of visual objects stacked in a sort order, and, while the first visual object is displayed to move in response to a user input for the first visual object, display one or more visual objects other than the first visual object among the plurality of visual objects through the display, and, after the user input, display the first visual object through the display at a second position according to the user input. While the first visual object is displayed to move, the one or more visual objects may be displayed to follow a movement path of the first visual object sequentially in the sort order.
[0187] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, electronic devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0188] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0189] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0190] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0191] According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0192] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In electronic devices, Memory that stores instructions; processor; and Including a display, The above instructions, when executed by the processor, cause the electronic device to: Displaying the first visual object at the top among a plurality of visual objects stacked in sort order through the display at the first point, While the first visual object is displayed to move in response to a user input for the first visual object, one or more visual objects other than the first visual object among the plurality of visual objects are displayed through the display, After said user input, causing said first visual object to be displayed through said display at a second point according to said user input; The one or more visual objects are displayed so as to follow the movement path of the first visual object sequentially according to the alignment order while the first visual object is displayed to move. Electronic devices.
2. In claim 1, The above user input includes drag input or fling input, Each visual object of the above plurality of visual objects includes an app icon running on the electronic device. Electronic devices.
3. In claim 1, The opacity of the first visual object is higher than the opacity of each visual object of the one or more visual objects, The size of the first visual object is larger than the size of each visual object of the one or more visual objects. Electronic devices.
4. In claim 3, The one or more visual objects include a second visual object and a third visual object, The third visual object is positioned below the second visual object according to the sorting order, The opacity of the third visual object is set lower than the opacity of the second visual object, The size of the third visual object is smaller than the size of the first visual object. Electronic devices.
5. In claim 1, While the first visual object is displayed to move, the movement speed of one or more visual objects displayed to follow the movement path of the first visual object is determined according to the number of the plurality of visual objects. Electronic devices.
6. In claim 1, The above instructions, when executed by the processor, cause the electronic device to: Display multiple pop-up windows through the above display, Causing the first visual object to be displayed based on receiving at least one user input for reducing each of the plurality of pop-up windows to an icon; The first visual object represents an application corresponding to the most recently used pop-up window among the plurality of pop-up windows. Electronic devices.
7. In claim 1, The above instructions, when executed by the processor, cause the electronic device to: Based on a first user input for the first visual object, causing a container object and the plurality of visual objects on the container object to be displayed through the display, The above plurality of visual objects are arranged in a specified direction according to the sorting order on the container object, The first user input includes a tap input, Electronic devices.
8. In claim 7, The above instructions, when executed by the processor, cause the electronic device to: Receiving a second user input for moving one of the plurality of visual objects to another area on the container while the plurality of visual objects and the container object are displayed; Causing the plurality of visual objects to be displayed based on the sorting order that changes according to the second user input; The second user input includes a drag input, Electronic devices.
9. In claim 7, The above instructions, when executed by the processor, cause the electronic device to: While the plurality of visual objects and the container object are displayed, based on a third user input for the container object, causing the container object and the plurality of visual objects to be displayed at a location indicated by the third user input; The above plurality of visual objects are arranged in the specified direction according to the sorting order on the container object after the third user input, The third user input includes a drag input using multi-touch. Electronic devices.
10. In claim 7, The above instructions, when executed by the processor, cause the electronic device to: While the plurality of visual objects and the container object are displayed, based on a fourth user input for the container object, causing the container object and the plurality of visual objects to be displayed at a location indicated by the fourth user input; The above plurality of visual objects are arranged in a direction substantially perpendicular to the specified direction according to the alignment order on the container object after the fourth user input, The fourth user input includes a rotation input using multi-touch. Electronic devices.
11. In claim 7, The above instructions, when executed by the processor, cause the electronic device to: Based on a fifth user input for a visual object among the plurality of visual objects, causing a preview window of an application associated with the visual object to be displayed through the display; The fifth user input includes a hovering input using a stylus pen. Electronic devices.
12. In claim 1, The above instructions, when executed by the processor, cause the electronic device to: Receiving a sixth user input for the first visual object at the top among the plurality of stacked visual objects, Causing a plurality of pop-up windows associated with the plurality of visual objects to be displayed through the display based on the sixth user input. Electronic devices.
13. In claim 12, The above instructions, when executed by the processor, cause the electronic device to: Receiving a seventh user input for the handle of a designated pop-up window among the above multiple pop-up windows, Based on the seventh user input, causing the plurality of pop-up windows to be displayed through the display so that the plurality of pop-up windows overlap within an area including the designated pop-up window; The above designated pop-up window is displayed at the top among the multiple nested pop-up windows. Electronic devices.
14. In a method performed by an electronic device, An action of displaying the first visual object at the top among multiple visual objects stacked in sort order at the first point, An operation of displaying one or more visual objects other than the first visual object among the plurality of visual objects through the display while the first visual object is displayed to move in response to a user input for the first visual object; After the user input, the method comprises displaying the first visual object through the display at a second point according to the user input. The one or more visual objects are displayed so as to follow the movement path of the first visual object sequentially according to the alignment order while the first visual object is displayed to move. method.
15. In a non-transitory computer-readable medium, the non-transitory computer-readable medium includes a memory including instructions, The above instructions, when executed by the processor, cause the electronic device to: Displaying the topmost first visual object among multiple visual objects stacked in sort order at the first point; While the first visual object is displayed to move in response to a user input for the first visual object, one or more visual objects other than the first visual object among the plurality of visual objects are displayed through the display, After said user input, causing said first visual object to be displayed through said display at a second point according to said user input; The one or more visual objects are displayed so as to follow the movement path of the first visual object sequentially according to the alignment order while the first visual object is displayed to move. Non-transitory computer-readable medium.
Citation Information
Patent Citations
Mobile terminal and operation control method thereof
KR1020110068068A
Mobile twrminal and 3D image controlling method thereof
KR1020120117219A
Method and apparatus for controlling screen display using environmental information
KR1020140139377A
Mobile terminal and method for controlling the same
KR1020150089813A
Method and device for displaying icons
KR1020180008707A