Apparatus and method for providing user interface
The electronic device addresses usability and resource inefficiencies by controlling interfaces with a single gesture, enhancing user experience and resource utilization through intelligent screen resizing based on input gestures.
Patent Information
- Application Number
- KR1020210105013
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-10
- Publication Date
- 2026-11-03
- Estimated Expiration
- 2041-08-10
AI Technical Summary
Existing multimedia devices face usability and system resource inefficiencies due to separate interfaces, such as pop-ups and widgets, which are managed separately from application icons, leading to complex and inefficient user interactions.
An electronic device with a touch screen and processor that detects specific input gestures to control interface sizes and execution screens through a single module, allowing applications to be executed and resized based on drag inputs or button interactions.
Enhances user experience by simplifying interface control with a single gesture, efficiently utilizing system resources and enabling faster operations by eliminating separate tasks.
Smart Images

Figure R1020210105013_ABST
Abstract
Description
Technology Field
[0001] This document relates to electronic devices, and for example, to electronic devices that provide a user interface and methods for providing such devices. Background Technology
[0003] With the advancement of information and communication technology and semiconductor technology, electronic devices are evolving into multimedia devices that provide various multimedia services. For example, electronic devices can provide various multimedia services such as voice call services, messaging services, broadcasting services, wireless internet services, camera services, and music playback services.
[0004] As the use of multimedia services increases, the amount of information that electronic devices must process and display is also increasing. Accordingly, electronic devices may be equipped with touch screens to increase the size of the display area while improving space utilization. The problem to be solved
[0007] Separate interfaces, such as pop-ups and widgets, may be used to perform auxiliary functions on electronic devices. However, separate interfaces, including pop-ups and widgets, are created and managed in a location separate from application icons installed on the application tray or home screen, so their usability may be complex and inefficient.
[0008] The electronic device and the method for providing its interface according to this document can overcome usability and system resource utilization issues by controlling interfaces with a single gesture in a single module. means of solving the problem
[0010] An electronic device according to various embodiments includes a touch screen that receives touch input, a processor operatively connected to the touch screen, and a memory, wherein the memory may store instructions such that, at execution, the processor detects whether a first input occurs in which a touch input is maintained on an icon of a first application for a preset time or longer using the touch screen, and if a drag input occurs in a first direction after the occurrence of the first input on the icon of the first application, the size of the execution screen of the first application is determined in correspondence with the position where the drag input is detected, and the first application is executed according to the determined size, and detects whether a second input occurs in which a touch input is maintained on the execution screen of the first application for a preset time or longer using the touch screen, and if the second input is detected on the execution screen of the first application, the size of the execution screen is fixed without changing.
[0011] An electronic device according to various embodiments includes a processor and a memory operatively connected to separate hardware separated from the electronic device, and the memory may store instructions such that, at execution, the processor detects whether a first input occurs in which an input using a specific button of separate hardware is maintained for a preset time or longer, and if a drag input occurs in a first direction after the first input occurs on the icon of the first application, the size of the execution screen of the first application is determined in correspondence with the position where the drag input is detected, and the first application is executed, and the processor detects whether a second input occurs in which an input using a specific button of separate hardware is maintained for a preset time or longer, and if the second input is detected on the execution screen of the first application, the size of the execution screen is fixed without changing.
[0012] A method for providing a user interface of an electronic device according to various embodiments may include: detecting whether a first input occurs in which a touch input or a button input is maintained for a preset time or longer on an icon of a first application; determining the size of an execution screen of a first application corresponding to the position where the drag input is detected when a drag input occurs in a first direction after the occurrence of the first input on the icon of the first application, and executing the first application; detecting whether a second input occurs in which a touch input or a button input is maintained for a preset time or longer on an execution screen of the first application; and controlling the execution screen so that its size does not change and remains fixed when the second input is detected on an execution screen of the first application. Effects of the invention
[0014] According to various embodiments, the electronic device can enhance the user experience by controlling interfaces with a single gesture in a single module.
[0015] According to various embodiments, the electronic device can efficiently utilize system resources by controlling interfaces with a single gesture in a single module, and can operate interfaces faster by not performing separate tasks. Brief explanation of the drawing
[0017] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2 is a block diagram showing the configuration of an electronic device according to various embodiments. FIGS. 3A and FIGS. 3B illustrate user interfaces of electronic devices according to various embodiments. FIGS. 4a to 4d show user interface screens of electronic devices according to various embodiments. FIGS. 5a and 5b show the form of information displayed on the screen according to the size of the application execution screen. FIGS. 6c to 6d show display forms of application execution screens according to various embodiments. FIG. 7 illustrates the process of fixing an application execution screen of an electronic device to the home screen according to various embodiments. FIG. 8 is a flowchart illustrating a method for displaying an interface of an electronic device according to various embodiments. Specific details for implementing the invention
[0018] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0019] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0020] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0021] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0022] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0023] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0024] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0025] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0026] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0027] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0028] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0029] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0030] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0031] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0032] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0033] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0034] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0035] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0036] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0037] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0038] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0039] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0040] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0041] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0042] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0043] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0044] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0045] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0047] FIG. 2 is a block diagram showing the configuration of an electronic device according to various embodiments.
[0048] According to various embodiments, the electronic device (200) may include a touch screen (210), a processor (220), and a memory (230).
[0049] According to various embodiments, the touch screen (210) may include a display unit (not shown) and a touch panel (not shown). The display unit (not shown) may display the status of the electronic device (200). In this case, the display unit (not shown) may be implemented as an LCD and may be equipped with an LCD control unit, a memory capable of storing display data, and an LCD display element. The touch panel (not shown) is mounted on the display unit (not shown) and can detect touch operations on the display unit (not shown). The touch panel (not shown) may include a touch detection unit (not shown) and a signal conversion unit (not shown). The touch detection unit (not shown) can detect touch operations by detecting a change in a physical quantity, such as resistance or capacitance. The signal conversion unit (not shown) can convert a change in a physical quantity into a touch signal.
[0050] In the following description, the term "touch" may refer to the act of contacting or approaching a touch screen on an electronic device. In this case, the touch may be generated by the hand of the user of the electronic device or by a stylus pen. Such touch may be provided as various touch actions depending on at least one of the touch area, whether it moves, the distance moved, the direction of movement, or the duration of hold on the touch screen. The term "drag" may refer to the act of a user of the electronic device moving a finger while touching, that is, while the finger is in contact with the touch screen. The "home screen" may refer to the first screen displayed on the touch screen (210) when the power of the electronic device (200) is turned on. On the home screen, execution keys for running multiple applications stored in the electronic device (200) may be displayed arranged in rows and columns. The execution keys may be formed of icons, buttons, or text, etc. The "app tray" may refer to the screen where these execution keys are arranged. When each execution key is touched, the application corresponding to the touched execution key may be executed and displayed on the display. Applications may each refer to programs implemented independently of one another by the manufacturer of the electronic device (200) or the application developer. The electronic device (200) may not require that another application be running in advance in order to run one application. Additionally, the electronic device (200) may continue to run another application even if one application is terminated.
[0051] In the following description, the terms interface and user interface may refer to a physical or virtual medium created to allow a user to access the electronic device (200), issue commands, and perform specific functions. In particular, if the electronic device (200) includes a portable terminal (e.g., smartphone, tablet PC, etc.), the user interface may refer to a medium for executing applications, including environment settings, image display, audio playback, screen scrolling, games, watching broadcasts, and using wireless internet.
[0052] In one embodiment, the touch screen (210) can detect a change in a physical quantity (e.g., voltage, light intensity, resistance, charge quantity, capacitance, etc.) specified by user input, e.g., touch. In one embodiment, the touch screen (210) may be placed overlappingly with a display panel (e.g., the display panel (160) of FIG. 1). The touch screen (210) may include a sensing array, and the sensing array may include conductive lines arranged along a row direction or a column direction. The touch screen (210) may be composed of a plurality of sensor nodes formed at the intersection points of the conductive lines.
[0053] In one embodiment, the processor (220) is electrically connected to the touch screen (210), detects a change in a physical quantity on the touch screen (210), and can calculate data for user input, such as a touch (e.g., coordinate data (X, Y) of the location where the touch occurred) based on the change in the physical quantity (e.g., voltage, light intensity, resistance, electric charge, capacitance, etc.). The processor (220) can acquire the data for the touch as an event regarding the user input.
[0054] According to various embodiments, the processor (220) can process data within the electronic device (200), control at least one other component related to the function of the electronic device (200), and perform data processing and computation necessary for performing the function. Additionally, the processor (220) may be electrically and / or functionally connected to an external device (240) in addition to other components of the electronic device (200), such as a touch screen (210). According to various embodiments, there is no limitation to the computation and data processing functions that the processor (220) can implement within the electronic device (200); however, the various embodiments disclosed herein will describe functions such as detecting touch input on the touch screen (210) or button input transmitted from the external device (240), adjusting the size of the application screen, executing the application, and fixing the execution screen as a widget.
[0055] According to one embodiment, the memory (230) is intended to temporarily or permanently store digital data without limitation and may include at least one of the configuration and / or function of the memory (130) of FIG. 1. The memory may include non-volatile memory such as OTPROM (one-time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD), and volatile memory such as DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM). The memory (230) may store various instructions that can be executed by the processor (220). Such instructions may include various control commands, including arithmetic and logical operations, data movement, or input / output, which can be recognized by the processor (220).
[0056] According to one embodiment, the processor (220) can detect when a user's drag input occurs on the touch screen (210). At this time, the processor (220) can calculate a drag variation value from the change in touch coordinates in the drag path. That is, the processor (220) can calculate the length of the drag path, the drag direction, the drag speed, etc. Additionally, the processor (220) can detect a control command that can be executed on the function execution screen in response to the drag variation value and control the execution of the corresponding command.
[0057] According to one embodiment, the processor (220) may acquire a specified physical quantity, such as a capacitance value (Cm), which changes as user input is detected, and generate a digital value corresponding to the acquired capacitance value (Cm). The processor (220) may generate data for each of a plurality of sensor nodes by performing calibration, filtering, etc., on the generated digital value. Based on the generated data, the processor (220) may calculate a location (e.g., coordinates) on the touch screen (210) where user input occurs, and based on this, set a specific area where user input is entered.
[0058] According to one embodiment, the processor (220) can control the size of a window including a user interface screen or an application execution screen. For example, the processor (220) can control the size of a window (e.g., an application execution screen) by considering change information regarding any one of the touch points generated by a user's touch or drag. Additionally, the processor (220) can control the size of a window by considering touch information or drag information regarding a size change area included in the window. That is, the processor (220) can control the size of a window displayed on a touch screen (210) by considering continuous drag information or change information regarding a touch point.
[0060] FIGS. 3A and FIGS. 3B illustrate user interfaces of electronic devices according to various embodiments.
[0061] According to FIG. 3a, a home screen or an application tray screen may be displayed on the touch screen (e.g., the touch screen (210) of FIG. 2) of an electronic device (e.g., the electronic device (200) of FIG. 2). The "home screen" may refer to the first screen displayed on the touch screen (210) when the power of the electronic device (200) is turned on. On the home screen, execution keys for executing a number of applications stored in the electronic device (200) may be displayed arranged in rows and columns. The execution keys may be formed of icons, buttons, or text, etc. The "application tray" may refer to the screen where these execution keys are arranged. When each execution key is touched, the application corresponding to the touched execution key may be executed and displayed on the display.
[0062] In Figure 310, a processor (e.g., the processor (220) of Figure 2) can detect a user's touch input on a touch screen. The user's touch input may be input on an icon or a widget, and the processor (220) can distinguish between a first input (e.g., a short touch input) and a second input (e.g., a long touch press) that is distinct from the first input. The first input and the second input are not limited thereto and may further include touch, long press, double tap, pressure touch, etc. When the first input is detected, the processor (220) can run the application in full screen (or a screen larger than the first size). When the second input, which is not the first input, is detected, the processor (220) can run the application in a popup form rather than in full screen. A widget refers to a mini application that allows users to directly access functions such as weather, calendars, and calculators, as well as news and games, on devices like computers or mobile phones without using a web browser.
[0063] The processor (220) can detect a long touch input (302) on the application and display the application execution screen (303) in a popup form as shown in Figure 312. In Figure 312, the processor (220) can detect user input (e.g., drag input (304)) on the execution screen (303). "Drag input" may refer to the act of a user of the electronic device (200) moving a finger in both directions or in one direction while touching, i.e., touching the finger, on the touch screen. The processor (220) can calculate the length of the drag path and the drag direction. Additionally, the processor (220) can detect a control command that can be executed on the application execution screen (303) in response to the drag variation value and control the execution of the corresponding command. For example, if a drag input is applied in the opposite direction, such as the drag input (304) in Figure 312, the processor (220) can determine this as a command for expanding the execution screen (303). The processor (220) can identify the point where the drag input ends and extend the execution screen (303) to the point where the drag input ends, and display it on the touch screen (210). In the extended execution screen (303) of Figure 314, a relatively larger amount of information may be displayed than in the execution screen (303) before extension of Figure 312, or existing information may be extended and displayed. Additionally, if the electronic device (200) has the form of a rollable terminal, when the drag input is received in a critical area (e.g., the edge of the display or an area adjacent to the edge), the processor (220) can automatically extend the display (not shown) and extend the execution screen to display it in the extended area. Additionally, the processor (220) can extend the display if the drag input is maintained in the aforementioned critical area for a certain period of time.
[0064] In addition, if the drag input is applied in the same direction or in a narrowing direction rather than in the opposite direction as in Figure 312, the processor (220) can determine this as a command for shrinking the execution screen (303).
[0065] According to one embodiment, the processor (220) may be operatively connected to an external device (e.g., the external device (240) of FIG. 2). According to FIG. 3b, the processor (220) may recognize user input using the external device (240) and provide a user interface. In the following description, the external device (240) is assumed to be a mouse having a wheel pointer, but the type of the external device (240) may not be limited thereto. For example, the external device (240) may include a device that is physically separated from the electronic device (200) but is electrically and / or operatively connected, such as a stylus pen.
[0066] In Figure 320, the processor (220) can detect a first input from a user on an application icon (301). The first input from a user may be pre-set and, for example, may include pressing the left mouse button and the wheel button (321) simultaneously or together within a threshold time on a threshold area including the application icon (301). In Figure 322, the processor (220) can detect the first input and display an execution screen (303) of the application to which the first input was applied on the screen. Subsequently, in Figure 324, the processor (220) can adjust the size of the application execution screen (303) displayed in correspondence with the position of the mouse moving while maintaining the first input.
[0067] The external device (240) may include a stylus pen or an electronic pen. In this case, the user may input the first input using a stylus pen or an electronic pen instead of the first input using a mouse. For example, the user may touch an application icon (301) on the screen with the tip of the pen while pressing the side button or the rear button of the electronic pen. The button of the electronic pen is not limited to the side or the rear, and the position of the button may vary depending on the manufacturing process. The processor (220) detects such input and, as in FIGS. 3a and 3b, adjusts the size of the application execution screen (303) and executes the corresponding application.
[0069] FIGS. 4a to 4d show user interface screens of electronic devices according to various embodiments.
[0070] In Figure 410, the processor (e.g., the processor (220) of Figure 2) can recognize a first touch (402) applied to an application icon and execute an application resizing mode. The first touch (402) may include a long touch input for a certain period of time or longer, as described in Figure 3a above. The first and second inputs applied to the critical area on the application icon are not limited to this and may further include touch, long press, double tap, pressure touch, etc. Subsequently, when the second touch point (405) is changed via a drag input (404) while the first touch (402) is maintained in the application resizing mode, the processor (220) can adjust the size of the first window (e.g., application execution screen) by considering the change information of the second touch point (405). Here, the change information of the second touch point (405) may include a change in distance of the second touch point (405) and a change direction of the second touch point (405). The processor (220) may run the application in full screen (or a screen larger than the first size) when a first input (e.g., touch input) is detected. The processor (220) may run the application in a popup form rather than full screen when a second input other than the first input (e.g., long press, double tab, pressure touch) is detected. This has been described in FIG. 3a above.
[0071] For example, as illustrated in Figure 412, if the second touch point (405) changes and the distance from the first touch point (402) increases, the electronic device (200) can expand the overall size of the first window (403) by a certain ratio, taking into account the change in distance of the second touch point (404). As another example, as illustrated in Figure 414, if the second touch point (405) changes to a first direction (e.g., right), the processor (220) can expand the first window (403) in the first direction (e.g., right). In this case, the processor (220) can determine the expansion ratio of the right size by taking into account the change in distance of the second touch point (405). Drag input does not necessarily have to be bidirectional, and the processor (220) can recognize a one-way drag input and perform size adjustment of the window displayed in that direction.
[0072] In another example, as illustrated in Figure 416, when the second touch point (405) changes downward, the processor (220) can expand the size of the bottom of the first window (403). At this time, the processor (220) can determine the expansion ratio of the bottom size by taking into account the change in distance of the second touch point (405). According to Figure 418, the electronic device (200) can display the application execution screen (403) in full screen when the second touch point (405) moves away from the first touch point (402) by a certain distance or more. Additionally, the application execution screen (403) may be displayed as a pop-up window before switching to full screen. In the expanded execution screen (403) of Figures 414 to 418, a relatively larger amount of information may be displayed than in the execution screen (403) before expansion of Figure 412, or existing information may be expanded and displayed. Additionally, if the electronic device (200) has the form of a rollable terminal, when a drag input is received in a critical area (e.g., an edge of the display or an area adjacent to the edge), the processor (220) can automatically expand the display (not shown) and display an execution screen in the expanded area. Additionally, the processor (220) can expand the display if the drag input is maintained in the aforementioned critical area for a certain period of time.
[0074] Figures 420 to 426 in Fig. 4b can be understood in the same way as Figures 410 to 418 in Fig. 4a.
[0075] For example, as illustrated in Figure 422, if the second touch point (405) changes and the distance from the first touch point (402) increases, the electronic device (200) can expand the overall size of the first window (403) by a certain ratio, taking into account the change in distance of the second touch point (405). Additionally, if this size is expanded by more than a certain ratio, the processor (220) can display the application in full screen, as illustrated in Figure 428. As another example, as illustrated in Figure 424, if the second touch point (405) changes downward, the processor (220) can expand the size of the bottom of the first window (403). At this time, the processor (220) can determine the expansion ratio of the bottom size by taking into account the change in distance of the second touch point (405). In another example, as illustrated in Figure 426, when the second touch point (405) changes to the right, the processor (220) may enlarge the right size of the first window (403). In this case, the processor (220) may determine the enlargement ratio of the right size by taking into account the change in distance of the second touch point (405).
[0076] According to one embodiment, the size of the application execution screen (403) may be stored in memory (e.g., memory (230) of FIG. 2) with a predetermined array unit (e.g., 2x2, 2x4, 4x2, 4x4), or it may be freely specified by the user. When the size of the application execution screen (403) is predetermined in an array unit, even if the window is reduced or increased beyond a certain area (e.g., 2.1x2.3), the size of the application execution screen (403) may be displayed in accordance with the predetermined unit size (e.g., 2x2).
[0077] FIGS. 4c and 4d illustrate that the application execution screen (or first window) (403) is freely specified by the user. In FIG. 430, if the second touch point (404) moves to the right, the processor (220) recognizes this and can expand the right side of the first window (403) as in FIG. 431. Subsequently, if the second touch point (405) moves to the left, the processor (220) recognizes this movement and can shrink the first window (403) to the left as in FIG. 435. At this time, the size of the first window (403) may be manually determined by the user as in FIG. 432, rather than in array units (e.g., 4x4 size). This can be similarly applied in FIG. 440 and 445, which use an external device (240) instead of touch input. That is, the user can determine the size of the application execution screen (or first window) (403) by moving the second touch point (405) at will using an external device (240).
[0079] FIGS. 5a and 5b show the form of information displayed on the screen according to the size of the application execution screen.
[0080] According to one embodiment, a processor (e.g., the processor (220) of FIG. 2) can determine at least one of the type of information to be displayed on the screen, the amount of information, and the nature of the information in correspondence with the size of the application execution screen (403).
[0081] According to FIG. 5a, the processor (220) can display application execution information on one unit screen (501) when the size of the first window (e.g., application execution screen) (403) is 2x2. On the other hand, as in FIG. 515, when the size of the first window is expanded to 4x2, application execution information can be displayed on at least two unit screens (503). Additionally, as in FIG. 520, when the size of the first window (403) is expanded to 4x4, it can be seen that the screen (505) displaying application execution information also increases. In FIG. 520, the screen (505) displaying application execution information is shown as five, but this is not fixed and may vary depending on the screen size of the electronic device (e.g., the electronic device (200) of FIG. 2) and the type of application being executed.
[0082] The processor (220) can determine the type of information to be displayed on the screen, the amount of information, and the nature of the information, in addition to the number of screens displaying application execution information corresponding to the size of the first window (403).
[0084] FIGS. 6a to 6d show display forms of application execution screens according to various embodiments.
[0085] According to one embodiment, a memory (e.g., memory (230) of FIG. 2) may store instructions for, at execution, for a processor (e.g., processor (220) of FIG. 2) to detect whether a first input occurs on a second application (602) in which the touch input is maintained for a preset time or longer using a touch screen (e.g., touch screen (210) of FIG. 2), and if a drag input occurs in a second direction after the first input occurs on the second application (602), to determine the size of the execution screen of the second application (602) in response to the drag input, to execute the second application (602), and to display the execution screen of the second application (602) together with the execution screen (603) of the first application as a multi-window (605). Additionally, the multi-window may include execution screens of multiple applications, or it may include multiple execution screens of a single application.
[0086] In Figure 610, the processor (220) can execute a size adjustment mode of the application to which the first input (601) is applied in response to the first input (601). Subsequently, the size of the application execution screen (603) is determined according to the second input (604), and can be displayed on the touch screen (210) in a form similar to the pop-up window (603) in Figure 612. The term 'pop-up window' included in this document refers to the execution screen of a specific application being displayed in an overlay form, and may be referred to as a pop-up screen, a pop-up view, or a floating window. Additionally, 'pop-up window' may refer to a screen in which the execution screen of another application (e.g., the first application) is displayed in an overlay form on a specific screen (e.g., the main screen, or the home screen). For example, the processor (220) can move the pop-up window based on the user touching and dragging the execution screen displayed as an overlay.
[0087] According to one embodiment, the first pop-up window (603) may include an execution screen of a specific application (e.g., the first application). Additionally, the second pop-up window (605) may include an execution screen of another application (e.g., the second application).
[0088] The processor (220) can display the second pop-up window (605) on the main screen and the first pop-up window based on user input related to the creation of a new pop-up window (e.g., the state of FIG. 10) when the first pop-up window (603) is in an aligned state (e.g., the state of FIG. 10). The user input for creating the second pop-up window (605) may be the same or similar to the first input (601) of FIG. 610.
[0089] According to one embodiment, the processor (220) may move the position of the second pop-up window (605) based on user input in which at least a portion of the second pop-up window (605) is touched and dragged while the first pop-up window (603) is displayed (e.g., Fig. 612). Here, the second pop-up window (605) may be displayed overlapping the first pop-up window (603), as in Fig. 614 or Fig. 624.
[0090] The processor (220) may display the application in full screen according to user input. As shown in FIG. 6c, if the user touches the application (601) briefly rather than touching it for a certain period of time, the application screen (603) may be displayed in full screen on the touch screen (210). Additionally, as shown in FIG. 6d, if the user presses the full screen button (641), the processor (220) may recognize this input and display the application execution screen (603) in full screen.
[0092] FIG. 7 illustrates the process of fixing and displaying an application execution screen of an electronic device according to various embodiments on the home screen.
[0093] According to one embodiment, when a first input (701) is detected on the execution screen (703) of a first application, the processor (e.g., the processor (220) of FIG. 2) may fix and display the execution screen in the form of a widget on the home screen or application tray of the electronic device (200). A widget may refer to a mini application that allows direct access to functions such as weather, calendar, and calculator, as well as news and games, without going through a web browser on a computer or mobile phone. Although the widget itself is not an application, the application may include data representing the execution screen of the widget. The data of the widget may include, for example, image data of a GUI (Graphic User Interface) representing part or all of the execution screen of the widget, layout data of the GUI, text data, and video data.
[0094] According to Figure 710, the processor (220) recognizes the first input (701) entered into the application and can display the application execution screen (703) as a pop-up window on the touch screen (e.g., the touch screen (210) of Figure 2). The first input (701) may refer to an input in which a press input is applied for a certain period of time or longer, as described in the preceding Figure 3a.
[0095] According to Figure 712, when a first input (701) is applied to an application execution screen (703), the processor (220) can fix the application execution screen (703) to a widget (705).
[0096] According to Figure 714, the processor (220) can fix the application execution screen (703) to the location where it was located as a widget (705) in response to user input, and move other application icons (707) that were in that location to the bottom of the widget (705) to display them. In this way, the user can run a second application different from the first application while using the first application.
[0098] FIG. 8 is a flowchart illustrating a method for displaying an interface of an electronic device according to various embodiments.
[0099] The illustrated method (800) can be executed by an electronic device (e.g., the electronic device (200) of FIG. 2) described above through FIG. 1 to 7, and the technical features described above will be omitted below.
[0100] In operation 810, the electronic device (200) can detect a user's touch input or button input entered on a specific application (e.g., the first application). This has been described in the preceding FIGS. 3a and 3b. Touch input can be entered on a touch screen (e.g., the touch screen (210) of FIG. 2) using a user's finger, as described in FIG. 3a. Button input can be entered on the screen by an external device (e.g., the external device (240) of FIG. 2), as described in FIG. 3b.
[0101] In operation 820, the processor (e.g., the processor (220) of FIG. 2) can determine whether an input applied to the electronic device (200) lasts for a certain period of time or longer. That is, the processor (220) can determine whether the generated touch is maintained for a preset period of time. In operation 820, the processor (220) can distinguish between a normal touch and a touch intended to enter the resizing mode of the document. If the touch is not maintained for a preset period of time or longer, the processor (220) can determine that it is a normal touch. Accordingly, the processor (220) can control the performance of the function of the first application in operation 825. The function of the first application may refer to any user interface and may include, for example, a phone book, image viewing, audio playback, and settings of a mobile terminal. If, as a result of the check, the input is a short input of less than the first period of time, the processor (220) determines that it is an execution input for the first application and can execute the first application.
[0102] On the other hand, the processor (220) can check whether a drag input is detected near the icon of the first application in operation 830 when the input is a long press input maintained for a first time or longer. According to one embodiment, the processor (220) can detect a drag input applied to the execution screen of the first application. A drag input may refer to the act of a user of the electronic device (200) moving a finger while touching, that is, touching the finger, on the touch screen as described in FIG. 3 above. At this time, the first finger may maintain a long press input near the icon of the first application, and a second finger other than the first finger may touch an area outside the icon of the first application and then perform a drag operation. Here, the subject of the touch and drag input is not limited to a finger, but may include any object capable of applying input using a change in an electrical signal, such as a stylus pen.
[0103] The processor (220) may enter an application resizing mode in operation 840 when a drag input is detected near the icon of the first application. According to one embodiment, the processor (220) may execute a user interface in a resizing mode for the first application. The resizing mode may mean a mode in which the first application screen is executed in a floating mode and the size of the first application execution screen can be adjusted according to user input.
[0104] In operation 830, if the processor (220) checks and determines that no drag input is detected, it can detect in operation 835 whether the user has released the touch. If the user has released the touch, the processor (220) can wait while maintaining the resizing mode in operation 845 and then release the resizing mode after a certain period of time. If the user has not released the touch, the processor (220) can enter the icon modification mode in operation 855. The icon modification mode may refer to, for example, a floating mode for changing the arrangement of icons of multiple applications. Subsequently, if a drag input is detected again, the processor (220) can release the icon modification mode.
[0105] In operation 830, if the processor (220) detects a drag input, it may enter an application resizing mode in operation 840. Subsequently, in operation 850, the processor (220) may determine the execution screen size of the first application corresponding to the user's drag input position and execute the first application. This process has been described in the preceding FIGS. 3a to 4b.
[0106] In operation 860, the processor (220) can detect that a first input is applied to the first application screen. When the first input is detected, the processor (220) can fix the first application screen as a widget on the home screen or application tray in operation 870. A widget may refer to a mini application that allows direct access to functions such as weather, calendar, calculator, news, and games without going through a web browser on a computer or mobile phone, as described in FIG. 7 above. While fixing the first application screen as a widget, the processor (220) can automatically move the application icons that were placed at that location to another location, or move the icons to another location based on user input.
[0107] A method for providing a user interface of an electronic device (200) according to various embodiments may include: detecting whether a first input occurs in which a touch input or a button input is maintained for a preset time or longer on a first application; determining the size of the execution screen of the first application in correspondence with the position where the drag input is detected when a drag input occurs in a first direction after the first input occurs on the first application, and executing the first application; detecting whether a first input occurs on the execution screen of the first application; and controlling the execution screen to be fixed as a widget on the home screen or application tray of the electronic device (200) when the first input is detected on the execution screen of the first application.
[0108] According to one embodiment, the operation of determining the size of the execution screen of the first application and executing the first application may include the operation of displaying a guide screen on the icon of the first application when a first input occurs, indicating to the user whether to select the size of the execution screen from among the sizes of the execution screen of the first application pre-set or to determine the size of the execution screen according to arbitrary user input.
[0109] According to one embodiment, the method for providing a user interface of an electronic device (200) may further include an operation of determining at least one of the type of information to be displayed on the screen, the amount of information, and the nature of the information corresponding to the size of the execution screen of the first application.
[0110] According to one embodiment, the method may further include: detecting whether a first input occurs in which a touch input or button input is maintained for a preset time or longer on an icon of a second application; and if a drag input occurs in a second direction after the first input occurs on an icon of a second application, determining the size of the execution screen of the second application in response to the drag input and executing the second application.
[0111] According to one embodiment, the operation of displaying the execution screen of the second application together with the execution screen of the first application as a multi-window may be further included.
[0112] According to one embodiment, the method may further include an operation to detect whether a second input occurs in which a touch input or a button input is maintained for a preset time or longer on the execution screen of the second application, and an operation to control the execution screen so that its size does not change and remains fixed when the second input is detected on the execution screen of the second application.
[0113] An electronic device according to various embodiments includes a touch screen that receives touch input, a processor operatively connected to the touch screen, and a memory, wherein the memory may store instructions such that, at execution, the processor detects whether a first input occurs in which a touch input is maintained on an icon of a first application for a preset time or longer using the touch screen, and if a drag input occurs in a first direction after the occurrence of the first input on the icon of the first application, the size of the execution screen of the first application is determined in correspondence with the position where the drag input is detected, and the first application is executed according to the determined size, and detects whether a second input occurs in which a touch input is maintained on the execution screen of the first application for a preset time or longer using the touch screen, and if the second input is detected on the execution screen of the first application, the size of the execution screen is fixed without changing.
[0114] According to one embodiment, the processor can determine the size of the execution screen of the first application in response to user input.
[0115] According to one embodiment, the memory stores a table in which size information of the execution screen of the first application is pre-set, and stores instructions for displaying a guide screen to determine whether to select an execution screen size from among the pre-set execution screen sizes of the first application or to determine an execution screen size according to arbitrary user input when a first input occurs on the first application, and the form of the execution screen may include the form of an icon or a widget.
[0116] According to one embodiment, the processor can determine at least one of the type of information to be displayed on the screen, the amount of information, and the nature of the information in correspondence with the size of the execution screen of the first application.
[0117] According to one embodiment, the memory may store instructions such that, at execution, the processor uses a touch screen to detect whether a first input occurs in which a touch input is maintained on an icon of a second application for a preset time or longer, and if a drag input occurs in a second direction after the first input occurs on the icon of the second application, the size of the execution screen of the second application is determined in response to the drag input, the second application is executed, and the execution screen of the second application is displayed as a multi-window together with the execution screen of the first application.
[0118] According to one embodiment, the memory may store instructions for, at execution, to detect whether a second input occurs in which a touch input is maintained for a preset time or longer on the execution screen of a second application using a touch screen, and to control the execution screen to be fixed in the form of a widget on the home screen or application tray of an electronic device when the second input is detected on the execution screen of the second application.
[0119] An electronic device according to various embodiments includes a processor and a memory operatively connected to separate hardware separated from the electronic device, and the memory may store instructions such that, at execution, the processor detects whether a first input occurs in which an input using a specific button of separate hardware is maintained for a preset time or longer, and if a drag input occurs in a first direction after the first input occurs on the icon of the first application, the size of the execution screen of the first application is determined in correspondence with the position where the drag input is detected, and the first application is executed, and the processor detects whether a second input occurs in which an input using a specific button of separate hardware is maintained for a preset time or longer, and if the second input is detected on the execution screen of the first application, the size of the execution screen is fixed without changing.
[0120] According to one embodiment, the electronic device includes a separate external device, a mouse, and specific buttons used for the first input and the second input may include the left click button and the wheel button of the mouse.
[0121] According to one embodiment, a separate external device includes at least one of a stylus pen or a touch pen, and a specific button used for the first input and the second input may include a side button of the stylus pen or the touch pen.
[0122] According to one embodiment, the processor can determine the size of the execution screen of the first application in response to user input.
[0123] According to one embodiment, the memory stores a table in which size information of the execution screen of a first application is pre-set, and may store instructions for displaying a guide screen to determine whether to select an execution screen size from among the pre-set execution screen sizes of the first application when a first input occurs on the first application, or to determine the execution screen size according to arbitrary user input.
[0124] According to one embodiment, the processor can determine at least one of the type of information to be displayed on the screen, the amount of information, and the nature of the information in correspondence with the size of the execution screen of the first application.
[0125] According to one embodiment, the memory may store instructions such as, at execution, detecting whether a first input occurs in which an input using a specific button of separate hardware on an icon of a second application is maintained for a preset time or longer, and if a drag input occurs in a second direction after the occurrence of the first input on the icon of the second application, determining the size of the execution screen of the second application in response to the drag input, executing the second application, and displaying the execution screen of the second application together with the execution screen of the first application as a multi-window.
[0126] According to one embodiment, the memory may store instructions that, at execution, detect whether a first input occurs on the execution screen of a second application, and if the first input is detected on the execution screen of the second application, control the size of the execution screen to remain fixed without changing.
Claims
Claim 1 An electronic device comprising: a touch screen receiving touch input; a processor operatively connected to the touch screen; and a memory, wherein, at execution, the memory stores instructions for the processor to detect whether a first input occurs in which a touch input is maintained on an icon of a first application for longer than a preset time using the touch screen, and if a drag input occurs in a first direction after the occurrence of the first input on the icon of the first application, to determine the size of the execution screen of the first application by considering a change in distance at the position where the drag input was detected, and to execute the first application according to the determined size, and to detect whether a second input occurs in which a touch input is maintained on the execution screen of the first application for longer than a preset time using the touch screen, and if the second input is detected on the execution screen of the first application, to control the execution screen to be fixed and displayed in the form of a widget on the home screen or application tray of the electronic device. Claim 2 In claim 1, the processor is an electronic device that determines the size of the execution screen of the first application in response to user input. Claim 3 An electronic device according to claim 1, wherein the memory stores a table in which size information of the execution screen of the first application is pre-set, and stores instructions for displaying a guide screen to determine whether to select the size of the execution screen from among the pre-set sizes of the execution screen of the first application when the first input occurs on the first application, or to determine the size of the execution screen according to arbitrary user input, and the form of the execution screen includes the form of an icon or a widget. Claim 4 In claim 1, the processor is an electronic device that determines at least one of the type of information to be displayed on the screen, the amount of information, and the nature of the information in correspondence with the size of the execution screen of the first application. Claim 5 In claim 1, the memory is an electronic device that stores instructions for, at execution, for the processor to detect whether the first input occurs when the touch input on the icon of the second application is maintained for a preset time or longer using the touch screen, and for determining the size of the execution screen of the second application in response to the drag input when a drag input occurs in a second direction on the icon of the second application after the first input occurs, to execute the second application, and to display the execution screen of the second application as a multi-window together with the execution screen of the first application. Claim 6 In claim 5, the memory stores instructions for the processor to detect, at execution, whether a second input occurs in which a touch input is maintained for a preset time or longer on the execution screen of the second application using the touch screen, and to control the execution screen to be fixed in the form of a widget on the home screen or application tray of the electronic device when the second input is detected on the execution screen of the second application. Claim 7 An electronic device comprising: a processor operatively connected to separate hardware separated from the electronic device; and a memory, wherein, upon execution, the memory stores instructions for the processor to detect whether a first input occurs in which an input using a specific button of the separate hardware is maintained for a preset time or longer, and if a drag input occurs in a first direction on the icon of the first application after the occurrence of the first input, to determine the size of the execution screen of the first application by considering a change in distance at the position where the drag input was detected, and to execute the first application, and to detect whether a second input occurs in which an input using a specific button of the separate hardware is maintained for a preset time or longer on the execution screen of the first application, and to control the execution screen to be fixed and displayed as a widget on the home screen or application tray of the electronic device when the second input is detected on the execution screen of the first application. Claim 8 delete Claim 9 delete Claim 10 delete Claim 11 In claim 7, the memory stores a table in which size information of the execution screen of the first application is pre-set, and an electronic device that stores instructions for displaying a guide screen to determine whether to select the size of the execution screen from among the pre-set sizes of the execution screen of the first application when the first input occurs on the first application, or to determine the size of the execution screen according to arbitrary user input. Claim 12 delete Claim 13 In claim 7, the memory is an electronic device that stores instructions for, at execution, the processor detecting whether a first input occurs in which an input using a specific button of the separate hardware is maintained for a preset time or longer, and if a drag input occurs in a second direction on the icon of the second application after the occurrence of the first input, determining the size of the execution screen of the second application in response to the drag input, executing the second application, and displaying the execution screen of the second application as a multi-window together with the execution screen of the first application. Claim 14 delete Claim 15 A method for providing a user interface of an electronic device, comprising: detecting whether a first input occurs in which a touch input or a button input is maintained for a preset time or longer on an icon of a first application; determining the size of an execution screen of the first application by considering a change in distance at the position where the drag input is detected when a drag input occurs in a first direction on the icon of the first application after the occurrence of the first input, and executing the first application; detecting whether a second input occurs in which a touch input or a button input is maintained for a preset time or longer on an execution screen of the first application; and controlling the execution screen to be fixed and displayed as a widget on the home screen or application tray of the electronic device when the second input is detected on the execution screen of the first application. Claim 16 delete Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete
Citation Information
Patent Citations
Method and apparatus to provide multi-window at touch device
KR1020140039575A
Devices, methods, and graphical user interfaces for navigating between user interfaces and interacting with control objects
KR1020210064423A
