Methods for control a background application and an electronic device supporting the same

Abstract

An electronic device comprises a display, at least one sensor, a processor, and a memory operatively connected to the display, the sensor, and the processor. The memory stores instructions such that, when executed, the processor displays an execution screen of a first application among the plurality of applications on the display, detects a first user input that is not in contact with the electronic device through the sensor, displays a first user interface related to the control of a second application running in the background among the plurality of applications in a designated area of ​​the display based on the detected first user input, detects a second user input through the at least one sensor, changes the first user interface to a second user interface related to the control of a third application running in the background among the plurality of applications based on the detected second user input, and, when a third user input is detected through the at least one sensor, performs control of the third application based on the third user input. In addition to this, various embodiments identified through this document are possible.

Description

Technology Field

[0001] Various embodiments of the present invention relate to a method for controlling an application running in the background and an electronic device supporting the same. Background Technology

[0002] An electronic device, such as a smartphone, can run multiple applications. For example, the electronic device can run a music playback application to play music. When the electronic device runs an e-book application, such as an e-book, while the music playback application is running, the music playback application that was previously playing music can play music in the background state. Additionally, the e-book application can become foreground, and the e-book application in the foreground state can be displayed on the display in a focusing state controlled by user input currently received by the electronic device. Meanwhile, the technology forming the background of the present invention is disclosed in Korean Patent Publication No. 10-2015-0129830 (published on Nov. 20, 2015), Korean Patent Publication No. 10-2019-0033658 (published on Mar. 29, 2019), and Korean Patent Publication No. 10-2016-0026141 (published on Mar. 9, 2016). The problem to be solved

[0003] However, while existing electronic devices can control applications running in the foreground state through user input such as key input or touch input, it has been difficult to control applications running in the background. For example, an electronic device can call an application running in the background state to the foreground to control it. As a result of calling a foreground application running in the background state, the flow of use of the existing foreground application may be interrupted.

[0004] Various embodiments of the present invention may provide a method for controlling a background application through user input (e.g., gesture or hovering input) that is not in contact with an electronic device, and an electronic device that supports the same. means of solving the problem

[0005] An electronic device according to various embodiments of the present invention comprises a display, at least one sensor, a processor, and a memory operatively connected to the display, the sensor, and the processor. The memory may include instructions that, when executed, the processor displays an execution screen of a first application among the plurality of applications on the display, detects a first user input that is not in contact with the electronic device through the sensor, displays a first user interface related to the control of a second application running in the background among the plurality of applications in a designated area of ​​the display based on the detected first user input, detects a second user input through the at least one sensor, changes the first user interface to a second user interface related to the control of a third application running in the background among the plurality of applications based on the detected second user input, and, when a third user input is detected through the at least one sensor, performs control of the third application based on the third user input.

[0006] An electronic device according to various embodiments of the present invention comprises a display, at least one sensor, a communication module, a processor, and a memory operatively connected to the display, the sensor, the communication module, and the processor. The memory may include instructions that, when executed, cause the processor to transmit data related to an execution screen of a first application installed on the electronic device through the communication module to the external electronic device, display an execution screen of a second application installed on the electronic device on the display, detect a first user input that is not in contact with the electronic device through the at least one sensor, display a first user interface related to the control of the first application in a designated area of ​​the display based on the detected first user input, detect a second user input through the at least one sensor, and transmit a control signal for the first application to the external electronic device through the communication module based on the detected second user input.

[0007] A method of operating an electronic device according to various embodiments of the present invention may include, when a plurality of applications installed on the electronic device are executed, an operation of displaying an execution screen of a first application among the plurality of applications on a display of the electronic device; an operation of detecting a first user input that is not in contact with the electronic device through a sensor of the electronic device; an operation of displaying a first user interface related to the control of a second application running in the background among the plurality of applications in a designated area of ​​the display based on the detected first user input; an operation of detecting a second user input through the sensor; an operation of changing the first user interface to a second user interface related to the control of a third application running in the background among the plurality of applications based on the detected second user input; and an operation of performing control of the third application based on the third user input when a third user input is detected through the sensor. Effects of the invention

[0008] According to various embodiments of the present invention, a background application can be controlled based on an input that is not in contact with an electronic device.

[0009] In addition, according to various embodiments of the present invention, data regarding a background application of an electronic device is transmitted to an external electronic device that is communicationally connected to the electronic device, and when the external electronic device displays the execution screen of the background application, the background application running on the external electronic device can be controlled based on user input detected by the electronic device.

[0010] In addition, various effects that can be identified directly or indirectly through this document may be provided. Brief explanation of the drawing

[0011] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present invention. FIG. 2 is a block diagram of an electronic device that controls an application running in the background according to an embodiment of the present invention. FIG. 3 is a diagram illustrating a method for controlling a plurality of applications running in the background according to an embodiment of the present invention. FIG. 4 is a diagram illustrating a method for controlling an application running in the background while connected to an external electronic device according to an embodiment of the present invention. FIG. 5 is a diagram illustrating a method for controlling an application running on an electronic device based on user input according to an embodiment of the present invention. FIG. 6 is a drawing for illustrating a user interface according to an embodiment of the present invention. FIG. 7 is a diagram illustrating a method for receiving user input through a touch screen according to an embodiment of the present invention. FIG. 8 is a diagram illustrating a method for controlling the function of a background application according to an embodiment of the present invention. FIG. 9 is a diagram illustrating a method for selecting and controlling one of a plurality of applications running in the background according to an embodiment of the present invention. FIG. 10 is a drawing for explaining a method of stopping the activation of a sensor according to an embodiment of the present invention. FIG. 11 is a diagram illustrating a method for controlling a background application while connected to an external electronic device according to an embodiment of the present invention. FIG. 12 is a diagram illustrating a method for controlling a plurality of applications displayed through a multi-window according to an embodiment of the present invention. FIG. 13 is a diagram illustrating a method for controlling a plurality of applications displayed through a multi-window while connected to an external electronic device according to an embodiment of the present invention. Specific details for implementing the invention

[0012] Hereinafter, various embodiments of the present invention are described with reference to the attached drawings. For convenience of explanation, the size of the components illustrated in the drawings may be exaggerated or reduced, and the present invention is not necessarily limited to what is illustrated.

[0013] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present invention.

[0014] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input device (150), sound output device (155), display device (160), audio module (170), sensor module (176), interface (177), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., display device (160) or camera module (180)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components may be implemented as a single integrated circuit. For example, a sensor module (176) (e.g., fingerprint sensor, iris sensor, or light sensor) can be implemented embedded in a display device (160) (e.g., display).

[0015] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can load commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) into volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) and an auxiliary processor (123) (e.g., a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). Additionally or generally, the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0016] The auxiliary processor (123) can control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display device (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)).

[0017] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0018] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0019] The input device (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input device (150) may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus pen).

[0020] The sound output device (155) can output a sound signal to the outside of the electronic device (101). The sound output device (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as multimedia playback or recording playback, and the receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0021] The display device (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display device (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display device (160) may include a touch circuitry configured to detect a touch, or a sensor circuitry configured to measure the intensity of the force generated by said touch (e.g., a pressure sensor).

[0022] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through an input device (150) or output sound through an audio output device (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) that is directly or wirelessly connected to the electronic device (101).

[0023] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0024] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0025] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0026] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0027] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0028] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0029] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0030] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi Direct, or IrDA (infrared data association)) or a second network (199) (e.g., a cellular network, the Internet, or a long-range communication network such as a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify and authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0031] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include a single antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., an RFIC) may be additionally formed as part of the antenna module (197).

[0032] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0033] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the electronic devices (102, 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the request may perform at least part of the requested function or service, or additional functions or services related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the above result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

[0034] FIG. 2 is a block diagram of an electronic device controlling a background application according to an embodiment of the present invention.

[0035] Referring to FIG. 2, the electronic device (200) (e.g., the electronic device (101) of FIG. 1) can execute a plurality of applications stored in a memory (204) (e.g., the memory (130) of FIG. 1). The electronic device (200) can display at least one of the plurality of applications currently running through a display (201) (e.g., the display device (160) of FIG. 1). The electronic device (200) can display one of the plurality of applications in a foreground state on the display. The application running in the foreground state may be an application in a focusing state that is controlled based on user input received by the electronic device (200) while being displayed through the display (201). Hereinafter, when describing various embodiments of the invention, the application in the foreground state will be described as a foreground application. When the foreground application is executed or switched on the electronic device (200), a plurality of applications excluding the foreground application may be executed or switched to a background state. The applications executed or switched to the background state may be non-focused applications that are not controlled based on user input received by the electronic device (200), regardless of whether they are displayed on the display (201). Hereinafter, when describing various embodiments of the invention, the applications in the background state will be described as background applications. The data being executed in the foreground is not limited to data related to the plurality of applications and may include focused content (text, image, video, icon, or symbol) data that is displayed on the display (201) and controlled based on currently received user input.

[0036] According to one embodiment, while the electronic device (200) displays the foreground application on the display (201), it may receive user input that is not in contact with the electronic device (200) through a sensor (202) (e.g., sensor module (176) of FIG. 1). For example, the user input that is not in contact with the electronic device (200) may be a gesture, hovering, or proximity input. Based on the user input that is not in contact with the electronic device (200) received through the sensor (202), the electronic device (200) may display a user interface related to the control of one of a plurality of background applications in a designated area of ​​the display (201).

[0037] According to one embodiment, while the electronic device (200) is displaying the user interface in the designated area, it may detect other user input (e.g., user input not in contact with the electronic device or user input detected on the user interface) through the sensor (202). Based on the other user input detected through the sensor (202), the electronic device (200) may change the user interface to another user interface related to the control of another background application among the plurality of background applications. While the electronic device (200) is displaying the other user interface in the designated area, it may detect yet another user input (e.g., user input not in contact with the electronic device or user input detected on the user interface). Based on the detected yet another user input, the electronic device (200) may control the other background application running in the background.

[0038] The electronic device (200) may include the display (201), the sensor (202), the communication module (203) (e.g., the communication module (190) of FIG. 1), the memory (204) (e.g., the memory (130) of FIG. 1), and the processor (205) (e.g., the processor (120) of FIG. 1). However, the configuration of the electronic device (200) is not limited thereto. According to various embodiments, the electronic device (200) may omit at least one of the components described above and may include at least one additional component. For example, the electronic device (200) may include a speaker (e.g., the sound output device (155) of FIG. 1).

[0039] The display (201) can display at least one application that is executed when at least one of a plurality of applications installed in the electronic device (200) is executed. The display (201) can display not only the executed application but also various contents (e.g., text, images, videos, icons, or symbols) obtained through a wired / wireless network. The display (201) may include a touchscreen. For example, the display (201) can receive touch, gesture, proximity, or hovering inputs using a part of the user's body.

[0040] The sensor (202) can detect user input that is in contact with or not in contact with the electronic device (200). The sensor (202) may include at least one of a touch sensor, an image sensor, and a motion sensor. However, the configuration of the sensor (202) is not limited thereto. According to various embodiments, the sensor (202) may omit at least one of the components described above and may include at least one additional component. For example, the sensor (202) may include a pressure sensor. The electronic device (200) can detect user input through the sensor (202) and control at least one of the plurality of applications based on the detected user input. For example, the sensor (202) may detect touch, gesture, proximity, or hovering input using a part of the user's body to control the plurality of applications.

[0041] The communication module (203) can support communication between the electronic device (200) and an external electronic device. According to one embodiment, data related to at least one of the plurality of applications can be transmitted and received from the external electronic device through the communication module (203). However, the function of the communication module (203) is not limited thereto. For example, the communication module (203) can transmit and receive a signal for controlling the at least one application from the external electronic device.

[0042] The memory (204) may store various data used by at least one component of the electronic device (200). According to one embodiment, the memory (204) may store information related to the user interface displayed through the display (201). Additionally, the memory (204) may store information related to a gesture for controlling at least one of the plurality of applications. For example, the information related to the gesture may be information related to the form of a gesture that matches the function of the application in order to execute the function of at least one of the plurality of applications.

[0043] The processor (205) can control at least one other component of the electronic device (200) and can process or compute various data. The processor (205) can execute a plurality of applications installed in the electronic device (200).

[0044] According to one embodiment, the processor (205) can execute a plurality of applications stored in the memory (204). The processor (205) can execute one of the plurality of applications as a foreground application in a focusing state (e.g., a first application) that can be controlled by a currently received user input. The processor (205) can display the foreground application on the display (201). While displaying the foreground application on the display (201), the processor (205) can receive user input (e.g., a first user input) that is not in contact with the electronic device (200) through the sensor (202). This may include user input gestures, hovering, or proximity inputs that are not in contact with the electronic device (200). The processor (205) can display a user interface (e.g., a first user interface) related to the control of one of the plurality of background applications running in the background (e.g., a second application) in a designated area of ​​the display (201) based on the received user input.

[0045] According to one embodiment, while the processor (205) displays the foreground application through the display (201), the user interface may be displayed in a designated area of ​​the display (201). While displaying the user interface, the processor (205) may receive other user input (e.g., a second user input) that is not in contact with the electronic device (200) through the sensor (202) or the display (201) or is detected on the user interface. The processor (205) may control the one background application based on the received other user input. If the other user input is an input that contacts the electronic device (200), the processor (205) may control the foreground application being displayed on the display (201) based on the other user input that contacts the electronic device (200).

[0046] According to one embodiment, the other user input that is not in contact with the electronic device (200) or is received on the user interface may be a user input that intends to select another background application (e.g., a third application) among a plurality of applications running in the background, rather than a user input that intends to control the one background application. The processor (205) may receive the other user input (a user input not in contact with the electronic device or an input detected on the user interface) that switches to the other background application in order to control the other background application. Based on the received other user input, the processor (205) may change the user interface displayed in the designated area to another user interface (e.g., a second user interface) related to the control of the other application. For example, the user interface displayed in at least a portion of the top of the display (201) (e.g., a designated area) may be changed to a different user interface.

[0047] According to one embodiment, the processor (205) may receive another user input (an input not in contact with the electronic device or an input detected on a second user interface) (e.g., a third user input) through the display (201) or the sensor (202). Upon receiving the other user input, the processor (205) may control the other application based on the other user input.

[0048] As described above, according to various embodiments, an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (200) of FIG. 2) comprises a display (e.g., the display device (160) of FIG. 1 or the display (201) of FIG. 2), at least one sensor (e.g., the sensor module (176) of FIG. 1 or the sensor (202) of FIG. 2), a processor (e.g., the processor (120) of FIG. 1 or the processor (205) of FIG. 2), and a memory (e.g., the memory (130) of FIG. 1 or the memory (204) of FIG. 2) operatively connected to the display, the sensor, and the processor, and the memory comprises, when executed, the processor, while a plurality of applications installed on the electronic device are running, displays the execution screen of a first application among the plurality of applications on the display, detects a first user input that is not in contact with the electronic device through the sensor, and based on the detected first user input, the second application running in the background among the plurality of applications Instructions can be stored to display a first user interface related to control in a designated area of ​​the display, detect a second user input through at least one sensor, change the first user interface to a second user interface related to the control of a third application running in the background among the plurality of applications based on the detected second user input, and, when a third user input is detected through at least one sensor, perform control of the third application based on the third user input.

[0049] According to various embodiments, the first user interface may include an object representing first control information related to the function of the second application, and the second user interface may include an object representing second control information related to the function of the third application.

[0050] According to various embodiments, the first control information may include an object that guides a fourth user input, and the second control information may include an object that guides a third user input.

[0051] According to various embodiments, the instructions allow the processor to divide and display each of the execution screens of the plurality of applications on the screen of the display, and to focus on the execution screen of the first application.

[0052] According to various embodiments, the instructions may display the first user interface on the execution screen of the second application when the processor detects the first user input.

[0053] According to various embodiments, the instructions may display the second user interface on the execution screen of the third application when the processor detects the second user input.

[0054] According to various embodiments, the sensor may include at least one of a touch sensor, an image sensor, and a motion sensor.

[0055] As described above, according to various embodiments, an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (200) of FIG. 2) comprises a display (e.g., the display device (160) of FIG. 1 or the display (201) of FIG. 2), at least one sensor (e.g., the sensor module (176) of FIG. 1 or the sensor (202) of FIG. 2), a processor (e.g., the processor (120) of FIG. 1 or the processor (205) of FIG. 2), and a memory (e.g., the memory (130) of FIG. 1 or the memory (204) of FIG. 2) operatively connected to the display, the sensor and the processor, and, when executed, the memory comprises, the processor transmitting data related to the execution screen of a first application installed on the electronic device to the external electronic device through the communication module, displaying the execution screen of a second application installed on the electronic device on the display, detecting a first user input that is not in contact with the electronic device through the at least one sensor, and based on the detected first user input, Instructions can be stored for displaying a first user interface related to the control of the first application in a designated area of ​​the display, detecting a second user input through the at least one sensor, and transmitting a control signal for the first application to the external electronic device through the communication module based on the detected second user input.

[0056] According to various embodiments, the instructions may include the processor detecting a third user input, changing to a second user interface related to the control of at least one third application installed in the electronic device based on the detected third user input, and in response to changing to the second user interface, transmitting data related to the execution screen of the third application to the external electronic device.

[0057] According to various embodiments, the instructions allow the processor to divide and display the execution screens of the first application, the second application, and the third application on the screen of the display, and to focus on the execution screen of the second application.

[0058] According to various embodiments, the instructions may allow the processor to display the first user interface on the execution screen of the first application based on the detected first user input.

[0059] According to various embodiments, the instructions may allow the processor to display the second user interface on the execution screen of the at least one third application based on the detected third user input.

[0060] According to various embodiments, the first user interface may include an object representing first control information related to the function of the second application, and the second user interface may include an object representing second control information related to the function of the third application.

[0061] According to various embodiments, the first control information may include an object that guides a fourth user input, and the second control information may include an object that guides a third user input.

[0062] According to various embodiments, the sensor may include at least one of a touch sensor, an image sensor, and a motion sensor.

[0063] FIG. 3 is a diagram illustrating a method for controlling a plurality of applications running in the background according to an embodiment of the present invention.

[0064] Referring to FIG. 3, in operation 301, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2)) may execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor may execute or switch one of the plurality of applications as a foreground application in a focusing state controlled by user input received by the electronic device. The processor may display the foreground application on the display of the electronic device (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). The processor may execute or switch a plurality of applications other than the foreground application as background applications. The above background application may be an application that is not focused, excluding the foreground application among a plurality of applications, and may be an application that is not controlled based on user input received by the electronic device.

[0065] According to one embodiment, the processor may execute or switch a first application among a plurality of applications as a foreground application to be displayed in a focused state on the display. When the processor executes or switches the first application (e.g., foreground application), the first application may be displayed on the display.

[0066] In operation 303, when the processor displays one of the plurality of applications as a foreground application through the display, it can execute or switch the plurality of applications excluding the foreground application as background applications.

[0067] In operation 305, the processor may detect user input that is not in contact with the electronic device (200) through a sensor of the electronic device (e.g., sensor module (176) or sensor (202) of FIG. 1). Based on the detected user input, the processor may display a user interface related to the control of one of the multiple background applications running in the background in a designated area of ​​the display.

[0068] According to one embodiment, the processor may receive a first user input (e.g., user input) through the sensor, which is an input that is not in contact with the electronic device (e.g., hovering input or gesture). Based on the received first user input, the processor may display a first user interface (e.g., user interface) related to the control of a second application (e.g., one background application) among a plurality of background applications running in the background of the display in a designated area of ​​the display.

[0069] According to another embodiment, if the first user input is an input that comes into contact with the electronic device (e.g., a key input or a touch input), the processor can control the first application being displayed through the display based on the first user input that comes into contact with the electronic device.

[0070] 307 In operation, while the processor is displaying the user interface in the designated area, it may receive other user input through the sensor or the display (user input that is not in contact with the electronic device or user input detected on the user interface). Based on the other user input received, the processor may change the user interface being displayed in the designated area to another user interface related to the control of another background application among a plurality of background applications running in the background.

[0071] According to one embodiment, the processor may receive a second user input (a user input that is not in contact with the electronic device or a user input detected on the first user interface) through the sensor. Based on the received second user input, the processor may change the first user interface displayed in the designated area to a second user interface (another user interface). The second user interface may be an interface related to the control of a third application (another background application) among a plurality of applications running in the background of the display.

[0072] According to another embodiment, the second user input received by the processor may be a user input intended to control the second application, rather than a user input intended to control the third application. The operation of the processor to determine whether to control the second application among background applications or to call a second user interface for controlling the third application based on the received user input that is not in contact with the electronic device will be described in detail in FIG. 6.

[0073] 309 In operation, while the processor displays the other user interface in the designated area, it may receive another user input through the display or the sensor (user input that is not in contact with the electronic device or user input detected on the other user interface).

[0074] 311 In operation, the processor can control the other background application running in the background of the display based on the other user input received.

[0075] According to one embodiment, the processor may receive a third user input (e.g., another user input) through the sensor or the display. While displaying the second user interface, the processor may control the third application among a plurality of applications running in the background of the display based on the received third user input.

[0076] According to another embodiment, the processor can control the third application by touching an object representing control information displayed on the second user interface. The object representing the control information will be described in detail in FIG. 6.

[0077] As described above, according to various embodiments, a method of operation of an electronic device (e.g., the electronic device (101) of FIG. 1 or the electronic device (200) of FIG. 2) comprises: displaying the execution screen of a first application among the plurality of applications on the display of the electronic device (e.g., the display device (160) of FIG. 1 or the display (201) of FIG. 2)) while a plurality of applications installed on the electronic device are executed; detecting a first user input that is not in contact with the electronic device through a sensor of the electronic device (e.g., the sensor module (176) of FIG. 1 or the sensor (202) of FIG. 2); displaying a first user interface related to the control of a second application running in the background among the plurality of applications in a designated area of ​​the display based on the detected first user input; detecting a second user input through the sensor; changing the first user interface to a second user interface related to the control of a third application running in the background among the plurality of applications based on the detected second user input; and through the sensor When a third user input is detected, the method may include an operation to perform control of the third application based on the third user input.

[0078] According to various embodiments, the operation of displaying the execution screen of the first application on the display of the electronic device may further include dividing and displaying each of the execution screens of the plurality of applications on the screen of the display and focusing the execution screen of the first application.

[0079] According to various embodiments, when the first user input is detected, the operation of displaying the first user interface on the execution screen of the second application may be included.

[0080] According to various embodiments, when the second user input is detected, the operation of displaying the second user interface on the execution screen of the third application may be included.

[0081] According to various embodiments, the first user interface may include an operation of displaying an object representing first control information related to the function of the second application, and the second user interface may include an operation of displaying an object representing second control information related to the function of the third application.

[0082] FIG. 4 is a diagram illustrating a method for controlling an application running in the background while connected to an external electronic device according to an embodiment of the present invention.

[0083] Referring to FIG. 4, in operation 401, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) may execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor may execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor may display the foreground application in a focusing state on the display of the electronic device (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). The processor can be communicated to an external electronic device (e.g., the electronic device (102 or 104) of FIG. 1) through a communication module (e.g., the communication module (190) of FIG. 1 or the communication module (203) of FIG. 2) and transmit data related to the execution screen of a foreground application being displayed through the display.

[0084] According to one embodiment, the processor can control a first application (e.g., a foreground application) among a plurality of applications based on received user input while displaying it on the display. While the processor is displaying the foreground application through the display, it can transmit data related to the execution screen of the foreground application through the communication module to the external electronic device. The external electronic device can display the foreground application on the display of the external electronic device based on the received data related to the execution screen of the foreground application.

[0085] 403 In operation, the processor of the electronic device may execute another application among the plurality of applications. When the processor executes the other application, it may switch the foreground application currently running to a background application so that it runs in the background. As the foreground application switches to a background application, the processor may display the other application through the display as a foreground application in a focused state. That is, in order to control the other application based on user input receiving the other application, the processor may display the foreground application in a focused state through the display, release the focus of the foreground application that was previously displayed on the display, and switch it to a background application.

[0086] According to one embodiment, the processor may execute a second application among a plurality of applications. When the processor executes the second application, in order to display the second application in a focused state through the display, the processor may release the focused state of the first application that was previously running and switch to a background application. However, even if the first application is switched to a background application, the external electronic device may display the execution screen of the first application.

[0087] According to another embodiment, the 401 operation and the 403 operation may be performed in a reversed order. The processor may execute a plurality of applications. The processor may display a second application among the executed plurality of applications as a foreground application in a focused state through the display.

[0088] While the processor displays the second application through the display, it can transmit data related to the execution screen of the first application among the plurality of background applications running in the background to the external electronic device.

[0089] In operation 405, the processor may detect user input that is not in contact with the electronic device through a sensor of the electronic device (e.g., sensor module (176) or sensor (202) of FIG. 1). Based on the detected user input, the processor may display a user interface related to the control of one of the plurality of background applications running in the background in a designated area of ​​the display.

[0090] According to one embodiment, the processor may receive a first user input (e.g., user input) through the sensor, which is an input that is not in contact with the electronic device (e.g., hovering input or gesture). Based on the received first user input, the processor may display a first user interface related to the control of a first application among a plurality of background applications running in the background of the display in a designated area of ​​the display.

[0091] According to another embodiment, if the first user input is an input in contact with the electronic device, the processor can control the second application (e.g., foreground application) based on the first user input in contact with the electronic device.

[0092] 407 In operation, while the processor displays the user interface in the designated area, it may receive other user input through the display or the sensor.

[0093] In operation 409, the processor may transmit a control signal for one background application to the external electronic device through the communication module in response to the other user input received.

[0094] According to one embodiment, the processor of the electronic device may receive a second user input (e.g., another user input) through the sensor or the display. While the processor is displaying a first user interface (e.g., a user interface) in the designated area, it may control a first application among a plurality of background applications running in the background of the display based on the received second user input. In response to controlling the first application running in the background, the processor may transmit a control signal to the external electronic device through the communication module to control the first application displayed by the external electronic device. If the second user input is a user input for controlling the volume of the first application, the processor may transmit a control signal for controlling the volume of the first application being output by the external electronic device, thereby causing the external electronic device to control the volume of the first application being output by the external electronic device.

[0095] According to another embodiment, the processor can control the first application running in the background by touching an object representing control information displayed on the first user interface. The processor can control the first application running in the background based on the touch input of the object representing control information. In response to controlling the first application, the processor can transmit a control signal to the external electronic device to control the volume function of the first application that is outputting a voice signal from the external electronic device. A detailed description of the object representing control information will be provided in FIG. 6.

[0096] FIG. 5 is a diagram illustrating a method for controlling an application running on an electronic device based on user input according to an embodiment of the present invention.

[0097] Referring to FIG. 5, in state 510, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor can execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor can display at least a portion of the execution screen (500) of the foreground application through the touch screen of the electronic device (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). While the processor displays the foreground application on the display, it can execute or switch a plurality of applications other than the foreground application to background applications that are not in focus.

[0098] As in state 530, the processor may receive an input (513) (e.g., key input or touch input) that is in contact with the electronic device through the touch screen. The processor may control a foreground application that is displayed in a focusing state on the touch screen based on the received input (513) that is in contact with the electronic device based on the user input (513) that is in contact with the electronic device.

[0099] According to one embodiment, the processor may execute or switch a first application among the plurality of applications as a foreground application to be displayed on the touch screen in a focused state. While the processor is displaying the first application on the touch screen in a focused state, it may execute or switch the plurality of applications excluding the first application as background applications in an unfocused state.

[0100] According to one embodiment, the processor may receive a first user input (513) through the touch screen. Based on the received first user input (513) (user input contacting the electronic device (e.g., key input or touch input)), the processor may scroll a portion of the screen (500) of the first application currently displayed on the touch screen to display it as another screen (531).

[0101] Additionally, the processor of the electronic device may display a sensor icon (512) indicating that a sensor (e.g., sensor module (176) or sensor (202) of FIG. 1) is activated in at least a portion of the touchscreen. While the sensor icon (512) is displayed, the processor may receive an input (511) (e.g., gesture or hovering) that is not in contact with the electronic device through the sensor.

[0102] In the 550 state, if the processor receives an input (511) that is not in contact with the electronic device through the sensor, it may display a gesture icon (551) indicating that a user input (511) that is not in contact with the electronic device is currently being detected in at least a portion of the touch screen. While displaying the gesture icon (551), the processor may control the detected user input on a user interface related to the control of a background application running in the background.

[0103] According to one embodiment, while the processor is displaying at least a portion of the screen (500) of a first application (e.g., foreground application), it may receive a second user input (e.g., another user input) through the sensor while the sensor icon is displayed. The processor may display a gesture icon (551) indicating that the second user input is being received in at least a portion of the touchscreen. Based on the received second user input, the processor may control the second application among a plurality of applications running in the background.

[0104] FIG. 6 is a drawing for illustrating a user interface according to an embodiment of the present invention.

[0105] Referring to FIG. 6, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (600) (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2)) may execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor may execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor may display at least a portion of the execution screen (610) of the foreground application (e.g., at least a portion of the execution screen (500) of the first application of FIG. 5) on the touch screen of the electronic device (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). As the processor executes or switches the foreground application, it can execute or switch a plurality of applications other than the foreground application as background applications that are not in a focused state.

[0106] The processor can detect user input that is not in contact with the electronic device (600) through a sensor of the electronic device (e.g., sensor module (176) or sensor (202) of FIG. 1). Based on the detected user input that is not in contact with the electronic device, the processor can display a user interface (650) related to the control of one of the multiple background applications running in the background in a designated area of ​​the display.

[0107] According to one embodiment, the user interface (650) may include at least one of an icon (651) of the one background application, title information (652) of the one background application, an object (653) representing control information, and a guide icon (654) for controlling the one background application. The icon (651) of the one background application may be an icon representing a background application installed on the electronic device. The title information (652) of the one background application may be the title of the one background application installed on the electronic device or the title of content running in the one background application.

[0108] According to one embodiment, the object (653) representing the control information is an object corresponding to at least one function included in the second application (another background application), and the user can check which function among the functions included in the second application to control through the object (653) representing the control information. For example, the object (653) representing the control information may represent a volume control function, a rewind function, a fast-forward function, and a stop function of the second application. Additionally, the object (653) representing the control information may include an object representing a swap function that changes the first user interface (650) to a second user interface related to the control of the third application in order to control the third application instead of the second application.

[0109] According to one embodiment, the guide icon (654) for controlling the second application may include an object that guides each function of the second application in order to control the functions of the second application. For example, the guide icon (654) may be an icon representing the form of a gesture that matches the function of the second application. When the processor detects a gesture (user input) similar to the form of the guide icon (654) for controlling the second application through the sensor, it may execute the function of the second application that matches the detected guide icon.

[0110] FIG. 7 is a diagram illustrating a method for receiving user input through a touch screen according to an embodiment of the present invention.

[0111] Referring to FIG. 7, in state 710, the processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of the electronic device (700) (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can receive user input. The processor of the electronic device can receive user input that contacts the electronic device (700), such as key input or touch input, through a touch screen (711) (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). Additionally, the processor of the electronic device (700) can receive user input that does not contact the electronic device (700) through the touch screen (711).

[0112] In state 730, the processor of the electronic device (700) can receive user input that is not in contact with the electronic device (700) in at least a portion area (731) of the touch screen (711). For example, the processor of the electronic device (700) can detect user input that is not in contact with the electronic device (700) based on a change in capacitance detected in at least a portion area (731) of the touch screen (711).

[0113] In state 750, when the processor of the electronic device (700) receives user input that is not in contact with the electronic device (700) in at least a portion area (731) of the touch screen (711), a gesture icon (752) and a processing object (751) may be displayed on the touch screen (711). The gesture icon (752) and the processing object (751) may be different forms of a user interface displayed in at least a portion area of ​​the touch screen (711). The gesture icon (752) may be an icon indicating that the electronic device (700) is currently receiving user input that is not in contact with the electronic device (700). The processing object (751) may be an object indicating the progress of a task performed based on the received user input that is not in contact with the electronic device (700). The processing object (751) may change color and shape depending on the progress of the task being performed.

[0114] FIG. 8 is a diagram illustrating a method for controlling the function of a background application according to an embodiment of the present invention.

[0115] Referring to FIG. 8, in state 810, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) may execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor may execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor may display the executed foreground application on the display of the electronic device (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). The processor may execute or switch a plurality of applications other than the foreground application into a background application that is not in a focusing state.

[0116] According to one embodiment, the processor may designate a first application among a plurality of applications as a foreground application to be displayed on the display in a focused state. The first application may be an application that is displayed on the display in a focused state and can be controlled based on user input received by the processor. When the processor selects the first application as a foreground application, a plurality of applications excluding the first application may be switched or executed as background applications.

[0117] The processor may display the foreground application through the display. While displaying the foreground application, if the processor receives user input (e.g., gesture or hovering input) that has not been in contact with the electronic device for a specified period of time near the electronic device via the sensor, the processor may display a sensor icon (811) in at least a portion of the display. The sensor icon (811) may be an icon indicating that the sensor can detect input that has not been in contact with the electronic device.

[0118] In state 830, the processor may receive user input that is not in contact with the electronic device through the sensor while the sensor icon (811) is displayed in at least a portion of the display. Based on the received user input that is not in contact with the electronic device, the processor may display a user interface (831) (e.g., user interface (650) of FIG. 6) related to the control of one of the plurality of background applications in a designated area of ​​the display. The user interface (831) may include at least one of an icon of the one background application, title information of the one background application, an object representing control information, and a guide icon for controlling the one background application.

[0119] According to one embodiment, while the processor displays the first application in the focusing state through the display, it may receive a first user input through the sensor, which is an input that is not in contact with the electronic device. Based on the received first user input, the processor may display a first user interface (831) related to the control of a second application among a plurality of background applications in a designated area of ​​the display. The processor may display an icon of the second application through the first user interface (831). The processor may display the title of the content being played by the second application (e.g., My station) through the user interface (831). The processor may display an object representing control information of the second application. The object representing control information may be an object representing a volume control function, a rewind function, a fast-forward function, or a stop function, which are functions of the second application.

[0120] According to one embodiment, the processor may display a guide icon for controlling a second application through the first user interface (831). The guide icon may be a gesture icon matched to a function of the second application to control the function of the second application. When the processor receives a form of a gesture similar to the guide icon through the sensor, it may control the function of the second application matched to the form of the gesture.

[0121] In state 850, the processor may receive other user input (852) through the sensor. The other user input (852) may include user input that is not in contact with the electronic device or user input detected on the user interface (831).

[0122] In state 870, the processor can control the one background application running in the background based on the other received user input (852). The processor can display an object (871) representing the sound of the one background application in at least a portion of the display in response to increasing the sound of the one background application.

[0123] According to one embodiment, the processor may detect a second user input (852) for controlling a second application through the sensor (a user input that is not in contact with the electronic device or a user input detected on the first user interface). The processor may control the second application among a plurality of background applications based on the detected second user input (852). If the received second user input (852) is a user input that selects a guide icon matched with a function to increase sound among the functions of the second application, the processor may increase the sound of the content being played by the second application. In response to increasing the sound of the content being played by the second application, the processor may display an object (871) indicating the sound level of the content in at least a portion of the display.

[0124] FIG. 9 is a diagram illustrating a method for selecting and controlling one of a plurality of applications running in the background according to an embodiment of the present invention.

[0125] Referring to FIG. 9, in the 910 state, the processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of the electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor can execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor can control the foreground application based on user input received by the electronic device by displaying it in a focusing state through the display of the electronic device (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). The processor can execute or switch the plurality of applications, excluding the foreground application, in an unfocused background state.

[0126] According to one embodiment, the processor may execute or switch a first application among a plurality of applications as a foreground application to be displayed through the display in a focused state. The processor may execute or switch the plurality of applications, excluding the first application, as unfocused background applications. When the processor detects user input (e.g., gesture or hovering input) that has not been in contact with the electronic device for a specified period of time near the electronic device through the sensor, the processor may display a sensor icon (911) in at least a portion of the display. The sensor icon (911) may be an icon indicating that the sensor can detect user input that has not been in contact with the electronic device.

[0127] In state 930, the processor may receive user input through the sensor while displaying the sensor icon (911) on the display and not in contact with the electronic device. Based on the received user input, the processor may display a user interface (931) (e.g., user interface (650) of FIG. 6) related to the control of one of the plurality of background applications in a designated area of ​​the display. The user interface (931) may include at least one of an icon of the one background application, title information of the one background application, an object representing control information, and a guide icon for controlling the one background application.

[0128] According to one embodiment, while the processor is displaying the first application on the display, it may receive a first user input that is not in contact with the electronic device through the sensor. Based on the received first user input, the processor may display a first user interface (931) related to the control of a second application among the background applications through a designated area of ​​the display. The processor may display first control information (932) related to the function of the second application on the first user interface (931). The processor may display the title of the content being played by the second application (e.g., Black Car) through the first user interface (931). The object representing the first control information may be an object representing the functions of the second application, such as a volume control function, a rewind function, a fast-forward function, and a stop function.

[0129] In state 930, while the user interface (931) is displayed in a designated area of ​​the display, the processor may receive other user input (user input not in contact with the electronic device or user input detected on the user interface) through the sensor or the display. The processor may control the one background application based on the received other user input. However, the received other user input may be an input intended to select the other background application in order to control the other background application among the plurality of background applications. If the form of the other user input detected through the sensor is similar to the form indicated by the control information of the function of changing the one background application to the other background application, the processor may change the user interface (931) to another user interface (951). The processor may acquire user input (gesture) through the sensor and identify the form of the acquired user input based on the characteristic points of the acquired user input (e.g., the border points of the gesture).

[0130] According to one embodiment, the processor may display a first user interface (931) related to the control of the second application in a designated area of ​​the display. While displaying the first user interface (931), the processor may receive a second user input (a user input not in contact with an electronic device) through the sensor. The processor may extract feature points of the second user input received through the sensor and identify the shape of the second user input (gesture) based on the extracted feature points.

[0131] According to one embodiment, the processor may compare the form of the identified second user input with the form of a guide icon included in the first control information (932) displayed on the first user interface (931). The guide icon may be an icon that matches the function of changing from the second application to the third application. If the form of the second user input is similar to the form indicated by the guide icon, the processor may execute the function that matches the guide icon (selecting the application to be controlled as a video playback application (third application)). The processor may change the first user interface (931) related to the control of the second application displayed in a designated area of ​​the display to the second user interface (951) related to the control of the third application.

[0132] In state 950, the processor may display another user interface (951) related to the control of another background application among a plurality of background applications in a designated area of ​​the display. While the processor is displaying the other user interface (951), it may receive user input (952) through the sensor. The processor may control another background application of the electronic device based on the received third user input (952). If the received user input (952) is an input that increases the volume of the other background application, the processor may increase the volume of the other background application.

[0133] In state 970, the processor controls the other background application based on the received user input (952) and can display an object (971) indicating that it is controlling the other background application.

[0134] According to one embodiment, the processor may display a second user interface (951) related to the control of a third application (another background application) in a designated area of ​​the display. While displaying the second user interface (951), the processor may receive a third user input (952) through the sensor. The third user input (952) may be an input that is not in contact with the electronic device (e.g., a gesture or hovering input) and may be an input detected on the area of ​​the second user interface (951) (e.g., a key input or a touch input). If the received third user input (952) is an input that increases the volume of another background application among the plurality of background applications, the processor may increase the volume of the other background application based on the third user input (952).

[0135] According to one embodiment, the processor may display an object (971) representing a volume gauge of the other background application in at least a portion of the display in response to increasing the volume of the other background application. The object (971) may be an object related to the function being controlled, in addition to the volume gauge, when the processor controls the function of one of the multiple applications running in the background based on user input received.

[0136] FIG. 10 is a drawing for explaining a method of stopping the activation of a sensor according to an embodiment of the present invention.

[0137] Referring to FIG. 10, in the 1010 state, the processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of the electronic device (1000) (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (1000) (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor can execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor can display the foreground application on the display of the electronic device (1000) (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). While the processor displays the foreground application in a focused state on the display, it can execute or switch a plurality of applications other than the foreground application to the background application in an unfocused state.

[0138] According to one embodiment, the processor may receive user input through a sensor (e.g., the sensor module (176) of FIG. 1 or the sensor (202) of FIG. 2). The user input may be user input that is in contact with or not in contact with the electronic device. The processor may receive user input that is not in contact with the electronic device (e.g., gesture or hovering input) through the sensor (e.g., image sensor). The processor may receive user input that is not in contact with the electronic device when the sensor is active. The processor may display a sensor icon (1001) (e.g., the sensor icon (512) of FIG. 5) indicating that the sensor is active in at least a portion of the display.

[0139] According to one embodiment, the processor may receive a first user input (a user input that is not in contact with the electronic device) while the sensor icon (1001) is displayed. When the processor receives the first user input through the sensor, it may display a gesture icon (1002) (e.g., the gesture icon (551) of FIG. 5) on the display to indicate that it is receiving a user input that is not in contact with the electronic device. The gesture icon (1002) may be an icon that the processor displays when it receives an input that is not in contact with the electronic device (1000) through the sensor. The gesture icon (1002) may be another form of user interface.

[0140] According to one embodiment, if the first user input is an input that terminates the activation of the sensor, the processor may prevent the sensor icon (1001) and the gesture icon (1002) from being displayed on the display, such as in state 1030.

[0141] According to another embodiment, the processor may reactivate the sensor (e.g., image sensor). The processor may reactivate the sensor when it receives a gesture that activates the sensor near the sensor through another sensor (e.g., motion sensor), or when it receives a gesture that is maintained for a specified amount of time. The processor may control the other sensor to maintain activation when the power of the electronic device (1000) is on, and may not display a sensor icon (1001) separately.

[0142] FIG. 11 is a diagram illustrating a method for controlling a background application while connected to an external electronic device according to an embodiment of the present invention.

[0143] Referring to FIG. 11, in the 1110 state, the processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of the electronic device (1111) (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can execute the plurality of applications based on data related to the plurality of applications stored in the memory of the electronic device (1111) (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor can execute or switch one of the plurality of applications into a foreground application in a focusing state controlled by user input received by the electronic device. The processor can display the foreground application in a focusing state through a display (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2).

[0144] According to one embodiment, while the processor displays at least a portion (1112) of the execution screen of the foreground application on the display, it may transmit data related to the execution screen of one of the plurality of background applications excluding the foreground application to an external electronic device (1115) (e.g., the electronic device (102 or 104) of FIG. 1) via a communication module (e.g., the communication module (190) of FIG. 1 or the communication module (203) of FIG. 2). The processor may transmit and receive data via the communication module using a wired / wireless network. The wired / wireless network may include, but is not limited to, at least one of Wi-Fi (wifi-direction), Bluetooth, NFC (near field communication), and USB (universal serial bus). The one background application may be an application that is not in a focusing state and is not controlled by user input received by the processor.

[0145] According to one embodiment, in state 1130, the processor of the electronic device (1111) may receive a user input (1113) that is not in contact with the electronic device (1111) through the sensor. When the processor of the electronic device (1111) receives the user input (1113), it may display a user interface related to the control of one of a plurality of background applications in a designated area of ​​the display. While outputting the user interface related to the control of the one background application, the processor of the electronic device (1111) may receive another user input (a user input not in contact with the electronic device or a user input detected on the user interface) through the sensor or the display. The processor of the electronic device may control the one background application based on the received other user input.

[0146] According to one embodiment, if the other user input received by the processor of the electronic device (1111) is an input that controls the volume of the one background application, the processor of the electronic device (1111) can control the volume of the one background application. As the processor controls the volume of the one background application, it can display an object (1132) related to the volume of the one background application in at least a portion of the display area of ​​the electronic device (1111).

[0147] The processor can transmit a signal to the external electronic device (1115) displaying the execution screen of the one background application to adjust the volume through the communication module in response to adjusting the volume of the one background application based on user input (1113) that is not in contact with the electronic device (1111). The external electronic device (1115) can control the volume of the one background application displayed by the external electronic device (1115) while displaying a separate object (1131) corresponding to the object (1132) on the display of the external electronic device (1115) based on the received signal.

[0148] According to one embodiment, in state 1150, the processor may receive user input (1114) that is in contact with the electronic device (1111) through a sensor (e.g., sensor module (176) of FIG. 1 or sensor (202) of FIG. 2) or through the display. Based on the received user input (1114) that is in contact with the electronic device (1111), the processor may control a foreground application that is displayed through the display of the electronic device (1111). For example, if the received user input (1114) that is in contact with the electronic device (1111) is an input that scrolls a portion of the screen of the foreground application displayed through the display, the processor may scroll the screen of the foreground application based on the received user input (1114) that is in contact with the electronic device (1111). Since the processor controls the foreground application that is being displayed in a focused state on the display based on the user input (1114) that is in contact with the electronic device (1111), it may not separately transmit a signal to the external electronic device (1115) that is displaying the background application to control the background application.

[0149] FIG. 12 is a diagram illustrating a method for controlling a plurality of applications displayed through a multi-window according to an embodiment of the present invention.

[0150] Referring to FIG. 12, in state 1210, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor can display the executed plurality of applications through a divided screen (e.g., multi-window) of the display (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2).

[0151] According to one embodiment, in a state 1210, the processor can execute each of the first application (1213), the second application (1214), the third application (1215), and the fourth application (1216) among the plurality of applications and display them through the divided screen of the display. The processor can designate the first application (1213) as the foreground application in a focusing state. As the processor designates the first application (1213) as the foreground application, the applications (the second application (1214), the third application (1215), and the fourth application (1216)) excluding the first application (1213) (foreground application) can be designated as background applications. The processor may apply a graphic effect (1211) to at least a portion of the display to distinguish between a foreground application (e.g., a first application (1213)) and background applications (1214, 1215, and 1216). The graphic effect may apply a colored diagonal line to the border of the screen displaying the foreground application (1213), apply a semi-transparent effect to the background applications (1214, 1215, and 1216), and apply various graphic effects to distinguish the focused application.

[0152] According to one embodiment, the processor may display a sensor icon (1212) indicating that a sensor (e.g., sensor module (176) or sensor (202) of FIG. 1) is activated on a screen where the foreground application (first application (1213)) in the focusing state is displayed. The processor may receive a user input (e.g., first user input) that is not in contact with the electronic device through the sensor while the sensor icon (1212) is activated. The user input that is not in contact with the electronic device may be a gesture input or a hovering input. Based on the received user input that is not in contact with the electronic device, the processor may display a user interface (1231) (e.g., first user interface) related to the control of one of the background applications (second application (1214)) that is being displayed on one of the divided screens of the display. The second application (1214) may be one of the background applications among a plurality of background applications. The processor can display the user interface (1231) in at least a portion of the execution screen of the second application (1214).

[0153] In state 1230, the processor may receive other user input (e.g., a second user input) while displaying the user interface (1231). The other user input may be an input that is not in contact with the electronic device or a user input detected on the user interface related to the control of the second application (1214).

[0154] The processor may control the one background application (1214) based on the other user input received. If the other user input received by the processor is an input that controls the volume function of the one background application (the second application (1214)), the processor may control the volume of the one background application (the second application (1214)). On the other hand, the other user input received by the processor may be a user input for controlling another background application (the third application (1215)) among the applications displayed on the split screen of the display. When the processor receives the user input selected to control the other background application, the processor may display another user interface (1251) related to the control of the other background application in at least a portion of the screen displaying the other background application.

[0155] According to another embodiment, the processor may receive user input (e.g., key input or touch input) that is in contact with the electronic device while displaying the user interface (1231). The processor may control a foreground application (first application (1213)) that is being displayed in a focused state through the display based on the received user input that is in contact with the electronic device.

[0156] In state 1250, the processor may receive another user input (e.g., a third user input) through the sensor or the display. The other user input may be a user input that is not in contact with the electronic device or a user input detected on the other user interface.

[0157] According to one embodiment, if another user input received by the processor is an input related to a function of controlling the volume of the other background application, the processor can control the volume of the other background application based on the other user input.

[0158] In state 1270, the processor may display a volume gauge object (1271) in at least a portion of the screen displayed by the display of the electronic device in response to controlling the volume of the other background application (third application (1215)) based on the received other user input. The volume gauge object (1271) may be another form of the user interface.

[0159] FIG. 13 is a diagram illustrating a method for controlling a plurality of applications displayed through a multi-window while connected to an external electronic device according to an embodiment of the present invention.

[0160] Referring to FIG. 13a, a processor (e.g., processor (120) of FIG. 1 or processor (205) of FIG. 2) of an electronic device (e.g., electronic device (101) of FIG. 1 or electronic device (200) of FIG. 2) can execute a plurality of applications based on data related to a plurality of applications stored in the memory of the electronic device (e.g., memory (130) of FIG. 1 or memory (204) of FIG. 2). The processor can display the executed plurality of applications on each of the divided screens of the display (e.g., display device (160) of FIG. 1 or display (201) of FIG. 2). The processor can display the execution screens of the first application (1313), the second application (1314), the third application (1315), and the fourth application (1316) among the plurality of applications through each of the divided screens of the display. The processor may designate the first application (1312) among the plurality of applications (the first application (1313), the second application (1314), the third application (1315), and the fourth application (1316)) as the foreground application in a focused state. The processor may display a sensor icon (1312) indicating that a sensor (e.g., the sensor module (176) of FIG. 1 or the sensor (202) of FIG. 2)) is activated on at least some of the screens where the execution screen of the focused first application is displayed. Additionally, the processor may apply graphic effects to at least some areas of the display to distinguish between the foreground application and background applications that are not in a focused state.

[0161] According to one embodiment, the processor of the electronic device may receive user input that is not in contact with the electronic device through the sensor. The user input that is not in contact with the electronic device may include one of gesture input or hovering input. The processor may display a user interface (1317a) on the execution screen of one of the plurality of background applications based on the received user input that is not in contact with the electronic device. The user interface (1317a) may be an interface related to the control of one of the plurality of background applications selected based on the user input that is not in contact with the electronic device. The processor may transmit data related to the execution screen of one of the background applications to be controlled through the user interface (1317a) to an external electronic device (1320).

[0162] According to one embodiment, the processor may receive a first user input (an input that is not in contact with the electronic device) through the sensor. Based on the received first user input, the processor may display a first user interface related to the control of a second application among a plurality of background applications in a designated area of ​​the display. For example, the processor may display the first user interface in the top area of ​​the display. As another example, the processor may display the first user interface on the execution screen of the second application that is to be controlled through the first user interface. The processor may transmit data related to the execution screen of the second application that is to be controlled through the first user interface to the external electronic device (1320).

[0163] Referring to FIG. 13b, the processor may receive other user input through the sensor. The other user input may be user input that is not in contact with the electronic device or user input detected on the user interface (1317a). Additionally, the other user input may be user input that selects another background application (e.g., a third application (1315)) among the plurality of background applications to control the other background application. Based on the received other user input, the processor may change the user interface (1317a) to another user interface (1317b) and display it through a designated area of ​​the display. For example, the processor may display the other user interface (1317b) on the execution screen of the other background application to be controlled through the other user interface (1317b). The processor can transmit data related to the execution screen of the other background application to the external electronic device (1320) through the communication module as the user interface (1317a) changes to the other user interface (1317b).

[0164] According to one embodiment, the processor may receive a second user input (a user input that is not in contact with the electronic device or a user input detected on the first user interface) through the sensor. Based on the received second user input, the processor may display a second user interface (1317b) related to the control of a third application (another background application) among a plurality of background applications. The processor may display the second user interface (1317b) on the execution screen of the third application. In response to displaying the second user interface (1317b), the processor may transmit data related to the execution screen of the third application to the external electronic device (1320) through the communication module.

[0165] Referring to FIG. 13c, the processor may receive another user input (e.g., a third user input) through the sensor. The other user input may be a user input that is not in contact with the electronic device or a user input detected on the other user interface (1317b). Based on the received other user input, the processor may control one of the functions of the other background application included in the other user interface (1317b). The processor may receive the other user input that is similar in form to a guide icon that matches the function of the other background application among the control information of the other user interface (1317b). For example, if the form of the detected other user input is similar to the form of a guide icon that matches the function of adjusting the volume of the other background application among the control information displayed through the other user interface (1317b), the processor may adjust the volume of the other background application.

[0166] The processor may display a volume gauge object (1317c) related to volume control of the other background application in response to volume control of the other background application. The processor may transmit a signal to the external electronic device (1320) to control the volume of the other background application displayed by the external electronic device (1320) in response to volume control of the other background application in response to volume control of the other background application in response to volume control of the other background application in response to volume control of the external electronic device (1320). Upon receiving the signal, the external electronic device (1320) may display a separate object (1321) corresponding to the volume gauge object (1317c).

[0167] According to one embodiment, the processor may receive a third user input through the sensor. The processor may control the function of the third application based on the third user input. If the third user input is an input that controls the volume of the third application, the processor may display a volume gauge object related to the volume of the third application through the display while adjusting the volume of the third application. In response to controlling the volume of the third application, the processor may transmit a signal to the external electronic device to control the volume of the third application. The external electronic device may adjust the volume of the third application being displayed based on the received signal.

[0168] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0169] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" and "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0170] As used in this document, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0171] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0172] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0173] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the components of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to the integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

Claim 1 An electronic device comprises: a display; at least one sensor; at least one processor; and a memory for storing instructions, wherein when the instructions are executed by the at least one processor, the electronic device displays on the display a screen of execution of a first application among the plurality of applications while a plurality of applications installed on the electronic device are executed, and while displaying a first icon indicating that the at least one sensor is activated in at least a portion of the display in response to a gesture input activating the at least one sensor, a first user input not in contact with the electronic device through the at least one sensor is detected, and based on the detected first user input, a first user interface related to the control of a second application running in the background among the plurality of applications is displayed in a designated area of ​​the display, wherein the first user interface includes control information regarding at least one function included in the second application and guide information indicating the form of a gesture matched with at least one function of the second application, and while the first user input is detected, a second icon indicating that the first user input is being received is displayed in at least a portion of the display. While displaying the first user interface, a second user input is detected through the at least one sensor, and if the detected second user input is an input that contacts the electronic device, the execution screen of the first application is controlled, and if the detected second user input is an input that does not contact the electronic device and does not correspond to guide information included in the first user interface, the first user interface is changed to a second user interface related to the control of a third application running in the background among the plurality of applications.The second user interface includes control information regarding at least one function included in the third application and guide information indicating the form of a gesture matched to at least one function of the third application; an electronic device that, upon detecting a third user input corresponding to the guide information included in the second user interface through the at least one sensor, performs control of the third application based on the third user input. Claim 2 delete Claim 3 delete Claim 4 An electronic device according to claim 1, wherein, when the instructions are executed by the at least one processor, the electronic device divides and displays each of the execution screens of the plurality of applications on the screen of the display and focuses the execution screen of the first application. Claim 5 An electronic device according to claim 4, wherein, when the instructions are executed by the at least one processor, the electronic device displays the first user interface on the execution screen of the second application when it detects the first user input, and displays the second user interface on the execution screen of the third application when it detects the second user input. Claim 6 delete Claim 7 delete Claim 8 An electronic device comprises: a display; at least one sensor; a communication module; at least one processor; and a memory for storing instructions. When the instructions are executed by the at least one processor, the electronic device transmits data related to an execution screen of a first application installed on the electronic device to an external electronic device via the communication module, displays an execution screen of a second application installed on the electronic device on the display, and while displaying a first icon indicating that the at least one sensor is active in at least a portion of the display in response to a gesture input activating the at least one sensor, detects a first user input that is not in contact with the electronic device through the at least one sensor, and based on the detected first user input, displays a first user interface related to the control of the first application in a designated area of ​​the display, wherein the first user interface includes control information regarding at least one function included in the first application and guide information indicating the form of a gesture matched with at least one function of the first application, and while the first user input is detected, a second icon indicating that the first user input is being received is displayed in at least a portion of the display. An electronic device that detects a second user input through at least one sensor, controls the execution screen of the second application if the detected second user input is an input that contacts the electronic device, and transmits a control signal for the first application to the external electronic device through the communication module if the detected second user input is an input that does not contact the electronic device. Claim 9 An electronic device according to claim 8, wherein, when the instructions are executed by the at least one processor, the electronic device detects a third user input, changes to a second user interface related to the control of at least one third application installed on the electronic device based on the detected third user input, and in response to the change to the second user interface, transmits data related to the execution screen of the third application to the external electronic device. Claim 10 In claim 9, the electronic device, when the instructions are executed by the at least one processor, divides and displays the execution screens of the first application, the second application, and the third application on the screen of the display, and focuses the execution screen of the second application. Claim 11 An electronic device according to claim 10, wherein, when the instructions are executed by the at least one processor, the electronic device displays the first user interface on the execution screen of the first application based on the detected first user input, and displays the second user interface on the execution screen of the at least one third application based on the detected third user input. Claim 12 delete Claim 13 delete Claim 14 delete Claim 15 delete Claim 16 A method of operating an electronic device, wherein, in a state where a plurality of applications installed on the electronic device are executed, an operation of displaying an execution screen of a first application among the plurality of applications on a display of the electronic device; an operation of detecting a first user input that is not in contact with the electronic device through the sensor while displaying a first icon indicating that the sensor is active in at least a portion of the display in response to a gesture input that activates the sensor of the electronic device; an operation of displaying a first user interface related to the control of a second application running in the background among the plurality of applications in a designated area of ​​the display based on the detected first user input, wherein the first user interface includes control information regarding at least one function included in the second application and guide information indicating the form of a gesture matched with at least one function of the second application, and a second icon indicating that the first user input is being received is displayed in at least a portion of the display while the first user input is detected; an operation of detecting a second user input through the sensor while displaying the first user interface; and if the detected second user input is an input that contacts the electronic device, controlling the execution screen of the first application. Operation; if the detected second user input is an input that does not come into contact with the electronic device and does not correspond to guide information included in the first user interface, the operation of changing the first user interface to a second user interface related to the control of a third application running in the background among the plurality of applications, wherein the second user interface includes control information regarding at least one function included in the third application and guide information indicating the form of a gesture matched with at least one function of the third application;A method of operation of an electronic device comprising the operation of performing control of the third application based on the third user input when a third user input corresponding to guide information included in the second user interface is detected through the sensor. Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete

Images