Window control method and electronic device

Abstract

The present application relates to the technical field of terminals, and provides a window control method and an electronic device. The present application can adaptively change the size of a source window and / or a target window in response to a cross-window operation of a user, so that the operation of the user is facilitated by means of the adaptive change of the window. The method comprises: an electronic device displays a first interface, the first interface comprising a first window and a second window; and when detecting a first operation of a user moving a first content displayed in the first window to the second window, the electronic device adjusts the size of the first window and / or the second window in response to the first operation, wherein the size of the adjusted first window is smaller than that of the unadjusted first window, and the size of the adjusted second window is greater than that of the unadjusted second window.

Description

Window control method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on June 15, 2023, with application number 202310713824.2 and application name “Window Control Method and Electronic Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of terminal technology, and in particular to a window control method and electronic device. Background Art

[0003] With the development of terminal technology, electronic devices support running multiple application windows to meet users' multi-window usage needs. For example, while editing a memo, a user can open a browser in a floating window to browse the web. This allows the user to add the content found in the browser to the memo being edited.

[0004] However, due to the limitation of the display size of electronic devices, the floating window will block the memo content being displayed. Therefore, during the operation, the user needs to close or minimize the floating window first before viewing the location of the content to be added in the memo, which is cumbersome for the user to operate.

[0005] Summary of the Invention

[0006] To solve the above technical problems, the present application provides a window control method and electronic device. The technical solution provided by the present application adaptively changes the display size of the source window and / or the target window in response to a user's cross-window operation, thereby facilitating user operations through adaptive window changes.

[0007] In order to achieve the above technical objectives, this application provides the following technical solutions:

[0008] In a first aspect, a window control method is provided for use in an electronic device. The method includes: displaying a first interface, the first interface including a first window and a second window; detecting a first user operation to move first content displayed in the first window to the second window; and resizing the first window and / or the second window in response to the first operation, such that the resized first window is smaller than the pre-resized first window, and the resized second window is larger than the pre-resized second window.

[0009] In some examples, the first operation is, for example, a cross-window drag operation, wherein the first window is, for example, a source window, and the second window is, for example, a target window.

[0010] In this way, in response to a user's cross-window drag operation, the electronic device automatically reduces the size of the source window and / or automatically enlarges the size of the target window. This simplifies the user's operation, avoids the source window from obstructing the target window, and facilitates the user's determination of the insertion position of the moved content in the target window.

[0011] According to the first aspect, the first interface further includes a third window, and the method further includes: in response to the first operation, adjusting the size of the third window, wherein the adjusted third window is smaller than the third window before the adjustment.

[0012] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adapts the size and / or position of one or more windows among the multiple windows currently displayed, thereby facilitating the user's operation in the target window.

[0013] According to the first aspect, or any implementation of the first aspect above, the window type of the first window and the window type of the second window remain unchanged before and after resizing; or, before and after resizing, the window type of the first window and / or the window type of the second window change.

[0014] According to the first aspect, or any implementation of the first aspect above, the window type includes at least one of a full-screen window, a floating window, a split-screen window, a card window, an icon window, and a floating ball window.

[0015] For example, while the electronic device is displaying a memo application in full screen, it displays a browser application in a floating window. For example, the first window is the memo application window, and the second window is the browser application window. The electronic device detects that a user has selected and dragged an image displayed in the first window toward the second window. The electronic device then automatically reduces the size of the first window to prevent it from obscuring the second window, making it easier for the user to locate the image in the second window. That is, the window type of the second window remains unchanged before and after the resizing.

[0016] For example, a floating window and a card window are displayed on the desktop of an electronic device. The first window is, for example, a floating window, and the second window is, for example, a card window. The electronic device detects that a user has selected an image displayed in the first window and then dragged it to the second window. The electronic device may then launch the memo application corresponding to the second window and display the last displayed application interface of the memo application in full screen. That is, the window type of the second window changes before and after resizing.

[0017] In this way, the electronic device can adaptively change the window size according to the window type, enrich the window change scenarios, and improve the user experience.

[0018] According to the first aspect, or any implementation of the first aspect above, the first application corresponding to the second window is not started or is running in the background, and the method also includes: in response to the first operation, starting the first application, and displaying the most recently closed page or home page of the first application in the resized second window.

[0019] Exemplarily, a floating window and an icon window are displayed on the desktop of an electronic device, where the first window is, for example, a floating window, and the second window is, for example, an icon window. The electronic device detects an operation by a user to drag a picture displayed in a source floating window to move it to the icon window. Then, the electronic device can start the memo application corresponding to the icon window and display the memo application in full screen. Optionally, when the electronic device is running the memo application in the background, if the cross-window drag operation of the above-mentioned user is detected, the electronic device can directly display the memo interface running in the background; or, if the electronic device does not start the memo application, in response to the cross-window drag operation of the above-mentioned user, the electronic device starts the memo application and displays the homepage of the memo application.

[0020] In this way, when displaying the desktop, the electronic device can also respond to user operations and adaptively adjust the window size or position to facilitate the user's cross-window operations.

[0021] In addition, if the application corresponding to the target window is not started, the electronic device can also respond to the user operation and adaptively start the application corresponding to the target window to meet the user's usage needs.

[0022] According to the first aspect, or any implementation of the first aspect above, the first operation is a cross-window drag operation on the first content, and in response to the first operation, the size of the first window and / or the second window is adjusted, including: in response to the first operation, the size of the first window and / or the second window is adjusted in a direction opposite to the drag direction of the first operation.

[0023] According to the first aspect, or any implementation of the first aspect above, the first operation is a cross-window drag operation on the first content, and the method also includes: in response to the first operation, adjusting the display position of the first window and / or the second window in a direction opposite to the drag direction of the first operation.

[0024] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adaptively adjusts the position of the source window and / or target window, thereby preventing the source window from blocking the target window, facilitating the user's operation in the target window.

[0025] According to the first aspect, or any implementation of the first aspect above, the method further includes: moving the display position of the first window in a clockwise direction to avoid movement of the first content in response to the first operation.

[0026] According to the first aspect, or any implementation of the first aspect above, detecting a first operation by a user to move the first content displayed in the first window to the second window includes: detecting a first operation by a user to move the first content displayed in the first window to a hot zone range of the second window, the hot zone range including a display area of ​​the second window and a display area within a preset range outside the second window, the display area of ​​the second window, and at least one of a display area within a preset range outside the second window.

[0027] For example, the second window is a floating window. The entire floating window is the hot zone range corresponding to the floating window; or the hot zone range of the floating window includes the area where the floating window is located and the range within N pixel widths around the floating window, where N is a positive integer; or the hot zone range of the floating window is the range within N pixel widths around the floating window.

[0028] In other embodiments, when the electronic device detects the user's operation of moving the content of the first window to the second window, it is not necessary to change the size and display position of the first window or the second window.

[0029] For example, if the electronic device determines that the first window does not obstruct the second window, or the size of the second window is greater than a preset threshold, the user can more easily determine the position where the mobile content is to be inserted. In this case, the electronic device does not need to adjust the window size and / or position, thereby reducing the amount of computation required by the electronic device and lowering the device's power consumption.

[0030] In a second aspect, a window control method is provided for use in an electronic device. The method includes: displaying a first interface, the first interface including a first window and a second window; detecting a first user operation to move first content displayed in the first window to the second window; and, in response to the first operation, adjusting the display position of the first window and / or the second window in a direction opposite to the dragging direction of the first operation.

[0031] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adaptively adjusts the position of the source window and / or target window, thereby preventing the source window from blocking the target window, facilitating the user's operation in the target window.

[0032] According to the second aspect, the method further includes: moving the display position of the first window in a clockwise direction to avoid movement of the first content in response to the first operation.

[0033] According to the second aspect, or any implementation of the second aspect above, the method also includes: in response to the first operation, adjusting the size of the first window and / or the second window, the first window after resizing is smaller than the first window before resizing, and the second window after resizing is larger than the second window before resizing.

[0034] According to the second aspect, or any implementation of the above second aspect, the first application corresponding to the second window is not started or is running in the background, and the method also includes: in response to the first operation, starting the first application, and displaying the most recently closed page or home page of the first application in the resized second window.

[0035] According to the second aspect, or any implementation of the above second aspect, the first operation is a cross-window drag operation on the first content, and the method also includes: in response to the first operation, adjusting the size of the first window and / or the second window in a direction opposite to the drag direction of the first operation.

[0036] According to the second aspect, or any implementation of the second aspect above, detecting the first operation of the user to move the first content displayed in the first window to the second window includes: detecting the first operation of the user to move the first content displayed in the first window to the hot zone range of the second window, the hot zone range includes the display area of ​​the second window and the display area within the preset range outside the second window, the display area of ​​the second window, and at least one of the display area within the preset range outside the second window.

[0037] The technical effects corresponding to the second aspect and any implementation method of the second aspect can be found in the technical effects corresponding to the above-mentioned first aspect and any implementation method of the first aspect, and will not be repeated here.

[0038] In a third aspect, an electronic device is provided. The electronic device includes: a processor, a memory, and a display screen. The memory and the display screen are coupled to the processor. The memory is used to store computer program code. The computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the electronic device executes the method provided in the first aspect and any one of the implementations of the first aspect.

[0039] In a fourth aspect, an electronic device is provided. The electronic device includes: a processor, a memory, and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the electronic device executes the method provided in the second aspect and any one of the implementations of the second aspect.

[0040] In a fifth aspect, an electronic device is provided, comprising one or more functional modules for implementing the window control method described in the first aspect and any possible implementation thereof; or, alternatively, the electronic device comprises one or more functional modules for implementing the window control method described in the second aspect and any possible implementation thereof. The functional modules may be implemented in hardware, or corresponding software may be executed by hardware.

[0041] In a sixth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program (also referred to as instructions or code). When the computer program is executed by an electronic device, the electronic device performs the method of the first aspect or any one of the embodiments of the first aspect; or performs the method of the second aspect or any one of the embodiments of the second aspect.

[0042] In the seventh aspect, a computer program product is provided. When the computer program product is run on an electronic device, the electronic device executes the method of the first aspect or any one of the embodiments of the first aspect; or, the electronic device executes the method of the second aspect or any one of the embodiments of the second aspect.

[0043] In an eighth aspect, a circuit system is provided, the circuit system including a processing circuit, the processing circuit being configured to execute the method of the first aspect or any one of the embodiments of the first aspect; or, the processing circuit being configured to execute the method of the second aspect or any one of the embodiments of the second aspect.

[0044] In the ninth aspect, a chip system is provided, comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor. When the at least one processor executes the instructions, the at least one processor executes the method of the first aspect or any one of the embodiments of the first aspect; or, the at least one processor executes the method of the second aspect or any one of the embodiments of the second aspect.

[0045] The technical effects of the aforementioned aspects can be referenced with each other and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] FIG1 is a schematic diagram of a scenario in which a user manually adjusts the window size according to an embodiment of the present application;

[0047] FIG2 is a schematic diagram of the electronic device provided in an embodiment of the present application;

[0048] FIG3 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0049] FIG4 is a schematic diagram of a software structure block diagram of an electronic device provided in an embodiment of the present application;

[0050] FIG5 is a schematic diagram of an interface for adaptively reducing a source window in a floating window scenario provided by an embodiment of the present application;

[0051] FIG6 is a schematic diagram of a window display position adjustment direction according to an embodiment of the present application;

[0052] FIG7 is a schematic diagram of an interface for adaptively restoring a source window in a floating window scenario provided by an embodiment of the present application;

[0053] FIG8 is a schematic diagram of an interface for adaptively reducing a source window in a split-screen scenario provided by an embodiment of the present application;

[0054] FIG9 is a first schematic diagram of an interface for adaptively enlarging a target window in a floating window scenario provided by an embodiment of the present application;

[0055] FIG10 is a second schematic diagram of an interface for adaptively enlarging a target window in a floating window scenario provided by an embodiment of the present application;

[0056] FIG11 is a schematic diagram of an interface for adaptively restoring a target window in a floating window scenario provided by an embodiment of the present application;

[0057] FIG12 is a schematic diagram of an interface for adaptively adjusting multiple windows provided in an embodiment of the present application;

[0058] FIG13 is a first schematic diagram of an interface for adaptively adjusting a target window displayed on a desktop according to an embodiment of the present application;

[0059] FIG14 is a second schematic diagram of an interface for adaptively adjusting a target window displayed on a desktop provided by an embodiment of the present application;

[0060] FIG15 is a third schematic diagram of an interface for adaptively adjusting a target window displayed on a desktop provided by an embodiment of the present application;

[0061] FIG16 is a fourth schematic diagram of an interface for adaptively adjusting a target window displayed on a desktop according to an embodiment of the present application;

[0062] FIG17 is a fifth diagram of an interface for adaptively adjusting a target window displayed on a desktop provided by an embodiment of the present application;

[0063] FIG18 is a schematic diagram of an interface for adaptively adjusting a target window displayed in the background according to an embodiment of the present application;

[0064] FIG19 is a flow chart of a window control method according to an embodiment of the present application;

[0065] FIG20 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0066] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two).

[0067] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0068] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.

[0069] In some embodiments, the electronic device supports multi-window display. For example, the electronic device can display different applications in different windows through various methods such as floating windows and split screens, so that users can operate multiple applications at the same time to meet usage needs.

[0070] For example, as shown in (a) in Figure 1, when the mobile phone displays the memo application interface 101 in full screen, the browser application is displayed through the floating window 102. In this way, the user can easily add the content queried by the browser to the memo. However, due to the limited display area, the floating window will block the memo content, and it is inconvenient for the user to view the blocked content. Then, the user needs to manually adjust the size of the floating window to facilitate pasting the copied browser query content in the memo. For example, in response to the user clicking the minimize control 11, as shown in (b) in Figure 1, the mobile phone shrinks the floating window 102 to a floating ball 103, so that the user can continue to edit the memo content. Afterwards, if the user needs to continue to query through the browser, he needs to click the floating ball 103 again, so that the mobile phone can respond to the user's operation and display the interface shown in (c) in Figure 1, and then display the browser application through the floating window 102.

[0071] It can be seen that since the window size needs to be manually adjusted by the user, it is difficult for the user to operate across windows, which affects the user experience.

[0072] Therefore, in an embodiment of the present application, a window control method is provided, in which the electronic device adaptively changes the display size and / or position of the source window and / or target window in response to the user's cross-window operation, thereby facilitating the user's operation through the adaptive change of the window.

[0073] Optionally, the window control method provided in the embodiment of the present application can be applied to an electronic device 100. As shown in FIG2 , the electronic device 100 can be a mobile phone 21, a tablet computer 22, a laptop computer 23, a wearable device 24, a smart screen 25, a vehicle terminal 26, a computer, a computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), an artificial intelligence (AI) device, or other terminal device with a display function. The operating system installed on the electronic device 100 includes but is not limited to This application does not limit the specific type of the electronic device 100 or the installed operating system.

[0074] Exemplarily, as shown in Figure 3, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0075] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0076] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0077] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0078] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0079] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0080] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to a touch sensor, a charger, a flash, a camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to a touch sensor via an I2C interface, enabling communication between the processor 110 and the touch sensor via the I2C bus interface, thereby enabling touch functionality of the electronic device 100.

[0081] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0082] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect to other first electronic devices, such as an AR device.

[0083] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0084] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the first electronic device via the power management module 141.

[0085] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0086] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0087] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0088] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0089] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0090] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with a network and other devices via wireless communication technology. Wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. GNSS may include the global positioning system (GPS), the global navigation satellite system (GLONASS), the Beidou navigation satellite system (BDS), the quasi-zenith satellite system (QZSS) and / or the satellite based augmentation system (SBAS).

[0091] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0092] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be manufactured using a liquid crystal display (LCD), for example, an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini-LED, a Micro-LED, a Micro-OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 can include one or N display screens 194, where N is a positive integer greater than one.

[0093] In some embodiments, the electronic device 100 displays multiple application windows on the display screen 194, detects a user's cross-window operation on the display screen 194 through a touch sensor, and determines that the user has instructed to copy or cut the content displayed in the source window and drag it to the target window. Then, in response to the user operation, the electronic device 100 adaptively adjusts the size of the source window and / or the target window to facilitate the user's operation in the target window.

[0094] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0095] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0096] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0097] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be set in the processor 110, or some functional modules of the audio module 170 can be set in the processor 110. The electronic device 100 can use the audio module 170, such as music playback and recording. The audio module 170 may include a speaker, a receiver, a microphone, a headphone jack, and an application processor to implement audio functions.

[0098] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0099] A touch sensor, also known as a "touch-sensitive device," can be provided on the display screen 194. The touch sensor and the display screen 194 form a touch screen, also known as a "touch screen." The touch sensor is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor can also be provided on the surface of the electronic device 100, at a location different from that of the display screen 194.

[0100] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0101] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback.

[0102] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0103] The SIM card interface 195 is used to connect a SIM card. The device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.

[0104] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0105] FIG4 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

[0106] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0107] The application layer can include a series of application packages.

[0108] As shown in FIG4 , the application package may include applications such as calendar, contacts, memo, camera, music, gallery, map, call, video, etc.

[0109] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0110] As shown in FIG4 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0111] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0112] In some embodiments, the electronic device 100 manages the display position and size of multiple windows being displayed through a window manager. When the electronic device 100 detects a user dragging selected display content from a source window toward a target window and determines that the user has instructed to copy the dragged display content to the target window for display, the electronic device 100 adjusts the size of the source window and / or the target window through the window manager to prevent the source window from obscuring the target window and affecting the user's dragging operation.

[0113] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0114] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0115] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0116] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0117] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0118] The Android runtime includes the core library and the virtual machine. The Android runtime is responsible for scheduling and management of the Android system.

[0119] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0120] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0121] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0122] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0123] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0124] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0125] A 2D graphics engine is a drawing engine for 2D drawings.

[0126] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0127] In some embodiments, the electronic device supports multi-window display. For example, the electronic device can display multiple application windows at the same time through floating windows, split screens, etc., to meet the user's needs for simultaneous operation of multiple applications. In some cases, the user needs to move the content of one window to another window by copying, cutting, etc. For example, after the user selects the content queried in the browser application window, he or she can drag and drop it to the memo application window to add the memo content, making it easier for the user to record the queried content.

[0128] In some examples, in response to a user's cross-window drag operation, the electronic device automatically reduces the size of the source window to facilitate the user's dragging of the selected content to the target window. For example, if the source window overlaps the target window, reducing the source window's covered area reduces the area of ​​the target window, making it easier for the user to determine the location in the target window where the selected content is to be inserted. The source window is the window where the user's drag operation is detected, i.e., the window where the selected content is copied or cut. The target window is the window where the user's drag operation ends, i.e., the window where the selected content is to be inserted.

[0129] For example, in a floating window scenario, as shown in FIG5(a), an electronic device displays a browser application through a floating window while displaying a memo application in full screen. The source window 11 is a browsing application window, and the target window 21 is a memo application window. The source window 11 covers the target window 21. If a user needs to insert the content displayed in the source window 11 (such as a picture 101) into the target window 21 for display, the target window 21 may be blocked, which may affect the user's ability to determine the insertion position of the selected content in the target window 21. For example, as shown in FIG5(b), the electronic device detects that the user has selected the picture 101 displayed in the source window 11 and dragged it toward the target window 21 in the direction indicated by the arrow 102, and determines that the user has indicated that the picture 101 is to be inserted into the target window 21 by copying or cutting. Then, as shown in FIG5(c), the electronic device automatically reduces the size of the source window 11 to avoid the source window 11 blocking the target window 21, thereby making it easier for the user to determine the position of the picture 101 to be inserted in the target window 21.

[0130] In some examples, the user's operation of inserting content from a source window into a target window can include other operations in addition to the drag-and-drop operation described above. For example, after a user selects content in the source window and then clicks the target window, the source window can adaptively resize to facilitate the user's paste operation in the target window. The following describes the window change process using the example of a user dragging selected content across windows.

[0131] In some examples, the electronic device may also prevent the source window from affecting the user's operations in the target window through other means, such as increasing the transparency of the source window, moving the display position of the source window, or making the target window cover the source window.

[0132] In some examples, the electronic device changes the display position and / or size of the source window in response to a user's drag operation based on the drag direction. For example, in the scenario shown in FIG5 , if the electronic device detects that the user has dragged the source window in the direction indicated by arrow 102 toward the upper left of the display screen, the source window may be reduced in size or moved in the direction opposite to arrow 102.

[0133] For example, as shown in FIG6 , taking the four quadrants as an example, the electronic device moves and / or shrinks the source window in the direction opposite to the user's dragging direction. For example, if the electronic device detects that the user has dragged the selected content from the fourth quadrant to the second quadrant, it may move and / or shrink the source window from the second quadrant to the fourth quadrant. Alternatively, the electronic device moves the source window clockwise (or counterclockwise) to avoid the user's dragging of the selected content to the target window. For example, as shown in FIG5 (c), after the electronic device detects that the user has moved the image 101 to the target window 21, it continues to perform the drag operation to adjust the display position of the image 101 in the target window 21. For example, if the electronic device detects that the user has dragged the image 101 from the third quadrant to the fourth quadrant, it may control the source window 11 to move clockwise, such as from the fourth quadrant to the third quadrant, to avoid the display position of the image 101. Optionally, the center position of the four quadrants may be the center position of the electronic device's display screen.

[0134] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adaptively adjusts the size and / or position of the source window, thereby facilitating the user's operation in the target window.

[0135] In some embodiments, after the user moves the selected content in the source window to the target window, the user may need to continue operating the application displayed in the source window. In this case, the electronic device can automatically restore the display of the source window in response to the user's operation on the source window.

[0136] Exemplarily, as shown in (c) in FIG5 , the electronic device displays the image 101 in the target window at the position indicated by the user by pasting it in response to the user operation. Afterwards, as shown in (a) in FIG7 , the electronic device detects the operation of the user clicking on the blank display area 701 in the source window 11, or detects the operation of the user clicking on the magnification control 702 displayed on the source window 11, and determines that the user indicates to operate the source window 11. Then, as shown in (b) in FIG7 , the electronic device may enlarge the source window 11 to facilitate the user to continue to operate the source window. Optionally, the display position and size of the enlarged source window are the same as the display position and size of the source window before the electronic device adaptively shrinks and / or moves the source window in response to the user's cross-window drag operation, that is, the electronic device restores the display of the source window.

[0137] As another example, in a split-screen scenario, the electronic device may also adaptively change the size of the source window in response to the user's cross-window drag operation. As shown in Figure 8 (a), the electronic device displays a memo application and a browser application in split screen, for example, the source window 11 displays the browser application, and the target window 21 displays the memo application. As shown in Figure 8 (b), the electronic device detects that the user has selected the picture 801 displayed in the source window 11 (such as long pressing the picture 801) and dragged the picture 801 toward the target window 21 in the direction indicated by the arrow 802. As shown in Figure 8 (c), the electronic device may automatically reduce the size of the source window 11 in response to the user's cross-window drag operation, and the corresponding target window 21 automatically enlarges as the source window 11 is reduced. In this way, the user can more conveniently determine the position of the picture 801 to be inserted in the enlarged target window 21.

[0138] It should be understood that the above embodiments describe the process of adaptively adjusting the size and / or position of a window in response to a user's cross-window drag operation, assuming that the source window and target window interact during display. For example, when the source window obscures the target window, the electronic device adaptively reduces the size of the source window. In some scenarios, the source window and target window do not interact during display, but the display of the target window is inconvenient for the user to operate. In this case, the electronic device may adaptively adjust the window display to facilitate user operation.

[0139] In some embodiments, when the electronic device detects a user's cross-window dragging operation during multi-window display and determines that the target window is smaller, it can adaptively enlarge the display of the target window, thereby facilitating the user to confirm the insertion position of the dragged content in the target window.

[0140] For example, as shown in FIG9 (a), the electronic device displays the memo application through a floating window during the full-screen display of the browser application. Among them, the source window 11 is the browsing application window, and the target window 21 is the memo application window. It can be seen that if the user needs to insert the content in the source window 11 into the target window 21 for display, since the target window 21 is small, it is difficult for the user to accurately determine the position of the selected content to be inserted in the target window. For example, as shown in FIG9 (b), the electronic device detects the user's operation of dragging the picture 901 to the target window 21 in the direction indicated by the arrow 902, and determines that the user instructs to insert the picture 901 into the target window 21 for display. Then, as shown in FIG9 (c), in response to the user operation, the electronic device enlarges the target window 21 to facilitate the user to determine the insertion position of the picture 901 in the target window 21.

[0141] Optionally, if the electronic device determines that the size of the target window is less than a preset threshold, it may determine that the target window needs to be enlarged in response to the user's cross-window drag operation. Alternatively, if the electronic device determines that the target window is in a non-maximum display state under the current window format when the user's cross-window drag operation is detected, the target window may be enlarged. For example, in the scenario shown in Figure 9, the target window 21 is in a small window state of a floating window. In response to the user's cross-window drag operation, the electronic device may enlarge the target window 21 and display the target window 21 as a large window.

[0142] Optionally, when the electronic device detects that the user drags the content in the source window to the hot zone range of the target window, it determines that the user's cross-window drag operation is detected. Optionally, the hot zone range of the window is, for example, the display area where the window is located, or the display area where the window is located and the display area within a preset range outside the window. For example, the entire floating window is the hot zone range corresponding to the floating window; or the hot zone range of the floating window includes the area where the floating window is located and the range within N pixel widths outside the floating window, where N is a positive integer; or the hot zone range of the floating window is the range within N pixel widths outside the floating window.

[0143] In some embodiments, when the electronic device detects a user dragging operation across windows, it can adaptively change the size and / or position of the target window to reduce the difficulty of the user's operation.

[0144] For example, in the scenario shown in Figure 9, the electronic device detects that the user has selected the image 901 displayed in the source window 11 and is dragging it. It determines that the target window 21 is displayed in the direction of the user's drag, and it can be determined that the user needs to drag the image 901 across windows to the target window for display. Then, as shown in Figure 10 (a), the electronic device can enlarge the target window 21 in the direction opposite to the user's dragging direction. Then, as shown in Figure 10 (b), it is convenient for the user to determine the insertion position of the image 901 in the target window 21. In addition, the distance that the user drags the selected content is reduced, reducing the difficulty of the user's operation.

[0145] Optionally, when the electronic device detects that the user has dragged selected content in the source window beyond a preset distance and there is another window in the dragging direction, it determines that the user is performing a cross-window drag operation and adaptively enlarges or moves the target window. This avoids the adaptive adjustment of the target window, which would affect the user's ability to move displayed content in the source window.

[0146] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adaptively adjusts the size and / or position of the target window, thereby facilitating the user's operation in the target window.

[0147] In some embodiments, after the user moves the selected content in the source window to the target window, the user may need to continue operating the application displayed in the source window. In this case, the electronic device can automatically restore the display of the source window in response to the user's operation on the source window.

[0148] Exemplarily, as shown in FIG10(b), the electronic device displays the image 901 in the target window at the position indicated by the user by pasting it in response to the user operation. Afterwards, as shown in FIG11(a), the electronic device detects the user's operation of clicking on the source window 11 and determines that the user has indicated to operate the source window 11. Then, as shown in FIG11(b), the electronic device can shrink the target window 21 to avoid the target window blocking the source window 11, so that the user can continue to operate the source window 11. Optionally, the display position and size of the shrunken target window are the same as the display position and size of the target window before the electronic device enlarges and / or moves the target window in response to the user's cross-window drag operation, that is, the electronic device restores the display of the target window.

[0149] The above introduces the changes of the source window or target window in response to the user's cross-window drag operation. In some scenarios, the source window, target window and other windows displayed by the electronic device can all change in response to the user's cross-window drag operation to facilitate the user's operation in the target window.

[0150] In some embodiments, when displaying multiple windows, the electronic device detects a user's cross-window drag operation and determines to adjust the display of other currently displayed windows and one or more windows in the target window to avoid the display of other windows affecting the user's operation in the target window.

[0151] For example, as shown in FIG12(a), the electronic device displays a browser application window 11 as a floating window and displays a memo application window 21 and a media application window 31 in a split-screen manner. As shown in FIG12(b), the electronic device detects that a user has selected an image 1201 displayed in the browser application window 11 and dragged it toward the memo application window 21 in the direction indicated by arrow 1202, reaching the hot zone of the memo application window 21. The electronic device can then determine that the user has performed a cross-window drag operation, with the source window being the browser application window 11 and the target window being the memo application window 21. As shown in FIG12(c), the electronic device can adaptively adjust the multiple windows being displayed. For example, the electronic device can automatically shrink the browser application window 11 to prevent it from obscuring the memo application window 21; the electronic device can also automatically shrink the media application window 31 and correspondingly enlarge the memo application window 21. This enlarged display of the memo application window 21, which reduces obstruction, makes it easier for the user to determine the insertion position of the image 1201 that has been moved across windows.

[0152] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adapts the size and / or position of one or more windows among the multiple windows currently displayed, thereby facilitating the user's operation in the target window.

[0153] In some embodiments, the multiple windows displayed by the electronic device include full-screen windows, floating windows, split-screen windows, card windows (or described as cards), icon windows (or described as icons), floating ball windows (or described as floating balls), etc. When the electronic device detects that a user has selected and dragged displayed content in one window to another window, the electronic device may trigger adaptive resizing of the window.

[0154] In some examples, if the application corresponding to the target window is not started or is in the background, the electronic device can trigger the application corresponding to the target window to be pulled up and displayed in the foreground. It should be understood that the screen content of the foreground application can include not only the screen visible to the user, but also content without a user interface, content in a transparent layer, or content that is hidden from the user by other application interfaces.

[0155] Optionally, after the electronic device launches the application corresponding to the target window, the application interface displayed may be the application interface last displayed when the user exits the foreground display of the application, or may be an application interface frequently used by the user, or may be a default application interface set by the user.

[0156] In some examples, the electronic device enlarging the target window in response to a user's cross-window drag operation includes enlarging the target window without changing the display form or enlarging the target window with a change in the display form. Examples of display forms include full-screen display, floating window display, card display, icon display, floating ball display, etc. Optionally, the electronic device shrinking the source window in response to a user's cross-window drag operation includes shrinking the target window without changing the display form or shrinking the target window with a change in the display form.

[0157] For example, in response to a user's cross-window drag operation, the electronic device determines that the target window is a floating window, and enlarges the floating window displayed in a small window state to a floating window displayed in a large window state, that is, the display form of the enlarged target window does not change. For another example, in response to a user's cross-window drag operation, the electronic device determines that the target window is a card window, pulls up the application corresponding to the card window and displays the interface of the application in full screen, that is, the display form of the enlarged target window is changed. For another example, in response to a user's cross-window drag operation, the electronic device determines that the target window is a floating ball window, pulls up the application corresponding to the floating ball window and displays the application through the floating window, or displays the application card corresponding to the floating ball window, or displays the interface of the application corresponding to the floating ball window in full screen, etc., that is, the display form of the enlarged target window is changed. For another example, in response to a user's cross-window drag operation, the electronic device determines that the target window is an icon window, pulls up the application corresponding to the icon window and displays the interface of the application corresponding to the icon window in full screen, or displays the application card corresponding to the icon window, or displays the application corresponding to the icon window through a floating window, etc., that is, the display form of the enlarged target window is changed.

[0158] Exemplarily, as shown in (a) of FIG13 , the electronic device displays a floating window 11, a card 12, an icon 13, and a floating ball 14. As shown in (b) of FIG13 , the electronic device detects that the user selects the picture 1301 displayed in the floating window 11 and drags it in the direction indicated by the arrow 1302, determines that the picture 1301 is dragged to the hot zone range of the card 12, and determines that the user's cross-window drag operation is detected, the source window is the floating window 11, and the target window is the card 12. Then, as shown in (c) of FIG13 , the electronic device can start the memo application corresponding to the card 12 and display the last displayed application interface corresponding to the memo application in full screen. Optionally, the electronic device can also reduce the floating window 11 (i.e., the source window) to avoid the floating window 11 blocking the full-screen displayed memo application interface, affecting the user's adjustment of the insertion position of the picture 1301.

[0159] For example, as shown in FIG13 (a), since the floating window 11 (i.e., the source window) may block other windows displayed on the desktop, it affects the user's determination of the target window of the cross-window drag operation. Then, as shown in FIG14 (a), the electronic device detects that the user selects the picture 1301 displayed in the floating window 11 and drags it in the direction indicated by the arrow 1303 and keeps dragging it in the blank area of ​​the desktop for more than a preset time. It can be determined that the display of the current source window affects the user's determination of the target window, and the electronic device can shrink the source window. For example, as shown in FIG14 (b), the electronic device shrinks the floating window 11 so that the user can continue to drag the picture 1301 to determine the target window. Optionally, in the process of dragging the picture 1301 on the desktop, the electronic device can also respond to the user's operation and move the display position of the floating window 11 clockwise according to the quadrant shown in FIG6 to avoid the touch position of the user's finger (or stylus, etc.) to prevent the floating window 11 from blocking the target window to be selected by the user.

[0160] Afterwards, as shown in (a) in FIG15 , the electronic device detects that the user continues to drag the image 1301 to the hot zone range of the card 12, and can determine that the target window is the card 12. Then, as shown in (b) in FIG15 , the electronic device can start the memo application corresponding to the card 12 and display the memo application in full screen. Optionally, the electronic device detects the control position where the user's finger finally stops on the card (such as the position of the memo 3), and can trigger the display of the application interface corresponding to the control (such as the memo 3 interface); or, the electronic device directly displays the homepage or the last displayed interface of the application corresponding to the card 12. Optionally, as shown in (b) in FIG15 , while dragging the image 1301 to move in the memo application interface, the electronic device can also respond to the user operation and move the display position of the floating window 11 clockwise (or counterclockwise) according to the quadrant shown in FIG6 to avoid the touch position of the user's finger.

[0161] Alternatively, as shown in (a) of Figure 16, the electronic device detects that the user continues to drag the image 1301 to the hot zone of icon 13, and can determine that the target window is icon 13. Then, as shown in (b) of Figure 16, the electronic device can start the memo application corresponding to icon 13 and display the memo application in full screen. Optionally, when the electronic device is running the memo application in the background, if the cross-window drag operation of the above-mentioned user is detected, the electronic device can directly display the memo interface running in the background; or, if the electronic device has not started the memo application, in response to the cross-window drag operation of the above-mentioned user, the electronic device starts the memo application and displays the memo application homepage.

[0162] Alternatively, as shown in FIG17(a), the electronic device detects that the user continues to drag the image 1301 to the hot zone of the floating ball 14 and determines that the target window is the floating ball 14. Then, as shown in FIG17(b), the electronic device may launch the memo application corresponding to the floating ball 14 and display the memo application through the floating window 21.

[0163] In some examples, when the electronic device detects that the user continues to drag image 1301 to the edge of the current display interface and continues to drag, it can determine to switch to other interfaces of the desktop, so that the user can move image 1301 to the target window displayed on other interfaces of the desktop.

[0164] In this way, when displaying the desktop, the electronic device can also respond to user operations and adaptively adjust the window size or position to facilitate the user's cross-window operations.

[0165] As another example, the target window that the user needs to drag to move the displayed content may be displayed in the background. Then, as shown in Figure 18 (a), the electronic device detects that the user selects the picture 1301 displayed in the floating window 11 and drags it in the direction indicated by the arrow 1303 and keeps dragging it in the blank area of ​​the desktop for more than a preset time, and the multitasking interface shown in Figure 18 (b) can be displayed. Afterwards, the electronic device detects that the user continues to drag the picture 1301 to the background card 1304 on the multitasking interface, and can determine that the background card 1304 is the target window. Then, as shown in Figure 18 (c), the electronic device can start the memo application corresponding to the background card 1304 and display the memo application interface corresponding to the background card 1304 in full screen.

[0166] In this way, by triggering the display of the multitasking interface, the user can directly determine the target window located in the background, which reduces the difficulty of the user in finding the target window on the desktop.

[0167] For example, FIG19 is a flowchart of a window control method provided by an embodiment of the present application. It should be noted that the method is not limited to FIG19 and the specific sequence described below. It should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0168] S1901: The electronic device displays a first interface, where the first interface includes a first window and a second window.

[0169] In some embodiments, the electronic device supports multi-window display. For example, the electronic device can display multiple application windows simultaneously through floating windows, split screen, etc., to meet the user's needs for operating multiple applications simultaneously.

[0170] For example, in a floating window scenario, as shown in FIG5(a), the electronic device displays a browser application in a floating window while displaying a memo application in full screen. The first window is, for example, a memo application window, and the second window is, for example, a browser application window.

[0171] As another example, in a split-screen scenario, as shown in FIG8( a ), the electronic device displays a memo application and a browser application in split-screen, where the first window is, for example, a browser application window, and the second window is, for example, a memo application window.

[0172] S1902: The electronic device detects a first operation performed by a user to move first content displayed in a first window to a second window.

[0173] The first operation may be an operation of moving the display content in the first window to the second window, or an operation of moving the display content in the first window to a hot zone of the second window. For example, the first operation is a cross-window drag operation.

[0174] The first window is, for example, a source window, and the second window is, for example, a target window.

[0175] Optionally, when the electronic device detects that the user drags the selected content in the source window beyond a preset distance and there is another window in the dragging direction, it determines that the user is performing a cross-window drag operation.

[0176] Optionally, the hot zone range includes at least one of a display area within a preset range around the second window, a display area of ​​the second window, the second window, and a display area within a preset range around the second window.

[0177] For example, the second window is a floating window. The entire floating window is the hot zone range corresponding to the floating window; or the hot zone range of the floating window includes the area where the floating window is located and the range within N pixel widths around the floating window, where N is a positive integer; or the hot zone range of the floating window is the range within N pixel widths around the floating window.

[0178] S1903: In response to the first operation, the electronic device adjusts the size of the first window and / or the second window, wherein the first window after the adjustment is smaller than the first window before the adjustment, and the second window after the adjustment is larger than the second window before the adjustment.

[0179] In some embodiments, in response to the first operation, the electronic device adjusts the size of the first window and / or the second window in a direction opposite to the drag direction of the first operation.

[0180] For example, in a floating window scenario, as shown in FIG5(b), the electronic device detects that the user has selected the image 101 displayed in the source window 11 and dragged it toward the target window 21 in the direction indicated by the arrow 102, and determines that the user has instructed to insert the image 101 into the target window 21 by copying or cutting. Then, as shown in FIG5(c), the electronic device automatically reduces the size of the source window 11 to prevent the source window 11 from obscuring the target window 21, thereby making it easier for the user to determine the location of the image 101 to be inserted in the target window 21.

[0181] As another example, in a split-screen scenario, as shown in FIG8(b), the electronic device detects that the user has selected the picture 801 displayed in the source window 11 (e.g., long-pressed the picture 801) and dragged the picture 801 toward the target window 21 in the direction indicated by the arrow 802. As shown in FIG8(c), the electronic device can automatically reduce the size of the source window 11 in response to the user's cross-window drag operation, and the corresponding target window 21 automatically enlarges as the source window 11 is reduced. In this way, the user can more conveniently determine the position to be inserted into the enlarged target window 21.

[0182] As another example, as shown in FIG9 (a), the electronic device displays a memo application in a floating window while displaying a browser application in full screen. As shown in FIG9 (b), the electronic device detects that the user has dragged an image 901 in the direction indicated by arrow 902 to the target window 21, and determines that the user has indicated that the image 901 should be inserted into the target window 21 for display. Then, as shown in FIG9 (c), in response to the user's operation, the electronic device enlarges the target window 21 to facilitate the user's determination of the insertion position of the image 901 in the target window 21.

[0183] In this way, in response to the user's cross-window drag operation, the electronic device automatically reduces the size of the source window and automatically enlarges the size of the target window, thereby avoiding the source window from blocking the target window and making it easier for the user to determine the insertion position of the mobile content in the target window.

[0184] In other embodiments, in response to the first operation, the electronic device adjusts the display position of the first window and / or the second window in a direction opposite to the dragging direction of the first operation.

[0185] In some examples, the display position of the first window is moved in a clockwise direction to avoid movement of the first content in response to the first operation.

[0186] For example, as shown in FIG6 , taking the four quadrants as an example, the electronic device moves and / or shrinks the source window in the direction opposite to the user's dragging direction. For example, if the electronic device detects that the user has dragged the selected content from the fourth quadrant to the second quadrant, it may move and / or shrink the source window from the second quadrant to the fourth quadrant. Alternatively, the electronic device moves the source window clockwise (or counterclockwise) to avoid the user's dragging of the selected content to the target window. For example, as shown in FIG5 (c), after the electronic device detects that the user has moved the image 101 to the target window 21, it continues to perform the drag operation to adjust the display position of the image 101 in the target window 21. For example, if the electronic device detects that the user has dragged the image 101 from the third quadrant to the fourth quadrant, it may control the source window 11 to move clockwise, such as from the fourth quadrant to the third quadrant, to avoid the display position of the image 101. Optionally, the center position of the four quadrants may be the center position of the electronic device's display screen.

[0187] In other embodiments, when the electronic device detects the user's operation of moving the content of the first window to the second window, it is not necessary to change the size and display position of the first window or the second window.

[0188] For example, if the electronic device determines that the first window does not obstruct the second window, or the size of the second window is greater than a preset threshold, the user can more easily determine the position where the mobile content is to be inserted. In this case, the electronic device does not need to adjust the window size and / or position, thereby reducing the amount of computation required by the electronic device and lowering the device's power consumption.

[0189] In some embodiments, the window type of the first window and the window type of the second window remain unchanged before and after resizing; or, the window type of the first window and / or the window type of the second window change before and after resizing.

[0190] Optionally, the window type includes at least one of a full-screen window, a floating window, a split-screen window, a card window, an icon window, and a floating ball window.

[0191] For example, as shown in (a) of Figure 13, the electronic device displays a floating window 11, a card 12, an icon 13, and a floating ball 14. As shown in (b) of Figure 13, the electronic device detects that the user selects the picture 1301 displayed in the floating window 11 and drags it in the direction indicated by the arrow 1302, and determines that the picture 1301 is dragged to the hot zone range of the card 12. It can be determined that the user's cross-window drag operation is detected, the source window is the floating window 11, and the target window is the card 12. Then, as shown in (c) of Figure 13, the electronic device can start the memo application corresponding to the card 12 and display the last displayed application interface corresponding to the memo application in full screen. That is, the window type of the second window changes before and after resizing.

[0192] In some embodiments, the first interface further includes a third window. Then, in response to the first operation, the size of the third window is adjusted, and the resized third window is smaller than the pre-resized third window.

[0193] For example, as shown in Figure 12(a), the electronic device displays browser application window 11 as a floating window and displays memo application window 21 and media application window 31 in a split-screen manner. As shown in Figure 12(b), the electronic device detects that a user has selected an image 1201 displayed in browser application window 11 and dragged it toward memo application window 21 in the direction indicated by arrow 1202. The electronic device can determine that the user has performed a cross-window drag operation, with the source window being browser application window 11 and the target window being memo application window 21. Then, as shown in Figure 12(c), the electronic device can adaptively adjust the multiple windows being displayed. For example, the electronic device can automatically shrink browser application window 11 to prevent it from obscuring memo application window 21; the electronic device can also automatically shrink media application window 31 and correspondingly enlarge memo application window 21. This enlarged display of memo application window 21, with less obstruction, makes it easier for the user to determine the insertion position of the image 1201 that has been moved across windows.

[0194] In this way, in response to the cross-window drag operation of the electronic device, the electronic device adapts the size and / or position of one or more windows among the multiple windows currently displayed, thereby facilitating the user's operation in the target window.

[0195] In some embodiments, the first application corresponding to the second window is not started or is running in the background. Then, in response to the first operation, the electronic device starts the first application and displays the most recently closed page or the home page of the first application in the resized second window.

[0196] For example, as shown in (a) of FIG16 , the electronic device detects that the user drags the picture 1301 displayed in the source window 11 to the hot zone range of the icon 13, and can determine that the target window is the icon 13. Then, as shown in (b) of FIG16 , the electronic device can start the memo application corresponding to the icon 13 and display the memo application in full screen. Optionally, when the electronic device is running the memo application in the background, if the cross-window drag operation of the above-mentioned user is detected, the electronic device can directly display the memo interface running in the background; or, if the electronic device does not start the memo application, in response to the cross-window drag operation of the above-mentioned user, the electronic device starts the memo application and displays the memo application homepage.

[0197] In this way, when displaying the desktop, the electronic device can also respond to user operations and adaptively adjust the window size or position to facilitate the user's cross-window operations.

[0198] In addition, if the application corresponding to the target window is not started, the electronic device can also respond to the user operation and adaptively start the application corresponding to the target window to meet the user's usage needs.

[0199] The window control method provided by the embodiment of the present application is described in detail above with reference to Figures 5 to 19. The electronic device provided by the embodiment of the present application is described in detail below with reference to Figure 20.

[0200] In one possible design, Figure 20 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. As shown in Figure 20, electronic device 2000 may include: a display unit 2001, a processing unit 2002, and a transceiver unit 2003. Electronic device 2000 may be used to implement the functions of the electronic device involved in the above method embodiments.

[0201] Optionally, the display unit 2001 is used to support the electronic device 2000 in displaying interface content; and / or support the electronic device 2000 in executing S1901 and S1903 in Figure 19.

[0202] Optionally, the processing unit 2002 is used to support the electronic device 2000 to execute S1903 in Figure 19.

[0203] Optionally, the transceiver unit 2003 is used to support the electronic device 2000 to execute S1902 in Figure 19.

[0204] The transceiver unit may include a receiving unit and a transmitting unit, and may be implemented by a transceiver or transceiver-related circuit components, and may be a transceiver or a transceiver module. The operations and / or functions of each unit in electronic device 2000 are respectively for implementing the corresponding processes of the window control method described in the above method embodiment. All relevant content of each step involved in the above method embodiment can be referenced to the functional description of the corresponding functional unit and will not be repeated here for the sake of brevity.

[0205] Optionally, the electronic device 2000 shown in FIG20 may further include a storage unit (not shown in FIG20 ) storing a program or instruction. When the display unit 2001, the processing unit 2002, and the transceiver unit 2003 execute the program or instruction, the electronic device 2000 shown in FIG20 may execute the window control method described in the above method embodiment.

[0206] The technical effects of the electronic device 2000 shown in FIG. 20 may refer to the technical effects of the window control method described in the above method embodiment, and will not be repeated here.

[0207] In addition to being in the form of the electronic device 2000, the technical solution provided in this application may also be a functional unit or chip in the electronic device, or a device used in conjunction with the electronic device.

[0208] An embodiment of the present application also provides a chip system, including: a processor, the processor is coupled to a memory, the memory is used to store programs or instructions, when the program or instructions are executed by the processor, the chip system implements the method in any of the above method embodiments.

[0209] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0210] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.

[0211] Exemplarily, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0212] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0213] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer executes the above-mentioned related steps to implement the window control method in the above-mentioned embodiment.

[0214] An embodiment of the present application further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the window control method in the above-mentioned embodiment.

[0215] In addition, embodiments of the present application further provide a device. Specifically, the device may be a component or module, and may include one or more processors and a memory connected to each other. The memory is used to store a computer program. When the computer program is executed by one or more processors, the device performs the window control method described in each of the above method embodiments.

[0216] The apparatus, computer-readable storage medium, computer program product, or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0217] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disc (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0218] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed; that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-mentioned systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0219] In the several embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of modules or units, which can be electrical, mechanical or other forms.

[0220] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0221] Computer-readable storage media include, but are not limited to, any of the following: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and other media that can store program code.

[0222] The above is only a specific embodiment of the present application, but the scope of protection of this application is not limited to this. Any changes or substitutions within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A window control method, characterized in that: Applied to electronic equipment, the method comprises: Display a first interface, wherein the first interface includes a first window and a second window; detecting a first operation of a user moving first content displayed in the first window to the second window; In response to the first operation, the first window and / or the second window are resized, the first window after resizing is smaller than the first window before resizing, and the second window after resizing is larger than the second window before resizing.

2. The method according to claim 1, characterized in that The first interface further includes a third window, and the method further includes: In response to the first operation, the size of the third window is adjusted, and the third window after the adjustment is smaller than the third window before the adjustment.

3. The method according to claim 1 or 2, characterized in that: Before and after the resizing, the window type of the first window and the window type of the second window remain unchanged; or, Before and after the resizing, the window type of the first window and / or the window type of the second window changes.

4. The method according to claim 3, characterized in that: The window type includes at least one of a full-screen window, a floating window, a split-screen window, a card window, an icon window, and a floating ball window.

5. The method according to any one of claims 1 to 4, characterized in that: The first application corresponding to the second window is not started or is running in the background, and the method further includes: In response to the first operation, the first application is started, and a recently closed page or a home page of the first application is displayed in the resized second window.

6. The method according to any one of claims 1 to 5, characterized in that: The first operation is a cross-window drag operation on the first content, and adjusting the size of the first window and / or the second window in response to the first operation includes: In response to the first operation, the size of the first window and / or the second window is adjusted in a direction opposite to the drag direction of the first operation.

7. The method according to any one of claims 1 to 6, characterized in that: The first operation is a cross-window drag operation on the first content, and the method further includes: In response to the first operation, the display position of the first window and / or the second window is adjusted in a direction opposite to the drag direction of the first operation.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: The display position of the first window is moved in a clockwise direction to avoid movement of the first content in response to the first operation.

9. The method according to any one of claims 1 to 8, characterized in that: The first operation of detecting that the user moves the first content displayed in the first window to the second window includes: The first operation of the user moving the first content displayed in the first window to the hot zone range of the second window is detected, and the hot zone range includes a display area of ​​the second window and at least one of a display area within a preset range around the second window, a display area of ​​the second window, and a display area within a preset range around the second window.

10. An electronic device, characterized in that: include: A processor, a memory and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the electronic device executes the method as described in any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 9.

12. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 9.

Images