A window control method and device

Abstract

The present application relates to a window control method and device thereof, the method comprising: displaying a first application interface of a selected first application in a free window; receiving a first operation of a user; in response to the first operation, performing a cropping operation on the free window; and displaying a second application interface in the cropped free window, wherein the second application interface includes part of the content of the first application interface. By adopting the present application, a terminal device can perform a cropping operation on a free window and display part of the content in the cropped free window, so that the user can easily view the part of the content and improve the user experience.

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a window control method and device thereof. Background Art

[0002] In order to improve the efficiency of information interaction, terminal devices represented by mobile phones can adopt a freeform mode. In freeform mode, the mobile phone can display the application interface of the application selected by the user (for example, a video application) in the freeform window. In the related art, the mobile phone can enlarge and reduce the free window in proportion according to the user's operation. However, the free window is usually small, and the user may not be able to see clearly or need to spend time to find the content of interest in the scaled free window (especially the reduced free window). Taking the video application as an example, when the application interface of the video application is displayed in the free window, the content of the user's interest may be the video being played. The user needs to reduce the size of the free window during use, which results in a smaller display area occupied by the video being played, and a poor user experience. Summary of the invention

[0003] In view of this, a window control method and device are proposed, which at least solve the above-mentioned technical problem that the area occupied by the content concerned by the user is small.

[0004] In a first aspect, an embodiment of the present application provides a window control method, comprising: displaying a first application interface of a selected first application in a free window; receiving a first operation from a user; performing a cropping operation on the free window in response to the first operation; and displaying a second application interface in the cropped free window, wherein the second application interface includes part of the content of the first application interface.

[0005] In summary, when a user uses a free window to display the application interface of an application, the user can crop the free window according to the user's operation and only display part of the content in the cropped free window, which not only meets the user's demand for the display area but also highlights the content the user needs.

[0006] In a possible implementation, the first operation includes a triggering operation by the user on a first control on the first application interface, where the first control is used to instruct the free window to perform focused display.

[0007] By adopting the above method, the window control method of the embodiment of the present application can directly use the control to realize the focused display, thereby reducing the user operation and improving the user experience.

[0008] In a possible implementation, the first operation includes the user using a user part or an input device to slide upward along the free window at a speed exceeding a preset speed and / or leaving the free window after exceeding a preset sliding distance.

[0009] By adopting the above method, the window control method of the embodiment of the present application can utilize the above specific user operations to directly crop the free window to a size that only displays part of the content, thereby reducing user operations and improving user experience.

[0010] In a possible implementation, in response to the first operation, a cropping operation is performed on the free window, including: while keeping the width of the free window unchanged, cropping the length of the free window to the length required to display the partial content in the first application interface.

[0011] By adopting the above method, the window control method of the embodiment of the present application can display the partial content in the largest possible area, while saving the display area of ​​the free window on the screen.

[0012] In a possible implementation, the first operation includes sliding upward from a lower border of the free window along a vertical direction by a first distance.

[0013] By adopting the above method, the window control method of the embodiment of the present application can more flexibly adjust the size of the free window to meet user needs.

[0014] In a possible implementation, in response to the first operation, a cropping operation is performed on the free window, including: cropping the free window to a cropping length corresponding to the first distance while keeping a width of the free window unchanged.

[0015] The window control method of the embodiment of the present application can use the sliding distance to determine the cropping length, and then crop the application interface, so that application interfaces with different layouts can be cropped and the cropped window can be guaranteed to display the content of interest to the user.

[0016] In a possible implementation, after the second application interface is displayed in the cropped free window, the method further includes: receiving a second operation of the user; and performing a zoom operation on the cropped free window in response to the second operation.

[0017] By adopting the above method, the window display method of the embodiment of the present application can also perform scaling operations on the cropped free window, which can meet more user demands for the free window and improve the user experience.

[0018] In a possible implementation manner, the method further includes: determining partial content corresponding to the service provided by the first application.

[0019] By adopting the above method, the window display method of the embodiment of the present application can determine the type of the partial content according to the service provided by the application, so as to more accurately display the content of interest to the user and improve the user experience.

[0020] In a possible implementation manner, the partial content is displayed on the top of the cropped free window.

[0021] In order to ensure and highlight the partial area, the method may display the partial area on the top of the cropped free window.

[0022] In a possible implementation, the first application includes a video application, the first application interface includes a video and other content except the video, and the partial content includes a video played on the first application interface.

[0023] In implementation, if a video application is displayed in the free window, the window control method according to the embodiment of the present application can display the video content in the cropped window, thereby meeting user needs.

[0024] In a second aspect, an embodiment of the present application provides a non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that when the computer program instructions are executed by a processor, the above-mentioned first aspect or one or more of the multiple possible implementation methods of the first aspect are implemented.

[0025] In the third aspect, an embodiment of the present application provides a terminal device, comprising: a processor, a memory and a touch screen, wherein the memory and the touch screen are coupled to the processor, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the terminal device executes the above-mentioned first aspect or one or more of the multiple possible implementation methods of the first aspect.

[0026] In a fourth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute one or more of the methods of the first aspect or multiple possible implementations of the first aspect.

[0027] These and other aspects of the present application will become more apparent from the following description of the embodiment(s). BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the present application and, together with the description, serve to explain the principles of the present application.

[0029] Figure 1 A schematic diagram showing the structure of a terminal device according to an embodiment of the present application is shown;

[0030] Figure 2 A software structure block diagram of a terminal device according to an embodiment of the present application is shown;

[0031] Figure 3 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0032] Figure 4 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0033] Figure 5 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0034] Figure 6 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0035] Figure 7 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0036] Figure 8 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0037] Fig. 9 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0038] Fig.10 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0039] Fig.11 A schematic diagram showing an interface of a terminal device provided by the present application is shown;

[0040] Fig.12 A diagram showing determination of a cutting length according to an embodiment of the present application;

[0041] Fig.13 A diagram showing how to determine a content location according to an embodiment of the present application;

[0042] Fig.14 A flowchart showing a window control method according to an embodiment of the present application is shown;

[0043] Fig.15 A flowchart showing a window control method according to an embodiment of the present application is shown;

[0044] Fig.16 A flowchart showing a window control method according to an embodiment of the present application is shown;

[0045] Fig.17A flowchart of the steps of a window control method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0046] Various embodiments, features and aspects of the present application will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0047] In the embodiments of the present application, " / " can indicate that the objects associated before and after are in an "or" relationship, for example, A / B can indicate A or B; "and / or" can be used to describe that there are three relationships between the associated objects, for example, A and / or B can indicate: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In order to facilitate the description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first" and "second" can be used to distinguish between technical features with the same or similar functions. The words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily limit the difference. In the embodiments of the present application, the words "exemplary" or "for example" are used to indicate examples, illustrations or explanations, and any embodiment or design described as "exemplary" or "for example" should not be interpreted as being more preferred or more advantageous than other embodiments or design. The use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way for easy understanding.

[0048] In addition, in order to better illustrate the present application, specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present application can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present application.

[0049] In order to operate or use multiple applications at the same time, the user starts the free window mode in the mobile phone and selects the application to be displayed in the free window, but the size of the free window is usually smaller than the screen of the mobile phone. The user may not be able to see the application interface in the free window clearly. For example, in the case where the application interface of a video application is displayed in the free window, if the video application is playing a video, the user may not be able to see the video played in the free window clearly. In addition, when the user is watching the video, the text description below the played video may not be interested, but the text part may occupy a large display area. In particular, when the user needs to further reduce the size of the free window, the video displayed in the free window will be smaller for the user.

[0050] The present application provides a window control method, in which a user can crop a free window and display only part of the content in the cropped free window according to the user's operation when the user uses the free window to display the application interface of the application, so as to meet the user's demand for the display area and highlight the content required by the user. The window control method provided by the present application can produce a focused display effect, which means that only the content of interest to the user is displayed or displayed at the maximum proportion, and the area that the user is not interested in is displayed less or not displayed.

[0051] The execution subject of the window control method provided in the present application may be a terminal device having a display device, and the terminal device may be such as Figure 1 The electronic equipment shown, Figure 1 A structural diagram of an electronic device 100 is shown.

[0052] The electronic device 100 may include at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, or a smart city device. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100.

[0053] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0054] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0055] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0056] The processor can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0057] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may store instructions or data that have been used or are frequently used by the processor 110. If the processor 110 needs to use the instruction or data, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0058] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The processor 110 may be connected to a touch sensor, an audio module, a wireless communication module, a display, a camera, and other modules through at least one of the above interfaces.

[0059] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0060] The USB connector 130 is an interface that complies with USB standard specifications and can be used to connect the electronic device 100 and peripheral devices. Specifically, it can be a Mini USB connector, a Micro USB connector, a USB Type C connector, etc. The USB connector 130 can be used to connect a charger to enable the charger to charge the electronic device 100, and can also be used to connect other electronic devices to enable data transmission between the electronic device 100 and other electronic devices. It can also be used to connect headphones to output audio stored in the electronic device through the headphones. The connector can also be used to connect other electronic devices, such as VR devices. In some embodiments, the standard specifications of the universal serial bus can be USB1.x, USB2.0, USB3.x and USB4.

[0061] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0062] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0063] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0064] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0065] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0066] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0067] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), bluetooth low energy (BLE), ultra wide band (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0068] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other electronic devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0069] The electronic device 100 can realize the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0070] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or more display screens 194.

[0071] The electronic device 100 can realize the camera function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.

[0072] The camera module 193 can be used to collect color image data and depth data of the photographed object. The ISP can be used to process the color image data collected by the camera module 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera module 193.

[0073] The structured light 3D sensing module can also be applied to face recognition, somatosensory game consoles, industrial machine vision inspection and other fields. The TOF 3D sensing module can also be applied to game consoles, augmented reality (AR) / virtual reality (VR) and other fields.

[0074] The digital signal processor is used to process digital signals and can also process other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0075] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0076] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0077] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card. Or files such as music and videos are transferred from the electronic device to the external memory card.

[0078] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0079] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0080] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0081] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or output an audio signal for a hands-free call through the speaker 170A.

[0082] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0083] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0084] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0085] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194 .

[0086] There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. Capacitive pressure sensors can be at least two parallel plates with conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity based on the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0087] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, controls the reverse movement of the lens to offset the shaking of the electronic device 100, and achieves anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0088] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0089] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. When the electronic device is a foldable electronic device, the magnetic sensor 180D can be used to detect the folding or unfolding of the electronic device, or the folding angle. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, the automatic unlocking of the flip and other features are set.

[0090] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0091] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0092] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When the intensity of the detected reflected light is greater than a threshold value, it can be determined that there is an object near the electronic device 100. When the intensity of the detected reflected light is less than a threshold value, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0093] The ambient light sensor 180L can be used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is blocked, for example, the electronic device is in a pocket. When it is detected that the electronic device is blocked or in a pocket, some functions (such as the touch function) can be disabled to prevent misoperation.

[0094] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0095] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature detected by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs a reduction in processor performance to reduce the power consumption of the electronic device to implement thermal protection. In other embodiments, when the temperature detected by the temperature sensor 180J is lower than another threshold, the electronic device 100 heats the battery 142. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 can boost the output voltage of the battery 142.

[0096] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0097] In some embodiments, the touch sensor 180K can detect a user's touch operation on the display screen 194 , for example, can detect a user's touch operation on an application icon, a control on a user interface, etc.

[0098] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0099] The key 190 may include a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0100] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0101] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0102] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support one or more SIM card interfaces. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0103] The methods in the following embodiments can all be implemented in the electronic device 100 having the above hardware structure.

[0104] For example, Figure 2 As shown, the embodiment of the present application also provides a software structure block diagram of the electronic device 100. The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0105] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime (ART) and native C / C++ library, hardware abstract layer (HAL) and kernel layer.

[0106] The application layer can include a series of application packages.

[0107] like Figure 2 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0108] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0109] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, an activity manager, an input manager, and the like.

[0110] The window manager provides window management services (WMS). WMS can be used for window management, window animation management, surface management, and as a transfer station for the input system.

[0111] Content providers are used to store and retrieve data and make it accessible to applications. This data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0112] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0113] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0114] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0115] The activity manager can provide activity management services (AMS), which can be used to start, switch, and schedule system components (such as activities, services, content providers, and broadcast receivers) as well as manage and schedule application processes.

[0116] The input manager can provide input management services (IMS), which can be used to manage system input, such as touch screen input, key input, sensor input, etc. IMS takes events from input device nodes and distributes them to appropriate windows through interaction with WMS.

[0117] The Android runtime includes the core library and the Android runtime. The Android runtime is responsible for converting source code into machine code. The Android runtime mainly uses the ahead of time (AOT) compilation technology and the just in time (JIT) compilation technology.

[0118] The core library is mainly used to provide basic Java class library functions, such as basic data structures, mathematics, IO, tools, databases, networks, etc. The core library provides an API for users to develop Android applications.

[0119] The native C / C++ library can include multiple functional modules, such as surface manager, media framework, libc, OpenGL ES, SQLite, Webkit, etc.

[0120] Among them, the surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media framework supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. OpenGL ES provides drawing and operation of 2D graphics and 3D graphics in applications. SQLite provides a lightweight relational database for applications of electronic device 100.

[0121] The hardware abstraction layer runs in user space, encapsulates kernel layer drivers, and provides a calling interface to the upper layer.

[0122] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0123] The following is an example of the workflow of the software and hardware of the electronic device 100 in conjunction with the scenario of starting a video application.

[0124] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, and other information). The raw input event is stored in the kernel layer. The application framework layer obtains the raw input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is a control of a video application icon, the video application calls the interface of the application framework layer to start the video application.

[0125] Figures 3 to 11Some exemplary user interfaces involved in the process of a terminal device executing the window control method provided in this application are shown.

[0126] Figure 3 (a) shows a user interface displayed by a terminal device, which displays icons of multiple applications (referred to as application icons). On this user interface, the terminal device can start and display a multi-window application bar 30 in response to a user operation of starting a free window mode. Figure 3 As shown in (a), the user slides inward from the left edge or right edge of the screen (the right edge in the figure) with a finger. Figure 3 (b) shows that after the terminal device detects the above user operation, it can start and display the multi-window application bar 30 on the user interface, and the user can select an application to be executed in the free window mode from the multi-window application bar 30, such as Figure 3 As shown in (b), the user can select the application icon 31. Figure 3 (c) shows that the terminal device displays the application interface of the application program of the application icon 31 in the free window in response to the user's selection operation.

[0127] Free window mode is a multi-window mode of terminal devices based on the Android system, indicating a window that is not displayed in full screen on the display screen of the terminal device. Free window is a real active window, which not only includes the features of a complete active window, but also can be dragged, dropped, opened and closed according to user operations, and displayed on top of other application windows.

[0128] In implementation, the terminal device may adjust the size and position of the free window in response to a user operation. Figure 3 The free window shown in (c) displays the application interface of the application indicated by the application icon 31. In addition, the free window also includes a title bar. The title bar may include a full screen button 301, a minimize button 302 and a close button 303. The full screen button 301 may indicate that the application interface of the application displayed in the free window is completely displayed on the screen of the terminal device. As an example, the terminal device detects that the user clicks the full screen button 301, and the application interface of the application may be displayed on the display screen. The minimize button 302 indicates that the application displayed in the free window is displayed on the screen in the form of a small icon. As an example, the terminal device detects that the user clicks the minimize button 302, and the application icon 31 may be displayed in a suspended form on the screen. The close button 303 indicates that the application currently displayed in the free window exits the free window mode. As an example, the terminal device detects that the user clicks the close button 303, and the terminal device displays the following on the screen. Figure 3 The user interface in (a).

[0129] Figure 4(a) shows that there is only a single free window 410 in the terminal device. Figure 4 (b) shows that there are multiple free windows 420, 430 and 440 in the terminal device, and these free windows can be superimposed and displayed on the display screen. In a possible implementation, the terminal device can determine the free window to be processed according to the position touched by the user. Taking free window 410 as an example, the free window 410 may include a title bar 401 and an application interface 402, wherein the title bar 401 and the application interface 402 are already Figure 3 The interface of the terminal device described below includes the above two parts, which will not be repeated here.

[0130] Figure 5 (a) shows a user operation on a free window, in which an application interface of a video application can be displayed, and the user operation can indicate an adjustment operation on the free window. Figure 5 In the free window shown in (a), the area for playing the video is displayed at the top of the free window and the area is adjacent to the left and right borders of the free window. However, in practice, the area for playing the video can be displayed anywhere in the free window according to the layout of the application interface of the video application, and the area may not be adjacent to the left and right borders or may only be adjacent to one side of the border. This application does not impose any restrictions on this.

[0131] As an example, the adjustment operation may be an operation of sliding from the lower left corner to the upper right corner of the free window as shown in the figure. Figure 5 (b) shows that the terminal device detects the user operation, and in response to the user operation, the terminal device can adjust the display size of the free window. Figure 5 As can be seen in (b), the terminal device performs a zoom-out operation on the free window and displays the zoomed-out free window. Of course, the adjustment operation can also perform a zoom-in operation on the free window. During the adjustment process, the free window can scale the window size of the free window while keeping the position of the right vertex A of the free window unchanged on the display screen. Figure 5 As can be seen in (a) and (b), as the user scales the size of the free window, the area where the video is played is also scaled proportionally. Obviously, the area where the video is played becomes smaller.

[0132] Figure 6 (a) shows a user operation on the free window, in which the application interface of the video application can be displayed, and the user operation can indicate an adjustment operation on the free window. As an example, the adjustment operation can be an operation of sliding from the lower right corner to the upper left corner of the free window as shown in the figure. Figure 6(b) shows that the terminal device detects the user operation, and in response to the user operation, the terminal device can adjust the display size of the free window. Figure 6 As can be seen in (b), the terminal device performs a zoom-out operation on the free window and displays the zoomed-out free window. Of course, the adjustment operation can also perform a zoom-in operation on the free window. During the adjustment process, the free window can scale the window size of the free window while keeping the position of the left vertex B of the free window unchanged on the display screen. Figure 6 As can be seen in (a) and (b), as the user scales the size of the free window, the area where the video is played is also scaled proportionally. Obviously, the area where the video is played becomes smaller.

[0133] Figure 7 (a) shows that the terminal device detects a user operation on the free window, wherein the user operation can be a sliding operation from the bottom border of the free window and upward in the vertical direction as shown in the figure. The application interface of the video application can be displayed in the free window. The top of the application interface is the area for playing the video, the middle of the application interface is the introduction content of the video, and the bottom of the application interface is the comment content of the video.

[0134] Figure 7 (b) shows that in response to detecting the user operation, the terminal device shortens the length of the free window to the position where the user slides while keeping the width of the free window unchanged. Figure 7 In (b), the user's finger slides from the bottom border of the free window to below the introduction content, and the length of the free window will be shortened to below the introduction content, that is, the sliding distance and the cutting length are the same. Therefore, the terminal device cuts the free window in response to the user operation, and the cutting position of the free window is the position where the user slides (that is, below the introduction content). From the presentation effect, it is similar to scissors cutting the user interface horizontally from below the introduction content.

[0135] As an example, users can also Figure 7 The free window shown in (b) continues to perform the above operation, that is, the user Figure 7 The lower border of the free window in (b) continues to slide upward in the vertical direction until it slides below the video. In addition, in order to better meet the viewing habits (or aesthetics) of the user, the cropped window can be rounded, that is, the terminal device rounds the left and right corners of the cropped window. Figure 7 (c) shows that the terminal device crops the free window in response to the user operation, so that the cropped free window only displays the video.

[0136] Figure 8(a) shows that the terminal device detects a user operation on the free window, wherein the user operation can be a sliding operation from the bottom border of the free window and upward in the vertical direction as shown in the figure. The application interface of the video application can be displayed in the free window. The middle part of the application interface is the area for playing the video, and the top and bottom of the application interface can display content related to the playing video, such as a video introduction or video comments.

[0137] Figure 8 (b) shows that in response to detecting the user operation, the terminal device changes the length of the free window to a length corresponding to the amplitude of the user's sliding while keeping the width of the free window unchanged. That is, in response to the user operation, the terminal device crops the free window and displays the video on the top of the cropped free window. As an example, the user can Figure 8 The free window shown in (b) performs the above operation again, that is, the user's finger is still sliding vertically from the bottom to the top of the free window. Figure 8 (c) shows that the terminal device crops the free window in response to the user operation, so that the cropped free window only displays the video.

[0138] Fig. 9 (a) shows that the terminal device detects that the user triggers the icon 910 displayed on the free window, that is, the terminal device detects the user's operation on the icon 910. Fig. 9 (b) shows that the terminal device detects that the user triggers the button 920 displayed on the free window, that is, the terminal device detects the user's operation on the button 920. Fig. 9 (c) shows that the terminal device can receive user operations input by the user using voice. Fig. 9 (d) shows a specific user gesture of the user for the free window, which may indicate a specific gesture of the user sliding his finger upward quickly and then leaving the display screen, or may indicate a specific gesture of the user sliding his finger upward beyond a preset distance (e.g., beyond a maximum sliding distance). Fig. 9 In (a), (b), (c) and (d) of the figure, or in response to a specific user gesture, the terminal device may Fig. 9 As shown in (e) in the figure, the free window is cropped to only display the video.

[0139] Fig.10 (a) shows that when the free window only displays a video, the terminal device detects a user operation on the free window border, and the user operation may be an adjustment operation of sliding from the lower left corner to the upper right corner of the free window as shown in the figure. Fig.10(b) shows that the terminal device performs a reduction operation on the free window in response to the user operation, and displays a proportionally reduced video in the reduced free window. During the adjustment process, the free window can reduce the window size of the free window while keeping the position of the right vertex C of the free window unchanged on the display screen.

[0140] Fig.11 (a) shows that in the case where the free window only displays a video, the terminal device detects a user operation on the free window border, and the adjustment operation can be an operation of sliding from the lower left corner to the upper right corner of the free window as shown in the figure. Fig.11 (b) shows that the terminal device performs a zoom operation on the free window in response to the user operation, and displays a proportionally enlarged video in the enlarged free window. During the adjustment process, the free window can enlarge the window size of the free window while keeping the position of the right vertex D of the free window unchanged on the display screen.

[0141] It can be seen from the above description that the window control method provided by the present application can reduce the display area of ​​the free window without changing the area size of the video displayed in the free window, for example, Figure 7 (b) and (c) in Figure 8 (b) and (c) in the figure can display only the content that interests the user or display it in the maximum proportion, and display less or no areas that the user is not interested in, thereby producing a focused display effect.

[0142] In order to facilitate understanding of how the window control method of the present application determines the cropping length of the free window, the following will be combined with Fig.12 In short, in order to adapt to application interfaces with different layouts, the terminal device can determine the cropping length according to the sliding amplitude. The following describes an embodiment of the terminal device determining the cropping scale of the free window when the video is displayed in the middle of the free window.

[0143] like Fig.12 As shown in (a) of FIG. 1 , in the user interface 1201, the application interface of the video application can be displayed in the free window 1210 and the area where the video is played is located in the middle of the free window 1210, and the boundary line (also called the outline line) of the area where the video is played may not be adjacent to the frame of the free window 1210, which depends on the layout of the application interface of the video application, and this application does not impose any restrictions on this. Fig.12As shown in (b) of FIG. 12 , in user interface 1202, free window 1220 is a window that only displays video. As shown in (c) of FIG. 12 , in user interface 1203, free window 1230 may include an area for displaying video and an area 1240 for displaying other contents, that is, free window 1230 may at least display video, but not only video.

[0144] In a possible implementation, the terminal device may determine the position S1 of the lower border of the free window 1210, and the position S1 only indicates the position of the free window 1210 in the vertical direction. In implementation, the terminal device may determine the position of the free window 1210 in the terminal device using only the ordinate of S1. In addition, the terminal device may also determine the position of the lower border of the free window 1220, that is, the position S2 in the user interface 1202, which only indicates the position of the free window 1220 in the vertical direction. In implementation, the terminal device may determine the position of the free window 1220 in the terminal device using only the ordinate of S2. In an embodiment of the present application, the cropping length L1 between S1 and S2 refers to the maximum length that can be cropped to the free window 1210. In order to facilitate subsequent calculations, the cropping length L1 between S1 and S2 may be normalized, and the normalized cropping length L1 is 1.

[0145] Then, the terminal device may determine the maximum sliding distance corresponding to the cropping length L1, which is the maximum distance that the user can vertically slide with his finger. In other words, the terminal device may crop the cropping free window 1210 by the length L1 after detecting that the user vertically slides the maximum sliding distance upward. Fig.12 In (c), after the terminal device detects the maximum sliding distance, the free window 1210 is cropped to the free window 1220.

[0146] After determining the cutting length L1 and the maximum sliding distance, the terminal device may determine the ratio of the cutting length L1 to the maximum sliding distance. Fig.12 In (c), after the terminal device detects the user's finger sliding, it can determine the cropping length (cropping length L2 between S1 and S3) according to the sliding distance and the ratio determined above and further determine the position S3 of the bottom border of the free window 1230.

[0147] The following will be combined Fig.13 Describes from the software level how the terminal device determines the location of the highlighted / focused content. Fig.13As shown, in the Android system architecture, an application may include multiple application interfaces. Each application interface corresponds to an activity (one of the basic components of Android), and multiple activities corresponding to multiple application interfaces form an activity stack of an application, that is, a task. Activity uses a window to control the interface display. The window can correspond to multiple view components. Among these view components, decorview is the root layout component used to determine the layout of these view components. Therefore, the terminal device can use the decorview component to determine the layout in the application interface, and then determine the category and position of the displayed content.

[0148] Take the application interface for playing videos as an example. Fig.13 As shown, the terminal device can call the decorview component to obtain the view tree structure of the application interface. Subsequently, the terminal device can use the view tree structure to determine the display information. For example, the terminal device can find the texture view (surfaceview or textureview) component corresponding to the played video from the view tree structure, and then determine the video information in the application interface. For example, whether to play the video is determined by whether the texture view component is found. In addition, the terminal device can also find the area information and position information related to the played video from the view tree structure. In implementation, various operations performed on the application interface are performed by the application process corresponding to the application. Taking the video application as an example, the application process corresponding to the video application calls its corresponding decorview component and other operations performed using various view components.

[0149] In free window mode, the application interface displayed in the free window can correspond to a separate activity. These activities also constitute the free window stack and belong to the same task. The task is executed by the system process in the terminal device. When the terminal device operates the application interface of the application displayed in the free window, the system process corresponding to the free window of the terminal device calls the view component in the application. In other words, the terminal device performs operations across processes.

[0150] In conjunction with the above-mentioned drawings, the following will describe the step flow chart of the window control method provided by the embodiment of the present application. Fig.14 As shown, the method specifically includes:

[0151] Step S101, displaying a first application interface of a selected first application in a free window.

[0152] In a possible implementation, the terminal device may receive a user operation of starting the free window mode while displaying the main screen of the terminal device or the application interface of a certain application. Subsequently, the terminal device receives a selection operation of the user selecting a first application. In response to the selection operation, the terminal device may display the application interface of the selected first application in the free window. Figure 3 As shown in (a), the user can use a specific gesture (slide inward from the right edge of the screen) to start the free window mode. Subsequently, the terminal device can receive the user's selection of an application icon 31 to select an application, and display the application interface corresponding to the application icon 31 in the free window.

[0153] In step S102, a first operation of the user is received, wherein the first operation may instruct the user to slide upward in a vertical direction after touching the lower border of the free window. The vertical direction indicates the vertical line where the touch point of the user touching the lower border of the free window is located.

[0154] In step S103, the terminal device performs a cropping operation on the free window in response to the first operation.

[0155] In a possible implementation, the cropping operation indicates an operation of cropping the size of the free window in the horizontal direction, that is, the cropping operation is an operation of shortening the length of the free window while ensuring that the width of the free window remains unchanged. In implementation, the terminal device may determine the cropping ratio of the free window according to the ratio of sliding upward in the first operation, and crop the free window accordingly.

[0156] In step S104, the terminal device displays the cropped free window on the display screen, and the second user interface is displayed in the cropped free window, and the second user interface is part of the content of the first application interface.

[0157] In a possible implementation, the display area of ​​the content of the second user interface displayed in the cropped free window is the same as the area displayed in the first application interface. That is, when the display mode and display ratio remain unchanged, the cropped free window does not affect the display of this part of the content. Figure 7 As shown in (b), the display area of ​​the video and introduction displayed in the cropped free window remains unchanged, which saves the space occupied by the free window and does not affect the user's viewing of this part of the content for users who only want to watch this part of the content.

[0158] In a possible implementation, the cropped free window can at least display the user's content of interest in the application interface, that is, the partial area mentioned above is the area of ​​interest to the user. The content of interest mentioned in the embodiments of the present application is not the content determined subjectively by the user, but the content pre-set by the technician or the user according to the application. Different applications have different content of interest. Taking the video application as an example, the user's content of interest is the video being played. Therefore, the terminal device can give priority to displaying the video in the cropped free window, such as Figure 8 As shown in (b), the position of the video played in the cropped free window has changed, that is, the video is displayed at the top of the cropped free window. In other words, the terminal device can change the interface layout in the application to highlight the area of ​​interest to the user in the cropped free window.

[0159] It should be noted that the display screen of the terminal device may display multiple free windows, such as Figure 4 As shown in (a) and (b), the present application does not impose any limitation on this, and only the free window touched / triggered by the detected user is used to perform the above operations.

[0160] In summary, an embodiment of the present application provides a window control method, which can crop a free window and display part of the content in the cropped free window after receiving a user operation, thereby highlighting the area of ​​interest to the user and improving the user experience.

[0161] As another embodiment, after receiving the user operation, the terminal device may automatically adjust the free window to display only part of the content, such as Fig.15 As shown, a window control method provided in an embodiment of the present application is described in detail, as follows:

[0162] In step S201, the first application interface of the selected first application is displayed in a free window of the display screen. This step is the same as the above step S101 and will not be described again.

[0163] In step S202, a first operation of the user is received, wherein the first operation includes a triggering operation of the user on a first control on the first application interface or a specific user operation, and the first control is used to instruct the free window to perform focused display.

[0164] In a possible implementation, the trigger operation includes a combination of one or more of a click operation, a slide operation, a press operation, and a long press operation. In addition, the trigger operation can also be implemented in the form of voice. The terminal device receives a voice signal input by the user, parses the voice signal to obtain voice content, and when there is a keyword / word matching the preset information corresponding to the focused display control in the voice content, the terminal device determines that the user's second operation is received, such as Fig. 9 As shown in (a), (b) and (c).

[0165] The focused display mentioned here may also be referred to as "emphasized display", "highlighted display", etc., which means that the free window only displays part of the content of the first application interface. The partial content mentioned here may indicate the user's content of interest or key content inferred by the terminal device. Taking the video application as an example, the terminal device may infer that the partial content is a video, and taking the music playback application as an example, the terminal device may infer that the partial content is music lyrics. In implementation, the terminal device may predetermine the corresponding partial content for the embedded application.

[0166] In one possible implementation, the specific user operation indicates that the user leaves the free window after sliding upward in the vertical direction of the free window at a speed exceeding a preset speed and / or exceeding a preset sliding distance using a body part of the user (e.g., a finger, etc.) or an input device (e.g., a stylus, etc.).

[0167] The preset speed mentioned here may be a speed determined by a technician according to the user's usual sliding speed, which is much faster than the usual sliding speed. Therefore, the specific user operation may be simply understood as quickly sliding in the vertical direction of the free window and then leaving the free window. The preset sliding distance mentioned here may indicate the maximum sliding distance mentioned above. That is, when the user slides in the vertical direction of the free window beyond the maximum sliding distance, he leaves the free window.

[0168] In one possible implementation, the specific user operation also includes an operation in which the sliding speed exceeds a preset speed and the sliding distance exceeds a preset distance, that is, the specific user operation can also indicate the operation of the user leaving the free window after sliding upward in the vertical direction of the free window at a speed exceeding a preset speed and exceeding a preset sliding distance using a part of the user's body or an input device.

[0169] In step S203, in response to the first operation, the terminal device cuts the window size of the free window to a size that only displays the content of interest.

[0170] In a possible implementation, the terminal device determines the content of interest of the first application in response to the first operation. That is, the terminal device may determine different content of interest according to different applications. As shown above, in the case of a video application, the terminal device may determine that the content of interest is a video. Then, the terminal device may adjust the window size of the free window to a size that only displays the content of interest according to the determined display area size of the content of interest. As an example, in response to Fig. 9 The user operations or specific user gestures (which may be considered as the first operation) in (a), (b), (c) and (d) may be performed by the terminal device as follows. Fig. 9 As shown in (e) in the figure, the free window is cropped to only display the video.

[0171] In step S204, the cropped free window is displayed, and the cropped free window only displays the content of interest.

[0172] In summary, an embodiment of the present application provides a window control method, which can adjust the size of a free window after receiving a user operation so that it only displays part of the content, so that the terminal device can highlight this part of the content in the free window, allowing the user to easily view the part of the content and save display area.

[0173] As another embodiment, when the terminal device displays only part of the content (for example, the content of interest) in the cropped free window, the terminal device may also perform a zoom operation on the cropped free window. Fig.16 As shown, a window control method provided in an embodiment of the present application is described in detail, as follows:

[0174] In step S301, a second operation of the user is received, wherein the second operation instructs the user to perform a zooming operation on the cropped free window.

[0175] In a possible implementation, the second operation may include the user touching the lower border of the free window and sliding in a diagonal direction or a vertical direction. In implementation, the diagonal direction may indicate a direction at a preset angle to a horizontal line where the lower border is located, and the preset angle may be set within a preset angle range, for example, 30 degrees to 60 degrees. As an example, the diagonal direction may be as follows: Fig.10 The direction from the lower left corner to the upper right corner of the free window as shown in (a) can also be as follows Fig.11 In (a), the direction is from the lower left corner to the upper right corner.

[0176] In step S302, the terminal device performs scaling processing on the cropped free window in response to the second operation. That is, the terminal device can scale the cropped free window according to the second operation while ensuring that the aspect ratio of the cropped free window remains unchanged, and the content displayed in the window is also scaled proportionally. Fig.10 (b) and Fig.11 As shown in (b), the video displayed in the cropped free window is also scaled proportionally.

[0177] In summary, an embodiment of the present application provides a window control method, which can also perform scaling operations on the free window to meet the user's requirements for viewing size when only part of the content (for example, content of interest to the user) is displayed in the free window, thereby improving the user experience.

[0178] Combining the above embodiments, it can be seen that in order to focus on displaying part of the content in the free window, such as Fig.17 As shown, an embodiment of the present application provides a window control method, which may include the following steps:

[0179] In step S401, the first application interface of the selected first application is displayed in the free window. This step S401 is the same as the above step S101 and step S201, and will not be repeated here.

[0180] In step S402, a first operation of the user is received. In implementation, step S402 can be implemented as step S102 or step S202, that is,

[0181] In a possible implementation, the first operation includes a triggering operation by the user on a first control on the first application interface, where the first control is used to instruct the free window to perform focused display.

[0182] In a possible implementation, the first operation includes an operation in which the user utilizes a user part or an input device to slide upward along the free window and leaves the free window at a speed exceeding a preset speed and / or a preset sliding distance.

[0183] In a possible implementation, the first operation includes sliding upward from a lower border of the free window along a vertical direction by a first distance.

[0184] In step S403, in response to the first operation, a cropping operation is performed on the free window. In implementation, step S402 can be implemented as step S103 or step S203, that is,

[0185] In a possible implementation, while keeping the width of the free window unchanged, the length of the free window is cut to a length required to display the partial content in the first application interface.

[0186] In a possible implementation, the free window is cropped to a cropping length corresponding to the first distance while keeping the width of the free window unchanged.

[0187] In step S404, a second application interface is displayed in the cropped free window, wherein the second application interface includes part of the content of the first application interface. In implementation, step S402 can be implemented as step S104 or step S204, which will not be described in detail here.

[0188] In a possible implementation manner, the method further includes: performing a rounding operation on the cropped free window.

[0189] In a possible implementation manner, the method further includes: receiving a second operation of the user; and performing a zoom operation on the cropped free window in response to the second operation.

[0190] In a possible implementation manner, the method further includes: determining partial content corresponding to the service provided by the first application.

[0191] In a possible implementation manner, the partial content is displayed on the top of the cropped free window.

[0192] In a possible implementation, the first application includes a video application, and the partial content includes a video played on the first application interface.

[0193] In summary, the embodiment of the present application provides a window control method, which performs cropping on the free window and displays only part of the content in the cropped free window, which not only meets the user's demand for the display area but also highlights the content required by the user, thereby producing a focused display effect. The focused display effect refers to displaying only or displaying the content that interests the user in maximum proportion, and displaying less or no areas that the user is not interested in.

[0194] An embodiment of the present application provides a window control device, comprising: a processor and a memory for storing processor executable instructions; wherein the processor is configured to implement the above method when executing the instructions.

[0195] An embodiment of the present application provides a non-volatile computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the above method is implemented.

[0196] An embodiment of the present application provides a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0197] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing.

[0198] The computer-readable program instructions or codes described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0199] The computer program instructions for performing the operation of the present application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, by utilizing the state information of computer-readable program instructions to personalize an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA) or a programmable logic array (PLA), the electronic circuit can execute the computer-readable program instructions to implement various aspects of the present application.

[0200] Various aspects of the present application are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0201] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0202] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0203] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the device, system, method and computer program product according to multiple embodiments of the present application. In this regard, each square frame in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the square frame can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square frames can actually be executed substantially in parallel, and they can also be executed in reverse order sometimes, depending on the functions involved.

[0204] It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart, can be implemented by hardware (such as a circuit or ASIC (Application Specific Integrated Circuit)) that performs the corresponding function or action, or can be implemented by a combination of hardware and software, such as firmware.

[0205] Although the present invention is described herein in conjunction with various embodiments, in the process of implementing the claimed invention, those skilled in the art may understand and implement other variations of the disclosed embodiments by viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "one" or "an" does not exclude multiple situations. A single processor or other unit may implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0206] The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A window control method, characterized in that: The method comprises: Displaying the first application interface of the selected first application in the free window; Receiving a first operation of a user, wherein the first operation includes a triggering operation of a first control on the first application interface by the user, wherein the first control is used to instruct the free window to perform focused display, wherein the triggering operation includes one of a click operation, a slide operation, a press operation, and a long press operation, and the focused display is to display only content of interest to the user or to display the content in a maximum proportion; In response to the first operation, performing a cropping operation on the free window; A second application interface is displayed in the cropped free window, wherein the second application interface includes a portion of the content of the first application interface, and the portion of the content indicates the inferred user-interested content or key content.

2. The method according to claim 1, characterized in that The first operation includes the user using a user part or an input device to slide upward along the free window at a speed exceeding a preset speed and / or leaving the free window after exceeding a preset sliding distance.

3. The method according to claim 1, characterized in that In response to the first operation, performing a cropping operation on the free window includes: While keeping the width of the free window unchanged, the length of the free window is cut to a length required to display the portion of content in the first application interface.

4. The method according to claim 1, characterized in that The first operation includes sliding upwards from a lower border of the free window along a vertical direction for a first distance.

5. The method according to claim 4, characterized in that In response to the first operation, performing a cropping operation on the free window includes: While keeping the width of the free window unchanged, the free window is cropped to a cropping length corresponding to the first distance.

6. The method according to any one of claims 1 to 5, characterized in that After displaying the second application interface in the cropped free window, the method further includes: receiving a second operation from the user; In response to the second operation, a scaling operation is performed on the cropped free window.

7. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Determine partial content corresponding to the service provided by the first application.

8. The method according to any one of claims 1 to 5, characterized in that The partial content is displayed on the top of the cropped free window.

9. The method according to any one of claims 1 to 5, characterized in that The first application includes a video application, the first application interface includes a video and other content except the video, and the partial content includes a video played on the first application interface.

10. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 9 is implemented.

11. A terminal device, characterized in that: include: A processor, a memory and a touch screen, wherein the memory and the touch screen are coupled to the processor, the memory is used to store computer program codes, the computer program codes include computer instructions, and when the processor executes the computer instructions, the terminal device executes the method according to any one of claims 1 to 9.

12. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 9.

Images