Widget display method and electronic equipment
By detecting the application's task status and scene changes, we automatically display and adjust widgets on the desktop of electronic devices, solving the problem of cumbersome operations of manually adding widgets, and improving user experience and desktop utilization.
Patent Information
- Application Number
- CN202412000000.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2021-01-18
- Publication Date
- 2025-05-06
AI Technical Summary
In existing electronic devices, users need to manually add widgets to the desktop, which is cumbersome and has poor user experience.
By detecting that there is a work in progress in the application, the corresponding widget is automatically displayed on the device desktop, and the size and content of the widget is adjusted according to the scene changes.
It realizes automatic addition and location reuse of widgets, keeps the desktop clean, and provides high-priority information needed by users, improving user experience.
Smart Images

Figure CN119937887A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of electronic devices, and more specifically, to a widget display method and electronic device. Background Art
[0002] Taking mobile phones as an example, widgets can enrich the desktop of mobile phones and provide the information required by users, effectively utilizing the space of the touch screen. For example, users can add a music widget to the desktop of their mobile phones. Through the music widget on the desktop, users can control the play, pause, previous song, next song, etc. of music. When users want to know calendar information, they can also add a calendar widget to the desktop. However, users need to manually add widgets to the desktop every time, which is cumbersome and has a poor user experience. Summary of the invention
[0003] The present application provides a widget display method and an electronic device, which are helpful to improve user experience.
[0004] In a first aspect, a method for displaying widgets applied to an electronic device is provided, comprising: displaying a first widget of a first size in a first area of a first page of a desktop; in response to detecting that a first application has an ongoing task, simultaneously displaying the widget of the first application and the first widget after being reduced in size in the first area, the widget of the first application displaying first content, wherein the widget of the first application has a second size, and the second size is smaller than the first size; in response to the electronic device satisfying a preset condition, adjusting the size of the widget of the first application from the second size to the first size, wherein the widget of the first application of the first size displays second content, the second content is more than the first content, and the second content includes the first content.
[0005] When the electronic device 100 detects that there is an ongoing task in the first application, it can automatically display the first application widget on the device desktop, and display the widget in the area where the first application was displayed on the graphical interface, which not only realizes the automatic addition of widgets, but also reuses the position of the first display. The screen space of the electronic device is limited, and reusing the position of the first widget can keep the desktop tidy without adding widgets in a new position, and at the same time can provide the user with the information that the user needs and has a higher priority.
[0006] The electronic device 100 can detect changes in the scene and adjust the size of the widget and / or the content displayed by the widget, and / or the layout of the content displayed by the widget, so as to provide more information to the user, facilitate interaction with the user, and improve the user experience.
[0007] In combination with the first aspect, in some possible implementations of the first aspect, when the first application is a calendar application, the manner of detecting that the first application has an ongoing task is one or a combination of the following manners: by identifying the calendar content in the calendar application, determining that the time difference between the system time of the electronic device and the time in the calendar content is less than a first time threshold; or by identifying the calendar content in the calendar application, determining that the distance difference between the geographic location of the electronic device and the geographic location in the calendar content is less than a first distance threshold.
[0008] In combination with the first aspect, in some possible implementations of the first aspect, the preset condition is a combination of one or more of the following conditions: determining that the time difference between the system time of the electronic device and the time in the schedule content is less than a second time threshold, wherein the second time threshold is less than the first time threshold; or determining that the distance difference between the geographic location of the electronic device and the geographic location in the schedule content is less than a second distance threshold, wherein the second distance threshold is less than the first distance threshold.
[0009] In combination with the first aspect, in some possible implementations of the first aspect, when the widget of the first application and the first widget after being reduced in size are displayed simultaneously, the method further includes: detecting a pinch gesture, a first contact point of the pinch gesture contacts the widget of the first application, and a second contact point of the pinch gesture contacts the first widget; and in response to the pinch gesture, combining the widget of the first application and the first widget into a first composite widget and displaying it in the first area.
[0010] Through composite widgets, users can integrate the functions of different widgets. If any widget meets the trigger condition for displaying on the desktop, the composite widget will be displayed on the desktop. Users do not need to manually trigger the generation of another widget. The electronic device can intelligently push widgets to users based on user operations (pinching and combining widgets), which is more intelligent.
[0011] In combination with the first aspect, in some possible implementations of the first aspect, when the widget of the first application and the first widget after being reduced in size are displayed simultaneously, the method further includes: detecting that there is an ongoing task in the media application, stopping displaying the first widget, and displaying the widget of the first application and the widget of the media application in the first area at the same time.
[0012] By detecting that a media application is playing in the background, a widget generated by the media application is displayed on the desktop, and the user can directly interact with the application widget.
[0013] In combination with the first aspect, in some possible implementations of the first aspect, the method further includes: detecting that the system time of the electronic device exceeds the end time in the schedule content, stopping displaying the widget of the first application having the first size, and displaying the first widget having the first size in the first area.
[0014] The electronic device can stop displaying the schedule widget according to the end time of the schedule and display other widgets on the desktop. It can intelligently change the widgets displayed on the desktop according to user needs, provide users with content that they care more about, and improve user experience.
[0015] In combination with the first aspect, in some possible implementations of the first aspect, detecting that there is an ongoing task in the calendar application is specifically: detecting that there is an ongoing task in the calendar application through a broadcast receivers component in the calendar application.
[0016] In combination with the first aspect, in some possible implementations of the first aspect, the detection of the existence of an ongoing task of the first application is specifically: detecting that the first application logged in to the same user account has an ongoing task on other electronic devices, or detecting that the first application has an ongoing task on the other electronic devices after the electronic device is paired with the other electronic devices.
[0017] By generating application widgets across devices, users can continue tasks in different places. Electronic device 100 can receive ongoing tasks in applications in other electronic devices and display application widgets of the applications on the desktop. Users can interact with the applications between different electronic devices, and the user experience is improved.
[0018] In combination with the first aspect, in some possible implementations of the first aspect, the first page is a desktop homepage; or the first widget is a time and weather widget or a calendar widget; or the notification bar of the screen displays a 4G number identifier and a 5G signal identifier at the same time; or the first area is above the first page; or the first widget is transparent or translucent; or the first application is a calendar app, a memo app, or a reminder app; or the first application is an audio application or a video application; or the ongoing task is playing music, and the first content is a song title, singer, play / pause control, next song play control, and previous song play control, and the second content is a song title, singer, play / pause control, next song play control, and previous song play control. put control, collection control, switch play mode control; or the ongoing task is a travel task, the first content is the departure time, train number, departure station, arrival station, the second content is the departure time, arrival time, train number, departure station, arrival station, seat number; or the ongoing task is an express task, the first content is the pickup point and pickup time, the second content is the pickup point, pickup time, and pickup code; or the ongoing task is a movie task, the first content is the cinema location and movie screening time, the second content is the cinema location, movie screening time, and seat number; or the ongoing task is a meeting task, the first content is the meeting time and meeting location, the second content is the meeting time, meeting location, and meeting list.
[0019] When the electronic device 100 detects that there is an ongoing task (ongoing tasks) in the first application, it can automatically display the first application widget on the device desktop, and display the widget in the area where the time weather widget was displayed on the graphical interface, which not only realizes the automatic addition of widgets, but also reuses the position of the time weather widget. Because there are many places to display and view time on electronic devices, although the device displays the weather time widget on the desktop, most of the time, the user does not use the weather time widget, so the technical solution of this embodiment can reuse the position of the weather time widget to display the widget of the application including the ongoing task. The screen space of the electronic device is limited, and reusing the position of the time weather widget can keep the desktop tidy without adding widgets in new positions, and at the same time can provide users with the information they need and with higher priority.
[0020] In a second aspect, an electronic device is provided, comprising: a display screen, a memory, and one or more processors, wherein the memory comprises instructions, and when the instructions are executed by the one or more processors, the electronic device executes the widget display method in the above-mentioned first aspect and the possible implementation manner of the first aspect.
[0021] In a third aspect, a computer storage medium is provided, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the widget display method in any possible implementation of any of the above aspects.
[0022] In a fourth aspect, a computer program product is provided. When the computer program product is run on an electronic device, the electronic device executes a method for displaying a widget in any possible design of any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0024] Figure 2 It is a software structure block diagram of the electronic device provided in the embodiment of the present application.
[0025] Figure 3A-3M It is a schematic diagram of a set of graphical user interfaces provided in an embodiment of the present application.
[0026] Figure 4A-4G It is a schematic diagram of another set of graphical user interfaces provided in an embodiment of the present application.
[0027] Figures 5A-5EC It is a schematic diagram of another set of graphical user interfaces provided in an embodiment of the present application.
[0028] Figure 6A-6G It is a schematic diagram of another set of graphical user interfaces provided in an embodiment of the present application.
[0029] Figure 7 The figure is a schematic flow chart of a widget display method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0030] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0031] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
[0032] The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.
[0033] Figure 1 A structural diagram of an electronic device 100 is shown.
[0034] The electronic device 100 may include at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, or a smart city device. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device 100. The widget display method provided in the embodiment of the present application can be applied to the above-mentioned electronic device 100.
[0035] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) connector 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module, a button 190, a motor 191, an indicator 192, a camera module 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module may include a pressure sensor (not shown in the figure), a gyroscope sensor 180B, an air pressure sensor (not shown in the figure), a magnetic sensor (not shown in the figure), an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor (not shown in the figure), a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0036] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange the components differently (for example, the electronic device 100 may not include the USB connector 130, but include a lightening interface). The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0037] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0038] The processor can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.
[0039] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory may store instructions or data that have been used or are frequently used by the processor 110. If the processor 110 needs to use the instruction or data, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0040] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. The processor 110 may be connected to a touch sensor, an audio module, a wireless communication module, a display, a camera, and other modules through at least one of the above interfaces.
[0041] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0042] The USB connector 130 is an interface that complies with USB standard specifications and can be used to connect the electronic device 100 and peripheral devices. Specifically, it can be a MiniUSB connector, a MicroUSB connector, a USB Type C connector, etc. The USB connector 130 can be used to connect a charger to enable the charger to charge the electronic device 100, and can also be used to connect other electronic devices to enable data transmission between the electronic device 100 and other electronic devices. It can also be used to connect headphones to output audio stored in the electronic device through the headphones. The connector can also be used to connect other electronic devices, such as VR devices. In some embodiments, the standard specifications of the universal serial bus can be USB1.x, USB2.0, USB3.x and USB4.
[0043] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB connector 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.
[0044] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera module 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0045] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0046] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0047] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0048] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0049] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), bluetooth low energy (BLE), ultra wide band (UWB), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0050] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other electronic devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0051] The electronic device 100 can realize the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
[0052] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or more display screens 194.
[0053] The electronic device 100 can realize the photo taking or video recording function through the camera module 193, ISP, video codec, GPU, display screen 194, application processor AP, neural network processor NPU, etc.
[0054] The camera module 193 can be used to collect color image data and depth data of the photographed object. The ISP can be used to process the color image data collected by the camera module 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera module 193.
[0055] In some embodiments, the camera module 193 may be composed of a color camera module and a 3D sensing module.
[0056] In some embodiments, the photosensitive element of the camera of the color camera module can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format.
[0057] In some embodiments, the 3D sensing module may be a time of flight (TOF) 3D sensing module or a structured light 3D sensing module. Among them, structured light 3D sensing is an active depth sensing technology, and the basic components of the structured light 3D sensing module may include an infrared emitter, an IR camera module, etc. The working principle of the structured light 3D sensing module is to first emit a light spot of a specific pattern to the object being photographed, and then receive the light spot pattern coding (lightcoding) on the surface of the object, and then compare the similarities and differences with the original projected light spot, and use the triangulation principle to calculate the three-dimensional coordinates of the object. The three-dimensional coordinates include the distance between the electronic device 100 and the object being photographed. Among them, TOF3D sensing may be an active depth sensing technology, and the basic components of the TOF3D sensing module may include an infrared emitter, an IR camera module, etc. The working principle of the TOF3D sensing module is to calculate the distance (i.e., depth) between the TOF3D sensing module and the object being photographed by the time when the infrared rays return to obtain a 3D depth map.
[0058] The structured light 3D sensing module can also be applied to face recognition, somatosensory game consoles, industrial machine vision inspection and other fields. The TOF 3D sensing module can also be applied to game consoles, augmented reality (AR) / virtual reality (VR) and other fields.
[0059] In other embodiments, the camera module 193 may also be composed of two or more cameras. The two or more cameras may include a color camera, which can be used to collect color image data of the photographed object. The two or more cameras may use stereo vision technology to collect depth data of the photographed object. Stereo vision technology is based on the principle of human eye parallax. Under natural light, two or more cameras are used to capture images of the same object from different angles, and then triangulation and other operations are performed to obtain the distance information between the electronic device 100 and the photographed object, that is, the depth information.
[0060] In some embodiments, the electronic device 100 may include one or more camera modules 193. Specifically, the electronic device 100 may include one front camera module 193 and one rear camera module 193. The front camera module 193 may generally be used to collect color image data and depth data of the photographer facing the display screen 194, and the rear camera module may be used to collect color image data and depth data of the subject (such as a person, scenery, etc.) facing the photographer.
[0061] In some embodiments, the CPU or GPU or NPU in the processor 110 can process the color image data and depth data collected by the camera module 193. In some embodiments, the NPU can identify the color image data collected by the camera module 193 (specifically the color camera module) through a neural network algorithm based on the skeleton point recognition technology, such as a convolutional neural network algorithm (CNN), to determine the skeleton points of the photographed person. The CPU or GPU can also run a neural network algorithm to determine the skeleton points of the photographed person according to the color image data. In some embodiments, the CPU or GPU or NPU can also be used to confirm the figure of the photographed person (such as body proportions, fatness and thinness of body parts between skeleton points) according to the depth data collected by the camera module 193 (which can be a 3D sensing module) and the identified skeleton points, and can further determine the body beautification parameters for the photographed person, and finally process the photographed image of the photographed person according to the body beautification parameters, so that the body shape of the photographed person in the photographed image is beautified. The subsequent embodiments will describe in detail how to perform body beautification processing on the image of the photographed person based on the color image data and depth data collected by the camera module 193, which will not be elaborated here.
[0062] The digital signal processor is used to process digital signals and can also process other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0063] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0064] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0065] The external memory interface 120 can be used to connect an external memory card, such as a MicroSD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external memory card. Or files such as music and videos are transferred from the electronic device to the external memory card.
[0066] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional methods or data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.
[0067] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0068] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0069] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or output an audio signal for a hands-free call through the speaker 170A.
[0070] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.
[0071] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0072] The earphone interface 170D is used to connect a wired earphone and can be a USB connector 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0073] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0074] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, controls the reverse movement of the lens to offset the shaking of the electronic device 100, and achieves anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.
[0075] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0076] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. When the electronic device is a foldable electronic device, the magnetic sensor 180D can be used to detect the folding or unfolding of the electronic device, or the folding angle. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, the automatic unlocking of the flip and other features are set.
[0077] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0078] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
[0079] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When the intensity of the detected reflected light is greater than a threshold value, it can be determined that there is an object near the electronic device 100. When the intensity of the detected reflected light is less than a threshold value, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0080] The ambient light sensor 180L can be used to sense the brightness of the ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is blocked, for example, the electronic device is in a pocket. When it is detected that the electronic device is blocked or in a pocket, some functions (such as the touch function) can be disabled to prevent misoperation.
[0081] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0082] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature detected by the temperature sensor 180J exceeds a threshold, the electronic device 100 performs a reduction in processor performance to reduce the power consumption of the electronic device to implement thermal protection. In other embodiments, when the temperature detected by the temperature sensor 180J is lower than another threshold, the electronic device 100 heats the battery 142. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 can boost the output voltage of the battery 142.
[0083] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch control screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0084] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
[0085] The key 190 may include a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.
[0086] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0087] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0088] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support one or more SIM card interfaces. The SIM card interface 195 can support NanoSIM cards, MicroSIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0089] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The software system of the electronic device 100 may be an Android system, a Linux system, a Windows system, a Hongmeng system, an iOS system, etc.
[0090] The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.
[0091] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Androidruntime) and the system library, and the kernel layer.
[0092] The application layer can include a series of application packages.
[0093] like Figure 2 As shown, the application package may include music, calendar, SMS, memo, Changlian, browser, video, email, Bluetooth, map and other applications.
[0094] In the embodiment of the present application, for media applications (for example, Figure 2 The electronic device 100 can detect the existence of ongoing tasks in the local media application (such as music application, video application, etc.) and display the media widget on the desktop.
[0095] In some embodiments, the electronic device 100 can also adjust the size of the media widgets displayed on the desktop and / or the content displayed by the media widgets, and / or the layout of the content displayed by the media widgets by detecting changes in the scene (for example, changes in the system time or the geographic location of the local device).
[0096] In the Android operating system, an Android application can be built from at least one of the following components:
[0097] Activity: In some embodiments, it can be called an "activity". Activity is an interface for the system to interact with the user, and can be a user interface on a single screen (visible to the user). For example, an email application can have an Activity that displays a list of new emails, an Activity for composing emails, and an Activity for reading emails, where each Activity exists independently of the other Activities. In addition, other applications can start any of these Activities (if the email application allows it). For example, a camera application can start an Activity in the email application for composing new emails so that users can share pictures. Activities help complete important interactions between the system and applications. Through Activities, the system can track what the user is currently concerned about (for example, what is displayed on the screen) to ensure that the system continues to run the process hosting the Activity.
[0098] Service: In some embodiments, it may be referred to as a "service". A service is an application component that can perform long-running operations in the background without providing an interface. Services can be started by other application components (e.g., an Activity), and will continue to run in the background even if the user switches to another application. For example, when the user is using an email application, a service may play music in the background or obtain data over the network, but this will not block the user's interaction with the email application (e.g., an Activity that composes an email).
[0099] Services can be divided into foreground services and background services. If an application has a service, but it is visible to the user when it is running, then the service is a foreground service. For example, for a music application, since music playback is a service that the user can directly perceive, the music application will send a notification to the user, indicating that it wants to appear in the foreground (to avoid being closed in the background), thereby telling the system this message. In this case, the system understands that it should do its best to keep the service process running, because the disappearance of the process will make the user unhappy.
[0100] Broadcast Receiver: In some embodiments, it can be called a "broadcast receiver". With the help of the broadcast receiver component, the system can pass events to applications, allowing applications to respond to system-wide broadcast notifications. Because the broadcast receiver is another well-defined application entry point, the system can also pass broadcasts to applications that are not currently running. For example, the system can send a broadcast, and after the application receives it, the application can use the notification manager (such as Figure 2 ) to publish notifications to inform users of upcoming events. It should be understood that broadcasts can be initiated by the system. For example, the system can send a broadcast to notify that the screen is turned off, the battery is low, or a photo has been taken. Broadcasts can also be initiated by applications. For example, if a user wants to enter the email writing interface when receiving a text message, a broadcast event can be sent through the SMS application. After receiving the broadcast, the Broadcast Receiver of the email application triggers the generation of an Activity for writing an email. It should be understood that the Broadcast Receiver will not be displayed in the user interface, but it can create a status bar notification to remind the user through the Notification Manager when a broadcast event occurs.
[0101] Content Provider: In some embodiments, it can be called "content provider". ContentProvider supports storing and reading data between multiple applications and can be equivalent to a database. For application A that includes a Content Provider, other applications can query or modify the data in application A through the Content Provider (provided that the Content Provider allows it). For example, the contact application includes a Content Provider that manages contact information, so any application with appropriate permissions can query, read, and write contact-related information.
[0102] It should be understood that starting an Activity or interaction between Activities is achieved through messages. For example, if you want to start an Activity or start another Activity in an Activity, you can trigger it by sending an Intent message.
[0103] It should also be understood that in the Android system, an application is like a container, which can contain multiple Activities, multiple Services or multiple BroadcastReceivers. These Activities, Services, and BroadcastReceivers are relatively independent, and their interactions can be triggered by Intent messages.
[0104] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0105] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, an activity manager, an input manager, and the like.
[0106] The window manager provides window management services (WMS). WMS can be used for window management, window animation management, surface management, and as a transfer station for the input system.
[0107] Content providers are used to store and retrieve data and make it accessible to applications. This data can include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0108] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0109] In the embodiment of the present application, the widget displayed on the desktop of the electronic device 100 may be composed of one or more views, wherein the widget may include a view for displaying text and a view for displaying pictures. For example, a music widget includes a view for displaying lyrics and a view for displaying singer pictures.
[0110] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0111] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0112] The activity manager can provide activity management services (AMS), which can be used to start, switch, and schedule system components (such as activities, services, content providers, and broadcast receivers) as well as manage and schedule application processes.
[0113] The input manager can provide input management services (IMS), which can be used to manage system input, such as touch screen input, key input, sensor input, etc. IMS takes events from input device nodes and distributes them to appropriate windows through interaction with WMS.
[0114] The Android runtime includes the core library and the Android runtime. The Android runtime is responsible for converting source code into machine code. The Android runtime mainly uses the ahead of time (AOT) compilation technology and the just in time (JIT) compilation technology.
[0115] The core library is mainly used to provide basic Java class library functions, such as basic data structures, mathematics, IO, tools, databases, networks, etc. The core library provides an API for users to develop Android applications.
[0116] The native C / C++ library can include multiple functional modules, such as surface manager, media framework, libc, OpenGLES, SQLite, Webkit, etc.
[0117] Among them, the surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media framework supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. OpenGLES provides drawing and operation of 2D graphics and 3D graphics in applications. SQLite provides a lightweight relational database for applications of electronic device 100.
[0118] The hardware abstraction layer runs in user space, encapsulates kernel layer drivers, and provides a calling interface to the upper layer.
[0119] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0120] The following is an illustrative description of the workflow of the software and hardware of the electronic device 100 in conjunction with capturing a photo scene.
[0121] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, timestamp of the touch operation, and other information). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. For example, if the touch operation is a touch single-click operation and the control corresponding to the single-click operation is the control of the camera application icon, the camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer, and captures static images or videos through the camera module 193.
[0122] Before introducing the technical solution of the embodiment of the present application, the nouns involved in the embodiment of the present application are first introduced.
[0123] Taking Android as an example, the concepts of foreground applications and background applications are introduced:
[0124] Foreground app: The application's interface is visible to the current user and can interact with the user.
[0125] Background app: The application currently does not have any interface for user interaction.
[0126] The user opens the music application, and the electronic device 100 presents the interface of the music application. At this time, the music application is a foreground application, but there is no ongoing task for the music application. When the user plays audio, plays video, downloads audio, or downloads video in the interface of the music application, the music application has an ongoing task in the foreground (for example, in the specific implementation of the Android system, the music application calls or creates an activity). If the user stops playing audio, stops playing video, or stops downloading tasks in the music application interface, the electronic device 100 believes that there is no ongoing task for the music application.
[0127] When the user switches from the interface of the music application to other graphical user interfaces of the electronic device 100 and the music application is still playing audio, downloading audio, or downloading video, the electronic device 100 believes that there is an ongoing task of the music application in the background (for example, in the specific implementation of the Android system, the music application calls or creates a background task).
[0128] If the user switches from the interface of the music application to other graphical user interfaces of the electronic device 100, and the music application is still playing audio, downloading audio, or downloading video, but the electronic device 100 displays the notification card of the music application, then the electronic device 100 believes that there is an ongoing task of the music application in the foreground (for example, in the specific implementation of the Android system, the music application calls or creates a foreground task).
[0129] The device detects a predefined gesture operation by the user, and the device switches from the interface of the music application to other graphical user interfaces of the electronic device. The music application does not play audio in the background or there is no download task, so there is no background continuous task in the music application.
[0130] For media applications, "ongoing task" can refer to the "ongoing task of the foreground application" or "ongoing task of the background application" of the electronic device.
[0131] It should be understood that the "ongoing task of the foreground application" mentioned here refers to the foreground application has a vsisible activity. For example, the user opens the music application and plays audio, plays video, downloads audio, and downloads video in the music application interface, and the screen of the electronic device currently displays the interface of the music application, then the music application has a foreground ongoing task. It should be understood that the "background ongoing task" mentioned here refers to the task that is currently in the background and is continuously performed (for example, it can be a Service component of a media application, where the Service component runs continuously in the background). For example, the user switches from the interface of the music application to other graphical user interfaces of the electronic device 100, and the music application plays audio, or downloads audio, or downloads video in the background, then there is a background task in the music application. If the user stops playing audio, or stops playing video, or stops downloading tasks in the music application interface, the device detects the user's predefined gesture operation, and the device switches from the interface of the music application to other graphical user interfaces of the electronic device, and the music application does not play audio in the background or there is no download task, then there is no background task in the music application that is continuously performed.
[0132] In some embodiments, the “ongoing task” may be a task that the user has not completed. For example, when a user is processing a slideshow task in the electronic device 100 and leaves the process without closing the application program related to the slideshow, the slideshow task that the user has not completed is considered an “ongoing task”.
[0133] In some embodiments, an "ongoing task" may also be a schedule, wherein the schedule contains time information and / or geographic location information. For example, a user adds a schedule "Go shopping, time is September 1, 2020, location is Beijing Shopping Center" in the calendar application, then the schedule added by the user may be an "ongoing task". In other embodiments, when the electronic device 100 detects that there is a travel task in a schedule application (such as a calendar, memo, reminder, email, text message, etc.) in the local device, and the electronic device 100 detects that the local device's geographic location is close to the departure station, or the local device's system time is close to the departure time, then the electronic device 100 determines the travel task as an "ongoing task".
[0134] Widget: The widget described in the embodiment of the present application can be a miniature application view that is embedded in other applications (such as a home screen, a text messaging application, or an email application) and receives regular updates. For example, the widget can be an application widget displayed on the desktop. In some embodiments, the widget can also be a card displayed on the negative screen. In some embodiments, the widget can be a notification card on the lock screen interface.
[0135] Taking the application widgets on the desktop as an example, users can customize the home screen through application widgets. In addition, users can click on application widgets to enter the application associated with them, and users can move widgets or adjust the size of widgets.
[0136] Application widgets may include information widgets, control widgets, and hybrid widgets.
[0137] The information widget can periodically update the displayed message to provide different content to the user, for example, the weather widget can update weather information as time changes. For example, the schedule widget in the embodiment of the present application can provide messages to the user, and as the scene (for example, the system time or geographic location of the electronic device) changes, the schedule widget can display more messages.
[0138] The control widget may provide controls for user operation to control the application associated with the widget. For example, the music widget described in the embodiment of the present application may include a play / pause control, and the user may click the control to play / pause music.
[0139] The hybrid widget may have the functions of both an information widget and a control widget. For example, the music widget described in the embodiment of the present application may include controls and dynamically displayed lyrics.
[0140] It should be understood that the widget described in the embodiments of the present application may also be referred to as a small component, a small tool or a card, and the present application does not limit its specific name.
[0141] Figure 3A-3M A set of exemplary graphical user interfaces (GUIs) are shown in which a set of electronic devices 100 detects the presence of ongoing tasks in a media application (such as a music application, a video application, etc.) in the local device and displays a media widget on the desktop.
[0142] Figure 3A 3000 is an exemplary graphical user interface displayed on the display screen 194 of the electronic device 100. In some embodiments, the graphical user interface 3000 may be referred to as a lock screen interface. The graphical user interface 3000 may include a combination of one or more of the following elements:
[0143] Application widget 304-0: In some embodiments, application widget 304-0 may be located above the screen. It should be understood that the "above" refers to the area above 1 / 2 of the height of the screen. In some embodiments, the content displayed by application widget 304-0 may include one or a combination of time information, weather information, or location information. In some embodiments, widget 304-0 may include at least one location and its corresponding time information and weather information. For example, widget 340 may include time information of Beijing, weather information of Beijing, time information of London, and weather information of London at the same time. In some embodiments, application widget 304-0 may include two application widgets (for example, a music widget and a time weather widget displayed at the same time). It should be understood that the embodiment of the present application does not specifically limit the size (including width and height) of application widget 304-0. In some embodiments, the size of application widget 304-0 may be a small size. It should be understood that the "small size" described in the embodiment of the present application may refer to the width of the widget not reaching the maximum width of the widget that can be displayed on the desktop of the electronic device 100. In some embodiments, the first application widget 304-0 may be a time weather widget or a calendar widget. It should be understood that in some embodiments, the time weather widget may also be referred to as a weather application widget.
[0144] Icon 315: Fingerprint recognition icon. In some embodiments, icon 315 can be switched between transparent display and opaque display.
[0145] Icon 316: camera icon. Users can quickly enter the camera application interface through this camera icon.
[0146] System status bar 302: The system status bar 302 may include a battery level indicator, a time indicator (e.g., 8:00 shown in the figure), and a signal strength indicator of the user's wireless communication (e.g., 4G and 5G). It should be understood that in some embodiments, the content displayed in the status bar 302 is not limited thereto. For example, the status bar 302 may also display a Bluetooth indicator, an alarm clock indicator, etc. It should be understood that this embodiment does not limit the arrangement position of the content displayed in the status bar 302. For example, in some embodiments, the time indicator may be located in the middle.
[0147] It should be understood that the embodiment of the present application does not specifically limit the display position and number of elements included in the user interface 3000.
[0148] It should be understood that in some embodiments, graphical user interface 3000 may include more elements.
[0149] In some embodiments, a lock screen wallpaper (not shown) may also be included in GUI 3000. In some embodiments, the lock screen wallpaper displayed in GUI 3000 may be different each time the screen is turned on (eg, the Home key is activated, etc.).
[0150] Figure 3B Shown is an exemplary graphical user interface 3001-2 displayed on the display screen 194 of the electronic device 100. It should be understood that the exemplary graphical user interface 3001-2 can be called a desktop, and the embodiment of the present application does not specifically limit its name. In some embodiments, the graphical user interface 3001-2 can be a desktop home screen, and the electronic device can quickly switch to the desktop home screen when it detects a predefined gesture on other pages on the desktop (for example, sliding up from the bottom of the screen). It should be understood that the embodiment of the present application uses the name "desktop home screen" for schematic illustration, and does not represent a specific limitation on the name of the exemplary graphical user interface 3001-2. In some embodiments, the exemplary graphical user interface 3001-2 may include one or a combination of the following elements:
[0151] Status bars 302: Description of status bars 302 Figure 3A The description of the status bar in is not repeated here.
[0152] Dock bar (favourites tray) 308: The dock bar 308 may include application icons such as camera, address book, phone, and information. In some embodiments, the user may manually change the application icons displayed in the dock bar 308.
[0153] Desktop page mark 310: The desktop page mark 310 is used to display the number of pages contained in the desktop and locate the position of the current page. For example, Figure 3B In the GUI 3001-2 shown, the desktop page mark 310 shows that the electronic device 100 includes at least two desktop pages. In some embodiments, the negative one screen may also be referred to as a desktop page. After detecting a page switching instruction, the electronic device may switch between different desktop pages (for example, Figure 3C As shown, the electronic device 100 detects the input of the left-slide predefined gesture 3091, and the electronic device 100 switches the display from the desktop home page to the desktop page GUI3001-1). In some embodiments, the user can adjust the display order of the desktop home page and other desktop pages (for example, adjust the display order of GUI3001-2 and GUI3001-1).
[0154] Application icons 306: Application icons 306 may include at least one application icon. Application icons 306 may include at least one or a combination of "HUAWEI Video", "Health", "Weather", "Music", "AI Life", "Settings", "Recorder", "Vmall", "Camera", "Contacts", "Phone" and "Message" applications. In some embodiments, the application icons displayed by application icons 306 may be different, for example, the number of application icons may increase or decrease, and the categories of icons may also be different.
[0155] Application widget 304-1: The description of the application widget 304-1 can be referred to Figure 3A The description of the application widget 304-0 in the embodiment is not repeated here. It should be noted that the application widget 304-1 can also be any widget manually added by the user on the desktop of the electronic device 100. For example, in some embodiments, the first application widget 304-1 can be a time weather widget or a calendar widget.
[0156] It should be understood that in some embodiments, the status bar 302, widget 304-1, application icons 306, dock tray 308, and desktop page marker 310 may have different terms or names. In some embodiments, the application icons 306 may be referred to as application shortcuts, etc. The terms in this embodiment are merely exemplary.
[0157] It should also be understood that the display positions of the elements in the graphical user interface 3001-2 are schematic, and other arrangements may be used in other embodiments. It should also be understood that there may be more types of elements in the graphical user interface 3001-2.
[0158] For the widget 304-1, according to the survey, the widget at this location has always existed since the machine was turned on from the factory, and the user will not delete the widget. However, the widget occupies a large area of the screen, wasting screen space. Therefore, the technical solution provided by this application can utilize the area of the widget to intelligently display other widgets, provide users with more useful information, and improve the utilization rate of the desktop.
[0159] In some embodiments, the electronic device 100 displays an application widget 304-1 on the desktop. It should be understood that the application widget 304-1 can be a time weather widget, a calendar widget, or other application widgets. The electronic device 100 can detect the presence of ongoing tasks in the media applications (such as music applications, video applications, etc.) in the local computer and display the media widget on the desktop. In some embodiments, the media widget can be displayed in the same area on the desktop where the application widget 304-1 is displayed. In some embodiments, the same area can be an area on the desktop homepage.
[0160] The following takes a music application as an example to schematically illustrate the process of generating a media widget.
[0161] The application widget 304-1 displayed on the desktop is a time weather widget 304-1 (eg Figure 3B It should be understood that in some embodiments, the application widget 304-1 can also be Figure 4A-4E The widget described in the embodiment, or Figures 5A-5EC The schedule widget described in the embodiment, or Figure 6A-6G The instant messaging application widget described in the embodiment.
[0162] It should be understood that the music application described in the embodiment of the present application can also be replaced by other media applications (such as Huawei Video, Tencent Video, YOUTUBE, Sportify, iTunes, Himalaya FM, NetEase Cloud Music, QQ Music, etc.). It should be understood that the media application includes an application whose main function is to play videos and / or whose main function is to play audio. The embodiment of the present application does not limit the specific name of the media application.
[0163] When the electronic device 100 detects the instruction to activate the music application, the electronic device 100 responds and the music application is activated. For example, the electronic device 100 detects that the user's finger (not drawn to scale in the figure) is on the Figure 3D After the gesture of clicking the music application icon button 3064 on the GUI3001-2 displayed on the desktop, the electronic device 100 responds and the music application interface 3002 is displayed on the display screen of the electronic device 100. In some embodiments, in some embodiments, the location of the music application icon 303 can be in a folder in the desktop page (not shown in the figure). In some embodiments, the user can also activate the music application by stylus click, voice control or suspension control. In GUI3002, the music application interface may include the song title "TV" 312-2, the singer's picture 312-1, the singer "Tom Lee" 312-3, part of the lyrics 312-4 or the control 312-5, etc. In some embodiments, the content displayed in the music application interface 3002 is not limited to this, and may also include the lyricist, album name or arranger, etc.
[0164] After the electronic device 100 detects that the music playing control is activated (for example, Figure 3E As shown, the user clicks the play music control), and the interface of playing music is displayed.
[0165] When there is a song being played in the music application, after the electronic device 100 detects a predefined gesture input (for example, a swipe up gesture at the bottom of the screen), the electronic device 100 can switch to the desktop by displaying the music application interface GUI3002. It should be understood that the function of the "swipe up gesture at the bottom of the screen" operation is to switch the electronic device 100 to the desktop of the local device. It should be noted that the gesture operation for returning the electronic device to the local desktop is not limited to swiping up from the bottom of the screen, but may also be the user clicking the home button (not shown in the figure) or the user clicking the return button (not shown in the figure), which is not specifically limited in the embodiments of the present application.
[0166] Optionally, after the electronic device 100 switches from displaying the music application interface GUI 3002 to the desktop, the desktop may simultaneously display the music widget 314 - 2 and the widget 304 - 2 (the reduced-size application widget 304 - 1 ).
[0167] Exemplarily, the desktop may display a graphical user interface 3003-2, such as Figure 3FA As shown. Graphical user interface 3003-2 may include music widget 314-2 and time weather widget 304-2. Electronic device 100 displays the area of time weather widget 304-1 on the desktop, and displays music widget 314-2 and time weather widget 304-2. Optionally, music widget 314-2 and time weather widget 304-2 have the same size. In some embodiments, the size of music widget 314-2 and time weather widget 304-2 may be different. In some embodiments, time weather widget 304-2 may display less content than time weather widget 304-1. In some embodiments, the content displayed by music widget 314-2 may include widget name "Music", song title "TV", singer "Tom Lee" and operation controls. In some embodiments, the content displayed by music widget 314-2 may also include lyrics, album name, etc. It should be understood that the position layout of the content displayed by music widget 314-2 is schematic.
[0168] When the electronic device 100 detects that there are ongoing tasks in the media application, it can automatically display the area of the widget 304-1 on the desktop of the electronic device 100 to display the widget of the application, which not only realizes the function of automatically adding widgets, but also reuses the position of the widget 304-1. The screen space of the electronic device is limited. By reusing the positions of other widgets, the desktop can be kept tidy without adding widgets in new positions, and more information can be provided to the user.
[0169] It should be understood that the order of widgets in the graphical user interface 3003-2 is schematic. In some embodiments, the music widget 314-2 is displayed on the left side of the time weather widget 304-2 as a widget with a higher priority. In some embodiments, the electronic device can arrange the widgets with a higher priority on the right side. In some embodiments, the arrangement of the music widget 314-2 and the time weather widget 304-2 can be arranged in an upper and lower manner (not shown in the figure).
[0170] Optionally, the electronic device 100 detects that there is an ongoing task in the music application, and the electronic device 100 displays the area of the application widget 304-1 on the desktop and only displays the music widget 314-2, such as Figure 3FBAs shown, the music widget 314-2 may have a smaller size than the time and weather widget 304-1. In some embodiments, the electronic device 100 may display other widgets (e.g., common service widgets) while displaying the music widget 314-2 on the desktop, wherein the common service widgets may include a scan control, a ride code control, or a payment code control, and the user may quickly enter the application interface by clicking the scan control, the ride code control, or the payment code control, for example Figure 3FD It should be understood that the location layout of the content displayed by the music widget 314-2 is schematic.
[0171] Optionally, the electronic device 100 detects that there is an ongoing task in the music application, and the electronic device 100 displays the same area of the time weather widget 304-1 on the graphical user interface 3003, replacing the displayed music widget 314-1, wherein the music widget 314-1 has the same size as the time weather widget 304-1. Figure 3FC The content displayed by the music widget 314-1 may include the widget name "Music", the song title "TV", the singer "TomLee" and the operation controls. In some embodiments, the content displayed by the music widget 314-1 may also include lyrics, album name and other content. In some embodiments, compared to Figure 3FA or Figure 3FB In the music widget 314-2, the content displayed by the music widget 314-1 may be more or the same. It should be understood that the position layout of the content displayed by the music widget 314-2 is schematic.
[0172] When the electronic device 100 detects that there are ongoing tasks in the media application, it can automatically display the media widget on the device desktop, and display the widget in the area where the time weather widget was displayed on the graphical interface, which not only realizes the automatic addition of widgets, but also reuses the position of the time weather widget. Because there are many places to display and view time on electronic devices, although the device displays the weather time widget on the desktop, most of the time, the user does not use the weather time widget, so the technical solution of this embodiment can reuse the position of the weather time widget to display the widget of the application including the ongoing task. The screen space of the electronic device is limited, and reusing the position of the time weather widget can keep the desktop tidy without adding widgets in new positions, and at the same time can provide users with the information they need and with higher priority.
[0173] In some embodiments, the electronic device 100 may detect a predefined gesture input and change the order of widgets displayed on the desktop. It should be understood that the widgets may include all the widgets described in the embodiments of the present application, for example, the widgets may include Figure 4A-4FThe cross-device widget described in the embodiment, Figures 5A-5EC The schedule widget described in the embodiment, Figure 6A-6G The instant messaging application widget described in the embodiment. For example, Figure 3G As shown, after the electronic device 100 detects the gesture operation of the user's finger pressing the music widget and dragging it to the right, the display order of the time weather widget and the music widget is adjusted. In some embodiments, the order is related to the priority. Changing the arrangement order of the widgets changes the priority of the widgets.
[0174] In some embodiments, the electronic device 100 may detect a predefined gesture input and adjust the size of the widget displayed on the desktop and / or the content displayed by the widget. It should be understood that the widget may include all the widgets described in the embodiments of the present application, for example, the widget may include Figure 4A-4F The cross-device widget described in the embodiment, Figures 5A-5EC The schedule widget described in the embodiment, Figure 6A-6G Instant messaging application widget described in the embodiment. In some embodiments, the electronic device 100 can detect input of a predefined gesture and can also adjust the layout of the content displayed by the widget.
[0175] Indicatively, Figure 3HA As shown, the electronic device 100 detects that the user's finger long presses the edge of the music widget 314-2, and the music widget 314-2 enters an editable state. After the electronic device 100 detects the gesture operation of the user pressing the right edge of the widget and dragging it to the right, the electronic device 100 switches to display the graphical user interface 3003-1. Compared with the music widget 314-2 in the graphical user interface 3003-2, the graphical user interface 3003-1 does not display the widget 3003-2, but only displays the music widget, and the size of the displayed music widget 314-1 is enlarged. In some embodiments, the width of the music widget 314-1 displayed by the graphical user interface 3003-1 is the maximum width of the widget that the electronic device 100 can display on the desktop. In some embodiments, the enlarged widget can display more content. For example, compared with the music widget 314-2, the content displayed by the enlarged music widget 314-1 can also include part of the lyrics. In some embodiments, the layout of the displayed content (including but not limited to the widget name, song title, singer, and operation controls) of the music widget 314-1 may be different from that of the music widget 314-2. It should be understood that the electronic device 100 may also reduce the size of the widget after detecting a predefined gesture input (e.g., a gesture operation of pressing and dragging the right edge of the widget). Figure 3HAIn the embodiment, the electronic device 100 may also detect a predefined gesture input (eg, a gesture operation of pressing the right edge of the widget 314-1 and dragging it to the left) and reduce the size of the widget 314-1. For example, the style of the reduced-size widget 314-1 may be the widget 314-2.
[0176] After detecting the user's predefined gesture, the electronic device 100 adjusts the size of the widget displayed on the desktop, which can efficiently utilize the limited space of the screen, allowing the user to view and interact with different widgets, thereby improving interaction efficiency.
[0177] In some embodiments, the electronic device 100 may also adjust the size of the media widget displayed on the desktop and / or the content displayed by the media widget, and / or the layout of the content displayed by the media widget by detecting a change in the scene.
[0178] In some embodiments, a media widget may have a time tag and / or a geographic location tag, wherein the time tag and / or geographic location tag may be manually added by the user, or may be generated by the electronic device 100 based on the user's usage habits of the media application. For example, if the user often listens to music before going to bed at 22:00, the electronic device 100 will count the time and frequency of the user's use of the music application, thereby adding a time tag to the music application, wherein the time tag is 22:00. For example, if the user often listens to music at home, the electronic device will count the geographic location and frequency of the user's use of the music application, thereby adding a geographic location tag to the music application, wherein the geographic location tag is home.
[0179] When the electronic device 100 detects that the difference between the electronic device's system time and the time tag "22:00" is less than the preset time threshold value, and / or when the electronic device 100 detects that the difference between the device's geographical location and the geographical location tag "home" is less than the preset distance threshold value, the electronic device 100 adjusts the size of the music widget on the desktop and / or the content displayed by the music widget. In some embodiments, the electronic device 100 can enlarge the size of the music widget. In some embodiments, the content displayed by the enlarged music widget can be increased. For example, Figure 3HB As shown, the electronic device 100 displays the music widget 314-2 on the desktop, and the electronic device 100 detects the change of time and / or geographical location, and switches to display GUI 3003-1. Compared with the widget 314-2 displayed by GUI3003-2, the music widget 314-1 displayed by GUI3003-1 may display lyrics "I love watching TV" and operation controls (such as random play or favorite buttons).
[0180] In some embodiments, the electronic device 100 can also detect the brightness of the ambient light through the ambient light sensor to determine whether the scene has changed, thereby automatically adjusting the size of the media widget and / or the content displayed by the media widget, and / or the layout of the content displayed by the media widget. Schematically, when a user enters a dimly lit environment from a brightly lit place, if it is still a small-sized widget, the user may not be able to see the text presented by the widget clearly. Therefore, in order to meet user needs, the widget can automatically adjust its size to the size display, and the displayed font will be larger. Optionally, the displayed control can also be enlarged. The electronic device 100 can adjust the size of the media widget and / or the content displayed by the media widget, and / or the layout of the content displayed by the media widget by detecting changes in the scene, which can provide users with more information, facilitate interaction with users, and enhance user experience.
[0181] In some embodiments, the electronic device 100 detects a change in the scene (for example, the electronic device 100 detects that the user determines that the scene has changed by detecting that the time difference between the system time of the local device and the scene time is greater than a preset time threshold value, and / or the distance difference between the local device's geographical location and the scene's geographical location is greater than a preset distance threshold value), and can adjust the size of the media widget and / or the content displayed by the media widget, and / or the layout of the content displayed by the media widget. After detecting that the user's scene has changed again, the media widget can be restored to the display mode before the adjustment state, wherein the adjustment state includes adjusting the size of the media widget and / or the content displayed by the media widget, and / or the layout of the content displayed by the media widget.
[0182] In some embodiments, a music widget 314-1 is displayed on the desktop of the electronic device 100, wherein the width of the music widget 314-1 is approximately equal to the width of the screen, and the lyrics of the song being played are displayed on the music widget 314-1. When the electronic device 100 switches to display other pages on the desktop, or enters other application interfaces, the electronic device 100 displays the music widget 314-1 as a floating widget state, and the widget is in a transparent state, only displaying the lyrics, such as Figure 3J Optionally, after the electronic device 100 detects a predefined gesture (such as a single click) on the widget, the widget is displayed in a semi-transparent state, and the widget displays an operation control.
[0183] In some embodiments, after the electronic device 100 detects a predefined gesture input by the user (eg, activating a pause control on a widget, sliding a widget, activating a delete control on a widget), the media widget is stopped from being displayed on the desktop of the electronic device 100, and the application widget 304-1 is displayed instead.
[0184] For example, Figure 3KAs shown, a music widget 314-1 is displayed on the desktop of the electronic device 100. After the electronic device 100 detects that the user clicks the pause button on the music widget, the electronic device 100 switches the display to GUI3002-1, the electronic device 100 stops displaying the music widget, and the widget displayed on the desktop of the electronic device 100 is the time and weather widget 304-1.
[0185] By detecting a user's predefined operation on a media widget (for example, clicking a pause control, clicking a delete control, or a sliding gesture), the electronic device 100 stops displaying the media widget on the desktop and displays other widgets in a limited screen space to facilitate user interaction with other widgets.
[0186] In some embodiments, at least two application widgets are displayed on the desktop of the electronic device 100, for example, Figure 3L As shown, GUI5001 includes a first application widget and a second application widget. It should be understood that in some embodiments, the first application widget may also be one of the following widgets: a time and weather widget, a slideshow widget, an instant messaging application widget, and a calendar widget, wherein the slideshow widget may be based on Figure 4A-4F The information widget can be obtained according to the technical solution recorded in the embodiment. Figure 6A-6G The embodiment records the technical solution, and the schedule widget can be based on Figures 5A-5EC The description of the second application widget may refer to the content of the first application widget, which will not be repeated here.
[0187] Optionally, the electronic device 100 can detect that there are ongoing tasks in the media application (such as music application, video application, etc.) in the electronic device 100 and display the media widget and the first application widget on the desktop. For example, the electronic device can display the widget with a high priority on the left, the newly generated media widget has the highest priority, the media widget is arranged on the far left, and the second application widget is no longer displayed because it has the lowest priority. Figure 3L shown.
[0188] Indicatively, Figure 3M The electronic device 100 displays a schedule widget and a time and weather widget on its desktop. The electronic device 100 detects that there is an ongoing task in the music application, and displays the music widget and schedule widget on the desktop, with the music widget placed to the left of the schedule widget.
[0189] Optionally, the electronic device 100 may detect that there are ongoing tasks in a media application (eg, a music application, a video application, etc.) in the electronic device 100 and display a media widget and a second application widget on the desktop.
[0190] The above embodiment describes a technical solution for displaying widgets on the desktop. In some embodiments, the electronic device 100 can also use the technical solution described in the above embodiment on the lock screen interface to display widgets on the lock screen interface. It should be understood that the widgets include all the widgets described in the embodiments of the present application, for example, the widgets may include Figure 4A-4F The cross-device widget described in the embodiment, Figures 5A-5EC The schedule widget described in the embodiment, Figure 6A-6G The instant messaging application widget described in the embodiment.
[0191] Illustratively, the electronic device 100 displays GUI 3003-1, and after detecting a lock screen command input by the user, the electronic device 100 switches to displaying the lock screen interface GUI 3004, wherein the lock screen interface GUI 3004 displays the music widget 314-1 in the same area where the time weather widget 314-0 is displayed. In some embodiments, when the widget displayed on the lock screen interface 3004 does not contain time information, the electronic device 100 can display the time information in the status bar 302.
[0192] The widgets displayed on the lock screen interface allow users to interact with the widgets without unlocking the screen, which can improve the user experience.
[0193] In some embodiments, the electronic device 100 can detect the presence of ongoing tasks in the local media applications (such as music applications, video applications, etc.) and display media widgets on the lock screen page, wherein the display method of the media widgets on the lock screen page, the method of interacting with the user (for example, after the user clicks the pause control, the music widget stops being displayed and the time and weather widget is switched to be displayed) and the beneficial effects can refer to the display method of the media widgets on the desktop, which will not be repeated here.
[0194] Figure 4A-4F Shown is a set of exemplary graphical user interfaces for generating application widgets across devices.
[0195] When a user “leaves” an ongoing task in an application on another electronic device, the electronic device 100 displays an application widget related to the application.
[0196] It should be understood that the applications in the other electronic devices may include office applications, wherein the office applications may include word processing applications (for example, Microsoft Office Word, Microsoft Office Powerpoint, Microsoft Office Excel, PDF reader), image processing applications, online conferencing applications, browser applications, email applications, etc.
[0197] In some embodiments, the electronic device 100 displays an application widget 304 - 1 on the desktop.
[0198] It should be understood that the application widget 304-1 may also be Figure 3A-3M The media widget described in the embodiment, or Figures 5A-5EC The schedule widget described in the embodiment, or Figure 6A-6G The instant messaging application widget described in the embodiment.
[0199] The electronic device 100 can receive the "ongoing task" in the application in other electronic devices, and display the application widget of the application on the desktop. In some embodiments, the application widget of the application can be displayed in the same area on the desktop where the application widget 304-1 was displayed. In some embodiments, the same area can be on the desktop homepage.
[0200] The following is a schematic description using the electronic device 102 as the other electronic device, and an ongoing task in the slideshow application of the electronic device 102 .
[0201] It should be understood that in some embodiments, the electronic device 102 can be a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and other electronic devices.
[0202] In some embodiments, the electronic device 102 detects that there is an ongoing task in the slideshow application, and detects that the user "leaves" the electronic device 102, and can upload the "ongoing task" to the cloud server 180, such as Figure 4BA The electronic device 102 can upload the ongoing task to the cloud server 180 via a cellular network or a wireless local area network (WLAN).
[0203] The electronic device 102 may detect and determine that the user has "left" the device 102 by a sensor of the electronic device 102 detecting that the user has moved away from the electronic device 102, or by detecting that the user has not operated the electronic device 102 for a period greater than a preset time value. In some embodiments, the electronic device 102 may detect and determine that the user has left the device 102 by minimizing the window of the application displayed on the electronic device 102. Figure 4A, the user clicks the minimize button 402 in the GUI 4001 and returns to the desktop of the electronic device 102, and the electronic device 102 also determines that the user has "left" the electronic device 102. In some embodiments, the electronic device 102 can also determine that the user has "left" the electronic device 102 when the electronic device 100 is locked. This embodiment does not limit the specific determination method.
[0204] In some embodiments, the electronic device 102 may also upload the task to the cloud server by detecting a predefined input operation of the user on the electronic device 102. Figure 4BB , the electronic device 102 displays a slide that the user is editing, and there is an ongoing task in the slide application called "research report". After the electronic device 102 detects that the user clicks the PowerPoint icon in the slide application interface, the electronic device 102 displays a window, wherein the window may include options such as "push to electronic device 100", "push to electronic device 103", "push to electronic device 104", and "close window". It should be understood that in some embodiments, a control or icon of "push to electronic device" may be displayed in the GUI4001, and the electronic device 102 detects that the control or icon is activated, and may display options such as "push to electronic device 100", "push to electronic device 103", and "push to electronic device 104". The electronic device 102 detects that the user clicks the option "push to electronic device 100", and the electronic device 102 may upload the slide task "research report" to the cloud server via a cellular network or a wireless local area network (WLAN). For example, the latest task processed in the slide application is "research report", and the electronic device 102 may transmit the task "research report" to the cloud server 180.
[0205] When the electronic device 100 detects that the account logged in by the user locally is the same as the account logged in on the electronic device 102, the cloud server 180 pushes the ongoing task to the electronic device 100, and the application widget associated with the application is displayed on the desktop of the electronic device 100, as shown in 4BA.
[0206] In some embodiments, the electronic device 102 displays an application interface of the application (e.g., an email application interface, a browser application interface), and after the electronic device 100 and the electronic device 102 are paired, the electronic device 102 pushes the ongoing task to the electronic device 100 (e.g., pairing is completed via Bluetooth, and data is transmitted via WiFi direct connection), and the application widget is displayed on the desktop of the electronic device 100, such as Figure 4BA shown.
[0207] In some embodiments, the cloud server 180 or the electronic device 102 pushes the task to the electronic device 100. The task file may be too large and the current network connection of the electronic device 100 is weak. Before the electronic device 100 receives the ongoing task, it may ask the user whether he agrees to receive it. When a predefined operation input by the user is detected (for example, clicking the control "Yes"), the electronic device 100 receives the ongoing task and displays the application widget associated with the ongoing task on the desktop.
[0208] The electronic device 100 displays an application widget 304-1 on the desktop. The electronic device 100 receives the ongoing task from the server or the electronic device 102, and displays the application widget of the application on the desktop. The method for displaying the widget may refer to Figure 3FA-Figure 3FC The content will not be repeated here.
[0209] The electronic device 100 can receive ongoing tasks in applications in other electronic devices and display application widgets of the applications on the desktop. Users can interact with the applications between different electronic devices, thereby improving user experience.
[0210] exist Figures 4A-4BB The widget 304-1 in the embodiment is a time weather widget. It should be understood that the widget 304-1 may also be any widget described in this embodiment, for example, it may be as follows Figure 3A-3M The widget described in the embodiment.
[0211] For example, Figure 4C As shown, the application widget 304-1 displayed on the desktop of the electronic device 100 is a music widget. When the electronic device 100 receives the ongoing task from the server or the electronic device 102, the electronic device 100 simultaneously displays the PPT application widget and the reduced-size music widget on the desktop.
[0212] In some embodiments, the electronic device detects that there is a task in the office application, and the task of the office application is not completed. When the user returns to the desktop, the electronic device can display the application widget of the application on the desktop. The display method can refer to the method of displaying the widget. Figure 3FA-Figure 3FC For example, when a user edits a document on a PPT (Powerpoint) application on the electronic device 100, and the user clicks the Home button to return to the desktop, the electronic device 100 displays the PPT application widget on the desktop.
[0213] The electronic device 100 can receive ongoing tasks in applications in other electronic devices, and display the application widget of the application on the desktop, and display the widget in the area on the desktop where the time and weather widget is displayed, thereby realizing automatic addition of widgets and reusing the location of the time and weather widget. The screen space of the electronic device is limited, and reusing the location of the time and weather widget can keep the desktop homepage tidy without adding widgets in new locations, while providing the user with the information the user needs.
[0214] In some embodiments, at least two application widgets are displayed on the desktop of the electronic device 100, for example, a first application widget and a second application widget. It should be understood that in some embodiments, the first application widget may also be one of the following widgets: a time and weather widget, a music widget, an instant messaging application widget, and a calendar widget, wherein the music widget may be based on Figure 3A-3M The information widget can be obtained according to the technical solution recorded in the embodiment. Figure 6A-6G The embodiment records the technical solution, and the schedule widget can be based on Figures 5A-5EC The description of the second application widget may refer to the content of the first application widget, which will not be repeated here.
[0215] The electronic device 100 may receive an ongoing task in an application program in another electronic device, and display an application widget of the application on the desktop. Optionally, the electronic device 100 may display the application widget of the application in a manner as described in the embodiment of the present invention. Figure 3L-3M Contents of the embodiment.
[0216] Indicatively, Figure 4D As shown, a music widget (which may be referred to as a first application widget) and a time and weather widget (which may be referred to as a second application widget) are displayed on the desktop of the electronic device 100. The electronic device 100 receives an ongoing task in a slideshow application in another electronic device. The electronic device 100 displays a slideshow widget and a music widget (which may be referred to as a first application widget) on the desktop, and the slideshow widget is arranged on the left of the music widget.
[0217] In some embodiments, the electronic device 100 can detect a predefined gesture input (eg, left-right sliding or up-down sliding) and display different widgets. Figure 4EAs shown, the electronic device 100 displays a slide widget 404-2 and a music widget 314-2. The electronic device 100 detects that the user's finger slides to the left on the widget (e.g., the slide widget 404-2), and switches to display as GUI4005, wherein GUI4005 displays a portion of the slide widget 404-2, the music widget 314-2, and a portion of the time weather widget 304-2. The electronic device 100 detects that the user's finger continues to slide to the left on the widget (e.g., the music widget 314-2), and switches to display as GUI3003-2, and the electronic device 100 displays the music widget 314-2 and the time weather widget 304-2 on the desktop. It should be understood that the time weather widget 304-2 may be newly pushed by the system, or it may be running in the background without being displayed.
[0218] In some embodiments, Figure 4F As shown, the electronic device 100 displays a slide application widget. After the electronic device 100 detects a predefined gesture input (e.g., a finger clicking on the slide widget), the electronic device 100 switches to display the application interface GUI 4003 of the application associated with the application widget. In some embodiments, after the electronic device 100 detects that the predefined gesture input (e.g., a finger clicking on the slide widget) has a different action area, the electronic device 100 switches to display the application interface GUI 4003 differently.
[0219] In some embodiments, the electronic device 100 may detect a predefined gesture input and change the order of widgets displayed on the desktop. The content of changing the order of widgets displayed on the desktop may refer to Figure 3G The above content will not be repeated here.
[0220] In some embodiments, the electronic device 100 receives an ongoing task in an office application in another electronic device, and the electronic device 100 displays the office application widget on the desktop. The electronic device 100 can also adjust the size of the office application widget and / or the content displayed by the office application widget, and / or the layout of the content displayed by the office application widget by detecting a change in the scene, such as Figure 4G shown.
[0221] For example, the office application widget may have a scene time and / or a scene geographic location, wherein the scene time and / or the scene geographic location may be manually added by the user, or may be generated by the electronic device 100 according to the user's usage habits of the office application. For example, if the user often processes unfinished office tasks at home at 20:00, or if the user often turns on the electronic device to process unfinished office tasks during the subway commuting time after getting off work at 17:00, then the electronic device may determine after statistics that the scene time of the slideshow widget is 20:00 and / or 17:00, and the scene geographic location of the application widget is home or a specific subway station.
[0222] When the electronic device 100 detects that the difference between the system time of the electronic device and the scene time is less than a preset time threshold value, and / or when the electronic device 100 detects that the difference between the geographical location of the device and the geographical location of the scene is less than a preset distance threshold value, the electronic device 100 adjusts the size of the office application widget on the desktop and / or the content of the office application widget, and / or the layout of the content displayed by the office application widget.
[0223] In some embodiments, the electronic device 100 may also detect the brightness of the ambient light through an ambient light sensor to determine whether the scene has changed, thereby automatically adjusting the size of the application widget and / or the content displayed by the application widget, and / or the layout of the content displayed by the application widget.
[0224] The electronic device 100 detects the scene change, thereby adjusting the size of the office application widget and / or the content displayed by the office application widget, and / or the layout of the content displayed by the office application widget, and its beneficial effects can be cited as follows: Figure 3A-3M The relevant content of the embodiment.
[0225] Figures 5A-5EC What is shown is a set of exemplary graphical user interfaces of the electronic device 100 that generates widgets by identifying the content of the schedule and detecting the existence of ongoing tasks in the schedule of the local device according to the system time and / or the geographic location of the local device.
[0226] In some embodiments, the electronic device 100 displays a Figure 3A The application widget 304 - 1 is shown.
[0227] It should be understood that the application widget 304-1 may also be Figure 3A-3M The media widget described in the embodiment, or Figure 4A-4F The application widget described in the embodiment, or Figure 6A-6G The instant messaging application widget described in the embodiment.
[0228] The electronic device 100 can identify the schedule content and detect the ongoing tasks in the schedule of the local device according to the system time and / or the geographic location of the local device, and then generate a schedule widget for display on the desktop. In some embodiments, the schedule widget can be displayed in the same area of the desktop page where the application widget 304-1 is displayed. In some embodiments, the desktop page can be a desktop homepage.
[0229] It should be understood that the above-mentioned schedule content can be added manually by the user, or the electronic device 100 can automatically recognize the schedule content in schedule applications (such as SMS applications, emails, memos, reminders, etc.) and add it to the user's schedule (for example, a schedule in a calendar application).
[0230] For example, the electronic device 100 can automatically recognize that there is content related to the ticket itinerary in the SMS application (including but not limited to the departure station, arrival station, departure time, arrival time, passenger information, ticket gate, etc.). It should be understood that the electronic device 100 can identify which SMS messages are related to the itinerary through the SMS template and add the content of the ticket itinerary to the schedule.
[0231] For example, the electronic device 100 may detect the presence of express content (including but not limited to express company information, geographic location of the express pickup cabinet, pickup code, pickup time, etc.) in the SMS application, and the electronic device 100 may add the express content to the schedule.
[0232] Figure 5A What is shown is an exemplary graphical user interface 5000 of the text messaging application of the electronic device 100. The text message content includes ticket travel information, and the text message content includes departure date, train number, seat number, departure station, and departure time. It should be understood that the text message content may include more information, such as arrival station, arrival time, passenger name, etc. In some embodiments, the text message content may also be movie information (e.g., movie showtimes, geographic location of cinemas, etc.), shopping mall information (e.g., location of malls, time when users want to go shopping, etc.).
[0233] The electronic device 100 can identify the schedule content and determine that the difference between the system time of the local device and the time in the schedule content is less than a time threshold, and / or the geographical location of the local device is less than a distance threshold from the geographical location in the schedule content, and then determine that there is an ongoing task in the schedule content.
[0234] Exemplarily, the electronic device 100 can detect the current geographic location information of the electronic device 100 through one or more positioning methods such as GPS positioning, Wi-Fi positioning, base station positioning, etc., and then calculate the geographic location information of the departure point of the trip in the schedule content with the current geographic location information of the user. If the electronic device 100 detects that the distance between the user's current geographic location and the geographic location of the departure station in the trip schedule content is less than (or less than or equal to) the distance threshold preset value D1, the electronic device 100 determines that the ticket trip in the schedule application is an ongoing task, and then displays the schedule widget on the desktop homepage. In some embodiments, the electronic device 100 can also detect that the system time of the local machine is less than the time threshold preset value T1 from the departure time of the ticket trip in the schedule content, and the electronic device 100 determines that the ticket trip in the schedule application is an ongoing task, and then displays the schedule widget related to the schedule application on the desktop homepage.
[0235] Exemplarily, the electronic device 100 identifies the ticket itinerary in the schedule content. The electronic device 100 detects that the difference between the system time of the local device and the departure time in the schedule content is less than or equal to the time threshold, and the electronic device 100 displays the schedule widget corresponding to the schedule content on the desktop.
[0236] like Figure 5BA When the electronic device 100 detects that there is ticket itinerary information in the schedule content of the local device, the electronic device 100 identifies the ticket itinerary information in the schedule (e.g., passengers, departure station, arrival station, departure time, arrival time, etc.), and determines that the difference between the local system time 08:00 and the train departure time 08:26 is less than the time threshold, and / or the current geographical location of the local device is less than the distance threshold from the geographical location of the train departure station Beijing Station in the schedule content, then the ticket itinerary in the schedule content is determined to be an ongoing task, and the electronic device 100 displays the schedule widget 502-2 and the time and weather widget 304-2 on the desktop homepage.
[0237] The electronic device 100 displays an application widget 304-1 on the desktop. The electronic device 100 identifies the content of the schedule and detects whether there is an ongoing task in the schedule of the local device according to the system time and / or the geographical location of the electronic device 100, and then generates a schedule widget for display on the desktop. Figure 3FA to Figure 3FC The relevant description will not be repeated here.
[0238] In some embodiments, the electronic device 100 can display multiple schedule widgets at the same time (for example, multiple ticket itinerary information exists in the schedule application at the same time. In some embodiments, multiple schedule widgets can be displayed in a stacked manner.
[0239] In some embodiments, the electronic device 100 switches from displaying the widget 304-1 on the desktop to simultaneously displaying the schedule widget 502-2 and the common service widget 503-2, wherein the common service widget 503-2 may include controls such as a ride code, scan code, and payment code, such as Figure 5BB It should be understood that the commonly used service widgets are only exemplary names and do not represent a limitation on their names. Because users need to take the bus or take the subway on the way to the station, different widgets are intelligently pushed to users in order to meet their needs in different scenarios.
[0240] In some embodiments, the electronic device 100 can also display a music widget while displaying a schedule widget on the desktop, such as Figure 5BC As shown, the music widget can be automatically pushed by the electronic device 100 after counting the frequency of the user listening to music at the station, or it can be automatically pushed by the electronic device after the user associates the music widget with the schedule widget. It should be understood that the music widget is in a paused state at this time, which is different from Figure 3A-3M The music widget described in the embodiment.
[0241] Since the user has a need to listen to music on the way to the train station, the music widget is displayed while the schedule widget is displayed. When the user wants to listen to music, he can click on the control on the music widget to play the music.
[0242] The electronic device 100 displays other widgets on the desktop while displaying the schedule widget, and can intelligently provide different information to the user according to the associated scenarios, thereby improving the user experience.
[0243] In some embodiments, the electronic device 100 may detect an input predefined gesture operation (eg, pinching, where two pinching points are in contact with different widgets respectively), and the electronic device 100 responds by merging two widgets into a composite widget.
[0244] For example, in Figure 5C In the GUI 5001 shown, the electronic device 100 displays a schedule widget 502-2 and a music widget 314-2. The electronic device detects the user's predefined gesture, and the electronic device 100 responds by displaying Figure 5C In the GUI 5003 shown, the electronic device displays a composite widget 502-3. It should be understood that the content displayed by the composite widget 502-3 may include the content displayed by the schedule widget 502-2 and the music widget 314. It should also be understood that the content about the schedule widget displayed by the composite widget may be more or less than that of the schedule widget 502-2. It should also be understood that the content about the music widget displayed by the composite widget 502-3 may be more or less than that of the music widget 314-2.
[0245] In some embodiments, when the electronic device 100 detects an input predefined instruction (eg, a pinch gesture), the electronic device 100 may combine three or more widgets into a composite widget. The embodiment of the present application does not specifically limit the number of widgets used for combination.
[0246] When the electronic device 100 detects that an application associated with any widget in the composite widget has an ongoing task, the electronic device may display the composite widget on the desktop homepage.
[0247] For example, the user pinches the music widget and the schedule widget into a composite widget. The electronic device detects that there is an ongoing task in the music application, and the electronic device 100 displays the composite widget on the desktop homepage; or the electronic device 100 detects that there is an ongoing task in the schedule, and displays the composite widget on the desktop homepage.
[0248] After the user combines two widgets into a composite widget, the composite widget automatically appears the next time the user enters the same scene, and the user does not need to manually switch the two separate widgets to the display screen 194 for display, thereby improving the user experience (for example, the user's schedule contains ticket travel information, and the user wants to listen to music at the station, so the user combines the music widget and the schedule widget into a composite widget at the station. The next time the user enters the station scene, the electronic device 100 automatically displays the composite widget, and the widget content includes the schedule widget content and the music widget content).
[0249] In some embodiments, the electronic device 100 may detect a predefined input gesture and adjust the size of the widget and / or the content displayed by the widget. Figure 3HA The content will not be repeated here.
[0250] In some embodiments, a schedule widget is displayed on the desktop of the electronic device 100. The electronic device 100 can detect changes in the scene and adjust the schedule widget. For example, the electronic device 100 can adjust the size of the schedule widget and / or adjust the content displayed by the schedule widget.
[0251] For example, the electronic device 100 detects that the distance between the current geographical location of the local device and the geographical location of the departure station in the schedule content is less than (or less than or equal to) a distance threshold preset value D2, where D2 is less than D1, and / or detects that the system time of the device is less than a time threshold preset value T2 from the departure time in the schedule content, where T2 is less than T1, the electronic device 100 adjusts the size of the schedule widget, and / or adjusts the content displayed by the schedule widget.
[0252] For example, Figure 5DAs shown, the user is 200 meters away from the train station, and a schedule widget 502-2 (eg, Figure 5BA The electronic device 100 detects that the difference between the time of the electronic device and the departure time is less than a preset value (for example, the preset value can be set to 11 minutes or a value less than or equal to 11 minutes), and / or the electronic device detects that the distance difference between the geographical location information of the electronic device and the geographical location of the departure station is less than a preset value (for example, the preset value can be set to 200 meters or a value less than or equal to 200 meters), and the electronic device switches to display GUI5001 on the desktop, such as Figure 5EA As shown. The schedule widget 502-2 shown in GUI5001 displays the schedule theme "ticket", train number "High-speed Rail G80", departure station "Beijing Station", and arrival station "Shanghai Station". The electronic device 100 switches to GUI5002, where the widget displayed by GUI5002 is the schedule widget 502-1. Compared with widget 502-2, the size of schedule widget 502-1 is larger, and the displayed content of schedule widget 502-1 may be increased compared to widget 502-2. In some embodiments, the added information may include passenger name, seat number information, ticket gate information, etc. In some embodiments, the added displayed content may also include a map thumbnail of the current location of the electronic device 100, wherein the map thumbnail may display nearby services of the current location of the electronic device 100, and the nearby services may include information such as food, parking, storage, and hotels, such as Figure 5EB shown.
[0253] Exemplarily, a schedule widget is displayed on the desktop of the electronic device 100, wherein the schedule widget includes express information, and the express information includes the name of the express company, where the express is placed (or the location of the express pickup cabinet), and the express pickup time. Because the user is more concerned about less message content before arriving at the express pickup location, the schedule widget does not display much express content. When the user is about to arrive at the express pickup location, the user needs to know the pickup code and needs to obtain more messages. When the user's electronic device 100 detects that the distance difference between the geographical location of the machine and the location of the express pickup cabinet is less than the distance threshold, the electronic device 100 will enlarge the schedule widget and display more content, wherein the newly added content may include the express pickup code, etc.
[0254] In some embodiments, a composite widget is displayed on the desktop of the electronic device 100, wherein the composite widget is obtained by combining calendar widgets, for example Figure 5ECThe electronic device 100 detects that the distance between the current geographical location of the device and the geographical location of the trip departure station is less than (or less than or equal to) the preset distance threshold value D2, wherein D2 is less than D1, and / or detects that the system time of the device is less than the preset time threshold value T2 from the ticket trip departure time, wherein T2 is less than T1, and the desktop of the electronic device 100 switches to display the schedule widget with adjusted size and / or adjusted content.
[0255] In some embodiments, the electronic device 100 detects that the system time of the user's local computer has passed a specific time point in the schedule content, and the electronic device 100 stops displaying the schedule widget.
[0256] For example, the departure time in the ticket travel task in the schedule is 8:26. When the electronic device 100 detects that the system time of the local device exceeds or equals the departure time, the electronic device 100 stops displaying the schedule widget. In some embodiments, the specific time point in the schedule content also includes the movie screening time, the meeting end time, etc.
[0257] In some embodiments, at least two application widgets are displayed on the desktop of the electronic device 100. The electronic device can identify the content of the schedule and detect whether there are ongoing tasks in the schedule of the local device according to the system time and / or the geographical location of the local device, and then generate a schedule widget for display on the desktop. The display method of the schedule widget on the desktop can refer to Figure 3L-3M The display method of the media widgets will not be described here.
[0258] In some embodiments, the electronic device can identify the content of the schedule and detect whether there are ongoing tasks in the schedule of the local device according to the system time and / or the geographic location of the local device, thereby generating a schedule widget for display on the lock screen page. The display method and beneficial effects of displaying the schedule widget on the lock screen page can refer to the display method of the schedule widget on the desktop, which will not be repeated here.
[0259] In some embodiments, when the user's electronic device 100 is connected to the vehicle-mounted device (for example, via Bluetooth), the vehicle-mounted device may display the information displayed on the electronic device 100. Figures 5A-5EC The schedule widgets (including schedule widgets for express delivery content and schedule widgets for ticket travel tasks).
[0260] Figures 6A-6G Shown is a set of exemplary graphical user interfaces in which the electronic device 100 can display an instant messaging application widget on the desktop after detecting a user's predefined gesture on the instant messaging application interface.
[0261] In some embodiments, the electronic device 100 displays an application widget 304-1 on the desktop page, wherein the application widget 304-1 can refer to Figures 5A-5EC The relevant content will not be repeated here.
[0262] It should be noted that the application widget 304-1 can also be Figure 3A-3M The media widget described in the embodiment, or Figures 5A-5EC The schedule widget described in the embodiment, or Figure 4A-4F The application widget described in the embodiment.
[0263] The electronic device 100 may display the instant messaging application widget on the desktop page after detecting a predefined input operation of the user on the instant messaging application interface. The instant messaging application interface may include a chat window page (including a chat window with a single contact, a group chat). In some embodiments, the instant messaging application widget may be displayed in the same area on the desktop where the application widget 304-1 was displayed. In some embodiments, the desktop may be a desktop homepage.
[0264] The following is a schematic description using information application as an example.
[0265] It should be understood that the information application described in the embodiments of the present application can also be replaced by other instant messaging applications (such as WeChat, QQ, Changlian, WhatsApp, Messenger, Line, iMessage, etc.).
[0266] like Fig. 6A As shown, the electronic device 100 displays Figure 3B GUI3001-2 shown, the time weather widget 304-1 is displayed on the desktop. In some embodiments, after the electronic device 100 detects the user information application icon, the electronic device 100 displays the following Fig. 6A The application interface GUI 6001 of the information application is shown. It should be understood that the content displayed by GUI 6001 may include a status bar 302, a message display window 602, a message reply window 604, etc. It should also be understood that the message display window 602 may include but is not limited to text, pictures, videos, emoticons (Emoji), etc.
[0267] Optionally, after the electronic device 100 detects a predefined gesture input into the application interface 6001 (for example, the user slides inwards at a corner of the user interface 6001), the electronic device 100 responds by displaying an information application widget on the desktop homepage.
[0268] Optionally, after the electronic device 100 detects a predefined gesture operation of the user at a corner of the screen (for example, sliding from the upper right corner to the lower left corner), the electronic device 100 responds by displaying a control “Generate Widget” at the upper right corner of the information display window 602, such as Figure 6B When the electronic device 100 detects that the "Generate Widget" control is activated in the application interface (for example, the user clicks the control with a finger), the electronic device 100 responds by displaying the information application widget on the desktop homepage of the electronic device 100. Figure 6CA As shown, after the electronic device 100 detects the predefined gesture input into the application interface 6001, the electronic device 100 responds by displaying the information widget 608-1 on the desktop homepage.
[0269] In some embodiments, the information widget 608-1 may display a portion of the information content. In some embodiments, the content displayed by the information widget 608-1 may include the latest updated message. In some embodiments, the information widget 608-1 may display the update time 612 of the message. For example, Figure 6CA As shown, the message update time displayed in the information widget 608-1 is "today." It should be understood that the update time of the message displayed in the information widget 608-1 can be dynamically changed, for example, it can be "just now", "one day ago", etc.
[0270] In some embodiments, the electronic device 100 detects a predefined gesture input into the information application widget (eg, a finger sliding up and down on the widget), and the electronic device 100 may adjust the message content displayed by the information application widget (not shown in the figure).
[0271] In some embodiments, the information widget 608-1 may also include a sliding control, such as Figure 6CB In some embodiments, the information widget 608 - 1 displayed on the desktop homepage of the electronic device 100 may also include an information reply window 604 .
[0272] Optionally, if the information widget 608-1 can also include a sliding control, the electronic device 100 detects that the sliding control 605 is slid upward, and the information widget 608-1 can stop displaying the information reply window 604 and display more historical messages in a limited space, such as Fig.6D shown.
[0273] In some embodiments, after the electronic device 100 detects a predefined gesture input on the message widget 608-1 (for example, clicking the message reply window, or pressing and holding the lower edge of the widget and dragging downward), the electronic device 100 can display a soft keyboard 610, and the user can enter content in the message reply window 604 to send, such as Figure 6EAOptionally, the electronic device 100 can enlarge the size of the information application widget while displaying the soft keyboard 610 to display more content to the user, such as Figure 6EB It should be understood that the content input by the user in the message reply window 604 includes but is not limited to voice, text, emoticons, pictures and videos. Optionally, the sent message may also include an envelope message (the content is hidden and not directly presented, and cannot be captured or recorded).
[0274] Since users can reply to messages directly on the message widget, there is no need to find the "Message" application icon again and then enter the "Message" application interface by clicking the icon to reply. Users can receive and send messages more conveniently and quickly.
[0275] In some embodiments, the electronic device 100 may also refresh the content displayed by the information application widget after receiving the message.
[0276] Optionally, the electronic device 100 may add a mark point (eg, a red dot) at the end of the latest received message to remind the user. After the electronic device 100 detects a predefined gesture input (eg, the user clicks on the message application widget), it stops displaying the mark point.
[0277] Optionally, the method of reminding the user may also be a method such as shaking the widget.
[0278] Optionally, the method of reminding the user can also be that the electronic device 100 sets the information application widget to be displayed with a certain degree of transparency, and highlights the latest received message above the information application widget, such as Figure 6G In some embodiments, the electronic device 100 can display a control (e.g., a "reply" control) while highlighting the latest received message above the message application widget. The electronic device 100 detects that the "reply" control is activated and displays the message reply interface, such as Figure 6EA GUI6006 or Figure 6EB GUI6006 in.
[0279] In some embodiments, the electronic device 100 detects a user's predefined gesture (e.g., long press) on a message and can copy, delete, forward, or reply to the message.
[0280] In some embodiments, the instant messaging application widget displayed by the electronic device 100 contains a voice message. When playing the voice message, the electronic device 100 detects a predefined gesture input (for example, the user drags a progress bar) and can adjust the playback progress.
[0281] In some embodiments, after the electronic device 100 detects a predefined gesture input into the information application widget 608-1 (for example, sliding inward from the upper right corner of the information widget 608-1 or double-clicking the widget), the electronic device 100 may display a control on the information widget (for example, at least one of a full-screen control, a delete control, a pinned control, etc.).
[0282] Optionally, the electronic device 100 may display a widget control in a corner of the widget, such as Figure 6FA shown.
[0283] Optionally, after the electronic device 100 detects the predefined gesture inputted into the information widget 608-1, the widget may be set to be displayed with a certain degree of transparency, and the widget control may be displayed on the widget. Figure 6FB It should be understood that Figure 6FB What is shown is only a schematic illustration, and the embodiment of the present application does not limit the display position of the widget control.
[0284] The electronic device 100 displays an application widget 304-1 on the desktop. After the electronic device 100 detects a predefined input operation, an instant messaging application widget is displayed on the desktop homepage. The method of displaying the instant messaging application widget on the desktop homepage can refer to Figure 3FA to Figure 3FC The content will not be repeated here.
[0285] In some embodiments, at least two application widgets are displayed on the desktop of the electronic device 100. After the electronic device 100 detects a predefined input operation, an instant messaging application widget is displayed on the desktop. The method of displaying the instant messaging application widget on the desktop of the electronic device 100 can refer to Figure 3L-3M The display method of the media widgets will not be described here.
[0286] In some embodiments, the electronic device 100 can display the instant messaging application widget on the lock screen interface after detecting the user's predefined input operation on the instant messaging application interface. The display method and beneficial effects of displaying the instant messaging application widget on the lock screen page can refer to the display method of the instant messaging application widget on the desktop, which will not be repeated here.
[0287] The method of clicking the screen with a user's finger as described in all the above embodiments can be replaced by stylus input, floating touch, voice input and other methods in some embodiments.
[0288] Figure 7 Shown is a schematic flow chart of some embodiments of the present application.
[0289] S701, displaying a first widget of a first size in a first area of a first page of a desktop;
[0290] For example, Figure 3B As shown, the electronic device 100 displays a time and weather widget on the desktop;
[0291] S702, in response to detecting that a task in progress exists for the first application, displaying, in the first area, a widget of the first application and the first widget reduced in size, the widget of the first application displaying first content, wherein the widget of the first application has a second size, and the second size is smaller than the first size;
[0292] For example, Figure 3FA As shown, after the electronic device 100 detects that the music playing control is activated (for example, Figure 3E The user clicks the play music control as shown) to display the interface of the music being played. When there is a song being played in the music application, after the electronic device 100 detects the input of a predefined gesture (for example, an upward swipe gesture is made at the bottom of the screen), the electronic device 100 can switch from displaying the music application interface GUI3002 to the desktop. After the electronic device 100 switches from displaying the music application interface GUI3002 to the desktop, the desktop can simultaneously display the music widget 314-2 and the widget 304-2 (the reduced size application widget 304-1).
[0293] For example, Figure 5BA When the electronic device 100 detects that there is ticket itinerary information in the schedule content of the local device, the electronic device 100 identifies the ticket itinerary information in the schedule (e.g., passengers, departure station, arrival station, departure time, arrival time, etc.), and determines that the difference between the local system time 08:00 and the train departure time 08:26 is less than the time threshold, and / or the current geographical location of the local device is less than the distance threshold from the geographical location of the train departure station Beijing Station in the schedule content, then the ticket itinerary in the schedule content is determined to be an ongoing task, and the electronic device 100 displays the schedule widget 502-2 and the time and weather widget 304-2 on the desktop homepage.
[0294] S703: In response to the electronic device satisfying a preset condition, adjusting the size of the widget of the first application from the second size to the first size, wherein the widget of the first application with the first size displays second content, the second content is larger than the first content, and the second content includes the first content.
[0295] It should be understood that for all embodiments of the present application, the electronic device 100 can detect a predefined gesture input and change the order of widgets displayed on the desktop or lock screen interface. It should be understood that the widgets include all widgets described in the embodiments of the present application. Figure 3GAs shown, after the electronic device 100 detects a gesture operation in which the user presses the music widget with a finger and drags it to the right, it adjusts the display order of the time and weather widget and the music widget.
[0296] It should be understood that for all embodiments of the present application, the electronic device 100 can detect input predefined gestures and adjust the size of the widgets displayed on the desktop or lock screen interface and / or the content displayed by the widgets. It should be understood that the widgets include all the widgets described in the embodiments of the present application. In some embodiments, the electronic device 100 can detect input predefined gestures and can also adjust the layout of the content displayed by the widgets.
[0297] It should be understood that for all embodiments of the present application, the electronic device 100 can detect a change in the scene (for example, by detecting that the time difference between the system time of the local device and the scene time is less than a preset time threshold value, and / or the distance difference between the local device's geographical location and the scene's geographical location is less than a preset distance threshold value, thereby determining that the scene has changed), thereby adjusting the size of the widget displayed on the desktop page or the lock screen interface and / or the content displayed by the widget, and / or the layout of the content displayed by the widget. The specific method and beneficial effects can be cited in Figure 3HB The relevant contents of the description will not be repeated here. It should be understood that the widget may include Figure 3A-3M The widget described in the embodiment, Figure 4A-4F The application widget described in the embodiment, Figures 5A-5EC The schedule widget described in the embodiment, Figure 6A-6G The instant messaging application widget described in the embodiment.
[0298] It should be understood that for all embodiments of the present application, the electronic device 100 can detect a predefined gesture input (e.g., pinching, where two pinching points are in contact with different widgets respectively), and the electronic device 100 responds by merging two widgets on the desktop or lock screen interface (two widgets are on the same page at the same time, such as two widgets on the desktop homepage at the same time) into a composite widget. The specific method can be referred to in Figure 5C It should be understood that the widgets include all the widgets described in the embodiments of the present application.
[0299] It should be understood that for all embodiments of the present application, when the electronic device 100 displays a widget on the desktop, if a predefined gesture (such as a finger click) is detected, the application program interface of the widget may be displayed. Figure 4F content.
[0300] It should be understood that for all embodiments of the present application, when the electronic device 100 displays a widget on the lock screen interface, it may issue an unlock request when a predefined gesture (such as a finger click) is detected, and an unlock operation (such as face recognition, long press) input by the user is detected. Figure 3Aicon 315 in the widget or enter a password), the electronic device 100 displays the application program interface of the widget.
[0301] It should also be understood that the "simultaneous display" described in the embodiments of the present application refers to the simultaneous presentation of results, rather than the synchronization during the display process. For example, the simultaneous display of the music widget and the time and weather widget on the desktop of the electronic device 100 means that the user can see the music widget and the time and weather widget on the desktop of the electronic device 100 at the same time, rather than the music widget and the time and weather widget appearing on the desktop of the electronic device 100 at the same time.
[0302] It is understandable that, in order to realize the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.
[0303] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0304] In the case of using integrated units, the electronic device may include a processing module, a storage module and a communication module. Among them, the processing module can be used to control and manage the actions of the electronic device, for example, it can be used to support the electronic device to execute the steps performed by the above-mentioned receiving unit, detection unit, and display unit. The storage module can be used to support the electronic device to execute stored program codes and data, etc. The communication module can be used to support the communication between the electronic device and other devices.
[0305] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.
[0306] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment may be a Figure 1 Device of the structure shown.
[0307] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method for displaying widgets in the above-mentioned embodiment.
[0308] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the widget display method in the above-mentioned embodiment.
[0309] In addition, an embodiment of the present application further provides a device, which may specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor may execute the computer-executable instructions stored in the memory so that the chip executes the widget display method in the above-mentioned method embodiments.
[0310] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above and will not be repeated here.
[0311] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0312] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0313] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0314] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0315] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0316] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for displaying a widget applied to an electronic device, characterized in that: include: Displaying a first widget with a first size in a first area of a first page of the desktop; In response to detecting that there is an ongoing task of the first application, displaying a widget of the first application and the first widget reduced in size in the first area at the same time, the widget of the first application displays first content, wherein the widget of the first application has a second size, and the second size is smaller than the first size; In response to the electronic device satisfying a preset condition, adjusting the size of the widget of the first application from the second size to the first size, wherein the widget of the first application with the first size displays second content, the second content is larger than the first content and the second content includes the first content; The detecting that the first application has an ongoing task is specifically: It is detected that the first application logged in with the same user account has an ongoing task on other electronic devices, or After the electronic device is paired with another electronic device, it is detected that the first application has an ongoing task in the other electronic device.
2. The method according to claim 1, characterized in that When the first application is a calendar application, the manner of detecting that the first application has an ongoing task is one or a combination of the following manners: By identifying the schedule content in the schedule application, determining that the time difference between the system time of the electronic device and the time in the schedule content is less than a first time threshold; or By identifying the schedule content in the schedule application, it is determined that the distance difference between the geographical location of the electronic device and the geographical location in the schedule content is less than a first distance threshold.
3. The method according to claim 2, characterized in that The preset condition is one or more of the following conditions: Determine that a time difference between the system time of the electronic device and the time in the schedule content is less than a second time threshold, wherein the second time threshold is less than the first time threshold; or It is determined that a distance difference between a geographical location of the electronic device and a geographical location in the schedule content is less than a second distance threshold, and the second distance threshold is less than the first distance threshold.
4. The method according to claim 3, characterized in that When simultaneously displaying the widget of the first application and the first widget after reducing its size, the method further includes: A pinch gesture is detected, wherein a first contact point of the pinch gesture contacts the widget of the first application, and a second contact point of the pinch gesture contacts the first widget; In response to the pinch gesture, the widget of the first application and the first widget are combined into a first composite widget and displayed in the first area.
5. The method according to any one of claims 2 to 4, characterized in that: When simultaneously displaying the widget of the first application and the first widget after reducing its size, the method further includes: It is detected that there is an ongoing task in the media application, the first widget is stopped from being displayed, and the widget of the first application and the widget of the media application are simultaneously displayed in the first area.
6. The method according to any one of claims 2 to 4, characterized in that: The method further comprises: It is detected that the system time of the electronic device exceeds the end time in the schedule content, the widget of the first application with the first size is stopped from being displayed, and the first widget with the first size is displayed in the first area.
7. The method according to any one of claims 2 to 6, characterized in that: It is detected that there is an ongoing task in the calendar application, specifically: Through the broadcast receivers component in the calendar application, it is detected that there is an ongoing task in the calendar application.
8. The method according to claim 5, characterized in that The tasks being detected in progress in the media application are specifically: Through the Service component in the media application, it is detected that there is an ongoing task in the media application.
9. The method according to claim 1, characterized in that: The first page is a desktop homepage; or The first widget is a time and weather widget or a calendar widget; or The notification bar on the screen displays both the 4G number identifier and the 5G signal identifier; or The first area is above the first page; or The first widget is transparent or semi-transparent; or The first application is a calendar app, a memo app, or a reminder app; or The first application is an audio application or a video application; or The ongoing task is playing music, the first content is the song title, singer, play / pause control, next song play control, and previous song play control, and the second content is the song title, singer, play / pause control, next song play control, previous song play control, favorite control, and switch play mode control; or The ongoing task is a travel task, the first content is the departure time, train number, departure station, and arrival station, and the second content is the departure time, arrival time, train number, departure station, arrival station, and seat number; or The ongoing task is a courier task, the first content is a pickup point and a pickup time, and the second content is a pickup point, a pickup time, and a pickup code; or The ongoing task is a movie task, the first content is the location of the cinema and the movie showing time, and the second content is the location of the cinema, the movie showing time, and the seat number; or The ongoing task is a meeting task, the first content is the meeting time and meeting place, and the second content is the meeting time, meeting place, and meeting list.
10. An electronic device, characterized in that: include: A display screen, a memory, and one or more processors, wherein the memory includes instructions, and when the instructions are executed by the one or more processors, the electronic device implements the method as described in any one of claims 1-9.
11. A computer storage medium, characterized in that: The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method for displaying a widget according to any one of claims 1 to 9.
12. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is enabled to execute the widget display method according to any one of claims 1 to 9.