An input method and an electronic device
By receiving and displaying handwriting input on the lock screen, desktop, or any system-supported application's user interface, it solves the problem of limited application scenarios for existing electronic device input tools and improves the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUAWEI DEVICE CO LTD
- Filing Date
- 2024-11-25
- Publication Date
- 2026-05-26
AI Technical Summary
Existing electronic devices have limited application scenarios for touchscreen input tools, resulting in a poor user experience, especially with insufficient input functionality in non-specific applications.
An input method is provided that allows input via stylus or other means on the lock screen, desktop, or user interface of any application supported by the system, and displays the input content on a second user interface, thus expanding the application scenarios of stylus.
It improves the user experience, expands the application range of styluses on electronic devices, and enables input content to be displayed in more scenarios, meeting the diverse needs of users.
Smart Images

Figure CN122086259A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to an input method and an electronic device. Background Technology
[0002] With the development of technology, electronic devices have gradually become an indispensable tool in people's lives. As electronic devices continue to evolve, the screens of touchscreen devices are getting larger and larger. For example, from candybar phones to foldable phones, then to tablets, laptops, and even foldable touchscreen laptops, the screens of these devices are getting bigger and bigger. This increased screen size makes it easier for users to input information using styluses or other methods (such as fingers or other tools). However, currently, the application scenarios for styluses, fingers, or other touchscreen input tools on electronic devices are limited. Electronic devices only support users to input information using styluses, fingers, or other touchscreen input tools in specific application scenarios, resulting in a poor user experience. These specific application scenarios might include users drawing in drawing applications (APPs) using styluses, fingers, or other touchscreen input tools, or taking notes in note-taking apps using styluses, fingers, or other touchscreen input tools. Summary of the Invention
[0003] This application provides an input method and an electronic device. The method can be applied to a first electronic device, which includes a touchscreen. First, the first electronic device can display a first user interface on the touchscreen, which can be a lock screen, a desktop, or a user interface of a first application. Then, the first electronic device can receive first input content based on handwriting input or other methods. Finally, the first electronic device can display the first input content on a second user interface, which can be a lock screen or a desktop.
[0004] In this way, electronic devices not only support users to input via stylus or other means in specific applications such as drawing apps and note-taking apps, but also support users to input via stylus or other means in application scenarios such as the lock screen, desktop, or user interface of any application supported by the system. The content input via stylus or other means can be displayed on the lock screen or desktop, which broadens the application scenarios of stylus on electronic devices and improves the user experience.
[0005] In a first aspect, this application provides an input method applied to a first electronic device, the first electronic device including a touch screen, the method comprising: displaying a first user interface on the touch screen, the first user interface being a lock screen interface, a desktop, or a user interface of a first application; receiving first input content; and displaying the first input content on a second user interface, the second user interface being a lock screen interface or a desktop.
[0006] The first electronic device can be, for example, Figure 1 The electronic device 100 shown has a first user interface that can be a lock screen, a desktop, or a user interface of a first application. The first application can be any application supported by the system. The first input content can be any content entered by the user through a stylus or other means (such as through a finger or other tools). The second user interface can be a lock screen or a desktop.
[0007] It should be noted that the first user interface may also include a control center, that is, the electronic device 100 may also receive first input content based on stylus input or other methods (such as through fingers or other tools) in the control center; the first user interface may also include a notification center, that is, the electronic device 100 may also receive first input content based on stylus input or other methods (such as through fingers or other tools) in the notification center. This application embodiment does not limit the type of user interface included in the first user interface. The control center can be considered as a type of first application, and the notification center can also be considered as a type of first application.
[0008] By implementing the method provided in the first aspect, electronic devices can not only support users to input via stylus or other means in specific applications such as drawing apps and note-taking apps, but also support users to input via stylus or other means in application scenarios such as lock screen, desktop, or user interface of any application supported by the system. The content input via stylus or other means can be displayed on the lock screen or desktop, which broadens the application scenarios of stylus on electronic devices and improves the user experience.
[0009] In conjunction with the first aspect, in some embodiments, the first input content is content entered by touching the touchscreen with a stylus or finger or other tool, including handwriting and / or patterns.
[0010] For example, such as Figures 5A-5FAs shown, the electronic device 100 can display a desktop on a touchscreen. Then, the user can input the phrase "buy a birthday present for mom" by touching the touchscreen with a stylus. Next, the electronic device 100 can display this handwritten phrase "buy a birthday present for mom" on the lock screen. In other embodiments, the first input content can also be content input via voice, which may include text content converted from voice input. For example, the electronic device 100 can display a lock screen on a touchscreen. Then, the user can input the phrase "celebrate dad's birthday" via voice. Next, the electronic device 100 can convert this voice input into text content and display the text content "buy a birthday present for mom" on the lock screen.
[0011] In conjunction with the first aspect, in some embodiments, the method further includes: recognizing the handwriting of the first input content; determining whether the handwriting of the first input content is consistent with a preset handwriting; if so, the user identity is recognized and the corresponding operation is performed according to the first input content.
[0012] In some embodiments, if user identification is successful, the electronic device 100 can identify the first user intent based on the first input content and perform a corresponding operation based on the first user intent. The first user intent can be a user instruction type obtained by the electronic device 100 from the first input content.
[0013] In this way, the electronic device 100 can identify the user through the handwritten handwriting of the first input content. Furthermore, if the user identification is successful, the electronic device 100 can perform corresponding operations based on the first input content.
[0014] In conjunction with the first aspect, in some embodiments, the corresponding operation is performed based on the first input content, specifically including one or more of the following: if the first input content includes a phone number or a person's name, then the phone number or person's name is saved to the address book; if the first input content includes schedule information, then the schedule information is saved to the calendar; if the first input content includes event information, then the event information is saved to the memo.
[0015] In some embodiments, if the first input content includes a phone number and a name, the electronic device 100 can recognize the user's intent as an intention to save the phone number based on the first input content, and save the phone number and name to the address book. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 may display an address book user interface (such as...). Figure 3GThe user interface 360 shown); after receiving the first input content based on stylus input or other means (e.g., by finger or other tools), the electronic device 100 can display a contact list user interface (e.g., with the phone number and name added from the first input content) that has been added. Figure 3H The user interface shown is 370.
[0016] In some embodiments, if the first input content includes schedule information, the electronic device 100 can recognize the user's intent as an intention to save the schedule based on the first input content and save the schedule information to the calendar. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 may display a calendar user interface (such as...). Figure 4F The user interface 440 shown); after receiving the first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a calendar user interface (e.g., with the schedule information from the first input content added) Figure 4G The user interface shown is 450.
[0017] In some embodiments, if the first input content includes event information, the electronic device 100 can identify the user's intent as an intention to save the event based on the first input content and save the event information to a memo. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 may display a memo user interface (such as...). Figure 5G The user interface 560 shown); after receiving first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a memo user interface (e.g., with added event information from the first input content) Figure 5H The user interface shown is 570.
[0018] In conjunction with the first aspect, in some embodiments, the first electronic device includes a front-facing camera, and the method further includes: upon receiving first input content, activating the front-facing camera and using the image captured by the front-facing camera to perform user identification; if the user identification is successful, then performing corresponding operations based on the first input content.
[0019] In some embodiments, if user identification is successful, the electronic device 100 can identify a second user intent based on the first input content and perform a corresponding operation based on the second user intent. The second user intent can be a user instruction type obtained by the electronic device 100 from the first input content.
[0020] Thus, upon receiving initial input via stylus input or other means (e.g., via finger or other tools), the electronic device 100 can activate its front-facing camera and use the image captured by the front-facing camera for user identification. In some embodiments, once the electronic device 100 detects that it has entered a writing state, it can activate its front-facing camera and use the image captured by the front-facing camera for user identification.
[0021] It should be noted that user identification verification can indicate that a user who inputs the first input content using a stylus or other means (e.g., using a finger or other tools) is an authenticated user, while user identification verification failure can indicate that a user who inputs the first input content using a stylus or other means (e.g., using a finger or other tools) is an unauthenticated user. Authenticated users have permissions including, but not limited to: the permission for the electronic device 100 to display the first input content input by the authenticated user using a stylus or other means (e.g., using a finger or other tools) on the second user interface; and the permission for the electronic device 100 to recognize the user's intent based on the first input content and perform corresponding operations according to the user's intent. Unauthenticated users have permissions including, but not limited to: the permission for the electronic device 100 to display the first input content input by the unauthenticated user using a stylus or other means (e.g., using a finger or other tools) on the second user interface. It is understood that authenticated users have more permissions than unauthenticated users.
[0022] In conjunction with the first aspect, in some embodiments, the first user interface is a lock screen interface, and the method further includes: if the user identity is successfully verified, then unlocking the touchscreen.
[0023] In this way, if the user identity is verified (i.e., the user who inputs the first input content through a stylus or other means (e.g., through a finger or other tools) is an authenticated user), the electronic device 100 can also unlock the touchscreen after exiting the writing state.
[0024] In conjunction with the first aspect, in some embodiments, before receiving the first input content, the method further includes: displaying a touchpad on a first user interface, the touchpad being a valid input range for input made by touching a touchscreen with a stylus or finger or other tool.
[0025] In this embodiment, before receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state. This writing state allows the electronic device 100 to receive the first input content based on stylus input or other methods (e.g., via finger or other tools). In some embodiments, the electronic device 100 entering the writing state may include: the electronic device 100 displaying a touchpad on a first user interface. This touchpad may be a legal input range for input via stylus input, finger input, or other tools on the touchscreen. The legal input range for input via stylus input, finger input, or other tools refers to the positional range on the touchscreen where the electronic device 100 can receive stylus input or other methods (e.g., via finger or other tools). In other words, the user can only write using a stylus or other methods (e.g., via finger or other tools) within the legal input range (i.e., within the touchpad).
[0026] In conjunction with the first aspect, in some embodiments, the triggering conditions for displaying the touchpad on the first user interface include one or more of the following: detecting that the touchpad has been touched for more than a first duration by a stylus or finger or other tool, or detecting multi-finger touch of the touchpad.
[0027] The first duration can be a preset duration, such as 1 second.
[0028] It should be noted that the electronic device 100 detects that the touch screen is touched for more than a first duration by a stylus, finger or other tool. Specifically, the electronic device 100 detects that the non-UI element (such as an application icon on the desktop) on the touch screen is touched for more than a first duration (e.g., 1 second) by a stylus, finger or other tool.
[0029] In conjunction with the first aspect, in some embodiments, the first user interface is the user interface of the first application, and displaying the first input content on the second user interface specifically includes: displaying the first input content on the second user interface in conjunction with the information displayed by the first application on the first user interface.
[0030] It should be noted that the information displayed by the first application on the first user interface can refer to content included on the user interface of the first application that can showcase the characteristics of the application. For example, the information displayed by a music application on the first user interface can be song information, which may include, but is not limited to, song title, artist name, and album information. As another example, the information displayed by a conferencing application on the first user interface can be meeting information, which may include, but is not limited to, meeting name and meeting time.
[0031] In this way, when the electronic device 100 receives the first input content in the user interface of the first application, the electronic device 100 can display the first input content combined with the display information of the first application on the second user interface.
[0032] In conjunction with the first aspect, in some embodiments, the first input content is displayed on the second user interface in conjunction with the information displayed on the first user interface by the first application. Specifically, it includes one or more of the following: if the first application is a music application, the first input content is displayed on the second user interface in conjunction with the song information of the music application on the first user interface. The song information includes the song name, artist name, and album information. If the first application is a conferencing application, the first input content is displayed on the second user interface in conjunction with the conferencing information of the conferencing application on the first user interface. The conferencing information includes the conferencing name and conferencing time.
[0033] In conjunction with the first aspect, in some embodiments, the method further includes: re-displaying the second user interface, wherein the re-displayed second user interface does not include the first input content; re-displaying the second user interface specifically includes one or more of the following: re-displaying the second user interface after the first electronic device restarts, re-displaying the second user interface after the first electronic device unlocks the touchscreen, and re-displaying the second user interface after the first electronic device receives a first user operation, wherein the first user operation is used to clear the first input content.
[0034] It should be noted that the first user operation can be applied to the first user interface, the second user interface, or both the second and first user interfaces; this application embodiment does not impose any limitations on this. Specifically, if the first user operation is applied to the first user interface, neither the first nor the second user interface displayed after receiving the first user operation includes the first input content. If the first user operation is applied to the second user interface, and the second user interface differs from the first user interface, the second user interface displayed after receiving the first user operation will not include the first input content, while the first user interface may include the first input content. If the first user operation is applied to both the second and first user interfaces, neither the second nor the first user interface displayed after receiving the first user operation includes the first input content.
[0035] In a second aspect, this application provides an electronic device, which includes a processor and a memory; wherein the memory is coupled to the processor and is used to store a computer program, and when the processor executes the computer program, the electronic device performs the method described in any of the first aspects above.
[0036] Thirdly, this application provides a computer-readable storage medium storing a computer program that is executed by a processor to implement the method described in any of the first aspects above.
[0037] Fourthly, this application provides a computer program product that, when executed by a processor, implements the method described in any one of the first aspects above.
[0038] Fifthly, this application provides a chip including a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, causing the chip to perform the method described in any of the first aspects above.
[0039] The solutions provided in the second to fifth aspects above are used to implement or cooperate with the methods provided in the first aspect above, and therefore can achieve the same or corresponding beneficial effects as the methods in the first aspect, which will not be elaborated here. Attached Figure Description
[0040] Figure 1 This is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application;
[0041] Figure 2 This is a flowchart illustrating an input method provided in an embodiment of this application;
[0042] Figures 3A-3H These are a set of interface diagrams provided in the embodiments of this application;
[0043] Figures 4A-4G This is another set of interface diagrams provided in the embodiments of this application;
[0044] Figures 5A-5H This is another set of interface diagrams provided in the embodiments of this application;
[0045] Figures 6A-6F This is another set of interface diagrams provided in the embodiments of this application;
[0046] Figures 7A-7F This is another set of interface diagrams provided in the embodiments of this application. Detailed Implementation
[0047] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be a limitation of this application.
[0048] With the development of technology, electronic devices have gradually become an indispensable tool in people's lives. As electronic devices continue to evolve, the screens of touchscreen devices are getting larger and larger. For example, from candybar phones to foldable phones, then to tablets, laptops, and even foldable touchscreen laptops, the screens of these devices are getting bigger and bigger. This increased screen size makes it easier for users to input information using styluses or other methods (such as fingers or other tools). However, currently, the application scenarios for styluses, fingers, or other touchscreen input tools on electronic devices are limited. Electronic devices only support users to input information using styluses, fingers, or other touchscreen input tools in specific application scenarios, resulting in a poor user experience. These specific application scenarios might include users drawing in drawing applications (APPs) using styluses, fingers, or other touchscreen input tools, or taking notes in note-taking apps using styluses, fingers, or other touchscreen input tools.
[0049] To address the aforementioned issues, this application provides an input method and an electronic device. This method can be applied to a first electronic device, which includes a touchscreen. First, the first electronic device can display a first user interface on the touchscreen, which can be a lock screen, desktop, or the user interface of a first application. Then, the first electronic device can receive first input content input via a stylus pen or other means. Finally, the first electronic device can display the first input content on a second user interface, which can be a lock screen or desktop. In this way, the electronic device not only supports user input via a stylus pen or other means in specific applications such as drawing apps and note-taking apps, but also supports user input via a stylus pen or other means in various application scenarios, including the lock screen, desktop, or the user interface of any application supported by the system. The content input via a stylus pen or other means can be displayed on the lock screen or desktop, broadening the application scenarios of the stylus pen on electronic devices and improving the user experience.
[0050] It should be noted that the first user interface may also include a control center, meaning that the first electronic device may also receive first input content based on stylus input or other methods (e.g., via finger or other tools) in the control center; the first user interface may also include a notification center, meaning that the first electronic device may also receive first input content based on stylus input or other methods (e.g., via finger or other tools) in the notification center. This application embodiment does not limit the type of user interface included in the first user interface. The control center can be considered a type of first application, and the notification center can also be considered a type of first application.
[0051] It should be noted that, in some embodiments, the first input content may be content input via touch of the touchscreen using a stylus, finger, or other tool for inputting onto the touchscreen. This content may include handwritten strokes and / or patterns. For example, such as... Figures 5A-5F As shown, the first electronic device can display a desktop on a touchscreen. Then, the user can input the phrase "buy a birthday present for mom" using a stylus. Next, the first electronic device can display this handwritten phrase "buy a birthday present for mom" on the lock screen. In other embodiments, the first input content can also be content input via voice, which may include text content converted from voice input. For example, the first electronic device can display a lock screen on a touchscreen. Then, the user can input the phrase "celebrate dad's birthday" via voice. Next, the first electronic device can convert this voice input into text content and display the text content "buy a birthday present for mom" on the lock screen.
[0052] In some embodiments, the first electronic device may display all of the received first input content on the second user interface. Optionally, if the first input content occupies more than a preset threshold (e.g., two-thirds) on the touchscreen, i.e., if the first input content is large, for the sake of aesthetics, the first electronic device may display only a portion of the first input content on the second user interface. This portion may be, for example, the first two-thirds of the first input content, or for example, the last two-thirds of the first input content. This application embodiment does not limit the position range of the portion of the first input content displayed by the first electronic device on the second user interface.
[0053] In some embodiments, the display format of the first input content on the second user interface may be exactly the same as the display format of the first input content on the user interface receiving the first input content. That is, the handwritten handwriting of the first input content displayed on the second user interface is exactly the same as the handwritten handwriting of the first input content received by the first electronic device on the user interface receiving the first input content. Before displaying the first input content on the second user interface, the first electronic device does not perform any conversion on the display format of the first input content. Optionally, before displaying the first input content on the second user interface, the first electronic device may perform one or more conversions on the display format of the first input content, such as font, font size, font color, font weight, font italics, and text effects. For example, the first input content may be displayed as black handwriting on the user interface receiving the first input content, and the first input content may be displayed on the second user interface as follows: the font is KaiTi, the font size is 5, and the font color is blue. Before displaying the first input content on the second user interface, the first electronic device performs font, font size, and font color conversions on the first input content.
[0054] In some embodiments, the first electronic device can determine a second user interface for displaying the first input content based on the user's identity. The user identity can include an unauthenticated user and an authenticated user, with the unauthenticated user and the authenticated user having different permissions on the first electronic device. The method of user identity identification will be explained in detail later and will not be elaborated here. For example, if the user is an unauthenticated user, the second user interface can be a lock screen. The first electronic device can display the first input content entered by the unauthenticated user using a stylus or other methods (e.g., via finger or other tools) on the lock screen to leave a message for the main user, who is an authenticated user. For instance, when the main user is briefly away, if a colleague (an unauthenticated user) needs to contact the main user, the unauthenticated user can leave a message using a stylus on the first electronic device. These messages can be displayed on the lock screen for the main user to read upon returning. For example, if the user is an authenticated user, the second user interface can be a lock screen or a desktop. The first electronic device can display the first input content entered by the authenticated user using a stylus or other methods (e.g., via finger or other tools) on the lock screen or desktop. For example, a certified user might use a stylus to record important information on a non-lock screen, but this information is private and the certified user doesn't want it displayed on the lock screen. In this case, the important information recorded by the certified user can be displayed only on the desktop for later review. Another example is a certified user using a stylus to record public notes on their first electronic device, which the user wants to access from as many places as possible. In this case, the notes recorded by the certified user can be displayed on either the desktop or the lock screen for easy access later. Yet another example is a certified user using a stylus to create a screensaver on their first electronic device. In this case, the screensaver created by the certified user can be displayed on the lock screen for an aesthetically pleasing visual effect.
[0055] First, an electronic device 100 provided in the embodiments of this application will be introduced.
[0056] Figure 1 An electronic device 100 provided in an embodiment of this application is illustrated by way of example.
[0057] In this embodiment, the first electronic device may be referred to as electronic device 100. Electronic device 100 may be various types of smart terminal devices including a touch screen, and this embodiment does not limit the specific type of electronic device 100. For example, electronic device 100 may be a laptop computer, or it may be a mobile phone, mobile tablet computer, in-vehicle tablet computer, desktop computer, laptop computer, handheld computer, etc.
[0058] like Figure 1 As shown, the electronic device 100 may include a processor 210, an external memory interface 220, an internal memory 221, a Universal Serial Bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, antenna 1, antenna 2, a mobile communication module 250, a wireless communication module 260, a sensor module 270, a front-facing camera 283, a display screen 284, and a subscriber identity module (SIM) card interface 285, etc. The sensor module 270 may include, but is not limited to, a pressure sensor 270A and a touch sensor 270K.
[0059] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0060] Processor 210 may include one or more processing units, such as application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.
[0061] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0062] The processor 210 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. This memory can store instructions or data that the processor 210 has just used or that are used repeatedly. If the processor 210 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.
[0063] In some embodiments, the processor 210 can be used to recognize the handwriting of the first input content; the processor 210 can also be used to determine whether the handwriting of the first input content is consistent with a preset handwriting; if so, the user identification is successful; the processor 210 can also be used to perform user identification using an image captured by a front-facing camera; if the user identification is successful, the processor 210 can also be used to perform corresponding operations based on the first input content. Specifically, if the first input content includes a phone number or a name, the processor 210 can be used to save the phone number or name to the address book; if the first input content includes schedule information, the processor 210 can be used to save the schedule information to the calendar; if the first input content includes event information, the processor 210 can be used to save the event information to the memo. In some embodiments, if the user identification is successful, the processor 210 can also be used to unlock the touchscreen.
[0064] The external storage interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 210 through the external storage interface 220 to perform data storage functions. For example, music, photos, videos, and other data can be stored on the external memory card.
[0065] Internal memory 221 can be used to store one or more computer programs, which include instructions. Processor 210 can execute the instructions stored in internal memory 221, thereby causing electronic device 100 to perform the input methods provided in some embodiments of this application, as well as various functional applications and data processing. Internal memory 221 may include a program storage area and a data storage area. The program storage area may store the operating system; it may also store one or more applications (such as a gallery, contacts, etc.). The data storage area may store data created during the use of electronic device 100 (such as preset handwriting of authenticated users, facial images of authenticated users, photos, contacts, calendar information, event information, etc.). Furthermore, internal memory 221 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0066] USB port 230 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 230 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as augmented reality (AR) devices.
[0067] The charging management module 240 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 receives charging input from the wired charger via a USB interface 230. In some wireless charging embodiments, the charging management module 240 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 242, the charging management module 240 can also supply power to the electronic device 100 via the power management module 241.
[0068] The power management module 241 connects the battery 242, the charging management module 240, and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240, providing power to the processor 210, internal memory 221, external memory, display screen 284, front-facing camera 283, and wireless communication module 260. The power management module 241 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 241 may also be located within the processor 210. In other embodiments, the power management module 241 and the charging management module 240 may be housed in the same device.
[0069] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor.
[0070] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0071] The mobile communication module 250 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 250 may include at least one filter, switch, power amplifier, low-noise amplifier, etc. The mobile communication module 250 can receive electromagnetic waves via the antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to the modem processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna. In some embodiments, at least some functional modules of the mobile communication module 250 may be housed in the processor 210. In some embodiments, at least some functional modules of the mobile communication module 250 and at least some modules of the processor 210 may be housed in the same device.
[0072] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor displays images or videos via the display screen 284. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 210 and may be housed within the same device as the mobile communication module 250 or other functional modules.
[0073] The wireless communication module 260 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (WiFi) networks), Bluetooth (BT), global navigation satellite systems, frequency modulation, near field communication (NFC), infrared technology, ultra-wideband (UWB), and SparkLink. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via an antenna, frequency-modulates and filters the electromagnetic wave signals, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive signals to be transmitted from the processor 210, frequency-modulate and amplify them, and then convert them into electromagnetic waves for radiation via the antenna. For example, the wireless communication module 260 may include a Bluetooth module, a WiFi module, etc.
[0074] In some embodiments, a portion of the antenna of the electronic device 100 is coupled to the mobile communication module 250, and another portion of the antenna is coupled to the wireless communication module 260, enabling the electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), Millimeter Wave (mmWave), BitTorrent, Global Navigation Satellite System (GNSS), WLAN, NFC, Frequency Modulation (FM), UWB, and / or Infrared (IR) technology, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0075] In some embodiments, the electronic device 100 can establish a communication connection with the stylus via antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor. After establishing a communication connection with the stylus, the electronic device 100 can receive first input content based on the stylus input.
[0076] Electronic device 100 can perform display functions, such as displaying initial input content based on stylus input or other methods, through a GPU, display screen 284, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 284 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 210 may include one or more GPUs, which execute instructions to generate or modify display information.
[0077] The display screen 284 is used to display images, videos, etc. The display screen 284 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 284, where N is a positive integer greater than 1.
[0078] In this embodiment, the display screen 284 can be used to display a first user interface, which can be a lock screen, a desktop, or a user interface of a first application; the display screen 284 can also be used to receive first input content based on handwriting input or other methods; the display screen 284 can also be used to display the first input content on a second user interface, which can be a lock screen or a desktop.
[0079] In some embodiments, the first user interface can be the user interface of a first application, and the display screen 284 can be used on the second user interface to display the first input content in conjunction with the information displayed by the first application on the first user interface. Specifically, if the first application is a music application, the display screen 284 can be used on the second user interface to display the first input content in conjunction with the song information of the music application on the first user interface. The song information may include the song name, artist name, and album information. If the first application is a conferencing application, the display screen 284 can be used on the second user interface to display the first input content in conjunction with the conferencing information of the conferencing application on the first user interface. The conferencing information may include the conferencing name and conferencing time.
[0080] In some embodiments, the display screen 284 may be used to re-display the second user interface, wherein the re-displayed second user interface does not include the first input content. Specifically, re-displaying the second user interface includes one or more of the following: re-displaying the second user interface after the electronic device 100 restarts; re-displaying the second user interface after the electronic device 100 unlocks the touchscreen; and re-displaying the second user interface after the electronic device 100 receives a first user operation, wherein the first user operation can be used to clear the first input content.
[0081] In some embodiments, prior to receiving the first input content, the display screen 284 may be used to display a touchpad on a first user interface, the touchpad being within the legal input range for input made by touching the touchscreen with a stylus or finger or other tool.
[0082] Electronic device 100 can perform shooting functions through ISP, front-facing camera 283, video codec, GPU, display screen 284 and application processor.
[0083] The ISP (Image Signal Processor) is used to process data fed back from the front-facing camera 283. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the front-facing camera 283.
[0084] The front-facing camera 283 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N front-facing cameras 283, where N is a positive integer greater than 1.
[0085] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0086] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG)-1, MPEG-2, MPEG-3, MPEG-4, etc.
[0087] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0088] In this embodiment, the electronic device 100 can capture facial images via an ISP, a front-facing camera 283, a video codec, a GPU, a display screen 284, and an application processor. The electronic device 100 can then use the captured facial images for user identification.
[0089] The SIM card interface 285 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 285 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 285 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 285 simultaneously. The types of these multiple cards can be the same or different. The SIM card interface 285 is also compatible with different types of SIM cards. The SIM card interface 285 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100. In some embodiments, the electronic device 100 may not include the SIM card interface 285.
[0090] Pressure sensor 270A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, pressure sensor 270A can be disposed on display screen 284. There are many types of pressure sensors 270A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 270A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 284, electronic device 100 detects the intensity of the touch operation based on pressure sensor 270A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 270A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.
[0091] Touch sensor 270K, also known as a touch panel or touch-sensitive surface, can be located on display screen 284. The touch sensor 270K and display screen 284 together form a touchscreen, also called a "touchscreen." Touch sensor 270K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 284. In other embodiments, touch sensor 270K may also be located on the surface of electronic device 100, in a different position than display screen 284.
[0092] In some embodiments, the electronic device 100 may detect, through pressure sensor 270A, touch sensor 270K, that the touchscreen has been touched for more than a first duration (e.g., 1 second) by a stylus or finger or other tool, and / or detect multi-finger (e.g., eight-finger) touchscreen, triggering the electronic device 100 to enter writing mode.
[0093] The following is a detailed flowchart illustrating an input method provided in an embodiment of this application.
[0094] Figure 2 The following is an exemplary illustration of a specific flow of an input method provided in an embodiment of this application. This method can be applied to... Figure 1 The electronic device 100 shown.
[0095] like Figure 2 As shown, the method may include:
[0096] S101, Electronic device 100 displays a first user interface on a touch screen.
[0097] In this embodiment, the electronic device 100 can display a first user interface on a touch screen, which can be a lock screen interface, a desktop, or a user interface of a first application.
[0098] It should be noted that the first user interface may also include a control center, that is, the electronic device 100 may also receive first input content based on stylus input or other methods (such as through fingers or other tools) in the control center; the first user interface may also include a notification center, that is, the electronic device 100 may also receive first input content based on stylus input or other methods (such as through fingers or other tools) in the notification center. This application embodiment does not limit the type of user interface included in the first user interface. The control center can be considered as a type of first application, and the notification center can also be considered as a type of first application.
[0099] S102, Electronic device 100 enters writing mode.
[0100] In this embodiment, before receiving the first input content input via stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state. This writing state can be used by the electronic device 100 to receive the first input content input via stylus input or other methods (e.g., via finger or other tools). In some embodiments, when the electronic device 100 is in the writing state, the electronic device 100 may not receive other inputs besides the first input content input via stylus input or other methods (e.g., via finger or other tools), such as user input operations on application icons on the desktop. It should be noted that the first input content can be located above user interface (UI) elements such as application icons, application cards, and controls in the user interface.
[0101] In some embodiments, the electronic device 100 entering a writing state may include: the electronic device 100 displaying a touchpad on a first user interface, which may be a legal input range for input via a stylus, finger, or other tool touching the touchscreen. The legal input range refers to the area on the touchscreen where the electronic device 100 can receive input via stylus or other means (e.g., via finger or other tool). In other words, the user can only write using a stylus or other means (e.g., via finger or other tool) within the legal input range (i.e., within the touchpad). In other embodiments, the electronic device 100 entering a writing state may also include: the electronic device 100 not displaying a touchpad on the first user interface. It is understood that the electronic device 100 entering a writing state may also have other manifestations, and this application embodiment does not limit these.
[0102] In some embodiments, the triggering conditions for the electronic device 100 to enter the writing state may include one or more of the following: the electronic device 100 detects that the touchscreen has been touched for more than a first duration (e.g., 1 second) by a stylus, finger, or other tool; or the electronic device 100 detects that multiple fingers (e.g., eight fingers) have touched the touchscreen. It should be noted that the electronic device 100 detecting that the touchscreen has been touched for more than a first duration (e.g., 1 second) by a stylus, finger, or other tool specifically means that the electronic device 100 detects that a non-UI element (e.g., an application icon on the desktop) on the touchscreen has been touched for more than a first duration (e.g., 1 second) by a stylus, finger, or other tool. It is understood that the triggering conditions for the electronic device 100 to enter the writing state may also be other, and this embodiment does not limit these possibilities.
[0103] S103, Electronic device 100 receives the first input content.
[0104] In this embodiment of the application, after entering the writing state, the electronic device 100 can receive first input content based on stylus input or other methods (e.g., through fingers or other tools).
[0105] It should be noted that, in some embodiments, the first input content may be content input via touch of the touchscreen using a stylus, finger, or other tool for inputting onto the touchscreen. This content may include handwritten strokes and / or patterns. For example, such as... Figures 5A-5FAs shown, the first electronic device can display a desktop on a touchscreen. Then, the user can input the phrase "buy a birthday present for mom" using a stylus. Next, the first electronic device can display this handwritten phrase "buy a birthday present for mom" on the lock screen. In other embodiments, the first input content can also be content input via voice, which may include text content converted from voice input. For example, the first electronic device can display a lock screen on a touchscreen. Then, the user can input the phrase "celebrate dad's birthday" via voice. Next, the first electronic device can convert this voice input into text content and display the text content "buy a birthday present for mom" on the lock screen.
[0106] In some embodiments, when the first input content includes handwriting, the electronic device 100 can perform user identification through the handwriting of the first input content. Specifically, the electronic device 100 can recognize the handwriting of the first input content. Here, handwriting can refer to the traces left by a user writing on a touchscreen using a stylus or other means (e.g., with a finger or other tool), and these traces can be used to provide feedback on the font characteristics of the user's writing. It should be noted that the formation of handwriting is closely related to the physiological and psychological characteristics of individual users. Differences in each user's hand movements, neural control, and cognitive abilities lead to the uniqueness of their handwriting. This uniqueness makes handwriting an important biometric information, similar to fingerprints, deoxyribonucleic acid (DNA), or faces, possessing high individual specificity. Therefore, handwriting can be used for user identification. User identity can include unauthenticated users and authenticated users, with unauthenticated users and authenticated users having different permissions on the electronic device 100. When the first input content includes a pattern, the electronic device 100 can perform user identification through the pattern of the first input content. It should be noted that the condition for the electronic device 100 to recognize the pattern of the first input content is as follows: the authenticated user inputs a preset number of hand-drawn patterns into the electronic device 100. This preset number is greater than a large value (e.g., 5000). These preset number of hand-drawn patterns can be used for training of the electronic device 100, so that the electronic device 100 can extract the features of the authenticated user's hand-drawn patterns based on these preset number of hand-drawn patterns input by the user and store the features of the authenticated user's hand-drawn patterns in memory. This allows the electronic device 100 to perform user identification based on the features of the authenticated user's hand-drawn patterns. If the features of the pattern of the first input content match the features of the authenticated user's hand-drawn patterns, then the user who inputs the first input content on the touch screen using a stylus or other means (e.g., using a finger or other tools) is an authenticated user; otherwise, the user who inputs the first input content on the touch screen using a stylus or other means (e.g., using a finger or other tools) is an unauthenticated user.
[0107] Specifically, after recognizing the handwriting of the first input content, the electronic device 100 can determine whether the handwriting of the first input content matches a preset handwriting. Further, the electronic device 100 can determine whether the font characteristics of the first input content match the font characteristics of the preset handwriting. The preset handwriting can be the handwriting of an authenticated user already stored in the electronic device 100. Optionally, the preset handwriting can be the handwriting entered by the authenticated user in a settings application. If the handwriting of the first input content matches the preset handwriting, user identification is successful; otherwise, user identification fails. It should be noted that successful user identification indicates that the user who inputs the first input content using a stylus or other means (e.g., a finger or other tool) is an authenticated user, while failed user identification indicates that the user who inputs the first input content using a stylus or other means (e.g., a finger or other tool) is an unauthenticated user. In the case of successful user identification, the electronic device 100 can perform corresponding operations based on the first input content. In some embodiments, in the case of successful user identification, the electronic device 100 can recognize the first user's intent based on the first input content and perform corresponding operations based on the first user's intent.
[0108] In some embodiments, the electronic device 100 may include a front-facing camera. Upon receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 may activate the front-facing camera and use the image captured by the front-facing camera for user identification. In some embodiments, once the electronic device 100 detects that it has entered a writing state, the electronic device 100 may activate the front-facing camera and use the image captured by the front-facing camera for user identification. It should be noted that the image captured by the front-facing camera is a facial image of the user who inputs the first input content using a stylus or other methods (e.g., via finger or other tools). The electronic device 100's use of the image captured by the front-facing camera for user identification may specifically include the following steps: First, the electronic device 100 can recognize the image captured by the front-facing camera; then, the electronic device 100 can determine whether the image captured by the front-facing camera is consistent with a preset image, wherein the preset image may be a facial image of the authenticated user already stored in the electronic device 100; if the image captured by the front-facing camera is consistent with the preset image, then user identification is successful; otherwise, user identification fails; if user identification is successful, the electronic device 100 can perform corresponding operations based on the first input content. In some embodiments, if user identification is successful, the electronic device 100 can identify the second user's intent based on the first input content and perform corresponding operations according to the second user's intent. It should be noted that successful user identification indicates that the user who inputs the first input content using a stylus or other means (e.g., using a finger or other tools) is an authenticated user, while unsuccessful user identification indicates that the user who inputs the first input content using a stylus or other means (e.g., using a finger or other tools) is an unauthenticated user.
[0109] It should be noted that in the above embodiments, both the first user intent and the second user intent belong to user intent. A user intent can be the type of user instruction obtained by the electronic device 100 from the first input content. It should also be noted that the electronic device 100 can identify the user intent based on the first input content using an algorithmic model. The algorithmic model used to identify the user intent based on the first input content can be a neural network model, which can be trained using a first training set with a confidence level higher than a specific confidence value, such as 90%. The first training set includes a large number of training samples, one of which can include an input and its corresponding output sample. The input can include the first input content, and the output sample can be the user intent. This user intent is typically extracted from the first input content and is recognized by the language domain. Therefore, it is generally reliable and can be used to train the neural network.
[0110] Specifically, if the first input content includes a phone number and a name, the electronic device 100 can save the phone number and name to an address book, where an address book is an application for managing contact information; if the first input content includes schedule information, the electronic device 100 can save the schedule information to a calendar, where a calendar is an application for managing personal time, scheduling appointments, and reminding of important events; if the first input content includes event information, the electronic device 100 can save the event information to a memo, where a memo is an application for managing important information and to-do items. In some embodiments, if the first input content includes a phone number and a name, the electronic device 100 can identify the user's intent as an intent to save the phone number based on the first input content and save the phone number and name to the address book. Exemplarily, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display an address book user interface (e.g., ...). Figure 3G The user interface 360 shown); after receiving the first input content based on stylus input or other means (e.g., by finger or other tools), the electronic device 100 can display a contact list user interface (e.g., with the phone number and name added from the first input content) that has been added. Figure 3H The user interface 370 shown is illustrated. In some embodiments, if the first input content includes schedule information, the electronic device 100 can recognize the user's intent as an intent to save the schedule based on the first input content and save the schedule information to the calendar. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 may display a calendar user interface (such as...). Figure 4F The user interface 440 shown); after receiving the first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a calendar user interface (e.g., with the schedule information from the first input content added) Figure 4G The user interface 450 shown is described. In some embodiments, if the first input content includes event information, the electronic device 100 can identify the user's intent as an intent to save the event based on the first input content and save the event information to the memo. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 may display the memo user interface (e.g., ...). Figure 5G The user interface 560 shown); after receiving first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a memo user interface (e.g., with added event information from the first input content) Figure 5H The user interface shown is 570.
[0111] In the above embodiments, the permissions of an authenticated user include, but are not limited to: the permission for the electronic device 100 to display first input content entered by the authenticated user using a stylus or other means (e.g., via a finger or other tool) on the second user interface; and the permission for the electronic device 100 to identify the user's intent based on the first input content and perform corresponding operations according to the user's intent. The permissions of an unauthenticated user include, but are not limited to: the permission for the electronic device 100 to display first input content entered by the unauthenticated user using a stylus or other means (e.g., via a finger or other tool) on the second user interface. It is understood that authenticated users have more permissions than unauthenticated users.
[0112] In some embodiments, the electronic device 100 may be equipped with a handwriting recognition control and an image recognition control. The handwriting recognition control can be used to manage a service for user identification based on the handwritten handwriting of the first input content, and the image recognition control can be used to manage a service for user identification based on an image captured by a front-facing camera. If both the handwriting recognition control and the image recognition control are enabled, the electronic device 100 can perform user identification based solely on the handwritten handwriting of the first input content. If both the image recognition control and the handwriting recognition control are enabled, the electronic device 100 can perform user identification based solely on the image captured by the front-facing camera. If both the handwriting recognition control and the image recognition control are disabled, the electronic device 100 may not perform user identification.
[0113] Optionally, after receiving first input content based on stylus input or other means (e.g., by finger or other tools), and detecting a movement operation acting on the first input content, the electronic device 100 can change the position of the first input content on the touch screen.
[0114] It should be noted that after receiving the first input content based on stylus input or other methods (such as through a finger or other tool), if the operation of saving the first input content is detected, the electronic device 100 can exit the writing state and stop receiving input from the stylus or other methods (such as through a finger or other tool).
[0115] In some embodiments, the electronic device 100 may have one or more authenticated users. When the electronic device 100 has multiple authenticated users, if the electronic device 100 does not detect the operation of authenticated user A saving the first input content (i.e., the electronic device 100 is still in a writing state), and authenticated user B inputs on the touchscreen of the electronic device 100 using a stylus or other means (e.g., using a finger or other tool), then the electronic device 100 cannot perform the corresponding operation based on the input content of authenticated user B.
[0116] In some embodiments, the first user interface is a lock screen. If user identification is successful (i.e., the user who inputs the first input content via a stylus or other means (e.g., via a finger or other tool) is an authenticated user), the electronic device 100 can also unlock the touchscreen after exiting the writing state.
[0117] S104, Electronic device 100 displays the first input content on the second user interface.
[0118] In this embodiment of the application, the electronic device 100 can display the first input content on a second user interface, which can be a lock screen or a desktop.
[0119] In some embodiments, the electronic device 100 may display all of the received first input content on a second user interface. Optionally, if the first input content occupies more than a preset threshold (e.g., two-thirds) on the touchscreen, i.e., if the first input content is large, for the sake of aesthetics, the electronic device 100 may display only a portion of the first input content on the second user interface. This portion may be, for example, the first two-thirds of the first input content, or for example, the last two-thirds of the first input content. This embodiment does not limit the position range of the portion of the first input content displayed by the electronic device 100 on the second user interface.
[0120] In some embodiments, the display format of the first input content on the second user interface may be exactly the same as the display format of the first input content on the user interface receiving the first input content. That is, the handwritten handwriting of the first input content displayed on the second user interface is exactly the same as the handwritten handwriting of the first input content received by the electronic device 100 on the user interface receiving the first input content. Before displaying the first input content on the second user interface, the electronic device 100 does not perform any conversion on the display format of the first input content. Optionally, before displaying the first input content on the second user interface, the electronic device 100 may perform one or more conversions on the display format of the first input content, such as font, font size, font color, font weight, font italics, and text effects. For example, the first input content may be displayed as black handwriting on the user interface receiving the first input content, and the first input content may be displayed on the second user interface as follows: the font is KaiTi, the font size is 5, and the font color is blue. Before displaying the first input content on the second user interface, the electronic device 100 performs font, font size, and font color conversions on the first input content.
[0121] In some embodiments, the electronic device 100 can determine a second user interface for displaying the first input content based on the user's identity. For example, if the user is an unauthenticated user, the second user interface can be a lock screen. The electronic device 100 can display the first input content entered by the unauthenticated user using a stylus or other methods (e.g., via finger or other tools) on the lock screen to leave a message for the main user, who is an authenticated user. For instance, when the main user is briefly away, if a colleague (an unauthenticated user) needs to contact the main user, the unauthenticated user can leave a message on the electronic device 100 using a stylus. These messages can be displayed on the lock screen for the main user to read upon returning. For example, if the user is an authenticated user, the second user interface can be a lock screen or a desktop. The electronic device 100 can display the first input content entered by the authenticated user using a stylus or other methods (e.g., via finger or other tools) on the lock screen or desktop. For example, a certified user can use a stylus to record important information on the non-lock screen, but this information is private and the certified user doesn't want it displayed on the lock screen. In this case, the important information recorded by the certified user can be displayed only on the desktop for later review. As another example, a certified user can use a stylus to record some public notes on the electronic device 100, and the user wants to access these notes from as many places as possible. In this case, the notes recorded by the certified user can be displayed on either the desktop or the lock screen for easy access later. Yet another example is that a certified user can use a stylus to create a screensaver on the electronic device 100. In this case, the screensaver created by the certified user can be displayed on the lock screen for an aesthetically pleasing visual effect.
[0122] In some embodiments, the first user interface may be the user interface of a first application. Specifically, the electronic device 100 may display the first input content on the second user interface in conjunction with the information displayed by the first application on the first user interface. It should be noted that the information displayed by the first application on the first user interface may refer to content included on the user interface of the first application that can showcase the characteristics of the application. For example, the information displayed by a music application on the first user interface may be song information, which may include, but is not limited to, song title, artist name, and album information. As another example, the information displayed by a conferencing application on the first user interface may be conferencing information, which may include, but is not limited to, conferencing name and conferencing time. Exemplarily, if the first application is a music application, the electronic device 100 may display the first input content on the second user interface in conjunction with the song information of the music application on the first user interface. If the first application is a conferencing application, the electronic device 100 may display the first input content on the second user interface in conjunction with the conferencing information of the conferencing application on the first user interface.
[0123] In some embodiments, the electronic device 100 may re-display the second user interface, wherein the re-displayed second user interface does not include the first input content. Specifically, re-displaying the second user interface may include one or more of the following: re-displaying the second user interface after the electronic device 100 restarts, re-displaying the second user interface after the electronic device 100 unlocks the touchscreen, or re-displaying the second user interface after receiving a first user operation, wherein the first user operation can be used to clear the first input content. It should be noted that re-displaying the second user interface is relative to the initial display of the second user interface, which includes the first input content. After the electronic device 100 satisfies one or more of the conditions of restarting, unlocking the touchscreen, or receiving a first user operation, the re-displayed second user interface does not include the first input content. It should be noted that the first user operation can act on the first user interface, or on the second user interface, or on both the second and first user interfaces; this application embodiment does not limit this. Wherein, if the first user operation acts on the first user interface, neither the re-displayed first user interface nor the re-displayed second user interface after receiving the first user operation includes the first input content. If the first user operation is applied to the second user interface, and the second user interface differs from the first user interface, the second user interface displayed again after receiving the first user operation will not include the first input content, while the first user interface may include the first input content. If the first user operation is applied to both the second and first user interfaces, neither the second nor the first user interface displayed again after receiving the first user operation will include the first input content. It should be noted that the re-display of the first user interface is relative to the initial display of the first user interface, which includes the first input content. After the electronic device 100 receives the first user operation, the re-displayed first user interface will not include the first input content. If the first user interface has not received any first user operation, the electronic device 100 may automatically clear the first input content that has remained on the user interface where the first input content was received for more than a preset time (e.g., 24 hours).
[0124] Taking the lock screen interface as an example as the second user interface, the following describes a series of graphical user interfaces provided by the embodiments of this application.
[0125] In some embodiments, such as Figures 3A-3H As shown, the electronic device 100 can display a first user interface (e.g., on a touchscreen) Figure 3AThe user interface 310 shown can be a lock screen, a desktop, or the user interface of a first application. Before receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state, which can be used for the electronic device 100 to receive first input content based on stylus input or other methods (e.g., via finger or other tools). Optionally, the electronic device 100 entering the writing state may include: the electronic device 100 displaying a touchpad (e.g., on the first user interface). Figure 3B The touchpad 321 in the user interface 320 shown can be a valid input area for input via a stylus, finger, or other tool touching a touchscreen. The electronic device 100 can then receive first input content (e.g., input via stylus or other means, such as a finger or other tool) based on stylus input or other methods. Figure 3C The text 332 in the user interface 330 shown. Optionally, after receiving first input content based on stylus input or other means (e.g., by finger or other tools), and detecting a movement operation acting on the first input content, the electronic device 100 can change the position of the first input content on the touchscreen (e.g., display). Figure 3D The user interface 340 shown. After receiving the first input content based on stylus input or other means (e.g., via finger or other tools), an operation to save the first input content is detected (e.g., a click is detected). Figure 3E By operating the controls 342 in the user interface 340 shown, the electronic device 100 can exit the writing state and stop receiving stylus input. Then, the electronic device 100 can display the first input content (e.g., displaying...) on the second user interface. Figure 3F The user interface 350 shown is used. When the user is an authenticated user, the electronic device 100 can recognize the user's intent based on the first input content and perform corresponding operations accordingly. If the first input content includes a phone number or a name, the electronic device 100 can recognize the user's intent as wanting to save the phone number and save the phone number and name to the address book. For example, before receiving the first input content based on a stylus or other means (e.g., via a finger or other tool), the electronic device 100 can display the address book user interface (e.g., ...). Figure 3G The user interface 360 shown); after receiving the first input content based on stylus input or other means (e.g., by finger or other tools), the electronic device 100 can display a contact list user interface (e.g., with the phone number and name added from the first input content) that has been added. Figure 3H The user interface shown is 370.
[0126] For example, such as Figure 3A As shown, the electronic device 100 can display a user interface 310 (first user interface), which is a lock screen interface. In some embodiments, the electronic device 100 can receive an operation that triggers entry into a writing state (e.g., detecting an operation of touching the touchscreen for more than a first duration (e.g., 1 second) with a stylus or finger or other tool, detecting a multi-finger (e.g., eight-finger) touchscreen operation, etc.). In response to this operation, the electronic device 100 can enter the writing state and display, as shown in the image. Figure 3B The user interface 320 shown.
[0127] For example, such as Figure 3B As shown, the electronic device 100 can display a user interface 320, which may include a touchpad (e.g., touchpad 321) and a keyboard. The touchpad can be used to receive first input content based on stylus input or other methods (e.g., input via a finger or other tool), where the touchpad is within the valid input range of the touchscreen. The touchpad may include a save control (e.g., control 322) to save the first input content and trigger the electronic device 100 to exit the writing state. The keyboard can be used to input an unlock password or a lock screen question; the electronic device 100 can only unlock when the user's answer to the lock screen question matches a preset answer.
[0128] In some embodiments, after entering a writing state, the electronic device 100 can receive first input content based on stylus input or other methods (e.g., via finger or other tools), and display it as shown in the image. Figure 3C The user interface 330 shown.
[0129] For example, such as Figure 3C As shown, the electronic device 100 can display a user interface 330, which may include a touchpad (e.g., touchpad 331). The touchpad can be used to receive first input content based on stylus input or other methods (e.g., via finger or other tools), the touchpad being within the valid input range for input via a stylus pen, finger, or other tool touching the touchscreen. The touchpad may include the first input content (e.g., text 332) based on stylus input or other methods (e.g., via finger or other tools), the first input content including a phone number or name; for example, text 332 is "David 123456789".
[0130] "123456789" is a phone number, and "David" is a person's name.
[0131] In some embodiments, upon detecting a movement operation applied to the first input content, the electronic device 100 can change the position of the first input content on the touchscreen and display, as shown below. Figure 3D The user interface 340 shown.
[0132] For example, such as Figure 3D As shown, the electronic device 100 can display a user interface 340, which may include first input content (e.g., text 341) whose position is changed from the touchpad. Figure 3E As shown, the user interface 340 may also include a save control (e.g., control 342) which can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0133] In some embodiments, upon detecting an operation to save the first input content (e.g., detecting an operation to click control 342), the electronic device 100 can exit the writing state, stop receiving handwriting input, and display the first input content on a second user interface (e.g., display...). Figure 3F The user interface shown is 350.
[0134] For example, such as Figure 3F As shown, the electronic device 100 can display a user interface 350, which can include first input content (e.g., text 351), including a phone number and a person's name. For example, text 351 is "David 123456789", where "123456789" is a phone number and "David" is a person's name.
[0135] In some embodiments, when the user is an authenticated user, the electronic device 100 can identify the user's intent based on the first input content and perform corresponding operations accordingly. If the first input content includes a phone number or a name, the electronic device 100 can identify the user's intent as saving the phone number and save the phone number or name to the address book. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display an address book user interface (such as...). Figure 3G The user interface 360 shown); after receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display a contact list user interface that includes the phone number and name from the first input content, for example, Figure 3H The user interface 370 shown has added a contact named David and his phone number.
[0136] In some embodiments, such as Figures 4A-4GAs shown, the electronic device 100 can display a first user interface (e.g., on a touchscreen) Figure 4A The user interface 310 shown can be a lock screen, desktop, or the user interface of a first application. Before receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state, which can be used for the electronic device 100 to receive first input content based on stylus input or other methods (e.g., via finger or other tools). Optionally, the electronic device 100 entering the writing state may include: the electronic device 100 not displaying a touchpad on the first user interface (e.g., displaying...). Figure 4B The user interface 410 shown. Then, the electronic device 100 can receive first input content (e.g., input based on a stylus or other means, such as by a finger or other tool). Figure 4C The text 421 in the user interface 420 shown. After receiving the first input content based on stylus input or other means (e.g., by finger or other tools), an operation to save the first input content (e.g., a click is detected) is detected. Figure 4D By operating the controls 422 in the user interface 420 shown, the electronic device 100 can exit the writing state and stop receiving stylus input. Then, the electronic device 100 can display the first input content (e.g., displaying...) on the second user interface. Figure 4E The user interface 430 shown is used. When the user is an authenticated user, the electronic device 100 can recognize the user's intent based on the first input content and perform corresponding operations accordingly. If the first input content includes schedule information, the electronic device 100 can recognize the user's intent as an intention to save the schedule and save the schedule information to the calendar. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display a calendar user interface (such as...). Figure 4F The user interface 440 shown); after receiving the first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a calendar user interface (e.g., with the schedule information from the first input content added) Figure 4G The user interface shown is 450.
[0137] For example, such as Figure 4AAs shown, the electronic device 100 can display a user interface 310 (first user interface), which is a lock screen interface. In some embodiments, the electronic device 100 can receive an operation that triggers entry into a writing state (e.g., detecting an operation of touching the touchscreen for more than a first duration (e.g., 1 second) with a stylus or finger or other tool, detecting a multi-finger (e.g., eight-finger) touchscreen operation, etc.). In response to this operation, the electronic device 100 can enter the writing state and display, as shown in the image. Figure 4B The user interface 410 shown.
[0138] For example, such as Figure 4B As shown, the electronic device 100 can display a user interface 410, which may include a save control (e.g., control 411) that can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0139] In some embodiments, after entering a writing state, the electronic device 100 can receive first input content based on stylus input or other methods (e.g., via finger or other tools), and display it as shown in the image. Figure 4C The user interface shown is 420.
[0140] For example, such as Figure 4C As shown, the electronic device 100 can display a user interface 420, which can include first input content (e.g., text 421) input based on a stylus or other means (e.g., via a finger or other tool). This first input content includes schedule information; for example, text 421 could be "Repay 1000 yuan to Bank C in 5 days," where "Repay 1000 yuan to Bank C in 5 days" is schedule information. Figure 4D As shown, the user interface 420 may also include a save control (e.g., control 422) which can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0141] In some embodiments, upon detecting an operation to save the first input content (e.g., detecting an operation to click control 422), the electronic device 100 can exit the writing state, stop receiving handwriting input, and display the first input content on a second user interface (e.g., display...). Figure 4E The user interface shown is 430.
[0142] For example, such as Figure 4E As shown, the electronic device 100 can display a user interface 430, which can include first input content (e.g., text 431), which includes schedule information. For example, text 431 is “repay 1,000 yuan to bank C in 5 days”, where “repay 1,000 yuan to bank C in 5 days” is schedule information.
[0143] In some embodiments, when the user is an authenticated user, the electronic device 100 can identify the user's intent based on the first input content and perform corresponding operations accordingly. If the first input content includes schedule information, the electronic device 100 can identify the user's intent as an intention to save the schedule based on the first input content and save the schedule information to the calendar. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display a calendar user interface (such as...). Figure 4F The user interface 440 shown; after receiving first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a calendar user interface with the schedule information from the first input content added, for example, Figure 4G The user interface 450 shown has been updated with a schedule for repaying 1,000 yuan to bank C in 5 days.
[0144] In some embodiments, such as Figures 5A-5H As shown, the electronic device 100 can display a first user interface (e.g., on a touchscreen) Figure 5A The user interface 510 shown can be a lock screen, a desktop, or the user interface of a first application. Before receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state, which can be used for the electronic device 100 to receive first input content based on stylus input or other methods (e.g., via finger or other tools). Optionally, the electronic device 100 entering the writing state may include: the electronic device 100 displaying a touchpad (e.g., on the first user interface). Figure 5B The touchpad 521 in the user interface 520 shown can be a valid input area for input via a stylus, finger, or other tool touching a touchscreen. The electronic device 100 can then receive first input content (e.g., input via stylus or other means, such as a finger or other tool) based on stylus input or other input methods. Figure 5C The text 532 in the user interface 530 shown. After receiving the first input content based on stylus input or other means (e.g., by finger or other tools), an operation to save the first input content (e.g., a click is detected) is detected. Figure 5D By operating the controls 533 in the user interface 530 shown, the electronic device 100 can exit the writing state and stop receiving stylus input. Then, the electronic device 100 can display the first input content on the first user interface (e.g., displaying...). Figure 5EThe user interface 540 shown, and the first input content displayed on the second user interface (e.g., displaying...) Figure 5F The user interface 550 shown is used. When the user is an authenticated user, the electronic device 100 can recognize the user's intent based on the first input content and perform corresponding operations accordingly. If the first input content includes event information, the electronic device 100 can recognize the user's intent as an intention to save the event based on the first input content and save the event information to a memo. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display a memo user interface (such as...). Figure 5G The user interface 560 shown); after receiving first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a memo user interface (e.g., with added event information from the first input content) Figure 5H The user interface shown is 570.
[0145] For example, such as Figure 5A As shown, the electronic device 100 can display a user interface 510 (first user interface), which is a desktop. Optionally, the user interface 510 may include, but is not limited to, the current date, time, and weather. Below the current date, time, and weather, one or more application icons (e.g., contact app icon, calendar app icon, memo app icon, music app icon, meeting app icon, settings app icon, etc.) may also be included. Below one or more application icons and folder icons, a page indicator is also included, which is used to indicate the positional relationship between the currently displayed page and other pages. Optionally, multiple tray icons (e.g., dialer app icon, messaging app icon, browser app icon, camera app icon, etc.) are displayed below the page indicator, and the tray icons may remain displayed when switching pages. In some embodiments, the page indicator may not be part of the page and may exist independently; this embodiment does not limit this.
[0146] In some embodiments, the electronic device 100 may receive an operation that triggers entry into a writing state (e.g., detecting an operation that touches the touchscreen for more than a first duration (e.g., 1 second) using a stylus, finger, or other tool, detecting a multi-finger (e.g., eight-finger) touchscreen operation, etc.). In response to this operation, the electronic device 100 may enter a writing state and display, as shown in the image. Figure 5B The user interface shown is 520.
[0147] For example, such as Figure 5BAs shown, the electronic device 100 can display a user interface 520, which may include a touchpad (e.g., touchpad 521) displayed below the tray icon (bottom of the touchscreen). The touchpad can be used to receive first input content based on stylus input or other methods (e.g., via finger or other tools), where the touchpad is within the valid input range of the touchscreen touched by a stylus, finger, or other tool. The touchpad may include a save control (e.g., control 522) for saving the first input content and triggering the electronic device 100 to exit the writing state.
[0148] In some embodiments, after entering a writing state, the electronic device 100 can receive first input content based on stylus input or other methods (e.g., via finger or other tools), and display it as shown in the image. Figure 5C The user interface shown is 530.
[0149] For example, such as Figure 5C As shown, the electronic device 100 can display a user interface 530, which may include a touchpad (e.g., touchpad 531). The touchpad can be used to receive first input content based on stylus input or other methods (e.g., via finger or other tools), the touchpad being a valid input range for input via a stylus pen, finger, or other tool touching a touchscreen. The touchpad may include the first input content (e.g., text 532) based on stylus input or other methods (e.g., via finger or other tools), the first input content including event information, for example, text 532 is "Buy a birthday present for Mom", where "Buy a birthday present for Mom" is event information. Figure 5D As shown, the user interface 530 may also include a save control (e.g., control 533) which can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0150] In some embodiments, upon detecting an operation to save the first input content (e.g., detecting an operation to click control 533), the electronic device 100 can exit the writing state, stop receiving handwriting input, and display the first input content on the first user interface (e.g., display...). Figure 5E The user interface 540 shown, and the first input content displayed on the second user interface (e.g., displaying...) Figure 5F The user interface shown is 550.
[0151] For example, such as Figure 5EAs shown, the electronic device 100 can display a user interface 540, which can include first input content (e.g., text 541), the first input content including event information, for example, text 541 is "Buy a birthday present for mom", where "Buy a birthday present for mom" is event information. Figure 5F As shown, the electronic device 100 can display a user interface 550, which can include first input content (e.g., text 551), the first input content including event information, for example, text 551 is "buy a birthday present for mom", where "buy a birthday present for mom" is event information.
[0152] In some embodiments, when the user is an authenticated user, the electronic device 100 can identify the user's intent based on the first input content and perform a corresponding operation based on the user's intent. If the first input content includes event information, the electronic device 100 can identify the user's intent as an intention to save the event based on the first input content and save the event information to a memo. For example, before receiving the first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can display a memo user interface (such as...). Figure 5G The user interface 560 shown); after receiving first input content based on stylus input or other means (e.g., via finger or other tools), the electronic device 100 can display a memo user interface with added event information from the first input content, for example, Figure 5H The user interface 570 shown here has been updated with event information about buying a birthday gift for mom.
[0153] In some embodiments, such as Figures 6A-6F As shown, the electronic device 100 can display a first user interface (e.g., on a touchscreen) Figure 6A The user interface 610 shown can be a lock screen, a desktop, or the user interface of a first application. Before receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state, which can be used for the electronic device 100 to receive first input content based on stylus input or other methods (e.g., via finger or other tools). Optionally, the electronic device 100 entering the writing state may include: the electronic device 100 displaying a touchpad (e.g., on the first user interface). Figure 6B The touchpad 621 in the user interface 620 shown can be a valid input area for input via a stylus, finger, or other tool touching a touchscreen. The electronic device 100 can then receive first input content (e.g., input via stylus or other means, such as a finger or other tool) on the first user interface. Figure 6C The text 632 in the user interface 630 shown. After receiving the first input content based on stylus input or other means (e.g., by finger or other tools), an operation to save the first input content (e.g., a click is detected) is detected. Figure 6D By operating the controls 633 in the user interface 630 shown, the electronic device 100 can exit the writing state and stop receiving stylus input. Then, the electronic device 100 can display the first input content on the first user interface (e.g., displaying...). Figure 6E The user interface 640 shown is also available. The electronic device 100 can also display first input content (e.g., displaying information from the first application displayed on the first user interface) on the second user interface, in conjunction with the information displayed on the first user interface by the first application. Figure 6F (See user interface 650 shown). For example, if the first application is a music application, the electronic device 100 can display the first input content on the second user interface in conjunction with the song information of the music application on the first user interface.
[0154] For example, such as Figure 6A As shown, the electronic device 100 can display a user interface 610 (first user interface), which is the user interface of a first application (e.g., a music application). The user interface 610 can include display information of the first application. For example, the display information of the music application is song information, which may include, but is not limited to, song name, artist name, and album information.
[0155] In some embodiments, the electronic device 100 may receive an operation that triggers entry into a writing state (e.g., detecting an operation that touches the touchscreen for more than a first duration (e.g., 1 second) using a stylus, finger, or other tool, detecting a multi-finger (e.g., eight-finger) touchscreen operation, etc.). In response to this operation, the electronic device 100 may enter a writing state and display, as shown in the image. Figure 6B The user interface 620 shown is shown.
[0156] For example, such as Figure 6B As shown, the electronic device 100 can display a user interface 620, which may include a touchpad (e.g., touchpad 621) displayed at the bottom of the touchscreen. The touchpad can be used to receive first input content based on stylus input or other methods (e.g., input via a finger or other tool), where the touchpad is within the valid input range achieved by touching the touchscreen with a stylus, finger, or other tool. The touchpad may include a save control (e.g., control 622) for saving the first input content and triggering the electronic device 100 to exit the writing state.
[0157] In some embodiments, after entering a writing state, the electronic device 100 can receive first input content based on stylus input or other methods (e.g., via finger or other tools), and display it as shown in the image. Figure 6C The user interface 630 shown.
[0158] For example, such as Figure 6C As shown, the electronic device 100 can display a user interface 630, which may include a touchpad (e.g., touchpad 631). The touchpad can be used to receive first input content based on stylus input or other methods (e.g., via finger or other tools), where the touchpad is within the legal input range for input via a stylus, finger, or other tool touching the touchscreen. The touchpad may include the first input content (e.g., text 632) based on stylus input or other methods (e.g., via finger or other tools), which may be, for example, lyrics handwritten by the user. This embodiment of the application does not limit the first input content input by the user based on stylus input or other methods (e.g., via finger or other tools). Figure 6D As shown, the user interface 630 may also include a save control (e.g., control 633) which can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0159] In some embodiments, upon detecting an operation to save the first input content (e.g., detecting an operation to click control 633), the electronic device 100 can exit the writing state, stop receiving handwriting input, and display the first input content on the first user interface (e.g., display...). Figure 6E The user interface shown is 640.
[0160] For example, such as Figure 6E As shown, the electronic device 100 can display a user interface 640, which can include first input content (e.g., text 641). The first input content can be, for example, lyrics handwritten by the user. This application embodiment does not limit the first input content input by the user based on a stylus or other means (e.g., by finger or other tools).
[0161] The electronic device 100 can also display the first input content (e.g., displaying information from the first application displayed on the first user interface) on the second user interface in conjunction with the information displayed on the first user interface by the first application. Figure 6F (See user interface 650 shown). For example, if the first application is a music application, the electronic device 100 can display the first input content on the second user interface in conjunction with the song information of the music application on the first user interface.
[0162] For example, such as Figure 6FAs shown, the electronic device 100 can display a user interface 650, which may include first input content (e.g., text 651). This first input content may be, for example, lyrics handwritten by the user. This embodiment does not limit the first input content input by the user using a stylus or other methods (e.g., via finger or other tools). Furthermore, the user interface 650 may also include display information for a first application (e.g., display information 652). For example, display information 652 may be song information, which may include, but is not limited to, song title, artist name, and album information.
[0163] In some embodiments, such as Figures 7A-7F As shown, the electronic device 100 can display a first user interface (e.g., on a touchscreen) Figure 7A The user interface 710 shown can be a lock screen, a desktop, or the user interface of a first application. Before receiving first input content based on stylus input or other methods (e.g., via finger or other tools), the electronic device 100 can enter a writing state, which can be used for the electronic device 100 to receive first input content based on stylus input or other methods (e.g., via finger or other tools). Optionally, the electronic device 100 entering the writing state may include: the electronic device 100 not displaying a touchpad on the first user interface (e.g., ...). Figure 7B The user interface 720 shown. Then, the electronic device 100 can receive first input content (e.g., input based on a stylus or other means, such as by a finger or other tool). Figure 7C The text 731 in the user interface 730 shown. After receiving the first input content based on stylus input or other means (e.g., by finger or other tools), an operation to save the first input content (e.g., a click is detected) is detected. Figure 7D By operating the controls 732 in the user interface 730 shown, the electronic device 100 can exit the writing state and stop receiving stylus input. Then, the electronic device 100 can display the first input content on the first user interface (e.g., displaying...). Figure 7E The user interface 740 shown is illustrated. The electronic device 100 can also display first input content (e.g., displaying information from the first application displayed on the first user interface) on the second user interface, in conjunction with the information displayed on the first user interface by the first application. Figure 7F (See user interface 750 shown). For example, if the first application is a conferencing application, the electronic device 100 can display the first input content on the second user interface in conjunction with the conferencing information on the first user interface from the conferencing application.
[0164] For example, such as Figure 7AAs shown, the electronic device 100 can display a user interface 710 (first user interface), which is the user interface of a first application (e.g., a conferencing application). The user interface 710 can include display information of the first application. For example, the display information of the conferencing application is conferencing information, which may include, but is not limited to, conferencing name and conferencing time.
[0165] In some embodiments, the electronic device 100 may receive an operation that triggers entry into a writing state (e.g., detecting an operation that touches the touchscreen for more than a first duration (e.g., 1 second) using a stylus, finger, or other tool, detecting a multi-finger (e.g., eight-finger) touchscreen operation, etc.). In response to this operation, the electronic device 100 may enter a writing state and display, as shown in the image. Figure 7B The user interface shown is 720.
[0166] For example, such as Figure 7B As shown, the electronic device 100 can display a user interface 720, which may include a save control (e.g., control 721) that can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0167] In some embodiments, after entering a writing state, the electronic device 100 can receive first input content based on stylus input or other methods (e.g., via finger or other tools), and display it as shown in the image. Figure 7C The user interface shown is 730.
[0168] For example, such as Figure 7C As shown, the electronic device 100 can display a user interface 730, which may include first input content (e.g., text 731) input based on a stylus or other means (e.g., via a finger or other tool). This first input content may, for example, be a handwritten meeting note. This embodiment of the application does not limit the first input content input by the user based on a stylus or other means (e.g., via a finger or other tool). Figure 7D As shown, the user interface 730 may also include a save control (e.g., control 732) which can be used to save the first input content and trigger the electronic device 100 to exit the writing state.
[0169] In some embodiments, upon detecting an operation to save the first input content (e.g., detecting an operation to click control 732), the electronic device 100 can exit the writing state, stop receiving handwriting input, and display the first input content on the first user interface (e.g., display...). Figure 7E The user interface shown is 740.
[0170] For example, such as Figure 7EAs shown, the electronic device 100 can display a user interface 740, which may include first input content (e.g., text 741). The first input content may be, for example, a meeting note written by the user. This application embodiment does not limit the first input content entered by the user based on a stylus or other means (e.g., by a finger or other tools).
[0171] The electronic device 100 can also display the first input content (e.g., displaying information from the first application displayed on the first user interface) on the second user interface in conjunction with the information displayed on the first user interface by the first application. Figure 7F (See user interface 750 shown). For example, if the first application is a conferencing application, the electronic device 100 can display the first input content on the second user interface in conjunction with the conferencing information on the first user interface from the conferencing application.
[0172] For example, such as Figure 7F As shown, the electronic device 100 can display a user interface 750, which may include first input content (e.g., text 751). This first input content may be, for example, handwritten meeting notes by the user. This embodiment does not limit the first input content input by the user using a stylus or other methods (e.g., via finger or other tools). Furthermore, the user interface 750 may also include display information for a first application (e.g., display information 752). For example, display information 752 may be meeting information, which may include, but is not limited to, the meeting name and meeting time.
[0173] This application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement the steps performed by the electronic device in the above method embodiments, or the steps performed by the human-computer interaction module and the computing module.
[0174] This application also provides a computer program product that, when run on a terminal device, enables the terminal device to perform the steps executed by the electronic device in the above method embodiments.
[0175] This application also provides a chip system, which includes a processor coupled to a memory. The processor executes a computer program stored in the memory to implement the steps performed by the electronic device in any of the method embodiments of this application. The chip system can be a single chip or a chip module composed of multiple chips.
[0176] The term "user interface (UI)," or simply "interface," used in the specification and accompanying drawings of this application, refers to the medium through which an application or operating system interacts and exchanges information with the user. It facilitates the conversion between the internal form of information and a form acceptable to the user. The user interface of an application is written in source code using specific computer languages such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on the terminal device, ultimately presenting user-recognizable content, such as images, text, and buttons. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined using tags or nodes, such as XML tags. <textview> 、 <imgview> 、 <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a web page is also defined through tags or nodes in the web page source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>Used to define the elements and attributes of a webpage.
[0177] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0178] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
[0179] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0180] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is detected" can be interpreted as meaning "if determining..." or "in response to determining..." or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)".
[0181] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.
[0182] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.< / canvas> < / video> < / videoview> < / imgview> < / textview>
Claims
1. An input method applied to a first electronic device, characterized in that, The first electronic device includes a touchscreen, and the method includes: A first user interface is displayed on the touchscreen, which may be a lock screen, a desktop, or the user interface of a first application. Receive the first input content; The first input content is displayed on a second user interface, which is either the lock screen or the desktop.
2. The method according to claim 1, characterized in that, The first input content is the content entered by touching the touch screen with a stylus, finger, or other tool, and the content includes handwriting and / or patterns.
3. The method according to claim 2, characterized in that, The method further includes: Recognize the handwriting of the first input content; Determine whether the handwriting of the first input content matches the preset handwriting. If so, the user identity is verified and the corresponding operation is performed based on the first input content.
4. The method according to claim 3, characterized in that, The step of performing the corresponding operation based on the first input content specifically includes one or more of the following: If the first input content includes a phone number and a person's name, then the phone number and the person's name are saved to the address book; If the first input content includes schedule information, then the schedule information is saved to the calendar; If the first input includes event information, then the event information is saved to the memo.
5. The method according to any one of claims 1-4, characterized in that, The first electronic device includes a front-facing camera, and the method further includes: Upon receiving the first input content, the front-facing camera is activated, and the image captured by the front-facing camera is used for user identification. If the user's identity is verified, the corresponding operation will be performed based on the first input.
6. The method according to any one of claims 3-5, characterized in that, The first user interface is the lock screen interface, and the method further includes: If the user's identity is verified, the touchscreen will also be unlocked.
7. The method according to any one of claims 2-6, characterized in that, Before receiving the first input content, the method further includes: A touchpad is displayed on the first user interface, and the touchpad is within the legal input range for input by touching the touchscreen with the stylus, finger, or other tools.
8. The method according to claim 7, characterized in that, The trigger conditions for displaying the touchpad on the first user interface include one or more of the following: The system detects that the touchscreen has been touched for more than a first duration by the stylus, finger, or other tool, or detects multiple-finger touches on the touchscreen.
9. The method according to any one of claims 1-8, characterized in that, The first user interface is the user interface of the first application, and displaying the first input content on the second user interface specifically includes: The first input content is displayed on the second user interface in conjunction with the information displayed by the first application on the first user interface.
10. The method according to claim 9, characterized in that, The step of displaying the first input content on the second user interface in conjunction with the display information of the first application on the first user interface specifically includes one or more of the following: If the first application is a music application, then the first input content is displayed on the second user interface in conjunction with the song information of the music application on the first user interface. The song information includes the song name, artist name, and album information. If the first application is a conferencing application, then the first input content is displayed on the second user interface in conjunction with the conferencing information of the conferencing application on the first user interface. The conferencing information includes the conferencing name and the conferencing time.
11. The method according to any one of claims 1-10, characterized in that, The method further includes: The second user interface is displayed again, wherein the second user interface displayed again does not include the first input content; The re-display of the second user interface specifically includes one or more of the following: The second user interface is displayed again after the first electronic device restarts, after the first electronic device unlocks the touchscreen, and after the first electronic device receives a first user operation, wherein the first user operation is used to clear the first input content.
12. An electronic device, characterized in that, The electronic device includes a processor and a memory; wherein the memory is coupled to the processor and is used to store a computer program that, when executed by the processor, causes the electronic device to perform the method as described in any one of claims 1-11.
13. A computer storage medium, characterized in that, The computer storage medium stores a computer program that, when executed by a processor, causes the electronic device to perform the method as described in any one of claims 1-11.
14. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it causes the electronic device to perform the method as described in any one of claims 1-11.