Schedule creating method and electronic equipment
By detecting user actions on electronic devices and utilizing technologies such as smart workflow services and screenshots, schedule information can be quickly identified and created, solving the problem of cumbersome existing schedule creation methods and improving efficiency and user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2024-01-10
- Publication Date
- 2026-05-12
Smart Images

Figure CN122018766A_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application filed with the Chinese Patent Office with application number 202410042554.1, entitled "A Schedule Creation Method and Electronic Device". Technical Field
[0002] This application relates to the field of electronic technology, and more particularly to a schedule creation method and an electronic device. Background Technology
[0003] As people's pace of life gradually accelerates, the number of to-do items also increases. A plan or arrangement for a certain time point or time period is called a schedule. Schedule information is received by users' electronic devices through various channels (such as SMS, WeChat and other IM (Instant Messenger) software, office software, email, etc.) and in various forms (such as text, pictures, files, etc.).
[0004] Currently, after receiving schedule information, users usually switch to the schedule management program on their electronic devices, such as Calendar, and manually enter the schedule information to create a schedule corresponding to that information, so that the electronic device can remind the user at the set target time.
[0005] However, due to the complexity and variety of sources of schedule information, the above-mentioned schedule creation methods are cumbersome, have low efficiency, and result in a poor user experience. Summary of the Invention
[0006] This application provides a schedule creation method and electronic device, which can be used to solve the technical problems of existing schedule creation methods being cumbersome, inefficient, and having a poor user experience.
[0007] In a first aspect, this application provides a schedule creation method applied to an electronic device. The method includes: detecting a first operation of dragging a first control into a first area of the screen, the first control corresponding to first data, the first data including first schedule information; in response to the first operation, displaying a first icon of a first application; detecting a second operation of continuing to drag the first control into a second area where the first icon is located and releasing it; and in response to the second operation, displaying a first window of the first application, the first window including second schedule information, the second schedule information corresponding to the first schedule information.
[0008] In this embodiment, after detecting that a user drags a first control into a hot zone (i.e., the aforementioned first area), the electronic device can trigger a smart workflow service, displaying at least one application icon (including the first icon of the aforementioned first application). Upon detecting that the user continues to drag the first control to the second area where the first icon is located and releases it, the pending data (i.e., first data) corresponding to the first control is sent to the first application. The first data includes first schedule information. Then, the first window of the first application is displayed, including second schedule information, which corresponds to the first schedule information. This method, by triggering the smart workflow service, allows for simple and quick selection of the pending data (i.e., the first data) for schedule information recognition, and displays the second schedule information so that the user can create a schedule based on the second schedule information. This convenient operation improves the user experience.
[0009] In conjunction with the first aspect, in one possible implementation, the method further includes: displaying a first interface, the first interface including first schedule information; detecting a screenshot operation while displaying the first interface; and, in response to the screenshot operation, displaying a first control on the first interface, the first data being a screenshot image of the first interface.
[0010] In this embodiment of the application, a screenshot image can be used as the first data. This method can obtain the schedule information displayed on the interface by taking a screenshot, which is convenient to operate and can improve the user experience.
[0011] In conjunction with the first aspect, in one possible implementation, the first control displays a preview of a screenshot of the first interface.
[0012] In conjunction with the first aspect, in one possible implementation, the method further includes: displaying a second interface of a second application, the second interface including a first area, the first area displaying first text information, the first text information including first schedule information; detecting a long press operation on the first area while displaying the second interface; and displaying a first control on the first interface in response to the long press operation on the first area, the first data being the first text information.
[0013] In this embodiment of the application, the first text information on the first area can be selected as the first data by long-pressing. This method can conveniently select the first data to create a schedule, which is easy to operate and can improve the user experience.
[0014] In this application, the long press operation on the first area can also be other user operations on the first area, such as voice commands, clicks, etc., and this application does not limit this.
[0015] In conjunction with the first aspect, in one possible implementation, the method further includes: displaying a third interface of a third application, the third interface including multiple dialog boxes; detecting a long press operation on the third interface while displaying the third interface; and displaying a first control on the third interface in response to the long press operation on the third interface, the first data being the content of the multiple dialog boxes.
[0016] In this embodiment of the application, the method of pressing to recognize the screen can recognize the text in the entire interface (such as the multiple dialog boxes mentioned above), and create a schedule based on the recognized text. This method can conveniently select the text in the entire interface to create a schedule, simplifying the creation steps.
[0017] In this application, the long press operation on the third interface can also be other user operations on the third interface, such as voice commands, clicks, etc., and this application does not limit this.
[0018] In conjunction with the first aspect, in one possible implementation, the method further includes: displaying a fourth interface of a gallery application, the fourth interface including a first image; detecting a long press operation on the first image while displaying the fourth interface; and displaying a first control on the fourth interface in response to the long press operation on the first image, the first data being the first image.
[0019] In this embodiment, the user can long-press to select an image (such as the first image) from local storage (e.g., a gallery application). The electronic device can then recognize the selected image and create a schedule based on it. This method allows for the import of image data from a gallery application into a first application (e.g., the system calendar) to create a schedule through simple user operations, significantly reducing user interaction and improving the user experience.
[0020] In this application, the long press operation on the first image can also be other user operations on the first image, such as voice commands, clicks, etc., and this application does not limit this.
[0021] In conjunction with the first aspect, in one possible implementation, the first schedule information and the second schedule information correspond to the same schedule.
[0022] Optionally, the second schedule information can be obtained based on the first schedule information.
[0023] Optionally, the first schedule information and the second schedule information can be the same or different.
[0024] Optionally, a schedule can be a plan or arrangement for a specific point in time or a period of time.
[0025] In conjunction with the first aspect, in one possible implementation, the first window also includes a second control, and the method further includes: In response to a user action on the second control, a fifth interface of the first application is displayed. The fifth interface includes abbreviated information about the first schedule, which is created by the first application based on the first schedule information.
[0026] In conjunction with the first aspect, in one possible implementation, the first schedule information includes the schedule information of the second schedule and the schedule information of the third schedule; the first window includes a second area and a third area, the second area including the schedule information of the second schedule and the third area including the schedule information of the third schedule.
[0027] Optionally, the schedule information in the first schedule information may be different from the schedule information in the first window, and this application does not limit this.
[0028] In this embodiment of the application, when the data to be processed (i.e., the first data) includes schedule information for multiple schedules, the electronic device can identify the schedule information for multiple schedules in the data to be processed, and then display the schedule information for multiple schedules, such as displaying the identified schedule information for the second schedule and the schedule information for the third schedule in a first window. This method can quickly create multiple schedules without requiring the user to perform multiple creation operations, thereby reducing creation time and improving user experience.
[0029] In conjunction with the first aspect, in one possible implementation, the second region is selected, the first window also includes a second control, and the method further includes: in response to a user action on the second control, displaying a sixth interface of the first application, the sixth interface including abbreviated information of the second schedule.
[0030] This application embodiment allows users to select any schedule from multiple displayed schedule information to create a schedule. This method can meet users' personalized needs and improve user experience.
[0031] In conjunction with the first aspect, in one possible implementation, the second region is selected, the first window also includes a second control, and the method further includes: in response to a user operation on the third region, displaying the third region as selected; in response to a user operation on the second control, displaying a seventh interface of the first application, the seventh interface including abbreviated information of the second schedule and abbreviated information of the third schedule.
[0032] This method allows for the rapid creation of multiple events without requiring users to perform multiple creation operations, thus reducing creation time and improving user experience.
[0033] In conjunction with the first aspect, in one possible implementation, the first data includes first location information, the first window includes second location information, and the first location information is different from the second location information.
[0034] In this embodiment, the electronic device can identify a location from the data to be processed (i.e., the first data), and based on the identified location (i.e., the first location information) and the user's relevant address information, obtain a recommended location (i.e., the second location information); and display the recommended location. This method enables intelligent location recommendation, eliminates the need for users to manually supplement schedule information, simplifies schedule creation time, and improves user experience.
[0035] In conjunction with the first aspect, in one possible implementation, the first data is a first image; the method further includes: displaying the first image and a sharing control; displaying a first icon in response to a user action on the sharing control; and displaying a first window in response to a user action on the first icon.
[0036] In this embodiment of the application, an icon for creating a schedule (such as the first icon) is added to the sharing function, which supports importing image data (such as the first image) from other applications (such as the gallery application) into the application for creating a schedule (such as the first application) to create a schedule. This method greatly reduces user operations and can improve the user experience.
[0037] In conjunction with the first aspect, in one possible implementation, the method further includes: displaying an eighth interface of a fourth application, the eighth interface including first schedule information; while displaying the eighth interface, displaying a third control in response to a user operation performed on the eighth interface; and displaying a first window in response to a user operation performed on the third control.
[0038] In this embodiment of the application, text in the entire interface (such as the eighth interface) can be identified, and a schedule can be created based on the identified text. This method can conveniently select text in the entire interface to create a schedule, simplifying the creation steps.
[0039] In conjunction with the first aspect, in one possible implementation, the first schedule information includes at least one of the schedule topic, time, and location.
[0040] Secondly, this application provides a schedule creation method applied to an electronic device. The method includes: displaying a first interface of a first application, the first interface including calendar information and a first control; responding to a user operation on the first control, displaying a second interface of the first application, the second interface including a first input field and a second control; the first input field being blank; responding to a user operation on the second control, displaying a third interface of the second application, the third interface including a first preview image corresponding to a first image, the first image including first schedule information; responding to an operation on the first preview image, displaying a fourth interface of the first application, the fourth interface including a first input field, the first input field including second schedule information, the second schedule information corresponding to the first schedule information.
[0041] In this embodiment, an import control (i.e., a second control) is added to the schedule creation interface (i.e., the second interface of the first application). Users can select an image (such as the first image) from local storage (such as the second application) using the import control. Correspondingly, the electronic device can recognize the selected image and display the recognized schedule information (such as the aforementioned second schedule information) so that the user can create a schedule based on the recognized schedule information. This method allows for the import of image data from a second application (such as a gallery application) into a first application (such as the system calendar) to create a schedule through simple user operations. This method greatly reduces user operations and improves the user experience.
[0042] In conjunction with the second aspect, in one possible implementation, the first schedule information and the second schedule information correspond to the same schedule.
[0043] Optionally, the second schedule information can be obtained based on the first schedule information.
[0044] Optionally, the first schedule information and the second schedule information can be the same or different.
[0045] Optionally, a schedule can be a plan or arrangement for a specific point in time or a period of time.
[0046] In conjunction with the second aspect, in one possible implementation, the first schedule information is the schedule information corresponding to the first schedule, and the fourth interface also includes a second control. The method further includes: In response to a user action on the second control, a fifth interface of the first application is displayed, which includes abbreviated information about the first schedule.
[0047] In conjunction with the second aspect, in one possible implementation, the first schedule information includes the schedule information of the second schedule and the schedule information of the third schedule; the first window includes a second area and a third area, the second area including the schedule information of the second schedule and the third area including the schedule information of the third schedule.
[0048] In conjunction with the second aspect, in one possible implementation, the second region is in a selected state; the first window also includes a second control, and the method further includes: In response to a user action on the second control, a sixth interface of the first application is displayed, which includes abbreviated information about the second schedule.
[0049] In conjunction with the second aspect, in one possible implementation, the second region is in a selected state, the first window also includes a second control, and the method further includes: in response to a user operation on the third region, displaying the third region as selected; in response to a user operation on the second control, displaying a seventh interface of the first application, the seventh interface including abbreviated information of the first schedule and abbreviated information of the second schedule.
[0050] In conjunction with the second aspect, in one possible implementation, the first schedule information includes at least one of the schedule topic, time, and location.
[0051] Thirdly, this application provides an electronic device including one or more processors and one or more memories; wherein the one or more memories are coupled to one or more processors, and the one or more memories are used to store computer program code, the computer program code including computer instructions, which, when executed by one or more processors, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0052] Fourthly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are configured to invoke computer instructions to cause the electronic device to perform the methods described in the first aspect and any possible implementation thereof.
[0053] Fifthly, this application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0054] Sixthly, this application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0055] Understandably, the electronic device provided in the third aspect, the chip system provided in the fourth aspect, the computer storage medium provided in the fifth aspect, and the computer program product provided in the fifth aspect are all used to execute the method provided in this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0056] Figures 1A to 1M This is an example of the user interface related to the system calendar provided in the embodiments of this application; Figures 2A to 2F This is an example of the user interface for triggering the creation of a schedule by sharing a screenshot, provided in an embodiment of this application. Figures 3A to 3E This is an example of the user interface of the chat application provided in the embodiments of this application; Figures 4A to 4B This is an example of the user interface of the chat application provided in the embodiments of this application; Figures 5A to 5G This is the relevant user interface of the "multi-schedule recognition" function of the electronic device provided by the exemplary embodiments of this application; Figures 6A to 6D This is the relevant user interface of the "contextual reasoning" function of the electronic device provided by the exemplary embodiments of this application; Figures 7A to 7G This is the relevant user interface of the "location recommendation" function of the electronic device provided by the exemplary embodiments of this application; Figure 8 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application; Figure 9 This is a schematic diagram of the software architecture of an electronic device provided in an embodiment of this application. Detailed Implementation
[0057] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to and includes any or all possible combinations of one or more of the listed items.
[0058] Currently, many applications on electronic devices have the function of creating schedules. Taking the system calendar as an example, users can click the system calendar icon on the desktop to enter the calendar interface, select the target date in the calendar interface, and then manually create the event corresponding to the target date in the system calendar.
[0059] In the above method, users need to manually enter the schedule information of each date one by one through the system calendar application interface to create a schedule. The operation is cumbersome, resulting in low schedule creation efficiency and poor user experience.
[0060] In view of this, this application provides a schedule creation method that can improve the efficiency of schedule creation and enhance user experience.
[0061] In this embodiment, users can transmit data to be processed (such as images or text information) to a target application (such as the system calendar) through methods such as importing images, sharing screenshots, smart scrolling, and pressing to recognize the screen. Correspondingly, the electronic device can respond to the user's operation and recognize schedule information based on the data to be processed; then, the electronic device can display the recognized schedule information; the user can modify the displayed schedule information and instruct the displayed schedule information to be created as a schedule, etc. In this method, users do not need to manually input schedule information item by item, reducing user operations and improving the user experience.
[0062] In this embodiment of the application, the electronic device can also perform multi-schedule identification, contextual reasoning, and location recommendation on the data to be processed when identifying schedule information in the data to be processed, thereby optimizing the identified schedule information.
[0063] The schedule creation method will now be described in conjunction with the user interface (UI) implemented on an electronic device provided in the embodiments of this application.
[0064] It should be noted that in this application, user operations can be touch operations (such as click operations, long press operations, swipe up operations, swipe down operations, or side swipe operations), contactless operations (such as air gestures or mouse operations), or user voice commands. This application does not impose specific limitations on these operations. For ease of description, the following embodiments use user touch operations as an example.
[0065] First, we will introduce four ways to implement user-instructed schedule creation.
[0066] The first method: Import images to create a schedule.
[0067] In this embodiment of the application, the electronic device can display a user interface for creating a schedule. The user interface may include an import control for acquiring an image to create a schedule. When a user operation is detected on the import control, an image stored locally is displayed in response to the user operation. Furthermore, in response to a user operation that selects an image from the displayed images, a schedule is created based on the selected image.
[0068] The following is combined Figures 1A to 1H The method for creating a schedule is illustrated using a system calendar in an electronic device as an example. It is understood that the schedule creation method of this application embodiment is also applicable to schedule setting functions provided in other applications or services.
[0069] Figure 1A This is an example of the calendar interface of the system calendar provided in this application embodiment. For example... Figure 1A As shown, the user interface 11 includes calendar information 111 and creation control 112. The calendar information 111 includes the year, month, and a control for selecting the month to display, etc., which are not limited in this application. The creation control 112 is used to create a schedule. Figure 1A The example shows the current date as December 1, 2023, with a circle indicating that the current date is selected. Users can also select other dates to create schedules for those dates. It should be understood that the calendar information 111 may also include lunar calendar information for each date and other content, which is not limited in this application.
[0070] In some embodiments, when an electronic device detects a user action on the creation control 112, it may display a schedule creation interface in response to that user action. See also... Figure 1B , Figure 1B The user interface 12 shown is an exemplary schedule creation interface provided in this application embodiment.
[0071] User interface 12 may include an exit control 121, a creation control 122, a schedule properties bar 123, a schedule theme bar 124, an import control 125, a location bar 126, a date bar 127, and other schedule settings bars 128. The exit control 121 is used to exit schedule creation; the creation control 122 is used to create a schedule based on the content of the current interface; the schedule properties bar 123 is used to display the properties of the currently created schedule, which may include default, important days, birthdays, and to-do items; the schedule theme bar 124 is used to input the schedule theme; the import control 125 is used to select an image; the location bar 126 is used to input a location; the date bar 127 is the date selected in user interface 11, and the time period can be a system-preset time period, which the user can modify; the other schedule settings bars 128 include reminder controls, etc., which are not limited in this application. In this application, the system calendar can also be referred to as the first application, the user interface 11 can also be referred to as the first interface of the first application, and the creation control 112 can also be referred to as the first control; the user interface 12 can be referred to as the second interface of the first application, and at least one of the above-mentioned schedule attribute bar 123, schedule topic bar 124, location bar 126, date bar 127 and other schedule setting bar 128 can be referred to as the first input bar, and the import control 125 can also be referred to as the second control.
[0072] like Figure 1B As shown, when the electronic device detects a user operation on the import control 125, it can respond to the user operation by displaying, as shown in the image. Figure 1C The user interface 13 shown is included. User interface 13 may include an exit control 131, an album selection control 132, preview images of images in a specific album stored locally, and selection controls for each image (such as selection control 133 for the first image). At this time, all selection controls for each image (including selection control 133 for the first image) are in an unselected state. In this application, user interface 13 may be referred to as the third interface of a second application (such as a gallery application), and the third interface includes the first preview image corresponding to the first image.
[0073] The exit control 131 is used to exit the current interface; the album selection control 132 is used to select an album from local storage and display a preview image of the selected album on the current interface. It should be understood that, to avoid the preview image being too small and causing unclear text, the image content in the preview image is represented by “…” to indicate the actual content of the image. Figure 1CThe image shown here is an example of the first image after being enlarged from the preview image.
[0074] like Figure 1C As shown, when the electronic device detects a user operation on the selection control 133 corresponding to the first image, it can respond to the user operation by displaying, as shown in the image. Figure 1D The user interface 14 shown may include an exit control 131, an album selection control 132, a confirmation control 141, preview images of images in a specific album stored locally, a selection control for each image (such as the selection control 142 for the first image), and a selected preview area 143. The selection control 142 for the first image is selected, while other images are unselected. The selected preview area 143 displays a preview of the selected image.
[0075] like Figure 1D As shown, when the electronic device detects a user operation on the determination control 141, it can respond to the user operation, identify the schedule information in the first image, and display the identified schedule information on the schedule creation interface. For example, the electronic device can display... Figure 1E The user interface shown is 15.
[0076] User interface 15 may include an exit control 151, a creation control 152, a schedule topic bar 153, a smudge control 154, a location bar 155, a time bar 156, and a preview image 157 of the first image. The exit control 151 is used to exit schedule creation; the creation control 152 is used to create a schedule based on the content of the current interface; the schedule topic bar 153 includes the topic information "meeting" identified from the first image; the smudge control 154 is used to select topic information from the identified text information; the location bar 155 includes the location information "classroom" identified from the first image; and the time bar 156 includes the time information "December 12th" identified from the first image. User interface 15 also exemplarily illustrates other options for schedule settings, such as a schedule properties bar and reminders, which are not limited in this application. In this application, the user interface 15 can be referred to as the fourth interface of the first application (such as the system calendar), and at least one of the schedule theme bar 153, location bar 155, time bar 156 and other schedule settings bars in the user interface 15 can be referred to as the first input bar, the schedule information in the first image can be referred to as the first schedule information, and the schedule information displayed in the user interface 15 (such as meeting, classroom, etc.) can be referred to as the second schedule information.
[0077] In some embodiments, if the user is satisfied with the currently identified schedule information, they can touch the creation control 152, and the electronic device can respond to the user's operation and create a schedule accordingly.
[0078] In other embodiments of this application, the user can modify the theme information using the smudge control 154, such as... Figure 1E As shown, when the electronic device detects a user operation on the smear control 154, it can respond to the user operation by displaying, as shown in the image. Figure 1F User interface 16. User interface 16 can display a smudged area 161 on the original interface. The smudged area 161 can display text recognized from the first image, and the user can reselect a theme from the displayed text. Figure 1F An example is shown of a delete control 162A and a confirmation control 162B in the schedule topic bar 153. The delete control 162A is used to delete text in the schedule topic bar 153, and the confirmation control 162B is used to confirm the completion of the editing and to deselect the edited area 161. For example, a user can select text in the edited area 161 and then click the confirmation control 162B. In response to this user action, the electronic device can display the selected text in the schedule topic bar 153 and then deselect the edited area 161. The schedule topic bar 153 will no longer display the delete control 162A and the confirmation control 162B, but instead will display the edit control 154. Furthermore, the user can continue to click the edit control 154 to edit the text in the schedule topic bar 153.
[0079] For illustrative purposes, Figure 1F and Figure 1G In the selected area, the text is indicated by a bold border and bold text. The electronic device may also highlight the selected text in other ways, such as by filling the selected text with color. This application does not limit this method.
[0080] Figure 1G An exemplary user interface 17 is shown after a user modifies theme information using the smudge control 154. The user interface 17 includes a creation control 171; the creation control 171 is used to create a schedule based on the content of the current interface. It should be understood that the user can repeatedly select and deselect text in the smudge area 161 and edit the selected text using the aforementioned delete control 162A and confirm control 163B; this application does not limit this.
[0081] Furthermore, such as Figure 1G As shown, when the electronic device detects a user action on the creation control 171, it can respond to the user action by creating a schedule, and then display the following: Figure 1H The user interface shown is 18.
[0082] The user interface 18 may include calendar information 180, schedule information 181, and a notification window 182. The calendar information 180 includes a selected date 180A, which is the schedule time identified from the first image. The schedule information 181 displays abbreviated information of the schedule created based on the schedule information of the user interface 17, such as a reminder time of "all day," a theme of "class meeting," and a location of "classroom." The notification window 182 reminds the user that the created schedule has been saved. Optionally, the notification window 182 can be canceled after displaying a preset duration.
[0083] In other embodiments of this application, the electronic device detects, such as Figure 1D When a user interacts with the control 141, the system can respond to that interaction and identify schedule information in the first image. During the identification of the schedule information in the first image, a scanning animation of the first image can be displayed, and the user interface can be as follows: Figure 1I The user interface 19A shown exemplarily illustrates a first image 190. It should be understood that the above... Figures 1A to 1H In the illustrated embodiment, in Figure 1D and Figure 1E It can also be displayed between such as Figure 1I The user interface 19A shown here is a scanning animation for the first image.
[0084] Furthermore, the electronic device can display, after the recognition is complete, the following: Figure 1J The user interface shown is 19B.
[0085] like Figure 1J As shown, user interface 19B is an exemplary theme editing interface provided in this application embodiment. This interface includes a return control 191a, a confirm control 191b, a delete control 191c for the theme input box, a smudge area 191d, and an input control 191f. The return control 191a allows the user to return to the previous interface (e.g., ...). Figure 1D The interface shown is as follows: the confirm control 191b is used to confirm the theme, the delete control 191c is used to delete the text in the theme input box, the smudge area 191d is used to display the text identified from the first image, and the input control 191f is used to input the text selected by the user into the theme input box.
[0086] like Figure 1J As shown, when the electronic device detects a user operation on the smear area 191d, it can respond to the user operation by displaying, as shown in the image. Figure 1KThe user interface 19C is shown. User interface 19C exemplarily shows the selected text "classmeeting" in the smudged area 192. Furthermore, when the electronic device detects a user operation on the input control 191f, it can respond to the user operation by displaying the selected text in the subject input field, such as displaying... Figure 1L The user interface shown is 19D.
[0087] It should be understood that after an electronic device displays the selected text in the subject input field, it may display something like this: Figure 1L As shown in the user interface 19D, the user can also edit the text displayed in the theme input field, such as clicking the delete control 191c of the theme input field to delete the text in the theme input field, or adding the text again in the touch-smudged area 192, etc. This application does not limit this.
[0088] like Figure 1L As shown, when the electronic device detects a user operation on the control 191b, it can respond to the user operation by displaying, as shown in the image. Figure 1M The user interface 19E is shown. User interface 19E includes an information bar 193a, a creation control 193b, a smudge control 193c, and other controls. The information bar 193a displays text information recognized from the first image, the creation control 193b creates a schedule based on the current interface content, and the smudge control 193c returns to the theme editing interface (e.g., ...). Figure 1L The user interface shown is 19D; the contents of other controls can be found in [reference needed]. Figure 1G The user interface shown is 17.
[0089] like Figure 1M As shown, when the electronic device detects a user action on the creation control 193b, it can respond to the user action by creating a schedule, and then display the following: Figure 1H The user interface 18 is shown. The contents of user interface 18 can be found above, and will not be repeated here.
[0090] In this embodiment, an import control (such as import control 125 shown in user interface 12) is added to the schedule creation interface. Users can select images from local storage (such as gallery applications) using the import control. Correspondingly, the electronic device can recognize the image selected by the user and create a schedule based on that image. This method allows users to import image data from other applications (such as gallery applications) into the schedule creation application (such as the system calendar) to create a schedule through simple user operations. This method greatly reduces user operations and can improve the user experience.
[0091] The second approach is to create a schedule by sharing an image.
[0092] In this embodiment of the application, the electronic device may respond to a sharing operation for a screenshot or a sharing operation for an image in the gallery, and create a schedule based on the image targeted by the sharing operation.
[0093] The following is passed Figures 2A to 2F The following example illustrates how sharing a screenshot can trigger the creation of a schedule.
[0094] Figure 2A This application provides an example of a ticket purchasing application interface in an embodiment of this application. Figure 2A The example shows the ticket information of a ticket purchased by a user.
[0095] In display Figure 2A During the user interface 21 shown, the electronic device can detect a screenshot operation. This screenshot operation can be performed by actuating physical buttons on the electronic device, such as the power button or volume buttons, or by a touch operation on the screen of the electronic device, such as... Figure 2A This application does not limit the three-finger sliding operation or knuckle tapping, etc. shown.
[0096] In response to the screenshot operation described above, the electronic device can save a frame of the user interface on the screen at the current moment, i.e., a screenshot. Furthermore, the electronic device can display a preview of the screenshot on the screen to notify the user that a screenshot has been obtained. See also... Figure 2B User interface 22 is an exemplary user interface provided in this application embodiment for displaying a screenshot preview on the screen. In this application, the aforementioned user interface 21 can be referred to as the first interface, the ticket information in user interface 21 can be referred to as the first schedule information, and the aforementioned screenshot can be referred to as the screenshot image of the first interface.
[0097] like Figure 2B As shown, the user interface 22 may include a floating window 221 and a sharing control 222, wherein the floating window 221 is used to display... Figure 2A The screenshot shown is a preview of the user interface; the sharing control 222 is used to send the above screenshot to other applications.
[0098] Figure 2B The example shows the floating window 221 and the sharing control 222 floating in the lower left corner of the screen. It should be understood that the floating window 221 and the sharing control 222 can also be located in other areas of the screen, such as the upper right corner, lower right corner, upper left corner, etc. This application embodiment does not limit this. The user interface 22 may also include other controls, such as controls for swiping to take screenshots. This application does not limit this.
[0099] In this embodiment, the electronic device can maintain the display of the floating window 221 and the sharing control 222 for a period of time according to a preset timer, for the user to browse. This time period is, for example, 3 seconds. After the timer expires, the electronic device can stop displaying the floating window 221 and the sharing control 222.
[0100] like Figure 2B As shown, the user can touch the sharing control 222, and the electronic device responds to the user's operation by displaying a sharing window on the original user interface, such as... Figure 2C As shown, the user interface 23 displays a sharing window 231. The sharing window 231 is used to display applications that can receive screenshots. Figure 2C The example illustrates that the sharing window 231 includes a calendar icon 231a, an email icon 231b, a Bluetooth icon 231c, and a message icon 231d. It should be understood that the sharing window 231 may also include other application icons. When the number of applications exceeds the window size of the sharing window, the sharing window can display application icons across multiple pages, allowing users to browse other application icons by swiping through the content in the sharing window.
[0101] like Figure 2C As shown, when the electronic device detects a user action on the schedule creation icon 231a, it can respond to the user action by displaying a schedule creation window on the original user interface. For example, the electronic device can display as follows: Figure 2D The user interface 24 shown may include a schedule creation window 241. The schedule creation window 241 is used to display schedule information identified from the screenshot and related controls. In this application, the aforementioned schedule creation icon 231a may also be referred to as the first icon.
[0102] For example, the schedule creation window 241 may include an exit control 241a, a creation control 241b, schedule information 241c, a schedule attribute bar 241d, and a schedule topic bar 241f. This application does not limit the size, position, etc., of the schedule creation window 241. Specifically, the exit control 241a is used to exit schedule creation; the creation control 241b is used to create a schedule based on the content of the schedule creation window 241; the schedule information 241c is used to display information identified from the screenshot, such as "ticket, December 20, 2023, 21:22, Guangzhou"; the schedule attribute bar 241d is used to display schedule attributes identified from the screenshot, such as "default"; and the schedule topic bar 241f is used to display topic information identified from the screenshot, such as "ticket".
[0103] Optionally, users can modify the schedule settings through the schedule settings options in the schedule creation window 241 in the user interface 24, such as modifying schedule attributes or changing time information.
[0104] It should be understood that the sharing operation can also be applied to an image in the chat window. For example, if a user long-presses the image, the electronic device displays a sharing control (such as the sharing control 222 in the following text). The sharing operation can be an operation applied to the sharing control.
[0105] Optionally, the schedule creation window 241 may only display a portion of the schedule settings options, and the user can instruct the electronic device to display hidden schedule settings options by swiping. For example... Figure 2D As shown, the user can perform an up swipe operation in the schedule creation window 241. Correspondingly, the electronic device can respond to this user operation by displaying hidden schedule settings options. For example, the electronic device can display as follows: Figure 2E The user interface 25 shown may include previously hidden scheduling options, such as a location bar 251a and a reminder control 251b.
[0106] It should be understood that the aforementioned schedule creation window 241 may also have other schedule setting options, such as priority, etc., which are not limited in this application. Among them, priority is used to indicate the importance of the schedule, such as important and ordinary. For example, when the time is approaching, the priority of the schedule is set to important. If the departure time of the aforementioned ticket is close to the current time, the electronic device can set the priority of the schedule to important and can display an "important" mark in the schedule information.
[0107] In some embodiments, the user can touch the above Figure 2D The user interface shown is 24 or Figure 2E The user interface 25 shown includes a creation control 241b. Accordingly, the electronic device can create a schedule based on the current schedule information in the schedule creation window, and display it as shown below. Figure 2F The user interface shown is 26.
[0108] The user interface 26 may include calendar information 260, schedule information 261, and a notification window 262. The calendar information 260 includes a selected date 260A, which is the schedule time in the schedule creation window. The schedule information 261 displays a thumbnail of the schedule corresponding to the schedule creation window. The notification window 262 reminds the user that the created schedule has been saved. Optionally, the notification window 262 can be displayed for a preset duration before being hidden.
[0109] It should be understood that Figures 2A to 2F Taking the creation of a single event as an example, this application can also create multiple events based on screenshots, as described above. Figure 2A The user interface 21 shown can include multiple ticket information, so that the electronic device can identify multiple schedule information based on a screenshot including multiple schedule information (such as multiple tickets), thereby creating multiple schedules.
[0110] In this embodiment of the application, an icon for creating a schedule (such as schedule creation icon 231a) is added to the sharing function, which supports importing image data from other applications (such as gallery applications) into the application for creating a schedule (such as the system calendar) to create a schedule. This method greatly reduces user operations and can improve the user experience.
[0111] The third implementation method: Create a schedule through intelligent workflow services.
[0112] In this embodiment, the intelligent data transfer service refers to matching applications that can receive the data to be processed, providing users with a service to quickly send the data to the target application. The data to be processed includes, but is not limited to, text, images, videos, documents, hyperlinks, etc. The electronic device can determine the data to be processed based on the operation controls triggered by the intelligent data transfer.
[0113] In this embodiment, the data to be processed includes schedule information (such as images or text); the target application is an application that provides schedule creation, such as a system calendar. Users can send the data to be processed to the target application through the smart workflow service, so that the target application can identify the schedule information in the data to be processed and create a schedule.
[0114] Below, in conjunction with Figures 3A to 3E For example, we will use chat information from a chat application as the data to be processed.
[0115] Figure 3A This is an application interface of a chat application shown in an embodiment of this application. Figure 3A The user interface 31 shown includes chat messages 311 and chat messages 312. Figure 3A For example, chat message 311 does not include schedule information, while chat message 312 includes schedule information "Class meeting, Classroom, December 12th".
[0116] Taking chat message 312 as an example of the user-selected data to be processed, the electronic device can detect whether there are any user operations affecting chat message 312 during its display. (Reference) Figure 3A The electronic device can detect a long press operation on chat message 312. In response to the user operation, the electronic device can switch chat message 312 to a floating state. For example, the electronic device can display as follows: Figure 3BThe user interface 32 shown may include a floating window 321 for displaying chat information 312. The floating window 321 adjusts its display position in real time following the user's touch operation trajectory. It should be understood that the chat information 312 may also be an image. In one implementation, if the user long-presses the image and holds it for a preset time, the electronic device displays the image as a floating window (as shown in floating window 321 below). In another implementation, if the user long-presses the image, multiple controls, such as a share control, may be displayed. If the user continues to long-press the image for more than a preset time, the electronic device displays the image as a floating window (as shown in floating window 321 below).
[0117] It should be understood that Figure 3A The example described uses a long press operation. In other embodiments of this application, other operations may also be used, such as clicking, voice commands, double-clicking, etc. In this application, the chat application can be referred to as the second application, the user interface 31 can be referred to as the second interface of the second application, the area where the chat information 312 is located can be referred to as the first area, the chat information 312 can be referred to as the first text information, and the schedule information "Class meeting, Classroom, December 12th" can be referred to as the first schedule information.
[0118] like Figure 3B As shown, the electronic device can detect the user's action of dragging the floating window 321 towards the right edge of the screen. After detecting that the floating window 321 is close to the right edge of the screen, the electronic device can display a light strip, such as... Figure 3C As shown, the user interface 33 includes a floating window 321 and a light strip 331. The light strip 331 can be used to prompt the user that the floating window 321 has moved close to the right edge of the screen. At this time, the user can choose to continue swiping right to trigger the service corresponding to the right edge of the screen, or stop swiping right to avoid triggering the service corresponding to the right edge of the screen.
[0119] In this embodiment, the service corresponding to the right side of the screen can be a smart data transfer service. If smart data transfer is triggered, the electronic device can display a menu bar on the right side of the screen, including one or more candidate application icons. The candidate applications are those selected by the electronic device from all installed applications that can receive the data to be processed.
[0120] like Figure 3C As shown, the electronic device can detect the user's action of continuing to swipe right on the floating window 321. In response to the above action, the electronic device can trigger the smart flow service in the right side hotspot and display a menu bar including one or more candidate application icons, such as the one shown above. Figure 3D User interface 34. Reference Figure 3DThe electronic device can display a menu bar 343 on the right side of the screen. The menu bar 343 includes multiple application icons. For example... Figure 3D As shown, the menu bar 343 may display: a share icon 343a, a create schedule icon 343b (also known as the first icon), a message icon 343c, etc. Each icon can correspond to one application. The applications corresponding to the above icons are all applications (candidate applications) capable of receiving chat messages 312 from the floating window 321. For example, the application corresponding to the create schedule icon 343b can be the system calendar (also known as the first application). Understandably, when there are too many candidate applications to be displayed simultaneously in the menu bar 343, the electronic device can also update the currently displayed candidate application icons in the menu bar 343 based on the user's dragging operation.
[0121] A hot zone (also known as the first area) refers to a touch area of a fixed shape and size on the screen. The right side hot zone is a rectangular touch area extending from the right edge of the screen to the other side.
[0122] Optionally, the electronic device can determine whether the floating window 321 is close to the right edge of the screen by the distance between the current finger's touch point on the screen and the right edge hot zone. Furthermore, when the current touch point is detected to be within the right edge hot zone, the electronic device can determine to trigger the service corresponding to the right edge of the screen.
[0123] For example, the first region can also be the region where the light band 331 is located.
[0124] In this embodiment, the service corresponding to the right-side hotspot can be a smart data transfer service. A smart data transfer service refers to matching applications that can receive the data to be processed, providing users with a service to quickly send the data to other target applications. The data to be processed includes, but is not limited to, text, images, videos, documents, hyperlinks, etc. The electronic device can determine the data to be processed based on the floating window triggered by the smart data transfer. For example, in the above scenario, the floating window 321 can be called the first control, and the chat information 312 corresponding to the floating window 321 can be called the data to be processed (or the first data). In this application, the electronic device can detect the first operation (such as the long press and drag operation) of dragging the first control (such as the floating window 321) into the first area of the screen (such as the right-side hotspot) (such as the long press and drag operation), and in response to the first operation, display the first icon of the first application (such as the system calendar) (such as the created schedule icon 343b). It should be understood that the first operation of dragging the first control into the first area of the screen can refer to the right edge of the first control entering the first area, or a portion of the first control entering the first area, or even the finger pressing and holding the first control and the touch point on the screen entering the first area. This application does not limit this. For example, as described above... Figure 3CThe user operation of continuing to slide the floating window 321 to the right to trigger the display of the above menu bar can be referred to as the first operation of dragging the first control into the first area of the screen.
[0125] At the same time, the original user interface can be adjusted to a right perspective image (such as...). Figure 3D As shown in image 341, this, together with the menu bar 343, creates an "opening" animation effect, enhancing the user experience. In one implementation, after "opening," the image displayed on the left is a snapshot of the user interface at the trigger moment captured by the electronic device. This means that after "opening," the image on the left remains fixed during the user's selection of the target application and does not change over time. In other embodiments, the electronic device may also display the original application's user interface in real time after "opening." In this case, the image on the left changes over time during the user's selection of the target application after "opening."
[0126] like Figure 3D As shown, users can select a target application by dragging the floating window 321 to the area where the target application icon (such as the calendar creation icon 343b) is located (which can also be referred to as the second area corresponding to the first icon). Furthermore, after detecting the user's action of dragging the floating window 321 to and releasing the calendar creation icon 343b, the electronic device can confirm that the system calendar corresponding to the calendar creation icon 343b is the target application, identify the calendar information in the chat information within the floating window 321, and display a calendar creation window for that calendar information. For example, the electronic device can display... Figure 3E The user interface 35 shown may include a schedule creation window 351, which displays schedule information and schedule setting controls identified based on chat information. In this application, the schedule information included in the chat information 312 may be referred to as first schedule information, and the schedule information displayed in the schedule creation window 351 may be referred to as second schedule information; the schedule creation window 351 may also be referred to as the first window.
[0127] In this application, the second area corresponding to the first icon may refer to the area where the first icon is located, or it may refer to the area within a preset distance from the first icon. This application does not limit this.
[0128] For details regarding the controls in the schedule creation window 351, please refer to the above. Figure 2D The details of the schedule creation window 241 in the user interface 24 shown are not repeated here.
[0129] Optionally, after detecting that the floating window 321 has been dragged to the position corresponding to the create schedule icon, the electronic device can highlight the create schedule icon, such as by increasing its size or changing its color, to prompt the user that the application corresponding to the create schedule icon is currently selected as the target application, thus avoiding accidental transmission.
[0130] In other embodiments of this application, users can identify schedule information in screenshots through the intelligent workflow service. For example, users can... Figure 2A The user interface 21 shown is captured in a screenshot. Correspondingly, the electronic device can respond to the user's operation and display the following: Figure 2B The user interface 22 is shown; furthermore, the user can drag the floating window 221 in the user interface 22 to the right side of the screen, as described above. Figures 3B to 3D The user action shown triggers the intelligent workflow service, allowing the electronic device to send the screenshot in the floating window 221 to the system calendar. The system then performs schedule recognition on the screenshot and displays it as shown. Figure 2D The user interface shown is 24.
[0131] It should be understood that the above text Figures 3A to 3E This example illustrates a scenario where a smart data transfer service is triggered by chat messages; in this application, screenshots, images in a gallery, or text information are handled as described above. Figures 3A to 3D Both long press and drag operations can trigger the smart workflow service to generate a schedule. This application does not limit the carrier of the schedule information (such as images or text).
[0132] For example, an electronic device can display a third interface of a third application (such as a chat application), the third interface including multiple dialog boxes; when displaying the third interface, a long press operation on the third interface is detected; in response to the long press operation on the third interface, a first control (such as a floating window including the aforementioned multiple dialog boxes) is displayed on the third interface; furthermore, the electronic device can display the aforementioned first icon in response to a first operation of holding the long press on the third interface and dragging it to a hot area; a second operation of continuing to drag the first control into a second area where the first icon is located and releasing it is detected; in response to the second operation, the aforementioned first window is displayed. Wherein, the phone does not leave the screen during the long press operation and the first operation, that is, the long press operation and the drag operation are continuous operations without releasing the hand.
[0133] Another example is that an electronic device can display a fourth interface of a gallery application, the fourth interface including a first image; when displaying the fourth interface, a long press operation on the first image is detected; in response to the long press operation on the first image, the aforementioned first control is displayed on the fourth interface, and the first data is the first image. It should be understood that the above long press operation is only an example, and the present application can also replace the above long press operation with other user operations. Other user operations can be user touch operations (such as click operations, swipe up operations, swipe down operations, or side swipe operations), or contactless operations (such as air gestures or mouse operations), or user voice commands. The present application does not make specific limitations in this regard.
[0134] In this embodiment of the application, the intelligent workflow service allows for the simple and quick selection of data to be processed, enabling the creation of a schedule based on that data. This convenient operation enhances the user experience.
[0135] The fourth implementation method: Create a schedule by pressing and recognizing the screen.
[0136] In this embodiment, a user can extract text information from the current interface by pressing with two fingers. Correspondingly, the electronic device responds to the user's operation by displaying the extracted text information and a creation control. The creation control is used to create a schedule based on the extracted text information. Furthermore, when the electronic device detects a user operation on the creation control, it can respond to the user's operation by recognizing schedule information based on the extracted text. The recognized schedule is used to create a schedule.
[0137] Below, in conjunction with Figures 4A to 4B For example, we will use the current interface as the application interface of a chat application to illustrate this.
[0138] Figure 4A This is an application interface of a chat application shown in an embodiment of this application. Figure 4A The user interface 41 shown includes chat messages 311 and chat messages 312. Figure 4A The example shows that chat information 311 does not include schedule information, while chat information 312 includes the schedule information "Class meeting, Classroom, December 12th". In this application, the above-mentioned chat application can also be referred to as the fourth application, user interface 41 can also be referred to as the eighth interface of the fourth application, and the schedule information included in chat information 312 can also be referred to as the first schedule information.
[0139] like Figure 4A As shown, when the electronic device detects a user operation of pressing the screen with two fingers, it can respond to the user operation by extracting text from the currently displayed user interface 41. During the recognition process, the electronic device can display an animation of the scanned interface (not shown in the figure); after the extraction is completed, it can display as shown in the figure. Figure 4B The user interface 42 is shown. User interface 42 is exemplarily illustrated with a dashed box to indicate the extracted text. The electronic device may also highlight the extracted text in other ways, such as by coloring the area where the text is located, but this application does not limit this.
[0140] In other embodiments of this application, the user operation for extracting the text currently displayed on the screen may not be limited to the above-mentioned two-finger pressing screen operation, but may also be a click operation, a long press operation, an up swipe operation, a down swipe operation, or a side swipe operation, etc. This application does not impose specific restrictions on this.
[0141] The user interface 42 may include an add control 421 and more controls 422, wherein the add control 421 is used to identify schedule information from the text extracted from the interface; the more controls 422 may include other options for performing other operations on the text, which are not limited in this application.
[0142] like Figure 4B As shown, when the electronic device detects a user action on the added control 421, it can respond to the user action by displaying the schedule information identified from the text extracted from the interface via a floating window on the original user interface. For example, the electronic device can display, as shown in the example... Figure 3E The user interface 35 shown may include a schedule creation window 351. In this application, the user operation of pressing the screen with two fingers can be referred to as a user operation acting on the eighth interface, the added control 421 can be referred to as a third control, and the schedule creation window 351 can also be referred to as a first window.
[0143] In the embodiments of this application, such as Figure 4A As shown, when an electronic device detects a user's two-finger press on the screen, it can also respond to the user's action and trigger the Smart Flow Service mentioned above to create a schedule. For example, when the user's two-finger press duration meets a preset duration, the electronic device can respond to the user's action by displaying all the text recognized on the interface as a floating window; then, in response to the user's long-press and drag operation, it can display the application icon corresponding to the Smart Flow Service, including the schedule creation icon (such as schedule creation icon 231a); furthermore, in response to the user's dragging operation to the schedule creation icon, it can display the schedule creation window (such as schedule creation window 351). For details, please refer to the relevant content of the Smart Flow Service mentioned above.
[0144] In this embodiment of the application, the method of pressing and recognizing the screen can recognize the text in the entire interface and create a schedule based on the recognized text. This method can conveniently select the text in the entire interface to create a schedule, simplifying the creation steps.
[0145] The following describes the "multi-schedule recognition," "contextual reasoning," and "location recommendation" functions of electronic devices. These functions can be enabled by default or activated via controls; this application does not limit the specifics.
[0146] In some embodiments of this application, when the data to be processed includes schedule information for multiple schedules, the electronic device can identify the schedule information for multiple schedules in the data to be processed, and then display the schedule information for multiple schedules. The data to be processed can be a screenshot, multiple dialog boxes, or an image; this application does not limit the specific type of data.
[0147] For example, the following combination Figures 5A to 5GThis section introduces the "multi-schedule recognition" function of electronic devices.
[0148] Figure 5A This is an application interface of a chat application shown in an embodiment of this application. Figure 5A The user interface 51 shown includes chat information 511. This embodiment of the application exemplifies that chat information 511 includes two schedule messages: the first schedule message is "Meeting 1, Meeting Room 303, Next Wednesday (December 20th)", and the second schedule message is "Meeting 2, Meeting Room 301, Next Thursday (December 21st)". It should be understood that in other embodiments of this application, the above two schedule messages may also be located in two chat messages, and the two chat messages may be in the form of a dialogue, or both may be chat messages received by the electronic device. In this application, the two schedule messages included in chat information 511 may also be referred to as the schedule information of the second schedule and the schedule information of the third schedule.
[0149] During the display of chat message 511, the electronic device can detect whether there is a user action applied to chat message 511. (Reference) Figure 5A The electronic device can detect a long-press operation applied to chat message 511. This long-press operation can be a long press exceeding a certain duration. In response to this user operation, the electronic device can switch chat message 511 to a floating state. For example, the electronic device can display as follows: Figure 5B The user interface 52 shown may include a floating window 521, which is used to display chat information 511. The floating window 521 adjusts its display position in real time following the movement trajectory of the user's touch operation.
[0150] like Figure 5B As shown, the electronic device can detect the user's action of dragging the floating window 521 towards the right edge of the screen. After detecting that the floating window 521 is close to the right edge of the screen, the electronic device can display a light strip, such as... Figure 5C As shown, the user interface 53 includes a floating window 521 and a light strip 531. The light strip 531 can be used to prompt the user that the floating window 521 has moved close to the right edge of the screen. At this time, the user can choose to continue swiping right to trigger the service corresponding to the right edge of the screen, or stop swiping right to avoid triggering the service corresponding to the right edge of the screen.
[0151] In this embodiment, the service corresponding to the right side of the screen can be a smart data transfer service. If smart data transfer is triggered, the electronic device can display a menu bar on the right side of the screen, including one or more candidate application icons. The candidate applications are those selected by the electronic device from all installed applications that can receive the data to be processed.
[0152] like Figure 5CAs shown, the electronic device can detect a user's continued right swipe. In response to this action, the electronic device can trigger a smart navigation service and display a menu bar including one or more candidate application icons. For example, the electronic device can display something like... Figure 5D The user interface shown is 54. (Reference) Figure 5D The electronic device can display a menu bar 543 on the right side of the screen. The menu bar 543 includes multiple application icons. For example... Figure 5D As shown, the menu bar 543 may display: a share icon 543a, a create schedule icon 543b, a message icon 543c, etc. Each icon corresponds to one application. The applications corresponding to the above icons are all applications (candidate applications) that can receive chat messages 511 in the floating window 521. Understandably, when there are too many candidate applications to display simultaneously in the menu bar 543, the electronic device can also update the currently displayed candidate application icons in the menu bar 543 according to the user's drag operation.
[0153] At the same time, the original user interface can be adjusted to a right perspective image (such as...). Figure 5D As shown in image 541, this, together with the menu bar 543, creates an "opening" animation effect, enhancing the user experience. In one implementation, after "opening," the image displayed on the left is a snapshot of the user interface at the trigger moment captured by the electronic device. This means that after "opening," the image on the left remains fixed during the user's selection of the target application and does not change over time. In other embodiments, the electronic device may also display the original application's user interface in real time after "opening." In this case, the image on the left changes over time during the user's selection of the target application after "opening."
[0154] like Figure 5D As shown, a user can drag the floating window 521 to the area where the target application icon (such as the create schedule icon 543b) is located. In response to the user's action of dragging and releasing the floating window 521 to the create schedule icon, the electronic device can recognize schedule information from the chat messages within the floating window 521 and display a schedule creation window, which can include multiple recognized schedule information entries. For example, the electronic device can display, as shown... Figure 5E The user interface 55 shown may include a schedule creation window 551.
[0155] The schedule creation window 551 may include multiple identified schedule information items, such as first schedule information 551c and second schedule information 551d. Figure 5EThe first schedule information 551c is highlighted with a bold border to indicate that it is in a selected state. The schedule creation window 551 may also include an exit control 551a and schedule options corresponding to the selected schedule information (such as the first schedule information 551c), such as a creation control 551b, a schedule property bar 551e, and a schedule topic bar 551f. The exit control 551a is used to exit the schedule creation process; the creation control 551b is used to create a schedule based on the content of the schedule creation window 551. It should be understood that multiple schedule information items in the schedule creation window 551 can be selected simultaneously, and this application does not limit this. In this application, the area where the first schedule information 551c is located can be called the second area, and the first schedule information 551c can also be called the schedule information of the second schedule; the area where the second schedule information 551d is located can also be called the third area, and the second schedule information 551d can also be called the schedule information of the third schedule; the creation control 551b can also be called the second control, and the schedule creation window 551 can also be called the first window.
[0156] Optionally, the user can select the first schedule information 551c and / or the second schedule information 551d. Accordingly, the electronic device can respond to the user's operation by displaying the schedule options corresponding to the selected schedule information in the schedule creation window 551. Then, the user can modify the schedule information corresponding to the selected option through the schedule options. Alternatively, the user can click the creation control 551b to create the schedule corresponding to the selected schedule information.
[0157] Figure 5E The example shows that the first schedule information 551c is selected and the second schedule information 551d is unselected. At this time, if the user clicks the create control 551b, the electronic device can respond to the user's operation and create the schedule corresponding to the first schedule information 551c.
[0158] For example, a user can change the first schedule information 551c from a selected state to an unselected state by touching it, and can also change the second schedule information 551d from an unselected state to a selected state by touching it. At this time, if the user clicks the create control 551b, the electronic device can respond to the user's operation to create the schedule corresponding to the second schedule information 551d and display the sixth interface of the first application (such as the system calendar). The sixth interface includes the abbreviated information of the schedule corresponding to the second schedule information 551d (also referred to as the second schedule). The abbreviated information of the second schedule can be as shown in the first schedule information 571 in the user interface 57.
[0159] like Figure 5E As shown, when the electronic device detects a user operation on the second schedule information 551d, it can respond to the user operation by displaying the second schedule information 551d as selected. For example, the electronic device can display something like... Figure 5F The user interface 56 shown includes first schedule information 561c and second schedule information 561d, both of which are selected, as well as an exit control 551a and a creation control 561b corresponding to the selected schedule information.
[0160] like Figure 5F As shown, when the electronic device detects a user operation on the creation control 561b, it can respond to the user operation and create a schedule based on the schedule information (i.e., the first schedule information 561c and the second schedule information 561d) selected in the schedule creation window, displaying as shown. Figure 5G The user interface shown is 57.
[0161] The user interface 57 may include calendar information 570, first schedule information 571, second schedule information 572, and a notification window 573. The calendar information 570 includes a selected date 570A, which is the schedule time in the schedule creation window; the first schedule information 571 is a thumbnail of the first schedule information 561c; the second schedule information 572 is a thumbnail of the second schedule information 561d; and the notification window 573 is used to remind the user that the created schedule has been saved. Optionally, the notification window 573 can be canceled after displaying a preset duration. In this application, the user interface 57 may also be referred to as the seventh interface of a first application (such as the system calendar), and the first schedule information 571 may also be referred to as a thumbnail of the second schedule; the second schedule information 572 may also be referred to as a thumbnail of the third schedule.
[0162] It should be understood that the above Figures 5A to 5G This example illustrates how a chat message can include multiple schedule information entries, and how a smart workflow service can create multiple schedules based on that chat message. In other embodiments of this application, multiple schedule information entries can be included in a screenshot, multiple dialog boxes can include multiple schedule information entries, or images selected from a gallery can include multiple schedule information entries. This application does not limit the carrier of the multiple schedule information entries; schedule creation can also be triggered by importing images or sharing, and this application does not limit this either.
[0163] For example, users can also import images that include multiple schedule information to create multiple schedules, as described above. Figures 1A to 1H The first image in the process can also include multiple schedule information, so that the electronic device can recognize multiple schedules in the first image to create multiple schedules.
[0164] As another example, users can also import multiple images containing multiple schedule information to create multiple schedules, as described above. Figure 1C Users can select multiple images, each containing multiple schedule information; for example, image 1 includes first schedule information, and image 2 includes second schedule information. In response to the above... Figures 1D to 1H This operation allows electronic devices to recognize multiple events in multiple images to create multiple events.
[0165] As another example, users can also create multiple events by sharing screenshots or text to an application that creates events (such as the system calendar), as described above. Figures 2A to 2F The screenshot can also include multiple schedule information, so that the electronic device can recognize multiple schedules in the first image to create multiple schedules; Another example is that the user can also long press the screen to identify multiple events in multiple dialog boxes to create multiple events, for example, displaying a third interface of a third application (such as a chat application), the third interface including multiple dialog boxes; when the third interface is displayed, a long press operation on the third interface is detected; in response to the long press operation on the third interface, a first control (such as a floating window including the above-mentioned multiple dialog boxes) is displayed on the third interface, the first data being the content of the multiple dialog boxes, the first data including multiple event information, which is not limited in this application.
[0166] In this embodiment, when the data to be processed includes schedule information for multiple schedules, the electronic device can identify the schedule information for multiple schedules in the data to be processed, and then display the schedule information for multiple schedules, such as displaying the identified schedule information, like the first schedule information 551c and the second schedule information 551d, in the schedule creation window 551. This method can quickly create multiple schedules without requiring the user to perform multiple creation operations, reducing creation time and improving user experience.
[0167] In some embodiments of this application, when the data to be processed includes multi-turn dialogues, the electronic device can perform contextual reasoning on the data to be processed to determine the schedule information in the data to be processed.
[0168] For example, the following combination Figures 6A to 6D This paper exemplifies the "contextual reasoning" function of electronic devices by using a two-finger screen press as an example. It should be understood that the data to be processed on the current application interface can also be sent to the target application (such as a system application) via the aforementioned screenshot sharing or smart transfer after screenshotting; this application does not limit this.
[0169] Figure 6A This is an application interface of a chat application shown in an embodiment of this application. Figure 6A The user interface 61 shown includes a multi-turn dialogue between two users.
[0170] like Figure 6AAs shown, when the electronic device detects a user operation of pressing the screen with two fingers, it can respond to the user operation by extracting text from the currently displayed user interface 61. During the recognition process, the electronic device can display an animation of the scanned interface (not shown in the figure); after the extraction is completed, it can display as shown in the figure. Figure 6B The user interface 62 shown is illustrated by a dashed box indicating the extracted text. The electronic device may also highlight the extracted text in other ways, such as by coloring the area containing the text, but this application does not limit this to such methods.
[0171] User interface 62 may include an add control 621 and more controls 622, wherein the add control 621 is used to identify schedule information from the text extracted from the interface; the more controls 622 may include other options for performing other operations on the text, which are not limited in this application.
[0172] like Figure 6B As shown, when the electronic device detects a user action on the added control 621, it can respond to the user action by displaying the schedule information identified from the text extracted from the interface via a floating window on the original user interface. For example, the electronic device can display, as shown in the example... Figure 6C The user interface 63 shown may include a schedule creation window 631, which is used to display schedule information extracted from the text and recognized by the interface.
[0173] For example, the schedule creation window 631 includes an exit control 631a, a creation control 631b, schedule information 631c, a schedule properties bar 631d, and a schedule topic bar 631f.
[0174] The schedule includes: an exit control 631a for exiting the schedule creation process; a creation control 631b for creating a schedule based on the schedule information in the schedule creation window 631; schedule information 631c for displaying schedule information identified from the text extracted from the interface, such as "business communication with Professor Xu, December 20th, 14:00, xx University Main Building 205"; a schedule attribute bar 631d for displaying schedule attributes identified from the text extracted from the interface, such as "default"; and a schedule theme bar 631f for displaying the theme information "business communication with Professor Xu" identified from the screenshot. It should be understood that "December 20th" in schedule information 631c is time information inferred from time information such as "Friday" identified from the text extracted from the interface.
[0175] In this application, users can modify schedule information based on controls in the schedule creation window 631. For example, users can edit the schedule theme using the smudge control in the schedule theme bar 631f. If a user clicks the smudge control in the schedule theme bar 631f, the electronic device can display, for example... Figure 1F The application provides the user with a selection of areas to apply, but does not limit this selection.
[0176] like Figure 6C As shown, when the electronic device detects a user operation on the creation control 631b, it can respond to the user operation and create a schedule based on the current schedule information in the schedule creation window 631, displaying as shown. Figure 6D The user interface shown is 64.
[0177] The user interface 64 may include calendar information 640, schedule information 641, and a notification window 642. The calendar information 640 includes a selected date 640A, which is the schedule time in the schedule creation window 631. The schedule information 641 displays a thumbnail of the schedule corresponding to the schedule creation window. The notification window 642 reminds the user that the created schedule has been saved. Optionally, the notification window 642 can be displayed for a preset duration before being hidden.
[0178] It should be understood that this application does not limit the size, position, etc. of the schedule creation window 631. Other options and window features of the schedule creation window 631 can be found in the relevant description of the schedule creation window 241, and will not be repeated here.
[0179] It should be noted that the above Figures 6A to 6D This example illustrates the use of two-finger screen pressing. In this application, users can also send the aforementioned multi-turn dialogue to an application (such as the system calendar) to create a schedule through the Smart Flow Service. For example, a user can long-press the user interface 61 until the electronic device displays the multi-turn dialogue in the user interface 61 as a floating window. Then, in response to the user's dragging operation while holding down the long press, the application icon corresponding to the Smart Flow Service is displayed, including the schedule creation icon (such as schedule creation icon 231a). Then, in response to the user's dragging operation to the schedule creation icon, the schedule creation window (such as schedule creation window 351) is displayed. For details, please refer to the relevant content of the Smart Flow Service above.
[0180] In this embodiment, when the data to be processed includes multi-turn dialogues, the electronic device can perform contextual reasoning on the data to determine the schedule information within it. This method eliminates the need for users to extract schedule information from the dialogue content, enabling intelligent recognition of schedule information, simplifying schedule creation time, and improving user experience.
[0181] In some embodiments of this application, after identifying a location from the data to be processed, the electronic device obtains a recommended location based on the identified location and the user's relevant address information; and displays the recommended location. The user's relevant address information may be locations the user frequently visits (such as frequently navigated locations).
[0182] For example, a user can enable the system calendar to access addresses, and the system calendar can store addresses that the user has visited; then, after a location is identified from the data to be processed, it can be matched with the stored addresses based on the identified location (such as a kindergarten). If the central kindergarten meets the matching criteria, it can be displayed as a recommended location.
[0183] For example, the following combination Figures 7A to 7G This section introduces the "location recommendation" function of electronic devices.
[0184] Figure 7A This is an application interface of a chat application shown in an embodiment of this application. Figure 7A The user interface 71 shown includes chat messages 711.
[0185] During the display of chat message 711, the electronic device can detect whether there is a user action applied to chat message 711. (Reference) Figure 7A The electronic device can detect a long press operation on chat message 711. In response to the user operation, the electronic device can switch chat message 711 to a floating state. For example, the electronic device can display as follows: Figure 7B The user interface 72 shown may include a floating window 721, which is used to display chat information 711. The floating window 721 adjusts its display position in real time following the movement trajectory of the user's touch operation.
[0186] like Figure 7B As shown, the electronic device can detect the user's action of dragging the floating window 721 towards the right edge of the screen. After detecting that the floating window 721 is close to the right edge of the screen, the electronic device can display a light strip, such as... Figure 7C As shown, the user interface 73 includes a floating window 721 and a light strip 731. The light strip 731 can be used to prompt the user that the floating window 721 has moved close to the right edge of the screen. At this time, the user can choose to continue swiping right to trigger the service corresponding to the right edge of the screen, or stop swiping right to avoid triggering the service corresponding to the right edge of the screen.
[0187] In this embodiment, the service corresponding to the right side of the screen can be a smart data transfer service. If smart data transfer is triggered, the electronic device can display a menu bar on the right side of the screen, including one or more candidate application icons. The candidate applications are those selected by the electronic device from all installed applications that can receive the data to be processed.
[0188] like Figure 7C As shown, the electronic device can detect a user's continued right swipe. In response to this action, the electronic device can trigger a smart navigation service and display a menu bar including one or more candidate application icons. For example, the electronic device can display something like... Figure 7D The user interface shown is 74. (Reference) Figure 7D The electronic device can display a menu bar 743 on the right side of the screen. The menu bar 743 includes multiple application icons. For example... Figure 7D As shown, the menu bar 743 may display: a share icon 743a, a create schedule icon 743b, a message icon 743c, etc. Each icon corresponds to one application. The applications corresponding to the above icons are all applications (candidate applications) that can receive chat messages 711 in the floating window 721. Understandably, when there are too many candidate applications to be displayed simultaneously in the menu bar 743, the electronic device can also update the currently displayed candidate application icons in the menu bar 743 according to the user's drag operation.
[0189] At the same time, the original user interface can be adjusted to a right perspective image (such as...). Figure 7D As shown in image 741, this, together with the menu bar 743, creates an "opening" animation effect, enhancing the user experience. In one implementation, after "opening," the image displayed on the left is a snapshot of the user interface at the trigger moment captured by the electronic device. This means that after "opening," the image on the left remains fixed during the user's selection of the target application and does not change over time. In other embodiments, the electronic device may also display the original application's user interface in real time after "opening." In this case, the image on the left changes over time during the user's selection of the target application after "opening."
[0190] like Figure 7D As shown, a user can drag the floating window 721 to the area where the target application icon (such as the create schedule icon 743b) is located. In response to the user's action of dragging and releasing the floating window 721 to the create schedule icon, the electronic device can recognize the schedule information in the chat information 711 within the floating window 721 and display a schedule creation window, which can include multiple recognized schedule information entries. For example, the electronic device can display, as shown... Figure 7E The user interface 75 shown may include a schedule creation window 751.
[0191] For example, the schedule creation window 751 may include an exit control 751a, a creation control 751b, and schedule information 751c. The exit control 751a is used to exit the schedule creation process; the creation control 751b is used to create a schedule based on the content of the schedule creation window 751; and the schedule information 751c is used to display information obtained from the chat message 711, such as "pick up child, December 20th, 18:00, kindergarten, and central kindergarten." The "central kindergarten" is a recommended location obtained based on the "kindergarten" in the chat message 711 combined with the user's relevant address information. In this application, the "kindergarten" in the chat message 711 can be referred to as first location information, and "central kindergarten" can also be referred to as second location information; the schedule creation window 751 can also be referred to as the first window.
[0192] like Figure 7E As shown, the user can perform an up swipe operation in the schedule creation window 751. Correspondingly, the electronic device can respond to this user operation by displaying hidden schedule settings options. For example, the electronic device can display as follows: Figure 7F The user interface 76 shown may include previously hidden schedule settings options, such as the location bar 761a.
[0193] The location bar 761a may include an undo control 761b, which is used to delete the current location, while the location bar 761a is used to enter a location.
[0194] In some embodiments, the user can touch the above Figure 7E The user interface shown is 75 or Figure 7F The user interface 76 shown includes a creation control 751b. Accordingly, the electronic device can create a schedule based on the current schedule information in the schedule creation window, and display it as shown below. Figure 7G The user interface shown is 77.
[0195] The user interface 77 may include calendar information 770, schedule information 771, and a notification window 772. The calendar information 770 includes a selected date 770A, which is the schedule date (i.e., December 20th) in the schedule creation window 751. The schedule information 771 displays a thumbnail of the schedule corresponding to the schedule creation window. The notification window 772 reminds the user that the created schedule has been saved. Optionally, the notification window 772 can be displayed for a preset duration before being de-displayed. In this application, the user interface 77 may be referred to as the fifth interface of a first application (such as a system calendar), and the schedule information 771 may be referred to as a thumbnail of the first schedule.
[0196] It should be understood that the applications in this application (such as the ticketing application, chat application, etc. mentioned above) can be system applications or third-party applications. In the embodiments of this application, a system application refers to an application directly provided by the operating system of an electronic device to achieve a specific function. A third-party application refers to an application provided by other developers and obtained by the electronic device through the Internet to achieve a specific function.
[0197] In this embodiment, the electronic device can identify locations from the data to be processed, and based on the identified locations and the user's relevant address information, obtain recommended locations and display them. This method enables intelligent location recommendations without requiring users to manually supplement schedule information, simplifying schedule creation time and improving user experience.
[0198] In some embodiments of this application, the electronic device can send data to be processed (such as images and text selected by the user) to the server, and the server can identify schedule information based on the data to be processed; then, the server sends the identified schedule information (such as schedule topic, location and time) to the electronic device; the electronic device displays the above schedule information.
[0199] In one possible implementation, the server can utilize deep learning to identify schedule information in the data to be processed. It should be noted that in other embodiments of this application, an electronic device may also identify the schedule information in the data to be processed; this application does not limit this approach.
[0200] For example, the server can train the neural network based on training data so that the trained neural network (referred to as the target neural network for ease of description) has the ability to recognize the topic, location and time of the event.
[0201] For example, when the data to be processed includes text within a time recognition range, the target neural network can identify the date, time, and priority from that text. The identified date can include specific information such as year, month, week, and day; the identified time can include a point in time or a period of time; and the priority indicates the importance of the event, such as important or ordinary. Table 1 exemplarily shows text within a time recognition range and the date information that can be identified from that text. For instance, if the text within the time recognition range of the data to be processed includes a relative year (such as "next year"), and if this year is 2023, the target neural network can identify the specific year information as "2024" based on "next year." As another example, if the text within the time recognition range of the data to be processed includes degree words (such as "very") or importance words (such as "urgent"), the target neural network can identify the priority of the event as "important."
[0202] Optionally, the target neural network can also prioritize the schedule as the time approaches, as described above. Figures 7A to 7G In the illustrated embodiment, since the time point "6 PM" is relatively close to the present, the target neural network can set the priority of this schedule as important.
[0203] Table 1
[0204] For example, Table 2 illustrates the topic classification rules for training data of the target neural network. If the target neural network cannot identify a specific category in the topic classification definition based on the data to be processed, it identifies a secondary category of topics based on the data to be processed and uses the secondary category as the identified topic. Optionally, the target neural network can also identify a primary category of topics based on the data to be processed. The primary category of topics is used for topic recommendation. For example, when the target neural network does not identify the specific category or the secondary category of topics in the topic classification definition in the data to be processed, it can identify the primary category corresponding to the data to be processed and display recommended topics in the topic column, such as in... Figure 1E The schedule topic bar 153 displays the first-level category.
[0205] Table 2
[0206] For example, the chat message displayed on the electronic device includes "Meeting at 2 PM, Important". The user selects this chat message as data to be processed, such as by long-pressing the chat message until it becomes floating and then dragging it to the "Create Schedule" icon, or by long-pressing the chat message until the share control is displayed and then clicking "Share to Create Schedule". Then, the electronic device can identify the schedule information in the data to be processed through the aforementioned target neural network. When the schedule information includes the fuzzy time point "2 PM", the electronic device, based on Table 1 and the fuzzy time point, if the day is December 20, 2023, can determine the time as "December 20, 2023, 16:00". When the schedule information includes "Important", the electronic device can set the priority of the schedule to Important based on Table 1. When the schedule information includes "Meeting", the electronic device can determine the schedule topic as "Meeting" in Table 2.
[0207] Next, the form and hardware / software architecture of the electronic device provided in the embodiments of this application will be described.
[0208] Electronic devices can be portable terminal devices running iOS®, Android®, Microsoft® or other operating systems, such as mobile phones, tablets, desktop computers, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, personal digital assistants (PDAs), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices, in-vehicle devices, smart home devices and / or smart city devices, etc.
[0209] Figure 8 The hardware structure of an electronic device according to an embodiment of this application is illustrated. For example... Figure 8 As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 126, a camera 130, a display screen 140, an audio module 150, a speaker 150A, a receiver 150B, a microphone 150C, a headphone jack 150D, and a sensor module 160. The sensor module 160 may include a pressure sensor 160A, a distance sensor 160F, a proximity light sensor 160G, a touch sensor 160K, an ambient light sensor 160L, etc.
[0210] The processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.
[0211] The controller can serve as the nerve center and command center of an electronic device. Based on the instruction opcode and timing signals, the controller generates operation control signals to control the fetching and execution of instructions.
[0212] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0213] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0214] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a limitation on the structure of the electronic device. In other embodiments of this application, the electronic device may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0215] Internal memory 126 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).
[0216] Random access memory can include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, such as fifth-generation DDR SDRAM, which is generally called DDR5 SDRAM), etc. Non-volatile memory can include disk storage devices and flash memory.
[0217] Flash memory can be classified according to its operating principle, including NOR FLASH, NAND FLASH, 3D NAND FLASH, etc.; according to the level of the storage cell, including single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc.; and according to the storage specification, including universal flash storage (UFS) and embedded multimedia card (eMMC), etc.
[0218] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.
[0219] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.
[0220] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.
[0221] Electronic devices implement display functions through a GPU, a display screen 140, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 140 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0222] Display screen 140 is used to display images, videos, etc. Display screen 140 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be manufactured using organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microLEDs, micro-OLEDs, quantum dot light-emitting diodes (QLEDs), etc. In some embodiments, the electronic device may include one or N displays 140, where N is a positive integer greater than 1.
[0223] Electronic devices can achieve shooting functions through ISP, camera 130, video codec, GPU, display 140 and application processor.
[0224] The ISP (Image Signal Processor) is used to process data fed back from the camera 130. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimizations on image noise, brightness, etc. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be integrated into the camera 130.
[0225] Camera 130 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device may include one or N cameras 130, where N is a positive integer greater than 1.
[0226] In this embodiment, the camera 130 may be a telephoto camera, a main camera, a wide-angle camera, etc.
[0227] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when an electronic device is selecting a frequency, a DSP can perform a Fourier transform on the frequency energy.
[0228] Video codecs are used to compress or decompress digital video. Electronic devices can support one or more video codecs. This allows the electronic device to play or record video in various encoded formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0229] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0230] Electronic devices can implement audio functions, such as music playback and recording, through audio modules 150, speakers 150A, receivers 150B, microphones 150C, headphone jacks 150D, and application processors.
[0231] The audio module 150 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. The audio module 150 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 150 may be located in the processor 110, or some functional modules of the audio module 150 may be located in the processor 110.
[0232] The speaker 150A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic devices can listen to music or make hands-free calls through the speaker 150A.
[0233] The receiver 150B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When an electronic device answers a phone call or voice message, the receiver 150B can be brought close to the ear to hear the voice.
[0234] Microphone 150C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 150C, inputting the sound signal into microphone 150C. Electronic devices can have at least one microphone 150C. In some embodiments, electronic devices can have two microphones 150C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic devices can have three, four, or more microphones 150C, enabling sound signal collection, noise reduction, sound source identification, and directional recording, among other functions.
[0235] The 150D headphone jack is used to connect wired headphones. The 150D headphone jack can be a USB interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, which is also a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.
[0236] The structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, the electronic device may also include buttons, motors, indicators, and a subscriber identification module (SIM) card interface, etc. As another example, the sensor module may also include: a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a fingerprint sensor, a temperature sensor, a bone conduction sensor, etc.
[0237] In this embodiment of the application, the electronic device can execute the schedule creation method provided in this application through the processor 110 and display the schedule information obtained by executing the schedule creation method provided in this application through the display screen 140.
[0238] Figure 9 The software architecture of an electronic device according to an embodiment of this application is illustrated by way of example.
[0239] like Figure 9 As shown, the layered architecture divides the system into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the system is divided into four layers, from top to bottom: application layer, application framework layer, system layer, and kernel layer. Wherein: The application layer can include a series of application packages. For example, an application package can include applications such as a system calendar, a chat application, and a ticketing application.
[0240] The application framework layer plays a bridging role, interacting with applications through the application program interface (API) and with the HAL through the HAL interface definition language (HIDL).
[0241] The software architecture may also include Figure 9 The Hardware Abstraction Layer (HAL), not shown in the diagram, is an interface layer located between the application framework layer and the kernel layer, providing a virtual hardware platform for the operating system.
[0242] The kernel layer serves as the layer between hardware and software. It includes drivers for various hardware components, such as display drivers, camera drivers, audio drivers, and sensor drivers. The kernel layer may also include digital signal processor (DSP) drivers (not shown) and image processor (IP) drivers (not shown). Specifically, the camera driver drives the image sensors of one or more cameras in the camera module to acquire images and drives the image signal processor to preprocess the images. The DSP driver drives the digital signal processor to process images. The IPC driver drives the graphics processor to process images.
[0243] The term "user interface (UI)" used in the specification, claims, and drawings of this application refers to the medium through which an application or operating system interacts and exchanges information with the user. It facilitates the conversion between the internal form of information and a form acceptable to the user. The user interface of an application is source code written in specific computer languages such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on an electronic device, ultimately presenting user-recognizable content such as images, text, and buttons. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined using tags or nodes, such as XML tags. <textview> 、 <imgview> 、 <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a page, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a web page is also defined through tags or nodes in the web page source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>To define the elements and attributes of a webpage.
[0244] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an interface element such as an icon, window, or control displayed on the screen of an electronic device. The control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0245] It should be understood that the steps in the above-described method embodiments provided in this application can be implemented by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules in the processor.
[0246] This application also provides an electronic device that may include a memory and a processor. The memory may be used to store a computer program; the processor may be used to invoke the computer program in the memory to cause the electronic device to perform the methods in any of the above embodiments.
[0247] This application also provides a chip system including at least one processor for implementing the functions involved in the methods performed by the electronic device in any of the above embodiments. In one possible design, the chip system further includes a memory for storing program instructions and data, the memory being located within or outside the processor. The chip system may be composed of chips or may include chips and other discrete devices.
[0248] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.
[0249] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.
[0250] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0251] This application also provides a computer program product, which includes a computer program (also referred to as code or instructions) that, when run, causes a computer to perform the method executed by the electronic device in any of the above embodiments.
[0252] This application also provides a computer-readable storage medium storing a computer program (also referred to as code or instructions). When the computer program is run, it causes the computer to perform the method executed by the electronic device in any of the above embodiments.
[0253] The various embodiments of this application can be combined arbitrarily to achieve different technical effects.
[0254] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to this application are generated, in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state drive).
[0255] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.
[0256] In summary, the above are merely embodiments of the technical solution of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made according to the disclosure of the present invention should be included within the scope of protection of the present invention.< / canvas> < / video> < / videoview> < / imgview> < / textview>
Claims
1. A method for creating a schedule, characterized in that, Applied to electronic devices, the method includes: The first interface is displayed, and the first interface includes first schedule information; Upon receiving a first operation on the first text containing the first schedule information In response to the first operation, a first interface element is displayed, the first interface element including the first schedule information; Upon receiving a drag operation applied to the first interface element, a light strip is displayed on the first side as the first interface element is dragged toward the first side of the display screen of the electronic device. Upon receiving an operation that the first interface element is dragged to the hot zone on the first side, the menu bar and the content of the scaled-down first interface are displayed. The menu bar and the hot zone are located on the same side, and multiple icons are displayed in the menu bar, including the icon of the calendar application. The first interface element is dragged to the icon of the calendar application. In response to the release operation, a second interface is displayed, which includes the first schedule information and the first control. The first operation and the release operation are continuous. In response to an operation on the first control, a first schedule is created; Upon receiving a request to perform a first text extraction operation on the first interface. During the text extraction process, a scanning animation of the first interface is displayed; After extracting text from the first interface, a third interface is displayed. The third interface includes a second control and text extracted from the first interface. The extracted text includes the first schedule information. In response to an operation on the second control, a first floating window is displayed, in which the first schedule information and the third control are displayed; In response to an operation on the third control, the first schedule is created.
2. The method according to claim 1, characterized in that, The method further includes: not displaying the light strip when displaying the menu bar and the content of the scaled-down first interface.
3. The method according to claim 1 or 2, characterized in that, The first schedule information includes at least one of the schedule topic, time, and location.
4. The method according to any one of claims 1-3, characterized in that, The first interface includes a first dialog box, and the first text is displayed in the first dialog box.
5. The method according to any one of claims 1-4, characterized in that, The method further includes: The fourth interface is displayed, which includes second schedule information, including the schedule topic and the time of the second schedule. The schedule topic corresponds to the second dialog box, and the time of the second schedule corresponds to the third dialog box. Upon receiving a second text extraction operation on the fourth interface, a scanning animation of the fourth interface is displayed during the text extraction process. After the text extraction is completed on the fourth interface, the fifth interface is displayed. The fifth interface includes a fourth control and the text extracted from the fourth interface. The extracted text includes the second schedule information, and the text "schedule" is displayed on the fourth control. In response to the operation of the fourth control, a second floating window is displayed, in which the second schedule information is displayed; In response to an operation on the second floating window, a sixth interface is displayed, the sixth interface containing a fifth control; in response to an operation on the fifth control, a second schedule is created.
6. The method according to claim 5, characterized in that, The first schedule information and the second schedule information correspond to the same schedule.
7. The method according to any one of claims 1-6, characterized in that, The first interface is the interface of the instant messaging software.
8. The method according to any one of claims 1-7, characterized in that, The second interface is the schedule creation interface, which displays the text "New Schedule"; the first floating window is the schedule creation window, which also displays the text "New Schedule".
9. The method according to any one of claims 1-8, characterized in that, After creating the first schedule, the method further includes: The calendar application's interface is displayed, and the calendar application's interface includes abbreviated information about the first event.
10. The method according to claim 1, characterized in that, The first text extraction operation includes: pressing the screen with two fingers; the second text extraction operation includes: pressing the screen with two fingers.
11. The method according to any one of claims 1-10, characterized in that, Displaying the content of the scaled-down first interface includes displaying the content of the scaled-down first interface in a perspective style.
12. The method according to any one of claims 1-11, characterized in that, The first operation and the release operation are continuous operations in which the finger does not leave the display screen.
13. The method according to any one of claims 1-12, characterized in that, The first text also includes schedule information for the third schedule; the second interface includes a second area and a third area, in which the schedule information for the first schedule is displayed in the second area and the schedule information for the third schedule is displayed in the third area.
14. The method according to claim 13, characterized in that, The method further includes: When the schedule information of the first schedule displayed in the second area is selected and the schedule information of the third schedule displayed in the third area is not selected, an operation on the first control is received.
15. The method according to claim 13, characterized in that, If the schedule information of the first schedule displayed in the second area is not selected, and the schedule information of the third schedule displayed in the third area is selected, the method further includes: In response to an operation on the second area, the schedule information of the first schedule displayed in the second area is selected, while the schedule information of the third schedule displayed in the third area is not selected; When the schedule information of the first schedule displayed in the second area is selected, and the schedule information of the third schedule displayed in the third area is not selected, an operation on the first control is received.
16. The method according to claim 1, characterized in that, The method further includes: The sixth interface is displayed, which includes the fourth schedule information; A screenshot operation was detected while the sixth interface was being displayed; In response to the screenshot operation, a screenshot preview and a sharing control of the sixth interface are displayed on the sixth interface; In response to an operation on the sharing control, a first icon is displayed; In response to an operation on the first icon, a seventh interface is displayed, on which the fourth schedule information and the sixth control are displayed. In response to the operation on the sixth control, a fourth schedule is created.
17. An electronic device, characterized in that, The electronic device includes a processor for invoking a computer program in memory, causing the electronic device to perform the method as claimed in any one of claims 1-16.
18. A computer-readable storage medium comprising instructions, characterized in that, The computer-readable storage medium stores computer instructions that, when executed on an electronic device, cause the electronic device to perform the method as claimed in any one of claims 1-16.