Schedule creating method and electronic equipment
Through smart circulation services and long press to recognize the screen, electronic devices automatically recognize and create schedules, solving the problem of cumbersome methods of creating existing schedules and improving operational efficiency and user experience.
Patent Information
- Application Number
- CN202410042554.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-12-26
- Filing Date
- 2024-01-10
- Publication Date
- 2025-07-04
AI Technical Summary
The existing schedule creation methods are cumbersome, inefficient, poor user experience, and difficult to quickly and easily create schedules on electronic devices.
By detecting user operations, using smart circulation services and long pressing to identify the screen, the pending data such as image and text information are transmitted to the target application, and the electronic device recognizes and displays the schedule information, and the user can modify and create the schedule.
Simplifies the schedule creation process, improves operational efficiency and user experience, reduces user manual input steps, and supports multi-schedule recognition, context reasoning and location recommendation.
Smart Images

Figure CN120255770A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic technologies, and in particular, to a schedule creation method and an electronic device. Background Art
[0002] With the gradual acceleration of people's living rhythms, various to-do items are gradually increasing. A plan or arrangement for a certain time node or time period is called a schedule, and schedule information is received by a user's electronic device through various channels (such as text messages, IM (Instant Messenger) software such as WeChat, office software, emails, etc.) and in various forms (such as text, pictures, files, etc.).
[0003] Currently, after receiving schedule information, a user usually switches to a schedule management program of the electronic device, such as a calendar, and manually enters the schedule information in the schedule management program to create a schedule corresponding to the schedule information, so that the electronic device can remind the user at a set target time point.
[0004] However, due to the complex sources and diverse forms of schedule information, the operation of the above schedule creation method is relatively cumbersome, the schedule creation efficiency is low, and the user experience is poor. Summary of the Invention
[0005] This application provides a schedule creation method and an electronic device, which can be used to solve the technical problems that the operation of the existing schedule creation method is relatively cumbersome, the schedule creation efficiency is low, and the user experience is poor.
[0006] In a first aspect, this application provides a schedule creation method, which is applied to an electronic device. The method includes: detecting a first operation of dragging a first control into a first area on a screen, where the first control corresponds to first data, and the first data includes first schedule information; in response to the first operation, displaying a first icon of a first application; detecting a second operation of continuing to drag the first control into a second area where the first icon is located and releasing it; in response to the second operation, displaying a first window of the first application, where the first window includes second schedule information, and the second schedule information corresponds to the first schedule information.
[0007] In an embodiment of the present application, after detecting that the user drags the first control into the hot zone (i.e., the above-mentioned first area), the electronic device can trigger the intelligent transfer service, display at least one application icon (including the first icon of the above-mentioned first application), and after detecting the operation that the user continues to drag the above-mentioned first control to the second area where the first icon is located and releases it, send the data to be processed corresponding to the above-mentioned first control (i.e., the first data) to the first application. The first data includes the first schedule information; furthermore, display the first window of the first application, and the first window includes the second schedule information, and the second schedule information corresponds to the first schedule information. By triggering the intelligent transfer service, this method can simply and quickly select the data to be processed (i.e., the first data) for schedule information recognition, display the second schedule information so that the user can create a schedule based on the second schedule information, with convenient operation and improved user experience.
[0008] In combination with the first aspect, in a possible implementation, the method further includes: displaying a first interface, where the first interface includes the first schedule information; when displaying the first interface, detecting a screenshot operation; in response to the screenshot operation, displaying a first control on the first interface, and the first data is the screenshot image of the first interface.
[0009] In an embodiment of the present application, the screenshot image can be used as the first data. This method can obtain the schedule information displayed on the interface through screenshot, with convenient operation and improved user experience.
[0010] In combination with the first aspect, in a possible implementation, a preview image of the screenshot image of the first interface is displayed on the first control.
[0011] In combination with the first aspect, in a possible implementation, the method further includes: displaying a second interface of a second application, where the second interface includes a first area, and first text information is displayed on the first area, and the first text information includes the first schedule information; when displaying the second interface, detecting a long-press operation on the first area; in response to the long-press operation on the first area, displaying a first control on the first interface, and the first data is the first text information.
[0012] In an embodiment of the present application, the first text information on the first area can be selected as the first data through a long-press operation. This method can conveniently select the first data to create a schedule, with convenient operation and improved user experience.
[0013] In the present application, the above-mentioned long-press operation on the first area can also be other user operations on the first area, such as voice commands, clicks, etc. The present application does not limit this.
[0014] In combination with the first aspect, in a possible implementation, the method further includes: displaying a third interface of a third application, the third interface including a plurality of dialog boxes; when the third interface is displayed, detecting a long-press operation on the third interface; in response to the long-press operation on the third interface, displaying a first control on the third interface, and the first data being the content of the plurality of dialog boxes.
[0015] In the embodiments of the present application, through the method of pressing and recognizing the screen, the text in the entire interface (such as the above-mentioned plurality of dialog boxes) can be recognized, and a schedule can be created based on the recognized text. This method can conveniently select the text in the entire interface to create a schedule, simplifying the creation steps.
[0016] In the present application, the above-mentioned long-press operation on the third interface can also be other user operations on the third interface, such as voice commands, clicks, etc., and the present application does not limit this.
[0017] In combination with the first aspect, in a possible implementation, the method further includes: displaying a fourth interface of a gallery application, the fourth interface including a first image; when the fourth interface is displayed, detecting a long-press operation on the first image; in response to the long-press operation on the first image, displaying a first control on the fourth interface, and the first data being the first image.
[0018] In the embodiments of the present application, the user can select an image (such as the first image) stored locally (such as in a gallery application) by long-pressing. Correspondingly, the electronic device can recognize the selected image by the user and create a schedule based on the image. This method can import the image data of the gallery application into the first application (such as the system calendar) to create a schedule through simple user operations, which greatly reduces user operations and can improve the user experience.
[0019] In the present application, the above-mentioned long-press operation on the first image can also be other user operations on the first image, such as voice commands, clicks, etc., and the present application does not limit this.
[0020] In combination with the first aspect, in a possible implementation, the first schedule information and the second schedule information correspond to the same schedule.
[0021] Optionally, the second schedule information can be obtained based on the first schedule information.
[0022] Optionally, the first schedule information and the second schedule information can be the same or different.
[0023] Optionally, a schedule can be a plan or arrangement for a certain time node or time period.
[0024] In combination with the first aspect, in a possible implementation, the first window further includes a second control, and the method further includes:
[0025] In response to a user operation on a second control, display a fifth interface of a first application, where the fifth interface includes thumbnail information of a first schedule, and the first schedule is created by the first application based on first schedule information.
[0026] In combination with the first aspect, in a possible implementation, the first schedule information includes schedule information of a second schedule and schedule information of a third schedule; the first window includes a second area and a third area, the second area includes the schedule information of the second schedule, and the third area includes the schedule information of the third schedule.
[0027] Optionally, the schedule information in the first schedule information and the schedule information in the first window may be different or may not be different, and this application does not make a limitation on this.
[0028] In the embodiments of this application, when the data to be processed (i.e., the first data) includes schedule information of multiple schedules, the electronic device can identify the schedule information of multiple schedules in the data to be processed, and then display the schedule information of multiple schedules, such as displaying the identified schedule information of multiple schedules in the first window, such as the schedule information of the second schedule and the schedule information of the third schedule. This method can quickly create multiple schedules, without the need for the user to perform multiple creation operations, which can reduce the creation time and improve the user experience.
[0029] In combination with the first aspect, in a possible implementation, the second area is in a selected state, the first window further includes a second control, and the method further includes: in response to a user operation on the second control, display a sixth interface of the first application, where the sixth interface includes thumbnail information of the second schedule.
[0030] The embodiments of this application can select any schedule information from the displayed schedule information of multiple schedules to create a schedule, which can meet the personalized needs of users and improve the user experience.
[0031] In combination with the first aspect, in a possible implementation, the second area is in a selected state, the first window further includes a second control, and the method further includes: in response to a user operation on the third area, display the third area as a selected state; in response to a user operation on the second control, display a seventh interface of the first application, where the seventh interface includes thumbnail information of the second schedule and thumbnail information of the third schedule.
[0032] This method can quickly create multiple schedules, without the need for the user to perform multiple creation operations, which can reduce the creation time and improve the user experience.
[0033] In combination with the first aspect, in a possible implementation, the first data includes first location information, the first window includes second location information, and the first location information is different from the second location information.
[0034] In an embodiment of the present application, after an electronic device identifies a location from the data to be processed (i.e., the first data), based on the identified location (i.e., the first location information) and the relevant address information of the user, a recommended location (i.e., the second location information) can be obtained; and the recommended location is displayed. This method can achieve intelligent recommendation of locations, eliminating the need for users to supplement schedule information themselves, simplifying the time for schedule creation, and improving the user experience.
[0035] In combination with the first aspect, in a possible implementation, the first data is the first image; the method further includes: displaying the first image and a sharing control; in response to a user operation on the sharing control, displaying a first icon; and in response to a user operation on the first icon, displaying a first window.
[0036] In an embodiment of the present application, an icon for schedule creation (such as the first icon) is added to the sharing function, supporting the import of image data (such as the first image) from other applications (such as a gallery application) into the application for creating schedules (such as the first application) to create schedules. This method greatly reduces user operations and can improve the user experience.
[0037] In combination with the first aspect, in a possible implementation, the method further includes: displaying an eighth interface of a fourth application, the eighth interface including first schedule information; when the eighth interface is displayed, in response to a user operation on the eighth interface, displaying a third control; and in response to a user operation on the third control, displaying a first window.
[0038] In an embodiment of the present application, the text in the entire interface (such as the eighth interface) can be recognized, and a schedule can be created based on the recognized text. This method can conveniently select the text in the entire interface to create a schedule, simplifying the creation steps.
[0039] In combination with the first aspect, in a possible implementation, the first schedule information includes at least one of a schedule theme, time, and location.
[0040] In a second aspect, the present application provides a schedule creation method applied to an electronic device. The method includes: displaying a first interface of a first application, the first interface including calendar information and a first control; in response to a user operation on the first control, displaying a second interface of the first application, the second interface including a first input field and a second control; the first input field is in a blank state; in response to a user operation on the second control, displaying a third interface of a second application, the third interface including a first preview image corresponding to the first image, the first image including first schedule information; and in response to an operation on the first preview image, displaying a fourth interface of the first application, the fourth interface including a first input field, and the first input field includes second schedule information, and the second schedule information corresponds to the first schedule information.
[0041] In the embodiments of the present application, an import control (i.e., the second control) is added to the schedule creation interface (i.e., the second interface of the first application). The user can select an image (such as the first image) stored locally (such as the second application) through the import control. Correspondingly, the electronic device can identify the selected image by the user and display the recognized schedule information (such as the above-mentioned second schedule information) so that the user can create a schedule based on the recognized schedule information. This method can import the image data of the second application (such as the gallery application) into the first application (such as the system calendar) to create a schedule through simple user operations, which greatly reduces user operations and can improve the user experience.
[0042] In combination with the second aspect, in a possible implementation, the first schedule information and the second schedule information correspond to the same schedule.
[0043] Optionally, the second schedule information may be obtained based on the first schedule information.
[0044] Optionally, the first schedule information and the second schedule information may be the same or different.
[0045] Optionally, a schedule may be a plan or arrangement for a certain time node or time period.
[0046] In combination with the second aspect, in a possible implementation, the first schedule information is the schedule information corresponding to the first schedule, and the fourth interface further includes a second control. The method further includes:
[0047] In response to a user operation on the second control, display a fifth interface of the first application, and the fifth interface includes thumbnail information of the first schedule.
[0048] In combination with the second aspect, in a possible implementation, the first schedule information includes the schedule information of the second schedule and the schedule information of the third schedule; the first window includes a second area and a third area, the second area includes the schedule information of the second schedule, and the third area includes the schedule information of the third schedule.
[0049] In combination with the second aspect, in a possible implementation, the second area is in a selected state; the first window further includes a second control. The method further includes:
[0050] In response to a user operation on the second control, display a sixth interface of the first application, and the sixth interface includes thumbnail information of the second schedule.
[0051] In combination with the second aspect, in a possible implementation, the second area is in a selected state, the first window further includes a second control. The method further includes: in response to a user operation on the third area, display the third area as the selected state; in response to a user operation on the second control, display a seventh interface of the first application, and the seventh interface includes the thumbnail information of the first schedule and the thumbnail information of the second schedule.
[0052] In combination with the second aspect, in a possible implementation, the first schedule information includes at least one of a schedule theme, time, and location.
[0053] In a third aspect, the present application provides an electronic device, which includes one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, and the computer program code includes computer instructions. When the one or more processors execute the computer instructions, the electronic device is caused to execute the method described in the first aspect and any possible implementation manner in the first aspect.
[0054] In a fourth aspect, an embodiment of the present application provides a chip system, which is applied to an electronic device. The chip system includes one or more processors, and the processors are used to call computer instructions to cause the electronic device to execute the method described in the first aspect and any possible implementation manner in the first aspect.
[0055] In a fifth aspect, the present application provides a computer-readable storage medium, including instructions. When the above instructions run on an electronic device, the above electronic device is caused to execute the method described in the first aspect and any possible implementation manner in the first aspect.
[0056] In a sixth aspect, the present application provides a computer program product including instructions. When the above computer program product runs on an electronic device, the above electronic device is caused to execute the method described in the first aspect and any possible implementation manner in the first aspect.
[0057] It can be understood that the electronic device provided in the above third aspect, the chip system provided in the fourth aspect, the computer storage medium provided in the fifth aspect, and the computer program product provided in the fifth aspect are all used to execute the method provided by the present application. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] Figures 1A to 1M is a relevant user interface of the system calendar exemplarily provided by an embodiment of the present application;
[0059] Figures 2A to 2F is a relevant user interface of sharing a screenshot to trigger the creation of a schedule exemplarily provided by an embodiment of the present application;
[0060] Figures 3A to 3E is a relevant user interface of a chat application exemplarily provided by an embodiment of the present application;
[0061] Figures 4A to 4B is a relevant user interface of a chat application exemplarily provided by an embodiment of the present application;
[0062] Figures 5A to 5G It is a user interface related to the "multi-schedule recognition" function of the electronic device provided exemplarily in an embodiment of the present application;
[0063] Figures 6A to 6D It is a user interface related to the "context reasoning" function of the electronic device provided exemplarily in an embodiment of the present application;
[0064] Figures 7A to 7G It is a user interface related to the "location recommendation" function of the electronic device provided exemplarily in an embodiment of the present application;
[0065] Figure 8 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;
[0066] Figure 9 It is a schematic diagram of the software architecture of an electronic device provided in an embodiment of the present application. Detailed implementation manners
[0067] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. As used in the specification and claims of the present application, the singular forms "a", "an", "the", "above-mentioned", "said", and "this" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more of the listed items.
[0068] Currently, many applications in electronic devices have the function of creating schedules. Taking the system calendar as an example, the user can click the icon of the system calendar on the desktop to enter the calendar interface, select the target date in the calendar interface, and then manually create a schedule corresponding to the target date in the system calendar.
[0069] In the above method, the user needs to manually input the schedule information of the date item by item in the application interface of the system calendar to create a schedule, and the operation is relatively cumbersome, resulting in a low schedule creation efficiency and a poor user experience.
[0070] In view of this, the present application provides a schedule creation method, which can improve the efficiency of creating a schedule and improve the user experience.
[0071] In the embodiments of the present application, a user can transmit data to be processed (such as an image or text information) to a target application (such as a system calendar) by importing an image, taking a screenshot and sharing, intelligent transfer, pressing and recognizing the screen, etc. Correspondingly, the electronic device can respond to the user operation, recognize schedule information based on the data to be processed; further, the electronic device can display the recognized schedule information; the user can modify the displayed schedule information, and perform operations such as instructing to create the displayed schedule information as a schedule. In this method, the user does not need to manually input schedule information item by item, and the user operations are few, which can improve the user experience.
[0072] In the embodiments of the present application, when the electronic device recognizes schedule information in the data to be processed, it can also perform multi-schedule recognition, context reasoning, and location recommendation on the data to be processed, so as to optimize the recognized schedule information.
[0073] Next, the schedule creation method will be described in combination with the user interface (UI) implemented on the electronic device provided in the embodiments of the present application.
[0074] It should be noted that in the present application, the user operation can be a touch operation of the user (such as a click operation, a long-press operation, a swipe-up operation, a swipe-down operation, or a side-swipe operation), or a non-contact operation (such as an air gesture or a mouse operation), or a voice command of the user. The embodiments of the present application do not make specific limitations on this. For convenience of description, the following embodiments will be described by taking the touch operation of the user as an example.
[0075] First, four implementation methods for the user to instruct to create a schedule will be introduced.
[0076] The first implementation method: Create a schedule by importing an image.
[0077] In the embodiments of the present application, the electronic device can display a user interface for creating a schedule. The user interface can include an import control for obtaining an image to create a schedule; when detecting a user operation on the import control, in response to the user operation, display the images stored locally; further, in response to the user operation of selecting an image from the displayed images, create a schedule based on the selected image.
[0078] Next, in combination with Figures 1A to 1H , taking the system calendar in the electronic device as an example, the schedule creation method will be described exemplarily. It can be understood that the schedule creation method of the embodiments of the present application is also applicable to the schedule setting functions provided in other application programs or services.
[0079] Figure 1A is the calendar interface of the system calendar exemplarily provided in the embodiments of the present application. As Figure 1AAs shown, the user interface 11 includes calendar information 111 and a creation control 112. Among them, the calendar information 111 includes the year, month, and a control for selecting the displayed month, etc., which are not limited in this application; the creation control 112 is used to create a schedule. Figure 1A Exemplarily, it is shown that the current date is December 1, 2023. Exemplarily, a circle is used to indicate that the current date is in a selected state, and the user can also select other dates to create schedules corresponding to other dates. It should be understood that the calendar information 111 may also include the lunar calendar information and other content of each date, which are not limited in this application.
[0080] In some embodiments, when the electronic device detects a user operation on the creation control 112, it can respond to the user operation and display a schedule creation interface. Please refer to Figure 1B , Figure 1B The user interface 12 shown is an exemplary schedule creation interface provided by an embodiment of this application.
[0081] The user interface 12 may include an exit control 121, a creation control 122, a schedule property bar 123, a schedule theme bar 124, an import control 125, a location bar 126, a date bar 127, and other schedule setting bars 128. Among them, the exit control 121 is used to exit the creation of a schedule; the creation control 122 is used to create a schedule based on the content of the current interface; the schedule property bar 123 is used for the properties of the currently created schedule, and the properties may include default, important day, birthday, and to-do; the schedule theme bar 124 is used to input the schedule theme; the import control 125 is used to select an image; the location bar 126 is used to input the location; the date bar 127 is the date selected in the user interface 11, and the time period can be a system-preset time period, and the user can modify the time in the date bar 127; other schedule setting bars 128 include reminder controls and other content, which are not limited in this application. In this application, the system calendar may also be referred to as the first application, the user interface 11 may also be referred to as the first interface of the first application, and the creation control 112 may also be referred to as the first control; the user interface 12 may be referred to as the second interface of the first application, and at least one of the above schedule property bar 123, schedule theme bar 124, location bar 126, date bar 127, and other schedule setting bars 128 may be referred to as the first input bar, and the import control 125 may also be referred to as the second control.
[0082] As Figure 1B shown, when the electronic device detects a user operation on the import control 125, it can respond to the user operation and display as Figure 1CThe user interface 13 shown. The user interface 13 may include an exit control 131, an album selection control 132, preview images of the images in a certain album in the local storage, and a selection control corresponding to each image (such as the selection control 133 corresponding to the first image). At this time, the selection controls corresponding to each image (including the selection control 133 corresponding to the first image) are all in an unselected state. In this application, the user interface 13 may be referred to as the third interface of a second application (such as a gallery application), and the third interface includes the first preview image corresponding to the first image.
[0083] Among them, the exit control 131 is used to exit the current interface; the album selection control 132 is used to select an album from the local storage so as to display the preview images of the images in the selected album on the current interface. It should be understood that to avoid unclear illustrated text due to the small size of the preview image, the image content in the preview image is indicated by "…" to represent the actual content of the image. The first image after the preview image is enlarged is exemplarily shown in Figure 1C the figure.
[0084] As Figure 1C shown, when the electronic device detects a user operation on the selection control 133 corresponding to the first image, it may respond to the user operation and display the user interface 14 as shown in Figure 1D the figure. The user interface 14 may include an exit control 131, an album selection control 132, a confirmation control 141, preview images of the images in a certain album in the local storage, and a selection control corresponding to each image (such as the selection control 142 corresponding to the first image), and a selected preview area 143. Among them, the selection control 142 corresponding to the first image is in a selected state, and the other images except the first image are in an unselected state; the selected preview area 143 is used to display the preview images of the selected images.
[0085] As Figure 1D shown, when the electronic device detects a user operation on the confirmation control 141, it may respond to the user operation, identify the schedule information in the first image, and display the identified schedule information on the schedule creation interface. For example, the electronic device may display the user interface 15 as shown in Figure 1E the figure.
[0086] The user interface 15 may include an exit control 151, a creation control 152, a schedule theme bar 153, a smearing control 154, a location bar 155, a time bar 156, and a preview image 157 of the first image. Among them, the exit control 151 is used to exit the creation of a schedule; the creation control 152 is used to create a schedule based on the content of the current interface; the schedule theme bar 153 includes the theme information "meeting" recognized from the first image; the smearing control 154 is used to select theme information from the recognized text information; the location bar 155 includes the location information "classroom" recognized from the first image; the time bar 156 includes the time information "December 12th" recognized from the first image. The user interface 15 also exemplarily shows other options for schedule settings, such as a schedule property bar and reminders, etc., which are not limited in this application. In this application, the user interface 15 may be referred to as the fourth interface of a first application (such as a system calendar), at least one of the schedule theme bar 153, the location bar 155, the time bar 156, and other schedule setting bars in the user interface 15 may be referred to as a first input bar, the schedule information in the first image may be referred to as first schedule information, and the schedule information displayed in the user interface 15 (such as meeting, classroom, etc.) may be referred to as second schedule information.
[0087] In some embodiments, if the user is satisfied with the currently recognized schedule information, the creation control 152 may be touched, and correspondingly, the electronic device may respond to this user operation and create a schedule.
[0088] In some other embodiments of the present application, the user may modify the theme information through the smearing control 154, such as Figure 1E shown, when the electronic device detects a user operation on the smearing control 154, it may respond to this user operation and display a user interface 16 as shown in Figure 1F The user interface 16 may display a smearing area 161 on the original interface. The smearing area 161 may display the text recognized from the first image, and the user may re-select the theme from the displayed text. Figure 1F Exemplarily shown are a deletion control 162A and a confirmation control 162B in the schedule theme bar 153. The deletion control 162A is used to delete the text in the schedule theme bar 153, and the confirmation control 162B is used to confirm the completion of smearing and cancel the display of the smearing area 161. For example, after the user selects text in the smearing area 161 and clicks the confirmation control 162B, the electronic device may respond to this user operation, display the text selected by the user in the schedule theme bar 153 and cancel the display of the smearing area 161. The deletion control 162A and the confirmation control 162B are no longer displayed in the schedule theme bar 153, but the smearing control 154 is displayed. Furthermore, the user may continue to click the smearing control 154 to edit the text in the schedule theme bar 153.
[0089] For convenience of illustration, Figure 1F and Figure 1G in the smearing area in, the selected text is indicated by a thick border and bold text. The electronic device can also highlight the selected text in other ways, such as filling the selected text with a color, etc. This application does not limit this.
[0090] Figure 1G Exemplarily shows a user interface 17 after the user modifies the theme information by smearing the control 154. The user interface 17 includes a creation control 171; the creation control 171 is used to create a schedule based on the content of the current interface. It should be understood that the user can repeatedly select and deselect text in the smearing area 161 and edit the selected text through the above-mentioned deletion control 162A and confirmation control 163B. This application does not limit this.
[0091] Furthermore, as Figure 1G shown, when the electronic device detects a user operation on the creation control 171, it can respond to the user operation to create a schedule, and then, it can display a user interface 18 as Figure 1H shown.
[0092] The user interface 18 may include calendar information 180, schedule information 181, and a notification window 182. Among them, the calendar information 180 includes a selected date 180A, and the selected date is the schedule time recognized from the first image; the schedule information 181 is used to display the thumbnail information of the schedule created based on the schedule information of the user interface 17, such as the reminder time is "all day", the theme is "classmeeting", and the location is "classroom"; the notification window 182 is used to remind the user that the created schedule has been saved. Optionally, the notification window 182 can cancel the display after a preset duration.
[0093] In some other embodiments of this application, when the electronic device detects a user operation on the determination control 141 as Figure 1D shown, it can respond to the user operation to recognize the schedule information in the first image. During the process of recognizing the schedule information in the first image, an animation effect of scanning the first image can be displayed, and the user interface can be a user interface 19A as Figure 1I shown, where the first image 190 is exemplarily shown. It should be understood that in the embodiments as Figures 1A to 1H shown above, between Figure 1D and Figure 1E an animation effect of scanning the first image as shown in the user interface 19A as Figure 1I shown can also be displayed.
[0094] Furthermore, after the recognition is completed, the electronic device can display a user interface as Figure 1JThe user interface 19B shown.
[0095] As Figure 1J shown, the user interface 19B is a theme editing interface exemplarily provided in an embodiment of the present application. This interface includes a return control 191a, a determination control 191b, a deletion control 191c for the theme input box, a smearing area 191d, and an input control 191f. Among them, the return control 191a is for the user to return to the previous interface (such as the interface shown in Figure 1D ), the determination control 191b is used to determine the theme, the deletion control 191c is used to delete the text in the theme input box, the smearing area 191d is used to display the text recognized from the first image, and the input control 191f is used to input the text selected by the user into the theme input box.
[0096] As Figure 1J shown, when the electronic device detects a user operation on the smearing area 191d, it can respond to this user operation and display the user interface 19C as shown in Figure 1K . The user interface 19C exemplarily shows that the selected text in the smearing area 192 is "classmeeting". Furthermore, when the electronic device detects a user operation on the input control 191f, it can respond to this user operation and display the selected text in the theme input bar, such as showing the user interface 19D as shown in Figure 1L .
[0097] It should be understood that after the electronic device displays the selected text in the theme input bar, such as showing the user interface 19D as shown in Figure 1L , the user can also edit the text displayed in the theme input bar. For example, click the deletion control 191c of the theme input box to delete the text in the theme input bar, or touch the text in the smearing area 192 to add it again, etc. The present application does not limit this.
[0098] As Figure 1L shown, when the electronic device detects a user operation on the determination control 191b, it can respond to this user operation and display the user interface 19E as shown in Figure 1M . The user interface 19E includes an information bar 193a, a creation control 193b, a smearing control 193c, and other controls. Among them, the information bar 193a is used to display the text information recognized from the first image, the creation control 193b is used to create a schedule based on the content of the current interface, the smearing control 193c is used to return to the theme editing interface (such as the user interface 19D shown in Figure 1L ), and the content of other controls can be referred to the user interface 17 shown in Figure 1G .
[0099] As Figure 1MAs shown, when the electronic device detects a user operation for creating control 193b, it can create a schedule in response to the user operation. Further, it can display a user interface 18 as shown in Figure 1H The content of user interface 18 can be referred to above and will not be elaborated here.
[0100] In the embodiments of the present application, an import control (such as import control 125 shown in user interface 12) is added to the schedule creation interface. The user can select an image stored locally (such as in a gallery application) through the import control. Correspondingly, the electronic device can identify the selected image by the user and create a schedule based on the image. This method can import the image data of other applications (such as a gallery application) into the application for creating a schedule (such as the system calendar) to create a schedule through a simple user operation. This method greatly reduces the user operation and can improve the user experience.
[0101] The second implementation: creating a schedule by sharing an image.
[0102] In the embodiments of the present application, the electronic device can create a schedule based on the image targeted by the sharing operation in response to a sharing operation for a screenshot or a sharing operation for an image in the gallery.
[0103] The following will take Figures 2A to 2F as an example to illustrate by taking sharing a screenshot to trigger schedule creation.
[0104] Figure 2A is an application interface of a ticketing application exemplarily provided in the embodiments of the present application. Figure 2A Exemplarily shows the ticket information of the ticket purchased by the user.
[0105] During the display of Figure 2A the user interface 21 shown, the electronic device can detect a screenshot operation. The above screenshot operation can be realized by acting on the physical keys of the electronic device, such as the power key, volume key, or can also be realized by a touch operation acting on the screen of the electronic device, such as Figure 2A the three-finger swipe down operation or knuckle tapping shown, etc. The present application does not limit this.
[0106] In response to the above screenshot operation, the electronic device can save one frame of the image of the user interface on the screen at the current moment, that is, the screenshot image (screenshot). Further, the electronic device can display a preview image of the above screenshot on the screen to prompt the user to obtain a frame of screenshot. It can be referred to Figure 2B User interface 22 is a user interface exemplarily provided in the embodiments of the present application for displaying a screenshot preview image on the screen. In the present application, the above user interface 21 can be called the first interface, the ticket information in user interface 21 can be called the first schedule information, and the above screenshot can be called the screenshot image of the first interface.
[0107] As shown Figure 2B in FIG. [not shown in the original, assumed placeholder], the user interface 22 may include a floating window 221 and a sharing control 222. Among them, the floating window 221 is used to display Figure 2A a preview of the screenshot of the user interface shown; the sharing control 222 is used to send the above screenshot to other applications.
[0108] Figure 2B Exemplarily, it is shown that the floating window 221 and the sharing control 222 float in the lower left corner area of the screen. It should be understood that the floating window 221 and the sharing control 222 may also be located in other areas of the screen, such as the upper right corner, the lower right corner, the upper left corner, etc. The embodiments of the present application do not limit this; the user interface 22 may also include other controls, such as a control for sliding the screenshot, which is not limited in the present application.
[0109] In the embodiments of the present application, the electronic device may keep displaying the floating window 221 and the sharing control 222 for a period of time according to a preset timer for the user to view. The above period of time is, for example, 3 seconds. After the timer counts down, the electronic device may no longer display the floating window 221 and the sharing control 222.
[0110] As shown Figure 2B in FIG. [not shown in the original, assumed placeholder], the user can touch the sharing control 222. Correspondingly, the electronic device responds to this user operation and displays a sharing window on the original user interface, as shown Figure 2C in FIG. [not shown in the original, assumed placeholder], the user interface 23 displays a sharing window 231. The sharing window 231 is used to display applications that can receive screenshots. Figure 2C Exemplarily, it is shown that the sharing window 231 includes a create schedule icon 231a, an email icon 231b, a Bluetooth icon 231c, and an information icon 231d. It should be understood that the sharing window 231 may also include other application icons. When the number of applications is greater than the window size of the sharing window, the sharing window can display application icons through multiple pages. The user can view other application icons by sliding the content in the sharing window and other means.
[0111] As shown Figure 2C in FIG. [not shown in the original, assumed placeholder], when the electronic device detects a user operation on the create schedule icon 231a, it can respond to this user operation and display a schedule creation window on the original user interface. Exemplarily, the electronic device can display a user interface 24 as shown Figure 2D in FIG. [not shown in the original, assumed placeholder]. The user interface 24 may include a schedule creation window 241. Among them, the schedule creation window 241 is used to display the schedule information and related controls recognized from the screenshot. In the present application, the above create schedule icon 231a may also be referred to as the first icon.
[0112] Exemplarily, the schedule creation window 241 may include an exit control 241a, a creation control 241b, schedule information 241c, a schedule property bar 241d, and a schedule theme bar 241f. This application does not limit the size, position, etc. of the schedule creation window 241. Among them, the exit control 241a is used to exit the schedule creation; the creation control 241b is used to create a schedule based on the content of the schedule creation window 241; the schedule information 241c is used to display the information recognized based on the screenshot, such as "train ticket, December 20, 2023, 21:22, Guangzhou"; the schedule property bar 241d is used to display the schedule properties recognized based on the screenshot, such as "default"; the schedule theme bar 241f is used to display the theme information recognized based on the screenshot, such as "train ticket".
[0113] Optionally, the user can modify the schedule settings through the schedule setting options in the schedule creation window 241 of the user interface 24, such as modifying the schedule properties or changing the time information, etc.
[0114] It should be understood that the sharing operation can also be directed to the image in the chat window. For example, when the user long-presses the image, the electronic device displays a sharing control (such as the sharing control 222 below), and the sharing operation can be an operation on the sharing control.
[0115] Optionally, the schedule creation window 241 may only display some schedule setting options, and the user can indicate the electronic device to display the hidden schedule setting options through a sliding operation. For example Figure 2D As shown, the user can perform a swiping-up operation in the schedule creation window 241. Correspondingly, the electronic device can respond to this user operation and display the hidden schedule setting options. Exemplarily, the electronic device can display a user interface 25 as shown Figure 2E The user interface 25 may include the originally hidden schedule setting options, such as a location bar 251a and a reminder control 251b.
[0116] It should be understood that the above schedule creation window 241 may also have other schedule setting options, such as priority, etc. This application does not limit this. Among them, the priority is used to indicate the importance of the schedule, such as important and ordinary. For example, when the time is approaching, the priority of the schedule is set to important. If the departure time of the above train ticket is close to the current time, the electronic device can set the priority of the schedule to important and can display an "important" identifier in the schedule information.
[0117] In some embodiments, the user can touch the creation control 241b in the user interface 24 shown above Figure 2D or the user interface 25 shown above Figure 2E Correspondingly, the electronic device can create a schedule based on the current schedule information in the schedule creation window and display a user interface 26 as shown Figure 2F above.
[0118] The user interface 26 may include calendar information 260, schedule information 261, and a notification window 262. Among them, the calendar information 260 includes a selected date 260A, and the selected date is the schedule time in the schedule creation window; the schedule information 261 is used to display thumbnail information of the schedule corresponding to the schedule creation window; the notification window 262 is used to remind the user that the created schedule has been saved. Optionally, the notification window 262 may cancel the display after a preset duration of display.
[0119] It should be understood that Figures 2A to 2F Exemplarily, taking the creation of a schedule as an example, the present application can also create multiple schedules based on screenshots, as described above Figure 2A The shown user interface 21 may include multiple ticket information, so that the electronic device can recognize multiple schedule information based on a screenshot including multiple schedule information (such as multiple tickets), and thus create multiple schedules.
[0120] In the embodiment of the present application, an icon for creating a schedule (such as the schedule creation icon 231a) is added to the sharing function, which supports importing image data of other applications (such as the gallery application) into the application for creating a schedule (such as the system calendar) to create a schedule. This method greatly reduces user operations and can improve the user experience.
[0121] The third implementation method: creating a schedule through the intelligent transfer service.
[0122] In the embodiment of the present application, the intelligent transfer service refers to an application that can receive data to be processed, and provides a service for the user to quickly send the data to be processed to the target application. The data to be processed includes but is not limited to text, pictures, videos, documents, hyperlinks, etc. The electronic device can determine the data to be processed according to the operation control when triggering the intelligent transfer.
[0123] In the embodiment of the present application, the data to be processed is data including schedule information (such as image or text information); the target application is an application that provides schedule creation, such as the system calendar. The user can send the data to be processed to the target application through the intelligent transfer service, so that the target application can recognize the schedule information in the data to be processed to create a schedule.
[0124] Next, in combination with Figures 3A to 3E , taking the chat information of the chat application as an example of the data to be processed for illustration.
[0125] Figure 3A is an application interface of a chat application shown in the embodiment of the present application. Figure 3A The shown user interface 31 includes chat information 311 and chat information 312. Figure 3AExemplarily, it is shown that the chat message 311 does not include schedule information, and the chat message 312 includes the schedule information "Class meeting, Classroom, December 12th".
[0126] Taking the chat message 312 selected by the user as the data to be processed as an example, during the process of displaying the chat message 312, the electronic device can detect whether there is a user operation acting on the chat message 312. Refer to Figure 3A , the electronic device can detect a long - press operation acting on the chat message 312. In response to the above - mentioned user operation, the electronic device can switch the chat message 312 to a floating state. Exemplarily, the electronic device can display a user interface 32 as Figure 3B shown. The user interface 32 can include a floating window 321, and the floating window 321 is used to display the chat message 312. The floating window 321 adjusts the display position in real - time following the movement track of the user's touch operation, that is, adjusts the display position of the floating window 321. It should be understood that the chat message 312 can also be an image. In one implementation, if the user long - presses the image and does not release it within a preset time, the electronic device will display the image as a floating window (such as the floating window 321 below). In one implementation, if the user long - presses the image, multiple controls can be displayed, such as a share control. If the user continues to long - press the picture for more than the preset time, the electronic device will display the image as a floating window (such as the floating window 321 below).
[0127] It should be understood that Figure 3A exemplarily, the long - press operation is taken as an example for illustration. In other embodiments of the present application, it can also be other operations, such as clicking, voice commands, double - click operations, etc. In the present application, the above - mentioned chat application can be called the second application, the user interface 31 can be called the second interface of the second application, the area where the above - mentioned chat message 312 is located can be called the first area, the above - mentioned chat message 312 can be called the first text message, and the above - mentioned schedule information "Class meeting, Classroom, December 12th" can be called the first schedule information.
[0128] As Figure 3B shown, the electronic device can detect the operation of the user dragging the floating window 321 and sliding it towards the right side of the screen. After detecting that the floating window 321 is close to the right side of the screen, the electronic device can display a light band. As Figure 3C shown, the user interface 33 includes the floating window 321 and the light band 331. The light band 331 can be used to prompt the user that the floating window 321 has approached the right side of the screen. At this time, the user can determine whether to continue swiping right to trigger the service corresponding to the right side of the screen or stop swiping right to avoid triggering the service corresponding to the right side of the screen.
[0129] In an embodiment of the present application, the service corresponding to the right side of the screen may be a smart transfer service. If smart transfer is triggered, the electronic device may display a menu bar including one or more candidate application icons on the right side of the screen. The candidate applications are applications that can receive the data to be processed selected by the electronic device from all the installed applications.
[0130] As Figure 3C shown, the electronic device may detect a user operation of continuously swiping the floating window 321 to the right. In response to the above operation, the electronic device may trigger the smart transfer service of the right side hot zone and display a menu bar including one or more candidate application icons. For example, the electronic device may display a user interface 34 as shown in the figure. Figure 3D Referring to Figure 3D , the electronic device may display a menu bar 343 on the right side of the screen. The menu bar 343 includes a plurality of application icons. As Figure 3D shown, the menu bar 343 may display: a share icon 343a, a create schedule icon 343b (which may also be referred to as a first icon), a message icon 343c, etc. One icon may correspond to one application program. The application programs corresponding to the above icons are all application programs (candidate applications) that can receive the chat information 312 in the floating window 321. Exemplarily, the application corresponding to the create schedule icon 343b may be the system calendar (which may also be referred to as a first application). It can be understood that when there are too many candidate applications to be displayed in the menu bar 343 at the same time, the electronic device may also update the candidate application icons currently displayed in the menu bar 343 according to the user's drag operation.
[0131] Among them, a hot zone (which may also be referred to as a first area) refers to a touch area with a fixed shape and size on the screen. The right side hot zone is a rectangular touch area extending from the edge of the right side of the screen to the other side.
[0132] Optionally, the electronic device may determine whether the floating window 321 is close to the right side of the screen according to the distance between the position of the current finger's touch point on the screen and the right side hot zone. Further, when it is recognized that the current touch point is within the right side hot zone, the electronic device may determine to trigger the service corresponding to the right side of the screen.
[0133] Exemplarily, the first area may also be the area where the above light band 331 is located.
[0134] In the embodiments of the present application, the service corresponding to the right-side hot zone may be an intelligent transfer service. The intelligent transfer service refers to an application that can receive data to be processed, and provides a service for the user to quickly send the data to be processed to other target applications. The data to be processed includes, but is not limited to, text, pictures, videos, documents, hyperlinks, etc. The electronic device can determine the data to be processed according to the floating window when the intelligent transfer is triggered. For example, in the above scenario, the floating window 321 may be referred to as the first control, and the chat information 312 corresponding to the floating window 321 may be referred to as the data to be processed (or the first data). In the present application, the electronic device can detect a first operation (such as the long-press and drag operation) of dragging the first control (such as the floating window 321) into the first area (such as the right-side hot zone) on the screen, and in response to the first operation, display a first icon (such as the create schedule icon 343b) of the first application (such as the system calendar). It should be understood that the first operation of dragging the first control into the first area on the screen may refer to the right edge of the first control entering the first area, or a part of the first control entering the first area, or the touch point of the finger pressing the first control on the screen entering the first area. The present application does not limit this. For example, the user operation of continuously swiping the floating window 321 to the right as shown in Figure 3C to trigger the display of the above menu bar can be referred to as the first operation of dragging the first control into the first area on the screen.
[0135] At the same time, the original user interface can be adjusted to a right perspective image (such as the image 341 in Figure 3D ) to form an "opening the door" animation effect with the above menu bar 343, enhancing the user experience. In one implementation, after "opening the door", the image displayed on the left is the user interface of the electronic device captured at the trigger moment. That is to say, after "opening the door", during the process of the user selecting the target application, the image on the left is fixed and does not change with time. In some other embodiments, the electronic device can also display the user interface of the original application in real time after "opening the door". At this time, after "opening the door", during the process of the user selecting the target application, the image on the left will change with time.
[0136] As Figure 3D shown, the user can select the target application by dragging the floating window 321 to the area where the target application icon (such as the create schedule icon 343b) is located (which can also be referred to as the second area corresponding to the first icon). Furthermore, after the electronic device detects the user operation of dragging the floating window 321 to the create schedule icon 343b and releasing it, the electronic device can confirm that the system calendar corresponding to the create schedule icon 343b is the target application, identify the schedule information in the chat information in the floating window 321, and display a schedule creation window for the schedule information. Exemplarily, the electronic device can display as Figure 3EThe user interface 35 shown, the user interface 35 may include a schedule creation window 351, and the schedule creation window 351 is used to display schedule information and schedule setting controls identified based on chat information. In this application, the schedule information included in the chat information 312 may be referred to as first schedule information, and the schedule information displayed in the schedule creation window 351 may be referred to as second schedule information; the schedule creation window 351 may also be referred to as the first window.
[0137] In this application, the second area corresponding to the first icon may refer to the area where the first icon is located, or may refer to the area within a preset distance from the first icon. This application does not make a limitation in this regard.
[0138] For details such as the controls of the schedule creation window 351, reference may be made to the relevant introduction of the schedule creation window 241 in the user interface 24 shown above Figure 2D and will not be elaborated here.
[0139] Optionally, after detecting that the floating window 321 is dragged to the position corresponding to the schedule creation icon, the electronic device may highlight the schedule creation icon, such as enlarging, changing color, etc., to prompt the user that the application corresponding to the currently selected schedule creation icon is the target application, avoiding mistransmission.
[0140] In some other embodiments of this application, the user can identify schedule information for a screenshot through the intelligent transfer service. Exemplarily, the user can take a screenshot of the Figure 2A user interface 21 shown, and correspondingly, the electronic device can respond to this user operation and display as Figure 2B the user interface 22 shown; furthermore, the user can drag the floating window 221 in the user interface 22 to the right side of the screen, and the specific operation can be as the Figures 3B to 3D user operation shown above, trigger the intelligent transfer service, so that the electronic device can send the screenshot in the floating window 221 to the system calendar, identify the schedule for the screenshot, and display as Figure 2D the user interface 24 shown.
[0141] It should be understood that the above Figures 3A to 3E exemplarily shows the scenario of triggering the intelligent transfer service for chat information; in this application, after performing long - press and drag operations such as the above Figures 3A to 3D on screenshots, images or text information in the gallery, etc., the intelligent transfer service can be triggered to generate a schedule, and this application does not limit the carrier of the schedule information (such as images or text).
[0142] Exemplarily, the electronic device may display a third interface of a third application (such as a chat application), and the third interface includes a plurality of dialog boxes; when the third interface is displayed, a long - press operation on the third interface is detected; in response to the long - press operation on the third interface, a first control (such as a floating window including the above - mentioned plurality of dialog boxes) is displayed on the third interface. Further, the electronic device may, in response to a first operation of long - pressing on the third interface without releasing and dragging it to a hot zone, display the above - mentioned first icon; a second operation of detecting and continuing to drag the first control into a second area where the first icon is located and releasing is detected; in response to the second operation, the above - mentioned first window is displayed. Among them, during the long - press operation and the first operation, the mobile phone does not leave the screen, that is, the long - press operation and the drag operation are continuous operations without releasing the hand.
[0143] In another example, the electronic device may display a fourth interface of a gallery application, and the fourth interface includes a first image; when the fourth interface is displayed, a long - press operation on the first image is detected; in response to the long - press operation on the first image, the above - mentioned first control is displayed on the fourth interface, and the first data is the first image. It should be understood that the above - mentioned long - press operation is only an example, and in this application, the above - mentioned long - press operation may also be replaced by other user operations. The other user operations may be touch operations of the user (such as click operation, upward - sliding operation, downward - sliding operation, or side - sliding operation), may also be non - contact operations (such as air gestures or mouse operations), or may also be voice commands of the user. This application does not make specific limitations on this.
[0144] In the embodiments of this application, through the intelligent transfer service, the data to be processed can be simply and quickly selected to create a schedule based on the data to be processed, which is convenient to operate and can improve the user experience.
[0145] The fourth implementation method: creating a schedule by pressing and recognizing the screen.
[0146] In the embodiments of this application, the user can extract the text information of the current interface by pressing with two fingers. Correspondingly, the electronic device, in response to this user operation, displays the extracted text information and a creation control, and the creation control is used to create a schedule based on the extracted text information; further, when the electronic device detects a user operation on the creation control, it can, in response to this user operation, recognize schedule information based on the extracted text, and the recognized schedule is used to create a schedule.
[0147] Next, in combination with Figures 4A to 4B , taking the application interface of the chat application as an example for introduction by way of example.
[0148] Figure 4A is an application interface of a chat application shown in the embodiments of this application. Figure 4A The shown user interface 41 includes chat information 311 and chat information 312. Figure 4AExemplarily, it is shown that the chat message 311 does not include schedule information, and the chat message 312 includes the schedule information "Class meeting, Classroom, December 12th". In this application, the above chat application may also be referred to as the fourth application, the user interface 41 may also be referred to as the eighth interface of the fourth application, and the schedule information included in the chat message 312 may also be referred to as the first schedule information.
[0149] As Figure 4A shown, when the electronic device detects a user operation of double-finger pressing on the screen, it can respond to this user operation and extract the text in the currently displayed user interface 41 on the screen. During the recognition process, the electronic device can display the animation effect of the scanning interface (not shown in the figure); after the extraction is completed, it can display as Figure 4B shown in the user interface 42. The user interface 42 exemplarily uses a dashed box to indicate the extracted text. The electronic device can also highlight the extracted text in other ways, such as color-smearing the area where the text is located, etc. This application does not make any limitations in this regard.
[0150] In some other embodiments of this application, the user operation for extracting the text currently displayed on the screen may not be limited to the above-mentioned user operation of double-finger pressing on the screen, and may also be a click operation, a long-press operation, a swipe-up operation, a swipe-down operation, or a side-swipe operation, etc. This application does not make specific limitations in this regard.
[0151] The user interface 42 may include an add control 421 and a more control 422. Among them, the add control 421 is used to identify schedule information from the text extracted from the interface; the more control 422 may include other options for performing other operations on the text. This application does not make any limitations in this regard.
[0152] As Figure 4B shown, when the electronic device detects a user operation on the add control 421, it can respond to this user operation and display, through a floating window on the original user interface, the schedule information identified from the text extracted from the interface. Exemplarily, the electronic device can display as Figure 3E shown in the user interface 35. The user interface 35 may include a schedule creation window 351. In this application, the above-mentioned user operation of double-finger pressing on the screen may be referred to as the user operation acting on the eighth interface, the add control 421 may be referred to as the third control, and the schedule creation window 351 may also be referred to as the first window.
[0153] In the embodiments of this application, as Figure 4AAs shown, when the electronic device detects a user operation of pressing the screen with two fingers, it can also respond to the user operation and trigger the intelligent transfer service described above to create a schedule. For example, when the duration of pressing with two fingers meets a preset duration, the electronic device can respond to the user operation and display all the text recognized on the interface as floating windows; further, in response to the dragging operation of the user pressing and holding without releasing, it displays the application icons corresponding to the intelligent transfer service, including the schedule creation icon (such as the schedule creation icon 231a); further, in response to the user operation of dragging to the schedule creation icon, it displays a schedule creation window (such as the schedule creation window 351). For the detailed process, reference can be made to the relevant content of the intelligent transfer service described above.
[0154] In the embodiments of the present application, through the method of recognizing the screen by pressing, it is possible to recognize the text in the entire interface and create a schedule based on the recognized text. This method can conveniently select the text in the entire interface to create a schedule, simplifying the creation steps.
[0155] Next, the "multiple schedule recognition" function, "context reasoning" function, and "location recommendation" function of the electronic device will be introduced. The above functions can be enabled by default or through controls, and the present application does not limit this.
[0156] In some embodiments of the present application, when the data to be processed includes the schedule information of multiple schedules, the electronic device can recognize the schedule information of multiple schedules in the data to be processed, and then display the schedule information of multiple schedules. Among them, the data to be processed can be a screenshot, or multiple dialog boxes, or an image, and the present application does not limit this.
[0157] Exemplarily, the following combines Figures 5A to 5G , to introduce the "multiple schedule recognition" function of the electronic device.
[0158] Figure 5A is the application interface of a chat application shown in the embodiments of the present application. Figure 5A The shown user interface 51 includes chat information 511. In the embodiments of the present application, it is exemplarily shown that the chat information 511 includes two schedule information. The first schedule information is "Meeting 1, Conference Room 303, Next Wednesday (12.20)", and the second schedule information is "Meeting 2, Conference Room 301, Next Thursday (12.21)". It should be understood that in other embodiments of the present application, the above two schedule information may also be located in two chat messages, and the two chat messages may also be in the form of a conversation, or both may be chat messages received by the electronic device. In the present application, the two schedule information included in the chat information 511 may also be referred to as the schedule information of the second schedule and the schedule information of the third schedule.
[0159] During the process of displaying chat message 511, the electronic device can detect whether there is a user operation acting on chat message 511. Refer to Figure 5A , the electronic device can detect a long - press operation acting on chat message 511. Among them, the long - press operation acting on chat message 511 can be a long - press operation that lasts for more than a certain period of time. In response to the above user operation, the electronic device can switch chat message 511 to a floating state. Exemplarily, the electronic device can display a user interface 52 as shown in Figure 5B . The user interface 52 can include a floating window 521, and the floating window 521 is used to display chat message 511. The floating window 521 adjusts its display position in real - time following the movement track of the user's touch operation, that is, adjusts the display position of the floating window 521.
[0160] As shown in Figure 5B , the electronic device can detect an operation where the user drags the floating window 521 and slides it towards the right side of the screen. After detecting that the floating window 521 is close to the right side of the screen, the electronic device can display a light band. As shown in Figure 5C , the user interface 53 includes a floating window 521 and a light band 531. The light band 531 can be used to prompt the user that the floating window 521 has approached the right side of the screen. At this time, the user can determine whether to continue swiping right to trigger the service corresponding to the right side of the screen or stop swiping right to avoid triggering the service corresponding to the right side of the screen.
[0161] In the embodiment of the present application, the service corresponding to the right side of the screen can be a smart transfer service. If the smart transfer is triggered, the electronic device can display a menu bar including one or more candidate application icons on the right side of the screen. The candidate applications are applications that can receive the data to be processed selected by the electronic device from all the installed applications.
[0162] As shown in Figure 5C , the electronic device can detect a user operation of continuing to swipe right. In response to the above operation, the electronic device can trigger the smart transfer service and display a menu bar including one or more candidate application icons. For example, the electronic device can display a user interface 54 as shown in Figure 5D . Refer to Figure 5D , the electronic device can display a menu bar 543 on the right side of the screen. The menu bar 543 includes multiple application icons. As shown in Figure 5D , the menu bar 543 can display: a share icon 543a, a create schedule icon 543b, a message icon 543c, etc. One icon corresponds to one application program. The application programs corresponding to the above icons are all application programs (candidate applications) that can receive the chat message 511 in the floating window 521. It can be understood that when there are too many candidate applications to be displayed in the menu bar 543 at the same time, the electronic device can also update the candidate application icons currently displayed in the menu bar 543 according to the user's drag operation.
[0163] Meanwhile, the original user interface can be adjusted to a right perspective image (as shown in the image 541 in Figure 5D ), forming an animation effect of "opening the door" with the above-mentioned menu bar 543, enhancing the user experience. In one implementation, after "opening the door", the image displayed on the left is the user interface of the electronic device captured at the triggering moment. That is to say, after "opening the door", during the process of the user selecting the target application, the left image is fixed and does not change over time. In some other embodiments, the electronic device can also display the user interface of the original application in real time after "opening the door". At this time, after "opening the door", during the process of the user selecting the target application, the left image will change over time.
[0164] As shown in Figure 5D , the user can drag the floating window 521 to the area where the target application icon (such as the create schedule icon 543b) is located. The electronic device can respond to the user operation of dragging the floating window 521 to the create schedule icon and releasing it, identify the schedule information in the chat information in the floating window 521, and display a schedule creation window, which can include multiple identified schedule information. Exemplarily, the electronic device can display a user interface 55 as shown in Figure 5E . The user interface 55 can include a schedule creation window 551.
[0165] Among them, the schedule creation window 551 can include multiple identified schedule information, such as the first schedule information 551c and the second schedule information 551d. Figure 5E The first schedule information 551c is indicated as the selected schedule information with a bold border; the schedule creation window 551 can also include an exit control 551a and schedule options corresponding to the selected schedule information (such as the first schedule information 551c), such as a create control 551b, a schedule property bar 551e, and a schedule theme bar 551f; the exit control 551a is used to exit the schedule creation; the create control 551b is used to create a schedule based on the content of the schedule creation window 551. It should be understood that multiple schedule information in the schedule creation window 551 can be in the selected state at the same time, and this application does not limit this. In this application, the area where the first schedule information 551c is located can be called the second area, and the first schedule information 551c can also be called the schedule information of the second schedule; the area where the second schedule information 551d is located can also be called the third area, and the second schedule information 551d can also be called the schedule information of the third schedule; the create control 551b can also be called the second control, and the schedule creation window 551 can also be called the first window.
[0166] Optionally, the user can select the first schedule information 551c and / or the second schedule information 551d. Correspondingly, the electronic device can, in response to this user operation, display the schedule options corresponding to the schedule information in the selected state in the schedule creation window 551. Further, the user can modify the schedule information corresponding to the option through the schedule option corresponding to the schedule information, or the user can click the creation control 551b to create a schedule corresponding to the schedule information in the selected state.
[0167] Figure 5E Exemplarily, it is shown that the first schedule information 551c is in the selected state and the second schedule information 551d is in the unselected state. At this time, if the user clicks the creation control 551b, the electronic device can, in response to this user operation, create a schedule corresponding to the first schedule information 551c.
[0168] Exemplarily, the user can change the first schedule information 551c from the selected state to the unselected state by touching, or can change the second schedule information 551d from the unselected state to the selected state by touching. At this time, if the user clicks the creation control 551b, the electronic device can, in response to this user operation, create a schedule corresponding to the second schedule information 551d and display the sixth interface of the first application (such as the system calendar). The sixth interface includes thumbnail information of the schedule corresponding to the second schedule information 551d (which can also be called the second schedule), and the thumbnail information of the second schedule can be as shown by the first schedule information 571 in the user interface 57.
[0169] As Figure 5E shown, when the electronic device detects a user operation on the second schedule information 551d, it can, in response to this user operation, display the second schedule information 551d in the selected state. For example, the electronic device can display a user interface 56 as shown in Figure 5F which includes the first schedule information 561c and the second schedule information 561d both in the selected state, as well as the exit control 551a and the creation control 561b corresponding to the schedule information in the selected state.
[0170] As Figure 5F shown, when the electronic device detects a user operation on the creation control 561b, it can, in response to this user operation, create a schedule based on the schedule information in the selected state in the schedule creation window (that is, create a schedule based on the first schedule information 561c and the second schedule information 561d), and display a user interface 57 as shown in Figure 5G which is shown.
[0171] The user interface 57 may include calendar information 570, first schedule information 571, second schedule information 572, and a notification window 573. Among them, the calendar information 570 includes a selected date 570A, and the selected date is the schedule time in the schedule creation window; the first schedule information 571 is a thumbnail of the first schedule information 561c; the second schedule information 572 is a thumbnail of the second schedule information 561d; the notification window 573 is used to remind the user that the created schedule has been saved. Optionally, the notification window 573 may cancel the display after a preset duration of display. In this application, the user interface 57 may also be referred to as the seventh interface of the first application (such as the system calendar), the first schedule information 571 may also be referred to as the thumbnail of the second schedule; the second schedule information 572 may also be referred to as the thumbnail of the third schedule.
[0172] It should be understood that the above Figures 5A to 5G is an exemplary introduction that a chat message includes multiple schedule information, and multiple schedules are created based on the chat message through the intelligent transfer service. In other embodiments of this application, it may be that the screenshot contains multiple schedule information, or it may be that multiple dialog boxes include multiple schedule information, or the pictures selected in the gallery include multiple schedule information, etc. This application does not limit the carrier of the multiple schedule information; it is also possible to trigger the creation of a schedule by importing an image or sharing, etc., and this application does not limit this.
[0173] Exemplarily, the user may also import an image including multiple schedule information to create multiple schedules. For example, the first image in the above Figures 1A to 1H may also include multiple schedule information, so that the electronic device can recognize the multiple schedules in the first image to create multiple schedules.
[0174] Another exemplarily, the user may also import multiple images including multiple schedule information to create multiple schedules. For example, in the above Figure 1C the user can select multiple images, and the multiple images include multiple schedule information. For example, Image 1 includes the first schedule information, and Image 2 includes the second schedule information. In response to the operation as above Figures 1D to 1H so that the electronic device can recognize the multiple schedules in the multiple images to create multiple schedules.
[0175] Another exemplarily, the user may also create multiple schedules by sharing a screenshot or text to an application for creating a schedule (such as the system calendar). For example, the screenshot in the above Figures 2A to 2F may also include multiple schedule information, so that the electronic device can recognize the multiple schedules in the first image to create multiple schedules;
[0176] In another exemplary case, the user can also long - press the screen to identify multiple schedules in multiple dialog boxes to create multiple schedules. For example, a third interface of a third application (such as a chat application) is displayed. The third interface includes multiple dialog boxes; when the third interface is displayed, a long - press operation on the third interface is detected; in response to the long - press operation on the third interface, a first control (such as a floating window including the above - mentioned multiple dialog boxes) is displayed on the third interface. The first data is the content of the multiple dialog boxes, and the first data includes multiple schedule information, which is not limited in this application.
[0177] In the embodiments of the present application, when the data to be processed includes schedule information of multiple schedules, the electronic device can identify the schedule information of multiple schedules in the data to be processed, and then display the schedule information of multiple schedules. For example, the identified multiple schedule information is displayed in the above - mentioned schedule creation window 551, such as the first schedule information 551c and the second schedule information 551d. This method can quickly create multiple schedules, without the need for the user to perform multiple creation operations, which can reduce the creation time and improve the user experience.
[0178] In some embodiments of the present application, when the data to be processed includes multiple rounds of conversations, the electronic device can perform context reasoning on the data to be processed to determine the schedule information in the data to be processed.
[0179] Exemplarily, the "context reasoning" function of the electronic device is introduced below by taking Figures 6A to 6D double - finger pressing the screen as an example. It should be understood that the data to be processed on the current application interface can also be sent to the target application (such as a system application) through the above - mentioned screenshot sharing or intelligent transfer after screenshotting, etc., which is not limited in this application.
[0180] Figure 6A is an application interface of a chat application shown in the embodiments of the present application. Figure 6A The shown user interface 61 includes multiple rounds of conversations between two users.
[0181] Such as Figure 6A shown, when the electronic device detects a user operation of double - finger pressing the screen, it can respond to this user operation, extract the text in the user interface 61 currently displayed on the screen, and the electronic device can display the dynamic effect of the scanning interface during the recognition process (not shown in the figure); after the extraction is completed, a user interface 62 as shown in Figure 6B can be displayed. The user interface 62 uses a dotted line box to exemplarily indicate the extracted text. The electronic device can also highlight the extracted text in other ways, such as coloring the area where the text is located, etc., which is not limited in this application.
[0182] The user interface 62 may include an add control 621 and more controls 622. The add control 621 is used to identify schedule information from the text extracted from the interface. The more controls 622 may include other options for performing other operations on the text, which are not limited in this application.
[0183] As Figure 6B shown, when the electronic device detects a user operation on the add control 621, it can respond to the user operation and display, through a floating window on the original user interface, the schedule information identified from the text extracted from the interface. Exemplarily, the electronic device can display a user interface 63 as Figure 6C shown. The user interface 63 may include a schedule creation window 631, and the schedule creation window 631 is used to display the schedule information identified based on the text extracted from the interface.
[0184] Exemplarily, the schedule creation window 631 includes an exit control 631a, a creation control 631b, schedule information 631c, a schedule property bar 631d, and a schedule theme bar 631f.
[0185] Among them, the exit control 631a is used to exit the schedule creation; the creation control 631b is used to create a schedule based on the schedule information in the schedule creation window 631; the schedule information 631c is used to display the schedule information identified based on the text extracted from the interface, such as "communicate with Teacher Xu about business, December 20th, 14:00, Room 205, Main Building of XX University"; the schedule property bar 631d is used to display the schedule properties identified based on the text extracted from the interface, such as "default"; the schedule theme bar 631f is used to display the theme information "communicate with Teacher Xu about business" identified based on the screenshot. It should be understood that the "December 20th" in the schedule information 631c is the time information inferred based on the time information "such as Friday" etc. identified from the text extracted from the interface.
[0186] In this application, the user can modify the schedule information based on the controls in the schedule creation window 631. For example, the user can edit the schedule theme through the smearing control in the schedule theme bar 631f. If the user clicks on the smearing control in the schedule theme bar 631f, the electronic device can display a smearing area as Figure 1F shown for the user to select, which is not limited in this application.
[0187] As Figure 6C shown, when the electronic device detects a user operation on the creation control 631b, it can respond to the user operation, create a schedule based on the current schedule information in the schedule creation window 631, and display a user interface 64 as Figure 6D shown.
[0188] The user interface 64 may include calendar information 640, schedule information 641, and a notification window 642. Among them, the calendar information 640 includes a selected date 640A, and the selected date is the schedule time in the schedule creation window 631; the schedule information 641 is used to display thumbnail information of the schedule corresponding to the schedule creation window; the notification window 642 is used to remind the user that the created schedule has been saved. Optionally, the notification window 642 may cancel the display after a preset duration is displayed.
[0189] It should be understood that this application does not limit the size, position, etc. of the schedule creation window 631. Other options and window features of the schedule creation window 631 can refer to the relevant description of the schedule creation window 241, which will not be elaborated here.
[0190] It should be noted that the above Figures 6A to 6D is exemplarily described by taking two-finger pressing on the screen as an example. In this application, the user can also send the above multi-round conversation to an application for importing and creating a schedule (such as the system calendar) through the intelligent transfer service to create a schedule. For example, the user can long-press the user interface 61 until the electronic device displays the multi-round conversation in the user interface 61 as a floating window; then, in response to the dragging operation of the user pressing and not releasing, display the application icon corresponding to the intelligent transfer service, including the schedule creation icon (such as the schedule creation icon 231a); then, in response to the user operation of dragging to the schedule creation icon, display the schedule creation window (such as the schedule creation window 351). The detailed process can refer to the relevant content of the intelligent transfer service in the above text.
[0191] In the embodiment of this application, when the data to be processed includes multi-round conversations, the electronic device can perform context reasoning on the data to be processed to determine the schedule information in the data to be processed. This method does not require the user to extract schedule information from the conversation content, can realize intelligent recognition of schedule information, simplifies the time for creating a schedule, and can improve the user experience.
[0192] In some embodiments of this application, after the electronic device recognizes a location from the data to be processed, based on the recognized location and the user's relevant address information, obtain a recommended location; display the recommended location. Among them, the user's relevant address information may be a location that the user often goes to (such as a location often navigated to).
[0193] Exemplarily, the user can enable the permission to obtain the address in the system calendar, and the system calendar can store the addresses the user has been to; then, after recognizing a location from the data to be processed, it can match the recognized location (such as a kindergarten) with the stored addresses. If the Central Kindergarten meets the matching principle, the Central Kindergarten can be used as the recommended location for display.
[0194] Exemplarily, the following is combined with Figures 7A to 7G, introduce the "location recommendation" function of the electronic device.
[0195] Figure 7A It is the application interface of a chat application shown in the embodiments of the present application. Figure 7A The shown user interface 71 includes chat information 711.
[0196] During the process of displaying the chat information 711, the electronic device can detect whether there is a user operation acting on the chat information 711. Refer to Figure 7A , the electronic device can detect a long - press operation acting on the chat information 711. In response to the above user operation, the electronic device can switch the chat information 711 to a floating state. Exemplarily, the electronic device can display as Figure 7B shown in the user interface 72. The user interface 72 can include a floating window 721, and the floating window 721 is used to display the chat information 711. The floating window 721 adjusts the display position in real - time following the movement track of the user's touch operation, that is, adjusts the display position of the floating window 721.
[0197] As Figure 7B shown, the electronic device can detect the operation that the user drags the floating window 721 and slides it to the right side of the screen. After detecting that the floating window 721 is close to the right side of the screen, the electronic device can display a light band. As Figure 7C shown, the user interface 73 includes the floating window 721 and the light band 731. The light band 731 can be used to prompt the user that the floating window 721 has been close to the right side of the screen. At this time, the user can determine to continue swiping right to trigger the service corresponding to the right side of the screen, or stop swiping right to avoid triggering the service corresponding to the right side of the screen.
[0198] In the embodiments of the present application, the service corresponding to the right side of the screen can be the intelligent transfer service. If the intelligent transfer is triggered, the electronic device can display a menu bar including one or more candidate application icons on the right side of the screen. The candidate applications are the applications that can receive the data to be processed screened by the electronic device from all the installed applications.
[0199] As Figure 7C shown, the electronic device can detect the user operation of continuing to swipe right. In response to the above operation, the electronic device can trigger the intelligent transfer service and display a menu bar including one or more candidate application icons. For example, the electronic device can display as Figure 7D shown in the user interface 74. Refer to Figure 7D , the electronic device can display a menu bar 743 on the right side of the screen. The menu bar 743 includes multiple application icons. As Figure 7DAs shown, the menu bar 743 may display: a share icon 743a, a create schedule icon 743b, a message icon 743c, etc. One icon corresponds to one application program. The application programs corresponding to the above icons are all application programs (candidate applications) that can receive the chat information 711 in the floating window 721. It can be understood that when there are too many candidate applications to be displayed in the menu bar 743 at the same time, the electronic device can also update the candidate application icons currently displayed in the menu bar 743 according to the user's drag operation.
[0200] At the same time, the original user interface can be adjusted to a right perspective image (such as the image 741 shown in Figure 7D ), which forms an "opening the door" animation effect with the above menu bar 743 to enhance the user experience. In one implementation, after "opening the door", the image displayed on the left is the user interface of the electronic device captured at the trigger moment. That is to say, after "opening the door", during the process of the user selecting the target application, the left image is fixed and does not change with time. In some other embodiments, the electronic device can also display the user interface of the original application in real time after "opening the door". At this time, after "opening the door", during the process of the user selecting the target application, the left image will change with time.
[0201] Such as Figure 7D shown, the user can drag the floating window 721 to the area where the target application icon (such as the create schedule icon 743b) is located. The electronic device can respond to the user operation of dragging the floating window 721 to the create schedule icon and releasing it, identify the schedule information in the chat information 711 in the floating window 721, and display a schedule creation window, which can include multiple identified schedule information. Exemplarily, the electronic device can display a user interface 75 as shown in Figure 7E . The user interface 75 may include a schedule creation window 751.
[0202] Exemplarily, the schedule creation window 751 may include an exit control 751a, a create control 751b, and schedule information 751c. Among them, the exit control 751a is used to exit the schedule creation; the create control 751b is used to create a schedule based on the content of the schedule creation window 751; the schedule information 751c is used to display the information obtained based on the chat information 711, such as "picking up the child, 18:00 on December 20th, kindergarten, and Central Kindergarten". Among them, "Central Kindergarten" is a recommended location obtained by combining "kindergarten" in the chat information 711 with the user's relevant address information. In this application, "kindergarten" in the chat information 711 can be called the first location information, "Central Kindergarten" can also be called the second location information, and the schedule creation window 751 can also be called the first window.
[0203] Such as Figure 7EAs shown, the user can perform a swiping-up operation in the schedule creation window 751. Correspondingly, the electronic device can respond to this user operation and display hidden schedule setting options. Exemplarily, the electronic device can display a user interface 76 as shown in Figure 7F . The user interface 76 can include previously hidden schedule setting options, such as a location bar 761a.
[0204] Among them, the location bar 761a can include a cancellation control 761b. The cancellation control 761b is used to delete the current location, and the location bar 761a is used to input a location.
[0205] In some embodiments, the user can touch the creation control 751b in the user interface 75 shown in the above Figure 7E or the user interface 76 shown in Figure 7F . Correspondingly, the electronic device can create a schedule based on the current schedule information in the schedule creation window and display a user interface 77 as shown in Figure 7G .
[0206] The user interface 77 can include calendar information 770, schedule information 771, and a notification window 772. Among them, the calendar information 770 includes a selected date 770A, and the selected date is the schedule time in the schedule creation window 751 (i.e., December 20th); the schedule information 771 is used to display thumbnail information of the schedule corresponding to the schedule creation window; the notification window 772 is used to remind the user that the created schedule has been saved. Optionally, the notification window 772 can cancel the display after a preset duration. In this application, the user interface 77 can be referred to as the fifth interface of a first application (such as the system calendar), and the schedule information 771 can also be referred to as the thumbnail information of the first schedule.
[0207] It should be understood that the application programs in this application (such as the above-mentioned ticket purchasing application, chat application, etc.) can be system application programs or third-party application programs. In the embodiments of this application, a system application program refers to an application program directly provided by the operating system of the electronic device for implementing specific functions. A third-party application program refers to an application program provided by other developers obtained by the electronic device through the Internet for implementing specific functions.
[0208] In the embodiments of this application, after the electronic device identifies a location from the data to be processed, it can obtain a recommended location based on the identified location and the user's relevant address information, and display the recommended location. This method can realize intelligent recommendation of locations, does not require the user to supplement schedule information by himself, simplifies the time for creating a schedule, and can improve the user experience.
[0209] In some embodiments of the present application, the electronic device may send the data to be processed (such as the images and texts selected by the user) to the server, and the server may identify the schedule information based on the data to be processed. Further, the server sends the identified schedule information (such as schedule theme, location, and time) to the electronic device, and the electronic device displays the above schedule information.
[0210] In a possible implementation, the server may use deep learning to identify the schedule information in the data to be processed. It should be noted that in other embodiments of the present application, it may also be the electronic device that identifies the schedule information in the data to be processed, and the present application does not limit this.
[0211] Exemplarily, the server may train a neural network based on training data so that the trained neural network (for the convenience of description, simply referred to as the target neural network) has the ability to identify schedule themes, locations, and times.
[0212] Exemplarily, when the data to be processed includes text within the time recognition range, the target neural network can identify the date, time, and priority from the text. Among them, the identified date may include specific information of year, month, week, and day; the identified time may include a time point or a time period; the priority is used to indicate the importance level of the schedule, such as important and ordinary. Table 1 exemplarily shows the text within the time recognition range and the date information that can be recognized from the text. For example, when the text within the time recognition range in the data to be processed includes a relative year (such as "next year"), if this year is 2023, the target neural network can identify the specific information of the year as "2024" based on "next year". Another example is that when the text within the time recognition range in the data to be processed includes a degree word (such as "very") or an important word (such as "urgent"), the target neural network can identify the priority of the schedule as "important".
[0213] Optionally, when the time is approaching, the target neural network can also set the priority of the schedule to important. For example, in the above Figures 7A to 7G shown embodiment, since the time point "6:00 p.m." is relatively close to the current time, the target neural network can set the priority of the schedule to important.
[0214] Table 1
[0215]
[0216] Exemplarily, Table 2 exemplarily shows the topic classification rules for the training data of training the target neural network. Among them, if the target neural network cannot recognize the specific classification in the topic classification definition based on the data to be processed, it will recognize the topic of the secondary classification based on the data to be processed, and use the topic of the secondary classification as the recognized topic. Optionally, the target neural network can also recognize the topic of the primary classification based on the data to be processed. The topic of the primary classification is used for topic recommendation. For example, when the target neural network does not recognize the specific classification and the content of the topic of the secondary classification in the data to be processed, it can recognize the primary classification corresponding to the data to be processed and display the recommended topic in the topic column. For example, in Figure 1E the schedule topic column 153 of
[0217] Table 2
[0218]
[0219] Exemplarily, the chat information displayed on the electronic device includes "There will be a meeting at 2 pm, which is important". The user selects this chat information as the data to be processed, such as long-pressing the chat information until it becomes a floating state and then dragging it to the create schedule icon, or long-pressing the chat information until the sharing control is displayed and then clicking to share it to the create schedule icon. Furthermore, the electronic device can recognize the schedule information in the data to be processed through the above target neural network. When it recognizes that the schedule information includes the fuzzy time point "2 pm", based on Table 1 above and this fuzzy time point, if the current day is December 20, 2023, the electronic device can determine the time as "16:00 on December 20, 2023". When it recognizes that the schedule information includes "important", the electronic device can set the priority of this schedule as important based on Table 1. When it recognizes that the schedule information includes "meeting", the electronic device can determine that the schedule topic is "Meeting" in Table 2 above.
[0220] Next, the form and software and hardware architecture of the electronic device provided in the embodiments of the present application will be introduced.
[0221] The electronic device can be equipped with Portable terminal devices of other operating systems, such as mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebooks, ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, personal digital assistants (PDAs), augmented reality (AR) devices, virtual reality (VR) devices, artificial intelligence (AI) devices, wearable devices, in-vehicle devices, smart home devices, and / or smart city devices, etc.
[0222] Figure 8 Exemplarily shows the hardware structure of the electronic device according to the embodiments of the present application. As Figure 8 shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 126, a camera 130, a display screen 140, an audio module 150, a speaker 150A, a receiver 150B, a microphone 150C, a headphone interface 150D, and a sensor module 160. Among them, the sensor module 160 may include a pressure sensor 160A, a distance sensor 160F, a proximity light sensor 160G, a touch sensor 160K, an ambient light sensor 160L, etc.
[0223] Among them, the processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.
[0224] Among them, the controller may be the nerve center and command center of the electronic device. The controller may generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.
[0225] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses and reduces the waiting time of the processor 110, thus improving the efficiency of the system.
[0226] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0227] It can be understood that the interface connection relationships among the modules illustrated in the embodiments of the present application are only illustrative descriptions and do not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods or a combination of multiple interface connection methods in the above embodiments.
[0228] The internal memory 126 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).
[0229] Random access memory may include static random-access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM, for example, the fifth generation of DDR SDRAM is generally referred to as DDR5 SDRAM), etc.;
[0230] Non-volatile memory may include disk storage devices and flash memory.
[0231] Flash memory can be classified into NOR FLASH, NAND FLASH, 3D NAND FLASH, etc. according to the operating principle, and can be classified into single-level cell (SLC), multi-level cell (MLC), triple-level cell (TLC), quad-level cell (QLC), etc. according to the number of potential levels of storage cells. According to the storage specification, it can include universal flash storage (UFS), embedded multi media Card (eMMC), etc.
[0232] Random access memory can be directly read and written by the processor 110, can be used to store the operating system or executable programs (such as machine instructions) of other running programs, and can also be used to store data of users and application programs, etc.
[0233] Non-volatile memory can also store executable programs and data of users and application programs, etc., and can be pre-loaded into random access memory for direct reading and writing by the processor 110.
[0234] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the electronic device. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external non-volatile memory.
[0235] The electronic device realizes the display function through the GPU, the display screen 140, the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 140 and the application processor. The GPU is used to execute mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.
[0236] The display screen 140 is used to display images, videos, etc. The display screen 140 includes a display panel. The display panel can adopt a liquid crystal display (LCD). The display screen panel can also adopt an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniled, a microLed, a micro-oled, a quantum dot light-emitting diode (QLED), etc. to manufacture. In some embodiments, the electronic device may include 1 or N display screens 140, where N is a positive integer greater than 1.
[0237] The electronic device can realize the shooting function through the ISP, the camera 130, the video codec, the GPU, the display screen 140, the application processor, etc.
[0238] The ISP is used to process the data fed back by the camera 130. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera sensor. The optical signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, etc. of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 130.
[0239] The camera 130 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format such as RGB or YUV. In some embodiments, the electronic device may include one or N cameras 130, where N is a positive integer greater than 1.
[0240] In the embodiments of the present application, the camera 130 may be a telephoto camera, a main camera, a wide-angle camera, or the like.
[0241] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.
[0242] The video codec is used to compress or decompress digital videos. The electronic device can support one or more video codecs. In this way, the electronic device can play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0243] The NPU is a neural-network (NN) computing processor. By learning from the biological neural network structure, such as learning from the transmission mode between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0244] The electronic device can implement audio functions through the audio module 150, the speaker 150A, the receiver 150B, the microphone 150C, the headphone jack 150D, and the application processor, etc. For example, music playback, recording, etc.
[0245] The audio module 150 is used to convert digital audio information into an analog audio signal for output, and is also used to convert analog audio input into digital audio signals. The audio module 150 can also be used to encode and decode audio signals. In some embodiments, the audio module 150 may be disposed in the processor 110, or some functional modules of the audio module 150 may be disposed in the processor 110.
[0246] The speaker 150A, also known as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. The electronic device can listen to music or a hands-free call through the speaker 150A.
[0247] The receiver 150B, also known as an "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device answers a call or a voice message, the user can listen to the voice by holding the receiver 150B close to the ear.
[0248] The microphone 150C, also known as a "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak with their mouth close to the microphone 150C to input the sound signal into the microphone 150C. The electronic device can be provided with at least one microphone 150C. In some other embodiments, the electronic device can be provided with two microphones 150C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device can also be provided with three, four or more microphones 150C to collect sound signals, reduce noise, identify the sound source, and implement functions such as directional recording.
[0249] The headphone jack 150D is used to connect a wired headphone. The headphone jack 150D can be a USB interface or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0250] The structure illustrated in the embodiments of the present application does not specifically limit the electronic device. In some other embodiments of the present application, the electronic device can include more or fewer components than those illustrated, or combine certain components, or split certain components, or have different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. For example, the electronic device can also include buttons, motors, indicators, and a subscriber identification module (SIM) card interface, etc. For another example, the sensor module can also include: a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a fingerprint sensor, a temperature sensor, a bone conduction sensor, and so on.
[0251] In the embodiments of the present application, the electronic device can execute the schedule creation method provided by the present application through the above-mentioned processor 110 and display the schedule information obtained by executing the schedule creation method provided by the present application through the display screen 140.
[0252] Figure 9 Exemplarily, the software architecture of the electronic device according to the embodiments of the present application is shown.
[0253] As Figure 9 shown, the layered architecture divides the system into several layers, and each layer has clear roles and divisions of labor. The layers communicate with each other through software interfaces. In some embodiments, the system is divided into four layers, from top to bottom, namely the application layer, the application framework layer (framework), the system layer, and the kernel layer. Among them:
[0254] The application layer (application) may include a series of application packages. For example, the application packages may include application programs such as the system calendar, chat applications, and ticket-purchasing applications.
[0255] The application framework layer (framework) plays a bridging role. It can interact with the application through the application programming interface (API) and interact with the HAL through the HAL interface definition language (HIDL).
[0256] The software architecture may further include Figure 9 the hardware abstract layer (HAL) not shown in , which is an interface layer located between the application framework layer and the kernel layer and provides a virtual hardware platform for the operating system.
[0257] The kernel layer is the layer between hardware and software. The kernel layer includes drivers for various hardware, such as display drivers, camera drivers, audio drivers, and sensor drivers. The kernel layer may also include a digital signal processor driver (not shown) and an image processor driver (not shown), etc. Among them, the camera driver is used to drive the image sensor of one or more cameras in the camera module to collect images and drive the image signal processor to preprocess the images. The digital signal processor driver is used to drive the digital signal processor to process images. The image processor driver is used to drive the graphics processor to process images.
[0258] The term "user interface (UI)" in the specification, claims, and drawings of this application is a media interface for interaction and information exchange between an application or an operating system and a user. It realizes the conversion between the internal form of information and the form acceptable to the user. The user interface of an application is source code written in specific computer languages such as Java and Extensible Markup Language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content recognizable by the user, such as controls like pictures, texts, and buttons. A control, also known as a widget, is a basic element of the user interface. Typical controls include a toolbar, a menu bar, a text box, a button, a scrollbar, pictures, and texts. The attributes and content of the controls in the interface are defined through tags or nodes. For example, XML uses <textview> 、 <imgview> 、 <videoview>Such nodes are used to define the controls included in the interface. One node corresponds to one control or property in the interface. After being parsed and rendered, the nodes are presented as visible content to the user. In addition, in the interfaces of many applications, such as hybrid applications, there are usually web pages included. A web page, also known as a page, can be understood as a special control embedded in the application interface. A web page is the source code written in a specific computer language, such as hyper text markup language (HTML), cascading style sheets (CSS), JavaScript (JS), etc. The web page source code can be loaded and displayed as recognizable content to the user by a browser or a web page display component similar to the browser function. The specific content included in the web page is also defined by the tags or nodes in the web page source code. For example, HTML uses 、 、 <video> 、 <canvas>to define the elements and attributes of a web page.
[0259] A commonly used form of the user interface is the graphical user interface (GUI), which refers to the user interface related to computer operations displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include visible interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, etc.
[0260] It should be understood that each step in the above method embodiments provided in the present application can be completed by the integrated logic circuit of the hardware in the processor or the instructions in the form of software. The method steps disclosed in combination with the embodiments of the present application can be directly embodied as being executed and completed by the hardware processor, or executed and completed by the combination of the hardware and software modules in the processor.
[0261] The present application also provides an electronic device, which may include: a memory and a processor. Among them, the memory can be used to store computer programs; the processor can be used to call the computer programs in the memory so that the electronic device executes the methods in any one of the above embodiments.
[0262] The present application also provides a chip system, which includes at least one processor for implementing the functions involved in the methods executed by the electronic device in any one of the above embodiments. In a possible design, the chip system further includes a memory for storing program instructions and data, and the memory is located inside or outside the processor. The chip system can be composed of chips or can include chips and other discrete devices.
[0263] Optionally, the processor in the chip system can be one or more. The processor can be implemented by hardware or by software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented by software, the processor can be a general-purpose processor that realizes by reading the software code stored in the memory.
[0264] Optionally, the memory in the chip system can also be one or more. The memory can be integrated with the processor or can be separately arranged from the processor, and the embodiments of the present application do not limit this. Exemplarily, the memory can be a non-transitory processor, such as a read-only memory ROM, which can be integrated with the processor on the same chip or can be separately arranged on different chips. The embodiments of the present application do not make specific limitations on the type of the memory and the setting manner of the memory and the processor.
[0265] Exemplarily, the chip system may be a field programmable gate array (FPGA), may be an application specific integrated circuit (ASIC), may also be a system on chip (SoC), may also be a central processor unit (CPU), may also be a network processor (NP), may also be a digital signal processing circuit (DSP), may also be a micro controller unit (MCU), may also be a programmable logic device (PLD) or other integrated chips.
[0266] The present application also provides a computer program product, which includes: a computer program (which may also be referred to as code or instruction). When the computer program is run, it causes the computer to execute the method performed by the electronic device in any one of the above embodiments.
[0267] The present application also provides a computer-readable storage medium, which stores a computer program (which may also be referred to as code or instruction). When the computer program is run, it causes the computer to execute the method performed by the electronic device in any one of the above embodiments.
[0268] The various embodiments of the present application can be combined arbitrarily to achieve different technical effects.
[0269] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions according to the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (such as coaxial cable, fiber optic, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk).
[0270] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware with a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The aforementioned storage medium includes various media that can store program codes, such as ROM or random access memory RAM, magnetic disks, or optical discs.
[0271] In summary, the above are only embodiments of the technical solutions of the present invention and are not intended to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention shall be included within the protection scope of the present invention.< / canvas> < / video> < / videoview> < / imgview> < / textview>
Claims
1. A schedule creation method, characterized in that, Applied to an electronic device, the method includes: Detecting a first operation of dragging a first control into a first area on the screen, the first control corresponding to first data, and the first data including first schedule information; In response to the first operation, displaying a first icon of a first application; Detecting a second operation of continuing to drag the first control into a second area where the first icon is located and releasing it; In response to the second operation, displaying a first window of the first application, the first window including second schedule information, and the second schedule information corresponding to the first schedule information.
2. The method according to claim 1, wherein The method further includes: Displaying a first interface, the first interface including the first schedule information; When displaying the first interface, detecting a screenshot operation; In response to the screenshot operation, displaying the first control on the first interface, and the first data being a screenshot image of the first interface.
3. The method according to claim 2, characterized in that, A preview image of the screenshot image of the first interface is displayed on the first control.
4. The method according to claim 1, characterized in that The method further includes: Displaying a second interface of a second application, the second interface including a first area, and first text information being displayed on the first area, the first text information including the first schedule information; When displaying the second interface, detecting a long-press operation on the first area; In response to the long-press operation on the first area, displaying the first control on the first interface, and the first data being the first text information.
5. The method according to claim 1, wherein The method further includes: Displaying a third interface of a third application, the third interface including a plurality of dialog boxes; When displaying the third interface, detecting a long-press operation on the third interface; In response to the long-press operation on the third interface, displaying the first control on the third interface, and the first data being the content of the plurality of dialog boxes.
6. The method according to claim 1, wherein The method further includes: Displaying a fourth interface of a gallery application, the fourth interface including a first image; When displaying the fourth interface, detecting a long-press operation on the first image; In response to the long-press operation on the first image, displaying the first control on the fourth interface, and the first data being the first image.
7. The method according to any one of claims 1-6, characterized in that, The first schedule information and the second schedule information correspond to the same schedule.
8. The method according to claim 7, wherein The first window further includes a second control, and the method further includes: In response to a user operation on the second control, displaying a fifth interface of the first application, the fifth interface including thumbnail information of the first schedule, and the first schedule being created by the first application based on the first schedule information.
9. The method according to any one of claims 1-6, characterized in that, The first schedule information includes schedule information of a second schedule and schedule information of a third schedule; the first window includes a second area and a third area, the second area including the schedule information of the second schedule, and the third area including the schedule information of the third schedule.
10. The method according to claim 9, wherein The second area is in a selected state, the first window further includes the second control, and the method further includes: In response to a user operation on the second control, displaying a sixth interface of the first application, the sixth interface including thumbnail information of the second schedule.
11. The method according to claim 9, wherein The second region is in a selected state, and the first window further includes the second control. The method further includes: In response to a user operation on the third region, display the third region as being in a selected state; In response to a user operation on the second control, display a seventh interface of the first application, where the seventh interface includes thumbnail information of the second schedule and thumbnail information of the third schedule.
12. The method according to any one of claims 1-11, characterized in that, The first data includes first location information, and the first window includes second location information, where the first location information is different from the second location information.
13. The method according to any one of claims 1 to 12, characterized in that, The first data is the first image; the method further includes: Display the first image and a sharing control; In response to a user operation on the sharing control, display the first icon; In response to a user operation on the first icon, display the first window.
14. The method according to any one of claims 1 to 13, characterized in that, The method further includes: Display an eighth interface of a fourth application, where the eighth interface includes the first schedule information; When displaying the eighth interface, in response to a user operation on the eighth interface, display a third control; In response to a user operation on the third control, display the first window.
15. The method according to any one of claims 1 to 14, characterized in that The first schedule information includes at least one of a schedule theme, time, and location.
16. A schedule creation method, characterized in that, Applied to an electronic device, the method includes: Display a first interface of a first application, where the first interface includes calendar information and a first control; In response to a user operation on the first control, display a second interface of the first application, where the second interface includes a first input field and a second control; the first input field is in a blank state; In response to a user operation on the second control, display a third interface of a second application, where the third interface includes a first preview image corresponding to the first image, and the first image includes first schedule information; In response to an operation on the first preview image, display a fourth interface of the first application, where the fourth interface includes the first input field, and the first input field includes second schedule information corresponding to the first schedule information.
17. The method according to claim 16, wherein The first schedule information and the second schedule information correspond to the same schedule.
18. The method according to claim 17, wherein The first schedule information is the schedule information corresponding to the first schedule, and the fourth interface further includes a second control. The method further includes: In response to a user operation on the second control, display a fifth interface of the first application, where the fifth interface includes thumbnail information of the first schedule.
19. The method according to claim 16, wherein, The first schedule information includes schedule information of a second schedule and schedule information of a third schedule; the first window includes a second region and a third region, where the second region includes the schedule information of the second schedule, and the third region includes the schedule information of the third schedule.
20. The method according to claim 19, wherein The second region is in a selected state; the first window further includes the second control. The method further includes: In response to a user operation on the second control, display a sixth interface of the first application, where the sixth interface includes thumbnail information of the second schedule.
21. The method according to claim 19, wherein The second region is in a selected state, and the first window further includes the second control. The method further includes: In response to a user operation on the third region, display the third region as a selected state; In response to a user operation on the second control, display a seventh interface of the first application, the seventh interface including thumbnail information of the first schedule and thumbnail information of the second schedule.
22. The method according to any one of claims 16-21, characterized in that, The first schedule information includes at least one of a schedule theme, time, and location.
23. An electronic device, characterized in that, Comprising one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, the computer program code includes computer instructions, when the one or more processors execute the computer instructions, causing the electronic device to execute the method according to any one of claims 1-22.
24. A computer-readable storage medium, comprising instructions, characterized in that, When the instruction runs on the electronic device, causing the electronic device to execute the method according to any one of claims 1-22.
Citation Information
Cited By
Schedule creation method and electronic device
EP4760469A1
Schedule creation method and electronic device
WO2025138829A1