Information processing method and device

Abstract

The invention discloses an information processing method and device, and the method comprises the steps: responding to a condition meeting a first condition, and outputting first multimedia information; the first multimedia information comprises first text information; wherein the first multimedia information is generated based on first information, the first information at least comprises the first text information, and the first text information and first time information can form a first time text relation.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to an information processing method and device. Background Art

[0002] Currently, the schedule information set in the schedule on the electronic device is usually broadcasted by voice to remind the user of the corresponding work or life plan or arrangement.

[0003] However, this method can only report one by one, which is monotonous and boring, resulting in a poor user experience. Summary of the invention

[0004] In view of this, the present application provides an information processing method and device as follows:

[0005] An information processing method, comprising:

[0006] In response to satisfying the first condition, outputting first multimedia information; the first multimedia information includes first text information;

[0007] The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information.

[0008] The above method, preferably, satisfies the first condition, including:

[0009] A second time condition is satisfied; the second time condition is different from the first time condition;

[0010] If the first time condition is met, the second multimedia information excluding the first text information is output; or the first text information is output; or the first text information and the second multimedia information excluding the first text information are output.

[0011] In the above method, preferably, the first condition includes reaching the target time, and in response to satisfying the first condition, outputting the first multimedia information includes any of the following:

[0012] In response to reaching a second time, outputting multimedia information for prompting the second time, the second time being irrelevant to the first time information;

[0013] In response to reaching a third time, multimedia information for prompting the first time information is output, and the third time is earlier than the time represented by the first time information.

[0014] The above method preferably further comprises:

[0015] inputting the first information into a generative model;

[0016] The output information of the generative model is obtained; the first multimedia information includes the output information.

[0017] The above method, preferably, after inputting the first information into the generative model, further comprises:

[0018] The generative model generates second multimedia information and outputs information that integrates the second multimedia information and the first text information.

[0019] The above method preferably further comprises:

[0020] The first multimedia information is generated based on the first information and the second media information.

[0021] In the above method, preferably, the second media information includes a first audio, and the first audio includes a first element;

[0022] The step of generating the first multimedia information based on the first information and the second media information includes:

[0023] The first text information and the first element are merged to obtain the first multimedia information.

[0024] In the above method, preferably, the second media information includes a second audio, and the second audio includes a first element and a second element;

[0025] The step of generating the first multimedia information based on the first information and the second media information includes:

[0026] Adjust the second element based on the first text information to obtain second text information;

[0027] The second text information is merged with the first element to obtain the first multimedia information.

[0028] The above method preferably further comprises one of the following:

[0029] Obtaining a first audio or a second audio whose operation parameter satisfies a second condition, so as to obtain the second media information including the first audio or the second audio;

[0030] The second audio satisfying a third condition is obtained to obtain the second media information including the second audio; the third condition indicates that the second element matches the first text information.

[0031] In the above method, preferably, in response to satisfying the first condition, outputting the first multimedia information includes any of the following:

[0032] In response to satisfying a first condition, triggering a first application to output the first multimedia information; the first information is information of a second application, and the first application is different from the second application;

[0033] In response to satisfying the first condition, the first application is triggered to output the first multimedia information; the first information is information in the first application.

[0034] The above method, preferably, further comprises:

[0035] Before the first condition is satisfied, obtaining the second media information;

[0036] The step of generating the first multimedia information based on the first information and the second media information includes:

[0037] The first information and the second media information are merged to obtain the first multimedia information.

[0038] The above method, preferably, further comprises:

[0039] Before the first condition is satisfied, obtaining the second media information, and fusing the first information and the second media information to obtain preset multimedia information;

[0040] The step of generating the first multimedia information based on the first information and the second media information includes:

[0041] In response to the first information and / or the second information corresponding to the second media information, adjusting the preset multimedia information to obtain the first multimedia information;

[0042] The second information represents a change in the first information and / or a change in the second media information.

[0043] An information processing device, comprising:

[0044] A condition monitoring unit, used to monitor whether a first condition is met;

[0045] A multimedia output unit, configured to output first multimedia information in response to satisfying the first condition; the first multimedia information includes first text information;

[0046] The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information.

[0047] An electronic device, comprising:

[0048] A processor, configured to monitor whether a first condition is satisfied;

[0049] Output means, for outputting first multimedia information in response to satisfying the first condition; the first multimedia information includes first text information;

[0050] The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0052] Figure 1 A flowchart of an information processing method provided in an embodiment of the present application;

[0053] Figure 2 This is an example diagram of reminding users through songs;

[0054] Figure 3 This is an example diagram for reminding users through text;

[0055] Figure 4 Example diagram for reminding users through songs and texts;

[0056] Figure 5 This is an example diagram of reminding a user through a song whose lyrics are a schedule content in an embodiment of the present application;

[0057] Figure 6 This is an example diagram of reminding a user by outputting a video with schedule content in an embodiment of the present application;

[0058] Figure 7 A partial flow chart of an information processing method provided in an embodiment of the present application;

[0059] Figure 8 An example diagram of generating first multimedia information in an embodiment of the present application;

[0060] Fig. 9 Another example diagram of generating the first multimedia information in an embodiment of the present application;

[0061] Fig.10 This is another example diagram of generating the first multimedia information in an embodiment of the present application;

[0062] Fig.11 Another example diagram of generating the first multimedia information in an embodiment of the present application;

[0063] Fig.12 This is another example diagram of generating the first multimedia information in an embodiment of the present application;

[0064] Fig.13 A schematic diagram of the structure of an information processing device provided in an embodiment of the present application;

[0065] Fig.14 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0066] Fig.15 This is an example diagram of implementing schedule reminders in a mobile phone for this application. DETAILED DESCRIPTION

[0067] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0068] refer to Figure 1 As shown, it is a flowchart of an implementation of an information processing method provided in an embodiment of the present application, which can be applied to electronic devices capable of data processing, such as mobile phones, tablet devices, notebooks, computers, etc. The technical solution in this embodiment is mainly used to improve the user experience of information reminders.

[0069] Specifically, the method in this embodiment may include the following steps:

[0070] Step 101: monitor whether a first condition is satisfied. In response to the first condition being satisfied, execute step 102. If the first condition is not satisfied, continue to execute step 101.

[0071] The first condition refers to a condition that requires outputting multimedia information to remind the user. In this embodiment, it is continuously monitored whether the first condition is satisfied, and if the first condition is satisfied, step 102 is executed.

[0072] Step 102: Output the first multimedia information.

[0073] The first multimedia information includes the first text information. The first text information is used to describe the content that needs to be reminded to the user. The first text information may include: at least one of: a schedule description text, a to-do description text, or a completed description text. Alternatively, the first text information may also be obtained from a communication application, and the first text information may be: a short message text in a short message application, a chat record text in a chat application, etc.

[0074] Specifically, the first multimedia information is generated based on the first information, the first information at least includes first text information, and the first text information can form a first time-text relationship with the first time information.

[0075] In one case, the first information may only include the first text information, and the first text information corresponds to the first time information to represent that the task in the first text information needs to be executed at the first time corresponding to the first time information. Based on this, when obtaining the first multimedia information, the first time information is first mapped to the first text information, so that the output first multimedia information can reflect the content represented by the first text information and the time corresponding to the first time information. For example, the first information includes the first text information such as "Remind me for a meeting", and the first text information corresponds to the first time information "8 o'clock". In this embodiment, when obtaining the first multimedia information, "8 o'clock" is added to the first text information "Remind me for a meeting", and the first multimedia information is obtained based on the integrated text information, that is, the multimedia information that can represent the "meeting at 8 o'clock". Accordingly, the first multimedia information is output when the first condition is met.

[0076] In another case, in addition to the first text information, the first information may also include the first time information to indicate that the task in the first text information needs to be executed at the first time corresponding to the first time information. Based on this, when obtaining the first multimedia information, the first time information in the first information may be removed, the first text information may be processed first, and then processed in combination with the first time information to obtain the first multimedia information, so that the output first multimedia information can reflect the content represented by the first text information and the time corresponding to the first time information. For example, the first information may include "remind me of a meeting" and the first time information "8 o'clock". In this embodiment, when obtaining the first multimedia information, the first multimedia information is first obtained according to the first text information "remind me of a meeting", and the first multimedia information corresponds to "8 o'clock". Therefore, the first multimedia information is output when the first condition corresponding to "8 o'clock" is met.

[0077] It should be noted that, in addition to the first text information, the first multimedia information also includes other types of information, where the other types may include at least one of an audio type and an image type.

[0078] In one case, the first multimedia information includes not only the first text information but also audio information. Based on this, outputting the first multimedia information in this embodiment can achieve the purpose of reminding the user in both audio and text modes.

[0079] In another case, the first multimedia information includes not only the first text information but also image information. Based on this, outputting the first multimedia information in this embodiment can achieve the purpose of reminding the user in both image and text ways.

[0080] It can be seen from the above technical solution that in an information processing method provided in an embodiment of the present application, in response to satisfying a first condition, multimedia information generated at least based on the first text information is output. Therefore, different from the reminder method of broadcasting the first text information one by one, the multimedia information generated by the first text information in the present application realizes user reminders, which can improve the user experience.

[0081] In one implementation, the first condition in step 101 may be satisfied by satisfying a second time condition. The second time condition is a condition related to time and is different from the first time condition.

[0082] If the first time condition is met, the second multimedia information excluding the first text information is output; or the first text information is output; or the first text information and the second multimedia information excluding the first text information are output.

[0083] In this embodiment, if the second time condition is met, the first multimedia information including the first text information is output.

[0084] For example, when the first time condition is met, the output second multimedia information that does not contain the first text information may be an audio with other text information, such as a melody with lyrics, that is, a song, which is irrelevant to the description content of the first text information. Figure 2 As shown in , when the first time condition is met, the mobile phone outputs the song through the speaker to achieve the purpose of alarm reminder.

[0085] When the first time condition is met, the output first text information may be a text description that can remind the schedule content. Figure 3 As shown in , when the first time condition is met, the mobile phone outputs a text description of the schedule content such as "meeting at 8 o'clock" on the screen, thereby achieving the purpose of schedule reminder through the text description.

[0086] When the first time condition is met, the output first text information may be a text description that can remind the schedule content, and the output second multimedia information that does not include the first text information may be an audio with other text information. Figure 4 As shown in , when the first time condition is met, the mobile phone outputs a song through the speaker and outputs a text description of the schedule content such as "meeting at 8 o'clock" on the screen, thereby achieving the purpose of schedule reminder through text description and song.

[0087] When the second time condition is met, the first multimedia information output in this embodiment is an audio or video containing the first text information. Figure 5 As shown in , when the second time condition is met, the mobile phone outputs a song with the description content of "8 o'clock meeting" through the speaker, that is, the lyrics of the song are schedule content such as "8 o'clock meeting". Figure 6 As shown in , when the second time condition is met, the mobile phone outputs a video with schedule content such as "meeting at 8 o'clock" through the screen, that is, the video screen contains the description content of "meeting at 8 o'clock", and further, a song with lyrics of "meeting at 8 o'clock" can also be output through the speaker at the same time.

[0088] It can be seen that Figure 5 and Figure 6 As shown in , in this embodiment, the user can be reminded of the schedule in the form of a combination of multiple types of information (that is, the information used for reminders is integrated, such as lyrics plus melody, or video plus lyrics plus melody, etc., instead of outputting information from different sources at the same time), thereby improving the user experience of schedule reminders.

[0089] In a specific implementation, the first condition may include: reaching the target time. That is, when the target time is reached, the first multimedia information is output.

[0090] In one implementation, the target time may be the second time. Based on this, in response to satisfying the first condition, outputting the first multimedia information may be:

[0091] In response to reaching the second time, multimedia information for prompting the second time is output.

[0092] The second time is independent of the first time information. Based on this, the multimedia information for prompting the second time includes the first text information corresponding to the first time information, but the first time corresponding to the first time information is independent of the second time.

[0093] Based on this, in this embodiment, it is monitored whether the second time has arrived. If the second time has arrived, multimedia information for prompting the second time is output, and the output multimedia information prompts that the second time has arrived, and prompts the description content corresponding to the first text information.

[0094] For example, when the mobile phone alarm detects that the time reaches 8 o'clock in the morning, the mobile phone alarm triggers the speaker to output the reminder content, that is, the song with the description of "schedule content" is output through the speaker, that is, the lyrics of the song are "schedule content". At this time, the schedule time corresponding to the "schedule content", such as this month viewed in the meeting minutes (that is, the first time corresponding to the first time information), has nothing to do with "8 o'clock in the morning". That is, the user does not set the alarm to remind the schedule, so there is no need to consider the schedule and the time corresponding to the schedule, but the alarm uses the schedule information when reminding. It not only reminds the user that it is the time set by the user, but also reminds the user what to do today or what he did yesterday.

[0095] In one implementation, in this embodiment, multiple reminder modes can be constructed for the electronic device, such as a reminder mode for reviewing completed items, a reminder mode for warning of to-do items, etc. In this embodiment, when obtaining the first multimedia information, the corresponding first text information can be obtained according to the currently set reminder mode, such as the first text information can include: description text of historical completed items corresponding to the reminder mode for reviewing existing items, description text of future to-do items corresponding to the reminder mode for warning of to-do items, etc., and then the first multimedia information is obtained according to the first text information, and the user is reminded of completed items or to-do items in a combination of multiple types of information.

[0096] For example, when the user sets the electronic device to a reminder mode for reviewing to-do items, when a first condition is met, the first multimedia information obtained based on the description text of the to-do items of the previous day can be output to remind the user of everything that has been done the previous day.

[0097] For another example, when the user sets the electronic device to a reminder mode for alerting to-do items, when a first condition is met, the first multimedia information obtained based on the description text of tomorrow's to-do items can be output to remind the user of everything he needs to do tomorrow.

[0098] In another implementation, the target time may be a third time. Based on this, in response to satisfying the first condition, outputting the first multimedia information may be:

[0099] In response to reaching the third time, multimedia information for prompting the first time information is output.

[0100] The third time is earlier than the time represented by the first time information, that is, the first time. Based on this, the multimedia information used to prompt the first time information includes the first text information corresponding to the first time information, and the time represented by the first time information here is later than the third time, that is, the first multimedia information is output in advance at the third time to prompt that the task corresponding to the first text information needs to be executed at the later first time.

[0101] Based on this, in this embodiment, it is monitored whether a third time earlier than the time represented by the first time information is reached. If the third time is reached, multimedia information for prompting the first time information is output, so that the output multimedia information prompts the upcoming first time and prompts the description content corresponding to the first text information.

[0102] For example, when the mobile phone's schedule application detects that the time has reached the warning time corresponding to "meeting at 8 o'clock", that is, 7:45 in the morning, the mobile phone's schedule application triggers the speaker to output the reminder content, that is, a song with a description of "schedule content" is output through the speaker, that is, the lyrics of the song are "schedule content". At this time, the schedule time corresponding to the "schedule content", such as the meeting start time of 8 o'clock (that is, the first time corresponding to the first time information) is earlier than "7:45 in the morning".

[0103] Of course, this embodiment is also applicable to the scheme of using an alarm clock to remind the schedule. In this case, the user's alarm clock is set automatically. For example, if it is monitored that there is an item "meeting at 8 o'clock tomorrow morning" in the schedule, the wake-up time will be estimated based on the user's habit data. Assuming that the user analysis shows that the user usually goes to work one hour after getting up, then the alarm clock will be automatically set at 7 o'clock in the morning as the user's wake-up alarm clock.

[0104] In one implementation, this embodiment may also include the following processing: Figure 7 As shown in:

[0105] Step 701: Input first information into a generative model.

[0106] Among them, the generative model can be an intelligent model that can generate at least one of audio, text, and image.

[0107] Step 702: Obtain output information of the generative model.

[0108] The first multimedia information includes output information. It can be understood that in this embodiment, the first information including the first text information is input into the generative model, and then the first multimedia information is generated according to the output information of the generative model, and the first multimedia information includes the output information.

[0109] In one possible implementation, after the first information is input into the generative model, the output information of the generative model is multimedia information containing multiple types of information. At this time, in this embodiment, the output information of the generative model can be used as the first multimedia information, and the first multimedia information is output when the first condition is met.

[0110] For example, the first information containing the first text information "meeting at 8 o'clock" is used as the input of the generative model, such as Figure 8 As shown in , the generative model outputs a song whose lyrics contain "meeting at 8 o'clock" as the first multimedia information. When the first condition is met, the first multimedia information is output, that is, the song whose lyrics contain "meeting at 8 o'clock" is output to remind the user of the schedule "meeting at 8 o'clock". Compared with directly broadcasting "meeting at 8 o'clock", the user's experience of schedule reminders can be improved.

[0111] In a possible implementation, after the first information is input into the generative model, the generative model generates the second multimedia information, based on which, in this embodiment, information that fuses the second multimedia information and the first text information can be output. That is, the second multimedia information output by the generative model and the first text information are first fused to obtain the first multimedia information, and thus the first multimedia information is output when the first condition is met.

[0112] For example, the first information containing the first text information "meeting at 8 o'clock" is used as the input of the generative model, such as Fig. 9 As shown in , the generative model outputs a melody or a video stream with a melody as the second multimedia information, and the second multimedia information is merged with "meeting at 8 o'clock" to obtain the first multimedia information, thereby outputting the first multimedia information when the first condition is met.

[0113] In one implementation, the first multimedia information can be generated based on the first information and the second media information in this embodiment. That is, the generative model is not used in this embodiment, but information fusion is directly performed based on the existing first information and the existing second media information to obtain the first multimedia information, thereby outputting the first multimedia information when the first condition is met.

[0114] The second media information may be audio information or image information, which is a single type of information. The second media information may be pre-stored in a cache. After the first text information is created, that is, when the first multimedia information needs to be generated, the second media information may be read from the cache, and the first multimedia information may be generated based on the second media information and the first information including the first text information. At this time, the first multimedia information is composed of multiple types of information. When the first condition is met, the first multimedia information may be output.

[0115] For example, after the user sets the first text message of "meeting at 8 o'clock", Fig.10 As shown in , multimedia information including "meeting at 8 o'clock" is generated by integrating "meeting at 8 o'clock" with a preset music melody, that is, the first multimedia information, and thus the first multimedia information is output when the first condition is met.

[0116] Based on the above implementation, in a possible implementation manner, the second media information may include a first audio, and the first audio includes a first element. The first element may be a note, that is, the first audio is a melody composed of multiple notes.

[0117] Based on this, in this embodiment, when the first multimedia information is generated based on the first information and the second media information, the first text information and the first element may be merged to obtain the first multimedia information.

[0118] In a specific implementation, in this embodiment, the description characters in the first text information may be merged with the first element in the first audio to obtain a melody merged with the description characters.

[0119] For example, after the user sets the first text message of "meeting at 8 o'clock", Fig.11 As shown in , each character in "8 o'clock meeting" is merged with the corresponding note in the first audio in turn to obtain a song whose lyrics include "8 o'clock meeting", that is, the first multimedia information, thereby outputting the first multimedia information when the first condition is met.

[0120] In another possible implementation, the second media information may include a second audio, the second audio includes a first element and a second element, the first element may be a musical note, and the second element may be a character, that is, the second audio is a song containing lyrics and musical notes.

[0121] Based on this, in this embodiment, when generating the first multimedia information based on the first information and the second media information, the second element can be adjusted based on the first text information to obtain the second text information, and then the second text information and the first element are merged to obtain the first multimedia information.

[0122] In a specific implementation, in this embodiment, the second element in the second audio can be replaced or modified according to the description characters in the first text information to obtain the second text information, and then the description characters in the second text information are merged with the first element in the second audio to obtain a melody that incorporates the description characters of the first text information.

[0123] For example, after the user sets the first text message of "meeting at 8 o'clock", Fig.12 As shown in , the lyrics in the second audio are modified according to each character in "8 o'clock meeting", and the modified lyrics are then merged with the corresponding notes in the second audio in sequence to obtain a song whose lyrics include "8 o'clock meeting", that is, the first multimedia information, and thus the first multimedia information is output when the first condition is met. Therefore, in this embodiment, the lyrics in the pre-cached song are replaced with schedule content such as "8 o'clock meeting", and the user is reminded by the song with schedule content, thereby improving the user experience.

[0124] Based on the above implementation scheme, in a possible implementation manner, in this embodiment, the first audio whose operation parameters meet the second condition can be obtained to obtain the second media information including the first audio.

[0125] The first audio operation parameter meeting the second condition may include at least one of the following: the total playback time of the first audio reaches the target time; the total number of playbacks of the first audio reaches the target number of times; the number of accounts that have collected the first audio reaches the target number. The operation parameter meeting the second condition can characterize the user's preference for the audio. Based on this, in this embodiment, the first text information can be fused with the first element in the first audio that the user prefers to obtain the first multimedia information.

[0126] For example, in this embodiment, a melody played by the user for a total time of 1 hour can be selected as the first audio, and the second media information including the first audio can be obtained accordingly.

[0127] In another possible implementation manner, in this embodiment, second audio whose operating parameters satisfy the second condition may be obtained to obtain second media information including the second audio.

[0128] Among them, the operation parameters of the second audio satisfying the second condition may include at least one of the following: the total playback time of the second audio reaches the target time; the total number of playbacks of the second audio reaches the target number of times; the number of accounts where the second audio is collected reaches the target number. The operation parameters satisfying the second condition can characterize the user's preference for the audio. Based on this, in this embodiment, the second element in the second audio preferred by the user can be adjusted based on the first text information to obtain the second text information, and then the second text information is fused with the first element in the second audio preferred by the user to obtain the first multimedia information.

[0129] For example, in this embodiment, songs that have been played by the user a total of 200 times can be selected as the second audio, and the second media information containing the second audio can be obtained accordingly.

[0130] In another possible implementation, in this embodiment, the second audio that meets the third condition may be obtained to obtain the second media information including the second audio. The third condition indicates that the second element matches the first text information.

[0131] Based on this, in this embodiment, a second audio that matches a second element such as lyrics is selected according to the first text information, and the second element in the matched second audio can be adjusted based on the first text information to obtain the second text information. Then, the second text information is fused with the first element in the matched second audio to obtain the first multimedia information.

[0132] For example, in this embodiment, the second audio that matches the corresponding lyrics can be selected according to "Meeting at 8 o'clock", thereby obtaining the second media information including the second audio.

[0133] It can be seen that in this embodiment, the lyrics in the audio requested by the user are replaced with schedule content such as "meeting at 8 o'clock", and the user is reminded of the schedule content through the song that the user likes, thereby further improving the user experience.

[0134] In one implementation, in this embodiment, the second media information can be obtained before the first condition is met. That is, the second media information can be pre-deployed. Based on this, when the first multimedia information is generated based on the first information and the second media information, the first information and the second media information can be fused to obtain the first multimedia information. In other words, when the first multimedia information needs to be output, that is, when the first condition is met, the first information and the second media information are fused to obtain the first multimedia information.

[0135] For example, in this embodiment, the second media information is pre-deployed, and after the first information is generated, the first condition is met, and then the first multimedia information is generated based on the first information and the second media information and output. Thus, even if the first text information in the first information is modified, the first multimedia information can be generated based on the modified first information when the first condition is met, thereby improving the accuracy of outputting the first multimedia information.

[0136] In one implementation, in this embodiment, before the first condition is met, the second media information can be obtained, and the first information and the second media information can be merged to obtain the preset multimedia information. That is, the second media information can be pre-deployed, and after the first information is generated, the corresponding preset multimedia information is generated, waiting for the first condition to be met. When the first condition is met, there may be a situation where the first information changes and / or the second media information changes. At this time, the preset multimedia information can be adjusted in response to the second information corresponding to the first information and / or the second media information to obtain the first multimedia information.

[0137] The second information represents a change in the first information and / or a change in the second media information.

[0138] Specifically, in this embodiment, the preset multimedia information is adjusted, including at least one of the following:

[0139] Adjusting the information corresponding to the first element in the preset multimedia information, such as adjusting the musical notes to adjust the tune of the melody in the multimedia information;

[0140] The information corresponding to the second element in the preset multimedia information is adjusted, such as adjusting the lyrics, so as to adjust the lyrics in the multimedia information.

[0141] For example, in this embodiment, the second media information is pre-deployed. After the first information is generated, the preset multimedia information can be directly generated based on the first information and the second media information. When the first condition is met, the preset multimedia information is adjusted according to the changes in the first information and the second media information, and then the adjusted multimedia information is output, so as to avoid the situation where the changes in the first information and the second media information before the first condition is met cause the first multimedia information to be output incorrectly, thereby improving the accuracy of outputting the first multimedia information. Moreover, in this application, it is only necessary to adjust the preset multimedia information according to the information changes, and there is no need to re-execute the multimedia information generation process, so that the data processing amount of the first multimedia information acquisition can be reduced, thereby improving the efficiency of information acquisition.

[0142] In one implementation, the first multimedia information in this embodiment can be generated by a local electronic device, or after the local electronic device provides the first text information to a cloud server, the cloud server can initiate the generation of the first multimedia information and then send it to the local electronic device.

[0143] It should be noted that in this embodiment, it can be determined whether the first multimedia information is generated by a local electronic device or a cloud server according to the sensitivity of the first text information. For example, when the first text information contains user privacy data, the first multimedia information is generated by a local electronic device such as a mobile phone to ensure the security of the privacy data; when the first text information does not contain user privacy data, the first multimedia information is generated by a cloud server, which can reduce the resource consumption of the local electronic device and improve the performance of the electronic device.

[0144] In one implementation, in step 102, when the first multimedia information is output in response to the first condition being met, it can be implemented in the following manner:

[0145] In response to satisfying the first condition, triggering the first application to output the first multimedia information.

[0146] The first information is information of the second application, and the first application is different from the second application. The first application is an application that can output multimedia information, such as an alarm clock application; the second application is an application that can provide the first information, such as a calendar application or a communication type application such as a chat application. That is, in this embodiment, outputting the first multimedia information and providing the first information are implemented by different applications.

[0147] For example, in this embodiment, the schedule content "meeting at 8 o'clock" is provided through the schedule application, and the first multimedia information corresponding to the "meeting at 8 o'clock" is output through the alarm clock application. The schedule application and the alarm clock application are different application programs in the mobile phone.

[0148] In another implementation, in step 102, when the first multimedia information is output in response to the first condition being met, it can be implemented in the following manner:

[0149] In response to satisfying the first condition, triggering the first application to output the first multimedia information.

[0150] The first information is information in the first application. The first application outputs multimedia information through a reminder function module, such as an alarm function module; the first application provides the first information through a schedule function module, such as a schedule function module. That is, in this embodiment, outputting the first multimedia information and providing the first information are implemented through different function modules in the same application.

[0151] For example, in this embodiment, the schedule function module in the specific application provides the schedule content "meeting at 8 o'clock", and the reminder function module in the application outputs the first multimedia information corresponding to "meeting at 8 o'clock". The schedule function module and the reminder function module are different function modules in the application.

[0152] refer to Fig.13 , is a schematic diagram of the structure of an information processing device provided in an embodiment of the present application, which can be configured in an electronic device capable of data processing, such as a mobile phone, a tablet device, a notebook, a computer, etc. The technical solution in this embodiment is mainly used to improve the user experience of information reminders.

[0153] Specifically, the device in this embodiment may include the following units:

[0154] The condition monitoring unit 1301 is used to monitor whether the first condition is met;

[0155] The multimedia output unit 1302 is configured to output first multimedia information in response to satisfying the first condition; the first multimedia information includes first text information;

[0156] The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information.

[0157] It can be seen from the above technical solution that in an information processing device provided in an embodiment of the present application, in response to satisfying a first condition, multimedia information generated at least based on the first text information is output. Therefore, different from the reminder method of broadcasting the first text information one by one, the multimedia information generated by the first text information in the present application realizes user reminders, which can improve the user experience.

[0158] refer to Fig.14, is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and the electronic device may include the following structure:

[0159] Processor 1401, configured to monitor whether a first condition is met;

[0160] Output device 1402, used for outputting first multimedia information in response to satisfying the first condition; the first multimedia information includes first text information;

[0161] The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information.

[0162] The output device 1402 may include at least one of a sound output device and a picture output device. The sound output device may be a speaker or the like. The picture output device may be a display screen or the like.

[0163] It can be seen from the above technical solution that in an electronic device provided in an embodiment of the present application, in response to satisfying a first condition, multimedia information generated at least based on the first text information is output. Therefore, different from the reminder method of broadcasting the first text information one by one, the multimedia information generated by the first text information in the present application realizes user reminders, which can improve the user experience.

[0164] Taking a mobile phone as an example, the technical solution of this application is illustrated below:

[0165] Currently, in a busy life, it is difficult for consumers to check their daily schedules in a convenient, easy and creative way. And schedule apps are usually considered non-essential apps, with low user stickiness and high churn rate.

[0166] To this end, this application proposes a way to use a generative AI model to achieve a more creative schedule reminder solution. Through the application, the following processing can be performed:

[0167] First, an audio database containing second media information covering popular music is established; then, with the user's permission, the first audio or the second audio is determined by analyzing the operating parameters of the audio in the user's playlist to establish a user's preference profile for the audio.

[0168] In addition, when checking the schedule on the mobile phone every day, the schedule content is compared with the audio in the audio database to find the audio with a higher degree of lyrics matching, that is, the second audio. Based on this, the audio in the audio database and the user's preference profile for audio are sent to the AI ​​model together, and the AI ​​model is allowed to adjust the lyrics of the audio in the audio database that matches the user's preference profile according to the schedule content to obtain a song with lyrics for the schedule content, or the AI ​​model is allowed to generate a new melody and then merge the lyrics corresponding to the schedule content to obtain a song with lyrics for the schedule content. Finally, when the target time arrives, it is played to the user to broadcast the target time such as the schedule content of the day.

[0169] like Fig.15 As shown in , the process is as follows:

[0170] 1. The user enters the day's events in the calendar application;

[0171] 2. Based on the audio database, by analyzing the user's audio operation parameters, establish a user's audio preference profile, such as the audio that the user often listens to;

[0172] 3. The AI ​​model generates music with a melody that matches the day’s events;

[0173] 4. Combine the events of the day with the music to obtain an audio file whose lyrics contain the events of the day;

[0174] 5. Output audio with lyrics containing the day’s events for the user.

[0175] Furthermore, the present application can also receive user feedback on the output audio, and optimize the AI ​​model and the audio generation process accordingly.

[0176] It should be noted that in this embodiment, when matching music, the user's preferred language, dialect type, intonation, voice tone, etc. can be considered. When analyzing the user's preference profile for audio, the user's frequently listened music and collection of music can be considered. The specific dimensions considered may include: pitch, beat, dynamics, ascending, and descending.

[0177] For example, the schedule content is: the user has a sales roadshow at 9 o'clock today. In the past week, the song with the highest number of replays is Fly Away. The song has a line of lyrics: "The horn has sounded, run out of the house as fast as possible; run along the road to catch up with the sun, and speak out your heart." The new broadcast audio is generated through the AI ​​model, using the original tune of the song, but changing the lyrics to: "The horn has sounded, run out of the house as fast as possible, chase the rising sun at 9 o'clock, and start the sales roadshow."

[0178] It can be seen that the technical solution of this application is closer to the user's preferences, more creative, and can give users more surprises than simply reading the content on the schedule. Moreover, using audio to broadcast the schedule allows users to easily understand the schedule content while driving, etc., thereby increasing the stickiness between users and software and devices.

[0179] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0180] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0181] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0182] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An information processing method, comprising: In response to satisfying the first condition, outputting first multimedia information; the first multimedia information includes first text information; The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information.

2. The method according to claim 1, wherein the first condition is met, comprising: A second time condition is satisfied; the second time condition is different from the first time condition; If the first time condition is met, the second multimedia information excluding the first text information is output; or the first text information is output; or the first text information and the second multimedia information excluding the first text information are output.

3. The method according to claim 1, wherein the first condition includes reaching the target time, and in response to satisfying the first condition, outputting the first multimedia information includes any of the following: In response to reaching a second time, outputting multimedia information for prompting the second time, the second time being irrelevant to the first time information; In response to reaching a third time, multimedia information for prompting the first time information is output, and the third time is earlier than the time represented by the first time information.

4. The method according to claim 1, further comprising: inputting the first information into a generative model; Obtaining output information of the generative model; The first multimedia information includes the output information.

5. The method according to claim 4, after inputting the first information into the generative model, further comprising: The generative model generates second multimedia information and outputs information that integrates the second multimedia information and the first text information.

6. The method according to claim 1, further comprising: The first multimedia information is generated based on the first information and the second media information.

7. The method according to claim 6, wherein the second media information comprises a first audio, and the first audio comprises a first element; in, The generating the first multimedia information based on the first information and the second media information includes: The first text information and the first element are merged to obtain the first multimedia information.

8. The method according to claim 6, wherein the second media information comprises a second audio, and the second audio comprises a first element and a second element; in, The generating the first multimedia information based on the first information and the second media information includes: Adjust the second element based on the first text information to obtain second text information; The second text information is merged with the first element to obtain the first multimedia information.

9. The method according to claim 7 or 8, further comprising one of the following: Obtaining a first audio or a second audio whose operation parameter satisfies a second condition, so as to obtain the second media information including the first audio or the second audio; The second audio satisfying a third condition is obtained to obtain the second media information including the second audio; the third condition indicates that the second element matches the first text information.

10. The method according to any one of claims 1 to 8, in response to satisfying the first condition, outputting the first multimedia information, comprises any one of the following: In response to satisfying a first condition, triggering a first application to output the first multimedia information; the first information is information of a second application, and the first application is different from the second application; In response to satisfying the first condition, triggering the first application to output the first multimedia information; The first information is information in the first application.

11. The method according to claim 6, further comprising: Before the first condition is satisfied, obtaining the second media information; The step of generating the first multimedia information based on the first information and the second media information includes: The first information and the second media information are merged to obtain the first multimedia information.

12. The method according to claim 6, further comprising: Before the first condition is satisfied, obtaining the second media information, and fusing the first information and the second media information to obtain preset multimedia information; The step of generating the first multimedia information based on the first information and the second media information includes: In response to the first information and / or the second information corresponding to the second media information, adjusting the preset multimedia information to obtain the first multimedia information; The second information represents a change in the first information and / or a change in the second media information.

13. An information processing device, comprising: A condition monitoring unit, used to monitor whether a first condition is met; a multimedia output unit, configured to output first multimedia information in response to satisfying the first condition; The first multimedia information includes first text information; The first multimedia information is generated based on the first information, the first information at least includes the first text information, and the first text information can form a first time-text relationship with the first time information.

Images