Information processing method and apparatus

Abstract

The application discloses an information processing method and device. The method comprises: outputting first multimedia information in response to a first condition being met; the first multimedia information comprises first text information; wherein the first multimedia information is generated based on first information, the first information at least comprises the first text information, and the first text information can form a first time-text relationship with first time information.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to an information processing method and apparatus. Background Technology

[0002] Currently, voice broadcasts of schedule information set on electronic devices are commonly used to remind users of relevant work or life plans or arrangements.

[0003] However, this method can only broadcast messages one by one, which is monotonous and boring, resulting in a poor user experience. Summary of the Invention

[0004] In view of the above, this application provides an information processing method and apparatus, as follows:

[0005] An information processing method, comprising:

[0006] If the first condition is met, the first multimedia information is output; the first multimedia information includes first text information.

[0007] The first multimedia information is generated based on the first information, which includes at least the first text information, and the first text information can form a first time text relationship with the first time information.

[0008] The above method, preferably, satisfies the first condition, including:

[0009] The second time condition is met; the second time condition is different from the first time condition.

[0010] If the first time condition is met, output second multimedia information that does not include the first text information; or output the first text information; or output the first text information and second multimedia information that does not include the first text information.

[0011] In the above method, preferably, the first condition includes reaching the target time, the response satisfying the first condition, and outputting first multimedia information, including any one of the following:

[0012] Upon reaching the second time, a multimedia message is output to indicate the second time, which is unrelated to the first time information;

[0013] Upon reaching a third time, multimedia information is output to indicate the first time information, wherein the third time is earlier than the time represented by the first time information.

[0014] The above method, preferably, also includes:

[0015] The first information is input into the generative model;

[0016] Obtain the output information of the generative model; the first multimedia information includes the output information.

[0017] Preferably, after inputting the first information into the generative model, the above method further includes:

[0018] The generative model generates second multimedia information and outputs information that integrates the second multimedia information and the first text information.

[0019] The above method, preferably, also includes:

[0020] The first multimedia information is generated based on the first information and the second media information.

[0021] In the above method, preferably, the second media information includes a first audio, and the first audio includes a first element;

[0022] The step of generating the first multimedia information based on the first information and the second media information includes:

[0023] The first text information and the first element are combined to obtain the first multimedia information.

[0024] In the above method, preferably, the second media information includes a second audio, and the second audio includes a first element and a second element;

[0025] The step of generating the first multimedia information based on the first information and the second media information includes:

[0026] The second element is adjusted based on the first text information to obtain the second text information;

[0027] The second text information is combined with the first element to obtain the first multimedia information.

[0028] The above method, preferably, also includes one of the following:

[0029] Obtain a first audio or a second audio that satisfies the second condition, so as to obtain the second media information including the first audio or the second audio;

[0030] Obtain the second audio that satisfies the third condition to obtain the second media information including the second audio; the third condition indicates that the second element matches the first text information.

[0031] The above method, preferably, outputs first multimedia information in response to a first condition, including any one of the following:

[0032] When the first condition is met, the first application is triggered to output the first multimedia information; the first information is information from the second application, and the first application is different from the second application.

[0033] When the first condition is met, the first application is triggered to output the first multimedia information; the first information is information from the first application.

[0034] Preferably, the above method further includes:

[0035] Before the first condition is met, the second media information is obtained;

[0036] The generation of the first multimedia information based on the first information and the second media information includes:

[0037] The first information and the second media information are combined to obtain the first multimedia information.

[0038] Preferably, the above method further includes:

[0039] Before the first condition is met, the second media information is obtained, and the first information and the second media information are merged to obtain preset multimedia information;

[0040] The generation of the first multimedia information based on the first information and the second media information includes:

[0041] In response to the first information and / or the second information corresponding to the second media information, the preset multimedia information is adjusted to obtain the first multimedia information;

[0042] Wherein, the second information represents the change of the first information and / or the change of the second media information.

[0043] An information processing apparatus, comprising:

[0044] A condition monitoring unit is used to monitor whether the first condition is met;

[0045] A multimedia output unit is configured to output first multimedia information in response to the fulfillment of the first condition; the first multimedia information includes first text information.

[0046] The first multimedia information is generated based on the first information, which includes at least the first text information, and the first text information can form a first time text relationship with the first time information.

[0047] An electronic device, comprising:

[0048] The processor is used to monitor whether the first condition is met.

[0049] An output device is configured to output first multimedia information in response to the fulfillment of the first condition; the first multimedia information includes first text information.

[0050] The first multimedia information is generated based on the first information, which includes at least the first text information, and the first text information can form a first time text relationship with the first time information. Attached Figure Description

[0051] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0052] Figure 1 A flowchart illustrating an information processing method provided in an embodiment of this application;

[0053] Figure 2 Example image showing how to remind users through songs;

[0054] Figure 3 Example image showing a text-based notification to the user;

[0055] Figure 4 Example image showing reminders to users via songs and text;

[0056] Figure 5 This is an example diagram illustrating a song reminder for users using lyrics as scheduling content in an embodiment of this application.

[0057] Figure 6 This is an example diagram illustrating how a video reminder with schedule content is output to the user in an embodiment of this application.

[0058] Figure 7 This is a partial flowchart of an information processing method provided in an embodiment of this application;

[0059] Figure 8 This is an example diagram illustrating the generation of the first multimedia information in an embodiment of this application;

[0060] Figure 9 This is another example diagram illustrating the generation of the first multimedia information in this application embodiment;

[0061] Figure 10 This is another example diagram illustrating the generation of the first multimedia information in the embodiments of this application;

[0062] Figure 11 This is another example diagram illustrating the generation of the first multimedia information in this application embodiment;

[0063] Figure 12 This is another example diagram illustrating the generation of the first multimedia information in the embodiments of this application;

[0064] Figure 13 This is a schematic diagram of the structure of an information processing device provided in an embodiment of this application;

[0065] Figure 14 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0066] Figure 15 This is an example diagram illustrating how this application can be used to implement schedule reminders on mobile phones. Detailed Implementation

[0067] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0068] refer to Figure 1 The diagram shown is a flowchart illustrating the implementation of an information processing method according to an embodiment of this application. This method can be applied to electronic devices capable of data processing, such as mobile phones, tablets, laptops, and computers. The technical solution in this embodiment is primarily used to improve the user experience of information reminders.

[0069] Specifically, the method in this embodiment may include the following steps:

[0070] Step 101: Monitor whether the first condition is met. If the first condition is met, execute step 102. If the first condition is not met, continue executing step 101.

[0071] The first condition refers to the condition requiring the output of multimedia information to remind the user. In this embodiment, the first condition is continuously monitored to determine whether it is met. If the first condition is met, step 102 is executed.

[0072] Step 102: Output the first multimedia information.

[0073] The first multimedia information includes first text information. The first text information describes content that needs to be reminded to the user. The first text information may include at least one of the following: a schedule description text, a to-do list description text, or a completed task description text. Alternatively, the first text information may also be obtained from a communication application, and may include: short message text in a short message application, chat history text in a chat application, etc.

[0074] Specifically, the first multimedia information is generated based on the first information, which includes at least the first text information, and the first text information can form a first time text relationship with the first time information.

[0075] In one scenario, the first information may contain only first text information, which corresponds to first time information, representing that the task in the first text information needs to be executed at the first time corresponding to the first time information. Based on this, when obtaining the first multimedia information, the first time information is first mapped to the first text information so that the output first multimedia information can reflect the content represented by the first text information and the time corresponding to the first time information. For example, the first information includes first text information such as "Remind me of a meeting," which corresponds to the first time information "8 o'clock." In this embodiment, when obtaining the first multimedia information, "8 o'clock" is added to the first text information "Remind me of a meeting." Based on the integrated text information, the first multimedia information is obtained, which represents the multimedia information of "meeting at 8 o'clock." Accordingly, the first multimedia information is output when the first condition is met.

[0076] In another scenario, the first information may include not only the first text information but also first time information, indicating that the task in the first text information needs to be executed at the first time corresponding to the first time information. Based on this, when obtaining the first multimedia information, the first time information can be removed. The first text information is processed first, and then combined with the first time information for further processing to obtain the first multimedia information. This ensures that the output first multimedia information reflects both the content represented by the first text information and the time corresponding to the first time information. For example, the first information may include "Remind me of a meeting" and the first time information "8 o'clock". In this embodiment, when obtaining the first multimedia information, the first multimedia information is first obtained based on the first text information "Remind me of a meeting". The first multimedia information corresponds to "8 o'clock". Therefore, the first multimedia information is output when the first condition corresponding to "8 o'clock" is met.

[0077] It should be noted that the first multimedia information includes not only the first text information, but also other types of information, which may include at least one of audio type and image type.

[0078] In one case, the first multimedia information includes not only the first text information but also audio information. Based on this, in this embodiment, outputting the first multimedia information can achieve the purpose of reminding the user through both audio and text.

[0079] In another scenario, the first multimedia information includes not only the first text information but also image information. Based on this, in this embodiment, outputting the first multimedia information can achieve the purpose of reminding the user through both images and text.

[0080] As can be seen from the above technical solutions, in the information processing method provided by the embodiments of this application, in response to the fulfillment of the first condition, multimedia information generated based on the first text information is output. Thus, unlike the reminder method of broadcasting the first text information one by one, the multimedia information generated by the first text information in this application realizes the user reminder, which can improve the user experience.

[0081] In one implementation, satisfying the first condition in step 101 can be: satisfying the second time condition. The second time condition is a time-related condition. The second time condition is different from the first time condition.

[0082] If the first time condition is met, output the second multimedia information that does not include the first text information; or output the first text information; or output the first text information and the second multimedia information that does not include the first text information.

[0083] In this embodiment, if the second time condition is met, the first multimedia information including the first text information is output.

[0084] For example, when the first time condition is met, the output second multimedia information, which does not contain the first text information, can be audio with other text information, such as a melody with lyrics, i.e., a song. This song is unrelated to the description of the first text information. Figure 2 As shown, when the first time condition is met, the mobile phone outputs a song through the speaker to serve as an alarm reminder.

[0085] When the first time condition is met, the first text message output can be a text description that serves as a reminder of the scheduled content. For example... Figure 3 As shown, when the first condition is met, the phone outputs a text description of the schedule, such as "Meeting at 8 o'clock," on the screen, thereby achieving the purpose of schedule reminder through text description.

[0086] When the first time condition is met, the output first text information can be a text description that reminds you of the schedule content, while the output second multimedia information, excluding the first text information, can be audio containing other text information. For example... Figure 4 As shown, when the first-time condition is met, the mobile phone outputs a song through the speaker and displays a text description of the schedule, such as "Meeting at 8 o'clock," on the screen, thereby achieving the purpose of schedule reminder through text description and song.

[0087] When the second time condition is met, the first multimedia information output in this embodiment is audio or video containing the first text information. For example, such as... Figure 5 As shown, when the second time condition is met, the mobile phone outputs a song with the description "Meeting at 8 o'clock" through its speaker; that is, the lyrics of the song contain schedule information such as "Meeting at 8 o'clock." For example, ... Figure 6 As shown, when the second time condition is met, the mobile phone outputs a video with schedule content such as "meeting at 8 o'clock" through the screen. That is, the video screen contains the description of "meeting at 8 o'clock". Furthermore, it can also output a song with the lyrics "meeting at 8 o'clock" through the speaker at the same time.

[0088] It can be seen that, as Figure 5 and Figure 6 As shown in the figure, this embodiment can remind users of their schedules by combining multiple types of information (that is, the information used for reminders is fused together, such as lyrics plus melody, or video plus lyrics plus melody, etc., rather than outputting information from different sources at the same time), thereby improving the user's experience of using schedule reminders.

[0089] In a specific implementation, the first condition may include: reaching the target time. That is, if the target time is reached, the first multimedia information is output.

[0090] In one implementation, the target time can be a second time. Based on this, in this embodiment, in response to satisfying the first condition, the output of the first multimedia information can be:

[0091] In response to the arrival of the second time, output multimedia information to indicate the second time.

[0092] In this context, the second time is unrelated to the first time information. Therefore, the multimedia information used to indicate the second time includes first text information corresponding to the first time information, but the first time information corresponds to the second time is unrelated to the second time.

[0093] Based on this, in this embodiment, it is monitored whether the second time has been reached. If the second time has been reached, multimedia information is output to indicate that the second time has arrived, and the corresponding description content of the first text information is also displayed.

[0094] For example, when a phone alarm detects that it's 8 AM, it triggers the speaker to output a reminder message. This message is a song with the lyrics "Schedule Content," meaning the song's lyrics describe the schedule. In this case, the schedule time (e.g., the current month's schedule in meeting minutes, i.e., the first time corresponding to the first-time information) is unrelated to "8 AM." In other words, the user doesn't set the alarm specifically to remind them of scheduled events, so they don't need to consider the schedule or its corresponding time. However, the alarm uses the schedule information when it's triggered. This serves both to remind the user of the set time and, incidentally, to remind them of their tasks for the day or activities completed yesterday.

[0095] In one implementation, this embodiment can construct multiple reminder modes for the electronic device, such as a reminder mode for reviewing completed tasks and a reminder mode for alerting pending tasks. In this embodiment, when obtaining the first multimedia information, corresponding first text information can be obtained based on the currently set reminder mode. For example, the first text information may include: descriptive text of historical completed tasks corresponding to the reminder mode for reviewing existing tasks, descriptive text of future pending tasks corresponding to the reminder mode for alerting pending tasks, etc. Then, the first multimedia information is obtained based on the first text information, and the user is reminded of completed or pending tasks in a combination of multiple information types.

[0096] For example, when a user sets their electronic device to a reminder mode to review completed tasks, if the first condition is met, the first multimedia information obtained from the description text of the tasks completed the previous day can be output to remind the user of everything they have done the previous day.

[0097] For example, when a user sets their electronic device to a reminder mode for pending and completed tasks, once the first condition is met, the first multimedia information obtained from the description text of tomorrow's tasks can be output to remind the user of everything they need to do tomorrow.

[0098] In another implementation, the target time can be a third time. Based on this, in this embodiment, in response to satisfying the first condition, the output of the first multimedia information can be:

[0099] In response to the arrival of the third time, output multimedia information to prompt the first time information.

[0100] The third time is earlier than the time represented by the first time information, i.e., the first time. Based on this, the multimedia information used to prompt the first time information includes the first text information corresponding to the first time information, and the time represented by the first time information is later than the third time. That is to say, the first multimedia information is output in advance at the third time to prompt that the task corresponding to the first text information needs to be executed at the subsequent first time.

[0101] Based on this, in this embodiment, it is monitored whether a third time earlier than the time represented by the first time information is reached. If the third time is reached, multimedia information is output to prompt the first time information. The output multimedia information prompts the upcoming first time and also prompts the description content corresponding to the first text information.

[0102] For example, when the phone's calendar app detects that the time has reached the warning time corresponding to "meeting at 8 o'clock" (i.e., 7:45 AM), the phone's calendar app triggers the speaker to output a reminder message, that is, it outputs a song with the description of "calendar content" through the speaker. In other words, the lyrics of the song are "calendar content". At this time, the calendar time corresponding to "calendar content", such as the meeting start time of 8 o'clock (i.e. the first time corresponding to the first time information), is earlier than "7:45 AM".

[0103] Of course, this embodiment also applies to the solution of using an alarm clock to remind the schedule. In this case, the user's alarm clock is set automatically. For example, if the schedule contains a "meeting at 8 am tomorrow", the wake-up time will be estimated based on the user's habit data. Assuming that the analysis shows that the user usually starts working 1 hour after waking up, then the alarm clock at 7 am will be automatically set as the user's wake-up alarm.

[0104] In one implementation, this embodiment may further include the following processes, such as... Figure 7 As shown:

[0105] Step 701: Input the first information into the generative model.

[0106] Among them, the generative model can be an intelligent model that can generate at least one of audio, text, and images.

[0107] Step 702: Obtain the output information of the generative model.

[0108] The first multimedia information includes output information. This can be understood as follows: in this embodiment, first information, including first text information, is input into the generative model, and then the first multimedia information is generated based on the output information of the generative model. The first multimedia information contains the output information.

[0109] In one possible implementation, after the first information is input into the generative model, the output information of the generative model is multimedia information containing multiple types of information. In this embodiment, the output information of the generative model can be used as the first multimedia information, and the first multimedia information is output when the first condition is met.

[0110] For example, using the first piece of information containing the initial text "meeting at 8 o'clock" as input to the generative model, such as... Figure 8 As shown, the generative model outputs a song with lyrics containing "meeting at 8 o'clock" as the first multimedia information. When the first condition is met, the first multimedia information is output, that is, a song with lyrics containing "meeting at 8 o'clock" is output to remind the user of the scheduled "meeting at 8 o'clock". Compared with directly announcing "meeting at 8 o'clock", this can improve the user's experience of using the schedule reminder.

[0111] In one possible implementation, after the first information is input into the generative model, the generative model generates second multimedia information. Based on this, in this embodiment, information that integrates the second multimedia information and the first text information can be output. That is, the second multimedia information and the first text information output by the generative model are first integrated to obtain the first multimedia information, and then the first multimedia information is output when the first condition is met.

[0112] For example, using the first piece of information containing the initial text "meeting at 8 o'clock" as input to the generative model, such as... Figure 9 As shown, a melody or a video stream with a melody is output by the generative model as the second multimedia information. The second multimedia information is then fused with "meeting at 8 o'clock" to obtain the first multimedia information. The first multimedia information is then output when the first condition is met.

[0113] In one implementation, this embodiment can generate first multimedia information based on first information and second media information. That is, this embodiment does not use a generative model, but directly performs information fusion based on existing first information and existing second media information to obtain the first multimedia information, thereby outputting the first multimedia information when the first condition is met.

[0114] The second media information can be audio or image information, and is a single type of information. The second media information can be pre-stored in a cache. When the first text information is created, i.e., when the first multimedia information needs to be generated, the second media information can be read from the cache, and the first multimedia information can be generated based on the second media information and the first information containing the first text information. At this time, the first multimedia information is composed of multiple types of information. When the first condition is met, the first multimedia information can be output.

[0115] For example, after a user sets the first text message "Meeting at 8 o'clock", such as Figure 10 As shown, the "meeting at 8 o'clock" is fused with a preset musical melody to generate multimedia information containing "meeting at 8 o'clock", namely the first multimedia information. Thus, the first multimedia information is output when the first condition is met.

[0116] Based on the above implementation, in one possible implementation, the second media information may include a first audio element, which includes a first element. The first element may be a musical note, that is, the first audio element is a melody composed of multiple musical notes.

[0117] Therefore, in this embodiment, when generating the first multimedia information based on the first information and the second media information, the first text information and the first element can be merged to obtain the first multimedia information.

[0118] In a specific implementation, this embodiment can fuse the descriptive characters in the first text information with the first element in the first audio to obtain a melody that incorporates the descriptive characters.

[0119] For example, after a user sets the first text message "Meeting at 8 o'clock", such as Figure 11 As shown, each character in "8 o'clock meeting" is sequentially fused with the corresponding note in the first audio to obtain a song whose lyrics include "8 o'clock meeting", i.e., the first multimedia information. Thus, the first multimedia information is output when the first condition is met.

[0120] In another possible implementation, the second media information may include a second audio, which includes a first element and a second element. The first element may be a musical note, and the second element may be a character. That is, the second audio is a song containing lyrics and musical notes.

[0121] Based on this, in this embodiment, when generating the first multimedia information based on the first information and the second media information, the second element can be adjusted based on the first text information to obtain the second text information, and then the second text information and the first element can be merged to obtain the first multimedia information.

[0122] In a specific implementation, in this embodiment, the second element in the second audio can be replaced or modified according to the descriptive characters in the first text information to obtain the second text information. Then, the descriptive characters in the second text information are fused with the first element in the second audio to obtain a melody that incorporates the descriptive characters of the first text information.

[0123] For example, after a user sets the first text message "Meeting at 8 o'clock", such as Figure 12 As shown, the lyrics in the second audio are modified according to each character of "8 o'clock meeting," and then the modified lyrics are sequentially merged with the corresponding notes in the second audio to obtain a song whose lyrics include "8 o'clock meeting," i.e., the first multimedia information. The first multimedia information is then output when the first condition is met. Thus, in this embodiment, the lyrics in the pre-cached song are replaced with schedule content such as "8 o'clock meeting," reminding the user through a song containing schedule content, thereby improving the user experience.

[0124] Based on the above implementation scheme, in one possible implementation, in this embodiment, a first audio that satisfies the second condition can be obtained to obtain second media information including the first audio.

[0125] The operation parameters of the first audio file satisfying the second condition may include at least one of the following: the total playback duration of the first audio file reaches the target duration; the total number of times the first audio file is played reaches the target number of times; the number of accounts that have favorited the first audio file reaches the target number. The operation parameters satisfying the second condition can characterize the user's preference for audio. Based on this, in this embodiment, the first text information and the first element in the first audio file favored by the user can be merged to obtain the first multimedia information.

[0126] For example, in this embodiment, a melody that has been played by the user for a total duration of 1 hour can be selected as the first audio, and second media information containing the first audio can be obtained accordingly.

[0127] In another possible implementation, in this embodiment, a second audio that satisfies the second condition can be obtained to obtain second media information including the second audio.

[0128] The operation parameters of the second audio that satisfy the second condition may include at least one of the following: the total playback duration of the second audio reaches the target duration; the total number of times the second audio is played reaches the target number; the number of accounts that have favorited the second audio reaches the target number. The operation parameters satisfying the second condition can characterize the user's preference for audio. Based on this, in this embodiment, the second element in the second audio that the user prefers can be adjusted based on the first text information to obtain the second text information. Then, the second text information is fused with the first element in the second audio that the user prefers to obtain the first multimedia information.

[0129] For example, in this embodiment, a song that has been played by the user up to 200 times can be selected as the second audio, thereby obtaining second media information containing the second audio.

[0130] In another possible implementation, this embodiment can obtain a second audio that satisfies a third condition to obtain second media information including the second audio. The third condition indicates that the second element matches the first text information.

[0131] Based on this, in this embodiment, the second audio that matches the second element, such as lyrics, is selected according to the first text information. The second element in the matched second audio can be adjusted based on the first text information to obtain the second text information. Then, the second text information is fused with the first element in the matched second audio to obtain the first multimedia information.

[0132] For example, in this embodiment, a second audio file matching the lyrics of "meeting at 8 o'clock" can be selected, thereby obtaining second media information containing the second audio file.

[0133] As can be seen, in this embodiment, the lyrics in the audio requested by the user are replaced with schedule content such as "meeting at 8 o'clock". The user is reminded of the schedule content by the song he likes, which further improves the user experience.

[0134] In one implementation, the second media information can be obtained before the first condition is met. That is, the second media information can be pre-deployed. Based on this, when generating the first multimedia information based on the first and second media information, the first and second media information can be merged to obtain the first multimedia information. Alternatively, when the first multimedia information needs to be output, that is, when the first condition is met, the first and second media information are then merged to obtain the first multimedia information.

[0135] For example, in this embodiment, second media information is pre-deployed. After the first information is generated, the system waits for the first condition to be met before generating and outputting the first multimedia information based on the first information and the second media information. Therefore, even if the first text information in the first information is modified, the first multimedia information can still be generated based on the modified first information when the first condition is met, thereby improving the accuracy of the output first multimedia information.

[0136] In one implementation, this embodiment allows obtaining the second media information before the first condition is met, and then fusing the first and second media information to obtain preset multimedia information. That is, the second media information can be pre-deployed; after the first information is generated, the corresponding preset multimedia information is generated, awaiting the first condition to be met. When the first condition is met, there may be changes in the first information and / or the second media information. In this case, the preset multimedia information can be adjusted in response to the second information corresponding to the first and / or the second media information to obtain the first multimedia information.

[0137] The second information represents the change in the first information and / or the change in the second media information.

[0138] Specifically, in this embodiment, the preset multimedia information is adjusted in at least one of the following ways:

[0139] Adjust the information corresponding to the first element in the preset multimedia information, such as adjusting the notes, to adjust the melody of the melody in the multimedia information;

[0140] Adjust the information corresponding to the second element in the preset multimedia information, such as adjusting the lyrics, to adjust the lyrics in the multimedia information.

[0141] For example, in this embodiment, by pre-deploying second media information, preset multimedia information can be generated directly based on the first and second media information after the first information is generated. When the first condition is met, the preset multimedia information is adjusted according to the changes in the first and second media information before the adjusted multimedia information is output. This avoids the situation where changes in the first and second media information before the first condition is met lead to errors in the output of the first multimedia information, thereby improving the accuracy of the output first multimedia information. Moreover, in this application, only the preset multimedia information needs to be adjusted according to the information changes; there is no need to re-execute the multimedia information generation process, thereby reducing the amount of data processing required to acquire the first multimedia information and improving the efficiency of information acquisition.

[0142] In one implementation, the first multimedia information in this embodiment can be generated by a local electronic device, or the cloud can initiate the generation of the first multimedia information and then send it to the local electronic device after the local electronic device provides the first text information to the cloud server.

[0143] It should be noted that in this embodiment, the generation of the first multimedia information (either by a local electronic device or by a cloud server) can be determined based on the sensitivity of the first text information. For example, if the first text information contains user privacy data, the first multimedia information is generated by a local electronic device, such as a mobile phone, to ensure the security of the privacy data; if the first text information does not contain user privacy data, the first multimedia information is generated by a cloud server, which can reduce the resource consumption of the local electronic device and improve the performance of the electronic device.

[0144] In one implementation, step 102, when outputting the first multimedia information in response to satisfying the first condition, can be achieved in the following way:

[0145] In response to the fulfillment of the first condition, the first application is triggered to output the first multimedia information.

[0146] In this embodiment, the first information refers to information from the second application, and the first application is different from the second application. The first application is an application capable of outputting multimedia information, such as an alarm clock application; the second application is an application capable of providing the first information, such as a calendar application or a chat application, or other communication-type applications. In other words, in this embodiment, outputting the first multimedia information and providing the first information are achieved through different applications.

[0147] For example, in this embodiment, the calendar application provides the schedule content "Meeting at 8 o'clock," and the alarm clock application outputs the first multimedia information corresponding to "Meeting at 8 o'clock." The calendar application and the alarm clock application are different applications on the mobile phone.

[0148] In another implementation, step 102, when outputting the first multimedia information in response to satisfying the first condition, can be achieved in the following way:

[0149] In response to the fulfillment of the first condition, the first application is triggered to output the first multimedia information.

[0150] Here, the first information refers to information within the first application. The first application outputs multimedia information through a reminder function module, such as an alarm clock function module; it also provides the first information through a schedule function module, such as a calendar function module. In other words, in this embodiment, outputting the first multimedia information and providing the first information are achieved through different functional modules within the same application.

[0151] For example, in this embodiment, the schedule content "meeting at 8 o'clock" is provided through the schedule function module in a specific application, and the first multimedia information corresponding to "meeting at 8 o'clock" is output through the reminder function module in the application. The schedule function module and the reminder function module are different function modules in the application.

[0152] refer to Figure 13 This is a schematic diagram of an information processing device provided in an embodiment of this application. The device can be configured in an electronic device capable of data processing, such as a mobile phone, tablet, laptop, or computer. The technical solution in this embodiment is mainly used to improve the user experience of information reminders.

[0153] Specifically, the apparatus in this embodiment may include the following units:

[0154] Condition monitoring unit 1301 is used to monitor whether the first condition is met;

[0155] The multimedia output unit 1302 is configured to output first multimedia information in response to the fulfillment of the first condition; the first multimedia information includes first text information.

[0156] The first multimedia information is generated based on the first information, which includes at least the first text information, and the first text information can form a first time text relationship with the first time information.

[0157] As can be seen from the above technical solutions, in the information processing device provided in this application embodiment, in response to the fulfillment of the first condition, multimedia information generated based on the first text information is output. Thus, unlike the reminder method of broadcasting the first text information one by one, the user reminder is realized through multimedia information generated from the first text information in this application, which can improve the user experience.

[0158] refer to Figure 14This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device may include the following structure:

[0159] Processor 1401 is used to monitor whether the first condition is met;

[0160] Output device 1402 is used to output first multimedia information in response to the fulfillment of the first condition; the first multimedia information includes first text information.

[0161] The first multimedia information is generated based on the first information, which includes at least the first text information, and the first text information can form a first time text relationship with the first time information.

[0162] The output device 1402 may include at least one of a sound output device and a video output device. The sound output device may be a speaker or the like. The video output device may be a display screen or the like.

[0163] As can be seen from the above technical solutions, in an electronic device provided by the embodiments of this application, in response to the fulfillment of a first condition, multimedia information generated based on at least the first text information is output. Thus, unlike the reminder method of broadcasting the first text information one by one, the multimedia information generated by the first text information in this application realizes user reminders, which can improve the user experience.

[0164] Taking a mobile phone as an example, the technical solution of this application is illustrated below:

[0165] Currently, in their busy lives, consumers often lack convenient, easy, and creative ways to check their daily schedules. Calendar apps are typically perceived as non-essential, resulting in low user engagement and high churn rates.

[0166] Therefore, this application proposes a generative AI model to achieve a more creative schedule reminder solution. The application can then perform the following processing:

[0167] First, an audio database containing secondary media information is established, covering popular music. Then, with the user's permission, the first or second audio is determined by analyzing the user's audio operation parameters in their playlist, in order to build a user's audio preference profile.

[0168] Furthermore, when users check their daily schedules on their phones, the system compares the schedule content with audio files in an audio database, identifying the audio with the highest lyric matching score—the second audio file. Based on this, the audio files in the database, along with the user's audio preference profile, are fed into an AI model. The AI ​​model then adjusts the lyrics of the audio files matching the user's preference profile according to the schedule content, resulting in a song with lyrics matching the schedule content. Alternatively, the AI ​​model can generate a new melody and then blend it with the lyrics corresponding to the schedule content to create a song with lyrics matching the schedule content. Finally, when the target time arrives, the song is played to the user, announcing the target time as part of the day's schedule.

[0169] like Figure 15 As shown, the process is as follows:

[0170] 1. Users enter their daily tasks in the calendar application;

[0171] 2. Based on the audio database, by analyzing the user's audio operation parameters, establish a user preference profile for audio, such as the audio that the user often listens to;

[0172] 3. The AI ​​model generates music that matches the day's events;

[0173] 4. Integrate the day's events with music to create an audio file where the lyrics contain the day's events;

[0174] 5. Output audio lyrics containing the day's events for the user.

[0175] Furthermore, this application can also receive user feedback on the output audio, thereby optimizing the AI ​​model and the audio generation process.

[0176] It should be noted that in this embodiment, when matching music, user preferences such as language, dialect, intonation, and tone can be considered. When analyzing user audio preference profiles, frequently listened-to and collected music can be considered, and specific dimensions to consider can include: pitch, tempo, dynamics, ascending, and descending frequencies.

[0177] For example, the schedule might read: "The user has a sales roadshow at 9:00 AM today." The user's most frequently played song over the past week is "Fly Away." One line of the song is: "The bugle has sounded, run fast and overturn the house; rush along the road to chase the sun, and speak your heart." A new audio message can be generated using an AI model, retaining the original key of the song but changing the lyrics to: "The bugle has sounded, run fast and overturn the house, at 9:00 AM chase the rising sun, and start the sales roadshow."

[0178] It is evident that the technical solution adopted in this application, compared to simply reading the content on the schedule, is closer to user preferences, more creative, and can bring users more surprises. Moreover, using audio to announce the schedule allows users to easily understand the schedule content in scenarios such as driving, increasing user stickiness with the software and device.

[0179] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0180] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0181] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein can be implemented directly by hardware, a software module executed by a processor, or a combination of both. The software module can be located in random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other form of storage medium known in the art.

[0182] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An information processing method, comprising: If the first condition is met, output the first multimedia information; The first multimedia information includes the first text information; Wherein, the first multimedia information is obtained by fusing the first information and the second media information, the second media information includes audio, the first information includes at least the first text information, and the first text information can form a first time text relationship with the first time information. The first time text relationship indicates that the task in the first text information needs to be executed at the first time corresponding to the first time information. Wherein, the first multimedia information obtained by fusing the first information and the second media information includes at least one of the following: The second media information includes a first audio, which includes a first element, which is a musical note. The first text information and the first element are then combined to obtain the first multimedia information. The second media information includes a second audio, which includes a first element and a second element. The first element is a musical note, and the second element is a character. The second element is adjusted based on the first text information to obtain the second text information. The second text information and the first element are then merged to obtain the first multimedia information.

2. The method according to claim 1, wherein satisfying the first condition includes: The second time condition is met; the second time condition is different from the first time condition. If the first time condition is met, output second multimedia information that does not include the first text information; or output the first text information; or output the first text information and second multimedia information that does not include the first text information.

3. The method according to claim 1, wherein the first condition includes reaching the target time, the response satisfying the first condition, and outputting first multimedia information, including any one of the following: Upon reaching the second time, a multimedia message is output to indicate the second time, which is unrelated to the first time information; Upon reaching a third time, multimedia information is output to indicate the first time information, wherein the third time is earlier than the time represented by the first time information.

4. The method according to claim 1, further comprising: The first information is input into the generative model; Obtain the output information of the generative model; The first multimedia information includes the output information.

5. The method according to claim 4, further comprising, after inputting the first information into the generative model: The generative model generates second multimedia information and outputs information that integrates the second multimedia information and the first text information.

6. The method according to claim 1, wherein the second media information includes a first video, and the first video includes a first element; in, The process of obtaining the first multimedia information based on the fusion of the first information and the second media information includes: The first text information and the first element are combined to obtain the first multimedia information.

7. The method according to claim 1, wherein the second media information includes a second video, and the second video includes a first element and a second element; in, The process of obtaining the first multimedia information based on the fusion of the first information and the second media information includes: The second element is adjusted based on the first text information to obtain the second text information; The second text information is combined with the first element to obtain the first multimedia information.

8. The method of claim 1, further comprising one of the following: Obtain a first audio or a second audio that satisfies the second condition, so as to obtain the second media information including the first audio or the second audio; Obtain the second audio that satisfies the third condition to obtain the second media information including the second audio; the third condition indicates that the second element matches the first text information.

9. The method according to any one of claims 1 to 7, wherein the response satisfies the first condition and outputs first multimedia information, including any one of the following: When the first condition is met, the first application is triggered to output the first multimedia information; the first information is information from the second application, and the first application is different from the second application. If the first condition is met, the first application is triggered to output the first multimedia information. The first information is information from the first application.

10. The method according to claim 1, further comprising: Before the first condition is met, the second media information is obtained; The generation of the first multimedia information based on the first information and the second media information includes: The first information and the second media information are combined to obtain the first multimedia information.

11. The method according to claim 1, further comprising: Before the first condition is met, the second media information is obtained, and the first information and the second media information are merged to obtain preset multimedia information; The generation of the first multimedia information based on the first information and the second media information includes: In response to changes in the first information and / or the second media information, the preset multimedia information is adjusted to obtain the first multimedia information.

12. An information processing apparatus, comprising: A condition monitoring unit is used to monitor whether the first condition is met; A multimedia output unit is configured to output first multimedia information in response to the fulfillment of the first condition. The first multimedia information includes the first text information; Wherein, the first multimedia information is obtained by fusing the first information and the second media information, the second media information includes audio, the first information includes at least the first text information, and the first text information can form a first time text relationship with the first time information. The first time text relationship indicates that the task in the first text information needs to be executed at the first time corresponding to the first time information. Wherein, the first multimedia information is generated by fusing the first information and the second media information, including at least one of the following: When the second media information includes a first audio, and the first audio includes a first element, the first element being a musical note, the first text information and the first element are merged to obtain the first multimedia information; When the second media information includes a second audio, the second audio includes a first element and a second element, the first element is a musical note and the second element is a character, the second element is adjusted based on the first text information to obtain the second text information; the second text information and the first element are then merged to obtain the first multimedia information.

Images