Notification method, electronic device, storage medium and computer program product

Abstract

The invention relates to a notification method, electronic equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring call content between users; and identifying event notification information in the call content, and sending a notification to a notified end based on the event notification information. Therefore, in the conversation process between the users, the notification event in the conversation process can be automatically identified, and the notification information is sent to the notified end, so that the trouble that the users need to manually record the notification event in the conversation process can be avoided, and the conversation efficiency between the users can be improved to a great extent.

Description

Technical Field

[0001] The present disclosure relates to the field of communication technology, and in particular to a notification method, an electronic device, a storage medium, and a computer program product. Background Art

[0002] When users communicate with each other via mobile phones, they often agree on related activities or one party notifies the other party to participate in related activities. When users receive phone notifications, they often need to manually record related activity information, which affects the call efficiency between users. Summary of the invention

[0003] The present disclosure provides a notification method, an electronic device, a storage medium, and a computer program product.

[0004] According to a first aspect of the present disclosure, a notification method is provided, the method comprising:

[0005] Get the conversation content between users;

[0006] Identify event notification information in the call content, and send a notification to the notified end based on the event notification information.

[0007] According to a second aspect of the present disclosure, a notification device is provided, the device comprising:

[0008] A call content acquisition module is used to acquire the call content between users;

[0009] An identification module, used to identify event notification information in the call content;

[0010] The notification module is used to send a notification to the notified end based on the event notification information.

[0011] According to a third aspect of the present disclosure, an electronic device is provided, which includes a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the program, the method described above is implemented.

[0012] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the above method of the present disclosure is implemented.

[0013] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program, wherein the computer program implements the above method of the present disclosure when executed by a processor.

[0014] The notification method, electronic device, storage medium and computer program product provided by the embodiments of the present disclosure obtain the content of the call between users, identify the event notification information in the call content, and send a notification to the notified end based on the event notification information. In this way, during the call between users, it is possible to automatically identify the notification event during the call and send the notification information to the notified end, thereby avoiding the tediousness of the user having to manually record the notification event during the call, and greatly improving the call efficiency between users. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Further details, features and advantages of the present disclosure are disclosed in the following description of exemplary embodiments in conjunction with the accompanying drawings, in which:

[0016] Figure 1 A schematic diagram of an event notification content setting interface provided by an exemplary embodiment of the present disclosure;

[0017] Figure 2 A schematic diagram of an event notification video generated at different urgency levels provided by an exemplary embodiment of the present disclosure;

[0018] Figure 3 A flowchart of a notification method provided by an exemplary embodiment of the present disclosure;

[0019] Figure 4 A schematic block diagram of functional modules of a notification device provided by an exemplary embodiment of the present disclosure;

[0020] Figure 5 A structural block diagram of an electronic device provided by an exemplary embodiment of the present disclosure;

[0021] Figure 6 An exemplary embodiment of the present disclosure provides a structural block diagram of a computer system. DETAILED DESCRIPTION

[0022] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0023] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0024] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0025] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0026] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0027] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0028] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0029] As an optional but non-limiting implementation, in response to receiving an active request from the user, the method of sending a prompt message to the user may be, for example, a pop-up window, in which the prompt message may be presented in text. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device. It is understandable that the above notification and the process of obtaining user authorization are only illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0030] With the increasing popularity of mobile terminals such as mobile phones, users usually communicate with each other through mobile phones. In daily mobile phone communication scenarios, users often face the issue or passive receipt of notifications of various important events, such as party reminders, meeting notifications, or ticket booking time. How to allow users to take notes and extract notification information in real time while receiving verbal notifications, and receive reminder messages before the event occurs? The relevant technology usually uses the voice note function of the terminal device, but this requires users to pre-install and manually wake up the real-time voice note software before use.

[0031] In the related technology, users need to install third-party voice memo software outside the operator in advance and ensure that it is woken up in advance, otherwise the content of the phone notification cannot be collected in real time. However, the locally installed voice memo requires authorization to monitor the call content throughout the process, which poses an information security risk.

[0032] Moreover, the person notifying can only emphasize the important content of the notification on the phone, and cannot automatically send reminder messages to the other party. The notified party can usually only rely on the local mobile phone alarm reminder function and needs to set the reminder manually. Since the mobile phone alarm only has simple text and ringing reminders, users cannot intuitively feel the context of the notification event and the urgency of the person notifying.

[0033] Therefore, in order to solve the above technical problems, the disclosed embodiment does not require users to install or use third-party note-taking software. By analyzing the content of the conversation between users, the notification event information in the content is identified and the notified party is reminded at the corresponding time. In addition, the notification event can also be generated into an event notification video with the help of a virtual image of the notifying party, so that when the notified party sees the event notification video, he can intuitively feel the reminder scenario of the notifying party to the notified party, making the event notification more interactive.

[0034] Specifically, 1) collect the voice content of calls between users in real time and identify events in the voice content.

[0035] In the embodiment, the call between users can be a two-party call or a multi-party call. The call can be a voice call or a video call, and the embodiment is not limited thereto. Therefore, after the telephone connection is established between the users, the communication platform can collect the voice call data between the users in real time, separate the human voice from the audio content of the two-party call, and extract the corresponding text content through voice recognition technology.

[0036] It should be noted that when recognizing speech between users, it is necessary not only to obtain the text content corresponding to the speech, but also to obtain the interaction mode and tone in the speech. For example, the interaction mode can be one party reminding the other party to execute a related event, or a related event that both parties agree to execute. The tone can be a strong reminder, a general reminder, or a gentle reminder. In addition, the system can identify key information of the notification event, such as the event notifier, the notified person, the event content, and the notification time.

[0037] In an embodiment, the interactive content between users can be obtained in real time. For example, by collecting the call voice in real time, the system can capture the real-time interaction between the two parties, which facilitates accurate identification of notification events. For example, when obtaining the voice call between users in real time, if keywords such as time, place, or related people are identified in the call content, it can be further determined whether the call content contains an event notification.

[0038] In the embodiment, in the case of obtaining the content of the call between users in real time, it is necessary not only to identify the voice content in the call, but also to accurately identify the notifying party and the notified party. For example, the notifying party can be a mother, and the notified party can be a daughter. In this way, the digital human image of the notifying party can be used to generate a notification video with the collected voice and other data, and remind the other party at the notification time or before the notification time. For example, the mother reminds her daughter to come home for dinner before 6 pm. At this time, the notification video can be sent to the daughter at 5 pm to remind her to come home for dinner before 6 pm; wait until 5:30 pm to send the notification video again to remind until the daughter closes the notification video. Among them, with the user's permission, the location of the user terminal can also be obtained in real time, for example, the current location of the daughter's mobile phone can be obtained in real time, and it can be judged whether the daughter has arrived home based on the location. If she has not arrived home, the notification video can be sent to the daughter at intervals until the daughter arrives home and stops sending the notification video.

[0039] In addition, in the embodiment, the notification video can also be generated into a video ringback tone, and an invitation can be sent to the notified party during an appropriate call to request the notified party to subscribe, so that the notification is more personalized and vivid.

[0040] In an embodiment, when the conversation between users is acquired and identified in real time, continuous voice recognition can be performed on the voice conversation between users. For example, based on the continuous conversation between the two parties' voices, the change in tone of voice and the change in the content of the call can be analyzed through the duration of the conversation, which is conducive to improving the accuracy of time feature analysis and extraction. For example, if the tone of the conversation between users is monitored to be serious, or changes from calm to serious, it is likely that a notification event has occurred, and the content of the voice call needs to be further identified, which is conducive to accurately identifying the notification event in the voice call.

[0041] 2) Feature analysis and feature extraction of events.

[0042] In the embodiment, the above embodiment can convert the voice call between users into voice call text, and input the voice call text into the event feature analysis model, and extract the display text features of the notification event involved in the voice call text. For example: a mother calls her daughter and informs her to remember to go home for dinner at 6 o'clock tonight. After being processed by the text event key information disassembly module and the importance priority decision module in the event feature analysis model, a display feature record of the event can be obtained, exemplarily:

[0043] Notifier: Identifies the user who initiated the notification, such as "Mom".

[0044] Notified Person: Identifies the user who receives the notification, such as "daughter".

[0045] Time: Identify the specific time mentioned in the notification, such as "tonight at 6 o'clock."

[0046] Event: Summarize the main content of the notice, such as "go home for dinner."

[0047] Event: If the notification is related to a specific event, the system will identify and record that event, such as "Grandma's birthday."

[0048] Urgency: Based on factors such as the tone of voice, speaking speed, and the relationship between the current time and the event time during the call, the system classifies the urgency of the event, such as marking it as "P1".

[0049] 3) Dynamically generate digital human videos that match the urgency of the notification.

[0050] In an embodiment, a scene video of a digital human sending a notification can be obtained based on the above-identified notification event features, combined with the virtual digital human image of the notifying party, and based on the digital human animation generation model.

[0051] In an embodiment, the digital human animation generation model can be trained through training samples. The training samples may include a live broadcast scene video and corresponding audio, such as by collecting or recording a live video of a notification event, and based on the data, the corresponding digital human's action, expression, gesture, voice and other data can be produced. For example, relevant tools such as facegood can be used to obtain digital human animation drive training data. Among them, facegood is a desktop-level facial motion capture software.

[0052] By using relevant tools such as facegood, data such as actions, expressions or gestures can be extracted from real-person video data, and TF-IDF (term frequency-inverse document frequency) can be used to extract key information from voice call text, and the text information feature vector can be extracted by integrating a large language model. In the embodiment, a video coding model can be used to extract features from the videos in the training set, so that latent variables of video information can be obtained. An audio coding module can be used to extract features from the sounds in the training set to obtain latent variables of sound information, and by using an acoustic model, audio synthesis can be performed on the speech information required by the digital human.

[0053] In an embodiment, in order to convert latent variables with multimodal indication information into actual digital human animation driving data, a multimodal-digital human driving information Transformer model can be constructed. The model is based on the Transformer architecture and uses one-dimensional convolution to expand the dimension of the input data and map it to a high-dimensional space. Then, a self-attention mechanism layer is constructed to capture the correlation between the latent variables with multimodal indication information and the actual digital human animation driving data, so as to realize the mapping relationship between the two.

[0054] In the embodiment, the loss function Loss of the model can be divided into two, L_mul and L_animate, where L_mul is responsible for shortening the distance between the latent variable of the multimodal indication information and the feature vector of the text information, and can be adjusted by combining the L1 distance and the L2 distance and using the control variable α as the weight. Among them, L_animate is responsible for constraining the association between the digital human-related animation data predicted by the Transformer network of the multimodal digital human driving information and the real digital human-related animation data, and similarly, the L1 distance and the L2 distance are combined and the control variable β is used as the weight adjustment.

[0055] In the embodiment provided by the present disclosure, by inputting the latent variables of the notification event obtained in the above embodiment into the digital human event distribution mapper, it is possible to map the event features to the latent space distribution generated by the digital human animation. And further obtain the feature vector corresponding to the digital human video, and the mapping relationship is learned in the end-to-end training process of the system. The above-mentioned digital human animation generation model can specifically be a multimodal digital human driven generation model. After model training, it can approximate the event features and the posture features of the real person broadcast video, encode them into a unified latent space, and then send them to the multimodal digital human driven generation model, and then predict the rendering drive data of the digital human animation video.

[0056] 4) The system automatically sends event notification videos.

[0057] In the embodiment, the system will determine whether to push the event notification video. If the notifying party has not subscribed to the video ringing notification of the event, a readable and editable display feature text and video can be pushed to the notifying party first. The user can modify and edit the event features and regenerate the digital human animation. After the notifying party confirms the notification content, the system will pop up a setting request for the digital human video ringing on the other party's call interface. For details, please visit Figure 1 As shown, Figure 1 A schematic diagram of an event notification content setting interface provided in an embodiment of the present disclosure.

[0058] If the other party has subscribed to the video ringing notification of the event, a digital human video matching the urgency of the notification can be dynamically regenerated, namely the event notification video.

[0059] In the embodiments provided by the present disclosure, in scenarios such as video calls, for users who are reminded by situational video ringing, the system can track whether the notification has been delivered, and regenerate an event notification video that is closer to the time scenario in combination with the urgency of the event countdown. The above embodiments can be combined, for example, in a notification event where a mother notifies her daughter that she will be home for dinner at 6 o'clock, the urgency of the event countdown can be regenerated into a digital animation that is closer to the time scenario. Figure 2 As shown, Figure 2 This is a schematic diagram of event notification videos generated at different urgency levels provided by an embodiment of the present disclosure. For example, the scene video received by the daughter at 5 o'clock and the scene video received after clicking on the reminder later at 5:30 present the following differences.

[0060] This dynamic generation mechanism not only reproduces the content of the notification event, but also reflects the urgency of the event through the changes in the digital human's movements, expressions and tone.

[0061] (1) Countdown monitoring: The system will continuously monitor the time until the notification event actually occurs to determine the current level of urgency.

[0062] (2) Urgency assessment: Based on the countdown time span, the system assesses the urgency of the event and adjusts the expression of the digital human video notification accordingly.

[0063] (3) Dynamic video generation:

[0064] When the countdown time is long, the digital human’s video may show a gentle reminder and a relaxed tone to avoid causing tension in the recipient too early.

[0065] As the time approaches, the digital human's movements will become more obvious and frequent, his expression will gradually change from relaxed to serious, and his tone will become more firm and urgent.

[0066] In the embodiment, the system (i.e., the server) sends the event notification video to the user in the form of a video ringback tone. For example, the server will initiate a call request to the user at a corresponding time, and the user's terminal can receive the video ringback tone of the event notification video, such as Figure 2 As shown, when the user answers the call request, the event notification video can be played on the user's terminal interface, and when the user hangs up the request, the event notification video stops playing. In addition, in the embodiment, the server can also play the event notification video on the user's terminal interface while initiating the call request to the user, but the embodiment is not limited thereto.

[0067] Based on the above embodiment, in another embodiment provided by the present disclosure, the present disclosure embodiment further provides a notification method, such as Figure 3 The method may include the following steps:

[0068] In step S310, the content of the conversation between users is obtained.

[0069] In an embodiment, during a two-party or multi-party call between users, the content of the call between users can be obtained. The call content can be voice content, for example, audio information of the call between users can be obtained in real time, and the audio information can be converted into a call text, etc. The call text can be used as the content of the call between users. In addition, the tone feature of the user can be extracted from the audio information, and the tone feature can also be used as the content of the call between users.

[0070] Specifically, for example, after a telephone connection is established between users, the communication platform can collect voice call data between users in real time, separate the human voice from the audio content of the two calls, and extract the corresponding text content through voice recognition technology.

[0071] In step S320, event notification information in the call content is identified, and a notification is sent to the notified end based on the event notification information.

[0072] In the embodiment, keywords in the above-mentioned call text are extracted, such as titles, time, place or related event content. And according to the tone characteristics of the conversation between users, it is determined whether a notification event occurs in the content of the conversation between users. For example, if the tone of the conversation between users changes from calm to serious or emphasized, a notification event is likely to occur. Therefore, when recognizing the voice between users, it is necessary not only to obtain the text content corresponding to the voice, but also to obtain the tone characteristics in the voice.

[0073] When the event notification information in the call content between users is identified, a notification can be sent to the notified end based on the time notification information. For example, the event notification information may include the notifying party, the notified party, the notification time, and the notification event content. In this way, the server or system sends the event notification information to the notified end corresponding to the notified party according to the notification time. For example, the mother reminds her daughter not to forget to go home for dinner at 6 o'clock in the evening. The notifying party of the event is the mother, the notified party is the daughter, the notification time is 6 o'clock, and the notification event content is going home for dinner. In this way, the server can send the event notification information to the daughter's mobile phone before 6 o'clock in the evening to remind her to go home in time for dinner.

[0074] The notification method provided by the embodiment of the present disclosure obtains the content of the call between users, identifies the event notification information in the call content, and sends a notification to the notified end based on the event notification information. In this way, during the call between users, it is possible to automatically identify the notification event during the call and send the notification information to the notified end, thereby avoiding the tediousness of the user having to manually record the notification event during the call, and greatly improving the call efficiency between users.

[0075] Based on the above embodiment, in another embodiment provided by the present disclosure, the event notification information may include the notification time, and the above step S320 may further specifically include the following steps:

[0076] In step S321, an event notification video is generated based on the event notification information.

[0077] In an embodiment, an event notification video can be generated based on the event notification information. For example, the event notification information can be input into a digital human driving model, and the digital human can be driven by the event notification information to perform corresponding actions to obtain an event notification video. By sending the event notification video to the notified party, the notified party can be reminded more effectively through the video, avoiding the situation where the related technology uses a relatively single reminder method such as an alarm clock.

[0078] In step S322, the event notification video is sent to the notified end based on the notification time.

[0079] In an embodiment, the event notification information includes the notification time. For example, when a mother notifies her daughter that she will go home for dinner at 6 p.m., the notification time is 6 p.m. Therefore, an event notification video can be sent to the notified end according to the notification time. For example, reminder notifications can be sent to the notified end multiple times before the notification time. Specifically, the reminder intensity can be set according to the time between the distance notification time. The reminder intensity is inversely related to the time between the current and distance notification time. That is, the shorter the time between the current and distance notification time, the greater the reminder intensity, so as to make a more effective reminder to the user. The reminder intensity can be reflected in the volume when the notified end plays the event notification video, the tone in the audio, or the posture of the digital person in the event notification video.

[0080] Therefore, in order to make more effective and vivid reminders to the notified party, so as to notify the notified party to attend relevant activities on time and execute relevant events, when generating an event notification video based on the event notification information, the virtual digital human image of the notifying party can be obtained. And the event notification information drives the virtual digital human image to perform corresponding actions to obtain the event notification video.

[0081] In the embodiment, the virtual digital human image of the notifying party can be obtained, and the virtual digital human image can be driven by the event notification information to perform the response action, so as to achieve the effect of the notifying party personally reminding the notified party. For example, when a mother notifies her daughter to go home for dinner at 6 pm, the virtual digital human image of the mother can be obtained, and the mouth shape and body movements of the virtual digital human image can be driven. For example, the mouth shape is consistent with the mouth shape of a real person saying "go home for dinner at 6 pm", and the audio information of "go home for dinner at 6 pm" is played in the event notification video. The frequency of the audio information is consistent with the audio of the mother's usual speech. In this way, when playing the event notification video, the virtual digital human image of the mother and the pronunciation of the mother can be used to better remind the daughter.

[0082] It should be noted that in the embodiment provided by the present disclosure, before sending the event notification video to the notified end based on the notification time, the event notification video and event notification information can also be sent to the notified end. In this way, when the notified end receives an editing operation on the event notification information, the event notification video is regenerated based on the event notification information after the editing operation.

[0083] In an embodiment, when identifying event notification information in the content of a call between users, since information recognition generally has a certain recognition rate, in order to avoid erroneous event notification information caused by incorrect recognition, the embodiment can also send a generated event notification video and event notification information to the notified end before sending the event notification video to the notified end based on the notification time, so that the notifying end can edit the event notification information to correct or more accurately express the event notification information. In this way, by regenerating the event notification video from the event notification information after the editing operation, the notification intention of the notifying party can be expressed more accurately, and the notified party can be reminded more accurately.

[0084] Based on the above embodiment, in another embodiment provided by the present disclosure, the above step S322 may further include the following steps:

[0085] In step S11 , the transmission time of the event notification video is determined based on the notification time.

[0086] In an embodiment, the time between the current time and the notification time can be divided into multiple time periods, so that an event notification video can be sent to the notified party once each time period arrives. For example, the notification time is 6 o'clock, and it is 4 o'clock now. The event notification video can be sent to the notified end every half an hour. For example, the event notification video is sent to the notified end once at 4 o'clock, 4:30, 5 o'clock, 5:30 and 6 o'clock respectively. The 4 o'clock, 4:30, 5 o'clock, 5:30 and 6 o'clock are the sending times determined according to the notification time.

[0087] In step S12, the event notification video is sent to the notified end according to the sending time.

[0088] In the embodiment, since the notification time is getting closer and closer each time the notification end wants to send the event notification video according to the sending time, an emergency state can be set to make a more effective reminder to the notification end. The emergency state can be the urgency level corresponding to the above embodiment.

[0089] Specifically, the duration between the sending time and the notification time can be obtained, and the emergency state of the event notification information can be determined based on the duration. In this way, the target action of the virtual digital human image in the event notification video is adjusted based on the emergency state, and the event notification video with the adjusted action is sent to the notified end according to the sending time.

[0090] For example, A notifies B to attend a company meeting at 10 a.m., and the notification time is 10 a.m. Therefore, an event notification video can be sent to the notified end according to the notification time. The event notification video uses A's digital human virtual image, and reminder notifications can be sent to the notified end multiple times before the notification time. Specifically, the emergency state can be set according to the time between the distance notification time. The emergency state is inversely correlated with the time between the current and the distance notification time, that is, the shorter the time between the current and the distance notification time, the greater the corresponding intensity of the emergency state, so as to make a more effective reminder to the user. The emergency state can be reflected in the volume when the notified end plays the event notification video, the tone in the audio, or the posture of the digital human in the event notification video, etc., and the embodiment is not limited to this.

[0091] Based on the above embodiment, in another embodiment provided by the present disclosure, the above event notification video also includes audio information. Before sending the event notification video with action adjustment to the notified party according to the sending time, the method can also adjust the tone feature in the audio information based on the above state. For example, the tone feature can gradually change from a calm tone to a serious tone as the notification time approaches, so as to attract the attention of the notified party.

[0092] In the case of dividing each functional module according to each function, an embodiment of the present disclosure provides a notification device, which may be a server, a terminal, or a chip applied to a server. Figure 4 Schematic block diagram of functional modules of a notification device provided by an exemplary embodiment of the present disclosure. Figure 4 As shown, the notification device includes:

[0093] A call content acquisition module 10 is used to acquire the call content between users;

[0094] An identification module 20, used to identify event notification information in the call content;

[0095] The notification module 30 is used to send a notification to the notified end based on the event notification information.

[0096] In another embodiment provided by the present disclosure, the event notification information includes a notification time; the notification module is specifically configured to:

[0097] generating an event notification video based on the event notification information;

[0098] The event notification video is sent to the notified end based on the notification time.

[0099] In another embodiment provided by the present disclosure, the notification module is further configured to:

[0100] Obtaining the virtual digital human image of the notifying party;

[0101] The event notification information drives the virtual digital human image to perform corresponding actions to obtain an event notification video.

[0102] In another embodiment provided by the present disclosure, the device further includes:

[0103] An information sending module, used for sending the event notification video and the event notification information to the notified end;

[0104] The information editing module is used to regenerate the event notification video based on the event notification information after the editing operation is received by the notified end.

[0105] In another embodiment provided by the present disclosure, the notification module is further configured to:

[0106] Determining a sending time of the event notification video based on the notification time;

[0107] The event notification video is sent to the notified end according to the sending time.

[0108] In another embodiment provided by the present disclosure, the notification module is further configured to:

[0109] Obtaining the duration between the sending time and the notification time;

[0110] determining an emergency status of the event notification information based on the duration;

[0111] The target action of the virtual digital human image in the event notification video is adjusted based on the emergency state, and the event notification video with the adjusted action is sent to the notified end according to the sending time.

[0112] In another embodiment provided by the present disclosure, the event notification video also includes audio information; the device also includes:

[0113] A tone feature adjustment module is used to adjust the tone feature in the audio information based on the emergency state.

[0114] The notification device provided by the embodiment of the present disclosure obtains the content of the call between users, identifies the event notification information in the call content, and sends a notification to the notified end based on the event notification information. In this way, during the call between users, it is possible to automatically identify the notification event during the call and send the notification information to the notified end, thereby avoiding the tediousness of the user having to manually record the notification event during the call, and greatly improving the call efficiency between users.

[0115] An embodiment of the present disclosure also provides an electronic device, comprising: at least one processor; and a memory for storing instructions executable by the at least one processor; wherein the at least one processor is configured to execute the instructions to implement the above method disclosed in the embodiment of the present disclosure.

[0116] Figure 5 The structure diagram of an electronic device provided by an exemplary embodiment of the present disclosure is shown in FIG. Figure 5 As shown, the electronic device 1800 includes at least one processor 1801 and a memory 1802 coupled to the processor 1801 , and the processor 1801 can execute corresponding steps in the above method disclosed in the embodiment of the present disclosure.

[0117] The processor 1801 may also be referred to as a central processing unit (CPU), which may be an integrated circuit chip having signal processing capabilities. Each step in the method disclosed in the embodiment of the present disclosure may be completed by an integrated logic circuit of hardware in the processor 1801 or by instructions in the form of software. The processor 1801 may be a general-purpose processor, a digital signal processor (DSP), an ASIC (Application Specific Integrated Circuit), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present disclosure may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in a decoding processor. The software module may be located in a memory 1802, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, or other mature storage media in the art. The processor 1801 reads the information in the memory 1802 and completes the steps of the method in combination with its hardware.

[0118] In addition, when various operations / processes according to the present disclosure are implemented by software and / or firmware, they can be transmitted from a storage medium or a network to a computer system having a dedicated hardware structure, such as Figure 6 The computer system 1900 shown is installed with the programs constituting the software. When the various programs are installed, the computer system can perform various functions, including the functions described above. Figure 6 A structural block diagram of a computer system provided for an exemplary embodiment of the present disclosure.

[0119] Computer system 1900 is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0120] like Figure 6 As shown, the computer system 1900 includes a computing unit 1901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1902 or a computer program loaded from a storage unit 1908 to a random access memory (RAM) 1903. In the RAM 1903, various programs and data required for the operation of the computer system 1900 can also be stored. The computing unit 1901, the ROM 1902, and the RAM 1903 are connected to each other via a bus 1904. An input / output (I / O) interface 1905 is also connected to the bus 1904.

[0121] A plurality of components in the computer system 1900 are connected to the I / O interface 1905, including: an input unit 1906, an output unit 1907, a storage unit 1908, and a communication unit 1909. The input unit 1906 may be any type of device capable of inputting information to the computer system 1900, and the input unit 1906 may receive input digital or character information, and generate key signal inputs related to user settings and / or function control of the electronic device. The output unit 1907 may be any type of device capable of presenting information, and may include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 1908 may include, but is not limited to, a disk, an optical disk. The communication unit 1909 allows the computer system 1900 to exchange information / data with other devices over a network such as the Internet, and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0122] The computing unit 1901 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1901 performs the various methods and processes described above. For example, in some embodiments, the above methods disclosed in the embodiments of the present disclosure may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1908. In some embodiments, part or all of the computer program may be loaded and / or installed on an electronic device via ROM 1902 and / or communication unit 1909. In some embodiments, the computing unit 1901 may be configured to perform the above methods disclosed in the embodiments of the present disclosure in any other appropriate manner (e.g., by means of firmware).

[0123] The embodiment of the present disclosure further provides a computer-readable storage medium, wherein when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above method disclosed in the embodiment of the present disclosure.

[0124] The computer-readable storage medium in the disclosed embodiments may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. The computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. More specifically, the computer-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0125] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0126] The embodiments of the present disclosure further provide a computer program product, including a computer program, wherein when the computer program is executed by a processor, the above method disclosed in the embodiments of the present disclosure is implemented.

[0127] In embodiments of the present disclosure, computer program codes for performing the operations of the present disclosure may be written in one or more programming languages ​​or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer.

[0128] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0129] The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.

[0130] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0131] The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).

[0132] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A notification method, characterized in that: The method comprises: Get the conversation content between users; Identify event notification information in the call content, and send a notification to the notified end based on the event notification information.

2. The method according to claim 1, characterized in that The event notification information includes a notification time; and sending a notification to a notified end based on the event notification information includes: generating an event notification video based on the event notification information; The event notification video is sent to the notified end based on the notification time.

3. The method according to claim 2, characterized in that The generating the event notification video based on the event notification information includes: Obtaining the virtual digital human image of the notifying party; The event notification information drives the virtual digital human image to perform corresponding actions to obtain an event notification video.

4. The method according to claim 3, characterized in that Before sending the event notification video to the notified end based on the notification time, the method further includes: Sending the event notification video and the event notification information to the notified end; When an editing operation of the notified end on the event notification information is received, an event notification video is regenerated based on the event notification information after the editing operation.

5. The method according to claim 3, characterized in that: The sending the event notification video to the notified end based on the notification time includes: Determining a sending time of the event notification video based on the notification time; The event notification video is sent to the notified end according to the sending time.

6. The method according to claim 5, characterized in that The sending the event notification video to the notified end based on the sending time includes: Obtaining the duration between the sending time and the notification time; determining an emergency status of the event notification information based on the duration; The target action of the virtual digital human image in the event notification video is adjusted based on the emergency state, and the event notification video with the adjusted action is sent to the notified end according to the sending time.

7. The method according to claim 6, characterized in that The event notification video also includes audio information; Before sending the event notification video after the action is adjusted to the notified party at the sending time, the method further includes: The tone characteristics in the audio information are adjusted based on the emergency status.

8. An electronic device, characterized in that: include: at least one processor; a memory for storing the at least one processor-executable instruction; The at least one processor is configured to execute the instructions to implement the method according to any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the method as claimed in any one of claims 1 to 7.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 7 when being executed by a processor.

Images