Voice message management method and voice message management apparatus

Abstract

The application provides a voice message management method and device applied to an electronic device. The voice message management method comprises the following steps: determining a voice message to be played; in the case that there is a playing sound source, and the priority of the voice message is lower than the sound source according to a preset priority strategy, determining a presentation mode of the voice message according to a message type of the voice message. In this way, the voice message participating in the whole vehicle cabin mixing strategy is rejected, and the corresponding presentation strategy can still be determined according to the message type, instead of being directly stored in the message center or not being displayed to the user in any form. The user can pay attention to the voice message in time, and important voice messages are not missed, so that the user experience is improved.

Description

Technical Field

[0001] This application relates to the field of voice message playback technology, and in particular to a voice message management method and a voice message management device. Background Technology

[0002] Currently, for example, when a vehicle's smart cockpit plays voice messages, it is usually based on the vehicle's cockpit mixing strategy. When there is an audio source that is currently playing, if a new voice message to be played is received, the voice message to be played will be included in the vehicle's cockpit mixing strategy to determine whether the voice message to be played needs to be played.

[0003] In existing technologies, the vehicle cabin employs a first-come, first-served strategy for playing voice messages. For example, when a new voice message is received, if the vehicle's mixing strategy determines that there is no currently playing audio source or voice message, the new voice message is included in the vehicle's mixing strategy for playback. If a voice message is already playing, the new voice message is rejected by the vehicle's mixing strategy. After rejection, the vehicle will not play the new voice message; instead, it will be stored in the message center or discarded. If stored, the user can view it after the vehicle stops. This approach can lead to the rejection of important voice messages, causing users to miss crucial messages and negatively impacting the user experience. Summary of the Invention

[0004] This application provides a voice message management method and apparatus to solve the problem in the prior art where relatively important voice messages that users must pay attention to are refused to be played, resulting in users not being able to view voice messages in a timely manner, missing important voice messages, and affecting user experience.

[0005] In a first aspect, this application provides a voice message management method applied to an electronic device. The method includes: determining a voice message to be played; and, if it is determined that there is a playing audio source and the voice message has a lower priority than the audio source according to a preset priority strategy, and therefore the voice message is not played, determining the presentation method of the voice message according to the message type of the voice message.

[0006] In the implementation method of this application, the electronic device can specifically be a vehicle terminal, mobile phone, tablet, computer, or other devices.

[0007] The voice message management method provided in this application defines the message type of voice messages. When a voice message participates in the vehicle cabin mixing strategy, if there is a currently playing audio source, and the voice message's priority is determined to be lower than the audio source according to a preset priority strategy, and therefore the voice message is not played (i.e., when participation in the vehicle cabin mixing strategy is rejected), the presentation method of the voice message is determined according to its message type. This ensures that voice messages rejected from participating in the vehicle cabin mixing strategy can still have their corresponding presentation strategy determined according to their message type, rather than being directly stored in the message center or discarded. This avoids users missing important voice messages and improves the user experience.

[0008] In one implementation of the voice message management method provided in this application, the presentation method of the voice message is determined according to the message type of the voice message, including: when the message type is a first type, the voice message is presented in the form of a prompt sound playback and text display, where the text includes the text information corresponding to the voice message; when the message type is a second type, the voice message is discarded; when the message type is a third type, a voice message queue is determined, and the priority order of the voice messages corresponding to the voice messages in the voice message queue is determined, and the voice messages are played according to the priority order.

[0009] In this implementation, when a voice message of type 1 is rejected after participating in the vehicle's cabin mixing strategy, the user is notified via a combination of audio prompts and text on the screen. When a voice message of type 2 is rejected after participating in the vehicle's cabin mixing strategy, it is discarded without text prompts, reducing the number of times the user needs to view the screen while driving and lowering driving risks. When a voice message of type 3 is rejected after participating in the vehicle's cabin mixing strategy, the message is stored in a queue of voice messages to be played. Once the highest-priority audio sources have finished playing, the voice messages in the queue are played sequentially. Thus, different presentation strategies are used for voice messages of different types, improving the user experience.

[0010] In one implementation of the voice message management method provided in this application, the method further includes: if the priority of the voice message is determined to be greater than the priority of the audio source according to the priority strategy, the voice message is played at the same time as the audio source is played.

[0011] The implementation method of this application determines whether to play the voice message and the audio source simultaneously based on the priority relationship between the voice message and the audio source. This allows the playback of voice messages to better meet actual needs and improve the user experience.

[0012] In one implementation of the voice message management method provided in this application, determining whether to play a voice message while playing an audio source includes: stopping the audio source and playing the voice message; or playing the audio source and the voice message simultaneously.

[0013] In this implementation, the order of playback (voice message or audio source) is determined based on priority. This ensures that more important voice messages are played promptly.

[0014] In one implementation of the voice message management method provided in this application, stopping the playback of the audio source and playing the voice message includes: stopping the playback of the audio source, playing the voice message, and not playing the audio source after the voice message playback ends; or stopping the playback of the audio source, playing the voice message, and continuing to play the audio source after the voice message playback ends.

[0015] This application provides different playback methods, allowing users to choose the appropriate method based on the specific scenario. This enables users to receive important voice messages promptly, makes better use of their time, and improves the user experience.

[0016] In one implementation of the voice message management method provided in this application, playing an audio source and a voice message simultaneously includes: playing the audio source and the voice message simultaneously at the same volume; or playing the audio source and the voice message simultaneously at different volumes.

[0017] In this application, voice messages and audio sources are played simultaneously at the same volume, allowing users to focus on the voice messages while listening to the audio source. Alternatively, two voice messages can be distinguished by different volumes, enabling users to focus on the voice messages while listening to the audio source and differentiate the content of the two voice messages based on their volume.

[0018] In one implementation of the voice message management method provided in this application, the method further includes: stopping the playback of the audio source and playing the voice message when the priority of the voice message is determined to be equal to the priority of the audio source according to the priority strategy; and not playing the audio source after the voice message playback ends; or not playing the voice message when the priority of the voice message is determined to be equal to the priority of the audio source according to the priority strategy.

[0019] In the implementation of this application, if the voice message and the audio source have the same priority, the voice message of the channel can be played first, or the voice message can be chosen not to be played directly.

[0020] In one implementation of the voice message management method provided in this application, when the message type is the first type, the voice message is presented in the form of a prompt tone playback and text display, including: playing a prompt tone at the same volume as the sound source, determining the text information of the voice message, and displaying the text information on the display interface; or playing a prompt tone at a volume higher than the sound source volume, determining the text information of the voice message, and displaying the text information on the display interface.

[0021] In this implementation, if an important audio source is being played and a new important voice message is received, the newly received voice message is displayed in the form of a notification sound and text. Furthermore, the volume of the notification sound is either the same as or higher than the volume of the currently playing audio source. This allows users to easily view relatively important voice messages in a timely manner, avoiding inconvenience or frustration caused by missing important messages.

[0022] In one implementation of the voice message management method provided in this application, the method further includes: playing a voice message when there is no audio source currently playing.

[0023] In the implementation of this application, if there is no currently playing audio source, there is no need to confirm the message type of the newly received voice message, and the newly received voice message can be played directly.

[0024] Secondly, this application provides a voice message management device, including: a first processing module, used to determine a voice message to be played; and a second processing module, used to determine the presentation method of the voice message according to the message type of the voice message when there is a playing audio source and the voice message is determined to have a lower priority than the audio source according to a preset priority strategy, and therefore the voice message is not played.

[0025] The voice message management device provided in this application includes a module for executing the voice message management method provided in the first aspect, and thus can also achieve the beneficial effects (or advantages) of the voice message management method provided in the first aspect.

[0026] Thirdly, embodiments of this application provide an electronic device, including: a processor and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to implement the voice message management method provided by the implementation of the first aspect described above.

[0027] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the voice message management method provided by the implementation of the first aspect described above.

[0028] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the voice message management method provided by the implementation of the first aspect described above.

[0029] It is understandable that the beneficial effects of the third to fifth aspects mentioned above can also be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0030] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0031] Figure 1 A flowchart illustrating a voice message management method provided in an embodiment of this application;

[0032] Figure 2 This is a schematic diagram illustrating the definition of message types for voice messages provided in an embodiment of this application.

[0033] Figure 3 A flowchart illustrating another voice message management method provided in an embodiment of this application;

[0034] Figure 4 This is a schematic diagram of the structure of the voice message management device provided in the embodiments of this application;

[0035] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0036] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0037] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0038] As mentioned earlier, in current smart cockpits, voice message playback, after being incorporated into the vehicle's cockpit mixing strategy, will not be played back if rejected. Instead, it will be sent to the message center or discarded. For voice messages stored in the message center, users can only view the cached messages after the vehicle stops. For real-time messages, there is no need for a delay. Furthermore, for non-real-time messages, it's impossible to perfectly utilize driving time for voice message presentation. Therefore, in existing technology, relatively important voice messages requiring immediate user attention are rejected, leading to users missing important messages due to delayed viewing. Conversely, relatively important but unnecessary voice messages are rejected, meaning users may not hear them again during the entire driving process, impacting the user experience.

[0039] In other words, in the existing technology, if the voice message to be played is of high importance and urgency, such voice messages that require the user's immediate attention will be rejected from being played, resulting in the user not being able to view the voice message in time, missing important voice messages, and affecting the user experience; if the voice message to be played is of high importance but not urgent, such voice messages will also not be able to be played in the form of voice if there are no other voice messages to play on the vehicle system, thus failing to make reasonable use of the user's time.

[0040] Based on this, this application proposes a voice message management method. When there is a voice message currently playing, the method determines different presentation methods for the voice message based on its message type. Compared to directly putting the voice message into the message center or discarding it, the method processes voice messages of different message types in different ways based on the message type and presentation method, presenting real-time or important messages in different forms for the convenience of users.

[0041] Next, see Figure 1 The voice message management method provided in this application is applied to electronic devices such as vehicle terminals, and the electronic device specifically performs the following steps.

[0042] S110, confirm the voice message to be played.

[0043] S120: When there is a playing audio source, and the audio message is determined to have a lower priority than the audio source according to a preset priority strategy, and therefore the audio message is not played, the presentation method of the audio message is determined according to the message type of the audio message.

[0044] The voice message management method provided in this application defines the message type of voice messages. When a voice message participates in the vehicle cockpit mixing strategy, if there is a currently playing audio source, and the voice message is not played based on the priority of the audio source and the voice message (i.e., when participation in the vehicle cockpit mixing strategy is rejected), the presentation method of the voice message is determined according to its message type. This ensures that voice messages rejected from participating in the vehicle cockpit mixing strategy can still have their corresponding presentation strategy determined based on their message type, rather than being directly stored in the message center or discarded. This prevents users from missing important voice messages and improves the user experience.

[0045] In the implementation of this application, step S110 is first performed to determine the technical content of the voice message to be played.

[0046] In the implementation of this application, when the vehicle terminal receives a new voice message (as an example of a voice message to be played), it needs to determine whether to play the voice message.

[0047] Next, step S120 involves determining the presentation method of the voice message based on its message type, in the case where a playing audio source is confirmed, and the voice message is determined to have a lower priority than the audio source according to a preset priority strategy, and therefore the voice message is not played.

[0048] In the implementation of this application, when there is a currently playing audio source in the vehicle, it is determined whether a newly received voice message needs to be played at the same time as the audio source. Furthermore, if the voice message is not played while the audio source is being played, the presentation method of the voice message is determined based on the message type of the voice message.

[0049] In the implementation method of this application, such as Figure 2 As shown, voice messages are divided into four categories based on their real-time nature and importance: real-time and important voice messages (as an example of the first type), real-time but unimportant voice messages (as an example of the second type), non-real-time but important voice messages (as an example of the third type), and non-real-time and unimportant voice messages (as another example of the second type).

[0050] Furthermore, as shown in Table 1, the classification of voice message types is based on the substantive attributes of the message to define the message type of the voice message.

[0051] Table 1 Definitions of Voice Message Types

[0052]

[0053]

[0054] In particular, when an event occurs, the information about the event needs to be transmitted in real time via a message. Otherwise, it will lose its meaning if it is transmitted after a period of time. Furthermore, if the event cannot be received by the recipient in a timely manner, it will cause trouble or inconvenience to the message recipient (such as a driver). Therefore, the voice message category (i.e., message type) of this type of message is defined as a real-time and important voice message.

[0055] Furthermore, when an event occurs, the information about the event needs to be transmitted in real time via a message. Otherwise, transmitting it after a period of time would be meaningless. At the same time, if the event is not received by the recipient in a timely manner, it will not cause trouble or annoyance to the message recipient (such as the driver). Therefore, the voice message category (i.e., message type) of this type of message is defined as a real-time but non-critical voice message.

[0056] Furthermore, when an event occurs, it is not necessary to transmit the information about the event in real time via a message. Even if the information is transmitted after a period of time, it will not cause any adverse effects. However, if the event is not received by the recipient in a timely manner, it will cause trouble or annoyance to the message recipient (such as a driver). Therefore, the voice message category (i.e. message type) of this type of message is defined as non-real-time but important voice message.

[0057] Furthermore, when an event occurs, it is not necessary to transmit the event information in real time via a message. Even if it is transmitted after a period of time, it will not cause any adverse effects. Moreover, if the event is not received by the recipient in a timely manner, it will not cause trouble or annoyance to the message recipient (such as the driver). Therefore, the voice message category (i.e. message type) of this type of message is defined as non-real-time and non-important voice message.

[0058] Furthermore, referring to Table 2, in the vehicle field, for voice messages, the message types of voice messages in smart cockpits can be specifically divided into the aforementioned four categories based on the attributes of the voice messages.

[0059] Table 2 Examples of voice messages corresponding to message types

[0060]

[0061]

[0062] Among them, voice messages that would cause trouble or annoyance to drivers if not promptly known by them, such as battery thermal failure reminders, collision alarm voice messages, fault prompt voice messages, incoming call voice reminders, phone forgetting reminders, and distraction reminders, are classified as real-time and important voice messages.

[0063] For example, recommendations or reminders set in advance by the driver, such as smoking recommendations, parking recommendations, destination recommendations, and better route recommendations, are classified as real-time but unimportant (i.e., real-time but unimportant) voice messages if they are not known to the driver in a timely manner and do not affect driving safety or the driver's driving.

[0064] For example, voice messages such as WeChat messages, energy consumption reminders, and new feature upgrade reminders may not affect drivers in the short term if they are not informed in a timely manner, but they may cause trouble or annoyance to drivers if they are not informed for a long time. These are classified as non-real-time but important voice messages.

[0065] For example, voice messages such as welcome messages upon startup, which do not cause trouble or confusion to drivers if they are not promptly notified to them and remain unknown to them for an extended period, are classified as non-real-time and unimportant voice messages.

[0066] Furthermore, in the implementation of this application, the determination of whether to play a voice message while playing an audio source is based on a preset priority strategy is specifically made in the following way.

[0067] For example, the priority of the voice message and the audio source is determined based on the message type of the voice message and the audio source category of the currently playing audio source.

[0068] The currently playing audio source can be of various types, such as call audio, video playback audio, or music audio. It can also be a voice message. A priority strategy is generated by pre-defining the priority relationship between each message type and each audio source category. For example, call audio has a higher priority than non-real-time but important, non-real-time and unimportant, and real-time but unimportant message types, but a lower priority than real-time but important message types. Similarly, video playback audio has a higher priority than non-real-time and unimportant, and real-time but unimportant message types, but a lower priority than non-real-time but important and real-time and important message types.

[0069] In the implementation of this application, the priority between audio source category and message type can be set according to actual needs. The priority strategy table generated after setting is stored in the electronic device so that the electronic device can arbitrate the priority of newly received voice messages and audio sources according to the priority strategy.

[0070] In the implementation of this application, if the sound source is also a voice message, and the voice message and the sound source have the same message type, the priority of the voice message and the priority of the sound source can be determined based on the message content of the voice message and the message content of the sound source.

[0071] For example, if all messages are real-time and important voice messages, and the content of the voice message is a fault warning while the content of the audio source is a reminder notification, then the voice message with the fault warning content has a higher priority than the voice message with the reminder notification content. If all messages are non-real-time but important voice messages, then the voice message with the energy consumption reminder content has a higher priority than the voice message with the WeChat notification content.

[0072] If the message types are different, the priority of the voice message and the priority of the audio source are determined based on the message type of the voice message and the message type of the audio source.

[0073] For example, the priority order of voice messages defined by message type is: voice messages with real-time and important message type (as an example of the first type) have priority > voice messages with non-real-time and important message type (as an example of the third type) > voice messages with real-time but non-important message type or non-real-time and non-important message type (as an example of the sound source).

[0074] In this application's implementation, the priority of real-time but unimportant voice messages can also be defined as higher than that of non-real-time and unimportant voice messages.

[0075] If both the voice message and the audio source are real-time and important, and the voice message is a fault warning message while the audio source is an incoming call voice reminder message, then the voice message has a higher priority than the audio source. If both the voice message and the audio source are real-time and important, and both the voice message and the audio source are fault warning messages, then the voice message has the same priority as the audio source. Conversely, if the voice message is an incoming call voice reminder message while the audio source is a fault warning message, then the voice message has a lower priority than the audio source.

[0076] If the voice message type is real-time and important, and the audio source message type is non-real-time but important, then the voice message priority is determined to be higher than the audio source priority. If the voice message type is non-real-time but important, and the audio source message type is real-time and important, then the voice message priority is lower than the audio source priority.

[0077] In the implementation of this application, if the priority of the voice message is higher than the priority of the audio source, then the voice message is played at the same time as the audio source is played.

[0078] For example, if the priority of the voice message is greater than that of the audio source, it is determined that the voice message is played at the same time as the audio source (that is, participation in the whole vehicle cabin mixing strategy is not rejected).

[0079] For example, interrupt / pause / simultaneously mix and play audio sources to play voice messages.

[0080] Furthermore, it is determined that while playing the audio source, a voice message is played, including: stopping the audio source playback and playing a voice message.

[0081] In this implementation, the audio source can be stopped and the voice message can be played directly, so that more important voice messages can be played in a timely manner without being interfered with by other voice messages.

[0082] The options for stopping audio playback and playing voice messages can be either stopping the audio playback and immediately playing the voice message, stopping the voice message playback after the audio playback ends, or stopping the currently playing audio playback and immediately playing the voice message to be played, resuming the currently playing audio playback after the voice message to be played ends.

[0083] For example, when an audio source is being played, voice messages have a higher priority than the audio source. Therefore, voice messages should be played first. After the voice message is played, you can choose to continue playing the audio source or choose not to play the audio source but to play the newly received voice message.

[0084] The option to continue playing the audio source or not can be decided based on the actual situation, such as receiving a new voice message that is more important, or the voice message being an update to the audio source.

[0085] Furthermore, in the implementation of this application, determining that the audio source is played while the voice message is played also includes: playing the audio source and the voice message simultaneously.

[0086] For example, if two voice messages have the same priority or the voice message has a higher priority than the audio source, then the voice message and the audio source can be played simultaneously.

[0087] For example, playing audio sources and voice messages simultaneously can be done by playing them at the same volume, or by playing them at different volumes.

[0088] For example, the volume of the voice message is greater than or less than the volume of the audio source, or the volume of the voice message is equal to the volume of the audio source.

[0089] In this implementation, if the priority of the voice message is determined to be equal to the priority of the audio source according to the priority strategy, the voice message is played, and the audio source playback is stopped. After the voice message playback ends, the audio source playback is not resumed. Alternatively, if the priority of the voice message is determined to be equal to the priority of the audio source according to the priority strategy, the voice message is not played.

[0090] For example, if two voice messages have the same message type and the same priority, it can be determined whether to play the voice message while playing the audio source, or not to play the voice message while playing the audio source. As another example, if the voice message is a real-time and important battery thermal runaway alert, and the audio source being played is a phone call, and if the priority strategy determines that the voice message and the audio source have the same priority, then because the battery thermal runaway alert is very important, the voice message can be played directly, interrupting the phone call.

[0091] In this implementation, if there is a currently playing audio source and the priority of the voice message is the same as the priority of the audio source, the voice message can be played while the audio source is playing. For example, if the voice message is a real-time and important incoming call voice reminder message, and the currently playing audio source is a call, if the priority strategy determines that the voice message and the audio source have the same priority, the call can be played normally, and the incoming call voice reminder message will not be played.

[0092] Of course, in the implementation of this application, the playback strategy of the voice message and the audio source can also be determined in other ways when the voice message and the audio source have the same priority. For example, the audio source can be paused and the voice message can be played. After the voice message finishes playing, the audio source can be played again. This is only an example.

[0093] In the implementation of this application, if the priority of the voice message is determined to be lower than the priority of the audio source according to the priority strategy, then the voice message is not played while the audio source is played.

[0094] For example, if the priority of the voice message is lower than that of the audio source, it is determined that the voice message will not be played while the audio source is being played (i.e., participation in the whole vehicle cabin mixing strategy is rejected).

[0095] For example, while playing the real-time and important audio source, the non-real-time but important voice message is not played.

[0096] Furthermore, in the implementation of this application, while determining the audio source to be played, the presentation method of the audio message is determined according to the message type of the audio message without playing the audio message.

[0097] In other words, if the priority of a voice message is less than or equal to the priority of the audio source, the voice message is rejected from participating in the vehicle's audio mixing strategy. In this case, the presentation method of the voice message is determined based on the message type of the voice message.

[0098] For example, when the message type is real-time and important, the voice message is played in the form of a notification sound and a text display. The text includes the text information corresponding to the voice message.

[0099] In the implementation of this application, if there is a currently playing audio source and the real-time and important voice message cannot be played simultaneously with the currently playing audio source, the voice message is displayed to the driver in the form of a prompt sound and text display.

[0100] For example, play the prompt tone at the same volume as the sound source, determine the text information of the voice message, and display the text information on the display interface.

[0101] Alternatively, the prompt tone can be played at a volume higher than the source volume, and the text information of the voice message can be confirmed and displayed on the display interface.

[0102] For example, while playing the audio source at the same volume, a notification sound is emitted to inform the user that a new voice message is available, and the text information of the voice message is displayed on the display interface. Alternatively, for example, while playing the audio source at a different volume, a notification sound is emitted to inform the user that a new voice message is available, and the text information of the voice message is displayed on the display interface.

[0103] The notification sounds can be specific to sounds such as "ding", "ding-dong", or "beep".

[0104] Furthermore, voice messages are discarded if the message type is real-time but not important, or non-real-time and not important.

[0105] For example, if there is a currently playing voice message or audio source, and the newly received voice message is an unimportant voice message, it can be discarded directly without further playback. In this way, by filtering voice messages based on message type, relatively important messages can be played first, improving the user experience.

[0106] Alternatively, the voice message can be stored in the message center so that users can view it later.

[0107] Furthermore, when the message type is non-real-time but important, a voice message queue is determined, and the priority order of the voice messages in the voice message queue is determined. The voice messages are played according to the priority order, wherein all voice messages in the voice message queue are non-real-time but important.

[0108] For example, for non-real-time but important voice messages, their delayed playback will not affect the user's driving, but prolonged delays may cause inconvenience. Therefore, a voice message queue can be set up, the voice message can be added to the queue, and the voice messages in the queue can be prioritized so that, according to priority, the non-real-time but important voice messages in the queue can be played sequentially after the original audio source finishes playing.

[0109] Furthermore, in the implementation of this application, if there is no currently playing audio source (i.e., participation in the whole vehicle cabin mixing strategy has not been rejected), the message type of the voice message does not need to be considered, and the voice message can be played directly.

[0110] In this application, voice messages are categorized into four types based on their real-time nature and importance: real-time and important voice messages, real-time but unimportant voice messages, non-real-time but important voice messages, and non-real-time and unimportant voice messages. When a real-time and important voice message is rejected after participating in the vehicle's cabin mixing strategy, the user is notified via a short sound effect and on-screen text. When a real-time but unimportant voice message is rejected after participating in the vehicle's cabin mixing strategy, it is discarded directly without any on-screen text prompt, reducing the number of times the user needs to check the interface while driving and lowering driving risks. When a non-real-time but important voice message is rejected after participating in the vehicle's cabin mixing strategy, it is played only after the playback of a higher-priority voice message (i.e., audio) has finished. When a non-real-time and unimportant voice message is rejected after participating in the vehicle's cabin mixing strategy, it is discarded directly without queuing for playback or providing any text prompt, reducing the burden of information reception for the user.

[0111] Thus, the presentation of voice messages rejected by the vehicle's audio mixing strategy is optimized. Specifically, voice messages are categorized into four types. This ensures that real-time and important voice messages rejected due to conflicts in the vehicle's audio mixing strategy are alerted to the user through sound effects and text display. Conversely, non-real-time but important voice messages rejected by the vehicle's audio mixing strategy are alerted to the user through voice playback after the higher-priority audio has finished playing. Furthermore, in multi-scenario conflicts, unimportant voice messages can be blocked, reducing the burden of information reception for the user.

[0112] Next, see Figure 3The voice message management method provided in this application is also a smart in-vehicle voice message push solution, which belongs to the category of voice message push solutions for cars or electric vehicles. After extracting the notification content of the voice message text, it performs text semantic understanding processing, predefines the importance and urgency of the message, and competes with the currently playing audio source in the car to achieve timely and appropriate reminders to the user based on the message type. This can effectively notify the car owner of important information without frequently disturbing the car owner's use of the vehicle.

[0113] See Figure 3 The voice message management method specifically includes the following steps.

[0114] S210 defines four categories: real-time and important voice messages, real-time but unimportant voice messages, non-real-time but important voice messages, and non-real-time and unimportant voice messages.

[0115] For example, voice messages are pre-defined based on their real-time nature and importance as real-time and important voice messages, real-time but not important voice messages, non-real-time but important voice messages, and non-real-time and not important voice messages.

[0116] S220 categorizes the voice messages in the smart cockpit into real-time and important voice messages, real-time but unimportant voice messages, non-real-time but important voice messages, or non-real-time and unimportant voice messages, according to their definitions.

[0117] For example, when the vehicle terminal receives a new voice message, it needs to classify the voice message into one of the following: a real-time and important voice message, a real-time but unimportant voice message, a non-real-time but important voice message, or a non-real-time and unimportant voice message.

[0118] The S230's smart cockpit has voice messages that need to be played.

[0119] For example, determine if there are any new voice messages that need to be played in the current smart cockpit.

[0120] S240: Determine whether participation in the vehicle cabin mixing strategy has been rejected. If yes, proceed to step S250; otherwise, proceed to step S260.

[0121] For example, the decision to reject a new voice message in the vehicle cabin mixing strategy is based on the message type and priority of the voice message. That is, it determines whether a new voice message can be played simultaneously with the currently playing voice message.

[0122] S250, is this voice message important?

[0123] For example, if the newly received voice message is rejected from participating in the vehicle mixing strategy, it is determined whether the voice message is an important voice message.

[0124] S260 played it out as a voice message.

[0125] For example, if the newly received voice message is not rejected in the vehicle mixing strategy, it is played directly in voice format. That is, if there is a voice message being played at the same time or if no audio source category is currently playing, and the newly received voice message is not rejected, it is played immediately.

[0126] S270, is this voice message a real-time message?

[0127] For example, if the voice message is important, it is determined whether the voice message is a real-time message.

[0128] S280, discard it directly.

[0129] For example, unimportant voice messages are discarded and will not be played again.

[0130] S290, the voice message prompts the user in the form of a short sound effect and text display.

[0131] For example, if the voice message is a real-time and important voice message, the voice message is presented as a short sound effect plus text display to prompt the user.

[0132] S310 will play the voice message only after the high-priority audio has finished playing.

[0133] For example, if a voice message is rejected after participating in the vehicle mixing strategy, and the voice message is a non-real-time but important voice message, then the voice message will be queued for playback. That is, the voice messages in the voice queue will be played in sequence after the high-priority voice messages have finished playing.

[0134] It should be noted that the newly received voice message and the currently requested voice message mentioned above are the voice messages to be played. The audio source currently being played can be of various types, such as voice calls, navigation voices, multimedia, and voice messages. The voice message to be played is the text content of the voice message to be played.

[0135] It should also be noted that the technical content of steps S210-S310 can be found in the technical content of steps S110-S120.

[0136] In the implementation method of this application, the voice message management method can also be applied to electronic devices such as mobile terminals, such as mobile phones, computers, and tablets.

[0137] Further, see Figure 4 , Figure 4 This is a schematic diagram of the structure of a voice message management device provided in an embodiment of this application. Figure 4 As shown, the voice message management device includes: a first processing module 601 and a second processing module 602.

[0138] The first processing module 601 is used to determine the voice message to be played and the message type of the voice message.

[0139] The second processing module 602 is used to determine the presentation method of the voice message based on the message type of the voice message when it is determined that there is a playing audio source and the voice message has a lower priority than the audio source according to a preset priority strategy, and therefore the voice message is not played.

[0140] The voice message management device provided in this application embodiment can be used to execute the voice message management method described in the above embodiment. Its implementation principle and technical effect are similar, and will not be repeated here.

[0141] It should be noted that the division of the various modules in the above device is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, these modules can be implemented entirely in software via processing element calls; they can be fully implemented in hardware; or some modules can be implemented by processing element calls to software, while others are implemented in hardware. For example, a processing module can be a separate processing element, or it can be integrated into a chip within the device. Alternatively, it can be stored as program code in the device's memory, and its functions can be called and executed by a processing element. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. During implementation, each step of the above method or each of the above modules can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.

[0142] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Figure 5 As shown, the electronic device may include: transceiver 121, processor 122, and memory 123.

[0143] Processor 122 executes computer execution instructions stored in memory, causing processor 122 to perform the scheme in the above embodiments. Processor 122 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0144] The memory 123 is connected to the processor 122 via the system bus and completes communication between them. The memory 123 is used to store computer program instructions.

[0145] For example, and not as a limitation, memory 123 may include a hard disk drive (HDD), a floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 123 may include removable or non-removable (or fixed) media. Where appropriate, memory 123 may be internal or external to the integrated gateway device. In a particular embodiment, memory 123 is non-volatile solid-state memory. In a particular embodiment, memory 123 includes read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.

[0146] Transceiver 121 can be used to obtain the task to be run and its configuration information.

[0147] The system bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The system bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the diagram, but this does not indicate that there is only one bus or one type of bus. Transceivers are used to enable communication between database access devices and other computers (e.g., clients, read-write libraries, and read-only libraries). Memory may include random access memory (RAM) and may also include non-volatile memory.

[0148] This application also provides a chip for executing instructions, which is used to execute the technical solution of the voice message management method in the above embodiments.

[0149] This application also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on the processor of an electronic device, the processor of the electronic device executes the technical solution of the voice message management method described in the above embodiments.

[0150] In some possible implementations, various aspects of the methods provided in this application may also be implemented as a program product comprising program code that, when the program product is run on a processor of an electronic device, causes the processor of the electronic device to perform the steps of the methods according to various exemplary embodiments of this application described above. For example, the electronic device may perform the voice message management method described in the embodiments of this application.

[0151] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0152] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium, and when the at least one processor executes the computer program, it can implement the technical solution of the voice message management method in the above embodiments.

[0153] This application is described with reference to flowchart illustrations and / or block diagrams of the methods, apparatus, and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable information processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable information processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0154] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable information processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0155] These computer program instructions may also be loaded onto a computer or other programmable information processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0156] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.

[0157] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope.

Claims

1. A voice message management method, characterized in that, Applied to electronic devices, the method includes: Identify the voice message to be played; If a playing audio source is identified, and the priority of the voice message is determined to be lower than that of the audio source according to a preset priority strategy, the voice message is rejected from participating in the vehicle cabin mixing strategy. Furthermore, the presentation method of the voice message is determined based on its message type. Determining the presentation method based on the message type includes: When the message type is the first type, the voice message is presented in the form of a prompt sound playback and text display, and the text includes the text information corresponding to the voice message. The first type is a real-time and important voice message. If the message type is the second type, the voice message is discarded. The second type is either a real-time but unimportant voice message or a non-real-time and unimportant voice message. When the message type is the third type, a voice message queue is determined, and the priority order of the voice messages in the voice message queue is determined. The voice messages are then played according to the priority order. The third type is a non-real-time but important voice message.

2. The voice message management method according to claim 1, characterized in that, The method further includes: If, according to the priority strategy, the priority of the voice message is determined to be greater than the priority of the audio source, the voice message is played simultaneously with the audio source.

3. The voice message management method according to claim 2, characterized in that, Determining to play the voice message while playing the audio source includes: Stop playing the audio source and play the voice message; or Simultaneously play the audio source and the voice message.

4. The voice message management method according to claim 3, characterized in that, Stop playing the audio source and play the voice message, including: Stop playing the audio source, play the voice message, and after the voice message finishes playing, stop playing the audio source; or Stop playing the audio source, play the voice message, and resume playing the audio source after the voice message finishes playing.

5. The voice message management method according to claim 4, characterized in that, Simultaneously playing the audio source and the voice message includes: Play the audio source and the voice message simultaneously at the same volume; or The audio source and the voice message are played simultaneously at different volumes.

6. The voice message management method according to any one of claims 1-5, characterized in that, The method further includes: If, according to the priority strategy, the priority of the voice message is determined to be equal to the priority of the audio source, playback of the audio source is stopped, and the voice message is played. After the voice message finishes playing, the audio source is not played; or If the priority of the voice message is determined to be equal to the priority of the audio source according to the priority strategy, the voice message will not be played.

7. The voice message management method according to claim 1, characterized in that, When the message type is the first type, the voice message is presented in the form of a prompt sound playback and text display, including: Play the prompt tone at the same volume as the sound source, determine the text information of the voice message, and display the text information on the display interface; or Play the prompt tone at a volume higher than that of the sound source, determine the text information of the voice message, and display the text information on the display interface.

8. The voice message management method according to any one of claims 1-5, characterized in that, The method further includes: If no audio source is currently playing, the voice message is played.

9. A voice message management device, characterized in that, include: The first processing module is used to determine the voice message to be played; The second processing module is configured to, when a playing audio source exists and the priority of the voice message is determined to be lower than that of the audio source according to a preset priority strategy, reject the voice message from participating in the vehicle cabin mixing strategy, and determine the presentation method of the voice message according to its message type. Determining the presentation method of the voice message according to its message type includes: When the message type is the first type, the voice message is presented in the form of a prompt sound playback and text display, and the text includes the text information corresponding to the voice message. The first type is a real-time and important voice message. If the message type is the second type, the voice message is discarded. The second type is either a real-time but unimportant voice message or a non-real-time and unimportant voice message. When the message type is the third type, a voice message queue is determined, and the priority order of the voice messages in the voice message queue is determined. The voice messages are then played according to the priority order. The third type is a non-real-time but important voice message.

Images