Information interaction method, device and equipment, storage medium and vehicle

Abstract

The invention discloses an information interaction method and device, equipment, a storage medium and a vehicle. The method comprises the following steps: acquiring notification information; obtaining parameter information corresponding to the notification information, wherein the parameter information comprises a display mode and a target priority of the notification information; a target information interaction mode corresponding to the target priority is determined according to the corresponding relation between the priority and the information interaction mode, and the interaction strength of the information interaction mode is in positive correlation with the priority; and displaying the notification information according to the display mode, and performing information interaction corresponding to the notification information according to the target information interaction mode. According to the information interaction method provided by the embodiment of the invention, the driving safety and the driving experience of the user can be improved.

Description

Technical Field

[0001] The present application belongs to the field of information processing technology, and in particular, relates to an information interaction method, device, equipment, storage medium and vehicle. Background Art

[0002] At present, multiple applications (multiple business parties) in the vehicle system can display notification information to users through the vehicle screen. After receiving the notification information, the user can interact with the notification information. However, the notification style and interaction form of the notification information are relatively simple, which reduces the user experience. In addition, after receiving the notification information, the user cannot immediately determine the importance of the notification information, which may cause the user to miss important information, or may cause unimportant information to take up too much of the user's time and energy, reducing driving safety and the user's driving experience. Summary of the invention

[0003] The embodiments of the present application provide an information interaction method, device, equipment, storage medium and vehicle, which can improve driving safety and user driving experience.

[0004] In a first aspect, an embodiment of the present application provides an information interaction method, the method comprising:

[0005] Get notification information;

[0006] Acquire parameter information corresponding to the notification information, wherein the parameter information includes a display mode and a target priority of the notification information;

[0007] Determining a target information interaction mode corresponding to the target priority according to a correspondence between the priority and the information interaction mode, wherein the interaction intensity of the information interaction mode is positively correlated with the priority;

[0008] The notification information is displayed according to the display method, and information interaction corresponding to the notification information is performed according to the target information interaction method.

[0009] In a possible implementation manner, displaying the notification information in the display manner includes:

[0010] Rendering the notification information according to a display template corresponding to the notification information to generate a notification card;

[0011] Display the notification card.

[0012] In a possible implementation, the notification information includes at least one interactive control, the target priority is any one of a first priority, a second priority, and a third priority, the levels of the first priority, the second priority, and the third priority are successively increased, and the information interaction corresponding to the notification information according to the target information interaction mode includes:

[0013] When the target priority is the first priority, receiving a first input from a user selecting a first interactive control from among the at least one interactive control, the first interactive control being used to display a notification details page of the notification information;

[0014] In response to the first input, the notification details page is displayed.

[0015] In a possible implementation, the notification information includes multiple interactive controls, the target priority is any one of a first priority, a second priority, and a third priority, the levels of the first priority, the second priority, and the third priority are successively increased, and the information interaction corresponding to the notification information according to the target information interaction mode further includes:

[0016] When the target priority is the second priority, voice broadcasting the notification information;

[0017] receiving a second input from a user selecting a second interactive control from among the multiple interactive controls, where the second interactive control is any one of the multiple interactive controls;

[0018] In response to the second input, a control operation corresponding to the second interactive control is performed, and the second input is operation information for the second interactive control.

[0019] In a possible implementation, the notification information includes multiple interactive controls, the target priority is any one of a first priority, a second priority, and a third priority, the levels of the first priority, the second priority, and the third priority are successively increased, and the information interaction corresponding to the notification information according to the target information interaction mode further includes:

[0020] When the target priority is the third priority, extracting text information in the notification information;

[0021] Using an artificial intelligence big model, generate and output voice dialogue content based on the text information;

[0022] Receiving a user's reply to the voice conversation content;

[0023] Matching the reply information with the text information corresponding to each of the plurality of interactive controls respectively;

[0024] In the case that the reply information does not match the text information corresponding to each of the multiple interactive controls, the method returns to executing the method of using the artificial intelligence large model to generate and output voice dialogue content based on the text information until the reply information matches any one of the text information corresponding to each of the multiple interactive controls.

[0025] In a possible implementation, before receiving the user's reply information to the voice conversation content, the method further includes:

[0026] Saving text information corresponding to each of the plurality of interactive controls;

[0027] The matching the reply information with the text information corresponding to each of the plurality of interactive controls respectively includes:

[0028] Using the artificial intelligence big model to perform natural language understanding and semantic analysis on the reply information to determine the user intent corresponding to the reply information;

[0029] The user intention is matched with the text information corresponding to each of the multiple interactive controls.

[0030] In a possible implementation, after the reply information matches any one of the text information corresponding to each of the plurality of interactive controls, the method further includes:

[0031] Performing a control operation corresponding to target text information to obtain an operation result, wherein the target text information is text information matching the reply information among the text information corresponding to each of the plurality of interactive controls;

[0032] The operation result is notified to the user by voice.

[0033] In a possible implementation manner, the acquiring parameter information corresponding to the notification information includes:

[0034] Determine a business scenario corresponding to the notification information;

[0035] Determining a display method of the notification information according to a correspondence between the business scenario and the display method;

[0036] Determining the target priority of the notification information according to the correspondence between the business scenario and the priority;

[0037] The display mode and the target priority are determined as the parameter information.

[0038] In a second aspect, an embodiment of the present application provides an information interaction device, the device comprising:

[0039] A first acquisition module, used to acquire notification information;

[0040] A second acquisition module is used to acquire parameter information corresponding to the notification information, wherein the parameter information includes a display mode and a target priority of the notification information;

[0041] A determination module, configured to determine a target information interaction mode corresponding to the target priority according to a correspondence between the priority and the information interaction mode, wherein the interaction intensity of the information interaction mode is positively correlated with the priority;

[0042] An interaction module is used to display the notification information according to the display method, and to perform information interaction corresponding to the notification information according to the target information interaction method.

[0043] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device comprising: a processor and a memory storing computer program instructions;

[0044] When the processor executes the computer program instructions, the processor implements any possible implementation method of the first aspect described above.

[0045] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, implements a method in any possible implementation method of the first aspect described above.

[0046] In a fifth aspect, an embodiment of the present application provides a vehicle, the vehicle comprising at least one of the following:

[0047] An information interaction device as in any one of the embodiments of the second aspect;

[0048] An electronic device as in any one of the embodiments of the third aspect;

[0049] A computer-readable storage medium as in any embodiment of the fourth aspect.

[0050] The information interaction method, device, equipment, storage medium and vehicle of the embodiments of the present application, by displaying notification information in a display mode corresponding to the notification information, make different notification information display modes different, thereby enriching the notification style and improving the user experience. In addition, since the interaction intensity of the information interaction mode is positively correlated with the priority, by determining the target information interaction mode corresponding to the target priority according to the correspondence between the priority and the information interaction mode, and performing information interaction corresponding to the notification information according to the target information interaction mode, on the one hand, it is possible to enrich the interaction form and improve the user experience, and on the other hand, it is possible to enable the user to determine the importance of the notification information according to the interaction form, avoid the user missing important information, and avoid unimportant information taking up too much time and energy of the user, affecting the user's normal driving. In this way, through the embodiments of the present application, driving safety and the user's driving experience can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solution of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0052] Figure 1 It is a flowchart of an information interaction method provided in an embodiment of the present application;

[0053] Figure 2 is a schematic diagram of a display template provided in an embodiment of the present application;

[0054] Figure 3 is a schematic diagram of another display template provided in an embodiment of the present application;

[0055] Figure 4 is a schematic diagram of a notification card provided in an embodiment of the present application;

[0056] Figure 5 It is a flowchart of another information interaction method provided in an embodiment of the present application;

[0057] Figure 6 is a schematic diagram of an information interaction method provided in an embodiment of the present application;

[0058] Figure 7 is a structural diagram of an information interaction device provided in an embodiment of the present application;

[0059] Figure 8 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0061] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only part of the embodiments of the present application, rather than all of the embodiments.

[0062] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0063] In the embodiments of the present application, artificial intelligence (AI) large models refer to high-performance artificial intelligence models built through huge training samples and computing resources. They can learn a large amount of language knowledge, image features and speech patterns, and can reason and generate outputs similar to humans. They have wide applications in natural language processing, image recognition, speech recognition and other fields.

[0064] Active dialogue: refers to the dialogue process that is actively initiated and guided by the artificial intelligence system. In active dialogue, the AI ​​system actively asks questions, requests or suggestions to guide the direction and content of the dialogue. Compared with passive dialogue, active dialogue is more interactive and dynamic. The AI ​​system can actively provide information, explanations, inferences or reminders in the dialogue to help users better express their intentions or obtain the required information. Active dialogue can be applied to many scenarios, such as intelligent customer service, virtual assistants, learning interaction, automatic recommendations, etc. By actively guiding the dialogue, the AI ​​system can more actively adapt to user needs and provide personalized services and support. Achieving effective active dialogue requires solving multiple technical challenges, such as semantic understanding, context understanding, sentiment analysis, and generating natural and fluent responses. Through the development of deep learning and natural language processing technology, more and more research and practice are dedicated to improving the quality and naturalness of active dialogue systems.

[0065] As described in the background technology section, in order to solve the problems of the prior art, the embodiments of the present application provide an information interaction method, device, equipment, storage medium and vehicle. Among them, the information interaction method can be executed by a processor of the vehicle system. In addition, the vehicle system may include a voice assistant and multiple business parties (multiple applications). Among them, the multiple business parties may include, for example, a map application, a music player, a vehicle center, a scenario mode, etc.

[0066] The following is an introduction to the information interaction method provided in the embodiments of the present application.

[0067] Figure 1 FIG. 1 is a flow chart of an information interaction method provided by an embodiment of the present application. Figure 1 As shown, the information interaction method provided in the embodiment of the present application includes the following steps:

[0068] S110, obtaining notification information;

[0069] S120, acquiring parameter information corresponding to the notification information, wherein the parameter information includes a display mode and a target priority of the notification information;

[0070] S130, determining a target information interaction mode corresponding to the target priority according to a correspondence between the priority and the information interaction mode, wherein the interaction intensity of the information interaction mode is positively correlated with the priority;

[0071] S140: Display the notification information according to the display method, and perform information interaction corresponding to the notification information according to the target information interaction method.

[0072] The information interaction method of the embodiment of the present application displays the notification information in a display mode corresponding to the notification information, so that different notification information can be displayed in different ways, thereby enriching the notification style and improving the user experience. In addition, since the interaction intensity of the information interaction mode is positively correlated with the priority, by determining the target information interaction mode corresponding to the target priority according to the correspondence between the priority and the information interaction mode, and performing information interaction corresponding to the notification information according to the target information interaction mode, on the one hand, it is possible to enrich the interaction form and improve the user experience, and on the other hand, it enables the user to determine the importance of the notification information according to the interaction form, so as to avoid the user missing important information, and to avoid unimportant information taking up too much time and energy of the user, affecting the user's normal driving. In this way, through the embodiment of the present application, driving safety and the user's driving experience can be improved.

[0073] The specific implementation methods of the above steps are introduced below.

[0074] In some embodiments, in S110, the vehicle system may include multiple business parties, which may include, for example, a map application, a music player, a vehicle center, a scenario mode, etc. Different business parties may generate different notification information according to business needs. For example, if the business party is a music player, when the user pauses playing the music, a notification message of "whether to continue playing" may be generated. If the business party is a map application, when the map application detects that the road ahead is congested and finds a better recommended route, a notification message of "the road ahead is congested and a better recommended route is found" may be generated.

[0075] In some embodiments, in S120, the parameter information may include the display method and target priority of the notification information. Among them, the priority of the notification information generated by different business parties may be different. The same business party may also generate different priorities for notification information when in different business scenarios. The priority may include a first priority, a second priority, and a third priority. The target priority may be any one of the first priority, the second priority, and the third priority. The levels of the first priority, the second priority, and the third priority may increase in sequence. That is, the third priority may be higher than the second priority, and the second priority may be higher than the first priority. The higher the priority of the notification information, the more important the notification information may be.

[0076] In addition, the display methods of notification information generated by different business parties can be different. The same business party can also display different notification information generated in different business scenarios. Users can determine the source of notification information, business scenarios, etc. through the display method of notification information, which improves user experience.

[0077] As an example, the business party can determine the parameter information corresponding to the notification information and send the parameter information to the voice assistant to instruct the voice assistant to interact with the information corresponding to the notification information based on the parameter information. Specifically, the voice assistant may include a voice support installation package (Voice Support SDK), and the business party may integrate the Voice Support SDK. The Voice Support SDK can provide a communication interface for the business party and the voice assistant. The business party can send parameter information to the voice assistant through the interface.

[0078] Based on this, in some embodiments, the above S120 may specifically include:

[0079] Determine the business scenario corresponding to the notification information;

[0080] Determine the display method of notification information based on the correspondence between business scenarios and display methods;

[0081] Determine the target priority of notification information based on the correspondence between business scenarios and priorities;

[0082] Determine the display method and target priority as parameter information.

[0083] Here, each business party may pre-store the correspondence between business scenarios and display methods. For example, in the case where the business party is a music player, if the business scenario is to pause the music in the "I like" music list, the display method of the notification information may include an interactive control for displaying "continue playing" and an icon of the music player. At this time, the display method of the notification information may be, for example, Figure 2 If the business scenario is to pause the playback of music that is not in the "I like" music list, the display method of the notification information may include displaying the "continue playing" interactive control, the "play what I like" interactive control and the music player icon. At this time, the display method of the notification information may be, for example, as follows: Figure 3 shown.

[0084] In addition, each business party may also pre-store the correspondence between business scenarios and priorities. For example, if the business party is a music player, and the business scenario is that the user pauses playing a song in the "I like" playlist, the priority of the notification information may be the first priority (the importance of the notification information is lower). If the business party is a map application, and the business scenario is "the road ahead is congested and a better recommended route is found", the priority of the notification information may be the third priority (the importance of the notification information is higher).

[0085] As an example, when generating notification information, the business party can determine the business scenario corresponding to the notification information. After determining the business scenario, the display method of the notification information can be determined according to the correspondence between the business scenario and the display method, and the target priority can be determined according to the correspondence between the business scenario and the priority, and the display method and the target priority can be determined as parameter information.

[0086] In some embodiments, in S130, if the priority of the notification information is different, the information interaction mode for the notification information may be different. Among them, the interaction intensity of the information interaction mode may be positively correlated with the priority. That is, the higher the priority of the notification information, the stronger the interaction intensity of the notification information may be. Specifically, the information interaction mode may include only displaying the notification information, and actively checking it when the user needs to perceive the notification information; while displaying the notification information, voice broadcasting the notification information to notify the user of the notification information in a timely manner, so that the user can choose whether to interact with the notification information; while displaying and broadcasting the notification information, triggering an active dialogue with the notification information to guide the user to reply to the notification information. The interaction intensity of the above-mentioned information interaction modes may increase successively. The target information interaction mode may be the information interaction mode corresponding to the target priority among the above-mentioned multiple information interaction modes.

[0087] In some embodiments, in S140, on the one hand, after obtaining the notification information and parameter information, the notification information can be displayed according to the display method in the parameter information. Among them, the human-computer interaction interface of the voice assistant may include multiple pre-set display areas, and each display area may correspond to displaying a notification information sent by a business party. In addition, the displayed notification information may include an information title, information content, multiple interactive controls and icons of the business party, or may only include interactive controls and icons of the business party.

[0088] Based on this, in order to further improve the user experience, in some embodiments, the above-mentioned display of notification information in a display manner may specifically include:

[0089] The notification information is rendered according to a display template corresponding to the notification information to generate a notification card.

[0090] Show a notification card.

[0091] Here, the parameter information may also include a display template. The display templates corresponding to different business parties may be different, and the display templates corresponding to different business scenarios of the same business party may also be different. For example, in the case where the business party is a music player, if the business scenario is to pause the music in the "I like" music list, the display template of the notification information may include an interactive control of "continue playing" and an icon of the music player. At this time, the display template may be, for example, Figure 2 If the business scenario is to pause the playback of music that is not in the "I like" music list, the display template of the notification information may include an interactive control for "continue playing", an interactive control for "play what I like", and an icon of the music player. In this case, the display template may be, for example, Figure 3 shown.

[0092] As an example, rendering the notification information according to the display template corresponding to the notification information to generate a notification card may specifically include:

[0093] Get the display template corresponding to the notification information;

[0094] Generate configuration information corresponding to the notification information according to the display template;

[0095] Fill the configuration information into the corresponding position of the display template to get the notification card.

[0096] For example, when the business party is a map application, the display template may include a map icon, multiple information filling positions corresponding to the information title, information content, and multiple interactive controls. The configuration information may include specific content corresponding to the information title, specific content corresponding to the information content, and text information corresponding to each of the multiple interactive controls. By filling the configuration information into the corresponding position of the display template, a notification card can be obtained. If the business scenario for the map application to generate notification information is "the road ahead is congested and a better recommended route is found", the notification card can be as follows Figure 4 shown.

[0097] In this way, by rendering the notification information according to the display template, the notification cards displayed by different business parties and different business scenarios of the same business party can be different, so that users can intuitively determine the application source and business scenario of the notification information, determine their level of interest in the notification information, avoid missing the notification information of interest, and further enhance the user experience.

[0098] In addition, after displaying the notification card, the voice assistant can send a "notification card displayed successfully" message to the business party through the interface so that the business party can perform other tasks.

[0099] In some embodiments, in S140, on the other hand, after the target information interaction mode is determined, information interaction corresponding to the notification information may be performed according to the target information interaction mode.

[0100] In some embodiments, when the target priority is the first priority, the displayed notification information may include at least one interactive control. Based on this, the above S140 may specifically include:

[0101] receiving a first input of a user selecting a first interactive control from at least one interactive control, where the first interactive control is used to display a notification details page of notification information;

[0102] In response to the first input, a notification detail page is displayed.

[0103] Here, if the priority of the notification information is the first priority, the importance of the notification information is relatively low. Among them, the notification information with the first priority may include, for example, notification information related to music playback and video playback. In the case where the importance of the notification information is relatively low, in order to avoid the notification information taking up extra time and energy of the driver, the notification information can be displayed only on the human-computer interaction interface of the voice assistant. Among them, the notification information can disappear after a preset length of time, and can also be overwritten by the next notification information.

[0104] In addition, the first input may be an input by the user to select the first interactive control. The first input may be any one of touch input, voice input, and gesture input. If the first input is a touch input, the user can confirm the selection of the first interactive control by clicking on the screen. If the first input is a voice input, the user can first wake up the voice dialogue function of the voice assistant through the wake-up word, and then control the voice assistant to select the first interactive control through voice commands. If the first input is a gesture input, the user can control the screen through gestures to select the first interactive control. After receiving the first input, the voice assistant can first determine the first control instruction corresponding to the first interactive control, and then send the first control instruction to the business party through the interface, instructing the business party to perform the control operation corresponding to the first interactive control. Among them, the first control instruction may be a notification details page that displays notification information, so that the user can view the details of the notification information.

[0105] In this way, by only displaying notification information when the target priority is the first priority, and waiting to receive the user's active interaction with the notification information, it is possible to avoid unimportant notification information taking up too much of the user's time and energy, affecting the user's normal driving, and ensuring driving safety.

[0106] In some embodiments, when the target priority is the second priority, the displayed notification information may include multiple interactive controls. Based on this, the above S140 may further include:

[0107] Voice broadcast of notification information;

[0108] receiving a second input of a user selecting a second interactive control from among the multiple interactive controls, where the second interactive control is any one of the multiple interactive controls;

[0109] In response to the second input, a control operation corresponding to the second interactive control is performed, and the second input is operation information for the second interactive control.

[0110] Here, if the priority of the notification information is the second priority, the importance of the notification information may be higher than the first priority notification message. Among them, the notification information with the second priority may be, for example, "The road ahead is narrowing, please drive slowly and carefully." In the case where the importance of the notification information is high, in order to enable the driver to receive the notification information in time, the notification information can be voice broadcasted through the voice assistant. After the voice assistant finishes playing the notification information, it can send a message of "notification information broadcast completed" to the business party through the interface so that the business party can perform other tasks.

[0111] In addition, the second input may be an input for the user to select the second interactive control, that is, the second input may be operation information for the second interactive control. The second input may be any one of touch input, voice input, and gesture input. If the second input is a touch input, the user can confirm the selection of the second interactive control by clicking on the screen. If the second input is a voice input, the user can first wake up the voice dialogue function of the voice assistant through the wake-up word, and then control the voice assistant to select the second interactive control through voice instructions. If the second input is a gesture input, the user can control the screen through gestures to select the second interactive control. After receiving the second input, the voice assistant can first determine the second control instruction corresponding to the second interactive control, and then send the second control instruction to the business party through the interface, instructing the business party to perform the control operation corresponding to the second interactive control.

[0112] In this way, by displaying the notification information and voice broadcasting the notification information when the target priority is the second priority, it can ensure that the notification information is notified to the user in a timely manner so that the user can decide whether to take action, avoid the user missing important information, and improve the user's driving experience.

[0113] In some embodiments, when the target priority is the third priority, the displayed notification information may include multiple interactive controls. Based on this, the above S140 may further include:

[0114] Extract text information from notification information;

[0115] Using a large artificial intelligence model, voice conversation content is generated and output based on text information;

[0116] Receive the user's reply information to the voice conversation content;

[0117] Match the reply information with the text information corresponding to each of the multiple interactive controls respectively;

[0118] In the case that the reply information does not match the text information corresponding to each of the multiple interactive controls, the process returns to executing the large artificial intelligence model to generate and output voice dialogue content based on the text information until the reply information matches any one of the text information corresponding to each of the multiple interactive controls.

[0119] Here, if the priority of the notification information is the third priority, the importance of the notification information may be higher than the first and second priority notification messages. Among them, the notification information with the third priority may include notification information related to system abnormalities, information related to safe driving, etc. That is, the notification information of the third priority not only requires the driver to receive the notification information in a timely manner, but also requires the timeliness of feedback on the notification information. Therefore, in order to ensure safe driving, an active dialogue corresponding to the notification information can be conducted through the voice assistant.

[0120] As an example, after displaying the notification information, the voice assistant can trigger an active conversation. Specifically, the active conversation may include first extracting the text information in the notification information through the voice support service in the Voice Support SDK, and then using the artificial intelligence large model to generate and output the voice conversation content based on the text information. Among them, the artificial intelligence large model (i.e., AI large model) may include, for example, large language models (LLM) and ChatGPT.

[0121] As an example, the AI ​​big model may include a text-to-speech module. After extracting the text information, the AI ​​big model can generate and output the voice dialogue content based on the text information through the text-to-speech module. That is, the AI ​​big model can convey the text information to the user by voice through the text-to-speech module. Specifically, the voice assistant can first broadcast the information title and information content in the notification information, and then guide the user to select any one of multiple interactive controls. Among them, the voice dialogue content may be, for example, "The road ahead is congested and cannot be avoided for you. Do you want to check the specific conditions of the road ahead?"

[0122] After outputting the voice conversation content, the voice assistant can wait to receive the user's reply information to the voice conversation content. Among them, the reply information can be any one of voice reply information and manual reply information. The manual reply information can include touch reply information and gesture reply information.

[0123] As an example, the AI ​​big model may also include an automatic speech recognition module. Through the automatic speech recognition module, the voice assistant may receive the user's voice reply information.

[0124] If the plurality of interactive controls include an interactive control corresponding to a switch function and an interactive control corresponding to a cancel function, the text information corresponding to each of the plurality of interactive controls may include “switch” and “cancel”.

[0125] As an example, in the case where the reply message is a voice reply message, after receiving the user's reply message, the user's intention can be determined based on the reply message, and then the user's intention can be matched with the text information corresponding to each of the multiple interactive controls to determine the user's interactive operation on the notification information.

[0126] Based on this, in order to improve the accuracy of matching, in some embodiments, before receiving the user's reply information to the voice conversation content, the following may also be included:

[0127] Save the text information corresponding to multiple interactive controls.

[0128] Based on this, the above matching of the reply information with the text information corresponding to each of the multiple interactive controls may specifically include:

[0129] Use artificial intelligence big models to perform natural language understanding and semantic analysis on reply messages to determine the user intent corresponding to the reply messages;

[0130] Match the user intention with the text information corresponding to each of the multiple interactive controls.

[0131] Here, the AI ​​big model may also include a natural language understanding module and a natural semantic understanding module. In the case where the reply message is a voice reply message, the natural language understanding module and the natural semantic understanding module perform natural language understanding and semantic analysis on the reply message to determine the user intent corresponding to the reply message. If the user intent is the same as the control intent corresponding to the text information of the interactive control, it can be determined that the user intent matches the text information corresponding to the interactive control.

[0132] In this way, by using the AI ​​big model's powerful ability to understand language to determine the user's intention corresponding to the reply information, the accuracy of the user's intention can be improved. In this way, by matching the user's intention with the text information corresponding to each of the multiple interactive controls, the accuracy of the matching can be improved.

[0133] If the reply information does not match the text information corresponding to each of the multiple interactive controls, the user can continue to talk to the user and guide the user to trigger any interactive control in the hit notification information. If the user's intention matches the text information corresponding to any interactive control, the active conversation can be exited (i.e., the output of the voice conversation content is stopped) and the control operation corresponding to the interactive control can be performed.

[0134] Based on this, in order to further improve the user's interactive experience, in some embodiments, after the above reply information matches any one of the text information corresponding to the multiple interactive controls, it may also include:

[0135] Perform a control operation corresponding to the target text information to obtain an operation result, wherein the target text information is text information that matches the reply information among the text information corresponding to each of the plurality of interactive controls;

[0136] The operation result is announced to the user by voice.

[0137] Here, after the voice assistant determines that the user's intention matches the text information corresponding to a certain interactive control, on the one hand, it can exit the active dialogue, and on the other hand, it can send the control instruction corresponding to the interactive control to the business party, so that the business party can perform the control operation corresponding to the control instruction (target text information), thereby completing the entire interaction with the notification information. After the business party performs the control operation and obtains the operation result, it can return the operation result to the voice assistant, and the voice assistant will inform the user of the operation result by voice, further improving the user's interactive experience.

[0138] In addition, since the user's reply information may also be a manual reply information, in some embodiments, after receiving the user's reply information to the voice conversation content, the following may also be included:

[0139] receiving a third input of a user selecting a third interactive control from among the multiple interactive controls, where the third interactive control is any one of the multiple interactive controls;

[0140] In response to the third input, determining a target control operation corresponding to the third interactive control, and stopping outputting the voice dialogue content;

[0141] Perform target control operations.

[0142] Here, the third input can be a touch input or a gesture input. After the user selects the third interactive control, on the one hand, the voice assistant can exit the active dialogue. On the other hand, the voice assistant can determine the target control instruction corresponding to the third interactive control based on the correspondence between the interactive control and the control instruction, and send the target control instruction to the business party. After receiving the target control instruction, the business party can perform the target control operation corresponding to the target control instruction, thereby completing the entire interaction with the notification information.

[0143] In addition, in order to avoid waste of resources and ensure reasonable use of resources, in some embodiments, after receiving the user's reply information to the voice conversation content, the following may also be included:

[0144] If no reply message is received within the preset time, stop outputting the voice conversation content and stop displaying the notification message.

[0145] Here, if the voice assistant does not receive any reply information within the preset time, it can end the active conversation (i.e. stop outputting the voice conversation content) and stop displaying the notification information. If the notification card has been displayed in the human-computer interaction interface, the display of the notification card can be canceled at the same time as the active conversation ends.

[0146] Therefore, by conducting an active dialogue corresponding to the notification information when the target priority is the third priority, it is possible to ensure that the first important notification information is notified to the user in a timely manner, and the user's feedback is received in a timely manner, and the user's instructions are executed to ensure driving safety.

[0147] In order to better describe the entire solution, some specific examples are given based on the above embodiments.

[0148] For example, Figure 5 As shown, an information interaction method provided in an embodiment of the present application may include the following steps:

[0149] S51. When a trigger condition for generating notification information is met, the business party generates notification information corresponding to the trigger condition;

[0150] S52: The business party determines the target priority and display template corresponding to the notification information, and jointly determines the notification information, the target priority and the display template as parameter information;

[0151] S53: The business direction sends parameter information to the voice assistant;

[0152] S54. The voice assistant generates and displays a notification card corresponding to the parameter information, where the notification card includes at least one interactive control;

[0153] S551, when the priority of the notification information is the second priority, the voice assistant voice broadcasts the text information in the notification card;

[0154] S552: When the priority of the notification information is the third priority, the voice assistant conducts an active dialogue corresponding to the text information in the notification card;

[0155] S56. The voice assistant receives a target input from a user selecting a target interactive control from at least one interactive control;

[0156] S57. The voice assistant sends a target control instruction corresponding to the target interactive control to the business party;

[0157] S58, the business party performs a control operation corresponding to the target control instruction;

[0158] S59: The business direction sends the execution result corresponding to the control operation to the voice assistant;

[0159] S510: The voice assistant feeds back the execution result to the user.

[0160] Therefore, the push method of notification information is reasonably arranged based on the priority of the notification information. On the one hand, it can ensure that the first important notification information is notified to the user in time, and the user's feedback is received in time, and the user's instructions are executed to ensure driving safety. On the second hand, it can ensure that the second most important notification information is notified to the user in time to prevent the user from missing important information and improve the user's driving experience. On the third hand, it can prevent unimportant notification information from taking up too much time and energy of the user and affecting the user's normal driving. In this way, through the embodiments of the present application, driving safety and the user's driving experience can be improved.

[0161] In addition, in the case where the notification information triggers an active dialogue, a schematic diagram of an information interaction method applied to a vehicle system provided by an embodiment of the present application can be as follows: Figure 6 shown.

[0162] exist Figure 6 In the process, the business party can send notification information to the voice assistant through the interface provided by the voice support. After receiving the notification information, the voice assistant can conduct an active dialogue corresponding to the notification information through the active dialogue module. Specifically, the active dialogue module can first broadcast the notification information based on the text-to-speech service in the AI ​​big model, and then wait for the user's reply information to the notification information based on the automatic speech recognition service. After receiving the user's voice reply information, the voice reply information is understood by natural language and natural semantics based on the AI ​​big model to determine whether the user intention corresponding to the voice reply information is any of the control intentions corresponding to the notification information. If so, the control instruction corresponding to the voice reply information is sent to the business party, and the active dialogue ends; if not, the active dialogue with the user continues until it is determined that the user intention is any of the control intentions corresponding to the notification information.

[0163] Therefore, by combining the active dialogue of the AI ​​big model for information interaction, it can reduce user thinking and simplify user operations. While facilitating users, it also provides a guarantee for safe driving.

[0164] Based on the information interaction method provided in the above embodiment, the present application also provides a specific implementation of the information interaction device. Please refer to the following embodiment.

[0165] like Figure 7 As shown, the information interaction device 700 provided in the embodiment of the present application includes the following modules:

[0166] A first acquisition module 710, used to acquire notification information;

[0167] The second acquisition module 720 is used to acquire parameter information corresponding to the notification information, wherein the parameter information includes a display mode and a target priority of the notification information;

[0168] A determination module 730, configured to determine a target information interaction mode corresponding to the target priority according to a correspondence between the priority and the information interaction mode, wherein the interaction intensity of the information interaction mode is positively correlated with the priority;

[0169] The interaction module 740 is used to display the notification information in a display manner, and to perform information interaction corresponding to the notification information in a target information interaction manner.

[0170] The information interaction device 700 is described in detail below, as shown below:

[0171] In some embodiments, the interaction module 740 may specifically include:

[0172] A generation submodule, used to render the notification information according to a display template corresponding to the notification information and generate a notification card;

[0173] The first display submodule is used to display notification cards.

[0174] In some embodiments, the notification information includes at least one interactive control, and the target priority is any one of the first priority, the second priority, and the third priority, and the levels of the first priority, the second priority, and the third priority increase in sequence. Based on this, the interactive module 740 may specifically include:

[0175] A first receiving submodule is used to receive a first input of a user selecting a first interactive control from at least one interactive control when the target priority is a first priority, and the first interactive control is used to display a notification details page of the notification information;

[0176] The second display submodule is used to display the notification details page in response to the first input.

[0177] In some embodiments, the notification information includes multiple interactive controls, the target priority is any one of the first priority, the second priority and the third priority, and the levels of the first priority, the second priority and the third priority increase in sequence. Based on this, the interaction module 740 may further include:

[0178] The broadcast submodule is used to broadcast the notification information by voice when the target priority is the second priority;

[0179] A second receiving submodule is used to receive a second input of a user selecting a second interactive control from among the multiple interactive controls, where the second interactive control is any one of the multiple interactive controls;

[0180] The first control submodule is used to perform a control operation corresponding to the second interactive control in response to a second input, where the second input is operation information on the second interactive control.

[0181] In some embodiments, the notification information includes multiple interactive controls, the target priority is any one of the first priority, the second priority and the third priority, and the levels of the first priority, the second priority and the third priority increase in sequence. Based on this, the interaction module 740 may further include:

[0182] An extraction submodule, used for extracting text information from the notification information when the target priority is the third priority;

[0183] The dialogue submodule is used to generate and output voice dialogue content based on text information using the artificial intelligence model;

[0184] The third sub-receiving module is used to receive the user's reply information to the voice conversation content;

[0185] A matching submodule, used to match the reply information with the text information corresponding to each of the multiple interactive controls;

[0186] The execution submodule is used to return to the execution of using the artificial intelligence large model to generate and output voice dialogue content based on the text information when the reply information does not match the text information corresponding to each of the multiple interactive controls, until the reply information matches any one of the text information corresponding to each of the multiple interactive controls.

[0187] In some embodiments, the interaction module 740 may further include:

[0188] The saving submodule is used to save the text information corresponding to each of the multiple interactive controls before receiving the user's reply information to the voice dialogue content.

[0189] Based on this, the matching submodule may specifically include:

[0190] A determination unit, used to use a large artificial intelligence model to perform natural language understanding and semantic analysis on the reply information to determine the user intention corresponding to the reply information;

[0191] The matching unit is used to match the user intention with the text information corresponding to each of the multiple interactive controls.

[0192] In some embodiments, the interaction module 740 may further include:

[0193] The second control submodule is used to perform a control operation corresponding to the target text information after the reply information matches any one of the text information corresponding to the multiple interactive controls, and obtain an operation result, wherein the target text information is the text information matching the reply information in the text information corresponding to the multiple interactive controls;

[0194] The notification submodule is used to inform the user of the operation results by voice.

[0195] In some embodiments, the second acquisition module 720 may specifically include:

[0196] A first determination submodule, used to determine a business scenario corresponding to the notification information;

[0197] The second determination submodule is used to determine the display mode of the notification information according to the correspondence between the business scenario and the display mode;

[0198] A third determination submodule is used to determine the target priority of the notification information according to the correspondence between the business scenario and the priority;

[0199] The fourth determination submodule is used to determine the display mode and the target priority as parameter information.

[0200] The information interaction device of the embodiment of the present application displays the notification information in a display mode corresponding to the notification information, so that different notification information can be displayed in different ways, thereby enriching the notification style and improving the user experience. In addition, since the interaction intensity of the information interaction mode is positively correlated with the priority, by determining the target information interaction mode corresponding to the target priority according to the correspondence between the priority and the information interaction mode, and performing information interaction corresponding to the notification information according to the target information interaction mode, on the one hand, it is possible to enrich the interaction form and improve the user experience, and on the other hand, it enables the user to determine the importance of the notification information according to the interaction form, so as to avoid the user missing important information, and to avoid unimportant information taking up too much time and energy of the user, affecting the user's normal driving. In this way, through the embodiment of the present application, driving safety and the user's driving experience can be improved.

[0201] Based on the information interaction method provided in the above embodiment, the embodiment of the present application also provides a specific implementation of the electronic device. Figure 8 A schematic diagram of an electronic device 800 provided in an embodiment of the present application is shown.

[0202] The electronic device 800 may include a processor 810 and a memory 820 storing computer program instructions.

[0203] Specifically, the processor 810 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0204] The memory 820 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 820 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. Where appropriate, the memory 820 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 820 may be inside or outside the electronic device 800. In a particular embodiment, the memory 820 is a non-volatile solid-state memory.

[0205] The memory may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk storage medium device, an optical storage medium device, a flash memory device, an electrical, optical or other physical / tangible memory storage device. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., a memory device) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to the first aspect of the present application.

[0206] The processor 810 implements any one of the information interaction methods in the above embodiments by reading and executing computer program instructions stored in the memory 820.

[0207] In one example, the electronic device 800 may further include a communication interface 830 and a bus 840. Figure 8 As shown, the processor 810, the memory 820, and the communication interface 830 are connected via a bus 840 and communicate with each other.

[0208] The communication interface 830 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0209] Bus 840 includes hardware, software or both, and the parts of electronic equipment are coupled to each other. For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 840 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the application considers any suitable bus or interconnection.

[0210] Exemplarily, the electronic device 800 may be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA).

[0211] The electronic device can execute the information interaction method in the embodiment of the present application, thereby realizing the combination Figures 1 to 7 The information interaction method and device described.

[0212] In addition, in combination with the information interaction method in the above embodiments, the embodiments of the present application may provide a computer-readable storage medium for implementation. The computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any one of the information interaction methods in the above embodiments is implemented.

[0213] In addition, the embodiment of the present application further provides a vehicle, which may include at least one of the following:

[0214] An information interaction device as in any one of the embodiments of the second aspect;

[0215] An electronic device as in any one of the embodiments of the third aspect;

[0216] The computer-readable storage medium in any one of the embodiments of the fourth aspect will not be described in detail here.

[0217] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0218] The functional blocks shown in the above-described block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0219] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0220] The above reference is according to the method of the embodiment of the present application, the flow chart of the device (system) and the computer program product and / or the block diagram described various aspects of the present application.It should be understood that each square box in the flow chart and / or the block diagram and the combination of each square box in the flow chart and / or the block diagram can be realized by computer program instructions.These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the realization of the function / action specified in one or more square boxes of the flow chart and / or the block diagram.Such a processor can be but is not limited to a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit.It can also be understood that each square box in the block diagram and / or the flow chart and the combination of the square boxes in the block diagram and / or the flow chart can also be realized by the dedicated hardware that performs the specified function or action, or can be realized by the combination of dedicated hardware and computer instructions.

[0221] The above is only a specific implementation of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. An information interaction method, It is characterized in that include: Get notification information; Acquire parameter information corresponding to the notification information, wherein the parameter information includes a display mode and a target priority of the notification information; Determining a target information interaction mode corresponding to the target priority according to a correspondence between the priority and the information interaction mode, wherein the interaction intensity of the information interaction mode is positively correlated with the priority; The notification information is displayed according to the display method, and information interaction corresponding to the notification information is performed according to the target information interaction method.

2. The method according to claim 1, It is characterized in that The displaying of the notification information in the display mode includes: Rendering the notification information according to a display template corresponding to the notification information to generate a notification card; Display the notification card.

3. The method according to claim 1, It is characterized in that The notification information includes at least one interactive control, the target priority is any one of a first priority, a second priority, and a third priority, the first priority, the second priority, and the third priority are ranked in ascending order, and the information interaction corresponding to the notification information according to the target information interaction mode includes: When the target priority is the first priority, receiving a first input from a user selecting a first interactive control from among the at least one interactive control, the first interactive control being used to display a notification details page of the notification information; In response to the first input, the notification details page is displayed.

4. The method according to claim 1, It is characterized in that The notification information includes a plurality of interactive controls, the target priority is any one of a first priority, a second priority, and a third priority, the first priority, the second priority, and the third priority are ranked in ascending order, and the information interaction corresponding to the notification information in accordance with the target information interaction mode further includes: When the target priority is the second priority, voice broadcasting the notification information; receiving a second input from a user selecting a second interactive control from among the multiple interactive controls, where the second interactive control is any one of the multiple interactive controls; In response to the second input, a control operation corresponding to the second interactive control is performed, and the second input is operation information for the second interactive control.

5. The method according to claim 1, It is characterized in that The notification information includes a plurality of interactive controls, the target priority is any one of a first priority, a second priority, and a third priority, the first priority, the second priority, and the third priority are ranked in ascending order, and the information interaction corresponding to the notification information in accordance with the target information interaction mode further includes: When the target priority is the third priority, extracting text information in the notification information; Using an artificial intelligence big model, generate and output voice dialogue content based on the text information; Receiving a user's reply to the voice conversation content; Matching the reply information with the text information corresponding to each of the plurality of interactive controls respectively; In the case that the reply information does not match the text information corresponding to each of the multiple interactive controls, the method returns to executing the method of using the artificial intelligence large model to generate and output voice dialogue content based on the text information until the reply information matches any one of the text information corresponding to each of the multiple interactive controls.

6. The method according to claim 5, It is characterized in that Before receiving the user's reply information to the voice conversation content, the method further includes: Saving text information corresponding to each of the plurality of interactive controls; The matching the reply information with the text information corresponding to each of the plurality of interactive controls respectively includes: Using the artificial intelligence big model to perform natural language understanding and semantic analysis on the reply information to determine the user intent corresponding to the reply information; The user intention is matched with the text information corresponding to each of the multiple interactive controls.

7. The method according to claim 5, It is characterized in that After the reply information matches any one of the text information corresponding to each of the plurality of interactive controls, the method further includes: Performing a control operation corresponding to target text information to obtain an operation result, wherein the target text information is text information matching the reply information among the text information corresponding to each of the plurality of interactive controls; The operation result is notified to the user by voice.

8. The method according to claim 1, It is characterized in that The acquiring parameter information corresponding to the notification information includes: Determine a business scenario corresponding to the notification information; Determining a display method of the notification information according to a correspondence between the business scenario and the display method; Determining the target priority of the notification information according to the correspondence between the business scenario and the priority; The display mode and the target priority are determined as the parameter information.

9. An information interaction device, It is characterized in that The device comprises: A first acquisition module, used to acquire notification information; A second acquisition module is used to acquire parameter information corresponding to the notification information, wherein the parameter information includes a display mode and a target priority of the notification information; A determination module, configured to determine a target information interaction mode corresponding to the target priority according to a correspondence between the priority and the information interaction mode, wherein the interaction intensity of the information interaction mode is positively correlated with the priority; An interaction module is used to display the notification information according to the display method, and to perform information interaction corresponding to the notification information according to the target information interaction method.

10. An electronic device, It is characterized in that The electronic device comprises: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the information interaction method according to any one of claims 1 to 8 is implemented.

11. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the information interaction method according to any one of claims 1 to 8 is implemented.

12. A vehicle, It is characterized in that Include at least one of the following: The information interaction device as claimed in claim 9; The electronic device as claimed in claim 10; The computer readable storage medium of claim 11.

Images