Multi-mode alarm prompting method, controller, control system and automobile

Abstract

The invention discloses a multi-mode alarm prompting method, an alarm controller and a control system. The multi-mode alarm prompting method comprises the following steps: acquiring at least two pieces of original alarm prompting information; performing emergency degree analysis on each piece of original alarm prompt information, and determining a target emergency degree corresponding to the original alarm prompt information; determining target alarm prompt information based on the target emergency degrees corresponding to the at least two pieces of original alarm prompt information; and carrying out multi-mode alarm prompting on the target alarm prompting information. By performing emergency degree judgment on the original alarm prompt information, multi-mode alarm prompt can be performed according to different emergency degrees in a standardized manner, and the problems that the mode is single and the content of the alarm prompt information cannot be clearly expressed during alarm prompt are solved.

Description

Technical Field

[0001] The present invention relates to the field of alarm prompt control, and particularly to a multi-modal alarm prompt method, a controller, a control system and an automobile. Background Art

[0002] Currently, there are many alarm prompt messages applied to automobiles, ships, spacecrafts or other instruments. Most of the alarm prompt messages are concentrated in the form of a single icon or buzzer, etc., and cannot express alarm prompt messages with different meanings in multiple forms and modalities. Users need to spend time to understand and learn the multiple meanings of alarm prompt corresponding to a single icon and buzzer. Moreover, the existing alarm prompt messages cannot distinguish different levels of urgency, resulting in insufficient attention from users to the alarm prompt messages and affecting the response speed of users to the problems existing in the alarm prompt messages. Summary of the Invention

[0003] Embodiments of the present invention provide a multi-modal alarm prompt method, a controller, a control system and an automobile to solve the problem that the display of alarm prompt messages is not standardized, making it impossible for users to understand their meanings and levels of urgency.

[0004] A multi-modal alarm prompt method includes:

[0005] Obtain at least two original alarm prompt messages;

[0006] Perform an urgency analysis on each of the original alarm prompt messages to determine the target urgency level corresponding to the original alarm prompt message;

[0007] Based on the target urgency levels corresponding to at least two of the original alarm prompt messages, determine the target alarm prompt message;

[0008] Perform multi-modal alarm prompt on the target alarm prompt message.

[0009] Preferably, the performing an urgency analysis on each of the original alarm prompt messages to determine the target urgency level corresponding to the original alarm prompt message includes:

[0010] Perform an urgency analysis on the original alarm prompt message to determine the first urgency levels corresponding to at least two urgency evaluation dimensions;

[0011] Determine the target urgency level corresponding to the original alarm prompt message according to the first urgency levels corresponding to at least two of the urgency evaluation dimensions.

[0012] Preferably, the determining the target urgency level corresponding to the original alarm prompt message according to the first urgency levels corresponding to at least two of the urgency evaluation dimensions includes:

[0013] If at least two of the first emergency levels are level-one emergency levels, determine that the target emergency level corresponding to the original alarm prompt message is level-one emergency level;

[0014] If there is one first emergency level that is level-one emergency level, determine that the target emergency level corresponding to the original alarm prompt message is level-two emergency level;

[0015] If there is no first emergency level that is level-one emergency level, determine that the target emergency level corresponding to the alarm prompt message is level-three emergency level.

[0016] Preferably, determining the target alarm prompt message based on the target emergency levels corresponding to at least two of the original alarm prompt messages includes:

[0017] Compare the target emergency levels of at least two of the original alarm prompt messages;

[0018] If the target emergency levels of at least two of the original alarm prompt messages are different, determine the original alarm prompt message corresponding to the highest-level target emergency level as the target alarm prompt message;

[0019] If the target emergency levels of at least two of the original alarm prompt messages are the same, determine the original alarm prompt message corresponding to the alarm prompt message with the most recent alarm time as the target alarm prompt message.

[0020] Preferably, performing multimodal alarm prompting on the target alarm prompt message includes:

[0021] Obtain at least two original modal elements corresponding to the target alarm prompt message;

[0022] Perform modal scoring on at least two original modal elements corresponding to the target alarm prompt message to determine the target score values corresponding to at least two of the original modal elements;

[0023] Based on the target score values corresponding to at least two of the original modal elements, perform multimodal alarm prompting on the target alarm prompt message.

[0024] Preferably, performing modal scoring on at least two original modal elements corresponding to the target alarm prompt message to determine the target score values corresponding to at least two of the original modal elements includes:

[0025] Perform modal scoring on at least two original modal elements corresponding to the target alarm prompt message to obtain the modal score values corresponding to at least two of the original modal elements;

[0026] Based on the target emergency level corresponding to the target alarm prompt message, determine the target weights corresponding to at least two of the original modal elements;

[0027] Determine the target score values corresponding to at least two of the original modality elements based on the modality score values corresponding to at least two of the original modality elements and the target weights.

[0028] Preferably, the multimodal alarm prompt for the target alarm prompt information based on the target score values corresponding to at least two of the original modality elements includes:

[0029] Compare the target score value corresponding to the original modality element with a preset score value;

[0030] If the target score value corresponding to the original modality element is greater than the preset score value, determine the original modality element as the main modality element;

[0031] If the target score value corresponding to the original modality element is not greater than the preset score value, determine the original modality element as the auxiliary modality element;

[0032] Perform multimodal alarm prompt for the target alarm prompt information according to the main modality element and the auxiliary modality element.

[0033] A controller includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the multimodal alarm prompt method described in any one of the above is implemented.

[0034] A vehicle-mounted alarm control system includes: an entertainment domain controller, an intelligent driving domain controller, a central controller, and an actuator;

[0035] The entertainment domain controller is signal-connected to the intelligent driving domain controller and the central controller, and is configured to execute the multimodal alarm prompt method described in any one of the above, and send a target control signal to the intelligent driving domain controller and / or the central controller;

[0036] The intelligent driving domain controller and / or the central controller is configured to control the actuator to perform an alarm prompt according to the target control signal.

[0037] A vehicle includes the above vehicle-mounted alarm control system.

[0038] The above-mentioned multi-modal alarm prompting method, controller, control system and vehicle obtain at least two original alarm prompting messages, judge the urgency level of the original alarm prompting messages, and then determine the final target alarm prompting message according to the target urgency level of the original alarm prompting messages. According to the target alarm prompting message, various modal elements can be selected to perform alarm prompting. It can not only achieve the effect of performing alarm prompting at different levels according to the different urgency levels of the alarm prompting messages, but also achieve the effect of performing alarm prompting through various modal elements, enriching the display form of the alarm prompting, thereby ensuring the accuracy of the alarm prompting and being able to clearly express the meaning of the alarm prompting at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments of the present invention. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained according to these drawings.

[0040] Figure 1 is a flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0041] Figure 2 is another flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0042] Figure 3 is another flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0043] Figure 4 is another flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0044] Figure 5 is another flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0045] Figure 6 is another flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0046] Figure 7 is another flowchart of a multi-modal alarm prompting method in an embodiment of the present invention;

[0047] Figure 8 is an example diagram of a vehicle-mounted alarm control system in an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0048] In order to make the technical problems, technical solutions and beneficial effects solved by the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0049] An embodiment of the present invention provides a multimodal alarm prompting method. This multimodal alarm prompting method is applied to automobiles, ships, spaceships or other instruments, and can perform alarm processing of different degrees using multimodal alarm prompts according to the urgency of the alarm prompt information. Specifically, it can be on the controller of an automobile, a ship, a spaceship or other instruments. Here, the controller can be a dedicated controller that can implement alarm prompts on an automobile, or an existing controller that can integrate alarm prompts and other functions on an automobile.

[0050] In one embodiment, as Figure 1 shown, a multimodal alarm prompting method is provided. Taking the multimodal alarm prompting method applicable to the controller as an example, this multimodal alarm prompting method includes:

[0051] S101: Obtain at least two original alarm prompt messages;

[0052] S102: Analyze the urgency of each original alarm prompt message to determine the target urgency corresponding to the original alarm prompt message;

[0053] S103: Based on the target urgencies corresponding to at least two original alarm prompt messages, determine the target alarm prompt message;

[0054] S104: Perform multimodal alarm prompts on the target alarm prompt message.

[0055] Among them, the original alarm prompt message refers to the prompt message used to alarm according to the problems that occur in automobiles, ships, spaceships or other instruments.

[0056] As an example, in step S101, the controller obtains at least two original alarm prompt messages. By obtaining the original alarm prompt messages, it is convenient to select various modal elements for alarm prompts according to the specific meanings of the original alarm prompt messages, ensuring the accuracy of the alarm prompts.

[0057] Among them, the target urgency refers to the final urgency determined after comprehensively evaluating the original alarm prompt message.

[0058] As an example, in step S102, the controller analyzes the urgency level of the original alarm prompt information to determine the target urgency level of the original alarm prompt information, so as to achieve the best alarm prompt effect. Through evaluation from different dimensions, users can clearly understand the target urgency levels of different original alarm prompt information, so that users can clearly understand the contents of different alarm prompt information.

[0059] The target alarm prompt information refers to the target alarm prompt information that needs to be alarmed finally determined after the urgency levels of at least two original alarm prompt information are evaluated.

[0060] As an example, in step S103, the controller compares the target urgency levels of at least two original alarm prompt information according to the determined target urgency levels of at least two original alarm prompt information, and determines the target alarm prompt information according to the comparison result. By comparing the target urgency levels of the original alarm prompt information to determine the target alarm prompt information, the alarm prompt information with a high urgency level can be timely perceived by users, achieving the effect that there will be different alarm prompt sequences according to different urgency levels.

[0061] As an example, in step S104, the controller performs multimodal alarm prompts according to the determined target alarm prompt information. The multimodal alarm prompts here refer to that alarm prompts can be implemented by but not limited to text, sound, light or other means, which can avoid the shortcoming of only single-modal alarm prompts, achieve alarm prompts in multiple modes, and improve the safety and clarity of alarm prompts.

[0062] In this embodiment, the controller obtains at least two original alarm prompt information, analyzes the urgency levels of the original alarm prompt information, and determines the target urgency level of each original alarm prompt information; determines the target alarm prompt information according to the target urgency levels of at least two original alarm prompt information, and then the controller performs multimodal alarm prompts according to the determined target alarm prompt information. By analyzing the urgency levels of alarm prompt information, the shortcoming of only single-modal alarm prompts can be avoided, achieve alarm prompts in multiple modes, improve the safety and clarity of alarm prompts, and enable users to understand the alarm prompt content clearly and without obstacles, reducing the learning cost of users.

[0063] In one embodiment, as Figure 2 shown, step S102, analyzing the urgency level of each original alarm prompt information to determine the corresponding target urgency level of the original alarm prompt information, includes:

[0064] S201: Analyze the urgency level of the original alarm prompt information to determine the first urgency level corresponding to at least two urgency evaluation dimensions;

[0065] S202: Determine the target urgency level corresponding to the original alarm prompt message according to the first urgency levels corresponding to at least two emergency evaluation dimensions.

[0066] The emergency evaluation dimension refers to the dimension used to evaluate the urgency level of the original alarm prompt message. The first urgency level refers to the urgency level determined based on a single emergency evaluation dimension.

[0067] As an example, in step S201, the controller performs a first-level urgency analysis on the original alarm prompt message, determines at least two emergency evaluation dimensions, and effectively ensures the accuracy and reliability of the original alarm prompt message by using the content of at least two emergency evaluation dimensions for urgency evaluation. In this example, the emergency evaluation dimensions include, but are not limited to, whether it endangers safety, the degree of user intervention, display priority, and prompt effect, and then determines the first urgency levels corresponding to different emergency evaluation dimensions. By determining the first urgency levels of at least two emergency evaluation dimensions, a comprehensive analysis of the original alarm prompt message can be realized from different dimensions, improving the accuracy and safety of the alarm prompt.

[0068] As an example, in step S202, the controller specifically may, but is not limited to, determine the finally corresponding target urgency level of the original alarm prompt message by performing a weighted process on the first urgency levels corresponding to at least two emergency evaluation dimensions, so as to ensure the accuracy of the target urgency level, so as to further analyze the target score values of the original alarm prompt messages corresponding to different modal elements according to the target urgency level, ensuring that the actuator can not only play a reminder role but also reduce interference to the user when performing an alarm prompt, enabling the user to clearly know the importance of the alarm prompt message and achieving the effect of an efficient alarm prompt.

[0069] In this embodiment, the controller performs an urgency analysis on the original alarm prompt message, determines the first urgency levels corresponding to at least two emergency evaluation dimensions, and then determines the target urgency level corresponding to the original alarm prompt message according to the first urgency levels corresponding to at least two emergency evaluation dimensions, so that the target urgency level reflects the emergency evaluation results of at least two dimensions, which can improve the accuracy and safety of the alarm prompt. During the process of driving a vehicle, the distinction of the urgency level of the alarm prompt is carried out, avoiding the problem that when an alarm prompt is made, the user cannot recognize the importance of the alarm prompt message and is prone to misunderstand the content expressed by the alarm prompt message, and improving the user's recognition of alarm prompt messages with different urgency levels.

[0070] In one embodiment, such as Figure 3As shown in the figure, in step S202, according to the first emergency levels corresponding to at least two emergency evaluation dimensions, determining the target emergency level corresponding to the original alarm prompt message includes:

[0071] S301: If at least two of the first emergency levels are first-level emergency levels, determining that the target emergency level corresponding to the original alarm prompt message is the first-level emergency level;

[0072] S302: If there is one first-level emergency level among the first emergency levels, determining that the target emergency level corresponding to the original alarm prompt message is the second-level emergency level;

[0073] S303: If there is no first-level emergency level among the first emergency levels, determining that the target emergency level corresponding to the original alarm prompt message is the third-level emergency level.

[0074] As an example, in step S301, if the controller identifies that at least two of the first emergency levels are shown as first-level emergency levels, then it is determined that the target emergency level corresponding to the original alarm prompt message is the first-level emergency level, and when implementing the alarm prompt, the alarm prompt is carried out according to the situation of the first-level emergency level. In this example, when the controller identifies that whether it endangers safety is "Yes", the user intervention level is "Intervene immediately", the display priority is "High" and the prompt effect is "High", then the target emergency level can be determined to be the first-level emergency level. In automobile driving, if an alarm prompt for forward collision warning appears, then the target emergency level of the original alarm prompt message of the vehicle is the first-level emergency level.

[0075] As an example, in step S302, if the controller identifies that one of the first emergency levels is shown as the first-level emergency level, then it is determined that the target emergency level corresponding to the original alarm prompt message is the second-level emergency level, and when implementing the alarm prompt, the alarm prompt is carried out according to the situation of the second-level emergency level. In this example, when the controller identifies that whether it endangers safety is shown as "Possible", the user intervention level is "Intervene temporarily / at the right time", the priority of the alarm prompt is "Medium" and the prompt effect is "Medium", then the target emergency level can be determined to be the second-level emergency level. In automobile driving, when in autonomous driving, if the controller identifies an alarm prompt that the hand has not held the steering wheel for a long time, then the target emergency level of the original alarm prompt message of the vehicle is the second-level emergency level.

[0076] As an example, in step S303, if the controller identifies that there is no first emergency level displayed as a first-level emergency level, it determines that the target emergency level corresponding to the original alarm prompt information is a third-level emergency level, and when implementing the alarm prompt, it performs the alarm prompt according to the situation of the third-level emergency level. In this example, when the controller identifies that whether it endangers safety is displayed as "no", the user intervention level is "only prompt, no intervention", the priority of the alarm prompt is "low" and the prompt effect is "weak", then it can be determined that the target emergency level is a third-level emergency level. During vehicle driving, if there is an alarm prompt for low fuel / electricity, then the target emergency level of the original alarm prompt information of the vehicle is a third-level emergency level.

[0077] In this example, the first-level emergency level has the highest emergency level, the second-level emergency level has a medium emergency level, and the third-level emergency level has the weakest emergency level. Therefore, according to the different emergency levels, the priority levels for the controller to control the alarm prompt are also different, that is, the priority levels for controlling the alarm prompt are sorted according to the first-level emergency level, the second-level emergency level, and the third-level emergency level. The higher the emergency level, the higher the priority of the alarm prompt.

[0078] In this embodiment, if the controller identifies that at least two first emergency levels are first-level emergency levels, it determines that the target emergency level is a first-level emergency level; if there is one first emergency level that is a first-level emergency level, it determines that the target emergency level is a second-level emergency level; if there is no first emergency level that is a first-level emergency level, it determines that the target emergency level is a third-level emergency level. The controller determines the target emergency level based on the evaluation of at least two first emergency levels, which increases the accuracy and reliability of the alarm prompt, and enables the user to clearly understand the importance of the alarm prompt information, thereby making the meaning represented by the alarm prompt clearer, facilitating the user to perceive it in a timely manner, and achieving the effect of efficient prompting.

[0079] In one embodiment, as Figure 4 shown, step S103, based on the target emergency levels corresponding to at least two original alarm prompt information, determines the target alarm prompt information, including:

[0080] S401: Compare the target emergency levels of at least two original alarm prompt information;

[0081] S402: If the target emergency levels of at least two original alarm prompt information are different, then determine the original alarm prompt information corresponding to the highest-level target emergency level as the target alarm prompt information;

[0082] S403: If the target emergency levels of at least two original alarm prompt information are the same, then determine the original alarm prompt information corresponding to the alarm prompt information with the most recent alarm time as the target alarm prompt information.

[0083] Among them, the alarm time refers to the time when the controller obtains the original alarm prompt information.

[0084] As an example, in step S401, if the controller receives at least two original alarm prompt information, the controller compares the target urgency levels of the at least two original alarm prompt information to avoid the situation where the at least two original alarm prompt information are responded to simultaneously and it is impossible to distinguish the importance levels of the original alarm prompt information. For example, during car driving, the user cannot clearly understand the importance levels of the original alarm prompt information, resulting in the inability to handle relevant alarm problems in a timely manner. Therefore, by comparing the target urgency levels of the at least two original alarm prompt information, it is ensured that the user can first perceive the alarm prompt with a higher urgency level, enhancing the security of the alarm prompt.

[0085] As an example, in step S402, if the controller identifies that the target urgency levels of at least two original alarm prompt information are different, the original alarm prompt information with the highest target urgency level is determined as the target alarm prompt information, ensuring that the original alarm prompt information with the highest target urgency level is first perceived by the user and avoiding the situation where the problems reflected by the original alarm prompt information with a higher target urgency level are not effectively resolved under the interference of other original alarm prompt information, and ensuring the effectiveness and feasibility of the alarm prompt in real time.

[0086] As an example, in step S403, if the controller identifies that the target urgency levels of at least two original alarm prompt information are the same, the controller determines the original alarm prompt information with the most recent alarm time among the at least two original alarm prompt information as the target alarm prompt information, simplifying the subsequent steps of the alarm prompt. Determining the target alarm prompt information avoids interfering with the user and reduces the trouble caused by redundant alarm prompts generated by multiple original alarm prompt information, ensuring the effectiveness of the alarm prompt.

[0087] In this embodiment, the controller compares the target urgency levels of at least two original alarm prompt information; if the target urgency levels of the at least two original alarm prompt information are different, the original alarm prompt information corresponding to the highest target urgency level is determined as the target alarm prompt information; if the target urgency levels of the at least two original alarm prompt information are the same, the original alarm prompt information corresponding to the alarm prompt information with the most recent alarm time is determined as the target alarm prompt information. By comparing the target urgency levels of at least two original alarm prompt information, different-order alarm prompts are realized according to the different urgency levels of the alarm prompt information, avoiding chaos in the alarm prompt, enabling the user to have a better experience of the alarm prompt, and enabling the user to timely perceive the importance level of the alarm prompt.

[0088] In one embodiment, such as Figure 5As shown in the figure, in step S104, multi-modal alarm prompts are performed on the target alarm prompt information, including:

[0089] S501: Obtain at least two original modal elements corresponding to the target alarm prompt information;

[0090] S502: Perform modal scoring on at least two original modal elements corresponding to the target alarm prompt information to determine the target score values corresponding to the at least two original modal elements;

[0091] S503: Based on the target score values corresponding to the at least two original modal elements, perform multi-modal alarm prompts on the target alarm prompt information.

[0092] Among them, the original modal element is a modal element used to represent the manifestation form of the alarm prompt information. As an example, in an automobile, a ship, a spaceship or other instruments, different manifestation forms of modal elements such as, but not limited to, text, voice, icon, dynamic effect, vibration, prompt word, light, fragrance and wind feeling can be adopted to reflect the corresponding alarm prompt information.

[0093] As an example, in step S501, after the controller obtains the target alarm prompt information, it will obtain at least two original modal elements corresponding to the target alarm prompt information, that is, the target alarm prompt information is reflected by different original modal elements, so as to realize the function of using multiple modes for alarm prompts and overcome the shortcoming of using a single mode for alarm prompts.

[0094] Among them, the target score value refers to the final score value determined after comprehensively evaluating the original modal element.

[0095] As an example, in step S502, the controller scores at least two original modal elements according to the at least two original modal elements corresponding to the target alarm prompt information, and obtains the target score values corresponding to the original modal elements. Since the target score value can comprehensively reflect the comprehensive evaluation score of each original modal element, making the at least two original modal elements comparable, numerical processing of the at least two original modal elements in the target alarm prompt information can improve the accuracy of the alarm prompt and realize that users can understand the alarm prompt content without obstacles. Since the alarm prompt information corresponding to modal elements such as text, voice, icon, dynamic effect, vibration, prompt word, light, fragrance and wind feeling is not comparable, it is necessary to evaluate them according to their modal elements in different dimensions to determine their target score values, so as to convert the incomparable original modal elements into comparable target score values.

[0096] As an example, in step S503, the controller uses at least two original modal elements corresponding to the target score values to give an alarm prompt for the target alarm prompt information, that is, to give a multi-modal alarm prompt. Giving an alarm prompt according to the target score values of the original modal elements realizes the standardization of the alarm prompt, ensures that the user can clearly understand the alarm prompt content without obstacles, improves the accuracy of the alarm, enables the user to easily understand the meanings expressed by different modalities, and realizes the function of giving an alarm prompt in multiple modalities.

[0097] In this embodiment, after the controller obtains at least two original modal elements corresponding to the target alarm prompt information, it starts to perform modal scoring on the original modal elements to determine the target score values corresponding to the at least two original modal elements; subsequently, based on the target score values, a multi-modal alarm prompt is given for the target alarm prompt information. Determining the target score values facilitates subsequent multi-modal alarm prompts according to different target score values, thereby achieving a better alarm prompt effect, ensuring the safety and accuracy of the alarm prompt, and also improving the clarity of the alarm prompt expression. Especially during the driving of a vehicle, it can avoid the problem that an effective alarm cannot be achieved due to a single-modal alarm prompt.

[0098] In one embodiment, as Figure 6 shown, step S502, performing modal scoring on at least two original modal elements corresponding to the target alarm prompt information to determine the target score values corresponding to the at least two original modal elements, includes:

[0099] S601: Perform modal scoring on at least two original modal elements corresponding to the target alarm prompt information to obtain the modal score values corresponding to the at least two original modal elements;

[0100] S602: Based on the target urgency corresponding to the target alarm prompt information, determine the target weights corresponding to the at least two original modal elements;

[0101] S603: Based on the modal score values and the target weights corresponding to the at least two original modal elements, determine the target score values corresponding to the at least two original modal elements.

[0102] Among them, the modal score value refers to the score used to evaluate different original modal elements.

[0103] As an example, in step S601, the controller queries the modality scoring table according to at least two original modality elements corresponding in the target alarm prompt information, and can obtain the modality scoring values corresponding to the original modality elements in different evaluation dimensions. By determining the modality scoring values of at least two evaluation dimensions in the original modality elements, the incomparable original modality elements can be converted into comparable modality scoring values, enabling the controller to more accurately use appropriate original modality elements for alarm prompts and improving the safety and reliability of alarm prompts.

[0104] In this example, the evaluation dimensions include at least two of the four dimensions of clarity, response speed, interference situation, and learning cost. By determining the modality scoring value of clarity, it can be known how clear the original modality element is when giving an alarm prompt. By determining the modality scoring value of response speed, it can be known how fast the original modality element responds to the alarm prompt information. By determining the modality scoring value of the interference situation, it can be known the degree of interference of the original modality element on other operations of the user during response. By determining the modality scoring value of the learning cost, it can be known the degree of time and effort required for the user to learn the meaning expressed by the original modality element.

[0105] By determining the modality scoring values of at least two evaluation dimensions in the original modality elements and converting the incomparable original modality elements into comparable modality scoring values, the characteristics of each original modality element can be judged more clearly, ensuring that when using multiple modalities for alarm prompts, a clear meaning can still be expressed, thereby reducing the learning cost of the user and improving the alarm prompt effect.

[0106] For example, when scoring from the four dimensions, the following scoring criteria can be referred to, as shown in Table 1:

[0107]

[0108] Table 1

[0109] For example, by scoring from these four dimensions, a modality scoring table of different modality elements is obtained, as shown in Table 2:

[0110]

[0111] Table 2

[0112] Among them, the target weight refers to the weight used to determine different evaluation dimensions under different emergency levels.

[0113] As an example, in step S602, the controller determines the target weights corresponding to at least two evaluation dimensions in the corresponding original modal element according to the target urgency level corresponding to the target alarm prompt information. By determining different target weights, the normalization processing of the target alarm prompt information is realized, and the safety and accuracy of the alarm prompt are also higher. In this example, when the target urgency level is the first-level urgency level, the importance ranking of the evaluation dimensions of the original modal element at this time is response speed > clarity > learning cost > interference situation. Therefore, the target weights corresponding to the evaluation dimensions are 0.3, 0.25, 0.25, and 0.2 respectively. When the target urgency level is the second-level urgency level or the third-level urgency level, the importance ranking of the evaluation dimensions of the original modal element is clarity > learning cost > interference situation > response speed. Therefore, the target weights corresponding to the evaluation dimensions are 0.3, 0.25, 0.25, and 0.2 respectively. By determining different target weights according to different target urgency levels, the accuracy and safety of the alarm prompt are improved. For example, when the user is driving a car, different original modal elements are used to alarm the target alarm prompt information under different target urgency levels, which can more effectively achieve the prompting effect and ensure the safety of the user, realize the function of alarm prompt with multiple modalities, and avoid the problems of unclear expression and complicated alarm caused by single-modal alarm prompt.

[0114] As an example, in step S603, the controller linearly calculates the modal score value and the target weight corresponding to each evaluation dimension in the original modal element to obtain the target score value of the original modal element. Since the target score value can comprehensively reflect the comprehensive evaluation score of each original modal element, making at least two original modal elements comparable, it is convenient to perform multi-modal alarm prompts according to different target score values later, achieving a better alarm prompt effect, avoiding the problems of unclear expression and complicated alarm caused by single-modal alarm prompt, and at the same time, through the comparable scores, the alarm prompts are carried out in order to ensure the standardization of the alarm prompts.

[0115] For example, according to multiple original modal elements under different urgency levels, the corresponding target score values calculated are as

[0116] shown in Table 3:

[0117]

[0118] Table 3

[0119] In this embodiment, the controller performs modal scoring on the original modal elements. After obtaining the modal scoring values of at least two original modal elements, it determines the target weight according to the target urgency level corresponding to the target alarm prompt information. Subsequently, it calculates the modal scoring value and the target weight to determine the target scoring value corresponding to the original modal element. Determining the target scoring value facilitates subsequent corresponding alarm prompt operations for the target alarm prompt information using multiple original modal elements according to different target scoring values, achieving a better alarm prompt effect, ensuring the safety and accuracy of the alarm prompt, and also improving the clarity of the alarm prompt expression. Especially during the process of driving a vehicle, multimodal alarm prompts overcome the problems of insufficient accuracy and unclear expression of single-modal alarm prompts, realizing the function of efficiently conveying alarm prompt information.

[0120] In one embodiment, as Figure 7 shown, step S43, based on the target scoring values corresponding to at least two original modal elements, performs multimodal alarm prompts for the target alarm prompt information, including:

[0121] S701: Compare the target scoring value corresponding to the original modal element with the preset scoring value;

[0122] S702: If the target scoring value corresponding to the original modal element is greater than the preset scoring value, determine the original modal element as the main modal element;

[0123] S703: If the target scoring value corresponding to the original modal element is not greater than the preset scoring value, determine the original modal element as the auxiliary modal element;

[0124] S704: Perform multimodal alarm prompts for the target alarm prompt information according to the main modal element and the auxiliary modal element.

[0125] Among them, the preset scoring value is a scoring value preset for distinguishing the main modal element and the auxiliary modal element. The main modal element refers to the element that serves as the main alarm display among at least two modal elements. The auxiliary modal element refers to the element that is used to cooperate with the main modal element for alarm prompts among at least two modal elements.

[0126] As an example, in step S701, the controller compares the target score value of the original modal element with the preset score value to determine the modal element to be used according to the importance of the original modal element. That is, the more important the original modal element is, the more distinct the original modal element used for alarm prompt is, the easier it is to be perceived and it needs to conform to the corresponding scenario. By comparing the results, the original modal element mainly used for prompt and the original modal element used as an auxiliary for prompt are determined, so that in different scenarios, according to the comprehensive situation of the original modal elements, the appropriate original modal element mainly used for prompt or the original modal element used as an auxiliary for prompt can be used as the alarm prompt. Therefore, comparing the target score value with the preset score value can increase the accuracy of the alarm prompt, ensure that the best original modal element is selected for alarm when making an alarm prompt, ensure that the original modal element can clearly express the meaning, and achieve higher efficiency when using multiple modal elements for alarm prompt.

[0127] As an example, in step S702, if the controller recognizes that the target score value of the original modal element is greater than the preset score value, it indicates that the importance of the original modal element is relatively high, and a more obvious prompt method needs to be used for alarm prompt. In this example, text, voice, dynamic effects, and a prompt sound can be used as the main modal elements. Therefore, the controller uses these original modal elements as the main modal elements. Determining the main modal element from at least two original modal elements can efficiently convey the target alarm prompt information corresponding to the main modal element, present the original modal element that needs to be emphasized for prompt in a more distinct way, achieve a good alarm prompt effect, facilitate the user to better distinguish the importance of different modal elements, and also ensure the effectiveness of multi-modal alarm prompt.

[0128] As an example, in step S703, if the controller recognizes that the target score value of the original modal element is not greater than the preset score value, it indicates that the importance of the original modal element is not high, and a more obvious prompt method does not need to be used for alarm prompt, but a higher perception degree is required to promote the user's perception of the alarm prompt. Therefore, the controller determines these original modal elements as auxiliary modal elements. In this example, icons, vibrations, lights, fragrances, wind sensations, etc. can be used as auxiliary modal elements. Determining the auxiliary modal element from at least two modal elements can improve the user's perception of the alarm prompt corresponding to the auxiliary modal element while reducing interference to the user. For example, during the driving of a car, the use of auxiliary modal elements can not only ensure that the user perceives the alarm, facilitate the user to better distinguish the importance of different modal elements, but also ensure the effectiveness and responsiveness of multi-modal alarm prompt, and avoid the user generating negative emotions due to the response of multiple modal elements during driving, affecting the driving experience.

[0129] As an example, in step S704, the controller controls the actuator to perform multimodal alarm prompts according to the determined primary modal element and secondary modal element. By comprehensively using the primary modal element and secondary modal element for multimodal alarm prompts, the target alarm prompt information can be clearly expressed, and appropriate original modal elements can be selected for alarm prompts according to different scenarios. For example, during car driving, it can avoid causing great interference to the user, improve the effectiveness and reliability of alarm prompts, and ensure better alarm prompt effects when using multiple original modal elements.

[0130] For example, for different target emergency levels and scenarios of alarm prompt information, appropriate primary modal elements and secondary modal elements can be comprehensively selected for alarm prompts. For example, at the first-level emergency level, that is, when the car has a forward collision warning, the controller then selects text and a prompt sound as recommended items for alarm prompts among the primary modal elements, selects vibration and light as alternative items for alarm prompts among the secondary modal elements, and displays the icon in the secondary modal element as the alarm prompt stipulated by regulations; at the second-level emergency level, that is, when the car is in autonomous driving and the user's hand has not been holding the steering wheel for a long time, the controller then selects voice and dynamic effects as recommended items for alarm prompts among the primary modal elements, selects vibration as an alternative item for alarm prompts among the secondary modal elements, and displays the prompt sound in the primary modal element and the icon in the secondary modal element as the alarm prompt stipulated by regulations; at the third-level emergency level, that is, the reminder when the car's fuel / electricity is low, the controller then selects voice as the recommended item for alarm prompts among the primary modal elements and displays the icon in the secondary modal element as the alarm prompt stipulated by regulations.

[0131] In this embodiment, the controller compares the target score value corresponding to the original modal element with the preset score value; according to the comparison result, it determines the primary modal element for main display and the secondary modal element for alarm prompts with the assistance of the primary modal element. According to the determined different types of original modal elements, when performing alarm prompts, appropriate original modal elements can be selected in combination with the scenario of the alarm prompt information and the target emergency level to perform multimodal alarm prompts for the target alarm prompt information. By comparing the target score value with the preset score value, the accuracy of the alarm prompt information is improved, it is convenient for the user to better distinguish the importance of different modal elements, and the effectiveness and responsiveness of multimodal alarm prompts are also guaranteed, overcoming the shortcoming that a single modal element is not clearly expressed and is chaotic.

[0132] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

[0133] In one embodiment, a controller is provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, it implements the multi-modal alarm prompt method in the above embodiment, for example Figure 1 as shown in S101-S104, or Figures 2 to 7 as shown in [reference], to avoid repetition, it will not be elaborated here.

[0134] In one embodiment, as Figure 8 shown, a vehicle-mounted alarm control system is provided, including an entertainment domain controller, an intelligent driving domain controller, a central controller, and an actuator; the entertainment domain controller is signal-connected to the intelligent driving domain controller and the central controller, and is used to execute the multi-modal alarm prompt method in the above embodiment and send a target control signal to the intelligent driving domain controller and / or the central controller; the intelligent driving domain controller and / or the central controller is used to perform multi-modal alarm prompting on the target alarm prompt information according to the target control signal.

[0135] Among them, the entertainment domain controller (IDC: Internet Data Center) refers to an Internet data center, a device for storing a large amount of data. The intelligent driving domain controller (ADC: Attack Damage Carry) refers to a type of device used to convert continuous signals in analog form into discrete signals in digital form. The central controller (CCU: Communication Control Unit) refers to an interface device between a computer system and a data circuit, used to control all communication channels connected to remote data devices. The target control signal refers to a signal used to control the actuator to execute alarm prompting, specifically a control signal formed based on the target score value corresponding to the original modal element.

[0136] As an example, after receiving the target alarm prompt information, the entertainment domain controller will confirm and analyze the target alarm prompt information, and then the entertainment domain controller sends a target control signal to the intelligent driving domain controller and / or the central controller, so that the intelligent driving domain controller and / or the central controller respectively control the devices communicating with them. The entertainment domain controller can store a large amount of data, so it is convenient to store the content of the target alarm prompt information, ensuring the accuracy and reliability of alarm prompt execution.

[0137] As an example, after receiving the target control signal sent by the entertainment domain controller, the intelligent driving domain controller and / or the central controller respectively control the actuators communicating with them to perform control operations, so that the actuators complete unified multi-modal alarm prompts according to the target control signal. In this example, all three of the entertainment domain controller, the intelligent driving domain controller, and the central controller can use the CNA / CNA FD method for signal transmission to achieve the intercommunication and transmission of information, and can also monitor and control the vehicle state in real time to ensure the safety of the vehicle. In this example, the intelligent driving domain controller and its actuator transmit signals through LVDS, CAN, and LIN, and the central controller and its actuator transmit signals through CAN and LIN. Controlling through the controller and transmitting signals through methods such as CAN and LIN ensure the standardization and convenience of the alarm prompt, avoiding the problem of chaotic alarm prompts.

[0138] In this embodiment, after receiving the target alarm prompt information, the entertainment domain controller will send a target control signal to the intelligent driving domain controller and / or the central controller after analysis, so that the intelligent driving domain controller and / or the central controller control the actuators connected to them, so that the actuators perform multi-modal alarm prompts for the target alarm prompt information. Through the signal transmission between the controllers and between the controller and the actuator, the alarm prompt is standardized, avoiding the problem of chaotic alarm prompts.

[0139] In one embodiment, a vehicle is provided, including the in-vehicle alarm control system in the above embodiment.

[0140] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided in the present application can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0141] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, only the above division of each functional unit and module is used as an example. In actual applications, the above functions can be allocated to different functional units and modules according to needs, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above.

[0142] The above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments or perform equivalent replacements for some of the technical features. These modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention and should all be included in the protection scope of the present invention.

Claims

1. A multimodal alarm prompting method, characterized in that, Including: Obtain at least two original alarm prompt messages; Analyze the urgency level of each of the original alarm prompt messages to determine the target urgency level corresponding to the original alarm prompt message; Based on the target urgency levels corresponding to at least two of the original alarm prompt messages, determine the target alarm prompt message; Perform multimodal alarm prompts for the target alarm prompt message.

2. The multimodal alarm prompting method according to claim 1, wherein The analyzing the urgency level of each of the original alarm prompt messages to determine the target urgency level corresponding to the original alarm prompt message includes: Analyze the urgency level of the original alarm prompt message to determine the first urgency levels corresponding to at least two urgency evaluation dimensions; Based on the first urgency levels corresponding to at least two of the urgency evaluation dimensions, determine the target urgency level corresponding to the original alarm prompt message.

3. The multimodal alarm prompt method according to claim 2, wherein, The determining the target urgency level corresponding to the original alarm prompt message based on the first urgency levels corresponding to at least two of the urgency evaluation dimensions includes: If at least two of the first urgency levels are the first-level urgency level, determine that the target urgency level corresponding to the original alarm prompt message is the first-level urgency level; If there is one first urgency level that is the first-level urgency level, determine that the target urgency level corresponding to the original alarm prompt message is the second-level urgency level; If there is no first urgency level that is the first-level urgency level, determine that the target urgency level corresponding to the original alarm prompt message is the third-level urgency level.

4. The multimodal alarm prompting method according to claim 1, wherein, The determining the target alarm prompt message based on the target urgency levels corresponding to at least two of the original alarm prompt messages includes: Compare the target urgency levels of at least two of the original alarm prompt messages; If the target urgency levels of at least two of the original alarm prompt messages are different, then determine the original alarm prompt message corresponding to the highest-level target urgency level as the target alarm prompt message; If the target urgency levels of at least two of the original alarm prompt messages are the same, then determine the original alarm prompt message corresponding to the alarm prompt message with the most recent alarm time as the target alarm prompt message.

5. The multimodal alarm prompt method according to claim 1, characterized in that, The performing multimodal alarm prompts for the target alarm prompt message includes: Obtain at least two original modal elements corresponding to the target alarm prompt message; Perform modal scoring on at least two of the original modal elements corresponding to the target alarm prompt message to determine the target score values corresponding to at least two of the original modal elements; Based on the target score values corresponding to at least two of the original modal elements, perform multimodal alarm prompts for the target alarm prompt message.

6. The multimodal alarm prompting method according to claim 5, wherein The performing modal scoring on at least two of the original modal elements corresponding to the target alarm prompt message to determine the target score values corresponding to at least two of the original modal elements includes: Perform modal scoring on at least two of the original modal elements corresponding to the target alarm prompt message to obtain the modal score values corresponding to at least two of the original modal elements; Based on the target urgency level corresponding to the target alarm prompt message, determine the target weights corresponding to at least two of the original modal elements; Determine the target score values corresponding to at least two of the original modality elements based on the modality score values corresponding to the at least two original modality elements and the target weights.

7. The multimodal alarm prompt method according to claim 5, wherein The multimodal alarm prompt for the target alarm prompt information based on the target score values corresponding to at least two of the original modality elements includes: Compare the target score value corresponding to the original modality element with a preset score value; If the target score value corresponding to the original modality element is greater than the preset score value, determine the original modality element as the main modality element; If the target score value corresponding to the original modality element is not greater than the preset score value, determine the original modality element as the secondary modality element; Perform multimodal alarm prompt for the target alarm prompt information according to the main modality element and the secondary modality element.

8. A controller, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the multimodal alarm prompt method according to any one of claims 1 to 7.

9. A vehicle-mounted alarm control system, characterized in that, Including: An entertainment domain controller, an intelligent driving domain controller, a central controller, and an actuator; The entertainment domain controller is signal-connected to the intelligent driving domain controller and the central controller, and is configured to execute the multimodal alarm prompt method according to any one of claims 1-7, and send a target control signal to the intelligent driving domain controller and / or the central controller; The intelligent driving domain controller and / or the central controller is configured to perform multimodal alarm prompt for the target alarm prompt information according to the target control signal.

10. A vehicle, characterized in that, Including the vehicle-mounted alarm control system according to claim 9.

Images