Processing method and device for display interface of intelligent cabin, equipment and medium

Abstract

The invention discloses a processing method and device for a display interface of an intelligent cabin, equipment and a medium, and belongs to the technical field of display. According to the method, first information is obtained, and the first information comprises at least one of related information of the intelligent cabin and feature information of a user in the intelligent cabin; the related information comprises operation behavior information of the user on the intelligent cabin, feedback information of the user on the display interface and cabin state information of the intelligent cabin; the feature information comprises at least one of face information and voice information; according to the first information, second information is determined, and the second information comprises at least one of the following items: a first quantitative evaluation result of the display interface determined based on the related information; determining an emotion analysis result of the user based on the feature information; and determining interface information of the display interface according to the second information. The flexibility of the display interface can be improved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a method, device, equipment and medium for processing a display interface of a smart cockpit. Background Art

[0002] As the automotive industry transforms toward intelligence and electrification, smart cockpits have gradually become a key factor in improving driving experience and vehicle competitiveness. Consumers' expectations for cars are no longer limited to basic transportation functions, but are more focused on personalized, intelligent in-car environments and interactive experiences. The requirements for the display interface of smart cockpits are also getting higher and higher.

[0003] However, the display interfaces of many current in-vehicle systems are based on pre-configured information displays, which results in low display flexibility of the display interface of the smart cockpit.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the embodiments of the present application is to provide a method, device, equipment and medium for processing the display interface of a smart cockpit, aiming to solve the technical problem of low display flexibility of the display interface of the smart cockpit in the existing method.

[0006] In a first aspect, an embodiment of the present application provides a method for processing a display interface of a smart cockpit, the method comprising:

[0007] Acquire first information, wherein the first information includes at least one of relevant information of the smart cockpit and characteristic information of a user in the smart cockpit; the relevant information includes operation behavior information of the user on the smart cockpit, feedback information of the user on the display interface, and cockpit state information of the smart cockpit; the characteristic information includes at least one of facial information and voice information;

[0008] Determine second information based on the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information;

[0009] According to the second information, interface information of the display interface is determined.

[0010] In a second aspect, an embodiment of the present application provides a device for processing a display interface, the device comprising:

[0011] an acquisition module, configured to acquire first information, wherein the first information includes at least one of relevant information of the smart cockpit and characteristic information of a user in the smart cockpit; the relevant information includes information on the user's operation behavior on the smart cockpit, feedback information on the display interface by the user, and cockpit state information of the smart cockpit; and the characteristic information includes at least one of facial information and voice information;

[0012] An information determination module is configured to determine second information based on the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information;

[0013] A determination module is used to determine the interface information of the display interface according to the second information.

[0014] In a third aspect, an embodiment of the present application provides a device for processing the display interface of a smart cockpit, the device comprising: a memory, a processor, and a computer processing program stored in the memory and executable on the processor, the computer processing program being configured to implement the steps of the method for processing the display interface of the smart cockpit as described in the first aspect.

[0015] In a fourth aspect, an embodiment of the present application provides a storage medium having a computer processing program stored thereon, and when the computer processing program is executed by a processor, the steps of the method for quantitatively evaluating text display in a smart cockpit as described in the first aspect are implemented.

[0016] The present application proposes a method, device, equipment and medium for processing the display interface of a smart cockpit, by obtaining first information, wherein the first information includes at least one of the relevant information of the smart cockpit and the characteristic information of the user in the smart cockpit; the relevant information includes the user's operation behavior information on the smart cockpit, the user's feedback information on the display interface and the cockpit state information of the smart cockpit; the characteristic information includes at least one of facial information and voice information; then, according to the first information, second information is determined, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; an emotional analysis result of the user determined based on the characteristic information; finally, according to the second information, the interface information of the display interface is determined. The present application obtains the relevant information of the smart cockpit and / or the characteristic information of the user in the smart cockpit, obtains the emotional analysis result using the characteristic information of the user in the smart cockpit, quantitatively evaluates the display interface according to the relevant information of the smart cockpit, and adjusts the interface information such as the layout, content and interaction mode of the display interface according to the quantitative evaluation result and / or the emotional analysis result, so that the dynamic adjustment of the display interface can be realized, thereby improving the flexibility of determining the display interface. At the same time, adjusting the display interface according to the user's sentiment analysis results can improve the personalized display of the display interface and the user's satisfaction with the display of interface information. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flowchart of a method for processing a display interface of a smart cockpit according to an embodiment of the present application;

[0018] Figure 2 This is a schematic diagram of a processing device for a display interface of a smart cockpit according to an embodiment of the present application;

[0019] Figure 3 This is one of the schematic diagrams of a processing device for the display interface of the smart cockpit in an embodiment of the present application;

[0020] Figure 4 This is the second schematic diagram of the processing device of the display interface of the smart cockpit in the embodiment of the present application;

[0021] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0023] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0024] The display method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0025] Reference Figure 1 , Figure 1 This is a flow chart of an embodiment of a method for processing a display interface of a smart cockpit of the present application.

[0026] The embodiment of the present application provides a method for processing a display interface of a smart cockpit. The method for processing a display interface of a smart cockpit is applied to a vehicle. In this embodiment, the method for processing a display interface of a smart cockpit includes the following steps:

[0027] Step 10: Acquire first information, wherein the first information includes at least one of relevant information of the smart cockpit and characteristic information of a user in the smart cockpit; the relevant information includes operation behavior information of the user on the smart cockpit, feedback information of the user on the display interface, and cockpit status information of the smart cockpit; the characteristic information includes at least one of facial information and voice information;

[0028] Step 20: Determine second information based on the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information;

[0029] Step 30: Determine interface information of the display interface according to the second information.

[0030] The embodiment of the present application obtains first information, wherein the first information includes at least one of the relevant information of the smart cockpit and the characteristic information of the user in the smart cockpit; the relevant information includes the user's operation behavior information on the smart cockpit, the user's feedback information on the display interface and the cockpit state information of the smart cockpit; the characteristic information includes at least one of facial information and voice information; then, according to the first information, second information is determined, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; an emotional analysis result of the user determined based on the characteristic information; finally, according to the second information, the interface information of the display interface is determined. The present application obtains the relevant information of the smart cockpit and / or the characteristic information of the user in the smart cockpit, obtains the emotional analysis result using the characteristic information of the user in the smart cockpit, quantitatively evaluates the display interface according to the relevant information of the smart cockpit, and adjusts the interface information such as the layout, content and interaction mode of the display interface according to the quantitative evaluation result and / or the emotional analysis result, so that the dynamic adjustment of the display interface can be realized, thereby improving the flexibility of determining the display interface. At the same time, adjusting the display interface according to the user's sentiment analysis results can improve the personalized display of the display interface and the user's satisfaction with the display of interface information.

[0031] In some embodiments, in the above step 10, the first information may be data collected by the smart cockpit system, which may be initial data or processed data, for further analysis and service provision. The smart cockpit may be an integrated, intelligent driving and riding environment inside the car.

[0032] The relevant information of the smart cockpit may be information related to the function and status of the smart cockpit, which may be information about the user's operating behavior on the smart cockpit, user feedback information on the display interface, cockpit status information of the smart cockpit, text display parameters and reading behavior, etc.

[0033] The characteristic information of the user in the smart cockpit can be the user's unique biological or behavioral characteristics, such as facial information and voice information.

[0034] Operational behavior information includes control operations (control actions performed by users through buttons, touch screens or voice commands, such as adjusting the air conditioner, starting navigation, switching media, etc.), setting adjustments (users' personalized adjustments to seat position, mirror adjustment, audio settings, etc.), and safety operations (such as seat belt usage, door status (open / closed), lighting status, etc.).

[0035] Feedback information can be a user's subjective evaluation of the reading experience of the smart cockpit interface. Cockpit status information includes environmental data (environmental data inside the cockpit, such as temperature, humidity, air quality, etc.), device status (working status of various devices and systems, such as screen brightness, audio volume, working status of the navigation system, etc.), and vehicle status (data related to the vehicle status inside the cockpit, such as vehicle speed, fuel consumption, remaining mileage, etc.).

[0036] The facial information may be the facial features of the user, which is used for the recognition of facial emotions. The voice information may be the voice features of the user, which is used for the recognition of voice emotions.

[0037] For example, the user's operation of adjusting the seat position or setting the air conditioning temperature will be recorded as the user's operational behavior information on the smart cockpit. The user's direct feedback on the display interface of the smart cockpit, such as satisfaction evaluation, will be recorded as the user's feedback information on the display interface. The temperature and humidity detected in the car will be recorded as the cockpit status information of the smart cockpit. When the user smiles inside the vehicle, the user's smiling face is captured by the camera and recorded as facial information. The user's voice commands and feedback are collected through voice recognition technology, and the user's volume level, etc., will be recorded as voice information.

[0038] In some embodiments, in the above step 20, the second information refers to the result obtained by further analysis based on the first information, such as a quantitative evaluation result and a sentiment analysis result. The first quantitative evaluation result refers to a quantitative evaluation of the user display interface, such as a numerical representation of user satisfaction. The sentiment analysis result refers to a score or category obtained by inferring the user's emotional state by analyzing the user's voice, facial expression, etc. The emotional state can be divided into positive emotions and negative emotions. The sentiment analysis result can also include tension, fatigue, excitement, etc.

[0039] When the first information is only relevant information of the smart cockpit, the first quantitative evaluation result is calculated based on the user's operational behavior information on the smart cockpit, the user's feedback information on the display interface and the cockpit status information of the smart cockpit. In this case, the first quantitative result is the second information.

[0040] In the case where the first information is only characteristic information of the user in the smart cockpit, the characteristic information includes at least one item based on the user's facial information and voice information, and facial recognition technology and / or voice analysis technology can be used to identify the user's emotional state, that is, the emotion analysis result. In this case, the emotion analysis result is the second information.

[0041] In the case where the first information includes relevant information of the smart cockpit and characteristic information of the user in the smart cockpit, a first quantitative evaluation result of the display interface is determined based on the relevant information; and a sentiment analysis result of the user is determined based on the characteristic information. The first quantitative evaluation result is corrected according to the sentiment analysis result to obtain a second quantitative evaluation result. In this case, the second quantitative evaluation result is the second information.

[0042] In addition to the above situation, a feasible implementation method of determining the second information according to the second information also includes:

[0043] When the first information is only relevant information of the smart cockpit, the relevant information of the smart cockpit is input into a preset quantitative evaluation model to obtain a first quantitative evaluation result. At this time, the first quantitative result is the second information.

[0044] When the first information is only the relevant information of the smart cockpit, the relevant information of the smart cockpit is calculated and summed according to the weights, and the sum is used as the first quantitative evaluation result. At this time, the first quantitative result is the second information.

[0045] In the case where the first information is only the characteristic information of the users in the smart cockpit, the characteristic information of the users in the smart cockpit is input into a preset sentiment analysis model to obtain a sentiment analysis result. In this case, the sentiment analysis result is the second information.

[0046] In the case where the first information is only the characteristic information of the user in the smart cockpit, the characteristic information of the user in the smart cockpit is input into a preset sentiment analysis algorithm to obtain a sentiment analysis result. In this case, the sentiment analysis result is the second information.

[0047] The second information can be obtained by inputting data into a trained model. Obtain data and preprocess the data. The preprocessing of the data includes data cleaning (removing abnormal data) and feature extraction (extracting relevant features from user feedback), and then input the preprocessed data into the model for training to obtain a trained model, wherein the model is constructed by selecting a suitable machine learning algorithm. Data cleaning and data feature extraction can be designed using programming languages ​​such as Python; the model can be trained using machine learning libraries such as Scikit-Learn or TensorFlow, and a suitable algorithm can be selected for training, such as the support vector machine (SVM) algorithm. At the same time, the processed data can also be divided into 70% training set and 30% test set, and the model can be trained and tuned using the training set. In addition, the model can also use the cross-validation method to evaluate the model performance to ensure the accuracy and generalization ability of the model. For the model, new data can also be collected every quarter, and the model can be retrained and optimized to achieve the effect of regular updates.

[0048] For example, if the user frequently adjusts the brightness or contrast of the display interface, it may mean that the user is not satisfied with the current settings, thus giving a lower quantitative evaluation result. If the user's facial expression shows displeasure, or the tone of voice is frustrated, it may be analyzed that the current user's emotional state is not good.

[0049] In some embodiments, in the above step 30, the interface information of the display interface is determined according to the second information.

[0050] In this embodiment, it should be noted that the display interface may be an interface for user interaction in the smart cockpit, and the display interface may be a display interface of a touch screen, a dashboard display, etc. The interface information may be content presented on the display interface, including text, icons, images, background colors, menu options, etc. The interface information may also be an interface theme.

[0051] When the second information is the first quantitative evaluation result, the interface information of the display interface may be determined according to the first quantitative evaluation result.

[0052] When the second information is a result of sentiment analysis, a preset mapping table is queried according to the sentiment analysis result to obtain target interface information corresponding to the sentiment analysis result; and the interface information of the display interface is adjusted to the target interface information.

[0053] In the case where the second information includes a first quantitative evaluation result of a display interface determined based on relevant information and a sentiment analysis result of a user determined based on feature information, the first quantitative evaluation result is corrected according to the sentiment analysis result to obtain a second quantitative evaluation result; wherein, in the case where the sentiment category of the sentiment analysis result is a positive emotion, the second quantitative evaluation result is better than the first quantitative evaluation result; in the case where the sentiment category of the sentiment analysis result is a negative emotion, the first quantitative evaluation result is better than the second quantitative evaluation result; and the interface information of the display interface is determined according to the second quantitative evaluation result.

[0054] In any of the above three situations, when the second information indicates that the user is dissatisfied with the display interface, third information is obtained, where the third information includes at least one of the needs of the user of the smart cockpit and the driving environment of the smart cockpit; and interface information of the display interface is adjusted according to the third information.

[0055] For example, if it is detected that the user frequently adjusts the volume setting, and the impatience in the user's tone is detected through voice recognition technology, it is obtained that the user is dissatisfied with the current volume control, and then the interface information of the display interface is adjusted, such as adding a more intuitive volume adjustment control. If the first quantitative evaluation result shows that the user's satisfaction with the navigation menu is low, it is necessary to adjust the interface information of the display interface, such as optimizing the navigation interface. If the emotional analysis result shows that the user is nervous, adjusting the interface information of the display interface can be to adjust the interface color to a gentler tone or to replace it with a relaxing theme interface.

[0056] In some implementations, when the second information includes a first quantitative evaluation result of the display interface determined based on the relevant information and a sentiment analysis result of the user determined based on the feature information, the step of determining the interface information of the display interface according to the second information includes:

[0057] Correcting the first quantitative evaluation result according to the sentiment analysis result to obtain a second quantitative evaluation result; wherein, when the sentiment category of the sentiment analysis result is positive sentiment, the second quantitative evaluation result is better than the first quantitative evaluation result; and when the sentiment category of the sentiment analysis result is negative sentiment, the first quantitative evaluation result is better than the second quantitative evaluation result;

[0058] The interface information of the display interface is determined according to the second quantitative evaluation result.

[0059] In this embodiment, when the second information includes a first quantitative evaluation result of the display interface determined based on relevant information and a sentiment analysis result of the user determined based on feature information, the first quantitative evaluation result is corrected according to the sentiment analysis result. If the sentiment analysis result is a positive emotion, the first quantitative evaluation result will be improved to obtain a more positive second quantitative evaluation result. If the sentiment analysis result is a negative emotion, the first quantitative evaluation result will be reduced to obtain a more cautious second quantitative evaluation result. According to the second quantitative evaluation result, the information to be presented on the display interface is determined. By adjusting the first quantitative evaluation result considering the user sentiment analysis result, the user's true satisfaction can be more accurately reflected, thereby improving user satisfaction. Determining the display interface according to the corrected second quantitative evaluation result can better optimize the interface design. At the same time, adjusting the interface information according to the user's negative emotions can help the user calm down, which is conducive to enhancing driving safety.

[0060] In this embodiment, it should be noted that the second quantitative evaluation result refers to a satisfaction score adjusted according to the sentiment analysis result on the basis of the first quantitative evaluation result.

[0061] According to the sentiment analysis result, the first quantitative evaluation result is adjusted to generate a second quantitative evaluation result. In the case of positive emotions, the second quantitative evaluation result is better than the first quantitative evaluation result; in the case of negative emotions, the first quantitative evaluation result is better than the second quantitative evaluation result. According to the second quantitative evaluation result, the information to be presented on the display interface is determined, and the display interface is adjusted in real time to adapt to the user's emotions and satisfaction.

[0062] Exemplarily, the first quantitative evaluation result is adjusted according to the result of the user sentiment analysis. If the user's emotion is positive, the first quantitative evaluation result may be increased by 5% to obtain a more positive second quantitative evaluation result. If the user's emotion is negative, the first quantitative evaluation result may be reduced to 40% of the original to obtain a more cautious second quantitative evaluation result. If the second quantitative evaluation result shows that the user is very satisfied with the display interface, the relevant positive evaluation and recommended functions may be highlighted on the interface. If the second quantitative evaluation result shows that the user is dissatisfied with the display interface, the display interface may be adjusted according to the second quantitative evaluation result to meet the user's needs.

[0063] In some implementations, when the second information is the sentiment analysis result, the step of determining the interface information of the display interface according to the second information includes:

[0064] Querying a preset mapping table according to the sentiment analysis result to obtain target interface information corresponding to the sentiment analysis result;

[0065] The interface information of the display interface is adjusted to the target interface information.

[0066] In this embodiment, when the second information is the result of sentiment analysis, a preset mapping table is queried according to the sentiment analysis result. The mapping table associates different emotional states with specific display interface adjustments to obtain target interface information, and the target interface information is used as the interface information of the display interface. By adjusting the interface information of the display interface, the user's emotional state can be better reflected, and it has emotional adaptability. Moreover, by adjusting the interface information of the display interface to adapt to the user's emotions, the user's satisfaction and acceptance of the smart cockpit system can be improved. At the same time, based on the user's emotional changes, the interface information of the display interface is adjusted in time to improve responsiveness.

[0067] In this embodiment, it should be noted that the mapping table is used to map different emotion analysis results to corresponding display interface adjustment strategies. For example, if the emotion analysis result is fatigue, the corresponding display interface is adjusted to a soothing theme interface; if the emotion analysis result is anger, the corresponding display interface is adjusted to a simple interface layout. The target interface information is determined based on the emotion analysis result and the mapping table. The specific state to which the display interface should be adjusted may include color, layout, prompt information, etc.

[0068] According to the results of sentiment analysis, the interface adjustment strategy that matches the user's current emotional state, that is, the corresponding target interface information, is searched in the preset mapping table. According to the obtained target interface information, the elements of the current display interface are adjusted. The adjusted interface information is updated in real time on the display interface to adapt to the user's emotional state.

[0069] For example, if it is detected that the user is nervous while driving, the display interface adjustment strategy corresponding to the nervous emotion is searched in the mapping table, and the interface color is adjusted to a cool tone to reduce irritation, and some soothing language prompts may be added. Then the display interface is adjusted and updated, the interface background is changed to blue, the number of icons on the screen is reduced, the interface looks simpler, and the prompt message "Please relax, you are doing well!" is displayed on the interface. This relieves the user's nervousness.

[0070] For example, assuming that it is detected that the user is tired while driving, the display interface adjustment strategy corresponding to the nervous emotion is searched in the mapping table, and the soothing theme is determined to be selected, and the interface theme is changed to the soothing theme, thereby quickly responding to the user's emotions.

[0071] In some implementations, when the second information includes the first quantitative evaluation result, the step of determining the interface information of the display interface according to the second information includes:

[0072] Determining display information of the display interface according to the target quantitative evaluation result;

[0073] The target quantitative evaluation result is the first quantitative evaluation result, or the target quantitative evaluation result is obtained by correcting the first quantitative evaluation result.

[0074] In this embodiment, when the second information includes the first quantitative evaluation result, the display information of the display interface is determined according to the target quantitative evaluation result. The target quantitative evaluation result is the first quantitative evaluation result or is obtained by modifying the first quantitative evaluation result. In this way, the display interface can be adjusted according to the user's satisfaction to provide a more personalized and comfortable user experience.

[0075] In this embodiment, it should be noted that the target quantitative evaluation result refers to the final quantitative evaluation result, which may be a corrected quantitative evaluation result or a first quantitative evaluation result that does not need to be corrected. The target quantitative evaluation result is used as a basis for adjusting the display interface.

[0076] According to the target quantitative evaluation results, determine the information that should be displayed on the display interface. The information may include options with high user satisfaction, recommended functions, personalized settings, etc. There are two cases for the target quantitative evaluation results: Case 1, the first quantitative evaluation result of the display interface determined based on relevant information; Case 2, the target quantitative evaluation result is obtained by correcting the first quantitative evaluation result. In Case 2, the following correction methods are included:

[0077] First, the first quantitative evaluation result is corrected according to the sentiment analysis result to obtain a second quantitative evaluation result; wherein, when the sentiment category of the sentiment analysis result is positive emotion, the second quantitative evaluation result is better than the first quantitative evaluation result; when the sentiment category of the sentiment analysis result is negative emotion, the first quantitative evaluation result is better than the second quantitative evaluation result; the second quantitative evaluation result is used as the target quantitative evaluation result.

[0078] Second, the target quantitative evaluation result is obtained by manually correcting the first quantitative evaluation result.

[0079] Third, the first quantitative evaluation result is corrected using the correction parameter set in advance to obtain the target quantitative evaluation result.

[0080] For example, assume that a user detects the following behaviors when using the navigation system of the smart cockpit:

[0081] The user changes route multiple times during navigation.

[0082] Users gave positive feedback after arriving at their destination.

[0083] Based on the above behavior, a first quantitative evaluation result is generated, which is assumed to be 45 points, indicating that the user's overall satisfaction with the navigation system is high. However, the sentiment analysis results show that the user shows some signs of impatience when changing the route, such as faster speaking or tense facial expressions. This may mean that the user is not very satisfied with some aspects of the navigation system. Therefore, the first quantitative evaluation result is revised, and the score is adjusted to 40 points as the target quantitative evaluation result taking into account the user's emotional state. Based on the target quantitative evaluation result, it is determined that the navigation functions with high user satisfaction should be highlighted on the display interface, and some personalized route suggestions should be provided. For example, if the user often chooses a route that avoids the highway, the "avoid highway" option will be recommended on the interface, and this option will be displayed by default the next time the user uses navigation.

[0084] In some implementations, the step of determining the interface information of the display interface according to the second information includes:

[0085] When the second information indicates that the user is dissatisfied with the display interface, obtaining third information, where the third information includes at least one of a demand of the user of the smart cockpit and a driving environment of the smart cockpit;

[0086] According to the third information, the interface information of the display interface is adjusted.

[0087] In this embodiment, when the second information detects that the user is dissatisfied with the current display interface, the third information is collected, and the interface information of the display interface is adjusted according to the third information, so as to improve the user's satisfaction with the smart cockpit. At the same time, the third information includes at least one of the user needs of the smart cockpit and the driving environment of the smart cockpit, and the interface information can be adjusted according to the user's needs, which can enhance the personalized experience. Moreover, the display interface adjustment according to the driving environment helps to reduce driving interference and improve driving safety. In addition, the user's dissatisfaction can be responded to quickly and adjusted effectively, which can enhance the user's trust.

[0088] In this embodiment, it should be noted that the third information refers to the additional information that the system needs to collect when the user is not satisfied with the display interface, including the user's specific needs and the driving environment in which the smart cockpit is located. User needs refer to the user's expectations and preferences for the functions, interface design, and operational convenience of the smart cockpit. The driving environment refers to the external environment in which the smart cockpit is located, including factors such as weather, light, and traffic conditions.

[0089] Identify user dissatisfaction with the display interface by analyzing secondary information, such as users frequently adjusting settings or providing negative feedback. Obtain user demand information through questionnaires, voice interaction, or behavioral analysis, analyze the user demand information, and determine the user's specific expectations for the display interface, such as larger fonts, simpler layouts, etc. Evaluate the impact of the current driving environment on the readability of the display interface and user operations, such as the need for higher contrast under strong light. Based on the analysis results of user needs and / or driving environment, formulate and implement adjustment plans for the display interface, such as increasing font size, adjusting color contrast, optimizing interface layout, etc., to meet user needs and adapt to the driving environment.

[0090] For example, suppose that when a user is driving at night, it is detected through the second information that the user is dissatisfied with the brightness of the display interface and thinks that the interface is too bright, causing eye discomfort. By asking the user for specific needs of the display interface, such as wanting to reduce the brightness or adjust the color mode. Analyze the user's needs and the night driving environment, decide to reduce the brightness of the display interface and adjust it to night mode, use softer colors, and change the background color to dark to reduce stimulation to the user's eyes. After the adjustment, continue to monitor the user's feedback and operation behavior to ensure that the interface adjustment meets the user's needs, and iterate and optimize according to the user's further feedback.

[0091] In some implementations, when the first information includes relevant information of the smart cockpit, the step of determining the second information according to the first information includes:

[0092] The relevant information of the smart cockpit is input into a preset quantitative evaluation model to obtain the first quantitative evaluation result.

[0093] In this embodiment, information related to the smart cockpit is collected and the collected relevant information is input into a preset quantitative evaluation model. The quantitative evaluation model outputs a quantitative score or evaluation result, i.e., a first quantitative evaluation result, based on the input relevant information. The use of a quantitative evaluation model can provide a more objective user satisfaction evaluation and reduce the bias of subjective judgment. The quantitative evaluation model can process data in real time and generate quantitative evaluation results, and can quickly respond to changes in user needs.

[0094] In this embodiment, it should be noted that the preset quantitative evaluation model refers to a pre-set mathematical or statistical model used to process input data and output a quantitative evaluation result.

[0095] The relevant information of the smart cockpit needs to be collected first, and the data needs to be preprocessed. The preprocessing includes data cleaning and feature extraction, so as to remove abnormal data and extract relevant features. The model is trained using the preprocessed data to obtain a trained quantitative evaluation model.

[0096] For example, it is assumed that the smart cockpit system collects the following user operation data:

[0097] The amount of time users spend in the navigation menu.

[0098] How often the user adjusts the volume.

[0099] How often users use certain features.

[0100] Input these data into a preset quantitative evaluation model. The model may consider the following factors:

[0101] How long users spend in a menu may indicate how easy it is to find a function.

[0102] Frequent volume adjustments by users may indicate that the current setup is not intuitive or personalized enough.

[0103] High frequency of usage of certain features may indicate that these features are popular among users.

[0104] The model processes this data through algorithms, which may use weighted average, regression analysis, etc., and finally generates a quantitative score, for example, 70 points, indicating that the user's satisfaction with the current display interface is at a medium level. Analyzing this score, it is found that users spend a long time in the navigation menu, and it may be necessary to improve the layout of the menu or add a search function. Based on these analyses, the display interface can be adjusted, such as optimizing the navigation structure, adding shortcuts, or adjusting the layout of the volume control to improve user satisfaction.

[0105] In some implementations, when the first information includes characteristic information of the user in the smart cockpit, the step of determining the second information according to the first information further includes:

[0106] The characteristic information of the users in the smart cockpit is input into a preset sentiment analysis model to obtain the sentiment analysis result.

[0107] In this embodiment, characteristic information of users in the smart cockpit is collected and input into a preset sentiment analysis model. The sentiment analysis model outputs sentiment analysis results based on the input characteristic information. The sentiment analysis results usually classify the user's emotional state, such as happiness, sadness, anger, surprise, etc. Providing customized services based on the user's emotional state can bring a personalized experience. The sentiment analysis results can help interact with users more naturally and improve the naturalness and efficiency of interaction.

[0108] In this embodiment, it should be noted that the preset sentiment analysis model refers to a pre-set algorithm model, which is specially designed to analyze the user's characteristic information and identify the user's emotional state, such as happiness, sadness, anger, etc.

[0109] The characteristic information of users in the smart cockpit needs to obtain the user's emotional state through facial expressions and / or voice intonation, and then input into the sentiment analysis model to achieve the purpose of training the sentiment analysis model.

[0110] For example, suppose a user is driving a smart cockpit car, and the camera captures the user's facial expressions of frowning and drooping mouth corners, while the microphone records the high pitch and fast speech rate of the user's voice. The user's facial expression and voice information will be collected and input into the sentiment analysis model, which determines that the user may be in an angry or anxious emotional state and outputs this result.

[0111] Reference Figure 2 The embodiment of the method for processing the display interface of the smart cockpit of the present application provides a device 200 for processing the display interface of the smart cockpit, and the device includes:

[0112] The acquisition module 201 is used to acquire first information, wherein the first information includes at least one of the relevant information of the smart cockpit and the characteristic information of the user in the smart cockpit; the relevant information includes the operation behavior information of the user on the smart cockpit, the feedback information of the user on the display interface and the cockpit state information of the smart cockpit; the characteristic information includes at least one of the facial information and the voice information;

[0113] The information determination module 202 determines second information according to the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information;

[0114] The determination module 203 is used to determine the interface information of the display interface according to the second information. Furthermore, the determination module 203 is also used to: modify the first quantitative evaluation result according to the sentiment analysis result to obtain a second quantitative evaluation result; wherein, when the sentiment category of the sentiment analysis result is positive sentiment, the second quantitative evaluation result is better than the first quantitative evaluation result; when the sentiment category of the sentiment analysis result is negative sentiment, the first quantitative evaluation result is better than the second quantitative evaluation result;

[0115] The interface information of the display interface is determined according to the second quantitative evaluation result.

[0116] Furthermore, the determination module 203 is further used to: query a preset mapping table according to the sentiment analysis result to obtain target interface information corresponding to the sentiment analysis result;

[0117] The interface information of the display interface is adjusted to the target interface information.

[0118] Furthermore, the determination module 203 is also used to: determine the display information of the display interface according to the target quantitative evaluation result; wherein the target quantitative evaluation result is the first quantitative evaluation result, or the target quantitative evaluation result is obtained by correcting the first quantitative evaluation result.

[0119] Furthermore, the determination module 203 is further configured to: when the second information indicates that the user is not satisfied with the display interface, obtain third information, wherein the third information includes at least one of a demand of the user of the smart cockpit and a driving environment of the smart cockpit;

[0120] According to the third information, the interface information of the display interface is adjusted.

[0121] Furthermore, the determination module 203 is further configured to: input the relevant information of the smart cockpit into a preset quantitative evaluation model to obtain the first quantitative evaluation result.

[0122] Furthermore, the determination module 203 is further used to: input the characteristic information of the users in the smart cockpit into a preset sentiment analysis model to obtain the sentiment analysis result.

[0123] The processing device of the display interface of the smart cockpit in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0124] The processing device of the display interface of the smart cockpit in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0125] The processing device for the display interface of the smart cockpit provided in the embodiment of the present application can realize Figure 1 The various processes implemented by the method embodiment can achieve the same technical effect, and to avoid repetition, they will not be described here.

[0126] Alternatively, if Figure 3 As shown, an embodiment of the present application further provides an electronic device 300, including a processor 301 and a memory 302, wherein the memory 302 stores programs or instructions that can be executed on the processor 301, and when the program or instructions are executed by the processor 301, the various steps of the above-mentioned display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0127] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0128] Figure 4 A schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0129] The electronic device 400 includes but is not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display unit 406, a user input unit 407, an interface unit 404, a memory 409, and a processor 410.

[0130] Those skilled in the art will appreciate that the electronic device 400 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 410 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0131] The processor 410 is used for:

[0132] Acquire first information, wherein the first information includes at least one of relevant information of the smart cockpit and characteristic information of a user in the smart cockpit; the relevant information includes operation behavior information of the user on the smart cockpit, feedback information of the user on the display interface, and cockpit state information of the smart cockpit; the characteristic information includes at least one of facial information and voice information;

[0133] Determine second information based on the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information;

[0134] According to the second information, interface information of the display interface is determined.

[0135] In some implementations, the processor 410 is further configured to:

[0136] Correcting the first quantitative evaluation result according to the sentiment analysis result to obtain a second quantitative evaluation result; wherein, when the sentiment category of the sentiment analysis result is positive sentiment, the second quantitative evaluation result is better than the first quantitative evaluation result; and when the sentiment category of the sentiment analysis result is negative sentiment, the first quantitative evaluation result is better than the second quantitative evaluation result;

[0137] The interface information of the display interface is determined according to the second quantitative evaluation result.

[0138] In some implementations, the processor 410 is further configured to:

[0139] Querying a preset mapping table according to the sentiment analysis result to obtain target interface information corresponding to the sentiment analysis result;

[0140] The interface information of the display interface is adjusted to the target interface information.

[0141] In some implementations, the processor 410 is further configured to:

[0142] Determining display information of the display interface according to the target quantitative evaluation result;

[0143] The target quantitative evaluation result is the first quantitative evaluation result, or the target quantitative evaluation result is obtained by correcting the first quantitative evaluation result.

[0144] In some implementations, the processor 410 is further configured to:

[0145] When the second information indicates that the user is dissatisfied with the display interface, obtaining third information, where the third information includes at least one of a demand of the user of the smart cockpit and a driving environment of the smart cockpit;

[0146] According to the third information, the interface information of the display interface is adjusted.

[0147] In some implementations, the processor 410 is further configured to:

[0148] The relevant information of the smart cockpit is input into a preset quantitative evaluation model to obtain the first quantitative evaluation result.

[0149] In some implementations, the processor 410 is further configured to:

[0150] The characteristic information of the users in the smart cockpit is input into a preset sentiment analysis model to obtain the sentiment analysis result.

[0151] It should be understood that in the embodiment of the present application, the input unit 404 may include a graphics processor (Graphics Processing Unit, GPU) 4041 and a microphone 4042, and the graphics processor 4041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 407 includes a touch panel 4071 and at least one of other input devices 4072. The touch panel 4071 is also called a touch screen. The touch panel 4071 may include two parts: a touch detection device and a touch controller. Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0152] The memory 409 can be used to store software programs and various data. The memory 409 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 409 may include a volatile memory or a non-volatile memory, or the memory 409 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 409 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0153] The processor 410 may include one or more processing units; optionally, the processor 410 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 410.

[0154] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0155] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0156] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or system including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0157] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0158] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0159] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A method for processing a display interface of a smart cockpit, characterized in that: The method comprises the following steps: Acquire first information, wherein the first information includes at least one of relevant information of the smart cockpit and characteristic information of a user in the smart cockpit; the relevant information includes operation behavior information of the user on the smart cockpit, feedback information of the user on the display interface, and cockpit state information of the smart cockpit; the characteristic information includes at least one of facial information and voice information; Determine second information based on the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information; According to the second information, interface information of the display interface is determined.

2. The method according to claim 1, characterized in that In a case where the second information includes a first quantitative evaluation result of the display interface determined based on the relevant information and a sentiment analysis result of the user determined based on the feature information, the step of determining the interface information of the display interface according to the second information includes: Correcting the first quantitative evaluation result according to the sentiment analysis result to obtain a second quantitative evaluation result; wherein, when the sentiment category of the sentiment analysis result is positive sentiment, the second quantitative evaluation result is better than the first quantitative evaluation result; and when the sentiment category of the sentiment analysis result is negative sentiment, the first quantitative evaluation result is better than the second quantitative evaluation result; The interface information of the display interface is determined according to the second quantitative evaluation result.

3. The method according to claim 1, characterized in that In the case where the second information is the emotion analysis result, the step of determining the interface information of the display interface according to the second information includes: Querying a preset mapping table according to the sentiment analysis result to obtain target interface information corresponding to the sentiment analysis result; The interface information of the display interface is adjusted to the target interface information.

4. The method according to claim 1, characterized in that In the case where the second information includes the first quantitative evaluation result, the step of determining the interface information of the display interface according to the second information includes: Determining display information of the display interface according to the target quantitative evaluation result; The target quantitative evaluation result is the first quantitative evaluation result, or the target quantitative evaluation result is obtained by correcting the first quantitative evaluation result.

5. The method according to claim 1, characterized in that The step of determining the interface information of the display interface according to the second information includes: When the second information indicates that the user is dissatisfied with the display interface, obtaining third information, where the third information includes at least one of a demand of the user of the smart cockpit and a driving environment of the smart cockpit; According to the third information, the interface information of the display interface is adjusted.

6. The method according to claim 1, characterized in that In the case where the first information includes relevant information of the smart cockpit, the step of determining the second information according to the first information includes: The relevant information of the smart cockpit is input into a preset quantitative evaluation model to obtain the first quantitative evaluation result.

7. The method according to claim 1, characterized in that In the case where the first information includes characteristic information of the user in the smart cockpit, the step of determining the second information according to the first information further includes: The characteristic information of the users in the smart cockpit is input into a preset sentiment analysis model to obtain the sentiment analysis result.

8. A processing device for a display interface of a smart cockpit, characterized in that: The device comprises: an acquisition module, configured to acquire first information, wherein the first information includes at least one of relevant information of the smart cockpit and characteristic information of a user in the smart cockpit; the relevant information includes information on the user's operation behavior on the smart cockpit, feedback information on the display interface by the user, and cockpit state information of the smart cockpit; the characteristic information includes at least one of facial information and voice information; An information determination module is configured to determine second information based on the first information, wherein the second information includes at least one of the following: a first quantitative evaluation result of the display interface determined based on the relevant information; a sentiment analysis result of the user determined based on the feature information; A determination module is used to determine the interface information of the display interface according to the second information.

9. A processing device for a display interface of a smart cockpit, characterized in that: The device includes: a memory, a processor, and a computer processing program stored in the memory and executable on the processor, wherein the computer processing program is configured to implement the steps of the method for processing the display interface of the smart cockpit as described in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a computer processing program, and when the computer processing program is executed by the processor, the steps of the method for processing the display interface of the smart cockpit as described in any one of claims 1 to 7 are implemented.

Images