LUI and GUI method and system based on emotion module

Abstract

The invention relates to the field of modern man-machine interaction, in particular to an LUI and GUI method and system based on an emotion module. According to the technical scheme, the LUI and GUI method and system based on the emotion module comprise a dynamic GUI generation and adaptation module; compared with a traditional GUI system which generally depends on a preset interface design and a fixed interaction mode when interacting with a user and lacks active perception and active response ability to the emotion of the user, due to the defect, the user experience is not personalized enough, dynamic adjustment cannot be carried out according to the instant emotion state of the user, and the user experience is poor. According to the LUI and GUI system based on the emotion module, the language user interface is introduced to interact with the user, so that the defects in the prior art are overcome, the LUI can have a dialogue with the user through a natural language processing technology, and the system can call a dialogue management function by analyzing the emotion of the user, so that a response and interaction page conforming to the current emotion of the user is generated.

Description

Technical Field

[0001] The present invention relates to the field of modern human-computer interaction, and in particular to a LUI and GUI method and system based on an emotion module. Background Art

[0002] In the field of modern human-computer interaction, graphical user interfaces have become the main way of interaction between users and software systems. However, traditional GUIs usually only rely on preset interface designs and fixed interaction modes when interacting with users, and lack the ability to actively perceive and respond to user emotions.

[0003] Existing LUI and GUI systems based on emotion modules usually only rely on preset interface designs and fixed interaction modes when interacting with users, and lack the ability to actively perceive and respond to user emotions. This defect leads to an insufficiently personalized user experience and the inability to dynamically adjust according to the user's immediate emotional state.

[0004] In response to the problem that the existing LUI and GUI systems based on emotion modules cannot be dynamically adjusted according to the user's immediate emotional state, this LUI and GUI system based on emotion modules introduces a language user interface to interact with users, combined with advanced emotion perception technology to make up for the deficiencies in existing technologies. LUI can communicate with users through natural language processing technology, and perceive the user's emotional state in the process. By analyzing the user's emotions, the system can call the dialogue management function and perform in-depth analysis in combination with the context, thereby generating responses and interactive pages that are in line with the user's current emotions. Summary of the invention

[0005] In order to overcome the existing LUI and GUI systems based on emotion modules, when interacting with users, they usually only rely on preset interface designs and fixed interaction modes, lacking the ability to actively perceive and respond to user emotions. This defect leads to the user experience being not personalized enough and unable to be dynamically adjusted according to the user's immediate emotional state.

[0006] The technical solution of the present invention is: a LUI and GUI method based on an emotion module, including the following methods:

[0007] S11: first interact with the user through the LUI to collect information input by the customer;

[0008] S12: Perceive user emotions through sentiment analysis technology;

[0009] S13: After the emotion is perceived, the system analyzes the user's current emotion;

[0010] S14: The system calls the dialogue management module and performs in-depth analysis based on the context of the user input;

[0011] S15: Based on the results of sentiment analysis, the system dynamically adjusts the design and functionality of the GUI;

[0012] S16: The system generates an interactive page suitable for the current user's mood to ensure that the user can get the best user experience in different emotional states.

[0013] Preferably, when using LUI to interact with a user, the following method is included:

[0014] S21: Starting the system and receiving a user's natural language input through a microphone or a text input box;

[0015] S22: converting the voice input into text using voice recognition technology, or directly processing the text input;

[0016] S23: LUI engages in conversation with users and captures emotional clues in the conversation.

[0017] Preferably, when sensing the user's emotions, the following method is included:

[0018] S31: Using sentiment analysis technology to process user input information captured by LUI in real time;

[0019] S32: Classify user emotions using machine learning models based on multi-dimensional information such as voice intonation, vocabulary selection, and text content.

[0020] Preferably, when analyzing user emotions, the following method is included:

[0021] S41: Combine the user's historical interaction data and the current conversation context to conduct an in-depth analysis of the user's current emotions;

[0022] S42: Understand the underlying reasons and needs behind user emotions through sentiment analysis models.

[0023] Preferably, when the dialog management function is called, the following method is included:

[0024] S51: The system calls the dialogue management module to perform in-depth analysis based on the user's emotions and current context;

[0025] S52: The dialogue management module generates an appropriate response strategy and prepares for the next step of interaction with the user.

[0026] Preferably, when generating a GUI for active response, the following method is included:

[0027] S61: Based on the result of the sentiment analysis, the system determines the GUI elements that need to be adjusted;

[0028] S62: Dynamically adjust the design and functionality of the GUI to ensure that the interface not only visually matches the user's emotions, but also provides interactive options that better meet the user's needs;

[0029] S63: Update the GUI in real time to ensure that users can get the best experience in different emotional states.

[0030] A LUI and GUI system based on an emotion module, comprising:

[0031] Emotion perception module: used to perceive and identify the user's emotional state in real time;

[0032] Dialogue management and context analysis module: used to receive the dialogue content between LUI and users;

[0033] Dynamic GUI generation and adaptation module: used to make real-time adjustments based on the data provided by the emotion perception module and the response strategy generated by the dialogue management module.

[0034] Preferably, the emotion perception module is used to utilize advanced emotion analysis technology to perceive and identify the user's emotional state in real time, and can extract emotion features from the user's voice intonation, vocabulary selection, and text content multi-dimensional information. At the same time, by analyzing the extracted emotion features, the emotion perception module classifies the user's emotions into a variety of different emotional states, and transmits the identified emotional state data to subsequent modules as the basis for adjusting the interface and interaction.

[0035] Preferably, the dialogue management and context analysis module is responsible for receiving the dialogue content between the LUI and the user, and generating a suitable response strategy based on the user's current emotional state. The dialogue management module combines the user's historical interaction data and the context information of the current dialogue to perform in-depth analysis to understand the user's intentions and needs, and then responds in a way that matches the user's emotions and current situation.

[0036] Preferably, the dynamic GUI generation and adaptation module is used to adjust the design and function of the GUI in real time based on the data provided by the emotion perception module and the response strategy generated by the dialogue management module. The adjustment content includes interface color, layout and button prompts to ensure that users can get the best user experience in different emotional states.

[0037] Preferably, by closely integrating LUI with GUI, through natural language dialogue and emotion analysis, the system can generate a response that is more in line with the user's current situation. At the same time, the system can perceive the user's emotional changes in real time, and adjust the interface and adapt functions accordingly, so that users can get the best interactive experience in different emotional states.

[0038] Beneficial effects of the present invention:

[0039] 1. Compared with LUI and GUI systems based on emotion modules, when interacting with users, they usually only rely on preset interface designs and fixed interaction modes, and lack the ability to actively perceive and respond to user emotions. This defect leads to insufficient personalization of user experience and the inability to dynamically adjust according to the user's immediate emotional state. The LUI and GUI system based on emotion modules introduces a language user interface to interact with users and combines advanced emotion perception technology to make up for the deficiencies in existing technologies. LUI can communicate with users through natural language processing technology and perceive the user's emotional state in the process. Through the analysis of user emotions, the system can call the dialogue management function and conduct in-depth analysis in combination with the context to generate responses and interaction pages that meet the user's current emotions.

[0040] 2. By closely integrating LUI with GUI, through natural language dialogue and sentiment analysis, the system can generate responses that are more in line with the user's current situation. At the same time, the system can perceive the user's emotional changes in real time, and adjust the interface and adapt functions accordingly, so that users can get the best interactive experience in different emotional states. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 What is shown is a schematic diagram of the workflow of an LUI and GUI method based on an emotion module of the present invention;

[0042] Figure 2 What is shown is a schematic diagram of the LUI and GUI method based on the emotion module and the system LUI and user interaction process of the present invention;

[0043] Figure 3 What is shown is a schematic diagram of a GUI active response flow of a LUI and GUI method based on an emotion module of the present invention;

[0044] Figure 4 What is shown is a schematic diagram of the workflow of an LUI and GUI system based on an emotion module of the present invention. DETAILED DESCRIPTION

[0045] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0046] See also Figure 1-4 The present invention provides an embodiment: a LUI and GUI method based on an emotion module, including the following methods:

[0047] S11: first interact with the user through the LUI to collect information input by the customer;

[0048] S12: Perceive user emotions through sentiment analysis technology;

[0049] S13: After the emotion is perceived, the system analyzes the user's current emotion;

[0050] S14: The system calls the dialogue management module and performs in-depth analysis based on the context of the user input;

[0051] S15: Based on the results of sentiment analysis, the system dynamically adjusts the design and functionality of the GUI;

[0052] S16: The system generates an interactive page suitable for the current user's mood to ensure that the user can get the best user experience in different emotional states.

[0053] Preferably, when using LUI to interact with a user, the following method is included:

[0054] S21: Starting the system and receiving a user's natural language input through a microphone or a text input box;

[0055] S22: converting the voice input into text using voice recognition technology, or directly processing the text input;

[0056] S23: LUI engages in conversation with users and captures emotional clues in the conversation.

[0057] Preferably, when sensing the user's emotions, the following method is included:

[0058] S31: Using sentiment analysis technology to process user input information captured by LUI in real time;

[0059] S32: Classify user emotions using machine learning models based on multi-dimensional information such as voice intonation, vocabulary selection, and text content.

[0060] Preferably, when analyzing user emotions, the following method is included:

[0061] S41: Combine the user's historical interaction data and the current conversation context to conduct an in-depth analysis of the user's current emotions;

[0062] S42: Understand the underlying reasons and needs behind user emotions through sentiment analysis models.

[0063] Preferably, when the dialog management function is called, the following method is included:

[0064] S51: The system calls the dialogue management module to perform in-depth analysis based on the user's emotions and current context;

[0065] S52: The dialogue management module generates an appropriate response strategy and prepares for the next step of interaction with the user.

[0066] Preferably, when generating a GUI for active response, the following method is included:

[0067] S61: Based on the result of the sentiment analysis, the system determines the GUI elements that need to be adjusted;

[0068] S62: Dynamically adjust the design and functionality of the GUI to ensure that the interface not only visually matches the user's emotions, but also provides interactive options that better meet the user's needs;

[0069] S63: Update the GUI in real time to ensure that users can get the best experience in different emotional states.

[0070] A LUI and GUI system based on an emotion module, comprising:

[0071] Emotion perception module: used to perceive and identify the user's emotional state in real time;

[0072] Dialogue management and context analysis module: used to receive the dialogue content between LUI and users;

[0073] Dynamic GUI generation and adaptation module: used to make real-time adjustments based on the data provided by the emotion perception module and the response strategy generated by the dialogue management module.

[0074] Preferably, the emotion perception module is used to utilize advanced emotion analysis technology to perceive and identify the user's emotional state in real time, and can extract emotion features from the user's voice intonation, vocabulary selection, and text content multi-dimensional information. At the same time, by analyzing the extracted emotion features, the emotion perception module classifies the user's emotions into a variety of different emotional states, and transmits the identified emotional state data to subsequent modules as the basis for adjusting the interface and interaction.

[0075] Preferably, the dialogue management and context analysis module is responsible for receiving the dialogue content between the LUI and the user, and generating a suitable response strategy based on the user's current emotional state. The dialogue management module combines the user's historical interaction data and the context information of the current dialogue to perform in-depth analysis to understand the user's intentions and needs, and then responds in a way that matches the user's emotions and current situation.

[0076] Preferably, the dynamic GUI generation and adaptation module is used to adjust the design and function of the GUI in real time based on the data provided by the emotion perception module and the response strategy generated by the dialogue management module. The adjustment content includes interface color, layout and button prompts to ensure that users can get the best user experience in different emotional states.

[0077] Preferably, by closely integrating LUI with GUI, through natural language dialogue and emotion analysis, the system can generate a response that is more in line with the user's current situation. At the same time, the system can perceive the user's emotional changes in real time, and adjust the interface and adapt functions accordingly, so that users can get the best interactive experience in different emotional states.

[0078] The embodiments of the present invention are described in detail above with reference to the accompanying drawings, but the present invention is not limited to the above embodiments, and various changes can be made within the knowledge scope of those skilled in the art without departing from the spirit of the present invention.

Claims

1. A LUI and GUI method based on an emotion module; characterized in that: The following methods are included: S11: first interact with the user through the LUI to collect information input by the customer; S12: Perceive user emotions through sentiment analysis technology; S13: After the emotion is perceived, the system analyzes the user's current emotion; S14: The system calls the dialogue management module and performs in-depth analysis based on the context of the user input; S15: Based on the results of sentiment analysis, the system dynamically adjusts the design and functionality of the GUI; S16: The system generates an interactive page suitable for the current user's mood to ensure that the user can get the best user experience in different emotional states.

2. The LUI and GUI method based on the emotion module according to claim 1, characterized in that: When using LUI to interact with users, include the following methods: S21: Starting the system and receiving a user's natural language input through a microphone or a text input box; S22: converting the voice input into text using voice recognition technology, or directly processing the text input; S23: LUI engages in conversation with users and captures emotional clues in the conversation.

3. The LUI and GUI method based on the emotion module according to claim 1, characterized in that: When perceiving user emotions, the following methods are included: S31: Using sentiment analysis technology to process user input information captured by LUI in real time; S32: Classify user emotions using machine learning models based on multi-dimensional information such as voice intonation, vocabulary selection, and text content.

4. The LUI and GUI method based on the emotion module according to claim 1, characterized in that: When analyzing user sentiment, the following methods are included: S41: Combine the user's historical interaction data and the current conversation context to conduct an in-depth analysis of the user's current emotions; S42: Understand the underlying reasons and needs behind user emotions through sentiment analysis models.

5. The LUI and GUI method based on the emotion module according to claim 1, characterized in that: When calling the dialogue management function, the following methods are included: S51: The system calls the dialogue management module to perform in-depth analysis based on the user's emotions and current context; S52: The dialogue management module generates an appropriate response strategy and prepares for the next step of interaction with the user.

6. The LUI and GUI method based on the emotion module according to claim 1, characterized in that: When generating an active response GUI, include the following methods: S61: Based on the result of the sentiment analysis, the system determines the GUI elements that need to be adjusted; S62: Dynamically adjust the design and functionality of the GUI to ensure that the interface not only visually matches the user's emotions, but also provides interactive options that better meet the user's needs; S63: Update the GUI in real time to ensure that users can get the best experience in different emotional states.

7. A LUI and GUI system based on an emotion module, characterized in that: Included are: Emotion perception module: used to perceive and identify the user's emotional state in real time; Dialogue management and context analysis module: used to receive the dialogue content between LUI and users; Dynamic GUI generation and adaptation module: used to make real-time adjustments based on the data provided by the emotion perception module and the response strategy generated by the dialogue management module.

8. The LUI and GUI system based on the emotion module according to claim 7, characterized in that: The emotion perception module uses advanced emotion analysis technology to perceive and identify the user's emotional state in real time. It can extract emotional features from the user's voice intonation, vocabulary selection and text content multi-dimensional information. At the same time, by analyzing the extracted emotional features, the emotion perception module classifies the user's emotions into a variety of different emotional states, and transmits the identified emotional state data to subsequent modules as the basis for adjusting the interface and interaction.

9. The LUI and GUI system based on the emotion module according to claim 7, characterized in that: The dialogue management and context analysis module is responsible for receiving the dialogue content between the LUI and the user, and generating a suitable response strategy based on the user's current emotional state. The dialogue management module combines the user's historical interaction data and the context information of the current dialogue to conduct in-depth analysis to understand the user's intentions and needs, and then responds in a way that matches the user's emotions and current situation.

10. The LUI and GUI system based on the emotion module according to claim 7, characterized in that: The dynamic GUI generation and adaptation module is used to adjust the design and function of the GUI in real time based on the data provided by the emotion perception module and the response strategy generated by the dialogue management module. The adjustment content includes interface color, layout and button prompts to ensure that users can get the best user experience in different emotional states.

Images