Intelligent customer lifecycle management (AiCRM) method and system

Through multimodal data collection and fusion analysis, the problems of data uniformity and insufficient dynamic tracking capabilities in emotion recognition in customer relationship management systems have been solved, and comprehensive quantitative assessment of customers' emotional states and automatic triggering of personalized service strategies have been achieved, thereby improving the accuracy and timeliness of customer service.

CN120494834BActive Publication Date: 2025-10-14BEIJING RONGZHI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510580779.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-05-07
Publication Date
2025-10-14
Estimated Expiration
2045-05-07

AI Technical Summary

Technical Problem

Existing customer relationship management systems have a single data source and limited analysis dimensions in terms of emotion recognition, making it difficult to fully and accurately capture the true emotional state of customers. They lack the ability to dynamically track changes in customer emotions, resulting in delayed adjustments to service strategies.

Method used

Through multimodal data collection and fusion analysis, we obtain voice call records, real-time facial expression images and text feedback data, perform semantic analysis and dynamic feature recognition, generate a set of customer emotional features, dynamically update the multimodal customer emotion database, use the emotion computing model to generate emotion scores, and generate personalized service strategy adjustment information when the emotion score is lower than the baseline.

Benefits of technology

It achieves comprehensive quantitative assessment and dynamic tracking of customers' emotional states, improves the accuracy and timeliness of emotion recognition, can automatically generate personalized service strategies, and improves the accuracy and timeliness of customer service.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120494834B_ABST
    Figure CN120494834B_ABST
Patent Text Reader

Abstract

The application relates to the technical field of artificial intelligence customer service, and provides an intelligent customer life cycle management AiCRM method and system, which are used for solving the problems of low customer service accuracy and poor response timeliness in the prior art. In the application, the method comprises the following steps: in the interaction process between a target customer and an enterprise, customer voice, expression and text data are acquired, multi-modal sentiment analysis is performed, and a customer sentiment feature set is generated; a customer sentiment evolution graph is dynamically updated based on the customer sentiment feature set, accurate customer sentiment scores are generated by combining historical data and real-time interaction information and using a sentiment calculation model; and when the score is lower than a preset baseline, a personalized service strategy adjustment scheme matched with the current emotional state of the customer and the historical change trend is automatically generated by the system. The application improves the customer service accuracy and response timeliness.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence customer service technology, and in particular to an intelligent customer lifecycle management AiCRM method and system. Background Art

[0002] In the customer service sector, companies need to accurately identify customer emotions in real time and dynamically adjust service strategies based on historical interaction data to improve customer satisfaction and loyalty. Traditional manual analysis is inefficient and difficult to quantify emotional trends. Therefore, an intelligent approach is urgently needed to achieve multimodal emotion fusion analysis and automated decision-making.

[0003] Currently, there is a customer relationship management system based on text sentiment analysis, which uses natural language processing technology to extract emotional tendencies in customer service conversations and combines it with a simple rule engine to generate service recommendations.

[0004] This solution relies only on single text data and ignores multi-dimensional emotional information such as voice intonation and facial expressions, resulting in one-sided emotional judgment; at the same time, the rule engine lacks modeling of the customer's historical emotional evolution trends, and the strategy adjustment is rigid and difficult to adapt to personalized needs. Summary of the Invention

[0005] This application provides an intelligent customer lifecycle management AiCRM method and system to solve the problems of low customer service accuracy and poor response timeliness in the existing technology.

[0006] In a first aspect, the present application provides an intelligent customer lifecycle management AiCRM method, comprising:

[0007] During the interaction between target customers and enterprises, obtain target customers' voice call records, real-time facial expression images and text feedback data;

[0008] Performing semantic analysis on the voice call records and the text feedback data, performing dynamic feature recognition on the facial expression images, and cross-modally correlating the semantic analysis results with the dynamic feature recognition results to generate a customer emotion feature set;

[0009] Based on the customer emotion feature set, dynamically updating the customer emotion evolution graph in the preset multimodal customer emotion database;

[0010] Based on the updated customer emotion evolution graph and the customer emotion feature set, a sentiment computing model is used to generate a target customer emotion score for the target customer;

[0011] When the customer's emotional score is lower than the preset service baseline, service strategy adjustment information is generated to match the customer's current emotional state and historical emotional change trends to achieve intelligent customer lifecycle management AiCRM.

[0012] Optionally, the target customer sentiment score of the target customer is generated by using a sentiment computing model based on the updated customer sentiment evolution map and the customer sentiment feature set, comprising:

[0013] The updated customer sentiment evolution map is divided into a plurality of historical sentiment segments according to a preset time window, and the distribution density of the sentiment polarity label corresponding to the voice call record, the real-time facial expression image and the text feedback data in each historical sentiment segment is extracted;

[0014] The current sentiment polarity label in the customer sentiment feature set is discretely marked;

[0015] Based on the distribution density of the sentiment polarity label, the target correlation strength value between the current sentiment polarity label and each historical sentiment segment is calculated;

[0016] According to the target correlation strength value, each historical sentiment segment is assigned a weight value, and the weight value and the discretely marked result are linearly superimposed to generate a sentiment state fusion vector;

[0017] The sentiment state fusion vector is input into a sentiment computing model to output a target customer sentiment score.

[0018] Optionally, the sentiment state fusion vector is input into a sentiment computing model to output a target customer sentiment score, comprising:

[0019] The sentiment state fusion vector is divided into a historical sentiment weight component and a current sentiment label component according to a preset dimension by a sentiment computing model;

[0020] The historical sentiment weight component is processed hierarchically, and the superposition coefficient of each level is adjusted according to the target correlation strength value in each processing level;

[0021] The adjusted superposition coefficient and the current sentiment label component are interleaved and spliced to generate a hierarchical fusion signal;

[0022] The difference in proportion between the historical sentiment weight component and the current sentiment label component in the hierarchical fusion signal of each level is compared layer by layer by using the dynamic aggregation node of the sentiment computing model to generate a hierarchical contribution degree parameter;

[0023] According to the hierarchical contribution degree parameter, the transmission path in the dynamic aggregation node is selectively activated;

[0024] The output signal of the activated transmission path is scalar compressed to generate an initial customer sentiment score;

[0025] According to a statistical deviation of the sentiment polarity label distribution density, the initial customer sentiment score is bound and a target customer sentiment score is output.

[0026] Optionally, the dynamic aggregation node using the sentiment calculation model compares the proportion difference between the historical sentiment weight component and the current sentiment label component in the hierarchical fusion signal of each level layer by layer to generate a level contribution degree parameter, including:

[0027] The hierarchical fusion signal of each level is divided into a historical signal segment and a current signal segment according to a preset proportion;

[0028] The historical signal segment and the current signal segment are respectively subjected to amplitude accumulation calculation to obtain a historical cumulative amplitude and a current cumulative amplitude;

[0029] A level difference amplitude is generated according to the absolute value of the difference between the historical cumulative amplitude and the current cumulative amplitude;

[0030] The level difference amplitude is compared with a preset difference threshold value, and if the level difference amplitude exceeds the preset difference threshold value, a difference accumulator corresponding to the level is activated;

[0031] The signal output by the activated difference accumulator is subjected to directional marking;

[0032] The signal output by the difference accumulator in the same level is subjected to polarity weighting based on the directional marking result to generate a level difference index;

[0033] The level difference indexes of the levels are subjected to sliding window accumulation according to a preset aggregation rule to generate a level contribution degree parameter.

[0034] Optionally, the target association strength value between the current sentiment polarity label and each historical sentiment segment is calculated based on the sentiment polarity label distribution density, including:

[0035] The sentiment polarity labels in each historical sentiment segment are classified and counted according to a preset emotion category to generate a sentiment category distribution histogram of each historical sentiment segment;

[0036] The current sentiment polarity label is subjected to category matching to determine the emotion category to which the current sentiment polarity label belongs;

[0037] The occurrence frequency proportion of the emotion category in each sentiment category distribution histogram is calculated;

[0038] An initial association strength value is generated according to the deviation degree of the occurrence frequency proportion from a preset reference frequency;

[0039] The initial association strength value is corrected based on a time decay coefficient of each historical emotional segment to generate a target association strength value.

[0040] Optionally, when the customer emotional score is lower than the preset service baseline, service strategy adjustment information matching the current emotional state of the customer and the historical emotional change trend is generated, including:

[0041] According to the customer emotional evolution map, a change curve of emotional polarity labels in N interaction cycles is established, N being greater than or equal to 2;

[0042] The emotional polarity label corresponding to the current emotional state of the customer is matched with a key turning point in the change curve of emotional polarity labels to determine a stage position of the current emotional state of the customer in the historical emotional change trend;

[0043] According to the stage position, a corresponding strategy combination in a preset strategy template library is selected;

[0044] The customer emotional score is compared with a preset service baseline;

[0045] According to the comparison result, parameter reinforcement processing is performed on the strategy combination to generate service strategy adjustment information.

[0046] Optionally, after the service strategy adjustment information matching the current emotional state of the customer and the historical emotional change trend is generated, the method further includes:

[0047] According to the service strategy adjustment information, the service content display order in the interaction process between the target customer and the enterprise is adjusted in real time, and the emotional tendency label in the customer emotional evolution map is updated;

[0048] After the customer completes the current interaction, a closed-loop feedback signal is generated according to the adjusted service content display order and the change trend of the customer emotional score, the closed-loop feedback signal being used to iteratively optimize the mapping relationship between the emotional computing model and the service strategy adjustment information.

[0049] In a second aspect, the present application provides an intelligent customer lifecycle management AiCRM system, including:

[0050] An acquisition module is configured to acquire voice call records, real-time facial expression images and text feedback data of a target customer in an interaction process between the target customer and an enterprise;

[0051] An analysis module is configured to perform semantic analysis on the voice call records and the text feedback data, dynamic feature recognition on the facial expression images, cross-modal association of the semantic analysis result and the dynamic feature recognition result, and generation of a customer emotional feature set;

[0052] an updating module, configured to dynamically update a customer emotion evolution graph in a preset multi-modal customer emotion database based on the customer emotion feature set;

[0053] a first generating module, configured to generate a target customer emotion score of the target customer by using a sentiment computing model based on the updated customer emotion evolution graph and the customer emotion feature set;

[0054] a second generating module, configured to generate service strategy adjustment information matched with a current emotion state and a historical emotion change trend of the customer to realize intelligent customer life cycle management (AiCRM) when the customer emotion score is lower than a preset service baseline.

[0055] In a third aspect, the present application provides a computing device, comprising a processor and a memory, wherein the memory stores a computer program, and the processor is configured to execute the computer program to perform the intelligent customer life cycle management (AiCRM) method according to any one of the first aspect.

[0056] In a fourth aspect, the present application provides a computer storage medium, which stores computer program instructions, and the computer program instructions are executed by a processor to implement the intelligent customer life cycle management (AiCRM) method according to any one of the first aspect.

[0057] In the present application, an intelligent customer life cycle management (AiCRM) method is provided, which comprises: obtaining voice call records, real-time facial expression images and text feedback data of a target customer in a process of interaction between the target customer and an enterprise; performing semantic analysis on the voice call records and the text feedback data, performing dynamic feature recognition on the facial expression images, cross-modal correlation between the semantic analysis result and the dynamic feature recognition result, and generating a customer emotion feature set; dynamically updating a customer emotion evolution graph in a preset multi-modal customer emotion database based on the customer emotion feature set; generating a target customer emotion score of the target customer by using a sentiment computing model based on the updated customer emotion evolution graph and the customer emotion feature set; and generating service strategy adjustment information matched with a current emotion state and a historical emotion change trend of the customer to realize intelligent customer life cycle management (AiCRM) when the customer emotion score is lower than a preset service baseline.

[0058] The technical solution provided by the present application has the following beneficial effects:

[0059] The application solves the one-sidedness of single data source sentiment analysis by simultaneously collecting voice, expression and text data, and provides a multi-dimensional data basis for comprehensive evaluation of customer emotional state. The correlation analysis of voice semantics, text semantics and expression features breaks through the limitations of traditional single-modal analysis and improves the accuracy of emotional feature extraction. The time-series modeling of customer emotional state is realized, enabling the system to continuously track the customer emotional change trajectory and provide data support for trend analysis. By fusing real-time emotional features and historical evolution rules, a quantitative emotional score is generated, solving the problem of strong subjectivity of manual judgment. Based on the score, automatic triggering of personalized service strategy is realized, achieving closed-loop management from emotional recognition to service optimization, and improving the accuracy and timeliness of customer service.

[0060] Further, the application also divides the customer emotional evolution map into segments according to time windows, extracts multi-modal emotional distribution features of each segment, calculates the correlation strength between the current emotional label and historical segments, and accordingly assigns weights and generates a fusion vector, and finally outputs an emotional score.

[0061] Moreover, this process realizes dynamic weighted fusion of historical emotional data and real-time interaction information, considering both the time-series evolution rule of customer emotion and the detailed features of current interaction, so that the generated emotional score has historical continuity and can reflect the latest changes, improving the accuracy and reliability of emotional state evaluation.

[0062] These aspects or other aspects of the application will be more apparent in the following description of the embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0063] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiment or prior art description. Obviously, the drawings in the following description are some embodiments of the application, and those skilled in the art can obtain other drawings according to these drawings without creative labor.

[0064] Figure 1 A flowchart of an intelligent customer lifecycle management AiCRM method provided for the embodiments of the application;

[0065] Figure 2 A structural schematic diagram of an intelligent customer lifecycle management AiCRM system provided for the embodiments of the application;

[0066] Figure 3 A structural schematic diagram of a computing device provided for the embodiments of the application. DETAILED DESCRIPTION

[0067] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0068] In some of the processes described in the specification and claims of this application and the above-mentioned figures, multiple operations that appear in a specific order are included, but it should be clearly understood that these operations may not be executed in the order in which they appear in this document or may be executed in parallel. The serial numbers of the operations, such as 101, 102, etc., are only used to distinguish between different operations, and the serial numbers themselves do not represent any order of execution. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. It should be noted that the descriptions of "first", "second", etc. in this document are used to distinguish different messages, devices, modules, etc., and do not represent a sequential order, nor do they limit "first" and "second" to being different types.

[0069] Researchers have found that existing customer relationship management systems have problems with emotion recognition, such as a single data source and limited analysis dimensions. It is difficult to fully and accurately capture the true emotional state of customers, and lacks the ability to dynamically track changes in customer emotions, resulting in delayed adjustments to service strategies. Based on this, an embodiment of the present application provides an intelligent customer lifecycle management AiCRM method, which achieves a comprehensive quantitative assessment of customer emotions through multimodal data collection and fusion analysis, and dynamically tracks emotional evolution trends in combination with time series modeling technology, automatically triggering personalized service strategies when abnormal customer emotions are detected. The technical solution of this application can be applied to customer relationship management scenarios that require accurate grasp of customer emotional changes and the provision of intelligent services, such as high-value customer service areas such as financial customer service and e-commerce after-sales.

[0070] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0071] Figure 1 A flowchart of an intelligent customer lifecycle management AiCRM method provided in an embodiment of the present application is shown as follows: Figure 1 As shown, the method includes:

[0072] Step 101: During the interaction between the target customer and the enterprise, obtain the target customer's voice call records, real-time facial expression images, and text feedback data.

[0073] In step 101, the voice call record represents the audio data of a conversation between a customer and a company's customer service representative, including voice features such as intonation and speaking speed. The real-time facial expression image represents the customer's facial expression captured by a video capture device. The text feedback data represents the textual information entered by the customer during the interaction, such as chat logs and comments.

[0074] In an embodiment of the present application, the audio data of the customer's voice call is collected in real time through the customer service system, the camera is called to obtain the customer's facial expression video stream, and the text information entered by the customer in the interactive interface is recorded. These three types of original data are used as the input source for subsequent sentiment analysis.

[0075] For example, when a bank customer consults about financial products on a mobile banking app, the system records the call voice, captures the customer's video footage, and records the text questions entered by the customer in the chat window. The three are collected simultaneously and timestamped.

[0076] Step 102: Perform semantic analysis on the voice call record and the text feedback data, perform dynamic feature recognition on the facial expression image, perform cross-modal association between the semantic analysis result and the dynamic feature recognition result, and generate a customer emotion feature set.

[0077] In step 102, semantic analysis involves identifying intent and emotional tendencies in text and speech content. Dynamic feature recognition involves extracting expression features from video sequences. Cross-modal association involves fusing and correlating emotional features from different data sources. The customer emotional feature set represents the structured emotional feature data generated by integrating multi-source data.

[0078] In an embodiment of the present application, after the speech data is processed for speech-to-text conversion, emotional keyword extraction and emotional tendency analysis are performed together with the original text data; at the same time, face detection and expression feature extraction are performed on the video data; the text emotion analysis results and the expression recognition results are feature aligned and weightedly fused to generate a structured data set containing multi-dimensional emotional features.

[0079] For example, the system converts a customer's words "the profit is too low" into text and analyzes the negative emotion; at the same time, it detects the customer's frowning expression; and combines these two features according to preset weights to generate a set of emotional features containing the "negative-strong" label.

[0080] Step 103: Based on the customer emotion feature set, dynamically update the customer emotion evolution graph in the preset multimodal customer emotion database.

[0081] In step 103, the multimodal customer emotion database represents a structured database storing historical emotion features. The customer emotion evolution graph represents a graph of emotion state changes with time as the axis, where nodes represent emotion states and edges represent state transitions.

[0082] In an embodiment of the present application, the currently generated emotional feature set is associated with the historical records of the customer in the database, and the emotional state nodes and transfer edge weights are updated to form a time series graph reflecting the long-term changing trend of the customer's emotions.

[0083] For example, the system compares the "negative-strong" feature with the customer's past three interaction records and finds that the customer's negative emotions continue to worsen in the financial product consultation scenario. It adds a new state node to the evolution graph and adjusts the transfer edge weight.

[0084] Step 104: Based on the updated customer emotion evolution graph and the customer emotion feature set, a target customer emotion score of the target customer is generated using an emotion calculation model.

[0085] In step 104, the sentiment calculation model represents a sentiment evaluation model that comprehensively considers real-time features and historical trends. The target customer sentiment score represents a quantified customer sentiment state value.

[0086] In an embodiment of the present application, the model receives current emotional features and evolutionary graph data, first calculates the similarity between the current features and the historical state, then weights them in combination with the time decay factor, and finally outputs a standardized score through normalization processing.

[0087] For example, the model calculates the similarity between current negative emotions and historical records to be 0.8, and after weighting by the time factor, it is 0.72, which is normalized and converted into a percentage score of 58 points (calculation formula: 100*(1-0.72)=58).

[0088] Step 105: When the customer emotion score is lower than the preset service baseline, service strategy adjustment information matching the customer's current emotion state and historical emotion change trend is generated to implement intelligent customer lifecycle management AiCRM.

[0089] In step 105, the preset service baseline represents a preset emotion score threshold. The customer's current emotional state is the instant emotion analysis result generated by extracting emotion features and processing the emotion calculation model from the voice call records, facial expression images and text feedback data obtained in real time from the latest customer interaction. The current emotional state of the customer is characterized by the emotion polarity label generated by the current interaction data. Each emotion polarity label (such as positive / negative / neutral) corresponds to a specific emotion state classification to form a quantitative expression. Service strategy adjustment information refers to personalized service optimization instructions dynamically generated according to the customer's emotional state, specifically including communication language adjustment plans (such as tone and urgency, word choice), service priority ranking (such as response speed, processing level), service content adjustment (such as preferential strength, solution) and service channel selection (such as transfer to manual, video communication) in four dimensions.

[0090] In an embodiment of the present application, when the score is lower than the baseline, the system selects a matching response plan from the strategy library based on the emotional feature type and evolution trend, adjusts the plan strength parameter based on the score difference, and generates a final execution strategy.

[0091] For example, if the baseline score is 70 and the current score is 58, triggering a strategy adjustment, the system selects the "Wealth Management Manager Follow-up + Profit Compensation" plan. Based on the 12-point difference, the follow-up time limit is adjusted from 48 hours to within 24 hours, and the compensation ratio is increased by 5%.

[0092] This method achieves accurate identification and quantitative assessment of customers' emotional states through multi-dimensional data collection and fusion analysis. It can dynamically track the changing trends of customers' emotions and automatically generate and optimize service strategies when emotional anomalies are detected, thereby improving the timeliness and accuracy of customer service and providing intelligent decision-making support for the company's customer relationship management.

[0093] To address the accuracy and timeliness issues of customer sentiment scores, in some embodiments, step 104: generating a target customer sentiment score for the target customer using a sentiment computing model based on the updated customer sentiment evolution graph and the customer sentiment feature set, includes:

[0094] Step 201: Divide the updated customer emotion evolution map into multiple historical emotion segments according to a preset time window, and extract the emotion polarity label distribution density corresponding to the voice call record, the real-time facial expression image and the text feedback data in each historical emotion segment.

[0095] In step 201, a preset time window is set based on the business scenario, such as weekly or monthly divisions. Historical sentiment segments are units of historical customer interaction data divided into fixed time periods. The distribution density of sentiment polarity labels reflects the frequency of occurrence of different sentiment types (e.g., positive, neutral, negative) within each time period.

[0096] In an embodiment of the present application, the system reads the customer's interaction data for the past three months, divides it into three historical segments by month, and counts the proportion of emotional tags in voice, expression and text data in each segment to form three emotional distribution histograms.

[0097] Step 202: Discretely mark the current emotion polarity label in the customer emotion feature set.

[0098] In step 202, the current sentiment polarity label refers to the immediate sentiment characteristics obtained from the most recent customer interaction. It is distinguished from historical data by a timestamp, and its currency is determined by the real-time nature of data collection and processing. Discretization is the process of converting continuous sentiment values ​​into several pre-defined categorical labels.

[0099] In the embodiment of the present application, the sentiment value of 0.7 (range 0-1) obtained from the current call analysis is discretized into a "positive" label to facilitate comparison with historical clips.

[0100] Step 203: Based on the distribution density of the emotion polarity label, the target association strength value between the current emotion polarity label and each historical emotion segment is calculated.

[0101] In step 203 , the target association strength value quantifies the similarity between the current sentiment and the historical segments, and is calculated by comparing the position of the current label in the distribution of each segment.

[0102] In the embodiment of the present application, the percentile position of the current "positive" label in the distribution of three historical segments is calculated to obtain three association strength values.

[0103] Step 204: assigning a weight value to each historical emotion segment according to the target association strength value, and linearly superimposing the weight value and the discretization labeling result to generate an emotion state fusion vector.

[0104] In step 204, weights reflect the degree of influence of each historical segment on the current score. Each historical emotional segment is assigned a corresponding weight, and each segment's weight is independently calculated based on its target association strength with the current emotional state. The emotional state fusion vector is a feature representation that combines the weights with the current label.

[0105] In the embodiment of the present application, the three historical segments are given weights of 0.3, 0.5, and 0.2, and are weighted with the current "positive" label to generate a five-dimensional fusion vector.

[0106] Step 205: Input the emotional state fusion vector into the emotional calculation model, and output the target customer emotional score.

[0107] In the embodiment of the present application, after the fusion vector is input into the model, it is processed through three layers to output a scoring result of 0-100 points.

[0108] Here's a specific example:

[0109] When a bank customer consulted about the same wealth management product for the fourth time via mobile banking, the system divided the customer's past three consultations into three historical sentiment segments by month. The system calculated the occurrence rate of the "negative" sentiment label in each segment to be 60%, 70%, and 80%, respectively, to form the distribution density of the sentiment polarity label. During this consultation, the system detected the customer's voice saying "still too low" (converted to text and labeled "negative") and the facial expression "frowning" (labeled "strong"). The system combined these two factors to generate the current sentiment polarity label "negative-strong." The percentile method was used to calculate the correlation strength of this label with the three historical segments, yielding values ​​of 0.6, 0.7, and 0.8, respectively (calculated as: current label strength / historical maximum strength). This was then corrected by applying time decay coefficients of 0.9, 0.8, and 0.7 (calculated as: 1 - 0.1 × number of months between intervals), resulting in final correlation strengths of 0.54, 0.56, and 0.56, respectively. The weights are proportionally allocated as 0.32, 0.34, and 0.34 (calculation formula: association strength value of each segment / total), and linearly superimposed with the current label value 0.8 (negative 0.5 + strong 0.3) to generate a fusion vector [0.16, 0.17, 0.17, 0.5, 0.3]. After input into the model, the output sentiment score is 55 points (calculation formula: 100×(1-0.8×0.7)=55, where 0.7 is the model weighting parameter).

[0110] In the embodiment of the present application, the method realizes dynamic quantitative assessment of the customer's emotional state through the fusion of time series data analysis and real-time features, taking into account both historical change patterns and current characteristics, providing a reliable basis for precise service.

[0111] In order to solve the problem of fusing historical and current data in sentiment score calculation, in some embodiments, step 205: inputting the sentiment state fusion vector into the sentiment calculation model and outputting the target customer sentiment score includes:

[0112] Step 301: Using an emotion calculation model, the emotion state fusion vector is divided into a historical emotion weight component and a current emotion label component according to a preset dimension.

[0113] In step 301, the preset dimensions are set based on the model structure. Typically, the first N dimensions of the vector are classified as historical components, while the last M dimensions are current components. The historical sentiment weight component refers to the portion of the fused vector that reflects the influence of historical sentiment. The current sentiment tag component refers to the sentiment features extracted from the most recent customer interaction data. This component is distinguished from historical data by the data collection timestamp. Its current nature is reflected in the fact that processing always refers to the data generated by the most recent interaction.

[0114] In an embodiment of the present application, the system classifies the first three dimensions of the five-dimensional fusion vector as historical weight components and the last two dimensions as current label components.

[0115] Step 302: hierarchically process the historical sentiment weight components, and adjust the superposition coefficient of each level according to the target association strength value in each processing level.

[0116] In step 302, hierarchical processing refers to multi-level feature extraction and conversion of historical components. The superposition coefficient controls the contribution of each level to the final result and is dynamically adjusted according to the correlation strength. For example, in a customer service scenario, the customer's historical interactions within 3 months are divided into 12 segments by week. According to the correlation strength between each segment and the current complaint event (such as the matching degree of complaint-related conversations), the influence weight of each week's data in the calculation model is adjusted separately. If the correlation strength in the most recent week is high, its superposition coefficient is increased. The superposition coefficient of each level is obtained by dynamically calculating the target correlation strength value between the historical emotional segment corresponding to each level and the current interaction when hierarchically processing the historical emotional weight components.

[0117] In the embodiment of the present application, the model performs three-layer processing on the historical components, and each layer adjusts the conversion coefficient according to the association strength value, and the stronger the association, the higher the coefficient.

[0118] Step 303: interlacing and splicing the adjusted superposition coefficient with the current emotion tag component to generate a hierarchical fusion signal.

[0119] In step 303, interleaving is to alternately combine the adjusted historical features with the current features according to specific rules to form a new feature representation containing spatiotemporal correlations. For example, the adjusted weekly weight coefficients (such as [0.2, 0.3, 0.5]) are alternately combined with the emotional tags of the current complaint event (such as "anger") in the format of [weight-tag-weight...] to generate a signal sequence containing temporal weights and real-time emotions. The hierarchical fusion signal is a composite feature vector formed by interleaving the adjusted historical emotional weight components with the current emotional tag components in a specific order. It not only retains the hierarchical characteristics of historical emotional changes, but also integrates the real-time characteristics of current emotions, providing a unified feature representation for subsequent analysis.

[0120] In an embodiment of the present application, the three-layer historical processing results and the current mark are spliced ​​in the order of "history-current-history" to generate a seven-dimensional hierarchical fusion signal.

[0121] Step 304: Using the dynamic aggregation node of the emotion calculation model, the difference in proportion between the historical emotion weight component and the current emotion label component in the hierarchical fusion signal of each level is compared layer by layer to generate a hierarchical contribution parameter.

[0122] In step 304, the dynamic aggregation node, a special processing unit in the model, evaluates the importance of each layer's contribution by comparing the relative proportions of historical and current features. The "proportion difference" refers to the difference between the proportions of the historical sentiment weight component and the current sentiment tag component in the fusion signal at each layer. This reflects the relative strength of historical sentiment influence and current sentiment expression and is used to assess the importance of each layer. The layer contribution parameter is a quantitative value of each layer's contribution to the final sentiment score, calculated based on the proportion difference. A larger parameter value indicates a greater impact of the layer's features on the score result, and is used to guide subsequent path selection.

[0123] In an embodiment of the present application, the node calculates the difference between the proportion of historical and current features in each layer of signal. The greater the difference, the higher the contribution parameter of the layer.

[0124] Step 305: Selectively activate the transmission paths in the dynamic aggregation node according to the hierarchical contribution parameters.

[0125] In step 305, the transmission path refers to the connection channel between different processing units within the dynamic aggregation node, not involving the connection between nodes. Each path corresponds to a specific signal processing method. Selective activation is to open the most relevant processing path based on the contribution parameter.

[0126] In an embodiment of the present application, the node activates two paths whose contribution parameters exceed a threshold value and blocks other low-contribution paths.

[0127] Step 306: Perform scalar compression on the output signal of the activated transmission path to generate an initial customer sentiment score.

[0128] In step 306, the output signal is the result of processing the hierarchical fusion signal after filtering through the activation path. This signal retains the key features of the original signal while undergoing dimensionality reduction and normalization. Scalar compression is the process of converting a multidimensional signal into a single numerical value through methods such as weighted summation. The initial customer sentiment score is a preliminary score obtained by compressing the output signal of the activation path. This score does not yet take into account the constraints of historical sentiment fluctuations and is an intermediate calculation result of the target customer sentiment score.

[0129] In an embodiment of the present application, the multidimensional signals output by the activated paths are weighted and summed according to the contribution parameters of each path, and compressed into an initial score in the range of 0-1. Specifically: first, the amplitude of the multidimensional signals output by each activated path is summed, and then the summation result is mapped to the interval [0,1] by a preset normalization factor, and finally the median of the output results of all paths is taken as the initial score. For example, in a customer complaint handling scenario, the three activated paths output signal vectors [0.6, 0.2, 0.8], [0.4, 0.5, 0.3] and [0.7, 0.1, 0.9] respectively. Each path is first summed to obtain 1.6, 1.2 and 1.7, and then compressed using a normalization factor of 2.0 to obtain 0.8, 0.6 and 0.85, and the median 0.8 is taken as the initial sentiment score.

[0130] Step 307: Based on the statistical deviation of the distribution density of the sentiment polarity labels, perform boundary constraints on the initial customer sentiment scores and output the target customer sentiment scores.

[0131] In step 307, the statistical deviation is derived from the standard deviation of the frequency of various emotion labels (e.g., positive / negative) in the customer's historical interactions, reflecting the degree of customer emotional fluctuation. Boundary constraints are used to rationalize the initial score based on this fluctuation range. For example, if a customer's historical emotional distribution is detected to be highly skewed (emotionally volatile), the initial score is constrained from 0.3 to the range [0.4, 0.6] to avoid misjudgments due to single extreme emotions. A final score of 0.45 is output for service strategy formulation.

[0132] In an embodiment of the present application, when a large historical sentiment fluctuation is detected, the initial score of 0.4 is constrained to the range of 0.3-0.5, and a final score of 0.45 is output.

[0133] Here's a specific example:

[0134] When the customer of a certain bank consults the same financial product for the fifth time, the system divides the emotion state fusion vector [0.16, 0.17, 0.17, 0.5, 0.3] into a historical component [0.16, 0.17, 0.17] and a current component [0.5, 0.3]. The historical component is processed in three layers, and the superposition coefficients are adjusted to 0.3, 0.4, and 0.3 according to the correlation intensity of 0.54, 0.56, and 0.56, respectively (calculation formula: correlation intensity value x level weight coefficient 0.5). The adjusted coefficients are interleaved and spliced with the current component to generate a seven-dimensional hierarchical fusion signal [0.3, 0.5, 0.4, 0.3, 0.3, 0.5, 0.3]. The dynamic aggregation node calculates the difference between the historical and current proportions of each layer and finds that the second layer has the largest difference (historical proportion 0.4 / 0.9 = 44%, current proportion 0.3 / 0.9 = 33%, difference 11%), generating a hierarchical contribution parameter [0.2, 0.4, 0.2]. According to the parameter, two main paths are activated, and the output signal is compressed by weighted summation (weights 0.4 and 0.4) to obtain an initial score of 0.38 (calculation formula: (0.3 x 0.4 + 0.4 x 0.4) / 0.8). Combined with the historical emotion fluctuation range (maximum deviation 0.2), the score is constrained to the interval of 0.3-0.5, and the final output target score is 0.4.

[0135] In the embodiments of the present application, the method realizes the optimized combination of historical emotion rules and real-time features through multi-level feature fusion and dynamic path selection, so that the final score reflects both long-term trends and current state, providing a reliable basis for precise service.

[0136] To solve the problem of the accuracy of the fusion of historical and current features in emotion scoring, in some embodiments, step 304: the dynamic aggregation node using the emotion calculation model compares the proportion difference between the historical emotion weight component and the current emotion label component in the hierarchical fusion signal of each level layer by layer to generate a hierarchical contribution parameter, including:

[0137] Step 401: dividing the hierarchical fusion signal of each level into a historical signal segment and a current signal segment according to a preset proportion.

[0138] In step 401, the preset proportion is set according to the signal dimension, and is usually divided according to the original proportion of historical and current features. The historical signal segment refers to the part of the data in the hierarchical fusion signal that reflects the historical emotion feature, which includes the superposition coefficient adjustment result of the historical emotion weight component. The current signal segment refers to the part of the data that reflects the real-time emotion feature, which includes the discretization label result of the current emotion label component.

[0139] In the embodiments of the present application, the system divides the seven-dimensional hierarchical fusion signal into a historical signal segment and a current signal segment according to a proportion of 5 dimensions for the history and 2 dimensions for the current.

[0140] Step 402: Perform amplitude accumulation calculation on the historical signal segment and the current signal segment respectively to obtain a historical cumulative amplitude and a current cumulative amplitude.

[0141] In step 402, the amplitude accumulation calculation refers to the weighted summation of the values ​​of each dimension in the signal segment. The historical cumulative amplitude reflects the overall strength of the historical feature. The current cumulative amplitude reflects the overall strength of the real-time feature.

[0142] In an embodiment of the present application, each dimension of the historical signal segment is multiplied by the corresponding weight and then summed to obtain the historical cumulative amplitude, and the current signal segment is directly summed to obtain the current cumulative amplitude.

[0143] Step 403: Generate a level difference amplitude according to the absolute value of the difference between the historical cumulative amplitude and the current cumulative amplitude.

[0144] In step 403 , the level difference amplitude is a quantitative indicator obtained by calculating the absolute difference between the historical and current cumulative amplitudes, reflecting the degree of deviation between the historical characteristics and the real-time characteristics of the level.

[0145] In the embodiment of the present application, the historical cumulative amplitude is subtracted from the current cumulative amplitude and the absolute value is taken to obtain the level difference amplitude.

[0146] Step 404: Compare the level difference amplitude with a preset difference threshold. If the level difference amplitude exceeds the preset difference threshold, activate the difference accumulator corresponding to the level.

[0147] In step 404, a preset difference threshold is set based on historical data analysis. Exceeding the threshold indicates that the difference requires special processing. The difference accumulator is a computing unit specifically used to process the difference signal.

[0148] In the embodiment of the present application, when the level difference amplitude exceeds a threshold, the level difference accumulator is activated to start recording and amplifying the difference signal; otherwise, the input signal of the difference accumulator is suppressed.

[0149] Step 405: Directionally mark the signal output by the activated difference accumulator.

[0150] In step 405, the signal refers to the processed quantized emotional feature data, specifically the feature vector generated by the difference accumulator after comparing historical and current emotional data. The activated difference accumulator can output a signal because when the hierarchical difference amplitude exceeds a threshold, a specific processing unit within the accumulator is triggered, automatically performing preset feature extraction and conversion operations on the input historical signal segments and the current signal segment, generating a structured output signal containing difference information. Directional marking refers to determining whether the strength of the historical feature is greater than or less than the current feature, marking it as positive or negative, respectively, to reflect the direction of emotional change.

[0151] In the embodiment of the present application, the historical and current cumulative amplitude size are compared, and the positive direction is marked when the historical is larger, and vice versa.

[0152] Step 406: Polarization weighting is performed on the signals output by the difference accumulators in the same level based on the directionality marking result, and a level difference index is generated.

[0153] In step 406, the polarization weighting is to apply a positive or negative weight coefficient to the difference signal according to the directionality marking, and generate a directional difference index.

[0154] In the embodiment of the present application, the positive marking is weighted by 1.2 times, and the negative marking is weighted by 0.8 times, and a signed level difference index is generated. For example, in the customer complaint processing scene, when it is detected that the cumulative amplitude of the current anger emotion marking (current signal segment) is higher than that of the historical calm emotion data (historical signal segment), the directionality marking is "negative", and a negative weight coefficient of 0.8 is applied to the difference signal, and a level difference index-0.64 representing the deterioration of emotion is generated; otherwise, if the current satisfaction is higher than the historical level, the marking is "positive" and a positive weight of 0.6 is given, and a difference index +0.52 is generated.

[0155] Step 407: The level difference indexes of each level are accumulated in a sliding window according to a preset aggregation rule, and a level contribution parameter is generated.

[0156] In step 407, the preset aggregation rule refers to the calculation method adopted when the level difference index is accumulated in a sliding window, which specifically includes three key parameters of window size setting, weight distribution method and normalization processing flow, which are used to control the fusion method and influence degree of different level difference indexes. The sliding window accumulation refers to the local summation of adjacent level difference indexes in time sequence, which smooths random fluctuations and highlights the main trend.

[0157] In the embodiment of the present application, a sliding window with a window size of 3 is adopted, and the difference indexes of three adjacent levels are summed and averaged to generate the final contribution parameter.

[0158] The following is a specific example:

[0159] When a bank customer inquired about a wealth management product for the sixth time, the system segmented the seven-dimensional hierarchical fusion signal [0.3, 0.5, 0.4, 0.3, 0.3, 0.5, 0.3] according to the ratio of the historical five dimensions to the current two dimensions, resulting in three historical signal segments: [0.3, 0.5], [0.4, 0.3], and [0.3, 0.5], and the current signal segment [0.3]. The cumulative amplitudes of each historical signal segment were calculated to be 0.8, 0.7, and 0.8, respectively (calculated by adding the dimension values), and the cumulative amplitude of the current signal segment was 0.3. The hierarchical difference amplitudes were generated to be 0.5, 0.4, and 0.5 (calculated by subtracting the absolute value of the current amplitude from the historical amplitude). A threshold of 0.45 was set, the second layer was deactivated, and the difference accumulators for the first and third layers were activated (calculated by difference amplitude > threshold). The first layer's historical amplitude of 0.8 is greater than the current amplitude of 0.3, marking the positive direction. The same applies to the third layer, weighted by 1.2, to obtain difference indices of 0.6 and 0.6 (calculated by: difference amplitude × weighting coefficient). A sliding window with a window size of 2 is used for accumulation (calculated by: sum of adjacent indices divided by 2) to generate the contribution parameters [0.6, 0.4, 0.6].

[0160] In the embodiment of the present application, the method achieves a precise fusion of historical sentiment patterns and real-time features by quantitatively analyzing the differences in features at each level and highlighting changes, so that the scoring results can better reflect the real changing trends of customer emotions.

[0161] In order to solve the problem of quantifying the association between historical emotion data and the current emotion state, in some embodiments, step 203: calculating the target association strength value between the current emotion polarity label and each historical emotion segment based on the emotion polarity label distribution density includes:

[0162] Step 501: classify and count the emotion polarity labels in each historical emotion segment according to preset emotion categories, and generate an emotion category distribution histogram for each historical emotion segment.

[0163] In step 501, the emotional polarity labels in each historical emotional segment and the current emotional polarity labels are temporally correlated. The historical labels provide a reference for the customer's long-term emotional pattern, and the current labels are real-time data that need to be compared and analyzed. The two are emotional feature records of the same customer at different time points. The preset emotional category refers to a predefined emotional classification standard, which usually includes basic categories such as positive, neutral, and negative, and is used to standardize and classify emotional polarity labels to ensure the consistency of emotional analysis. The emotional category distribution histogram refers to a distribution chart formed by counting the various emotional polarity labels in the historical emotional segment according to the preset emotional categories. The horizontal axis represents the emotional category and the vertical axis represents the frequency of occurrence.

[0164] In the embodiment of the present application, the system first reads the original emotional label data stored in each historical emotional segment, classifies and arranges according to the preset "positive", "neutral" and "negative" three emotional categories, counts the number of occurrences of each category in the segment, and then visualizes the statistical results in the form of a histogram, with the horizontal axis representing the emotional category and the vertical axis representing the occurrence frequency of the corresponding category, forming an intuitive emotional distribution chart, providing a data basis for subsequent correlation analysis.

[0165] Step 502: Classifying the current emotional polarity label to determine the emotional category to which the current emotional polarity label belongs.

[0166] In step 502, classifying the current emotional polarity label means comparing the current emotional polarity label with the preset emotional category library to determine the standard emotional category to which it belongs. The emotional category refers to the specific classification of the emotional polarity label, such as "angry", "satisfied", etc., which is used to quantitatively describe the customer's emotional state and is the basic unit of emotional analysis.

[0167] In the embodiment of the present application, the system receives the emotional polarity label generated in the current interaction process, compares the label with the standard definition in the preset emotional category library, determines the emotional category to which it belongs through semantic analysis and feature matching, for example, classifies the "angry" label into the "negative" category and the "satisfied" label into the "positive" category, and completes the standardized classification of the current emotional state.

[0168] Step 503: Calculate the occurrence frequency proportion of the emotional category in each emotional category distribution histogram.

[0169] In step 503, the occurrence frequency proportion refers to the frequency of the current emotional category in the historical segment, which is calculated as the number of occurrences of the category divided by the total number of labels in the segment.

[0170] In the embodiment of the present application, based on the determined current emotional category, the system scans the emotional category distribution histogram of each historical segment, extracts the occurrence frequency data of the category in each histogram, and then divides by the total number of emotional labels of the corresponding segment to calculate the relative occurrence proportion of the emotional category in each historical segment, quantifying the historical emotional distribution characteristics.

[0171] Step 504: Generating an initial correlation strength value according to the deviation of the occurrence frequency proportion from the preset reference frequency.

[0172] In step 504, the preset baseline frequency refers to the average frequency of occurrence of a certain emotion category in historical data, serving as a reference for calculating the association strength. This frequency is typically derived from historical data analysis. The degree of deviation refers to the difference between the frequency of the current emotion category and the preset baseline frequency. It measures the deviation of the current emotional state from the historical norm; a greater difference indicates a stronger association. The initial association strength value is generated by comparing the current emotion's proportion relative to the baseline frequency; a greater deviation indicates a stronger association.

[0173] In an embodiment of the present application, the system pre-sets the baseline occurrence frequency of each type of emotion as a reference value, compares the calculated actual proportion with the baseline value, and calculates the relative deviation between the two. The greater the deviation, the higher the initial association strength value generated, indicating that the current emotional state is more strongly associated with the historical segment.

[0174] Step 505: Based on the time decay coefficient of each historical emotion segment, the initial association strength value is corrected to generate a target association strength value.

[0175] In step 505, a time decay coefficient is calculated based on the interval between the recording time of the historical emotion segment and the current time. An exponential decay function is typically used, with the decay coefficient decreasing as the interval increases. Correction processing involves calculating a time decay coefficient for each historical emotion segment individually, meaning each segment has its own independent time decay coefficient used to correct its corresponding initial association strength value.

[0176] In an embodiment of the present application, the system calculates the time attenuation coefficient based on the collection time of each historical segment. The closer the segment is to the time, the smaller the attenuation. Then, the obtained initial association strength value is multiplied by the corresponding attenuation coefficient to appropriately weaken the long-term association strength. Finally, the target association strength value considering timeliness is obtained, and the timing correction is completed.

[0177] Here's a specific example:

[0178] When a bank customer inquires about a wealth management product for the fifth time, the system divides the past four inquiries into four historical emotional segments by month. The percentage of "negative" sentiment in each segment is calculated, with the percentage being 50%, 60%, 70%, and 80%, respectively. This time, the customer's expression "getting worse" (labeled "negative") and a narrowed-eye expression (labeled "suspicious") are detected and fused to generate the current label "negative-suspicious." The frequency percentage of the "negative" category in the four historical segments is calculated (step 503). Comparing this with the baseline value of 40%, the initial correlation strengths are: (50-40) / 40 = 0.25 for the first segment, (60-40) / 40 = 0.5 for the second segment, (70-40) / 40 = 0.75 for the third segment, and (80-40) / 40 = 1.0 for the fourth segment (step 504). The decay coefficients are calculated based on the time intervals (4, 3, 2, and 1 month): 1-0.1×4=0.6, 1-0.1×3=0.7, 1-0.1×2=0.8, and 1-0.1×1=0.9 (step 505). The corrected target association strengths are: 0.25×0.6=0.15, 0.5×0.7=0.35, 0.75×0.8=0.6, and 1.0×0.9=0.9.

[0179] In the embodiment of the present application, the method achieves accurate calculation of the intensity of emotional association by quantifying the degree of matching between historical emotional distribution and current state and taking into account the time decay effect, thereby providing a reliable time series reference basis for emotional scoring.

[0180] To accurately match service strategies with customer emotional states, in some embodiments, step 105 , when the customer emotional score is lower than a preset service baseline, generates service strategy adjustment information that matches the customer's current emotional state and historical emotional change trends, including:

[0181] Step 601: Based on the customer emotion evolution graph, establish an emotion polarity label change curve of N interaction cycles, where N is greater than or equal to 2.

[0182] In step 601, the emotion polarity label change curve refers to a continuous change curve with time as the horizontal axis and the emotion polarity label value as the vertical axis, which reflects the temporal evolution trend of the customer's emotional state. N interaction cycles are set according to business needs, usually 3-6 cycles. Establishing an emotion polarity label change curve for N interaction cycles means establishing a curve that is connected by multiple emotion polarity label data points within N interaction cycles. That is, the number of curves is one, but the label data points that constitute the curve are multiple (corresponding to N cycles).

[0183] In an embodiment of the present application, the system reads the emotional polarity label data of the customer's most recent five interactions, draws a continuous change curve, and marks obvious peaks and troughs.

[0184] Step 602: match the emotional polarity label corresponding to the current emotional state of the customer with the key turning point in the emotional polarity label change curve, and determine the stage position of the current emotional state of the customer in the historical emotional change trend.

[0185] In step 602, the key turning point refers to the time point of the change of the slope in the emotional polarity label change curve, which is automatically identified by calculating the position where the second derivative of the curve exceeds a preset threshold (such as a change rate > 15%), and is marked as the turning time of the emotional trend. The stage position refers to the relative position of the current emotional state in the historical trend, such as the rising period, the falling period, or the stable period.

[0186] In the embodiment of the present application, the current emotional label is compared with the turning point on the curve to determine that the third stage is in the "continuous falling period".

[0187] Step 603: select the corresponding strategy combination in the preset strategy template library according to the stage position.

[0188] In step 603, the preset strategy template library contains standardized coping schemes for different emotional stages, and the strategy combination is an organic combination of multiple strategies selected according to the stage characteristics. The strategy combination specifically includes: the degree of tone (such as using a more moderate tone when angry), the proportion of professional terms used (such as reducing the use of terms for dissatisfied customers), and the frequency of inserting emotional resonance sentences (such as inserting one sentence of empathy expression every 3 sentences); the service priority adjustment scheme specifically includes: response time limit (such as increasing from 24 hours to 2 hours), processing personnel level (such as upgrading from ordinary customer service to supervisor), and compensation scheme authority (such as providing higher compensation authority).

[0189] In the embodiment of the present application, the combination strategy of "fast response + compensation scheme + upgraded service" is selected for the "continuous falling period".

[0190] Step 604: compare the customer emotional score with the preset service baseline.

[0191] In step 604, the preset service baseline is an emotional score threshold set according to historical service data, and the comparison result reflects the abnormality degree of the current emotional state. The comparison result indicates that when the comparison result exceeds a preset first threshold, a primary service strategy adjustment is triggered, and when the comparison result exceeds a preset second threshold, a senior service strategy adjustment is triggered.

[0192] In the embodiment of the present application, the current score is compared with the baseline value to obtain a difference result of 15 points below the baseline.

[0193] Step 605: parameter enhancement processing is performed on the strategy combination according to the comparison result, and service strategy adjustment information is generated.

[0194] In step 605, the parameter reinforcement processing is to adjust the execution intensity of the strategy according to the score difference, such as shortening the response time, increasing the compensation intensity, etc. For example, when the customer emotion score (0.3) is lower than the service baseline (0.5) and the difference reaches 40%, the original "apology + coupon" strategy combination is reinforced: the coupon amount is increased from 50 yuan to 50x(1+40%) = 70 yuan, and the response priority of senior customer service intervention is increased. The reinforcement amplitude is calculated as (baseline value-score value) / baseline value=40%.

[0195] In the embodiments of the present application, the parameter reinforcement processing is to adjust the execution intensity of the strategy according to the score difference, such as shortening the response time, increasing the compensation intensity, etc.

[0196] The following is a specific example:

[0197] When a customer of a certain bank inquires about a financial product again, the system establishes the emotion change curve of the customer's last 4 interactions, showing that the "negative" emotion proportion increases from 50% to 70%. Currently, the customer says "completely unacceptable" (labeled "negative") and clenches his fist (labeled "angry"), and the fusion generates the "negative-angry" label, which is found to be in the "rapid deterioration" stage by matching the curve. The system selects the "senior manager intervention + emergency compensation + product adjustment" strategy combination. The current emotion score is 53 points (calculation formula: 100x(1-0.8x0.6), which is 17 points different from the baseline of 70 points, and the strategy is reinforced to "division president video communication within 2 hours + compensation increase of 8% (original 5% + difference x 0.2%) + product scheme redesign" according to the difference. The compensation percentage increase calculation formula is: basic compensation 5%+(70-53)x0.2%=8.4%, rounded to 8%.

[0198] In the embodiments of the present application, the method realizes the accurate matching and dynamic optimization of the service strategy by analyzing the emotion change trend and quantifying the score difference, effectively improving the pertinence and timeliness of customer service.

[0199] In order to solve the problem of dynamic optimization of service strategy, in some embodiments, after generating the service strategy adjustment information matched with the current emotion state of the customer and the historical emotion change trend, the method further comprises:

[0200] Step 701: According to the service strategy adjustment information, the service content display order in the interaction process of the target customer with the enterprise is adjusted in real time, and the emotion tendency label in the customer emotion evolution graph is updated.

[0201] In step 701, the service content display order refers to the priority of the interactive interface elements rearranged according to the strategy adjustment result. The emotion tendency label is the latest emotion state label recorded in the customer emotion evolution graph.

[0202] In an embodiment of the present application, the system adjusts the information according to the strategy, displays the compensation plan and the advanced customer service entrance at the top, and updates the emotional label in the graph to the "negative-angry-processing" status.

[0203] Step 702: After the customer completes the current interaction, a closed-loop feedback signal is generated based on the adjusted service content display order and the changing trend of the customer's emotional score. The closed-loop feedback signal is used to iteratively optimize the mapping relationship between the emotional calculation model and the service strategy adjustment information.

[0204] In step 702, the closed-loop feedback signal is a comprehensive evaluation indicator that records the effectiveness of the strategy execution, including data such as the change in sentiment score and the click-through rate of service content, and is used to optimize the model strategy mapping relationship.

[0205] In an embodiment of the present application, the system tracks the entire customer interaction process, records the changes in sentiment scores and service option clicks after the strategy is executed, and generates a feedback signal including an effect evaluation.

[0206] Here's a specific example:

[0207] When a bank customer was upset over a financial product yield issue, the system implemented a modified "wealth manager follow-up within 24 hours + 5% yield compensation increase" strategy. The system immediately moved the "Dedicated Wealth Manager" portal and the "Yield Compensation Application" button to the top of the mobile banking screen (originally located on the third screen). The label on the customer's sentiment evolution graph was also updated to "Negative - Strong - Resolved." Within 24 hours, after the wealth manager completed the follow-up visit and provided a compensation plan, the system detected an increase in the customer's sentiment score from 58 to 68 (calculated using the formula: 100 × (1 - 0.32), where sentiment similarity was reduced to 0.6 and the time weighting factor was 0.8). The system also recorded three clicks on the "Yield Compensation" button and two clicks on the "Wealth Manager" portal. This closed-loop feedback signal, consisting of a 10-point score increase (68-58) and an 83% click-through rate (5 clicks / 6 impressions), was used to optimize the sentiment computing model's strategy matching weights for "negative-strong" sentiment.

[0208] In an embodiment of the present application, the method achieves closed-loop optimization of service strategies by adjusting service presentation in real time and continuously collecting feedback, enabling the system to continuously improve the accuracy of emotion recognition and service recommendations.

[0209] Figure 2 This is a schematic diagram of the structure of an intelligent customer lifecycle management AiCRM system provided in an embodiment of the present application, such as Figure 2 As shown, the system includes:

[0210] The acquisition module 21 is configured to acquire voice call records, real-time facial expression images and text feedback data of the target customer during interaction between the target customer and the enterprise.

[0211] The analysis module 22 is configured to perform semantic analysis on the voice call records and the text feedback data, dynamic feature recognition on the facial expression images, cross-modal correlation between the semantic analysis result and the dynamic feature recognition result, and generation of a customer emotion feature set.

[0212] The update module 23 is configured to dynamically update a customer emotion evolution graph in a preset multi-modal customer emotion database based on the customer emotion feature set.

[0213] The first generation module 24 is configured to generate a target customer emotion score of the target customer based on the updated customer emotion evolution graph and the customer emotion feature set by using an emotion computing model.

[0214] The second generation module 25 is configured to generate service strategy adjustment information matched with a current emotion state and a historical emotion change trend of the customer when the customer emotion score is lower than a preset service baseline, so as to realize intelligent customer lifecycle management (AiCRM).

[0215] Figure 2 The intelligent customer lifecycle management (AiCRM) system can perform the following steps Figure 1 The intelligent customer lifecycle management (AiCRM) method of the embodiments has the same implementation principles and technical effects as the system, and will not be described in detail here.

[0216] In one possible design, Figure 2 The intelligent customer lifecycle management (AiCRM) system can be implemented as a computing device, such as a server. Figure 3 As shown in the figure, the computing device can include a storage component 31 and a processing component 32.

[0217] The storage component 31 stores one or more computer instructions, wherein the one or more computer instructions are called and executed by the processing component 32.

[0218] The processing component 32 is configured to perform the above Figure 1 The intelligent customer lifecycle management (AiCRM) method of the embodiments.

[0219] The processing component 32 can include one or more processors to execute computer instructions to complete all or part of the steps in the above method. Of course, the processing component can also be one or more Application-Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Process Device (DSPD), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components, for executing the above method.

[0220] The storage component 31 is configured to store various types of data to support the operation of the terminal. The storage component can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as Static Random-Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0221] Of course, the computing device can also include other components, such as an input / output interface, a display component, a communication component, etc.

[0222] The input / output interface provides an interface between the processing component and peripheral interface modules, which can be output devices, input devices, etc.

[0223] The communication component is configured to facilitate wired or wireless communication between the computing device and other devices, etc.

[0224] The computing device can be a physical device or an elastic computing host provided by a cloud computing platform, and the computing device can refer to a cloud server, and the processing component, the storage component, etc. can be basic server resources rented or purchased from the cloud computing platform.

[0225] The embodiment of the application further provides a computer storage medium, which stores a computer program, and the computer program can realize the above-mentioned Figure 1 An intelligent customer lifecycle management AiCRM method of the embodiment shown.

[0226] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-mentioned system, device and unit can refer to the corresponding processes in the foregoing method embodiments, and will not be described here.

[0227] The device embodiments described above are only schematic, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, that is, can be located in one place, or can be distributed on multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiment scheme. Those skilled in the art can understand and implement without creative labor.

[0228] Through the foregoing description of the embodiments, those skilled in the art can clearly understand that each embodiment can be realized by means of software and the necessary general hardware platform, and of course, can also be realized by hardware. Based on such understanding, the foregoing technical solutions can be embodied in the form of software products, and the computer software product can be stored in a computer readable storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the method described in each embodiment or some parts of the embodiment.

[0229] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the application, and not to limit them; although the application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement to some technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the application.

Claims

1. An intelligent customer lifecycle management AiCRM method, characterized by: include: During the interaction between target customers and enterprises, obtain target customers' voice call records, real-time facial expression images and text feedback data; Performing semantic analysis on the voice call records and the text feedback data, performing dynamic feature recognition on the facial expression images, and cross-modally correlating the semantic analysis results with the dynamic feature recognition results to generate a customer emotion feature set; Based on the customer emotion feature set, dynamically updating the customer emotion evolution graph in the preset multimodal customer emotion database; Based on the updated customer emotion evolution graph and the customer emotion feature set, a sentiment computing model is used to generate a target customer emotion score for the target customer; When the customer's emotional score is lower than the preset service baseline, service strategy adjustment information is generated that matches the customer's current emotional state and historical emotional change trends to achieve intelligent customer lifecycle management AiCRM; The step of generating a target customer sentiment score for the target customer using a sentiment computing model based on the updated customer sentiment evolution graph and the customer sentiment feature set includes: Dividing the updated customer emotion evolution graph into multiple historical emotion segments according to a preset time window, and extracting the emotion polarity label distribution density corresponding to the voice call record, the real-time facial expression image, and the text feedback data in each historical emotion segment; Discretizing and marking the current emotion polarity label in the customer emotion feature set; Calculating a target association strength value between the current emotion polarity label and each historical emotion segment based on the emotion polarity label distribution density; Assigning a weight value to each historical emotion segment according to the target association strength value, and linearly superimposing the weight value with the discretization labeling result to generate an emotion state fusion vector; Inputting the emotional state fusion vector into the emotional computing model and outputting the target customer emotional score; The step of inputting the emotion state fusion vector into an emotion computing model and outputting a target customer emotion score includes: By using an emotion calculation model, the emotion state fusion vector is divided into a historical emotion weight component and a current emotion tag component according to a preset dimension; Performing hierarchical processing on the historical sentiment weight components, and adjusting the superposition coefficient of each layer according to the target association strength value in each processing layer; Interlacing and splicing the adjusted superposition coefficient with the current emotion tag component to generate a hierarchical fusion signal; Using the dynamic aggregation nodes of the sentiment computing model, the difference between the historical sentiment weight component and the current sentiment label component in the hierarchical fusion signal of each level is compared layer by layer to generate the hierarchical contribution parameter; selectively activating transmission paths in the dynamic aggregation node according to the hierarchical contribution parameter; Perform scalar compression on the output signal of the activated transmission path to generate an initial customer sentiment score; Based on the statistical deviation of the distribution density of the sentiment polarity labels, boundary constraints are performed on the initial customer sentiment scores, and the target customer sentiment scores are output.

2. The method according to claim 1, characterized in that The dynamic aggregation node of the emotion calculation model is used to compare the difference between the historical emotion weight component and the current emotion label component in the hierarchical fusion signal of each level layer by layer to generate the hierarchical contribution parameter, including: Split the hierarchical fusion signal of each level into historical signal segments and current signal segments according to a preset ratio; Performing amplitude accumulation calculation on the historical signal segment and the current signal segment respectively to obtain a historical cumulative amplitude and a current cumulative amplitude; generating a level difference amplitude according to an absolute value of a difference between the historical cumulative amplitude and the current cumulative amplitude; Comparing the level difference amplitude with a preset difference threshold, and activating a difference accumulator corresponding to the level if the level difference amplitude exceeds the preset difference threshold; Directionally mark the signal output by the activated difference accumulator; Based on the directional marking results, polarity weighting is performed on the signals output by the difference accumulators in the same level to generate a level difference index; The hierarchical difference index of each level is accumulated in a sliding window according to the preset aggregation rules to generate the hierarchical contribution parameter.

3. The method according to claim 1, characterized in that The calculating, based on the distribution density of the emotion polarity label, the target association strength value between the current emotion polarity label and each historical emotion segment includes: The emotional polarity labels in each historical emotional segment are classified and counted according to the preset emotional categories, and the emotional category distribution histogram of each historical emotional segment is generated; Performing category matching on the current emotion polarity label to determine the emotion category to which the current emotion polarity label belongs; Calculate the frequency of occurrence of the emotion category in each emotion category distribution histogram; Generating an initial correlation strength value according to the degree of deviation between the occurrence frequency ratio and a preset benchmark frequency; Based on the time decay coefficient of each historical emotion segment, the initial association strength value is corrected to generate a target association strength value.

4. The method according to claim 1, wherein When the customer's emotion score is lower than the preset service baseline, generating service strategy adjustment information that matches the customer's current emotion state and historical emotion change trend, including: According to the customer emotion evolution graph, establish an emotion polarity label change curve of N interaction cycles, where N is greater than or equal to 2; Matching the emotion polarity label corresponding to the customer's current emotion state with the key turning point in the emotion polarity label change curve to determine the stage position of the customer's current emotion state in the historical emotion change trend; Selecting a corresponding strategy combination in a preset strategy template library according to the stage position; comparing the customer sentiment score to a preset service baseline; According to the comparison result, parameter enhancement processing is performed on the policy combination to generate service policy adjustment information.

5. The method according to claim 1, wherein After generating service strategy adjustment information that matches the customer's current emotional state and historical emotional change trends, the method further includes: According to the service strategy adjustment information, the service content display order in the interaction process between the target customer and the enterprise is adjusted in real time, and the emotional tendency label in the customer emotional evolution map is updated; After the customer completes the current interaction, a closed-loop feedback signal is generated based on the adjusted service content display order and the changing trend of the customer's emotional score. The closed-loop feedback signal is used to iteratively optimize the mapping relationship between the emotional computing model and the service strategy adjustment information.

6. An intelligent customer lifecycle management AiCRM system, characterized by: include: The acquisition module is used to obtain the target customer's voice call records, real-time facial expression images and text feedback data during the interaction between the target customer and the enterprise; An analysis module is configured to perform semantic analysis on the voice call records and the text feedback data, perform dynamic feature recognition on the facial expression images, and perform cross-modal correlation between the semantic analysis results and the dynamic feature recognition results to generate a customer emotion feature set; An updating module, configured to dynamically update a customer emotion evolution graph in a preset multimodal customer emotion database based on the customer emotion feature set; A first generating module is configured to generate a target customer sentiment score of the target customer using a sentiment computing model based on the updated customer sentiment evolution graph and the customer sentiment feature set; The second generation module is used to generate service strategy adjustment information that matches the customer's current emotional state and historical emotional change trends when the customer's emotional score is lower than the preset service baseline, so as to realize intelligent customer lifecycle management AiCRM; The step of generating a target customer sentiment score for the target customer using a sentiment computing model based on the updated customer sentiment evolution graph and the customer sentiment feature set includes: Dividing the updated customer emotion evolution graph into multiple historical emotion segments according to a preset time window, and extracting the emotion polarity label distribution density corresponding to the voice call record, the real-time facial expression image, and the text feedback data in each historical emotion segment; Discretizing and marking the current emotion polarity label in the customer emotion feature set; Calculating a target association strength value between the current emotion polarity label and each historical emotion segment based on the emotion polarity label distribution density; Assigning a weight value to each historical emotion segment according to the target association strength value, and linearly superimposing the weight value with the discretization labeling result to generate an emotion state fusion vector; Inputting the emotional state fusion vector into the emotional computing model and outputting the target customer emotional score; The step of inputting the emotional state fusion vector into an emotional computing model and outputting a target customer emotional score includes: By using an emotion calculation model, the emotion state fusion vector is divided into a historical emotion weight component and a current emotion tag component according to a preset dimension; Performing hierarchical processing on the historical sentiment weight components, and adjusting the superposition coefficient of each layer according to the target association strength value in each processing layer; Interlacing and splicing the adjusted superposition coefficient with the current emotion tag component to generate a hierarchical fusion signal; Using the dynamic aggregation nodes of the sentiment computing model, the difference between the historical sentiment weight component and the current sentiment label component in the hierarchical fusion signal of each level is compared layer by layer to generate the hierarchical contribution parameter; selectively activating transmission paths in the dynamic aggregation node according to the hierarchical contribution parameter; Perform scalar compression on the output signal of the activated transmission path to generate an initial customer sentiment score; Based on the statistical deviation of the distribution density of the sentiment polarity labels, boundary constraints are performed on the initial customer sentiment scores, and the target customer sentiment scores are output.

7. A computing device, characterized in that It includes a processing component and a storage component; the storage component stores one or more computer instructions; the one or more computer instructions are used to be called and executed by the processing component to implement an intelligent customer lifecycle management AiCRM method as described in any one of claims 1 to 5.

8. A computer storage medium, characterized in that A computer program is stored, and when the computer program is executed by a computer, an intelligent customer lifecycle management AiCRM method according to any one of claims 1 to 5 is implemented.

Citation Information

Patent Citations

  • Service strategy adjustment method and device based on emotion recognition, equipment and medium

    CN119579182A

  • Intelligent customer service interaction method and system

    CN119721058A