Customer service system control method and device and computer readable storage medium
Through in-depth analysis of intelligent customer service dialogue data and real-time communication sessions, the problems of long waiting time and low service efficiency caused by manual customer service rebrowsing dialogues in the online customer service system are solved, and more efficient and accurate customer service is achieved.
Patent Information
- Application Number
- CN202411526497.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-30
- Publication Date
- 2024-11-29
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the existing online customer service system, manual customer service needs to rebrowse all previous conversations, resulting in long wait times for customers and low service efficiency, and customers need to re-describe the problem, which increases waiting and complexity.
Through pre-trained machine learning model, the intelligent customer service dialogue data is conducted in-depth analysis, and the customer's target needs and the reasons for the conversion of service methods are determined, clear service guidance is provided to manual customer service, concise prompt information is generated, and the client and manual customer service are established. Real-time communication sessions ensure real-time communication of information.
It improves the efficiency and accuracy of customer service, enables manual customer service to quickly understand customer needs, reduces waiting time, and improves the service efficiency of the intelligent customer service system.
Smart Images

Figure CN119052379A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication technology, and in particular to a control method, device and computer-readable storage medium for a customer service system. Background Art
[0002] In the current online customer service system, when a customer needs manual customer service video service, the manual customer service has to review all previous conversations again, resulting in a long waiting time for the customer. If the manual customer service asks again, the customer needs to describe the problem again. Therefore, the service efficiency of the current intelligent customer service system is low.
[0003] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention
[0004] The main purpose of this application is to provide a control method, device and computer-readable storage medium for a customer service system, aiming to solve the technical problem of how to improve the service efficiency of an intelligent customer service system.
[0005] To achieve the above objectives, the present application proposes a control method for a customer service system, the method comprising: When receiving a manual customer service request from the client, obtain the intelligent customer service conversation data; Inputting the intelligent customer service conversation data into a pre-trained analysis model to determine the corresponding target demand of the client and / or the reason for the service mode conversion; Generate prompt information according to the target demand and / or the reason for the service mode conversion; A communication session is established between the client and the manual client, and the manual client is controlled to display the prompt information.
[0006] In one embodiment, before the step of obtaining intelligent customer service dialogue data when receiving a manual customer service request sent by a client, the step includes: Receive a consultation request sent by a client, and determine a consultation text according to the consultation request; Input the consultation text into the intelligent customer service model to obtain knowledge point data corresponding to the consultation request; A response text corresponding to the consultation request is generated according to the knowledge point data, and the response text is sent to the client.
[0007] In one embodiment, before the step of inputting the intelligent customer service dialogue data into a pre-trained analysis model to determine the client's corresponding target demand and / or the reason for the service mode conversion, the step includes: Acquire historical conversation data of intelligent customer service, and perform data cleaning and preprocessing on the historical conversation data; Constructing training data and verification data for the analysis model based on the processed historical conversation data and the annotation information corresponding to the historical conversation data; The analysis model is trained based on the training data, and the training result of the analysis model is verified based on the verification data.
[0008] In one embodiment, the step of establishing a communication session between the client and the manual client and controlling the manual client to display the prompt information includes: According to the target demand and / or the reason for the service mode conversion, a target manual customer service terminal with corresponding knowledge is matched, and a communication address of the target manual customer service terminal is determined; According to the communication address, a session connection is established between the client and the target artificial customer service terminal; The prompt information is sent to the target artificial client terminal through the session connection to control the target artificial client terminal to render the prompt information.
[0009] In one embodiment, after the step of establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information, the method further includes: In response to the video session creation instruction, establishing a video session between the client and the artificial customer service terminal; Receive the client liveness recognition result fed back by the authentication end, send the liveness recognition result to the artificial client end, and control the artificial client end to display the liveness recognition result in the video conversation reality interface.
[0010] In one embodiment, after the step of establishing a video session between the client and the artificial client in response to the video session creation instruction, the step further includes: Receive the real-time video data stream sent by the client, and write the real-time video data stream into a cache area; Execute a first forwarding action and a second forwarding action corresponding to the real-time video data stream, wherein the first forwarding action is to forward the real-time video data stream in the cache area based on the communication address corresponding to the artificial client end, and the second forwarding action is to forward the real-time video data stream in the cache area based on the communication address of the authentication end; When the first forwarding action and the second forwarding action are completed, the real-time video data stream in the cache area is cleared.
[0011] In one embodiment, after the step of establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information, the following steps are included: Receiving a screen sharing request from the artificial client terminal and / or the client terminal, and transmitting the screen content of the artificial client terminal and / or the client terminal to the other terminal in real time; According to the screen annotation operation of the manual customer service end and / or the client end, the annotated content is synchronously displayed on the screens of both parties; If a document signing request is received from the manual customer service end and / or the client end, the handwritten signature is recognized by an online signature tool, and the handwritten signature is converted into a digital signature and saved; The call data of the communication session is recorded and saved in a log file.
[0012] In one embodiment, after the step of establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information, the method further includes: Converting the voice consultation request of the customer in the communication session into text consultation through voice recognition technology; According to the text consultation input intelligent customer service model, obtain the knowledge point data corresponding to the voice consultation request; The knowledge point data corresponding to the voice consultation request is sent to the manual customer service end.
[0013] In addition, to achieve the above-mentioned purpose, the present application also proposes a control device for a customer service system, the device comprising: a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the control method for the customer service system as described above.
[0014] In addition, to achieve the above-mentioned purpose, the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the control method of the customer service system described above are implemented.
[0015] The present application provides a control method for a customer service system. The present application first uses a pre-trained machine learning model to perform an in-depth analysis of intelligent customer service conversation data using natural language processing technology, thereby accurately inferring the customer's target needs or the reason for the change in service mode, providing clear service guidance for manual customer service, and improving the efficiency and accuracy of customer service. By converting the results output by the analysis model into concise prompt information, it directly reflects the customer's needs or the reason for the service change, allowing the manual customer service to quickly understand and respond, thereby improving processing efficiency. By establishing a real-time communication session between the client and the manual customer service, and pushing the generated prompt information to the manual customer service end, the real-time transmission of information is ensured, further improving the service efficiency of the intelligent customer service system. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0018] Figure 1 A flowchart of the first embodiment of the control method of the customer service system of the present application is provided; Figure 2 A flow chart of the second embodiment of the control method of the customer service system of this application; Figure 3 A flowchart diagram of the third embodiment of the control method of the customer service system of this application; Figure 4 A flowchart diagram of a fourth embodiment of the control method of the customer service system of the present application is provided; Figure 5 A flowchart diagram of a fifth embodiment of the control method of the customer service system of the present application is provided; Figure 6 A flowchart diagram of the sixth embodiment of the control method of the customer service system of this application is provided; Figure 7 A flow chart of the seventh embodiment of the control method of the customer service system of the present application; Figure 8 Schematic diagram of the device structure of the hardware operating environment involved in the control method of the customer service system in the embodiment of the present application.
[0019] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0020] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.
[0021] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.
[0022] The main solutions of the embodiments of this application are: At present, in the online customer service system, when a customer needs manual customer service video service, the manual customer service has to review all previous conversations again, resulting in a long waiting time for the customer. If the manual customer service asks again, the customer needs to describe the problem again. Therefore, the service efficiency of the current intelligent customer service system is low.
[0023] This application uses natural language processing technology through a pre-trained machine learning model to conduct in-depth analysis of intelligent customer service conversation data, thereby accurately inferring the customer's target needs or the reasons for the change in service methods, providing clear service guidance for manual customer service, and improving the efficiency and accuracy of customer service. By converting the results of the analysis model output into concise prompt information, it directly reflects the customer's needs or the reasons for the service conversion, allowing manual customer service to quickly understand and respond, improving processing efficiency. By establishing a real-time communication session between the client and manual customer service, and pushing the generated prompt information to the manual customer service end, it ensures real-time transmission of information, further improving the service efficiency of the intelligent customer service system.
[0024] It should be noted that the execution subject of this embodiment can be a control device of the customer service system, or a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., and this embodiment does not specifically limit this. The following takes the control device of the customer service system as an example of the execution subject to illustrate this embodiment and the following embodiments.
[0025] Embodiment 1 Based on this, the present application proposes a control method for a customer service system of the first embodiment, please refer to Figure 1 , the control method of the customer service system includes: Step S10, when receiving a manual customer service request sent by the client, obtaining intelligent customer service conversation data.
[0026] Before the customer request is transferred to manual customer service, the conversation data between the intelligent customer service and the customer is captured and collected in a timely manner to facilitate the subsequent analysis of customer needs. By obtaining this data, the customer service process can be managed more effectively, the customer experience can be improved, and the collaborative work efficiency between intelligent customer service and manual customer service can be optimized.
[0027] In this embodiment, the client refers to the terminal device used by the customer to initiate a service request, which is used to interact with the intelligent customer service or manual customer service. Manual customer service requests are requests sent by customers through the client when the intelligent customer service cannot meet their needs, requesting further communication with the manual customer service. Intelligent customer service conversation data is data generated during the interaction between the intelligent customer service and the customer, including customer questions, intelligent customer service answers, interaction timestamps, conversation contexts, and other data.
[0028] As an optional implementation, when a customer is having a conversation with intelligent customer service, the communication data between the client and the intelligent customer service is captured in real time and recorded in the log of the intelligent customer service system. When a manual customer service request is received from the client, the intelligent customer service conversation data in the log is obtained.
[0029] Step S20, inputting the intelligent customer service dialogue data into a pre-trained analysis model to determine the corresponding target demand of the client and / or the reason for the service mode conversion.
[0030] Use pre-trained analytical models to conduct in-depth analysis of intelligent customer service conversation data, so as to accurately identify the client's specific target needs and possible reasons for changing service methods, understand customer intentions more accurately, and provide strong data support for subsequent customer service strategy formulation and manual customer service intervention, thereby improving the pertinence and efficiency of customer service and enhancing customer satisfaction.
[0031] In this embodiment, the pre-trained analysis model refers to a machine learning model obtained by training with a large amount of historical data, which can understand and analyze natural language text and identify key information in the text. Target demand refers to the specific problem that the customer hopes to solve or the goal to be achieved when initiating a service request. The reason for the service mode conversion refers to the motivation or reason for the customer to switch from using intelligent customer service to requesting manual customer service, including questions that the intelligent customer service cannot answer, the customer is dissatisfied with the answer of the intelligent customer service, and needs more personalized services.
[0032] As an optional implementation, the intelligent customer service conversation data is cleaned to remove irrelevant information; based on natural language recognition technology, the syntactic structure of the conversation data is parsed and the features of the conversation data are extracted; the features are analyzed through an analysis model to determine the client's corresponding target needs and / or the reason for the service mode conversion.
[0033] In this embodiment, text cleaning refers to preprocessing text data to remove or correct information that does not meet the requirements or affects subsequent processing. By removing irrelevant information such as noise, advertisements, repeated content, non-standard characters, etc. in the dialogue data, it is ensured that the subsequent natural language processing and analysis are more accurate, and misjudgment and unnecessary computational burden are reduced. Natural language recognition technology refers to the technology of converting human language into a form that can be understood and processed by computers, including syntactic analysis, semantic understanding and other aspects. Syntactic structure refers to the grammatical relationship between words in a sentence, revealing the composition framework of the sentence and the dependency relationship between each component, such as subject-predicate-object structure, attributive-adverbial-complement structure, etc. Features refer to the iconic information extracted from the dialogue data that can represent the user's intention or dialogue content. Parse the syntactic structure and extract features to deeply understand the dialogue content and provide structured information for subsequent analysis models. By identifying the syntactic components such as the subject, predicate, and object of the sentence, and extracting features such as keywords and phrases, the user's intention and needs can be captured more effectively. The features are analyzed by the analysis model to identify the user's real needs and the reasons for the conversion of service methods, thereby providing decision support for the intelligent customer service system, which helps to improve user experience, optimize service processes, and improve customer satisfaction.
[0034] For example, regular expressions are used to match and remove advertising links, special symbols, non-standard characters, etc.; stop word filtering is used to remove common words in the conversation that are meaningless to the analysis; and hashing algorithms or similarity calculations are used to remove repeated sentences or paragraphs in the conversation. Natural language processing tools are used to perform syntactic analysis on the intelligent customer service conversation data to generate a syntactic tree to show the grammatical relationship between the various components in the sentence; based on the results of syntactic analysis, key features in the conversation data are extracted. Classification models are used to classify features to determine the user's target needs, regression models are used to analyze the association between features and service mode conversion to determine the reasons for the conversion, and clustering models are used to cluster features to discover potential patterns and trends in user needs.
[0035] Optionally, key features include lexical features, syntactic features and semantic features; lexical features reflect the theme or core content of the conversation, such as keywords, phrases, etc.; syntactic features reveal the grammatical relationship and structural characteristics within the sentence, such as dependency relationships, the structure of the syntax tree, etc.; semantic features further enrich the semantic information of the conversation, such as named entities, sentiment tendencies, etc.
[0036] Step S30: generating prompt information according to the target demand and / or the reason for the service mode conversion.
[0037] Based on the customer's specific target needs or reasons for changing service methods, appropriate prompt information is generated and provided to manual customer service to help manual customer service understand the customer's situation more comprehensively, so that they can more accurately answer the customer's questions, provide more considerate services, or guide the customer to complete the required business operations.
[0038] In this embodiment, the prompt information is information prepared to assist the manual customer service to better understand the customer's situation, including the customer's specific needs, the reason for the service mode change, and any relevant background information.
[0039] Step S40: establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information.
[0040] A communication session is established between the client and the manual customer service end so that the customer and the manual customer service end can communicate in real time. At the same time, by controlling the manual customer service end to display specific prompt information, the manual customer service end can quickly and accurately obtain the necessary information about the customer to ensure that the customer's questions or needs can be answered or handled in a timely and accurate manner.
[0041] Optionally, step S40 includes: Step S41, matching a target manual customer service terminal with corresponding knowledge according to the target demand and / or service mode conversion reason, and determining the communication address of the target manual customer service terminal.
[0042] After receiving the customer's manual customer service request and identifying the customer's target needs or the specific reason for choosing to change the service method, we match the manual customer service with corresponding expertise and experience to provide more professional services.
[0043] In this embodiment, the communication address is address information required for establishing a communication session with a target manual customer service end, including an IP address, a telephone number, an ID of an instant messaging software, and the like.
[0044] Exemplarily, according to the customer's target needs and / or reasons for changing the service method, relevant knowledge points are searched in the internal knowledge base, human customer service personnel with corresponding professional knowledge and experience are selected as target human customer service personnel, and the communication address information corresponding to the target human customer service personnel is queried.
[0045] Optionally, a candidate list is generated based on the screened human customer service personnel with corresponding professional knowledge and experience, and the corresponding work status of the human customer service personnel is further queried to screen idle human customer service personnel as target human customer service personnel.
[0046] Optionally, based on the screened idle human customer service representatives, the candidate list is further optimized, and skill assessment is performed based on factors such as the human customer service representative's historical service record, customer satisfaction score, and professional knowledge test results, and the human customer service representative with the highest assessment level is selected as the target human customer service representative.
[0047] Step S42: creating a session connection between the client and the target artificial client according to the communication address.
[0048] As an optional implementation, the communication address information is parsed, and according to the parsed communication address and the video communication protocol, the communication session parameters are set to establish a communication connection for the video session between the client and the artificial customer service end.
[0049] In this embodiment, the video communication protocol refers to a protocol used to transmit video, audio and data information between the client and the artificial customer service end, including WebRTC (Web Real-Time Communication), RTMP (Real Time Messaging Protocol), HLS (HTTP Live Streaming), etc. The communication session parameters refer to a series of configuration information required to establish a video communication connection, including but not limited to video resolution, frame rate, audio encoding format, network transmission protocol, port number, IP address, etc. The video communication connection refers to a real-time video and audio transmission channel established between the client and the artificial customer service end through the video communication protocol for face-to-face communication.
[0050] Exemplarily, a suitable video communication protocol is selected based on the compatibility between the client and the artificial customer service end, network conditions and service quality requirements, and the communication address is parsed to determine the network type, address format and other information to which it belongs. Based on the parsed communication address information and the requirements of the selected protocol, parameters such as video resolution, frame rate, and audio encoding format are configured to ensure the quality of video communication. Using the configured parameters, a video communication connection is established between the client and the artificial customer service end through the video communication protocol.
[0051] Step S43: sending the prompt information to the target artificial client terminal through the session connection to control the target artificial client terminal to render the prompt information.
[0052] On the established communication connection, key prompt information is accurately transmitted to the manual customer service end, and according to the preset rules and format, this information is displayed in the most appropriate way on the manual customer service end interface to improve the work efficiency of the manual customer service.
[0053] In this embodiment, the preset rules refer to a series of rules for controlling the display mode of prompt information on the manual customer service end, including the position, size, color, font, scrolling mode, etc. of the information display.
[0054] Exemplarily, the stability of the session link is checked, prompt information is transmitted to the manual client terminal through the session link, and according to preset rules, the manual client terminal is controlled to display the prompt information on the interface.
[0055] Optionally, the preset rule may be a rule pre-defined by the system, or may be a display rule for prompt information set by a manual customer service according to actual needs.
[0056] The present embodiment provides a control method for a customer service system. The present embodiment first uses a pre-trained machine learning model to perform an in-depth analysis of the intelligent customer service conversation data using natural language processing technology, thereby accurately inferring the customer's target needs or the reason for the service mode conversion, providing clear service guidance for manual customer service, and improving the efficiency and accuracy of customer service. By converting the results of the analysis model output into concise prompt information, it directly reflects the customer's needs or the reason for the service conversion, so that the manual customer service can quickly understand and respond, thereby improving processing efficiency. By establishing a real-time communication session between the client and the manual customer service, and pushing the generated prompt information to the manual customer service end, it ensures the real-time transmission of information, and further improves the service efficiency of the intelligent customer service system.
[0057] Based on the first embodiment, the second embodiment of the present application proposes a control method of a customer service system, referring to Figure 2 , before step S10, including: Step S50, receiving a consultation request sent by the client, and determining a consultation text according to the consultation request.
[0058] Receiving and processing consultation requests from clients in an intelligent way to provide fast and accurate answers or services helps improve customer experience and reduce the burden on manual customer service.
[0059] In this embodiment, the consultation request is inquiry or request information input by the customer through the client.
[0060] Step S60: input the consultation text into an intelligent customer service model to obtain knowledge point data corresponding to the consultation request.
[0061] The intelligent customer service model is used to efficiently and accurately identify the consultation requests sent by customers, and match them to the corresponding knowledge point data based on the identification results, so as to provide customers with accurate, timely and valuable information answers or services.
[0062] In this embodiment, the knowledge point data is information stored in the knowledge base of the intelligent customer service system, covering various questions that users may ask and their corresponding answers.
[0063] Exemplarily, the consultation request is passed to the intelligent customer service model for processing. The natural language processing capabilities of the intelligent customer service model are used to pre-process the consultation request and analyze the key information in the consultation request to determine the user's intentions and needs. Based on the identified user intentions and needs, the knowledge base is searched for relevant knowledge point data by keywords.
[0064] Optionally, an intelligent customer service model is trained by collecting text data and corresponding knowledge point data in related fields, and performing data cleaning and preprocessing operations, and the processed text data and corresponding knowledge point data are input into the intelligent customer service model for training.
[0065] Step S70: Generate a response text corresponding to the consultation request based on the knowledge point data, and send the response text to the client.
[0066] Based on the consultation request raised by the client, the existing knowledge point data is used to intelligently generate the corresponding response text to answer the client's questions, provide the required information or guide them to the next step.
[0067] In this embodiment, the response text is generated based on the consultation request and the knowledge point data, and is used to answer the client's questions, provide information, or guide operations.
[0068] Exemplarily, according to the matched knowledge points, combined with the specific content and format requirements of the consultation request, a corresponding response text is generated and sent to the client.
[0069] This embodiment provides a control method for a customer service system. This embodiment first receives a consultation request sent by a client, uses an intelligent customer service model to accurately identify the customer's intention, quickly matches relevant knowledge point data from the knowledge base, and generates a response text, which is immediately fed back to the customer in a clear text form, thereby improving the customer service experience and significantly improving service efficiency and quality.
[0070] Based on the first embodiment, the third embodiment of the present application proposes a control method for a customer service system, referring to Figure 3 , before step S20, including: Step S80, obtaining historical conversation data of the intelligent customer service, and performing data cleaning and preprocessing on the historical conversation data.
[0071] In this embodiment, data cleaning and preprocessing refers to operations such as screening, deduplication, and formatting of the collected historical conversation data to eliminate noise and improve data quality.
[0072] Exemplarily, an automated tool is used to export historical conversation data from the intelligent customer service system, including conversation time, client ID, conversation content, etc., and the data is cleaned to remove duplicate conversations, filter irrelevant information, and unify the data format.
[0073] Step S90, constructing training data and verification data for the analysis model based on the processed historical conversation data and the annotation information corresponding to the historical conversation data.
[0074] In this embodiment, the annotation information is used to mark each data item in the historical conversation data, clarify the corresponding target requirements and reasons for the service mode conversion, and serve as labels for model training.
[0075] Exemplarily, the cleaned data is labeled according to target requirements and reasons for service mode conversion, and the labeled data is divided into training data and verification data.
[0076] Step S100: training the analysis model based on the training data, and verifying the training result of the analysis model based on the verification data.
[0077] Exemplarily, the model is trained using training data through a machine learning algorithm, and the model parameters are adjusted through an iterative optimization algorithm so that the model can accurately identify user intentions and service conversion rules. The trained model is evaluated using verification data, and the model's accuracy, recall rate and other indicators are calculated. The model parameters are adjusted based on the verification results to improve the model's performance.
[0078] As an example of this embodiment, historical conversation data is exported from the intelligent customer service system using special tools or interfaces, including key information such as conversation time, client ID, and conversation content. Data cleaning operations such as removing duplicate data, processing missing values, and unifying data formats are performed. The data is annotated according to target needs and reasons for service mode conversion, and preprocessing operations such as text segmentation, stop word removal, and stem extraction are performed. The preprocessed historical conversation data is input into the model as a training set for training. The trained model is verified using validation set data, and the performance indicators of the model are evaluated. The model is regularly evaluated using new test set data, and the model's hyperparameters are adjusted based on the evaluation results. The model is iteratively optimized to continuously improve the recognition capability and service quality of the intelligent customer service.
[0079] This embodiment provides a control method for a customer service system. This embodiment first collects historical conversation data of intelligent customer service, and performs data cleaning and preprocessing operations to ensure the accuracy of the data. The processed data is input into the model for training, and the model is verified using validation set data to evaluate its performance indicators. The hyperparameters of the model are adjusted according to the evaluation results, and iterative optimization is performed to improve the recognition ability of the intelligent customer service, so that it can more accurately identify the client's needs and the reasons for the change in service mode.
[0080] Based on the first embodiment, the fourth embodiment of the present application proposes a control method for a customer service system, referring to Figure 4 , after step S40, comprising: Step S110 , in response to the video session creation instruction, establishing a video session between the client and the artificial client.
[0081] Step S120, receiving the client liveness recognition result fed back by the authentication end, sending the liveness recognition result to the artificial client end, and controlling the artificial client end to display the liveness recognition result in the video conversation reality interface.
[0082] In this embodiment, the authentication end refers to the server or device responsible for identity authentication, which processes the video data using computer vision and machine learning algorithms. The liveness recognition result is the conclusion drawn by the authentication end after liveness recognition of the client user, which is used to distinguish between real organisms and forgeries to ensure the authenticity of identity authentication.
[0083] Exemplarily, the video data from the client is received through the authentication end, computer vision technology is used to extract key features in the video, and machine learning algorithms are applied to analyze and compare these features to determine whether the customer in the video is a real living person. An authentication result is generated based on the analysis result to confirm the identity of the customer, and the liveness recognition result fed back by the authentication end is received and sent to the manual customer service end, which controls the video session reality interface to display the result in an appropriate position.
[0084] Optionally, if the identification result is that the verification is passed, the manual client end is prompted to continue the service; if the identification result is that the verification fails, the manual client end is prompted to terminate the service, and the verification failure information is sent to the client and recorded.
[0085] The present embodiment provides a control method for a customer service system. The present embodiment first realizes rapid and accurate verification of customer identity through real-time video acquisition and processing technology combined with computer vision and machine learning algorithms. Through liveness detection technology, it can effectively prevent the use of forged means such as photos and videos for identity authentication, ensuring that the person interacting with the customer service is a real person. The identification results are synchronously displayed on the manual customer service end, which can help customer service personnel quickly confirm the customer identity and improve service efficiency.
[0086] Based on the fourth embodiment, the fifth embodiment of the present application proposes a control method for a customer service system, referring to Figure 5 , after step S110, including: Step S130: receiving the real-time video data stream sent by the client, and writing the real-time video data stream into a cache area.
[0087] In this embodiment, the cache area is a storage space in the system for temporarily storing real-time video data streams.
[0088] Exemplarily, the real-time video data stream sent by the receiving client is immediately written into the pre-allocated buffer area.
[0089] Optionally, pre-processing operations such as format conversion and compression are performed on the data stream to meet the needs of subsequent forwarding and display.
[0090] Optionally, manage the use of cache regions by setting cache size limits, monitoring cache usage, and implementing cache replacement policies to avoid cache overflow or data loss.
[0091] Step S140, execute the first forwarding action and the second forwarding action corresponding to the real-time video data stream, wherein the first forwarding action is to forward the real-time video data stream in the cache area based on the communication address corresponding to the artificial customer service end, and the second forwarding action is to forward the real-time video data stream in the cache area based on the communication address corresponding to the authentication end.
[0092] Exemplarily, for the first forwarding action, the real-time video data stream in the cache area is read and forwarded to the artificial client terminal through the network according to the communication address of the artificial client terminal.
[0093] Exemplarily, for the second forwarding action, the real-time video data stream in the cache area is read and forwarded according to the communication address of the authentication end.
[0094] Step S150: when the first forwarding action and the second forwarding action are completed, clear the real-time video data stream in the cache area.
[0095] In this embodiment, the forwarded real-time video data stream in the cache area is cleared to release storage space and prevent the cache area from being occupied for a long time.
[0096] As an example of the system architecture of the customer service system of the present application, the customer service system includes a client, a server, an artificial customer service end and an identification end, and the server includes a receiving module, a cache area, a first forwarding module, a second forwarding module and a clearing module. Among them, the receiving module is responsible for receiving the real-time video data stream from the client; the received real-time video data stream is temporarily stored in the cache area for subsequent forwarding; the first forwarding module reads the real-time video data stream in the cache area and forwards it according to the communication address of the artificial customer service end; the real-time video data stream in the cache area is read by the second forwarding module, but forwarded according to the communication address of the identification end; the clearing module is responsible for clearing the real-time video data stream in the cache area after the first forwarding and the second forwarding are completed.
[0097] As an example of the workflow of the customer service system of the present application, the client is controlled to send a real-time video data stream to the server; the real-time video data stream is received through the server and written into the cache area, and the first forwarding module and the second forwarding module are started at the same time to forward the real-time video data stream in the cache area to the manual customer service end and the identification end respectively; the real-time video data stream is received and displayed based on the manual customer service end; the real-time video data stream is received from the server through the identification end, and a machine learning algorithm is used to perform liveness recognition verification; when the first forwarding and the second forwarding are completed, the server clears the real-time video data stream in the cache area.
[0098] This embodiment provides a control method for a customer service system. This embodiment first ensures that the video data stream can be correctly stored and forwarded to the manual customer service end for real-time video communication by efficiently processing and forwarding the real-time video data stream from the client in the video session, and is simultaneously forwarded to the authentication end for liveness recognition verification. Through the cache mechanism, the system can handle the temporary storage and forwarding of the data stream to ensure the smoothness of the video session.
[0099] Based on the first embodiment, the sixth embodiment of the present application proposes a control method for a customer service system, referring to Figure 6 , after step S40, comprising: Step S160: receiving a screen sharing request from the artificial client terminal and / or the client, and transmitting the screen content of the artificial client terminal and / or the client to the other terminal in real time.
[0100] Implementing the screen sharing function allows the human customer service and / or client to view the other party's screen content in real time during a communication session, which helps both parties to share information more intuitively, collaborate to solve problems or make presentations.
[0101] In this embodiment, the screen sharing request refers to a request initiated by a human client or client end to transmit its own screen content to another party in real time. The screen content is all information displayed on the device screen, including application interfaces, documents, pictures, etc.
[0102] Exemplarily, when a manual service end or client initiates a screen sharing request, the system receives the request and verifies the identity and authority of the initiator. After the verification is passed, the initiator's screen content is captured in real time and encoded into a video stream, which is transmitted to the recipient through the network. The recipient decodes and displays it on his own screen to achieve real-time screen sharing.
[0103] Step S170, according to the screen annotation operation of the manual customer service end and / or the client end, the annotated content is synchronously displayed on the screens of both parties.
[0104] The screen annotation function enables the manual customer service end and / or the client end to perform annotation operations on the screen, and synchronizes the annotation content to the screens of both parties in real time, which helps both parties to clearly communicate information, point out problems or emphasize key points.
[0105] In this embodiment, the screen annotation operation is an operation such as marking, annotating, drawing a line, etc. performed on the screen. The annotation content is all the marking and annotation information generated in the screen annotation operation.
[0106] Exemplarily, when a manual service end or client performs annotation operations on the screen, these operations are captured and annotation content is generated, the annotation content is encoded into data packets, and transmitted to the other party in real time through the network, the receiving party is controlled to decode the data packets and draw the annotation content on the receiving party's screen to achieve real-time synchronous display of the annotation content.
[0107] Step S180: If a document signing request is received from the manual client and / or the client, the handwritten signature is recognized by an online signature tool, and the handwritten signature is converted into a digital signature and saved.
[0108] Signing documents with handwritten signatures during communication sessions and converting handwritten signatures into digital signatures for storage helps ensure the legitimacy and traceability of document signing.
[0109] In this embodiment, the document signing request is initiated by a manual client or client end, and is intended to sign a document. A handwritten signature refers to a signature drawn on the screen by a user using a stylus or other tool. A digital signature is a handwritten signature converted into an electronic form, which has the same legal effect as a handwritten signature.
[0110] Exemplarily, when a manual service end or client initiates a request to sign a document, a document signing interface is displayed, an image of the handwritten signature is captured based on the handwritten signature drawn by the customer in the handwritten signature area, and the handwritten signature is recognized and processed using an online signature tool to be converted into a digital signature.
[0111] Step S190, recording the call data of the communication session and saving it in a log file.
[0112] This embodiment provides a control method for a customer service system. This embodiment first uses video communication technology and online signature tools to achieve real-time video communication, screen sharing, annotation collaboration, document signing, call data recording and other functions between customers and manual customer service, thereby improving customers' online customer service experience and improving online customer service efficiency.
[0113] Based on the first embodiment, the seventh embodiment of the present application proposes a control method for a customer service system, referring to Figure 7 , after step S40, further comprising: Step S200: converting the voice consultation request of the customer in the communication session into text consultation through voice recognition technology.
[0114] Convert voice consultation requests from customers in communication sessions into text form for easy storage and retrieval.
[0115] In this embodiment, speech recognition technology is a technology for converting human speech into machine-readable text, including steps such as audio signal preprocessing, feature extraction, pattern matching and text generation.
[0116] Exemplarily, the customer's voice input is processed by speech recognition software, the voice input is converted into text, and the text is cleaned and formatted to remove noise, filler words, grammatical errors, etc.
[0117] Step S210, inputting the intelligent customer service model according to the text consultation, obtaining knowledge point data corresponding to the voice consultation request.
[0118] The text consultation request is passed to the intelligent customer service model for processing. The natural language processing capabilities of the intelligent customer service model are used to parse and understand the consultation request, analyze the key information in the consultation request, determine the user's intentions and needs, and search for relevant knowledge point data in the knowledge base through keywords based on the identified user intentions and needs.
[0119] Step S220, sending the knowledge point data corresponding to the voice consultation request to the manual customer service end.
[0120] The present embodiment provides a control method for a customer service system. The present embodiment first converts the customer's voice consultation request into a text consultation request through voice recognition technology, which can make subsequent text processing and analysis more efficient and accurate. The text consultation request is parsed through an intelligent customer service model, and knowledge point data matching it is found to provide accurate answers or suggestions for customer questions, thereby improving customer service efficiency. The knowledge point data found by the intelligent customer service model is sent to the manual customer service end, so that the manual customer service can give a more professional and accurate reply based on the data content and the specific needs of the customer after receiving the knowledge point data, thereby improving customer service efficiency and customer satisfaction.
[0121] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the control method of the customer service system of the present application. More simple transformations based on this technical concept are all within the protection scope of the present application.
[0122] The present application provides a control device for a customer service system, the control device for the customer service system comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the control method for the customer service system in the above-mentioned embodiment one.
[0123] Reference below Figure 8 , which shows a schematic diagram of the structure of a control device of a customer service system suitable for implementing an embodiment of the present application. The control device of the customer service system in the embodiment of the present application may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 8 The control device of the customer service system shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0124] like Figure 8As shown, the control device of the customer service system may include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the control device of the customer service system are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the control device of the customer service system to communicate with other devices wirelessly or by wire to exchange data. Although the control device of the customer service system with various systems is shown in the figure, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.
[0125] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.
[0126] The control device of the customer service system provided by the present application adopts the control method of the customer service system in the above embodiment, which can solve the technical problem of how to improve the service efficiency of the intelligent customer service system. Compared with the prior art, the beneficial effects of the control device of the customer service system provided by the present application are the same as the beneficial effects of the control method of the customer service system provided by the above embodiment, and the other technical features in the control device of the customer service system are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.
[0127] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0128] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
[0129] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the control method of the customer service system in the above-mentioned embodiment.
[0130] The computer-readable storage medium provided in the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.
[0131] The computer-readable storage medium may be included in the control device of the customer service system; or may exist independently without being installed in the control device of the customer service system.
[0132] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the control device of the customer service system, the control device of the customer service system can write computer program codes for performing the operations of the present application in one or more programming languages or a combination thereof. The programming languages include object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect through the Internet).
[0133] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0134] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.
[0135] The readable storage medium provided in this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the control method of the above-mentioned customer service system, and can solve the technical problem of how to improve the service efficiency of the intelligent customer service system. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the control method of the customer service system provided in the above-mentioned embodiment, and will not be repeated here.
[0136] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.
Claims
1. A control method for a customer service system, It is characterized in that The method includes: When receiving a manual customer service request from the client, obtain the intelligent customer service conversation data; Inputting the intelligent customer service conversation data into a pre-trained analysis model to determine the corresponding target demand of the client and / or the reason for the service mode conversion; Generate prompt information according to the target demand and / or the reason for the service mode conversion; A communication session is established between the client and the manual client, and the manual client is controlled to display the prompt information.
2. The control method of the customer service system according to claim 1, It is characterized in that Before the step of obtaining intelligent customer service dialogue data when receiving a manual customer service request sent by a client, the method includes: Receive a consultation request sent by a client, and determine a consultation text according to the consultation request; Input the consultation text into the intelligent customer service model to obtain knowledge point data corresponding to the consultation request; A response text corresponding to the consultation request is generated according to the knowledge point data, and the response text is sent to the client.
3. The control method of the customer service system according to claim 1, It is characterized in that Before the step of inputting the intelligent customer service dialogue data into a pre-trained analysis model to determine the client's corresponding target demand and / or the reason for the service mode conversion, the step includes: Acquire historical conversation data of intelligent customer service, and perform data cleaning and preprocessing on the historical conversation data; Constructing training data and verification data for the analysis model based on the processed historical conversation data and the annotation information corresponding to the historical conversation data; The analysis model is trained based on the training data, and the training result of the analysis model is verified based on the verification data.
4. The control method of the customer service system according to claim 1, It is characterized in that The step of establishing a communication session between the client and the manual client and controlling the manual client to display the prompt information includes: According to the target demand and / or the reason for the service mode conversion, a target manual customer service terminal with corresponding knowledge is matched, and a communication address of the target manual customer service terminal is determined; According to the communication address, a session connection is established between the client and the target artificial customer service terminal; The prompt information is sent to the target artificial client terminal through the session connection to control the target artificial client terminal to render the prompt information.
5. The control method of the customer service system according to claim 1, It is characterized in that After the step of establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information, the method further includes: In response to the video session creation instruction, establishing a video session between the client and the artificial customer service terminal; Receive the client liveness recognition result fed back by the authentication end, send the liveness recognition result to the artificial client end, and control the artificial client end to display the liveness recognition result in the video conversation reality interface.
6. The control method of the customer service system according to claim 5, It is characterized in that After the step of establishing a video session between the client and the artificial customer service terminal in response to the video session creation instruction, the step further includes: Receive the real-time video data stream sent by the client, and write the real-time video data stream into a cache area; Execute a first forwarding action and a second forwarding action corresponding to the real-time video data stream, wherein the first forwarding action is to forward the real-time video data stream in the cache area based on the communication address corresponding to the artificial client end, and the second forwarding action is to forward the real-time video data stream in the cache area based on the communication address of the authentication end; When the first forwarding action and the second forwarding action are completed, the real-time video data stream in the cache area is cleared.
7. The control method of the customer service system according to claim 1, It is characterized in that After the step of establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information, the following steps are included: Receiving a screen sharing request from the artificial client terminal and / or the client terminal, and transmitting the screen content of the artificial client terminal and / or the client terminal to the other terminal in real time; According to the screen annotation operation of the manual customer service end and / or the client end, the annotated content is synchronously displayed on the screens of both parties; If a document signing request is received from the manual customer service end and / or the client end, the handwritten signature is recognized by an online signature tool, and the handwritten signature is converted into a digital signature and saved; The call data of the communication session is recorded and saved in a log file.
8. The control method of the customer service system according to claim 1, It is characterized in that After the step of establishing a communication session between the client and the manual client, and controlling the manual client to display the prompt information, the method further includes: Converting the voice consultation request of the customer in the communication session into text consultation through voice recognition technology; According to the text consultation input intelligent customer service model, obtain the knowledge point data corresponding to the voice consultation request; The knowledge point data corresponding to the voice consultation request is sent to the manual customer service end.
9. A control device for a customer service system, It is characterized in that The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the control method of the customer service system according to any one of claims 1 to 8.
10. A storage medium, It is characterized in that The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the control method of the customer service system according to any one of claims 1 to 8 are implemented.
Citation Information
Patent Citations
Intelligent response method and system based on context dialogue semantic recognition
CN106357942A
Artificial telephone customer service auxiliary system and method
CN106683678A
Voice communication system and method for realizing man-machine coordination
CN111246027A
Method for assisting interaction based on intelligent customer service
CN112307187A
Audio and video data processing method and device, computer equipment and storage medium
CN112398931A
Cited By
Work order-based sensitive customer management method and device
CN119226490A
Sensitive customer management method and device based on work order
CN119226490B
Customer service switching method, device, equipment and medium
CN119850219A
Method, device, equipment, medium and product for providing customer service
CN121280037A
