Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for evaluating conversation effect of robot

A robotic and artificial technology, applied in the field of data processing, can solve problems such as ignoring the overall effect of the conversation, and achieve a good overall effect

Inactive Publication Date: 2020-10-16
XIAMEN KUAISHANGTONG TECH CORP LTD
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the existing indicators for evaluating robots are only to evaluate the recognition problems of customer service robots, whether they can be correctly identified and answered, but ignore the overall effect of the conversation itself

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for evaluating conversation effect of robot
  • Method and system for evaluating conversation effect of robot
  • Method and system for evaluating conversation effect of robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0031] The content of the present invention will be described in detail below in conjunction with the examples.

[0032] The scheme of the present invention mainly prepares test data according to the original dialogue, including single sentence and overall dialogue, then performs dialogue alignment on the test data, sets a scoring mechanism, and then scores the responses of the test data, thereby obtaining the overall dialogue effect of the robot. According to the final score evaluation, it is possible to evaluate whether the overall conversation effect of the robot can meet the online standard.

[0033] refer to figure 1 As shown in FIG. 2 , it is a flow chart of a method for evaluating the effect of a robot conversation provided by an embodiment of the present invention. A method for assessing the effectiveness of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for evaluating the conversation effect of a robot. The method comprises the following steps: S1, acquiring test data; s2, obtaining responses of a robot and a worker according to the test data; s3, scoring the response of the robot and the manual response respectively; and S4, performing evaluation on the conversation effect of the robot by comparing the scoring proportion. According to the invention, the overall effect of the robot and the user session can be better evaluated, so that the online robot can respond to the consulting conversation of the user moresmoothly and reasonably.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and system for evaluating robot conversation effects. Background technique [0002] In considering the replacement scenario of old and new male robots, it is necessary to evaluate whether the effect of the existing robot can meet the online standard. The existing robot effect evaluation method cannot well explain whether the new version of the robot meets the upper limit standard, so more data is needed to prove The effect of the new version of Andrology Robot is sufficient to meet the launch standard. [0003] Existing test indicators for assessing the conversation effect of robots include: the accuracy of semantic similarity, intent recognition, NER recognition, symptom similarity, FAQ coverage, and rule speech coverage. Most of the existing indicators for evaluating robots are only to evaluate the identification problems of customer service robots and whether...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/332G16H50/20
CPCG06F16/3329G16H50/20
Inventor 周璐肖龙源李稀敏邓仁超刘晓葳谭玉坤
Owner XIAMEN KUAISHANGTONG TECH CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com