Linguistic style matching agent

A linguistic and stylistic technique, applied in the field of linguistic style matching agents, which can solve the problems of unnatural conversational agents and disappointment of conversational agent users.

Pending Publication Date: 2021-09-28
MICROSOFT TECH LICENSING LLC
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, conversational agents often interact in robotic and unnatural ways
This large gap in expectations may

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Linguistic style matching agent
  • Linguistic style matching agent
  • Linguistic style matching agent

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] This disclosure describes an "emotionally-intelligent" conversational agent that can recognize human behavior during an open conversation and automatically align its responses with the visual and conversational style of a human user. Systems for creating conversational agents utilize multimodal input (eg, audio, text, and video) to generate rich and perceptually effective responses, such as lip-syncing and synthetic facial expressions during a conversation. Therefore, the conversational agent can evaluate the user's visual and verbal (verbal) behavior in view of the larger conversational context, and make appropriate responses to the user's conversational style and emotional expression to provide a more natural conversational user interface than traditional systems ( UI).

[0019] The behavior of such an emotionally intelligent conversational agent can simulate style matching or entrainment, the phenomenon in which a subject adopts the behavior or traits of the person i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A conversational agent that is implemented as a voice-only agent or embodied with a face may match the speech and facial expressions of a user. Linguistic style-matching by the conversational agent may be implemented by identifying prosodic characteristics of the users speech and synthesizing speech for the virtual agent with the same or similar characteristics. The facial expressions of the user can be identified and mimicked by the face of an embodied conversational agent. Utterances by the virtual agent may be based on a combination of predetermined scripted responses and open-ended responses generated by machine learning techniques. A conversational agent that aligns with the conversational style and facial expressions of the user may be perceived as more trustworthy, easier to understand, and create a more natural human-machine interaction.

Description

Background technique [0001] Conversational interfaces are becoming more and more popular. Recent advances in speech recognition, generative dialogue models, and speech synthesis have enabled practical applications of voice-based input. Conversational agents, virtual agents, personal assistants, and "robots" that interact in natural language have created new platforms for human-machine interaction. In the U.S., an estimated nearly 50 million (or one in five) adults have access to a voice-controlled smart speaker, where the voice is the primary interface. Many more people have access to an assistant on a smartphone or smartwatch. [0002] However, many of these systems are constrained in how they can communicate because they are limited to vocal interactions, and these interactions do not even reflect the natural vocal characteristics of human speech. Embodied conversational agents can be an improvement because they provide a "face" to user conversations, rather than a disemb...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L13/027G06T13/40G10L15/22G06K9/00G10L25/63
CPCG10L15/22G10L13/027G10L25/63G06V40/174G06V40/161G06T13/40G10L13/00G10L15/1815G10L25/78G10L25/90
Inventor D·J·麦克杜夫K·R·罗恩M·P·切尔文斯基D·阿尼贾R·赫根
Owner MICROSOFT TECH LICENSING LLC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap