Home service robot cloud multimode dialogue method, device and system

Abstract

The invention discloses a home service robot cloud multimode dialogue method, device and system. The method includes the steps: receiving user voice information and scene image information in real time; converting the user voice information into text information, and performing word segmentation and named entity identification to determine dialogue types; preprocessing the scene image information;screening preprocessing image information and processed text information, adding the information into an incremental knowledge base, performing incremental model training when dialogue service load rate is smaller than a threshold value, and updating a dialogue service model; performing scene perception, user perception and emotion perception on the preprocessing image information and/or processed text information to obtain scene perception information, user perception information and emotion perception information; combining the processed text information with the scene perception information, the user perception information and/or the emotion perception information according to different dialogue types to generate interactive dialogue information of a user and a robot through the dialogue service model.

Description

technical field [0001] The disclosure belongs to the technical field of home service robot voice dialogue, and relates to a home service robot cloud multi-modal dialogue method, device and system. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] In recent years, problems such as population aging have become increasingly prominent, the urgent needs of society and the rapid development of artificial intelligence and robotics technology have greatly promoted the development of service robots. Voice dialogue technology provides the most humanized interaction method for home service robots. However, in the current human-computer voice interaction, the robot has no perception of scene information and interactive object information, often answers questions that are not relevant, and cannot generate satisfactory answers to users, which is very in...

AI Technical Summary

Problems solved by technology

[0004] (1) The traditional home service robot dialogue system only uses the user's voice interaction information, has no perception of the robot scene information, and has the problem of dialogue strategy deviation caused by the lack of scene information, and the generated dialogue cannot correspond to the user interaction content. poor experience

[0005] (2) The traditional home service robot dialogue system generates similar answers for the same voice input information of different users, and cannot generate personalized answers based on different user emotions, interests, etc.

[0006] (3) The traditional cloud-based family service person dialogue system has caused a lot of waste of time and computing power for massive user data and model update training methods, and the resource utilization rate is low

[0007] The above deficiencies lead to problems such as poor user experience in human-computer interaction and utilization of cloud resources in the home service robot dialogue system, hindering the application and promotion of home service robots

Images