Distributed Internet of Things equipment collaboration method and system based on multimodal interaction

An IoT device and distributed technology, applied in transmission systems, voice analysis, instruments, etc., can solve problems affecting user experience, improve response accuracy and stability, reduce network delay, and improve user experience.

Inactive Publication Date: 2020-01-21
深圳市华创技术有限公司
View PDF6 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing technology, distributed IoT devices use the same wake-up word. When the user voice wakes up, all devices respond,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed Internet of Things equipment collaboration method and system based on multimodal interaction
  • Distributed Internet of Things equipment collaboration method and system based on multimodal interaction
  • Distributed Internet of Things equipment collaboration method and system based on multimodal interaction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0023] see figure 1 , in the embodiment of the present invention: provide a multimodal interaction-based distributed IoT device collaboration method, including the following steps:

[0024] Step 1: Each sub-device of the distributed IoT device obtains the user's voice locally in real time, and makes a voice wake-up judgment; in this step, the distributed IoT device represents multiple smart terminals, and each smart terminal has its own microphone array, inclu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed Internet of Things equipment collaboration method and system based on multimodal interaction. The method comprises the steps as follows: each piece of distributedInternet of Things sub-equipment respectively collects a voice signal in real time via a microphone to perform voice wakeup judgment; on equipment waken up via voice, a camera is started to collect ahuman face image in real time to perform face detection, and a face detection result is sent to an interaction center control via network communication; the interaction center control performs arbitration and collaboration according to a voice wakeup result and the face detection result reported by each piece of sub-equipment; the equipment really responding to wakeup of a user is determined, voice commands are continuously monitored, and meanwhile wakeup information of the other sub-equipment is eliminated; and after the voice commands of the user are processed in real time, the corresponding control commands and voice reply content are issued to the Internet of Things sub-equipment responding to the wakeup. According to the method and system provided by the invention, arbitration and collaboration are performed according to a multimodal result via the distributed Internet of Things equipment and the interaction center control, and accuracy of collaborative interaction and response of the distributed Internet of Things equipment is improved.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a multi-modal interaction-based distributed Internet of Things device collaboration method and system thereof. Background technique [0002] With the continuous development of technology in the field of artificial intelligence, the accuracy of speech recognition and face detection has been continuously improved, which has led to the emergence of many intelligent voice devices in our daily life. The built-in microphone or microphone array in the smart voice device can realize the close or far-field interaction between the user and the smart device at a certain distance, but beyond this distance range, the accuracy of voice interaction will decrease or even cannot be realized. Now many smart devices with voice interaction are distributed in our home environment, such as smart voice speakers in the living room, smart desk lamps in the bedroom, etc., and the devices a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/30G10L15/22G10L15/25G10L15/34H04L29/08
CPCG10L15/30G10L15/22G10L15/25G10L15/34H04L67/12G10L2015/223
Inventor 郑敏郑炜乔
Owner 深圳市华创技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap