Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human-computer interaction system based on multi-modal data collection

A data collection and human-computer interaction technology, applied in the field of human-computer interaction, can solve problems such as low level of intelligence, inability to comprehensively analyze the situation that users want to express, and inability to meet user needs.

Inactive Publication Date: 2018-11-06
深圳万智联合科技有限公司
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the prior art, most of the human-computer interaction systems obtain a single data from the user, and make corresponding responses after analyzing and judging the data. The type of data collected is single, and the situation that the user wants to express cannot be fully analyzed. The level of modernization is low, which cannot meet the needs of users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-computer interaction system based on multi-modal data collection
  • Human-computer interaction system based on multi-modal data collection
  • Human-computer interaction system based on multi-modal data collection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The present invention will be further described in conjunction with the following application scenarios.

[0017] see figure 1 , which shows a human-computer interaction system based on multimodal data collection, including:

[0018] The collection module 1 is used to collect multimodal data, and the multimodal data includes collected environmental data, physiological data and behavioral data;

[0019] A state judging module 2, configured to determine the current state of the user according to the multimodal data collected by the collection module 1;

[0020] The processing module 3 is configured to perform corresponding processing according to the current state of the user determined by the state judging module 2 .

[0021] In the above embodiments of the present invention, the acquisition module 1 collects multimodal data of the user and the environment, analyzes the collected data, determines the current state of the user, and uses this as a basis to match the corr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a human-computer interaction system based on multi-modal data collection. The system comprise a collection module, a state judgment module and a processing module, wherein the collection module is used for collecting multi-modal data, and the multi-modal data comprises collected environment data, physiological data and behavior data; the state judgment module is used for determining the current state of a user according to the multi-modal data collected by the collection module; and the processing module is used for executing corresponding processing according to the current state, which is determined according to the state judgment module, of the user. The system can comprehensively consider the collected multi-modal data and react, and the system has a high intellectualization level and is suitable for different occasions.

Description

technical field [0001] The invention relates to the technical field of human-computer interaction, in particular to a human-computer interaction system based on multimodal data collection. Background technique [0002] In the prior art, most human-computer interaction systems obtain a single data from the user, and make corresponding responses after analyzing and judging the data. The type of collected data is single and cannot fully analyze the situation that the user wants to express. Intelligent The level of modernization is low and cannot satisfy users. Contents of the invention [0003] In view of the above problems, the present invention aims to provide a human-computer interaction system based on multi-modal data collection. [0004] The object of the present invention adopts following technical scheme to realize: [0005] A human-computer interaction system based on multimodal data collection, including: [0006] The collection module is used to collect multi-mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/01G06K9/62
CPCG06F3/011G06F18/24133G06F18/214
Inventor 杨金源
Owner 深圳万智联合科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com