Navigation type experiment interaction device with cognitive function

An interactive device and cognitive function technology, applied in the field of experimental interaction, can solve problems such as low integration efficiency and poor user experience, and achieve the effect of improving naturalness and interaction efficiency

Active Publication Date: 2019-09-27
UNIV OF JINAN
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] According to the multi-modal fusion method, we found in the research that there are proble...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Navigation type experiment interaction device with cognitive function
  • Navigation type experiment interaction device with cognitive function
  • Navigation type experiment interaction device with cognitive function

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Embodiment 1 of the present invention proposes a navigational experimental interaction device with cognitive functions, which includes an information input perception module, an information fusion module, and an operation application module;

[0039] The information input perception module obtains the visual perception of the coordinate mapping relationship between the human hand in the virtual environment and the virtual scene through the Kinect sensor;

[0040] By setting two identical virtual experimental containers as real objects, and setting induction detection devices in the induction loops of the two virtual experimental containers to detect the induction loop signals; One or more photosensitive sensors are set, and the inductive detection device and photosensitive sensors are connected to the chip to complete tactile perception;

[0041] Through voice input, keyword extraction, and keyword classification required for the experiment, the similarity probability i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a navigation type experiment interaction device with a cognitive function. The navigation type experiment interaction device comprises an information input sensing module, an information fusion module and an operation application module, wherein the information input sensing module obtains visual perception, obtains container information, completes tactile perception and auditory perception through voice input. And the information fusion module determines the multi-mode intention according to the visual sense, the tactile sense and the auditory sense acquired by the information input sensing module. The operation application module is applied to an experiment based on multi-modal intention understanding. According to the invention, perceptual expression of different states of three channels on interaction is realized; and matching the multi-modal information intersection set with the intention feature set to form a multi-modal intention understanding model, completing multi-modal fusion, prompting or guiding key operations through characters or voices, judging wrong operations according to user intentions and operation specifications, and prompting wrong operation behaviors or visually presenting consequences of the wrong operations.

Description

technical field [0001] The invention belongs to the technical field of experimental interaction, in particular to a navigational experimental interactive device with a cognitive function. Background technique [0002] With the development and application of human-computer interaction technology, computers have gradually changed our way of life. It is the process of realizing information exchange between humans and computers, and the machine provides users with a large amount of information and related prompts through output devices. Among them, multi-channel human-computer interaction has increasingly become a hot research field. Compared with the traditional single-channel interaction method, which has poor immersion, inaccurate input information, and low efficiency, the multi-channel interaction method can make up for the shortcomings of single-channel interaction. However, there is a greater application potential in natural interaction. The main purpose of the intellige...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F3/16G06T7/521G06T7/70G10L15/22
CPCG06F3/017G06F3/016G06F3/167G06T7/521G06T7/70G10L15/22G10L2015/223
Inventor 冯志全肖梦婷冯仕昌田京兰
Owner UNIV OF JINAN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap