Multimodal input-based interactive method and device

A multi-modal, device technology, applied in the computer field, can solve problems such as unnatural interaction, high deployment and maintenance costs, and unintuitiveness, and achieve the effect of reducing volume and weight, improving interactive experience, and avoiding discomfort.

Active Publication Date: 2017-08-01
HISCENE INFORMATION TECH CO LTD
View PDF5 Cites 51 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The former, such as two-dimensional code, NFC, WiFi positioning and other technologies, need to modify each target object, so there are

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multimodal input-based interactive method and device
  • Multimodal input-based interactive method and device
  • Multimodal input-based interactive method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0033] Combine figure 1 , The main purpose of this application is to provide a smart glasses device for comprehensive processing of multi-modal input, such as voice, touch, gesture, scene and other input information, including determining the operation command for interactive operation based on the input information to operate objects (including TV, Lights, washing machines, and other objects with entities, intangible objects projected by glasses, etc.) perform corresponding operations. In addition, it can also provide users with the function of defining interactive operations.

[0034] based on above, figure 2 A device schematic diagram of a smart glasses device for interacting with multi-modal input provided according to an aspect of the present application is shown. The smart glasses device 1 includes a first device 11, a second device 12, and a third device 13...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention aims to provide an intelligent glasses device and method used for performing interaction based on multimodal input and capable of enabling the interaction to be closer to natural interaction of users. The method comprises the steps of obtaining multiple pieces of input information from at least one of multiple input modules; performing comprehensive logic analysis on the input information to generate an operation command, wherein the operation command has operation elements, and the operation elements at least include an operation object, an operation action and an operation parameter; and executing corresponding operation on the operation object based on the operation command. According to the intelligent glasses device and method, the input information of multiple channels is obtained through the input modules and is subjected to the comprehensive logic analysis, the operation object, the operation action and the operation element of the operation action are determined to generate the operation command, and the corresponding operation is executed based on the operation command, so that the information is subjected to fusion processing in real time, the interaction of the users is closer to an interactive mode of a natural language, and the interactive experience of the users is improved.

Description

Technical field [0001] The present invention relates to augmented reality technology in the computer field, in particular to an augmented reality smart glasses technology. Background technique [0002] Augmented Reality (Augmented Reality) is a sub-field of natural picture recognition technology that superimposes digital information such as virtual 3D model animation, video, text, and pictures into the real scene in real time, and realizes it with real objects or users The innovative human-computer interaction technology of natural interaction emphasizes the natural human-computer visual interaction of the integration of virtual and real. Augmented reality technology includes multimedia, three-dimensional modeling, real-time video display and control, multi-sensor fusion, real-time tracking and registration, scene fusion and other new technologies and new methods. Due to the advancement and novelty of this technology, the application and promotion of augmented reality technology...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F3/0487G06V10/764
CPCG06F3/011G06F3/0487G06F3/038G06F2203/0381G06F3/017G06F3/04883G10L15/26G06V40/28G06V10/82G06V10/803G06V10/764G06F18/251G06F3/01G06F18/41G06F18/2414G06F3/012G06F3/167
Inventor 廖春元唐荣兴凌海滨黄玫
Owner HISCENE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap