Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Mixed reality interactive system and method based on tangible user interface

A mixed reality and user interface technology, applied in the input/output process of user/computer interaction, graphics reading, and data processing input/output process, etc. The effect of learning intuitively and improving cooperation ability

Active Publication Date: 2022-01-25
SHANDONG UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the handmade teaching products on the market currently use text, pictures and videos to reflect the production process. Without an interactive process, users cannot really participate in the production

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mixed reality interactive system and method based on tangible user interface
  • Mixed reality interactive system and method based on tangible user interface
  • Mixed reality interactive system and method based on tangible user interface

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0072] The present disclosure will be further described below in conjunction with the accompanying drawings and embodiments.

[0073] It should be pointed out that the following detailed description is exemplary and intended to provide further explanation to the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0074] It should be noted that the terminology used here is only for describing specific implementations, and is not intended to limit the exemplary implementations according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and / or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and / or combinati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present disclosure provides a mixed reality interaction system and method based on a tangible user interface, including a client and a server. The client is deployed with a mixed reality device. The server includes a hand position tracking submodule and a data transmission submodule. The position tracking sub-module is configured to use Kinect skeleton data for hand tracking, and performs Kinect and HoloLens coordinate system conversion during the initialization phase; the data transmission sub-module is configured to provide information communication between the client and the server; the client includes an interactive module , the interaction module is configured to use the mixed reality device to provide teaching information, and provide an interactive scene on the mixed reality device according to the received role selection, route design and dialogue design information.

Description

technical field [0001] The present disclosure relates to a mixed reality interaction system and method based on a tangible user interface. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] Mixed reality technology introduces real scene information into the virtual environment, and sets up an interactive feedback information loop between the virtual world, the real world and users, so as to enhance the realism of user experience. However, gesture interaction in mixed reality is more complicated for children, and simply using hand interaction is an ideal way. Hand tracking with Kinect has a relatively wide range and does not require specific gestures to track. This provides a solution for gesture interaction in mixed reality. [0004] Tangible user interface is a new paradigm of human-computer interaction interface. Through the coupling o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F3/0481
Inventor 杨承磊宋英洁盖伟刘娟卞玉龙周念梅孙千慧刘士军任伟
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com