Unlock instant, AI-driven research and patent intelligence for your innovation.

VR chemical laboratory implementation method and system based on unity 3D and hand motion capture

A chemical laboratory and hand exercise technology, applied in the computer field, can solve the problems of high cost of chemical experiments, lack of experimental training for users, and in-depth understanding of chemical knowledge, etc., to improve the training effect, improve safety, and deepen the effect of understanding.

Active Publication Date: 2022-07-05
HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of the above-mentioned deficiencies in the prior art, the purpose of the present invention is to provide a VR chemistry laboratory implementation method and system based on unity3D and hand motion capture, aiming to solve the problem that the high cost of existing chemical experiments causes users to lack experimental training and cannot Questions for in-depth understanding of chemical knowledge

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • VR chemical laboratory implementation method and system based on unity 3D and hand motion capture
  • VR chemical laboratory implementation method and system based on unity 3D and hand motion capture
  • VR chemical laboratory implementation method and system based on unity 3D and hand motion capture

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0044] In order to solve the problems in the prior art, such as figure 1 As shown, this embodiment provides a VR chemistry laboratory implementation method based on unity3D and hand motion capture, which includes the following steps:

[0045] S100, constructing a module and a chemical laboratory model in the VR experimental scene through modeling software;

[0046] S200, constructing a virtual environment required for the experiment in the VR experiment scene by using the unity3D engine;

[0047] S300, identifying the initial position of the user's hand, inputting the coordinates of the initial position of the user's hand to match the hand model in the VR experiment scene, and mapping hand movements to the hand model in the VR experiment scene in real time;

[0048] S400. Pop up corresponding text and voice prompts according to the user's operation to guide the user's operation.

[0049]The present invention constructs a virtual chemistry laboratory by using VR equipment and...

Embodiment 1

[0100] like image 3 As shown, this is a flow chart of preferred embodiment 1, which is a combustion property verification experiment.

[0101] The implementation steps are:

[0102] (1) The unity3D engine loads the laboratory environment, including preset experimental equipment and object groups in the laboratory.

[0103] (2) Initialize the hardware device, send the image stream to the VR device, and detect whether the gesture recognition hardware works normally.

[0104] (3) Gesture recognition hardware detects hand movements. The processing module analyzes the depth information of the hand according to the depth image of the hand, and recognizes the tapping action of the hand; initially, the user can view the hand image through the display provided in the gesture recognition hardware driver, and when the user confirms that the joint points of the fingers have been correctly When tracking, you can freely grasp any object you want to manipulate.

[0105] (4) When the ope...

Embodiment 2

[0113] like Figure 4 As shown, this is the flow chart of the preferred embodiment 2, which is a flame reaction experiment.

[0114] The implementation steps are:

[0115] (1) The unity3D engine loads the laboratory environment.

[0116] (2) Initialize the hardware device, send the image stream to the VR device, and detect whether the gesture recognition hardware works normally. Gesture recognition hardware detects hand movements. The principle is not repeated here.

[0117] (3) Pop-up text and voice prompts inform the operator of experimental background information.

[0118] (4) When the operator grasps the glass rod, the hand model coincides with the preset collision body on the glass rod. When a collision is detected, the grip script is triggered so that the glass rod can move with the hand.

[0119] (5) Put the bottom end of the glass rod into the hydrochloric acid, the bottom of the glass rod collides with the collision body inside the hydrochloric acid, and a promp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a VR chemical laboratory implementation method and system based on unity 3D and hand motion capture. The method comprises the following steps: constructing a module and a chemical laboratory model in a VR experiment scene through modeling software; a virtual environment required by an experiment in the VR experiment scene is constructed through a unity 3D engine; identifying the initial position of the hand of the user, inputting the initial position coordinate of the hand of the user to be matched with the hand model in the VR experiment scene, and mapping the hand action to the hand model in the VR experiment scene in real time; and corresponding character and voice prompts are popped up according to the operation of the user to guide an experimenter to operate. The virtual chemistry laboratory is constructed by using the VR equipment and the unity 3D engine, students are placed in a scene which cannot be realized in an original classroom, the students are promoted to deeply understand knowledge, an operator can operate experiment equipment in the virtual chemistry laboratory through a hardware interaction means, the training effect is improved, the experiment understanding is deepened, and the experiment efficiency is improved. Meanwhile, the cost is reduced and the safety is improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a VR chemical laboratory implementation method and system based on unity3D and hand motion capture. Background technique [0002] In fact, educational resources are unevenly distributed, while educational competition exists everywhere. Some schools do not have relevant equipment to provide corresponding hardware support for experiments. A large number of high school students reported that they did not achieve the expected ideal goals due to lack of experimental training when participating in major subject competitions. At the same time, the experiment is included in the examination scope of the middle and high school entrance examination, but in actual teaching, students are rarely allowed to operate by themselves, resulting in the inability of subject thinking to penetrate into every detail. The fundamental reason is the limited funding. In order to reduce the cost, the pre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/04815G06F3/01G06T19/00G06T17/10G06V40/20G09B9/00
CPCG06F3/04815G06F3/017G06T19/003G06T17/10G09B9/00
Inventor 漆舒汉卢登震李恒毅刘思媛仇傅宇李林浩
Owner HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com