Immersive remote teaching method and system

A remote teaching and remote server technology, applied in the field of immersive distance teaching methods and systems, can solve problems such as audio and video data out of sync, time error increase, device freeze, etc., achieve smooth rendering, reduce data pressure, and improve immersion degree of effect

Inactive Publication Date: 2021-08-24
上海陶瑞而信息科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Due to the problems in teaching interaction in distance teaching, the application of virtual reality technology in teaching can bring immersive experience, and at the same time, it can be closer to the real classroom in teaching interaction. However, since distance teaching involves many audio and video collection devices , the audio and video data collected by various devices are processed in different ways on the VR device, and there is a problem that the audio and video data are not synchronized;
[0003] Audio and video synchronization in the prior art is usually accomplished by calculating the time delay of voice and video data and then adjusting the timing of audio and video. That adjustment method is only suitable for regular audio and video transmission with stable transmission. However, due to network The objective existence of problems such as delays and device freezes makes it difficult to complete synchronization only by using time delays. Moreover, due to the natural existence of errors in the calculation of audio and video time delays, after a long period of accumulation, the accumulated time errors Increase, which in turn will cause the audio and video data to be out of sync again

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Immersive remote teaching method and system
  • Immersive remote teaching method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0033] Such as figure 1 As shown, the present embodiment provides a distance teaching method, the steps are as follows:

[0034] S1. The teacher sets the teaching mode, and the teaching mode includes a lecture mode, a discussion mode, and a questioning mode;

[0035] S2, comprehensively analyze the student's behavioral data, described behavioral data comprises eye movement, head posture, body posture, voice data, judges whether to trigger attention signal;

[0036] S3. If the attention signal is triggered, send the trigger attention signal to the remote server 6;

[0037] S4. The remote server 6 reconstructs and strengthens the synthesized video signal of the student who triggers the attention signal and combines it into the virtual scene data;

[0038] S5. The remote server 6 sends the virtual scene data to each student terminal and / or teacher terminal for display.

[0039] As a preferred embodiment, the teaching mode setting in S1 is set in the administrator mode, which c...

Embodiment 2

[0051] Such as figure 1 As shown, the present embodiment provides a remote teaching system, including a VR module 1, a camera 2, a processor 3 and an image processing and synthesis module 4, and the camera 2, the VR module 1 and the image processing and synthesis module 4 are all connected to the processor 3 ;

[0052] The processor 3 is wirelessly connected to the remote server 6 through the 5G module 5;

[0053] Described VR module 1 comprises the miniature camera 1-1 that is connected with processor 3, MEMS gyroscope 1-2 and is used for enrolling the voice module 1-3 of student or teacher voice data;

[0054] The processor 3 is also connected with the camera 2 that captures the body image data of students or teachers.

[0055] As a preferred embodiment, the image processing and synthesis module 4 is used for synthesizing the video signal near the eye parts captured by the miniature camera 1-1 and the face and body video signals captured by the camera 2, the image processi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a remote teaching method and system, the system comprises a camera, a processor, a VR module and an image processing synthesis module, the camera, the VR module and the image processing synthesis module are all connected with the processor, and the processor is wirelessly connected with a remote server through a 5G module. According to the method, behaviors of teachers or students are collected, whether the behaviors meet attention needs or not is analyzed, videos are further processed, individual videos are enhanced, the immersion degree is improved, and the actual attention rule of human beings to the surrounding classroom environment is met.

Description

technical field [0001] The invention relates to the field of distance teaching, in particular to an immersive distance teaching method and system. Background technique [0002] Due to the problems in teaching interaction in distance teaching, the application of virtual reality technology in teaching can bring immersive experience, and at the same time, it can be closer to the real classroom in teaching interaction. However, since distance teaching involves many audio and video collection devices , the audio and video data collected by various devices are processed in different ways on the VR device, and there is a problem that the audio and video data are not synchronized; [0003] Audio and video synchronization in the prior art is usually accomplished by calculating the time delay of voice and video data and then adjusting the timing of audio and video. That adjustment method is only suitable for regular audio and video transmission with stable transmission. However, due t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F9/50G06Q50/20
CPCG06F3/011G06F9/5027G06Q50/205
Inventor 倪青峰
Owner 上海陶瑞而信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap