Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A gesture interaction system and method applied to an intelligent classroom

An interactive system and gesture technology, which is applied in the field of human-computer interaction, can solve problems such as the inability to correctly recognize the teacher's interactive gestures, the system's inability to recognize students' effective gestures, and the mutual interference of students' gestures, so as to avoid unauthorized operations and reduce the risk of recognition Error, the effect of avoiding interference

Active Publication Date: 2019-03-29
GUANGZHOU JINGBIAO INFORMATION TECH CO LTD
View PDF8 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the large number of people in the classroom, if the operation authority is not restricted, the teacher's gestures will easily interfere with the students' gestures, which will cause the system to fail to correctly recognize the teacher's interactive gestures
In order to improve the accuracy of recognition, you can only give the teacher the operation authority, and only recognize the effective gestures issued by the teacher; however, when some teaching scenarios require students to perform related operations, the system cannot recognize the effective gestures of the students; for example, teacher A draws a certain student B When explaining his own composition, student B needs to turn the page after finishing a page. At this time, teacher A needs to help to operate or student B to operate on the podium. The teaching experience is not good

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A gesture interaction system and method applied to an intelligent classroom
  • A gesture interaction system and method applied to an intelligent classroom

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0047] A gesture interaction system applied to an intelligent classroom, including a camera module, a storage module and a processing module.

[0048] The camera module includes a depth camera, and the depth camera is used to collect images of the user's face, hands and posture, and upload the collected images to the storage module. Recognized human hand parts include arms and fingers. In this embodiment, the deep camera adopts the 3D sensor of Jingbiao Technology, which can effectively avoid interference such as light changes, curtain swings, glass reflections, and people walking in the back row during the collection process.

[0049] The storage module is used to store the collected images; the storage module also pre-stores gesture sample database, white list face database, temporarily authorized face database, face recognition algorithm based on deep neural algorithm and gesture recognition model based on deep neural algorithm; Different gesture samples in the sample libr...

Embodiment 2

[0054] Such as figure 1 As shown, a gesture interaction method applied to a smart classroom based on a gesture interaction system applied to a smart classroom includes the following steps:

[0055] S1. Collect the user's face, hand and posture images;

[0056] S2. Recognize the face in the collected image, match the recognized face with the whitelist face database, and determine whether the user belongs to the whitelist user;

[0057] S3. If the user belongs to the whitelist user, identify the hand gesture of the whitelist user in the collected image: convert the collected image into an image frame, and locate from the image frame through background modeling, moving object modeling and HSV skin color detection model For the arms and fingers of the human hand, use the particle filter algorithm of the HSV histogram to obtain the movement trajectories of the arms and fingers, and use the movement trajectories of the arms and fingers as gestures; match the gestures with the gestu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of human-computer interaction, in particular to a gesture interaction system and a gesture interaction method applied to an intelligent classroom. The gesture interaction system comprise: a camera module which is used for collecting images of faces, hands and gestures of users; a storage module for storing the acquired image; a processing module which recognizesthe face in the collected image based on the face recognition algorithm, matches the recognized face with the white list face database, and judges whether the user belongs to the white list user or not; if yes, the gesture of the white list user's hand in the collected image is recognized, and the gesture is matched with the pre-stored gesture sample library. Whether the white list user gesture matches the pre-stored gesture sample is judged, and if so, an operation corresponding to the matched gesture sample is performed. The technical proposal of the invention can realize real-time authorization.

Description

technical field [0001] The invention relates to the field of human-computer interaction, in particular to a gesture interaction system and method applied to an intelligent classroom. Background technique [0002] Smart classroom, also known as smart classroom, is a form of digital classroom and future classroom. The smart classroom is a new form of education, which is different from the traditional way of teaching and listening to lectures; the construction of smart classrooms makes full use of the original multimedia equipment, using liquid crystal touch all-in-one machines or projectors, electronic whiteboard display schemes and fully interactive smart terminals. The equipment includes multiple systems such as smart central control, speakers, power amplifiers, wireless sound reinforcement, teaching computers, interactive tablet software, etc. The systems are highly integrated and seamlessly combined, which can realize: wireless projection display, group interactive teachin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/017G06V40/172
Inventor 吴德佳叶婉娜
Owner GUANGZHOU JINGBIAO INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com