The invention discloses a real-time classroom
behavior monitoring and feedback method based on an end-edge-
cloud architecture and multi-
modal perception, belongs to the technical field of intelligent education, and is implemented based on a three-layer architecture of a terminal layer, an edge layer and a cloud layer. The terminal layer comprises student terminals and classroom cameras, the student terminals read seat labels through RFID, complete identity
verification in combination with
fingerprint identification, generate identity-seat binding certificates and send the identity-seat binding certificates to the edge layer through
Bluetooth, and the cameras collect video streams and transmit the video streams to the edge layer; the edge layer target detection model identifies the behavior of an original video
stream and outputs a result, the space-time association matching and
rule engine maps a behavior area to a physical seat according to a seat-image coordinate relationship, the behavior area is matched with a
voucher to generate an association behavior event
record, a
feedback control instruction is generated after event accumulation judgment, and the
feedback control instruction is sent to the video
stream. The information is sent to a student terminal through
Bluetooth to execute reminding; and the
cloud server receives the data uploaded by the edge layer, stores and calculates the data, and responds to a query and management instruction.