The invention discloses a learning accompanying
robot system based on AI multi-mode fusion and a
learning behavior intervention method of the learning accompanying
robot system. According to the
system, on the basis of a table lamp illumination function, multi-mode sensing modules such as an RGB camera and a
microphone array and a four-degree-of-freedom mechanical arm executing mechanism are integrated. Through the AI multi-mode fusion technology, the system can recognize six learning states (concentration, fatigue,
distraction, poor
sitting posture, fake learning and normal rest) of students, a personalized intervention strategy is generated in combination with a subject
knowledge graph, and active intervention is achieved through mechanical arm
physical interaction, voice prompt and light adjustment. The system further integrates an intelligent learning tutoring function, when the learner actively asks for help, a
heuristic teaching method is adopted to provide layered tutoring, and the tutoring effect is improved through multi-mode collaborative explanation of voice and mechanical arm pointing. According to the invention, a counterfeit
learning recognition algorithm and a fatigue
time sequence prediction model are put forward for the first time, and experiments show that the average concentration duration of students can be increased by 78%, the
sitting posture correction efficiency can be increased by 68%, the counterfeit
learning recognition accuracy can reach 92.7%, the fatigue prediction accuracy can reach 89%, and the question
completion rate after intelligent tutoring can reach 87%. The method is suitable for scenes of K12 family education, online education supervision,
library self-study and the like.