Interactive learning system for preschool education

Abstract

The invention discloses an interactive learning system for preschool education, and relates to the technical field of preschool education, and the system comprises a perception interaction unit, an intelligent processing cooperation unit, and a teaching execution unit. The perception interaction unit comprises an image acquisition module, a voice input module, a touch operation module and an environment perception module; the processing cooperation unit comprises a behavior analysis module, a content matching module, a feedback generation module, a data synchronization module and a user portrait module; the teaching execution unit comprises a projection display device, an entity teaching aid driving module, an audio output device, a parent end interface, a teacher management interface, a touch feedback module and a double-screen cooperation module. By fusing binocular vision space positioning of the image acquisition module, pressure track capture of the touch operation module and noise reduction analysis of the voice input module, multi-dimensional behavior intention collaborative analysis is realized, and the problem of intention misjudgment caused by single sensory data of a traditional system is effectively solved.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of preschool education, and particularly relates to an interactive learning system for preschool education. BACKGROUND

[0002] The preschool education interactive system improves learning participation through multi-sensory stimulation, assists cognitive development through a basic behavior feedback mechanism, and simplifies teaching evaluation with the aid of digital management. The existing electronic interactive teaching aids improve the interest of preschool education through multimedia forms, but the traditional physical teaching aids still have problems of single operation dimension and inability to capture the details of children's behavior in real time. The current electronic system lacks interaction reliability in complex environments and a dynamic adaptation mechanism based on an individual ability model, and the behavior intention recognition is fragmented and cannot be associated, resulting in misjudgment of children's cognitive intention and limitation of teaching effect. Therefore, the present application provides an interactive learning system for preschool education. SUMMARY

[0003] To solve the above technical problems, the present application is realized by the following technical scheme: The present application is an interactive learning system for preschool education, comprising a perception interaction unit, an intelligent processing cooperation unit and a teaching execution unit. The perception interaction unit comprises an image acquisition module, a voice input module, a touch operation module and an environment perception module. The processing cooperation unit comprises a behavior analysis module, a content matching module, a feedback generation module, a data synchronization module and a user portrait module. The teaching execution unit comprises a projection display device, a physical teaching aid driving module, an audio output device, a parent interface, a teacher management interface, a touch feedback module and a dual-screen cooperation module.

[0004] As a preferred technical solution, the output end of the image acquisition module is unidirectionally connected to the input end of the behavior analysis module, the output end of the voice input module is unidirectionally connected to the input end of the behavior analysis module and the input end of the content matching module, respectively, and the output end of the touch operation module is unidirectionally connected to the input end of the behavior analysis module.

[0005] As a preferred technical solution, the image acquisition module captures spatial three-dimensional coordinate data of the teaching aid in real time through a binocular vision sensor, synchronously acquires facial key point expression features of the child, and establishes an associated data set of spatial position and expression. The voice input module adopts a beamforming microphone array to directionally receive the voice instructions of the child, eliminates environmental background noise through an adaptive filtering algorithm, and outputs a pure voice stream for semantic analysis. As a preferred technical solution, the touch operation module detects the contact area change when the child operates the entity teaching aid based on the capacitance sensing matrix, and records the pressure value distribution and sliding trajectory coordinate sequence in real time. The environmental perception module is used for monitoring the illumination intensity, temperature and humidity parameters of the operation area, and dynamically adjusting the environmental light supplement intensity and temperature and humidity threshold.

[0006] As a preferred technical solution, the behavior analysis module output is respectively unidirectionally connected with the feedback generation module input and the data synchronization module input, the feedback generation module output and the data synchronization module output are both unidirectionally connected with the user portrait module input, the feedback generation module output and the data synchronization module output are both unidirectionally connected with the content matching module input, and the data synchronization module output is respectively unidirectionally connected with the parent interface input, the teacher management interface input and the double-screen cooperation module input.

[0007] As a preferred technical solution, the behavior analysis module is used for fusing image space coordinates, touch track and gesture data, analyzing operation logic consistency and generating intention matching degree score, and the intention matching degree score is generated by fusing image space coordinates, touch track and gesture data, and the formula is as follows: ; In the formula, is a three-dimensional deviation vector of the current position of the teaching aid and the target position, is a Euclidean norm, a space error index, is a touch track smoothness function, is a gesture similarity function, is a touch track data sequence, is a currently detected gesture joint coordinate, is a reference gesture template coordinate.

[0008] The content matching module is used for calling adaptive multimedia teaching resources from a preset knowledge graph based on a learner ability model, dynamically adjusting a task difficulty level, and dynamically adjusting a task difficulty level based on a user portrait ability model, and the formula is as follows: ; In the formula, is an adjusted task difficulty level, is a current task difficulty level, is a learning rate, is a target matching degree threshold, is a user ability standard deviation, is a user six-dimensional ability vector, is a lowest difficulty level, is a highest difficulty level. The feedback generation module is used for generating a three-level response strategy instruction according to the intention matching degree, including voice prompt intensity, projection guidance level and haptic feedback mode. As a preferred technical solution, the data synchronization module is used for encrypting transmission of operation records and environment data to the cloud, supporting real-time data access and instruction issuing of the teacher end and the parent end. The user portrait module is used for recording the operation habits of the current user, including a six-dimensional ability evaluation model of space cognition, language expression and logical reasoning, storing historical operation records and updating the ability growth curve.

[0009] As a preferred technical solution, the output end of the feedback generation module is unidirectionally connected with the input end of the audio output device and the input end of the haptic feedback module, the output end of the content matching module is unidirectionally connected with the input end of the projection display device and the input end of the physical teaching aid driving module, and the output end of the teacher management interface is unidirectionally connected with the input end of the dual-screen cooperation module.

[0010] As a preferred technical solution, the projection display device is used for projecting a 1:1 real scene on an operation table, dynamically superimposing operation guide lines and virtual teaching aid models, and supporting touch interaction correction of spatial positions. The physical teaching aid driving module is used for controlling a stepping motor to perform millimeter-level calibration of the spatial position of the teaching aid, and synchronously triggering a piezoelectric ceramic array to generate a local vibration feedback signal. The audio output device is used for directional playing of a precompiled situational voice guidance script, and dynamically switching background music spectrum features according to operation stages. As a preferred technical solution, the parent end interface is used for pushing a structured report data packet containing an operation heat map and an ability radar chart, and receiving parent-submitted parent-child task configuration parameters. The teacher management port is used for generating a three-dimensional ability matrix topological graph of a class, and supporting batch import and version management of teaching plan parameters. The haptic feedback module is used for outputting a differential haptic encoding signal through a double-channel linear resonant actuator, transmitting an error prompt pulse through the left wrist, and sending a completion confirmation waveform through the right wrist. The dual-screen cooperation module is used for realizing frame synchronous transmission of the teacher control screen and the parent interaction screen by using a low-delay streaming media protocol, so as to ensure that the picture content is strictly consistent.

[0011] The present application has the following beneficial effects: The application realizes multi-dimensional behavior intention collaborative analysis by fusing binocular vision space positioning of the image acquisition module, pressure trajectory capture of the touch operation module and noise reduction analysis of the voice input module, effectively solves the intention misjudgment problem caused by single sensory data of the traditional system, and significantly improves the interaction reliability in a complex light and noise scene in combination with real-time parameter adjustment of the environment perception module, so that the child operation logic is highly matched with the system feedback, and the cognitive accuracy is enhanced.

[0012] The application relies on a user portrait module to construct a dynamic evaluation model containing six-dimensional abilities such as spatial cognition and language expression, and continuously updates the individual ability growth curve; the content matching module intelligently calls adaptive resources from a knowledge graph and automatically adjusts the task difficulty level based on the model, realizes real-time personalized adaptation of teaching content, breaks through the limitation that the existing electronic system lacks a dynamic response mechanism of individual ability, and accurately promotes the cognitive development of children.

[0013] The application innovatively adopts a three-level response strategy linkage mechanism: the feedback generation module synchronously drives the situational voice prompts of the audio output device, the augmented reality guide line of the projection display device and the differential tactile coding of the tactile feedback module according to the behavior analysis result, forms a visual-auditory-tactile multi-channel collaborative feedback closed loop, and transmits the operation heat map and the ability radar chart to the parent / teacher end through the data synchronization module, and supports millisecond-level picture synchronization of the double-screen collaborative module, and significantly improves the teaching evaluation efficiency and the school-family co-education collaboration.

[0014] Of course, any product implementing the present application does not necessarily need to achieve all the advantages described above. BRIEF DESCRIPTION OF DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0016] Figure 1 A flow chart of the interactive learning system for preschool education of the present application. DETAILED DESCRIPTION

[0017] The technical solutions in the embodiments of the present application will be described clearly and completely in the following with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0018] Please refer to Figure 1As shown, the present application is an interactive learning system for preschool education, comprising a perception interaction unit, an intelligent processing cooperation unit and a teaching execution unit; The perception interaction unit comprises an image acquisition module, a voice input module, a touch operation module and an environment perception module. The processing cooperation unit comprises a behavior analysis module, a content matching module, a feedback generation module, a data synchronization module and a user portrait module. The teaching execution unit comprises a projection display device, an entity teaching aid driving module, an audio output device, a parent interface, a teacher management interface, a touch feedback module and a dual-screen cooperation module.

[0019] The output end of the image acquisition module is unidirectionally connected to the input end of the behavior analysis module, the output end of the voice input module is unidirectionally connected to the input end of the behavior analysis module and the input end of the content matching module, the output end of the touch operation module is unidirectionally connected to the input end of the behavior analysis module, and the output end of the environment perception module is unidirectionally connected to the input end of the image acquisition module.

[0020] The image acquisition module captures spatial three-dimensional coordinate data of the teaching aid in real time through a binocular vision sensor, synchronously acquires facial key point expression features of the child, and establishes an associated data set of spatial position and expression. The voice input module uses a beamforming microphone array to directionally receive the child's voice instructions, eliminates environmental background noise through an adaptive filtering algorithm, and outputs a pure voice stream for semantic analysis. The touch operation module detects changes in the contact area when the child operates the entity teaching aid based on a capacitance sensing matrix, and records pressure value distribution and sliding trajectory coordinate sequences in real time. The environment perception module is used to monitor the light intensity, temperature and humidity parameters of the operation area, and dynamically adjust the environmental light compensation intensity and temperature and humidity threshold values.

[0021] The output end of the behavior analysis module is unidirectionally connected to the input end of the feedback generation module and the input end of the data synchronization module, the output end of the feedback generation module and the output end of the data synchronization module are both unidirectionally connected to the input end of the user portrait module, the output end of the feedback generation module and the output end of the data synchronization module are both unidirectionally connected to the input end of the content matching module, and the output end of the data synchronization module is unidirectionally connected to the input end of the parent interface, the input end of the teacher management interface and the input end of the dual-screen cooperation module.

[0022] The behavior analysis module is used to fuse image spatial coordinates, touch track and gesture data, analyze operation logic consistency and generate an intention matching degree score, and generate an intention matching degree score by fusing image spatial coordinates, touch track and gesture data, according to the following formula: ; In the formula, a three-dimensional deviation vector of the current position of the teaching aid and a target position, a spatial error index, a touch trajectory smoothness function, a gesture similarity function, a touch trajectory data sequence, a currently detected gesture joint point coordinate, a reference gesture template coordinate.

[0023] The content matching module is configured to call adaptive multimedia teaching resources from a preset knowledge graph based on a learner ability model, and dynamically adjust a task difficulty level. The content matching module is also configured to dynamically adjust the task difficulty level based on a user portrait ability model, and the formula is as follows: In the formula, is an adjusted task difficulty level, is a current task difficulty level, is a learning rate, is a target matching degree threshold, is a user ability standard deviation, is a user six-dimensional ability vector, is a lowest difficulty level, is a highest difficulty level. The feedback generation module is configured to generate a three-level response strategy instruction according to the intention matching degree, including a voice prompt intensity, a projection guidance level, and a haptic feedback mode. The data synchronization module is configured to encrypt and transmit operation records and environment data to the cloud, and support real-time data retrieval and instruction issuing of the teacher end and the parent end. The user portrait module is configured to record the operation habits of the current user, including a six-dimensional ability evaluation model of spatial cognition, language expression, and logical reasoning, store historical operation records, and update an ability growth curve.

[0024] The output end of the feedback generation module is unidirectionally connected to the input end of the audio output device and the input end of the haptic feedback module. The output end of the content matching module is unidirectionally connected to the input end of the projection display device and the input end of the physical teaching aid driving module. The output end of the teacher management interface is unidirectionally connected to the input end of the dual-screen cooperation module.

[0025] The projection display device is configured to project a 1:1 real scene on the operation table, dynamically superimpose operation guide lines and virtual teaching aid models, and support touch interaction correction of spatial positions. The physical teaching aid driving module is configured to control a stepping motor to perform millimeter-level calibration of a teaching aid spatial position, and synchronously trigger a piezoelectric ceramic array to generate a local vibration feedback signal. ​The audio output device is used for playing precompiled situational voice guidance scripts in a targeted manner, and dynamically switching background music spectrum features according to operation stages; The parent interface is used for pushing a structured report data packet containing an operation heat map and a capability radar chart, and receiving parent-submitted parent-child task configuration parameters; The teacher management port is used for generating a class three-dimensional capability matrix topological graph, and supporting batch import and version management of teaching plan parameters; The touch feedback module is used for outputting a differential touch encoding signal through a double-channel linear resonant actuator, outputting an error prompt pulse through the left wrist, and sending a completion confirmation waveform through the right wrist; The double-screen cooperation module is used for realizing frame synchronous transmission of the teacher control screen and the parent interaction screen through a low-delay streaming media protocol, and ensuring that the picture content is strictly consistent.

[0026] One specific application of the embodiment is as follows: when the user picks up the triangular physical puzzle piece and approaches the target groove, the image acquisition module captures the spatial coordinates and frown expression features of the puzzle piece in real time through the binocular vision sensor; at this time, the voice input module starts the beamforming microphone array to directionally pick up the user's interrogative sentence "put it here?"; through adaptive filtering, 42 dB of air conditioner noise is eliminated; the touch operation module synchronously detects that the peak value of the contact surface pressure of the puzzle piece reaches 3.2 N / cm2 and the transverse sliding track; the environmental perception module automatically increases the light supplement intensity because it detects that the light in the operation area is insufficient; the behavior analysis module fuses the spatial coordinate deviation, the pressure fluctuation curve, and the interrogative voice to determine that the intention matching degree is 62%; the user portrait module marks "orientation judgment to be strengthened" in the spatial cognition dimension and updates the capability curve; the content matching module reduces the task difficulty from L3 to L2 level; the projection display device projects a pulsed red light guide line on the operation table to dynamically correct the angle; the feedback generation module triggers a response: the audio device plays the guiding voice "try to turn a direction" and switches to 180 Hz soothing piano music; the touch module drives the left wrist linear resonator to output a 0.3 s error pulse; when the user rotates the puzzle piece, the physical teaching aid driving module controls the stepping motor to perform a 0.7 mm fine adjustment; when the binocular vision detects that the deviation is reduced to 0.3 mm, the right wrist resonator outputs a 1.2 s sine wave completion signal, the projection guide line turns green, and the data synchronization module encrypts and transmits a 17-second heat map and updates the capability radar chart to the cloud: the parent interface pushes a report and receives the "increase space flip practice" parameter set by the guardian; the teacher management interface generates a class capability matrix graph to display that the user's spatial cognition score is improved to 78 points; the double-screen cooperation module ensures that the animation frame synchronization time difference between the teacher screen and the parent screen is less than 8 ms through the WebRTC protocol.

[0027] It is worth noting that the above system embodiments, including each unit is only divided according to the functional logic, but is not limited to the above division, as long as the corresponding function can be realized; in addition, the specific name of each functional unit is only for the convenience of mutual distinction, and is not used to limit the protection scope of the present application.

[0028] In addition, those skilled in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by a program instructing related hardware, and the corresponding program can be stored in a computer readable storage medium.

[0029] The preferred embodiments of the application disclosed above are only used to help explain the application. The preferred embodiments do not describe all the details and do not limit the application to the specific embodiments described. Obviously, many modifications and variations can be made according to the content of the present application. The present application selects and describes these embodiments in order to better explain the principles and practical applications of the present application, so that those skilled in the art can well understand and utilize the present application. The present application is limited only by the claims and their full scope and equivalents.

Claims

1. An interactive learning system for preschool education, characterized by: It includes a perception interaction unit, an intelligent processing coordination unit and a teaching execution unit; The perception interaction unit includes an image acquisition module, a voice input module, a touch operation module, and an environment perception module; The processing coordination unit includes a behavior analysis module, a content matching module, a feedback generation module, a data synchronization module, and a user portrait module; The teaching execution unit includes a projection display device, a physical teaching aid driving module, an audio output device, a parent-side interface, a teacher management interface, a tactile feedback module, and a dual-screen collaboration module.

2. The interactive learning system for preschool education according to claim 1, characterized in that: The output end of the image acquisition module is unidirectionally connected to the input end of the behavior analysis module, the output end of the voice input module is unidirectionally connected to the input end of the behavior analysis module and the input end of the content matching module respectively, the output end of the touch operation module is unidirectionally connected to the input end of the behavior analysis module, and the output end of the environment perception module is unidirectionally connected to the input end of the image acquisition module.

3. The interactive learning system for preschool education according to claim 1, characterized in that: The image acquisition module uses a binocular vision sensor to capture the spatial three-dimensional coordinate data of the teaching aid in real time, synchronously collects the facial expression features of key points on the child's face, and establishes a data set associated with spatial position and expression; The voice input module adopts a beamforming microphone array to directionally receive children's voice commands, eliminates environmental background noise through an adaptive filtering algorithm, and outputs a pure voice stream for semantic analysis.

4. The interactive learning system for preschool education according to claim 1, characterized in that: The touch operation module detects the change in contact area when the child operates the physical teaching aid based on the capacitive sensing matrix, and records the pressure value distribution and sliding trajectory coordinate sequence in real time; The environmental perception module is used to monitor the light intensity, temperature and humidity parameters of the operating area, and dynamically adjust the ambient fill light intensity and temperature and humidity thresholds.

5. The interactive learning system for preschool education according to claim 1, characterized in that: The output end of the behavior analysis module is unidirectionally connected to the input end of the feedback generation module and the input end of the data synchronization module respectively, the output end of the feedback generation module and the output end of the data synchronization module are both unidirectionally connected to the input end of the user portrait module, the output end of the feedback generation module and the output end of the data synchronization module are both unidirectionally connected to the input end of the content matching module, and the output end of the data synchronization module is unidirectionally connected to the input end of the parent interface, the input end of the teacher management interface and the input end of the dual-screen collaboration module respectively.

6. The interactive learning system for preschool education according to claim 1, characterized in that: The behavior analysis module is used to integrate image space coordinates, touch trajectory and gesture data, analyze the consistency of operation logic and generate an intention matching score; The content matching module is used to call adapted multimedia teaching resources from a preset knowledge graph based on the learner ability model and dynamically adjust the task difficulty level; The feedback generation module is used to generate three-level response strategy instructions according to the intention matching degree, including voice prompt intensity, projection guidance level and tactile feedback mode.

7. The interactive learning system for preschool education according to claim 1, characterized in that: The data synchronization module is used to encrypt and transmit operation records and environmental data to the cloud, supporting real-time data retrieval and instruction issuance between the teacher and parent sides; The user portrait module is used to record the current user's operating habits, including a six-dimensional ability evaluation model of spatial cognition, language expression, and logical reasoning, store historical operation records and update the ability growth curve.

8. The interactive learning system for preschool education according to claim 1, characterized in that: The output end of the feedback generation module is unidirectionally connected to the input end of the audio output device and the input end of the tactile feedback module respectively, the output end of the content matching module is unidirectionally connected to the input end of the projection display device and the input end of the physical teaching aid driving module respectively, and the output end of the teacher management interface is unidirectionally connected to the input end of the dual-screen collaboration module.

9. The interactive learning system for preschool education according to claim 1, characterized in that: The projection display device is used to project a 1:1 real scene on the operating table, dynamically superimpose operation guide lines and virtual teaching aid models, and support touch interaction to correct spatial positions; The physical teaching aid drive module is used to control the stepper motor to perform millimeter-level calibration of the teaching aid's spatial position and synchronously trigger the piezoelectric ceramic array to generate a local vibration feedback signal; The audio output device is used to play the pre-compiled contextualized voice guidance script in a targeted manner and dynamically switch the background music spectrum characteristics according to the operation stage.

10. The interactive learning system for preschool education according to claim 1, characterized in that: The parent-side interface is used to push a structured report data package containing an operation heat map and a capability radar map, and receive parent-child task configuration parameters submitted by parents; The teacher management port is used to generate a three-dimensional class capability matrix topology map and supports batch import and version management of teaching plan parameters; The tactile feedback module is used to output differential tactile coding signals through a dual-channel linear resonant actuator, with the left wrist transmitting an error prompt pulse and the right wrist sending a completion confirmation waveform; The dual-screen collaboration module is used to implement frame synchronization transmission between the teacher control screen and the parent interaction screen using a low-latency streaming protocol, ensuring strict consistency of the screen content.

Images