Pre-school education method and system based on image recognition

By identifying user interests and hobbies and automatically playing related video materials, the problem of low learning interest in children in the existing technology is solved, preschool education based on user interests is realized, and learning effect and educational service quality are improved.

CN119006236AInactive Publication Date: 2024-11-22SOUTH CHINA NORMAL UNIV
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202410922464.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-10
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing preschool education smart devices cannot accurately and comprehensively explore children's interests and hobbies, resulting in low learning interest and low learning efficiency, and the inability to conduct comprehensive preschool education based on children's interests.

Method used

By obtaining user's face information, identifying user identity, querying interests and hobbies, and using the line of sight to follow index and pupil dilated times to analyze user interests, automatically play relevant video materials until the content that the user is interested in is found, and the degree of mastery is evaluated through question and answer form Optimize educational content.

Benefits of technology

It has achieved customized educational materials based on user interests, stimulated learning interest, improved learning effect, and improved the quality of preschool education services through continuous optimization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119006236A_ABST
    Figure CN119006236A_ABST
Patent Text Reader

Abstract

The invention discloses a preschool education method and system based on image recognition, and relates to the technical field of preschool education. The method comprises the following steps: acquiring face information of a user; identifying user identity information according to the face information; querying a database according to the user identity information to obtain interests and hobbies corresponding to the current user, and randomly selecting related video data for playing; judging whether the user is interested in the currently played video data or not; according to the method, the interest degree of the user in the video data is analyzed through the sight line following index of the user for the currently played video data and the pupil magnification times when the user watches the video data, so that the optimal education data is customized for the user, teaching is achieved through lively activities, the learning interest of the user is stimulated, and the learning effect is improved; and finally, evaluating the mastery degree of the user on the video data in a question and answer form, and optimizing the content and form of the video data according to the mastery degree of the user, thereby continuously improving the preschool education service quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of preschool education, and in particular to a preschool education method and system based on image recognition. Background Art

[0002] Preschool education refers to the planned education of preschool children by institutions that implement early childhood education based on certain training goals and the physical and mental characteristics of children. Its main task is to enable children to achieve coordinated development and prepare for primary school education. Preschool education became an independent discipline, which was first proposed by German educator FWA Froebel. Froebel systematically discussed the importance, content and methods of kindergarten education. He believed that children's development is a gradual process, education should be suitable for children's development, and education should be based on children's autonomous activities.

[0003] The existing smart devices for preschool education usually only perform single image recognition on children, and cannot accurately and comprehensively explore children's interests and hobbies, and automatically play corresponding video image materials according to children's interests and hobbies, and cannot provide all-round preschool education according to children's interests, resulting in low learning interest and low learning efficiency for children. Therefore, we propose a preschool education method and system based on image recognition to solve the above problems. Summary of the invention

[0004] The purpose of the present invention is to provide a preschool education method and system based on image recognition to solve the problems in the current market raised by the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solution: a preschool education method based on image recognition, comprising the following steps:

[0006] Get the user's facial information;

[0007] Identify user identity information based on the facial information;

[0008] Query the database based on the user's identity information to obtain the interests and hobbies corresponding to the current user, and randomly select a related video material to play;

[0009] Determine whether the user is interested in the currently playing video material, specifically:

[0010] Get the user's eye tracking index for the currently playing video material;

[0011] Get the number of times the user's pupils dilate when watching;

[0012] If the sight following index is greater than the preset sight following index and the number of pupil dilations is greater than the preset number of pupil dilations, it means that the user is very interested in the currently playing video material; otherwise, it means that the user is not interested in the currently playing video material; if the sight following index is greater than the preset sight following index or the number of pupil dilations is greater than the preset number of pupil dilations, it means that the user is generally interested in the currently playing video material;

[0013] When it is determined that the user is not interested in the currently played video material, another video material related to the user's interests is played, until the video material of interest to the user is found;

[0014] Calculating the gaze following index includes:

[0015] Calculate the average velocity V of the eye following the sight mark, as follows:

[0016]

[0017] Calculate the average fixation time T of the eyeball at the center of the sight mark, as follows:

[0018]

[0019] in, is the starting point coordinate of the sight mark movement in the i-th moving segment, is the coordinate of the end point of the sight mark movement in the i+1th moving segment, n is the number of sight mark movement segments, t is the total time used for the sight mark movement, t1 is the time the eyeball stays at the first sight mark positioning point, t n+1 The time the eyeball stays at the n+1th sight mark location point, which is the last sight mark location point;

[0020] Calculate the gaze following index F as follows:

[0021]

[0022] Among them, V0 is the preset average rate, and T0 is the preset average fixation duration.

[0023] Preferably, determining the user identity information based on the facial information is specifically: locking and scanning the user's face, extracting facial features based on the scanned image, matching the extracted facial features with facial features of pre-input facial information, and outputting the user identity information corresponding to the matching facial features.

[0024] Preferably, the user identity information includes age, gender, and interests and hobbies.

[0025] Preferably, after the video material that the user is interested in is played, the user's mastery of the video material is evaluated based on a question-and-answer format, and the content and format of the video material are optimized based on the user's mastery of the video material.

[0026] A preschool education system based on image recognition, comprising:

[0027] The recognition module is used to obtain the user's facial information to identify the user's identity information;

[0028] The playback module is used to query the database according to the user identity information to obtain the interests and hobbies corresponding to the current user, and randomly select a related video material for playback;

[0029] The first acquisition module is used to obtain the user's eye tracking index for the currently playing video material;

[0030] The second acquisition module is used to obtain the number of pupil dilations of the user when watching;

[0031] An analysis module is used to analyze whether the user is interested in the currently played video material. If the user is not interested in the currently played video material, another video material related to the user's interests is played until the video material of interest to the user is found;

[0032] Question and answer module, used to randomly ask users questions based on the content of the video material and collect the users' answers;

[0033] The evaluation module is used to evaluate the user's mastery of the video material based on the user's answers.

[0034] Preferably, the calculation of the sight-following index in the first acquisition module includes:

[0035] Calculate the average velocity V of the eye following the sight mark, as follows:

[0036]

[0037] Calculate the average fixation time T of the eyeball at the center of the sight mark, as follows:

[0038]

[0039] in, is the starting point coordinate of the sight mark movement in the i-th moving segment, is the coordinate of the end point of the sight mark movement in the i+1th moving segment, n is the number of sight mark movement segments, t is the total time used for the sight mark movement, t1 is the time the eyeball stays at the first sight mark positioning point, t n+1 The time the eyeball stays at the n+1th sight mark location point, which is the last sight mark location point;

[0040] Calculate the gaze following index F as follows:

[0041]

[0042] Among them, V0 is the preset average rate, and T0 is the preset average fixation duration.

[0043] Compared with the prior art, the present invention has the following beneficial effects:

[0044] The present invention analyzes the user's interest in the video material through the user's line of sight following index to the currently playing video material and the number of times the user's pupil dilates when watching, so as to customize the best educational material for the user, which is conducive to stimulating the user's learning interest and improving the learning effect; finally, the user's mastery of the video material is evaluated through a question-and-answer format, and the content and format of the video material are optimized according to the user's mastery, so as to continuously improve the quality of preschool education services.

[0045] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 A schematic diagram of a preschool education method based on image recognition according to the present invention;

[0047] Figure 2 The present invention is a flowchart of a preschool education system based on image recognition. DETAILED DESCRIPTION

[0048] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] See also Figure 1 , a preschool education method based on image recognition, comprising the following steps:

[0050] Get the user's facial information;

[0051] Identify user identity information based on facial information, specifically: lock and scan the user's face, extract facial features based on the scanned image, match the extracted facial features with the facial features of the pre-input facial information, and output the user identity information corresponding to the matching facial features; the user identity information includes age, gender, interests and hobbies;

[0052] Query the database based on the user's identity information to obtain the interests and hobbies corresponding to the current user, and randomly select a related video material to play;

[0053] Determine whether the user is interested in the currently playing video material, specifically:

[0054] Get the user's eye tracking index for the currently playing video material;

[0055] Calculate the gaze following index, including:

[0056] Calculate the average velocity V of the eye following the sight mark, as follows:

[0057]

[0058] Calculate the average fixation time T of the eyeball at the center of the sight mark, as follows:

[0059]

[0060] in, is the starting point coordinate of the sight mark movement in the i-th moving segment, is the coordinate of the end point of the sight mark movement in the i+1th moving segment, n is the number of sight mark movement segments, t is the total time used for the sight mark movement, t1 is the time the eyeball stays at the first sight mark positioning point, t n+1 The time the eyeball stays at the n+1th sight mark location point, which is the last sight mark location point;

[0061] Calculate the gaze following index F as follows:

[0062]

[0063] Among them, V0 is the preset average rate, T0 is the preset average fixation duration;

[0064] Get the number of times the user's pupils dilate when watching;

[0065] If the sight following index is greater than the preset sight following index and the number of pupil dilations is greater than the preset number of pupil dilations, it means that the user is very interested in the currently playing video material; otherwise, it means that the user is not interested in the currently playing video material; if the sight following index is greater than the preset sight following index or the number of pupil dilations is greater than the preset number of pupil dilations, it means that the user is generally interested in the currently playing video material;

[0066] When it is determined that the user is not interested in the currently played video material, another video material related to the user's interests is played, until the video material of interest to the user is found;

[0067] After the video material that the user is interested in is played, the user's understanding of the video material is evaluated based on a question-and-answer format, and the content and format of the video material are optimized based on the user's understanding.

[0068] A preschool education system based on image recognition, comprising:

[0069] The recognition module is used to obtain the user's facial information to identify the user's identity information;

[0070] The playback module is used to query the database according to the user identity information to obtain the interests and hobbies corresponding to the current user, and randomly select a related video material for playback;

[0071] The first acquisition module is used to obtain the user's eye tracking index for the currently playing video material;

[0072] The calculation of the gaze following index includes:

[0073] Calculate the average velocity V of the eye following the sight mark, as follows:

[0074]

[0075] Calculate the average fixation time T of the eyeball at the center of the sight mark, as follows:

[0076]

[0077] in, is the starting point coordinate of the sight mark movement in the i-th moving segment, is the coordinate of the end point of the sight mark movement in the i+1th moving segment, n is the number of sight mark movement segments, t is the total time used for the sight mark movement, t1 is the time the eyeball stays at the first sight mark positioning point, t n+1 The time the eyeball stays at the n+1th sight mark location point, which is the last sight mark location point;

[0078] Calculate the gaze following index F as follows:

[0079]

[0080] Among them, V0 is the preset average rate, T0 is the preset average fixation duration;

[0081] The second acquisition module is used to obtain the number of pupil dilations of the user when watching;

[0082] An analysis module is used to analyze whether the user is interested in the currently played video material. If the user is not interested in the currently played video material, another video material related to the user's interests is played until the video material of interest to the user is found;

[0083] Question and answer module, used to randomly ask users questions based on the content of the video material and collect the users' answers;

[0084] The evaluation module is used to evaluate the user's mastery of the video material based on the user's answers.

[0085] The present invention analyzes the user's interest in the video material through the user's line of sight following index to the currently playing video material and the number of times the user's pupil dilates when watching, so as to customize the best educational material for the user, which is conducive to stimulating the user's learning interest and improving the learning effect; finally, the user's mastery of the video material is evaluated through a question-and-answer format, and the content and format of the video material are optimized according to the user's mastery, so as to continuously improve the quality of preschool education services.

[0086] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention belong.

[0087] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0088] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0089] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by hardware associated with program instructions, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps in the method embodiment.

[0090] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0091] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A preschool education method based on image recognition, characterized in that: The steps include: Get the user's facial information; Identify user identity information based on the facial information; Query the database based on the user's identity information to obtain the interests and hobbies corresponding to the current user, and randomly select a related video material to play; Determine whether the user is interested in the currently playing video material, specifically: Get the user's eye tracking index for the currently playing video material; Get the number of times the user's pupils dilate when watching; If the sight following index is greater than the preset sight following index and the number of pupil dilations is greater than the preset number of pupil dilations, it means that the user is very interested in the currently playing video material; otherwise, it means that the user is not interested in the currently playing video material; if the sight following index is greater than the preset sight following index or the number of pupil dilations is greater than the preset number of pupil dilations, it means that the user is generally interested in the currently playing video material; When it is determined that the user is not interested in the currently played video material, another video material related to the user's interests is played, until the video material of interest to the user is found; Calculating the gaze following index includes: Calculate the average velocity V of the eye following the sight mark, as follows: Calculate the average fixation time T of the eyeball at the center of the sight mark, as follows: in, is the starting point coordinate of the sight mark movement in the i-th moving segment, is the coordinate of the end point of the sight mark movement in the i+1th moving segment, n is the number of sight mark movement segments, t is the total time used for the sight mark movement, t1 is the time the eyeball stays at the first sight mark positioning point, t n+1 The time the eyeball stays at the n+1th sight mark location point, which is the last sight mark location point; Calculate the gaze following index F as follows: Among them, V0 is the preset average rate, and T0 is the preset average fixation duration.

2. A preschool education method based on image recognition according to claim 1, characterized in that: The determining of the user identity information based on the facial information is specifically as follows: locking and scanning the user's face, extracting facial features based on the scanned image, matching the extracted facial features with facial features of the pre-input facial information, and outputting the user identity information corresponding to the matching facial features.

3. A preschool education method based on image recognition according to claim 2, characterized in that: The user identity information includes age, gender, and interests and hobbies.

4. The preschool education method based on image recognition according to claim 1, characterized in that: After the video material that the user is interested in is played, the user's understanding of the video material is evaluated based on a question-and-answer format, and the content and format of the video material are optimized based on the user's understanding.

5. A preschool education system based on image recognition, characterized in that: include: The recognition module is used to obtain the user's facial information to identify the user's identity information; The playback module is used to query the database according to the user identity information to obtain the interests and hobbies corresponding to the current user, and randomly select a related video material for playback; The first acquisition module is used to obtain the user's eye tracking index for the currently playing video material; The second acquisition module is used to obtain the number of pupil dilations of the user when watching; An analysis module is used to analyze whether the user is interested in the currently played video material. If the user is not interested in the currently played video material, another video material related to the user's interests is played until the video material of interest to the user is found; Question and answer module, used to randomly ask users questions based on the content of the video material and collect the users' answers; The evaluation module is used to evaluate the user's mastery of the video material based on the user's answers.

6. A preschool education method and system based on image recognition according to claim 5, characterized in that: The calculation of the sight-following index in the first acquisition module includes: Calculate the average velocity V of the eye following the sight mark, as follows: Calculate the average fixation time T of the eyeball at the center of the sight mark, as follows: in, is the starting point coordinate of the sight mark movement in the i-th moving segment, is the coordinate of the end point of the sight mark movement in the i+1th moving segment, n is the number of sight mark movement segments, t is the total time used for the sight mark movement, t1 is the time the eyeball stays at the first sight mark positioning point, t n+1 The time the eyeball stays at the n+1th sight mark location point, which is the last sight mark location point; Calculate the gaze following index F as follows: Among them, V0 is the preset average rate, and T0 is the preset average fixation duration.

Citation Information

Patent Citations

  • Preschool education method and system based on image recognition

    CN112669180A

  • Interest degree determination method and device, electronic equipment and storage medium

    CN114066687A