Learning state evaluation method and system based on artificial intelligence
Through the learning state evaluation method based on artificial intelligence, combined with students' learning behavior and expression data, the target learning state evaluation network is used for evaluation, which solves the problem of poor reliability of learning state evaluation in the existing technology and improves the utilization of learning resources Efficiency and learning reinforcement targeted.
Patent Information
- Application Number
- CN202411182403.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-27
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-08-27
AI Technical Summary
The reliability of learning status assessment in the prior art leads to low effective utilization of learning resources and it is difficult to accurately cover all students' learning processes.
Using the learning state evaluation method based on artificial intelligence, by obtaining students' learning behavior image data and learning expression image data, using the target learning state evaluation network to perform learning state evaluation processing, output learning state evaluation results, and evaluate them in combination with behavior and expression information. Improve the reliability of the assessment.
It improves the reliability of learning status assessment, ensures the effective utilization of learning resources, avoids waste of learning resources, and enhances the pertinence of learning reinforcement.
Smart Images

Figure CN119067499A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of artificial intelligence technology, and in particular to an artificial intelligence-based learning status assessment method and system. Background Art
[0002] After students learn, strengthening their learning for their weak links is one of the important means to ensure the quality of their learning. Among them, in traditional technical solutions, the weak links of learning are generally determined based on students' feedback. This method is inefficient and unreliable. In other words, the learning status of students is determined based on the teacher's observation, that is, the weak links of students are determined. In this way, there are also problems of low efficiency and low reliability (it is difficult to effectively cover the entire learning process of all students). In other words, in the prior art, there is a problem of relatively poor reliability of learning status assessment (due to the poor reliability of learning status assessment, it will lead to the problem of wasted learning resources in the subsequent learning reinforcement process, or the problem of low effective utilization of learning resources). Summary of the invention
[0003] In view of this, an object of the present invention is to provide a learning status assessment method and system based on artificial intelligence to improve the problem of poor reliability of learning status assessment in the prior art.
[0004] To achieve the above objectives, the embodiments of the present invention adopt the following technical solutions:
[0005] A learning status assessment method based on artificial intelligence, comprising:
[0006] The first learning state data and the first number of second learning state data of the target student in the learning process are obtained, wherein the first learning state data is the image data about the learning behavior of the target student, the second learning state data is the image data about the learning expression of the target student, the formation time corresponding to the first number of learning expressions reflected by the first number of second learning state data is different from each other, and the duration corresponding to the learning behavior reflected by the first learning state data and the duration corresponding to the first number of learning expressions reflected by the first number of second learning state data have the same starting point and end point;
[0007] Using a target learning state evaluation network, performing learning state evaluation processing on the first learning state data and the first number of second learning state data, and outputting a corresponding first number of learning state evaluation results, wherein, for any one of the first number of learning state evaluation results, the corresponding evaluation basis includes at least the first learning state data and one of the second learning state data, and the target learning state evaluation network is a neural network formed by training based on sample learning state data and corresponding learning state labels;
[0008] Based on the first number of learning status assessment results, the target learning status assessment results of the target student are determined, wherein the target learning status assessment results refer to the learning status assessment results of the first number of learning status assessment results whose learning status does not meet the predetermined reference learning status, and the target learning status assessment results serve as the basis for strengthening the learning of the target student.
[0009] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state evaluation method, the step of using the target learning state evaluation network to perform learning state evaluation processing on the first learning state data and the first number of second learning state data, and outputting the corresponding first number of learning state evaluation results includes:
[0010] Performing feature mining on the first learning state data, outputting corresponding first state semantic features, and outputting corresponding first number of second state semantic features based on the first state semantic features and the first number of second learning state data, wherein one second state semantic feature is mined based on the first state semantic features and one of the second learning state data;
[0011] Determine the characteristics of interference with learning state;
[0012] The learning state interference feature is loaded so that a first feature transfer unit in a target learning state evaluation network acquires the learning state interference feature, and the learning state interference feature is processed by the first feature transfer unit to form a transferred learning state interference feature;
[0013] The transfer learning state interference feature is loaded so that the second feature transfer unit in the target learning state evaluation network obtains the transfer learning state interference feature, and the second feature transfer unit is used to determine a first number of feature extension links, wherein the second feature transfer unit is used to input the first state semantic feature in the first feature extension process, and input a second state semantic feature for each feature extension link in the second feature extension process, and the input data of the second feature extension process includes the output data of the first feature extension process;
[0014] Based on the transferred learning state interference feature, the first state semantic feature input by the first feature expansion process, and the first number of second state semantic features input by the second feature expansion process, the learning state evaluation results corresponding to each of the first number of feature expansion links are output.
[0015] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state assessment method, the step of performing feature mining on the first learning state data, outputting corresponding first state semantic features, and outputting corresponding first number of second state semantic features based on the first state semantic features and the first number of second learning state data, includes:
[0016] The first learning state data is segmented to output a plurality of corresponding local learning state data, and based on the image size corresponding to the first learning state data, each of the local learning state data is respectively subjected to a pixel expansion operation to form a plurality of corresponding expanded learning state data, wherein the image size corresponding to each of the expanded learning state data is equal to the image size corresponding to the first learning state data;
[0017] Performing a convolution operation on the first learning state data to form a corresponding learning state convolution feature, and performing a convolution operation on each of the local learning state data to form a local learning state convolution feature corresponding to each of the local learning state data, and fusing the learning state convolution feature with the local learning state convolution feature corresponding to each of the local learning state data to output a corresponding first state semantic feature;
[0018] Performing a convolution operation on each of the first number of second learning state data respectively, and outputting an initial learning state feature corresponding to each second learning state data;
[0019] For each second learning state data, the initial learning state feature corresponding to the second learning state data and the first state semantic feature are fused, and the second state semantic feature corresponding to the second learning state data is output.
[0020] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state evaluation method, the step of outputting the learning state evaluation results corresponding to each of the first number of feature extension links based on the transmitted learning state interference feature, the first state semantic feature input by the first feature extension process, and the first number of second state semantic features input by the second feature extension process includes:
[0021] In the first feature expansion process, the first state semantic feature is inputted using the second feature transfer unit;
[0022] Performing a deep mining operation on the transferred learning state interference feature and the first state semantic feature inputted in the first feature expansion process, and outputting a learning state deep feature corresponding to the first feature expansion process;
[0023] Associating the learning state deep feature to the first number of feature extension links;
[0024] In the second feature expansion process, a second state semantic feature is input for each feature expansion link respectively;
[0025] In each feature expansion link, a feature expansion operation is performed on the learning state deep feature and the second state semantic feature input in the second feature expansion process, and a first number of learning state expansion features corresponding to the second feature expansion process are output;
[0026] A learning state evaluation operation is performed according to the first number of learning state extension features, and learning state evaluation results corresponding to each of the first number of feature extension links are output.
[0027] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state evaluation method, the step of performing a deep mining operation on the first state semantic feature input by the transmitted learning state interference feature and the first feature expansion process to output the learning state deep feature corresponding to the first feature expansion process includes:
[0028] The transfer learning state interference feature is loaded so that the second feature transfer unit acquires the transfer learning state interference feature, wherein the second feature transfer unit includes a feature mining subunit, the feature mining subunit includes a feature compression module, a feature diffusion module and a feature expansion module, the input data of the feature diffusion module includes the output data of the feature compression module, the input data of the feature expansion module includes the output data of the feature diffusion module, and the feature compression module includes a first focusing submodule and a second focusing submodule;
[0029] Using the first focusing submodule, performing a focusing mining operation on the transfer learning state interference feature, and outputting a corresponding first learning state focusing feature;
[0030] Utilizing the second focusing submodule, the first learning state focusing feature is associated with the first state semantic feature that is input to perform a focusing mining operation, and the learning state deep feature corresponding to the first feature expansion process is output, wherein the number of dimensions of the transferred learning state interference feature is greater than the number of dimensions of the learning state deep feature, and the feature diffusion module is used to perform a diffusion operation on the learning state deep feature to form a first number of learning state deep features, and to perform a loading operation on the first number of learning state deep features to load them into a feature expansion module used to output a first number of learning state expansion features in the second feature expansion process.
[0031] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state assessment method, the step of using the second focusing submodule to associate the first learning state focusing feature with the input first state semantic feature to perform a focusing mining operation, and outputting the learning state deep feature corresponding to the first feature expansion process includes:
[0032] Performing a multiplication operation on the first learning state focus feature and the first spatial mapping parameter in the second focusing submodule, and outputting a corresponding first learning state mapping feature;
[0033] Performing a multiplication operation on the first learning state focus feature and the second spatial mapping parameter in the second focusing submodule, and outputting a corresponding second learning state mapping feature;
[0034] Performing a multiplication operation on the first state semantic feature and a third spatial mapping parameter in the second focusing submodule, and outputting a corresponding third learning state mapping feature;
[0035] Performing a multiplication operation on the first learning state mapping feature and the second learning state mapping feature, outputting a corresponding focus association parameter, and updating the focus association parameter according to the number of dimensions of the second learning state mapping feature, and outputting a corresponding updated focus association parameter;
[0036] A multiplication operation is performed on the updated focus association parameter and the third learning state mapping feature, and a corresponding learning state depth feature is output.
[0037] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state assessment method, the first number of feature extension links includes any feature extension link, and the any feature extension link refers to any feature extension link;
[0038] Among them, the step of performing a feature expansion operation on the learning state deep feature and the second state semantic feature input in the second feature expansion process in each feature expansion link, and outputting a first number of learning state expansion features corresponding to the second feature expansion process includes:
[0039] The learning state deep feature is loaded so that the feature extension module acquires the learning state deep feature, wherein the feature extension module includes a third focusing submodule and a fourth focusing submodule corresponding to the arbitrary feature extension link;
[0040] Using the third focusing submodule, performing a focused mining operation on the learning state deep feature, and outputting a corresponding second learning state focused feature;
[0041] Using the fourth focusing submodule, performing an associated focusing mining operation on the second learning state focusing feature and the second state semantic feature input by the arbitrary feature extension link, and outputting a corresponding learning state associated focusing feature;
[0042] Based on the learning state associated focus feature, the learning state extended feature corresponding to the arbitrary feature extension link is determined, wherein the number of dimensions of the transmitted learning state interference feature is equal to the number of dimensions of the learning state extended feature.
[0043] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state assessment method, the second feature transfer unit includes a second number of feature mining sub-units connected in cascade, each feature mining sub-unit is used to input the first state semantic feature in the first feature expansion process, and input a second state semantic feature for each feature expansion link in the second feature expansion process;
[0044] The second number of feature mining subunits includes any feature mining subunit, and the any feature mining subunit refers to any feature mining subunit;
[0045] The step of outputting the learning state evaluation results corresponding to each of the first number of feature extension links based on the transferred learning state interference feature, the first state semantic feature input by the first feature extension process, and the first number of second state semantic features input by the second feature extension process includes:
[0046] The feature to be processed is loaded so that the arbitrary feature mining subunit obtains the feature to be processed, and the arbitrary feature mining subunit is used to perform a deep mining operation on the feature to be processed and the first state semantic feature input in the first feature extension process, and a first number of learning state deep features corresponding to the arbitrary feature mining subunit are output, and the first number of learning state deep features corresponding to the arbitrary feature mining subunit are associated with the first number of feature extension links corresponding to the arbitrary feature mining subunit one by one, wherein, when the arbitrary feature mining subunit belongs to the first feature mining subunit, the feature to be processed is the transfer learning state interference feature, and the first number of learning state deep features are the same; when the arbitrary feature mining subunit does not belong to the first feature mining subunit, the feature to be processed includes the first number of learning state extension features corresponding to the previous feature mining subunit of the arbitrary feature mining subunit, and one learning state deep feature is formed based on a learning state extension feature corresponding to the previous feature mining subunit of the arbitrary feature mining subunit and the first state semantic feature, and the input data of the arbitrary feature mining subunit includes the output data of the previous feature mining subunit of the arbitrary feature mining subunit;
[0047] In the second feature expansion process, a second state semantic feature is input into each feature expansion link of the arbitrary feature mining subunit, and a feature expansion operation is performed on the learning state deep feature corresponding to the arbitrary feature mining subunit and the input second state semantic feature in each feature expansion link, and a first number of learning state expansion features corresponding to the arbitrary feature mining subunit are output;
[0048] When the arbitrary feature mining subunit is the last feature mining subunit, the learning state evaluation results corresponding to the first number of feature extension links of the arbitrary feature mining subunit are determined according to the first number of learning state extension features corresponding to the arbitrary feature mining subunit.
[0049] In some preferred embodiments, in the above-mentioned artificial intelligence-based learning state assessment method, the step of determining the learning state interference feature includes:
[0050] Determining historical learning status data, wherein the historical learning status data refers to historical image data about the learning behavior of the target student;
[0051] Loading the historical learning state data so that a feature mining unit in a target learning state evaluation network acquires the historical learning state data;
[0052] Using the feature mining unit, respectively performing a first feature mining operation and a second feature mining operation on the historical learning state data, and outputting a first historical state feature and a second historical state feature corresponding to the historical learning state data;
[0053] Based on the first historical state feature and the second historical state feature corresponding to the historical learning state data, determining to filter the first historical state feature and to filter the second historical state feature;
[0054] A learning state interference feature is determined based on the screening of the first historical state feature and the screening of the second historical state feature.
[0055] An embodiment of the present invention also provides an artificial intelligence-based learning status assessment system, including a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to execute the computer program to implement the above-mentioned artificial intelligence-based learning status assessment method.
[0056] The artificial intelligence-based learning status assessment method and system provided in the embodiments of the present invention can obtain the first learning status data and the first number of second learning status data of the target student in the learning process; secondly, using the target learning status assessment network, the first learning status data and the first number of second learning status data are subjected to learning status assessment processing, and the corresponding first number of learning status assessment results are output; then, based on the first number of learning status assessment results, the target learning status assessment result of the target student is determined. Based on the above method, when the target learning state evaluation network is used to perform learning state evaluation processing, the evaluation basis corresponding to each learning state evaluation result obtained includes at least the first learning state data and the second learning state data, so that the evaluation basis corresponding to each learning state evaluation result includes not only the expression information of the corresponding learning stage, but also the behavior information of the entire learning process. Therefore, the evaluation basis is rich and the evaluation basis is fully related, so that the obtained learning state evaluation result is more reliable; in addition, since the state data for the expression dimension will be subdivided, that is, the granularity is smaller and the accuracy is higher, and the state data for the behavior dimension is global, making the semantics richer, such a combination can also further improve the reliability of the evaluation, and thus improve the problem of relatively poor reliability of learning state evaluation in the prior art (the improvement in reliability can ensure that the resources of subsequent reinforcement learning will not be wasted).
[0057] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0058] Figure 1A structural block diagram of an artificial intelligence-based learning status assessment system provided in an embodiment of the present invention.
[0059] Figure 2 A flowchart of the steps of the artificial intelligence-based learning status assessment method provided in an embodiment of the present invention.
[0060] Figure 3 An internal processing flow chart of the first feature transfer unit provided in an embodiment of the present invention.
[0061] Figure 4 This is a flow chart of the internal processing of the second feature transfer unit provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0062] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings here can be arranged and designed in various different configurations.
[0063] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0064] like Figure 1 As shown, an embodiment of the present invention provides a learning state assessment system based on artificial intelligence. Among them, the learning state assessment system based on artificial intelligence may include a memory and a processor. In detail, the memory and the processor are electrically connected directly or indirectly to achieve data transmission or interaction. For example, they can be electrically connected to each other through one or more communication buses or signal lines. The memory may store at least one software function module (computer program) that can exist in the form of software or firmware. The processor can be used to execute the executable computer program stored in the memory, so as to implement the learning state assessment method based on artificial intelligence provided by the embodiment of the present invention (as described later).
[0065] Optionally, the memory may be, but not limited to, a random access memory (RAM), a read only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), etc. The processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), a system on chip (SoC), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
[0066] and, Figure 1 The structure shown is for illustration only. The artificial intelligence-based learning status assessment system may also include Figure 1 More or fewer components as shown, or with Figure 1 The different configurations shown, for example, may include a communication unit for information exchange with other devices. In a specific application example, the artificial intelligence-based learning status assessment system may be a server with data processing capabilities.
[0067] Combination Figure 2 The embodiment of the present invention also provides a learning status evaluation method based on artificial intelligence, which can be applied to the above-mentioned learning status evaluation system based on artificial intelligence. Among them, the method steps defined in the process related to the learning status evaluation method based on artificial intelligence can be implemented by the learning status evaluation system based on artificial intelligence. Figure 2 The process shown is explained.
[0068] Step S110, obtaining first learning status data and a first number of second learning status data of the target student during the learning process.
[0069] In an embodiment of the present invention, the artificial intelligence-based learning state assessment system can obtain the first learning state data and the first number of second learning state data of the target student during the learning process. The first learning state data is the image data of the target student's learning behavior (which may include multiple frames of images, such as acquired through a connected image acquisition device, or acquired by acquiring images of the target student's entire body), and the second learning state data is the image data of the target student's learning expression (which may include multiple frames of images, or acquired by acquiring images of the target student's face). The formation time corresponding to the first number of learning expressions reflected by the first number of second learning state data is different from each other, and the duration corresponding to the learning behavior reflected by the first learning state data is the same as the starting point and end point of the duration corresponding to the first number of learning expressions reflected by the first number of second learning state data. That is, the first learning state data corresponds to the entire learning process, and the second learning state data corresponds to part of the learning process.
[0070] Step S120: using the target learning state evaluation network, performing learning state evaluation processing on the first learning state data and the first number of second learning state data, and outputting a corresponding first number of learning state evaluation results.
[0071] In an embodiment of the present invention, the artificial intelligence-based learning state evaluation system can use the target learning state evaluation network to perform learning state evaluation processing on the first learning state data and the first number of second learning state data, and output the corresponding first number of learning state evaluation results. Wherein, for any one of the first number of learning state evaluation results, the corresponding evaluation basis includes at least the first learning state data and one of the second learning state data. For example, the first learning state data and the first second learning state data correspond to the first learning state evaluation result; the first learning state data and the second second learning state data correspond to the second learning state evaluation result; the first learning state data and the third second learning state data correspond to the third learning state evaluation result. In addition, the target learning state evaluation network is a neural network formed by training based on sample learning state data (including sample first learning state data and sample second learning state data) and corresponding learning state labels (i.e., actual learning state, which can be formed by expert evaluation), such as evaluating based on sample learning state data, and then calculating the error of the obtained evaluation state and learning state label, and then adjusting the parameters of the neural network in the direction of reducing the error so that the error converges, thereby obtaining the target learning state evaluation network. Exemplarily, the learning state evaluation result can be a discrete distribution (such as excellent learning state, better learning state, good learning state, average learning state, poor learning state, poor learning state, extremely poor learning state, etc.), or it can be a continuous distribution (such as 0-10 or 0-100, the higher the score, the better the state). Correspondingly, for discrete distribution, the output function of the target learning state neural network can be a classification function such as softmax, and for continuous distribution, the output function of the target learning state neural network can be some linear regression functions, etc., which can be configured according to actual needs.
[0072] Step S130: determining a target learning status assessment result of the target student based on the first number of learning status assessment results.
[0073] In an embodiment of the present invention, the artificial intelligence-based learning state evaluation system can determine the target learning state evaluation result of the target student based on the first number of learning state evaluation results. Wherein, the target learning state evaluation result refers to the learning state evaluation result in which the learning state does not meet the predetermined reference learning state in the first number of learning state evaluation results, and the target learning state evaluation result is used as the basis for strengthening the learning of the target student. Exemplarily, the learning state evaluation results belonging to poor learning state, poor learning state, and extremely poor learning state can be used as the target learning state evaluation result, or the learning state evaluation results with a score less than 5 or 50 can be used as the target learning state evaluation result, so that the learning content within the time of the corresponding second learning state data can be strengthened (i.e., the content learned during the poor learning state is learned again to achieve the strengthening of the weak links. For example, when the eyes are squinting, the learning state may be poor, and the content of this node may not be fully learned. However, since squinting does not necessarily mean that the attention is not focused, the overall action (behavior) of the student will also be combined for evaluation, so that the evaluation result can be more accurate).
[0074] Based on the above method, when the target learning state evaluation network is used to perform learning state evaluation processing, the evaluation basis corresponding to each learning state evaluation result obtained includes at least the first learning state data and the second learning state data, so that the evaluation basis corresponding to each learning state evaluation result includes not only the expression information of the corresponding learning stage, but also the behavior information of the entire learning process. Therefore, the evaluation basis is rich and the evaluation basis is fully related, so that the obtained learning state evaluation result is more reliable; in addition, since the state data for the expression dimension will be subdivided, that is, the granularity is smaller and the accuracy is higher, and the state data for the behavior dimension is global, making the semantics richer, such a combination can also further improve the reliability of the evaluation, and thus improve the problem of relatively poor reliability of learning state evaluation in the prior art (the improvement in reliability can ensure that the resources of subsequent reinforcement learning will not be wasted).
[0075] It should be noted that for the above-mentioned step S120, the specific method of performing learning status evaluation processing on the first learning status data and the first number of second learning status data is not limited and can be selected according to actual needs. For example, in a specific application example, in order to make the learning status evaluation processing more reliable and avoid similar input data (all are the same students and have the same first learning status data) causing the output data to be fitted as too similar, the above-mentioned step S120 can further include step S121, step S122, step S123, step S124 and step S125, and the specific content of each step is described as follows.
[0076] Step S121, performing feature mining on the first learning state data, outputting corresponding first state semantic features, and outputting corresponding first number of second state semantic features based on the first state semantic features and the first number of second learning state data.
[0077] In an embodiment of the present invention, the first learning state data may be feature mined to output corresponding first state semantic features, and based on the first state semantic features and the first number of second learning state data, the first number of second state semantic features may be output. Among them, a second state semantic feature is mined based on the first state semantic feature and a second learning state data. In other words, a second state semantic feature carries the semantic information of the first state semantic feature and the semantic information of the second learning state data.
[0078] Step S122, determining the learning state interference characteristics.
[0079] In the embodiment of the present invention, a learning state interference feature may be determined. Exemplarily, the learning state interference feature may be randomly generated or may be generated based on historical learning state data.
[0080] Step S123, loading the learning state interference feature so that the first feature transfer unit in the target learning state evaluation network acquires the learning state interference feature, and uses the first feature transfer unit to process the learning state interference feature to form a transferred learning state interference feature.
[0081] In an embodiment of the present invention, after determining the learning state interference feature, the learning state interference feature can be loaded so that the first feature transfer unit in the target learning state evaluation network obtains the learning state interference feature, and uses the first feature transfer unit to process the learning state interference feature to form a transferred learning state interference feature.
[0082] Step S124, loading the transfer learning state interference feature so that the second feature transfer unit in the target learning state evaluation network acquires the transfer learning state interference feature, and using the second feature transfer unit to determine a first number of feature extension links.
[0083] In an embodiment of the present invention, after obtaining the transfer learning state interference feature, the transfer learning state interference feature can be loaded so that the second feature transfer unit in the target learning state evaluation network obtains the transfer learning state interference feature, and uses the second feature transfer unit to determine a first number of feature extension links. The second feature transfer unit is used to input the first state semantic feature in the first feature extension process, and input a second state semantic feature for each feature extension link in the second feature extension process, and the input data of the second feature extension process includes the output data of the first feature extension process. That is to say, in the second feature transfer unit, two stages of processing are included, namely the first feature extension process and the second feature extension process, and the data processed by the second feature extension process includes the data (features) processed by the first feature extension process. In addition, the first number of feature extension links can refer to the first number of deep feature mining and evaluation output units in the second feature transfer unit, so that the first number of deep feature mining and evaluation output units can be used to perform deep mining on the transfer learning state interference feature, the first state semantic feature, and the first number of second state semantic features, and evaluate based on the mined deep features, so as to obtain the learning state evaluation results corresponding to each of the first number of feature extension links.
[0084] Step S125, based on the transferred learning state interference feature, the first state semantic feature input by the first feature expansion process, and the first number of second state semantic features input by the second feature expansion process, output the learning state evaluation results corresponding to each of the first number of feature expansion links.
[0085] In an embodiment of the present application, the learning state evaluation results corresponding to each of the first number of feature extension links can be output based on the transfer learning state interference feature, the first state semantic feature input by the first feature extension process, and the first number of second state semantic features input by the second feature extension process. That is to say, after the transfer learning state interference feature, the first state semantic feature input by the first feature extension process, and the first number of second state semantic features input by the second feature extension process are loaded into the second feature transfer unit, the second feature transfer unit can be used to process these loaded features, thereby realizing learning state evaluation and obtaining the corresponding learning state evaluation result.
[0086] In detail, in a specific application example, in order to further improve the representation ability of the obtained semantic features, the above step S121 may further include the following sub-steps:
[0087] First, the first learning state data may be segmented to output a plurality of corresponding local learning state data, and based on the image size corresponding to the first learning state data, pixel expansion operations may be performed on each of the local learning state data to form a plurality of corresponding expanded learning state data, wherein the image size corresponding to each of the expanded learning state data is equal to the image size corresponding to the first learning state data; illustratively, the image corresponding to the first learning state data may be segmented according to a predetermined image size (such as 108*192, etc.) to obtain a plurality of segmented sub-images, that is, to obtain a plurality of local learning state data, and then, pixel expansion (such as interpolation, etc.) may be performed on the segmented sub-images to obtain a plurality of expanded learning state data, so that the pixel distribution (such as 1080x1920, etc.) of the segmented sub-images after pixel expansion is the same as the pixel distribution of the image before segmentation;
[0088] Secondly, a convolution operation can be performed on the first learning state data to form a corresponding learning state convolution feature, and a convolution operation can be performed on each of the local learning state data respectively to form a local learning state convolution feature corresponding to each of the local learning state data, and the learning state convolution feature and the local learning state convolution feature corresponding to each of the local learning state data are fused to output the corresponding first state semantic feature; exemplarily, a convolution operation (and a pooling operation, etc.) can be performed on the first learning state data through a convolution unit (including one or more convolution kernels, etc.) in the target learning state evaluation network to form a corresponding learning state convolution feature, and A convolution operation is performed on each of the local learning state data to form a corresponding local learning state convolution feature. Then, the learning state convolution feature and each local learning state convolution feature can be connected (Concat, wherein the size of each feature is consistent) to achieve fusion, thereby obtaining a first state semantic feature. Based on this, the first state semantic feature can include both global behavioral semantics and local behavioral semantics, achieving global and local attention, and thus, the representation ability can be better; it should be noted that, in other examples, the first learning state data can also be semantically segmented, such as segmented according to body parts, so that each body part can be further focused on;
[0089] Then, a convolution operation may be performed on each of the first number of second learning state data, and an initial learning state feature corresponding to each second learning state data may be output. Exemplarily, a convolution operation may also be performed on the second learning state data through a convolution unit in the target learning state evaluation network (which may be the same as or different from the aforementioned convolution unit), and a corresponding initial learning state feature may be output.
[0090] Finally, for each second learning state data, the initial learning state feature corresponding to the second learning state data and the first state semantic feature can be fused to output the second state semantic feature corresponding to the second learning state data; exemplarily, the initial learning state feature and the first state semantic feature can be connected to obtain the second state semantic feature, and the connected feature can be convolved to obtain the second state semantic feature; or, in other examples, the initial learning state feature and the first state semantic feature can be weighted superimposed, etc., wherein the weight coefficient of the initial learning state feature can be larger to achieve differentiation between the second state semantic features, or focus on different expression information.
[0091] In detail, in a specific application example, in order to avoid excessive influence of the referenced learning state interference feature on subsequent feature processing, the above step S122 may further include:
[0092] First, the historical learning state data may be determined, wherein the historical learning state data refers to the historical image data of the target student's learning behavior. It should be noted that when the target student does not have historical image data, the historical image data of other students may also be used;
[0093] Secondly, the historical learning state data can be loaded so that the feature mining unit in the target learning state evaluation network can obtain the historical learning state data; that is, the historical learning state data can be input into the feature mining unit;
[0094] Then, the feature mining unit can be used to perform a first feature mining operation and a second feature mining operation on the historical learning state data, respectively, to output a first historical state feature and a second historical state feature corresponding to the historical learning state data; illustratively, the first feature mining operation can be to perform a convolution operation and a mean pooling operation on the historical learning state data, so as to obtain the first historical state feature; the first feature mining operation can be to perform a convolution operation and a maximum pooling operation on the historical learning state data (the step size and window size of the pooling are the same as the step size and window size of the pooling of the mean pooling operation), so as to obtain the second historical state feature;
[0095] Afterwards, based on the first historical state feature and the second historical state feature corresponding to the historical learning state data, it is possible to determine to select the first historical state feature and the second historical state feature; illustratively, the parameters in the first historical state feature and the second historical state feature can be randomly sampled respectively, so that the first historical state feature and the second historical state feature can be obtained, so that the difference between the first historical state feature and the second historical state feature can be guaranteed, and the semantic information in the historical learning state data can also be guaranteed;
[0096] Finally, the learning state interference feature can be determined based on the first historical state feature and the second historical state feature. For example, any one of the first historical state feature and the second historical state feature can be used as the learning state interference feature, or the average of the first historical state feature and the second historical state feature can be used as the learning state interference feature. In this way, the problem of poor feature expression caused by excessive interference can be avoided while adding interference features to avoid overfitting.
[0097] Specifically, in a specific application example, in order to avoid poor interference characteristics of the referenced learning state interference feature (such as excessive similarity between the historical learning state data and the first learning state data), the above step S123 may further include:
[0098] First, the first feature transfer unit may be used to determine any interference feature; illustratively, the arbitrary interference feature may be randomly generated, including at least one non-zero parameter among multiple parameters, and in addition, the size of the arbitrary interference feature may be greater than or equal to the size of the learning state interference feature;
[0099] Secondly, the first feature transfer unit can be used to perform a fusion operation of any local interference feature on the learning state interference feature in the second number of processing nodes, and output the corresponding transferred learning state interference feature, wherein the arbitrary local interference feature belongs to a partial feature of the arbitrary interference feature, and the arbitrary local interference features fused in the second number of processing nodes are different from each other, and the processing node carries a fusion weight coefficient for the fusion operation (the fusion weight coefficient can be used as a network parameter of the first feature transfer unit and is formed in the corresponding training process); exemplarily, combined with Figure 3In the first processing node, sampling can be performed from the arbitrary interference feature to obtain a first arbitrary local interference feature, and then, based on the corresponding fusion weight coefficient, the first arbitrary local interference feature and the learning state interference feature can be weighted summed to obtain a first fused interference feature; in the second processing node, sampling can be performed from the arbitrary interference feature (the sampling method is different in different processing nodes) to obtain a second arbitrary local interference feature, and then, based on the corresponding fusion weight coefficient, the second arbitrary local interference feature and the first fused interference feature can be weighted summed to obtain a second fused interference feature. In this way, the last fused interference feature corresponding to the last processing node can be obtained and used as the transferred learning state interference feature.
[0100] In detail, in a specific application example, in order to ensure that features with better representation capabilities can be mined so that a more reliable learning state evaluation can be performed based on the features, the above-mentioned step S125 can further include step S125a, step S125b, step S125c, step S125d, step S125e and step S125f, and the specific contents of each step are described as follows.
[0101] Step S125a: In the first feature expansion process, the first state semantic feature is inputted using the second feature transfer unit.
[0102] In the embodiment of the present invention, during the first feature expansion process, the second feature transfer unit may be used to input the first state semantic feature, that is, during the first feature expansion process, the first state semantic feature may be first input into the second feature transfer unit.
[0103] Step S125b: performing a deep mining operation on the transferred learning state interference feature and the first state semantic feature input by the first feature expansion process, and outputting a learning state deep feature corresponding to the first feature expansion process.
[0104] In an embodiment of the present invention, during the first feature expansion process, since the transferred learning state interference feature is previously input into the second feature transfer unit, the transferred learning state interference feature and the first state semantic feature input during the first feature expansion process can be deeply mined to output the learning state deep feature corresponding to the first feature expansion process. In this way, the learning state deep feature can represent the depth information, and the depth information has both the semantic information of the first state semantic feature and the semantic information of the transferred learning state interference feature, thereby enriching the depth information (such as fusing historical semantics as interference).
[0105] Step S125c: Associating the learning state deep feature with the first number of feature extension links.
[0106] In the embodiment of the present invention, after the learning state deep feature is output, the learning state deep feature can be associated with the first number of feature extension links, that is, each of the feature extension links can obtain the learning state deep feature.
[0107] Step S125d: In the second feature expansion process, a second state semantic feature is input for each feature expansion link.
[0108] In the embodiment of the present invention, after the output and association of the learning state deep features are completed, the second feature expansion process can be entered, and in the second feature expansion process, a second state semantic feature can be input for each feature expansion link respectively. That is to say, since there are a first number of feature expansion links and a first number of second state semantic features, the second state semantic features and feature expansion links can be matched one by one and input.
[0109] Step S125e: In each feature expansion link, a feature expansion operation is performed on the learning state deep feature and the second state semantic feature input in the second feature expansion process, and a first number of learning state expansion features corresponding to the second feature expansion process are output.
[0110] In an embodiment of the present invention, still in the second feature expansion process, after implementing the input of the second state semantic feature, the learning state deep feature and the second state semantic feature input in the second feature expansion process can be subjected to a feature expansion operation in each feature expansion link, and a first number of learning state expansion features corresponding to the second feature expansion process can be output; exemplarily, in the first feature expansion link, the learning state deep feature and the first second state semantic feature can be subjected to a feature expansion operation, and a first learning state expansion feature can be output; in the second feature expansion link, the learning state deep feature and the second second state semantic feature can be subjected to a feature expansion operation, and a second learning state expansion feature can be output; in the third feature expansion link, the learning state deep feature and the third second state semantic feature can be subjected to a feature expansion operation, and a third learning state expansion feature can be output; based on this, the learning state expansion feature corresponding to each feature expansion link can be obtained, and for the first number of feature expansion links, a first number of learning state expansion features can be obtained in the second feature expansion process.
[0111] Step S125f, performing a learning state evaluation operation according to the first number of learning state extension features, and outputting learning state evaluation results corresponding to each of the first number of feature extension links.
[0112] In an embodiment of the present invention, after obtaining a first number of learning state extension features, a learning state evaluation operation may be performed based on the first number of learning state extension features, and the learning state evaluation results corresponding to each of the first number of feature extension links may be output. For example, for the first learning state extension feature, a learning state evaluation operation may be performed on the learning state extension feature, and the corresponding first learning state evaluation result may be output; for the second learning state extension feature, a learning state evaluation operation may be performed on the learning state extension feature, and the corresponding second learning state evaluation result may be output. In addition, it should be noted that since the expressions at different stages of the learning process may be correlated, for each learning state extended feature, the learning state extended feature can be first subjected to an associated focus mining operation based on each other learning state extended feature to obtain a plurality of associated focus mining results corresponding to the learning state extended feature. Then, the plurality of associated focus mining results can be weighted summed (wherein, the closer the learning stage corresponding to other learning state extended features is to the learning stage corresponding to the learning state extended feature, the larger the corresponding weighting coefficient is) to obtain the weighted summation result corresponding to the learning state extended feature. Finally, the weighted summation result is pooled and fully connected. Finally, the processed result is classified and output based on the corresponding output function to obtain the corresponding learning state evaluation result.
[0113] In detail, in a specific application example, in order to ensure the accuracy of deep mining operations so that the obtained learning state deep features have better semantic representation capabilities, the above-mentioned step S125b can further include step b1, step b2 and step b3, and the contents of each step are described as follows.
[0114] Step b1, loading the transfer learning state interference feature so that the second feature transfer unit acquires the transfer learning state interference feature.
[0115] In an embodiment of the present invention, the transfer learning state interference feature can be loaded so that the second feature transfer unit acquires the transfer learning state interference feature. The second feature transfer unit includes a feature mining subunit, and the feature mining subunit includes a feature compression module, a feature diffusion module, and a feature expansion module. The input data of the feature diffusion module includes the output data of the feature compression module, and the input data of the feature expansion module includes the output data of the feature diffusion module. That is to say, the feature compression module, the feature diffusion module, and the feature expansion module are cascaded, and the output data of the previous module is used as the input data of the next module. The feature compression module includes a first focusing submodule and a second focusing submodule.
[0116] Step b2: using the first focusing submodule, performing a focusing mining operation on the transfer learning state interference feature, and outputting a corresponding first learning state focusing feature.
[0117] In an embodiment of the present invention, after the transfer learning state interference feature is input into the first focusing submodule, the first focusing submodule can be used to perform a focusing mining operation on the transfer learning state interference feature, and output a corresponding first learning state focusing feature. The specific processing method of the focusing mining operation can refer to the explanation of the associated focusing mining operation later, that is, the transfer learning state interference feature and the transfer learning state interference feature are associated with each other and the corresponding first learning state focusing feature is output.
[0118] Step b3: using the second focusing submodule, the first learning state focusing feature is associated with the input first state semantic feature to perform focusing mining operations, and output the learning state deep feature corresponding to the first feature expansion process.
[0119] In an embodiment of the present invention, after obtaining the first learning state focus feature, the second focus submodule can be used to associate the first learning state focus feature with the input first state semantic feature to perform a focus mining operation, and output the learning state deep feature corresponding to the first feature expansion process. Wherein, the number of dimensions of the transmitted learning state interference feature is greater than the number of dimensions of the learning state deep feature, and the feature diffusion module is used to diffuse the learning state deep feature to form a first number of learning state deep features, and load the first number of learning state deep features to load into the feature expansion module used to output the first number of learning state expansion features in the second feature expansion process, that is, the feature expansion module is used to perform a feature expansion operation on the first number of learning state deep features, so as to output the first number of learning state expansion features. Exemplarily, the first number of learning state deep features may be completely identical or may not be completely identical.
[0120] In detail, in a specific application example, the specific manner of performing the associated focus mining operation in the above step b3 is not limited. For example, in order to enable the first learning state focus feature and the first state semantic feature to be fully integrated by performing the associated focus mining operation to ensure that the obtained learning state deep feature has better semantic representation ability, the above step b3 may further include the following sub-steps:
[0121] First, the first learning state focus feature and the first spatial mapping parameter in the second focusing submodule may be multiplied to output the corresponding first learning state mapping feature, wherein the first spatial mapping parameter may be formed in a corresponding training process as a network parameter of the second focusing submodule;
[0122] Secondly, the first learning state focus feature and the second spatial mapping parameter in the second focusing submodule may be multiplied to output a corresponding second learning state mapping feature, wherein the second spatial mapping parameter, as a network parameter of the second focusing submodule, may be formed in a corresponding training process;
[0123] Then, the first state semantic feature and the third space mapping parameter in the second focusing submodule may be multiplied to output a corresponding third learning state mapping feature, wherein the third space mapping parameter, as a network parameter of the second focusing submodule, may be formed in a corresponding training process;
[0124] Afterwards, the first learning state mapping feature and the second learning state mapping feature may be multiplied to output a corresponding focus-related parameter, and the focus-related parameter may be updated according to the number of dimensions of the second learning state mapping feature to output a corresponding updated focus-related parameter. For example, the second learning state mapping feature may be divided by the number of dimensions, or by a positive correlation coefficient of the number of dimensions, such as the square of the positive correlation parameter being equal to the number of dimensions.
[0125] Finally, the updated focus association parameter and the third learning state mapping feature may be multiplied to output a corresponding learning state depth feature.
[0126] In detail, in a specific application example, in order to ensure the reliability of the feature extension operation so that the semantic representation ability of the obtained learning state extension feature is better, the above-mentioned step S125e can further include the following sub-steps (that is, the specific processing process of the above-mentioned feature extension module, the first number of feature extension links includes any feature extension link, and the arbitrary feature extension link refers to any feature extension link):
[0127] First, the learning state deep feature can be loaded so that the feature extension module acquires the learning state deep feature, wherein the feature extension module includes a third focusing submodule and a fourth focusing submodule corresponding to the arbitrary feature extension link, that is, the learning state deep feature can be input into the feature extension module;
[0128] Secondly, the third focusing submodule can be used to perform a focused mining operation (as described above) on the learning state deep features to output corresponding second learning state focused features;
[0129] Then, the fourth focusing submodule may be used to perform an associated focusing mining operation (as described above) on the second learning state focusing feature and the second state semantic feature input by the arbitrary feature extension link, and output a corresponding learning state associated focusing feature;
[0130] Finally, based on the learning state associated focused features, the learning state extended features corresponding to the arbitrary feature extension link can be determined, wherein the number of dimensions of the transmitted learning state interference features is equal to the number of dimensions of the learning state extended features; exemplarily, the learning state associated focused features can be used as the learning state extended features, or the learning state associated focused features can be further processed to obtain the corresponding learning state extended features, for example, the learning state associated focused features and the second state semantic features can be superimposed to obtain the corresponding learning state associated focused features, or the superimposed results can be processed by convolution, pooling, full connection, etc.
[0131] In detail, in a specific application example, the second feature transfer unit includes a second number of feature mining subunits connected in cascade, each feature mining subunit is used to input the first state semantic feature in the first feature expansion process, and input a second state semantic feature for each feature expansion link in the second feature expansion process. Wherein, the second number of feature mining subunits includes any feature mining subunit, and the any feature mining subunit refers to any feature mining subunit. Based on this, the above step S125 may also include:
[0132] First, the feature to be processed can be loaded so that the arbitrary feature mining subunit obtains the feature to be processed, and the arbitrary feature mining subunit is used to perform a deep mining operation on the feature to be processed and the first state semantic feature input in the first feature expansion process (refer to the relevant description in the previous text), and a first number of learning state deep features corresponding to the arbitrary feature mining subunit are output, and an association operation is performed on the first number of learning state deep features corresponding to the arbitrary feature mining subunit, so that the first number of feature expansion links corresponding to the arbitrary feature mining subunit are associated one by one, wherein, in combination Figure 4 , when the arbitrary feature mining subunit belongs to the first feature mining subunit, the feature to be processed is the transferred learning state interference feature, and the first number of learning state deep features are the same; when the arbitrary feature mining subunit does not belong to the first feature mining subunit, the feature to be processed includes the first number of learning state extended features corresponding to the previous feature mining subunit of the arbitrary feature mining subunit, and a learning state deep feature is formed based on a learning state extended feature corresponding to the previous feature mining subunit of the arbitrary feature mining subunit and the first state semantic feature, and the input data of the arbitrary feature mining subunit includes the output data of the previous feature mining subunit of the arbitrary feature mining subunit;
[0133] Then, in the second feature expansion process, a second state semantic feature can be input into each feature expansion link of the arbitrary feature mining subunit respectively, and in each feature expansion link, the learning state deep feature corresponding to the arbitrary feature mining subunit and the input second state semantic feature are subjected to feature expansion operation (refer to the relevant description above), and the first number of learning state expansion features corresponding to the arbitrary feature mining subunit are output;
[0134] Finally, when the arbitrary feature mining sub-unit belongs to the last feature mining sub-unit, the learning state evaluation results corresponding to the first number of feature extension links of the arbitrary feature mining sub-unit are determined according to the first number of learning state extension features corresponding to the arbitrary feature mining sub-unit; that is, the learning state evaluation operation can be performed on the first number of learning state extension features corresponding to the last feature mining sub-unit to obtain the learning state evaluation results corresponding to the first number of feature extension links.
[0135] Finally, it should be noted that the various features mentioned above can be expressed in the form of vectors and the like.
[0136] To sum up, the artificial intelligence-based learning state assessment method and system provided by the present invention can obtain the first learning state data and the first number of second learning state data of the target student in the learning process; secondly, using the target learning state assessment network, the first learning state data and the first number of second learning state data are subjected to learning state assessment processing, and the corresponding first number of learning state assessment results are output; then, based on the first number of learning state assessment results, the target learning state assessment result of the target student is determined. Based on the above method, when the target learning state evaluation network is used to perform learning state evaluation processing, the evaluation basis corresponding to each learning state evaluation result obtained includes at least the first learning state data and the second learning state data, so that the evaluation basis corresponding to each learning state evaluation result includes not only the expression information of the corresponding learning stage, but also the behavior information of the entire learning process. Therefore, the evaluation basis is rich and the evaluation basis is fully related, so that the obtained learning state evaluation result is more reliable; in addition, since the state data for the expression dimension will be subdivided, that is, the granularity is smaller and the accuracy is higher, and the state data for the behavior dimension is global, making the semantics richer, such a combination can also further improve the reliability of the evaluation, and thus improve the problem of relatively poor reliability of learning state evaluation in the prior art (the improvement in reliability can ensure that the resources of subsequent reinforcement learning will not be wasted).
[0137] In several embodiments provided in the embodiments of the present invention, it should be understood that the disclosed apparatus and method can also be implemented in other ways. The apparatus and method embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the apparatus, method and computer program product according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, program segment or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.
[0138] In addition, the functional modules in the various embodiments of the present invention may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.
[0139] If the functions are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention is essentially or partly contributed to the prior art or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to enable a computer device (which can be a personal computer, an electronic device, or a network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk. It should be noted that, in this article, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements that are not explicitly listed, or also includes elements inherent to such a process, method, article or device. Without more constraints, an element defined by the phrase "comprising a..." does not exclude the existence of other identical elements in the process, method, article or apparatus comprising the element.
[0140] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A learning status evaluation method based on artificial intelligence, characterized in that: include: The first learning state data and the first number of second learning state data of the target student in the learning process are obtained, wherein the first learning state data is the image data about the learning behavior of the target student, the second learning state data is the image data about the learning expression of the target student, the formation time corresponding to the first number of learning expressions reflected by the first number of second learning state data is different from each other, and the duration corresponding to the learning behavior reflected by the first learning state data and the duration corresponding to the first number of learning expressions reflected by the first number of second learning state data have the same starting point and end point; Using a target learning state evaluation network, performing learning state evaluation processing on the first learning state data and the first number of second learning state data, and outputting a corresponding first number of learning state evaluation results, wherein, for any one of the first number of learning state evaluation results, the corresponding evaluation basis includes at least the first learning state data and one of the second learning state data, and the target learning state evaluation network is a neural network formed by training based on sample learning state data and corresponding learning state labels; Based on the first number of learning status assessment results, the target learning status assessment results of the target student are determined, wherein the target learning status assessment results refer to the learning status assessment results of the first number of learning status assessment results whose learning status does not meet the predetermined reference learning status, and the target learning status assessment results serve as the basis for strengthening the learning of the target student.
2. The method for evaluating learning status based on artificial intelligence according to claim 1, characterized in that: The step of using the target learning state evaluation network to perform learning state evaluation processing on the first learning state data and the first number of second learning state data, and outputting the corresponding first number of learning state evaluation results includes: Performing feature mining on the first learning state data, outputting corresponding first state semantic features, and outputting corresponding first number of second state semantic features based on the first state semantic features and the first number of second learning state data, wherein one second state semantic feature is mined based on the first state semantic features and one of the second learning state data; Determine the characteristics of interference with learning state; The learning state interference feature is loaded so that a first feature transfer unit in a target learning state evaluation network acquires the learning state interference feature, and the learning state interference feature is processed by the first feature transfer unit to form a transferred learning state interference feature; The transfer learning state interference feature is loaded so that the second feature transfer unit in the target learning state evaluation network obtains the transfer learning state interference feature, and the second feature transfer unit is used to determine a first number of feature extension links, wherein the second feature transfer unit is used to input the first state semantic feature in the first feature extension process, and input a second state semantic feature for each feature extension link in the second feature extension process, and the input data of the second feature extension process includes the output data of the first feature extension process; Based on the transferred learning state interference feature, the first state semantic feature input by the first feature expansion process, and the first number of second state semantic features input by the second feature expansion process, the learning state evaluation results corresponding to each of the first number of feature expansion links are output.
3. The learning status assessment method based on artificial intelligence as claimed in claim 2, characterized in that: The step of performing feature mining on the first learning state data, outputting corresponding first state semantic features, and outputting corresponding first number of second state semantic features based on the first state semantic features and the first number of second learning state data, comprises: The first learning state data is segmented to output a plurality of corresponding local learning state data, and based on the image size corresponding to the first learning state data, each of the local learning state data is respectively subjected to a pixel expansion operation to form a plurality of corresponding expanded learning state data, wherein the image size corresponding to each of the expanded learning state data is equal to the image size corresponding to the first learning state data; Performing a convolution operation on the first learning state data to form a corresponding learning state convolution feature, and performing a convolution operation on each of the local learning state data to form a local learning state convolution feature corresponding to each of the local learning state data, and fusing the learning state convolution feature with the local learning state convolution feature corresponding to each of the local learning state data to output a corresponding first state semantic feature; Performing a convolution operation on each of the first number of second learning state data respectively, and outputting an initial learning state feature corresponding to each second learning state data; For each second learning state data, the initial learning state feature corresponding to the second learning state data and the first state semantic feature are fused to output the second state semantic feature corresponding to the second learning state data.
4. The method for evaluating learning status based on artificial intelligence according to claim 2, characterized in that: The step of outputting the learning state evaluation results corresponding to each of the first number of feature extension links based on the transferred learning state interference feature, the first state semantic feature input by the first feature extension process, and the first number of second state semantic features input by the second feature extension process comprises: In the first feature expansion process, the first state semantic feature is inputted using the second feature transfer unit; Performing a deep mining operation on the transferred learning state interference feature and the first state semantic feature inputted in the first feature expansion process, and outputting a learning state deep feature corresponding to the first feature expansion process; Associating the learning state deep feature to the first number of feature extension links; In the second feature expansion process, a second state semantic feature is input for each feature expansion link respectively; In each feature expansion link, a feature expansion operation is performed on the learning state deep feature and the second state semantic feature input in the second feature expansion process, and a first number of learning state expansion features corresponding to the second feature expansion process are output; A learning state evaluation operation is performed according to the first number of learning state extension features, and learning state evaluation results corresponding to each of the first number of feature extension links are output.
5. The method for evaluating learning status based on artificial intelligence according to claim 4, characterized in that: The step of performing a deep mining operation on the transferred learning state interference feature and the first state semantic feature inputted in the first feature expansion process, and outputting a learning state deep feature corresponding to the first feature expansion process, comprises: The transfer learning state interference feature is loaded so that the second feature transfer unit acquires the transfer learning state interference feature, wherein the second feature transfer unit includes a feature mining subunit, the feature mining subunit includes a feature compression module, a feature diffusion module and a feature expansion module, the input data of the feature diffusion module includes the output data of the feature compression module, the input data of the feature expansion module includes the output data of the feature diffusion module, and the feature compression module includes a first focusing submodule and a second focusing submodule; Using the first focusing submodule, performing a focused mining operation on the transfer learning state interference feature, and outputting a corresponding first learning state focused feature; Utilizing the second focusing submodule, the first learning state focusing feature is associated with the first state semantic feature that is input to perform a focusing mining operation, and the learning state deep feature corresponding to the first feature expansion process is output, wherein the number of dimensions of the transferred learning state interference feature is greater than the number of dimensions of the learning state deep feature, and the feature diffusion module is used to perform a diffusion operation on the learning state deep feature to form a first number of learning state deep features, and to perform a loading operation on the first number of learning state deep features to load them into a feature expansion module used to output a first number of learning state expansion features in the second feature expansion process.
6. The method for evaluating learning status based on artificial intelligence according to claim 5, characterized in that: The step of using the second focusing submodule to associate the first learning state focusing feature with the input first state semantic feature and perform a focusing mining operation to output a learning state deep feature corresponding to the first feature expansion process includes: Performing a multiplication operation on the first learning state focus feature and the first spatial mapping parameter in the second focus submodule, and outputting a corresponding first learning state mapping feature; Performing a multiplication operation on the first learning state focus feature and the second spatial mapping parameter in the second focusing submodule, and outputting a corresponding second learning state mapping feature; Performing a multiplication operation on the first state semantic feature and a third spatial mapping parameter in the second focusing submodule, and outputting a corresponding third learning state mapping feature; Performing a multiplication operation on the first learning state mapping feature and the second learning state mapping feature, outputting a corresponding focus association parameter, and updating the focus association parameter according to the number of dimensions of the second learning state mapping feature, and outputting a corresponding updated focus association parameter; A multiplication operation is performed on the updated focus association parameter and the third learning state mapping feature, and a corresponding learning state depth feature is output.
7. The method for evaluating learning status based on artificial intelligence according to claim 5, characterized in that: The first number of feature extension links includes any feature extension link, and the any feature extension link refers to any one feature extension link; Among them, the step of performing a feature expansion operation on the learning state deep feature and the second state semantic feature input in the second feature expansion process in each feature expansion link, and outputting a first number of learning state expansion features corresponding to the second feature expansion process includes: The learning state deep feature is loaded so that the feature extension module acquires the learning state deep feature, wherein the feature extension module includes a third focusing submodule and a fourth focusing submodule corresponding to the arbitrary feature extension link; Using the third focusing submodule, performing a focused mining operation on the learning state deep feature, and outputting a corresponding second learning state focused feature; Using the fourth focusing submodule, performing an associated focusing mining operation on the second learning state focusing feature and the second state semantic feature input by the arbitrary feature extension link, and outputting a corresponding learning state associated focusing feature; Based on the learning state associated focus feature, the learning state extended feature corresponding to the arbitrary feature extension link is determined, wherein the number of dimensions of the transmitted learning state interference feature is equal to the number of dimensions of the learning state extended feature.
8. The method for evaluating learning status based on artificial intelligence according to claim 2, characterized in that: The second feature transfer unit includes a second number of feature mining subunits connected in cascade, each feature mining subunit is used to input the first state semantic feature in the first feature expansion process, and input a second state semantic feature for each feature expansion link in the second feature expansion process; The second number of feature mining subunits includes any feature mining subunit, and the any feature mining subunit refers to any feature mining subunit; The step of outputting the learning state evaluation results corresponding to each of the first number of feature extension links based on the transferred learning state interference feature, the first state semantic feature input by the first feature extension process, and the first number of second state semantic features input by the second feature extension process includes: The feature to be processed is loaded so that the arbitrary feature mining subunit obtains the feature to be processed, and the arbitrary feature mining subunit is used to perform a deep mining operation on the feature to be processed and the first state semantic feature input in the first feature extension process, and a first number of learning state deep features corresponding to the arbitrary feature mining subunit are output, and the first number of learning state deep features corresponding to the arbitrary feature mining subunit are associated with the first number of feature extension links corresponding to the arbitrary feature mining subunit one by one, wherein, when the arbitrary feature mining subunit belongs to the first feature mining subunit, the feature to be processed is the transfer learning state interference feature, and the first number of learning state deep features are the same; when the arbitrary feature mining subunit does not belong to the first feature mining subunit, the feature to be processed includes the first number of learning state extension features corresponding to the previous feature mining subunit of the arbitrary feature mining subunit, and one learning state deep feature is formed based on a learning state extension feature corresponding to the previous feature mining subunit of the arbitrary feature mining subunit and the first state semantic feature, and the input data of the arbitrary feature mining subunit includes the output data of the previous feature mining subunit of the arbitrary feature mining subunit; In the second feature expansion process, a second state semantic feature is input into each feature expansion link of the arbitrary feature mining subunit, and a feature expansion operation is performed on the learning state deep feature corresponding to the arbitrary feature mining subunit and the input second state semantic feature in each feature expansion link, and a first number of learning state expansion features corresponding to the arbitrary feature mining subunit are output; When the arbitrary feature mining subunit is the last feature mining subunit, the learning state evaluation results corresponding to the first number of feature extension links of the arbitrary feature mining subunit are determined according to the first number of learning state extension features corresponding to the arbitrary feature mining subunit.
9. The method for evaluating learning status based on artificial intelligence according to claim 2, characterized in that: The step of determining the learning state interference feature includes: Determining historical learning status data, wherein the historical learning status data refers to historical image data about the learning behavior of the target student; Loading the historical learning state data so that a feature mining unit in a target learning state evaluation network acquires the historical learning state data; Using the feature mining unit, respectively performing a first feature mining operation and a second feature mining operation on the historical learning state data, and outputting a first historical state feature and a second historical state feature corresponding to the historical learning state data; Based on the first historical state feature and the second historical state feature corresponding to the historical learning state data, determining to filter the first historical state feature and to filter the second historical state feature; A learning state interference feature is determined based on the screening of the first historical state feature and the screening of the second historical state feature.
10. A learning status assessment system based on artificial intelligence, characterized in that: It comprises a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to execute the computer program to implement the artificial intelligence-based learning status assessment method described in any one of claims 1 to 9.
Citation Information
Patent Citations
Teaching estimation method and system
CN106228293A
Object recognition method and device and method and device for training object recognition network, and electronic device
CN108537135A
Multi-mode information fusion-based classroom learning state monitoring method and system
CN108805009A
Student online learning evaluation method and system based on image sentiment analysis
CN112883867A
Expression recognition and classroom state evaluation method and device, and medium
CN113239916A
