Teaching optimization method and system applied to electrical screen cabinet type practical operation teaching

Abstract

The invention discloses a teaching optimization method and system applied to electrical screen cabinet type practical operation teaching, and relates to the teaching optimization method and system applied to the electrical screen cabinet type practical operation teaching. The method comprises the following steps: establishing a spatial influence relationship of sound information of a shooting point along with the change of the relative position of the shooting point and the electrical screen cabinet, establishing a noise association relationship between equipment noise and operating parameters, and establishing a focusing association relationship between content and a shooting focusing point; outputting a distributed loudspeaker layout suggestion according to the spatial influence relationship; obtaining predicted noise data according to the noise association relationship and the predicted operation parameters of the electrical screen cabinet; according to the predicted noise data, the actual layout of the distributed loudspeakers and the layout suggestions of the distributed loudspeakers, adjusting the loudspeaking parameters of the distributed loudspeakers; and outputting camera position parameters and a parameter sequence according to the teaching content in the teaching requirements and the focusing association relationship. The method has the beneficial effects that the accuracy of the shooting point is improved, the teaching efficiency is improved, and the experience feeling of students at all positions is considered.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of teaching, in particular to a teaching optimization method and system applied to electrical screen cabinet practical teaching. BACKGROUND

[0002] In the practical teaching scene of the electrical screen cabinet, there are mainly two core pain points: 1. Limited space, poor observation effect: Due to the extremely narrow space behind the electrical screen cabinet, only one operation teacher and a small number of students can be accommodated. This results in the fact that most students in the back row cannot clearly observe the operation details of the teacher (such as line connection, switch switching, parameter setting, etc.), which seriously affects the teaching quality and observation experience; 2. Complex steps, lack of review means: The operation steps of the screen cabinet are usually complex and complicated, and students can hardly remember all the processes at one time by watching on site. At present, there is a lack of effective teaching scene playback function, and students cannot review and learn deeply after class, so it is difficult for them to fully digest and master the practical operation skills.

[0003] Although there are teaching live broadcast and recording technology in related technologies, a fixed camera position is usually adopted, and the focus is single, which may cause the problem that the shooting content is irrelevant to the teaching content in the teaching process. The teacher needs to constantly adjust the camera position according to the teaching content, which leads to a decrease in teaching efficiency and poor teaching quality.

[0004] In some other related technologies, only a microphone is used to amplify the voice of the training teacher, which can make the students clearly hear the teaching content, but the sound size heard by the students at different positions will be different, which affects the student experience. For example, although a large amplification effect can ensure that the students in the back row can clearly hear the teaching content, it will bring discomfort to the students in the front row and affect the teaching effect of the students in the front row. SUMMARY

[0005] The present application provides a teaching optimization method and system applied to electrical screen cabinet practical teaching to solve the problems of poor teaching efficiency and poor student experience in the prior art. By dynamically adjusting the amplification parameters and camera parameters in the teaching process through the spatial influence relationship of sound collection at different positions of the shooting point, the noise correlation relationship of the equipment operation, and the focusing correlation relationship of the content and the shooting focus, the accuracy of the shooting point is improved, the teaching efficiency is improved, and the sound receiving degree of different positions is reflected by the position of the shooting point to take into account the experience of students at different positions.

[0006] To achieve the above technical purposes, a technical solution provided by the present application is a teaching optimization method applied to electrical screen cabinet practical teaching, comprising the following steps: obtaining historical teaching scene information, historical shooting point position information, historical shooting point sound information and historical electrical screen cabinet position information, building a space influence relationship of shooting point sound information changing with the relative position of the shooting point and the electrical screen cabinet according to the distance between the teaching scene wall and the electrical screen cabinet; constructing a noise correlation relationship of device noise and operation parameters according to historical electrical screen cabinet operation parameters and historical device noise data; matching the shooting focus point in the historical teaching courseware according to the historical teaching content, and constructing a focus correlation relationship of content and shooting focus point; in response to teaching needs, outputting a distributed loudspeaker layout suggestion according to the current teaching scene information and the electrical screen cabinet information through the space influence relationship; obtaining the predicted operation parameters of the electrical screen cabinet according to the teaching content in the teaching needs, and obtaining the predicted noise data according to the noise correlation relationship and the predicted operation parameters of the electrical screen cabinet; adjusting the sound amplification parameters of the distributed loudspeaker according to the predicted noise data, the actual layout of the distributed loudspeaker and the distributed loudspeaker layout suggestion; outputting the camera position parameters and the parameter sequence according to the focus correlation relationship of the teaching content in the teaching needs, and adjusting the camera angle in the teaching process in real time to perform teaching live broadcast and record live video to generate teaching courseware.

[0007] Further, the space influence relationship of the shooting point sound information changing with the relative position of the shooting point and the electrical screen cabinet according to the distance between the teaching scene wall and the electrical screen cabinet includes: calculating the first position relationship under the historical teaching scene according to the position coordinates of the teaching scene wall and the position coordinates of the electrical screen cabinet; for the historical teaching scene with the same first position relationship, obtaining the second position relationship between the shooting point and the electrical screen cabinet, and constructing the space influence relationship corresponding to the first position relationship according to the change of the shooting point sound information with the second position relationship.

[0008] Further, the focus correlation relationship of content and shooting focus point constructed by matching the shooting focus point in the historical teaching courseware according to the historical teaching content includes: taking the center point of the video image in the historical teaching courseware as the shooting focus point, and constructing the focus correlation relationship according to the shooting focus point coordinates and the coordinate change sequence in the same teaching content type.

[0009] Further, the focus correlation relationship of content and shooting focus point constructed by matching the shooting focus point in the historical teaching courseware according to the historical teaching content includes: identifying the teaching content description in the historical teaching courseware by using voice recognition technology, and obtaining the image feature set corresponding to the teaching content description according to the video image under the same teaching content description by using image recognition algorithm; taking the same feature in the image feature set as the shooting focus point, and constructing the focus correlation relationship of content and shooting focus point.

[0010] Further, the acquiring the predicted noise data according to the teaching content in the teaching requirement, the noise correlation relationship and the predicted operation parameter of the electrical screen cabinet comprises: matching the teaching content in the teaching requirement with historical teaching content, acquiring the electrical screen cabinet historical operation parameter corresponding to the matched historical teaching content as the predicted operation parameter of the electrical screen cabinet; and acquiring the predicted noise data according to the noise correlation relationship and the predicted operation parameter of the electrical screen cabinet; wherein the predicted noise data at least comprises noise time sequence and noise frequency data.

[0011] Further, the adjusting the sound amplification parameter of the distributed sound amplifier according to the predicted noise data, the actual layout of the distributed sound amplifier and the layout suggestion of the distributed sound amplifier comprises: acquiring the layout difference according to the actual layout of the distributed sound amplifier and the layout suggestion of the distributed sound amplifier, calculating the compensation parameter according to the sound amplification parameter of the distributed sound amplifier and the layout difference; calculating the basic gain and the gain time sequence of the distributed sound amplifier according to the predicted noise data; acquiring the final gain of the distributed sound amplifier according to the compensation parameter and the basic gain, and acquiring the sound amplification parameter of the distributed sound amplifier according to the final gain and the gain time sequence.

[0012] Further, the outputting the camera position parameter and the parameter sequence according to the teaching content in the teaching requirement and the focusing correlation relationship comprises: matching the focusing correlation relationship according to the teaching content in the teaching requirement, acquiring the corresponding shooting focus point coordinates and the coordinate change sequence, calculating the camera angle parameter under the real-time camera coordinates according to the shooting focus point coordinates and the real-time camera coordinates, and acquiring the camera angle parameter change time sequence and the parameter sequence according to the change time sequence and the change sequence in the coordinate change sequence.

[0013] Further, the generating the teaching courseware by recording the live video further comprises: acquiring the recorded live video, generating the video caption by using the voice recognition technology, identifying the teaching content description in the video caption according to the teaching content description in the historical teaching courseware, acquiring the corresponding description jump node, and generating the teaching courseware containing the video caption and the description jump node.

[0014] Further, it further comprises: performing cluster analysis on the teaching content description in the historical teaching courseware, dividing the historical teaching courseware with the same teaching content description into the same type set; performing equipment detail recognition, portrait detail recognition, image dynamic and static recognition, and image range recognition on the historical teaching courseware in the same type set, obtaining equipment detail features, portrait detail features, image dynamic and static features, and image range features related to the teaching content description; first performing type set matching on the newly generated teaching courseware, and then calling the equipment detail features, portrait detail features, image dynamic and static features, and image range features in the type set to identify the newly generated teaching courseware, and determining whether there is an abnormal image, if so, output the corresponding abnormal image node and abnormal content.

[0015] Another technical solution provided by the application is a teaching optimization system applied to electrical screen cabinet type practical operation teaching, which is used to implement the above method. The sound collection device is used to collect voice information in the teaching process in real time. The video collection device at least includes a camera and a camera parameter adjustment unit. The camera is used to collect image information in the teaching process in real time and perform teaching live broadcast. The camera parameter adjustment unit pre-constructs a focus association relationship between content and a shooting focus point, outputs camera position parameters and parameter sequences according to the teaching content in the teaching requirement and the focus association relationship, and adjusts the camera angle in the teaching process in real time. The sound processing device at least includes a distributed loudspeaker and a loudspeaker parameter adjustment unit. The distributed loudspeaker is used to play the voice information collected by the sound collection device. The loudspeaker parameter adjustment unit pre-constructs a spatial influence relationship of the sound information at the shooting point with the relative position change between the shooting point and the electrical screen cabinet, a noise association relationship between the equipment noise and the operation parameter, and outputs the distributed loudspeaker layout suggestion and adjusts the loudspeaker parameter of the distributed loudspeaker. The courseware generation unit is used to generate a teaching courseware according to the image information collected by the camera.

[0016] The application has the following beneficial effects: 1. The image recognition algorithm is used to identify the electrical screen cabinet and the training teacher in the video image of the historical teaching courseware, to filter out redundant areas other than the two, to reduce the interference of useless information in the image, to take the image center point after filtering out the redundant area as the historical shooting focus point, to ensure that the shooting focus point is necessarily related to the training teacher and the electrical screen cabinet, and to ensure that the shooting focus point corresponds to the actual demand of the teaching content.

[0017] 2. According to the matching of the teaching content in the teaching requirement and the teaching content description, the image features corresponding to the teaching content description, i.e. the shooting focus point, are obtained, the image features of the current image are identified in real time in the teaching process, it is ensured that the image features corresponding to the shooting focus point are always in the current image, and the quality of the teaching content shooting and recording is ensured. BRIEF DESCRIPTION OF DRAWINGS

[0018] Figure 1 A flowchart of a teaching optimization method applied to electrical screen cabinet type practical operation teaching. DETAILED DESCRIPTION

[0019] To make the purposes, technical solutions, and advantages of the present application clearer, further detailed descriptions of the present application are given below in conjunction with the accompanying drawings and examples. It should be understood that the specific implementation described herein is only one of the best modes of the present application, which is used to explain the present application and does not limit the protection scope of the present application. All other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the protection scope of the present application.

[0020] As shown in Figure 1 The teaching optimization method applied to electrical screen cabinet type practical operation teaching includes the following steps: Obtain historical teaching scene information, historical shooting point position information, historical shooting point sound information, and historical electrical screen cabinet position information, and build a spatial influence relationship of shooting point sound information changing with the relative position of the shooting point and the electrical screen cabinet according to the distance between the teaching scene wall and the electrical screen cabinet; Build a noise correlation relationship between device noise and operating parameters according to historical electrical screen cabinet operating parameters and historical device noise data; According to the historical teaching content, match the shooting focus point in the historical teaching courseware, and build a focus correlation relationship between the content and the shooting focus point; In response to teaching needs, output a distributed loudspeaker layout suggestion according to the current teaching scene information and the electrical screen cabinet information through the spatial influence relationship; According to the teaching content in the teaching needs, obtain the predicted operating parameters of the electrical screen cabinet, and obtain the predicted noise data according to the noise correlation relationship and the predicted operating parameters of the electrical screen cabinet; Adjust the sound amplification parameters of the distributed loudspeakers according to the predicted noise data, the actual layout of the distributed loudspeakers, and the distributed loudspeaker layout suggestion; According to the teaching content in the teaching needs and the focus correlation relationship, output the camera position parameters and the parameter sequence, and use them to adjust the camera angle in real time to execute the teaching live broadcast and record the live broadcast video to generate the teaching courseware.

[0021] In the embodiment, the spatial influence relationship of the teaching scene wall and the electrical screen cabinet distance, the shooting point and the electrical screen cabinet distance on the shooting point sound information is constructed by the change of the distance between the historical teaching scene wall and the electrical screen cabinet, and the change of the shooting point sound information with the relative position of the shooting point and the electrical screen cabinet, so that the optimal layout of the distributed loudspeaker in the current scene is obtained according to the spatial influence relationship. Moreover, according to the correlation between the electrical screen cabinet operating state and the noise generated by the operation, the noise type and intensity that the electrical screen cabinet may generate are estimated, and the actual loudspeaker parameters are adjusted in combination with the actual layout and the optimal layout suggestion of the distributed loudspeaker to resist the environmental noise generated by the electrical screen cabinet, so as to ensure that the students can clearly hear the explanation of the teacher and the clear teaching sound can be recorded during the courseware shooting. In the real-time teaching process, the shooting area in the teaching process is automatically determined according to the relationship between the teaching content and the courseware shooting focus point, the focus point is automatically switched according to the teaching logic, and the camera angle is adjusted to ensure that the live or recorded courseware can reflect the teaching focus and improve the teaching quality.

[0022] Specifically, the historical teaching scene information at least includes teaching scene wall position coordinates and teaching scene ID information. The historical electrical screen cabinet position information at least includes electrical screen cabinet position coordinates and electrical screen cabinet ID information. The historical shooting point position information at least includes shooting point position coordinates and shooting device ID information. The shooting point position coordinates corresponding to the shooting device ID information and the shooting point sound information are analyzed for the spatial influence relationship. Under normal circumstances, the teaching scene is relatively fixed, so the basic coordinate system is built, and the teaching scene wall position coordinates and the electrical screen cabinet position coordinates are obtained. Since the sound will be reflected differently by the wall to cause uneven sound field, but each teaching is located in a teaching scene, therefore, the basic coordinate system can be built corresponding to the teaching scene respectively, or only one can be built corresponding to all teaching scenes, which does not affect the relative position of the electrical screen cabinet and the wall, the relative position of the electrical screen cabinet and the shooting point, and the camera focus position parameters under one teaching scene.

[0023] The historical teaching scene information, the historical shooting point position information, the historical shooting point sound information, and the historical electrical screen cabinet position information are obtained, and the spatial influence relationship of the shooting point sound information with the relative position of the shooting point and the electrical screen cabinet according to the distance between the teaching scene wall and the electrical screen cabinet includes: The first position relationship in the historical teaching scene is calculated according to the teaching scene wall position coordinates and the electrical screen cabinet position coordinates. For the historical teaching scene with the same first position relationship, the second position relationship between the shooting point and the electrical screen cabinet is obtained, and the spatial influence relationship corresponding to the first position relationship is constructed according to the change of the shooting point sound information with the second position relationship.

[0024] In the history teaching process, the relative position of the shooting point and the electrical screen cabinet affects the shooting point sound collection effect. If the shooting point is close to the electrical screen cabinet, the shooting point sound collection effect is good. If the shooting point is far away from the electrical screen cabinet, the shooting point sound collection effect is poor. At this time, the shooting point sound information changes with the shooting point position. Taking a historical teaching scene with the same first position relationship as an analysis set, the second position relationship and the shooting point sound information correlation are analyzed to construct the space influence relationship.

[0025] In the embodiment, the first position relationship at least includes the spacing relationship between the electrical screen cabinet and the surrounding wall. The first position relationship not only affects whether the teacher's voice will be disturbed by the wall reflection, but also affects the student's position compared to the electrical screen cabinet. For example, if the electrical screen cabinet is close to a wall on one side, the student will not be able to stand on that side due to the small space, so there is no need to layout the distributed loudspeaker on that side, which improves the accuracy of the distributed loudspeaker layout suggestion and reduces the cost of invalid layout.

[0026] The second position relationship at least includes the distance between the shooting point position and the electrical screen cabinet and the direction of the shooting point position to the electrical screen cabinet. The sound received by the front of the shooting point position and the side of the electrical screen cabinet also has a difference, so as to construct the space influence relationship between the shooting point position and the electrical screen cabinet position by the shooting point sound loudness change corresponding to different directions and different distances.

[0027] Therefore, through the teaching scene ID information and the electrical screen cabinet ID information, the space influence relationship can be quickly matched in the subsequent process, and the layout suggestion output efficiency of the distributed loudspeaker is improved.

[0028] In the embodiment, the noise correlation relationship between the device noise and the operation parameter is constructed according to the historical operation parameters of the electrical screen cabinet and the historical device noise data, so as to predict the device noise according to the electrical screen cabinet operation parameter required by the real-time teaching content, and facilitate the interference exclusion or suppression of the device noise. The device noise data at least includes the power frequency noise and the fan noise, and the operation parameter at least includes the operation voltage, the operation current and the operation time length.

[0029] In some cases, the focus correlation relationship between the content and the shooting focus point is constructed by matching the shooting focus point in the historical teaching courseware according to the historical teaching content, which includes: Taking the center point of the video image in the historical teaching courseware as the shooting focus point, the focus correlation relationship is constructed according to the shooting focus point coordinates and the coordinate change order in the same teaching content type.

[0030] It should be noted that the electrical screen cabinet position coordinates is a coordinate range, when calculating the distance between the wall and the electrical screen cabinet in the teaching scene, the minimum distance between the wall and the electrical screen cabinet is taken as the distance corresponding to the wall, and when obtaining the coordinate change sequence of the shooting focus point, the specific coordinate value of the shooting focus point on the electrical screen cabinet is obtained, for example, during the hand operation process, the shooting focus point is the area controlled by the hand, and the coordinate value of the center point of the current video image is taken as the coordinate value of the shooting focus point. At this time, even if the shooting angle deviates, it can be ensured that the shooting area corresponding to the shooting focus point can cover the range to be shot.

[0031] Since the position of the electrical screen cabinet usually does not change, the shooting focus point corresponding to the same teaching content will not change greatly, and at this time, the focus association relationship between the content and the shooting focus point is constructed according to the coordinates and the coordinate change sequence of the same teaching content, so that when the training teacher explains according to the teaching content, the coordinate change and the coordinate change sequence corresponding to the teaching content can be automatically matched, the shooting range can be automatically adjusted, and the teaching content can be ensured to be shot, thereby improving the teaching quality.

[0032] In other cases, the focus association relationship between the content and the shooting focus point is constructed by matching the shooting focus point in the historical teaching courseware according to the historical teaching content, which comprises: The electrical screen cabinet and the training teacher in the video image of the historical teaching courseware are identified by using an image recognition algorithm, so as to remove the redundant area of the video image; The center point of the video image after removing the redundant area is taken as the historical shooting focus point; The focus association relationship between the content and the shooting focus point is constructed according to the historical shooting focus point coordinates and the coordinate change sequence of the same historical teaching content.

[0033] The image recognition algorithm can be selected from YOLO, R-CNN and other target detection algorithms, and the image recognition algorithm is selected according to the shooting area and the shooting clarity of the actual camera, for example, a smaller shooting area or a lower shooting clarity can select a higher precision image recognition algorithm, and a larger shooting area or a higher shooting clarity can select a lower image recognition algorithm.

[0034] In this case, the electrical screen cabinet and the training teacher in the video image of the historical teaching courseware are identified by using an image recognition algorithm, and the redundant area other than the two is screened out, the useless information interference in the image is reduced, and the center point of the image after screening out the redundant area is taken as the historical shooting focus point. It is ensured that the shooting focus point is necessarily related to the training teacher and the electrical screen cabinet, and the shooting focus point corresponds to the actual demand of the teaching content.

[0035] In yet some cases, the constructing the focusing correlation between the content and the shooting focus point according to the historical teaching content matching the shooting focus point in the historical teaching courseware further comprises: The teaching content description in the historical teaching courseware is recognized by using the voice recognition technology, and the image feature set corresponding to the teaching content description is obtained according to the video image under the same teaching content description by using the image recognition algorithm. The same feature in the image feature set is taken as the shooting focus point, and the focusing correlation between the content and the shooting focus point is constructed.

[0036] The voice recognition technology can select the existing subtitle generation algorithm to generate the text explanation of the courseware while recognizing the voice. This process can be performed when the courseware is generated, and the text explanation is directly called as the teaching content description, the video images with the same teaching content description are retrieved, the image features in the retrieved video images are recognized by the image recognition algorithm, and the image features appearing in all video images of the same teaching content description are taken as the shooting focus point of the teaching content description. It can be understood that, in order to avoid the feature missing in part of the video images leading to the shooting focus point being unable to be selected, a same threshold can be set, when the frequency of a certain feature appearing in the image feature set is greater than the same threshold, it is considered that the feature belongs to the same feature, and the same threshold can be set to 97%.

[0037] For example, the video image of the teaching content description "now check the terminal row B phase connection" is extracted, the image features in the video image are recognized, the "B phase terminal, blue connection, located on the left side of the screen cabinet" corresponding to "now check the terminal row B phase connection" is obtained, the same features of "now check the terminal row B phase connection" such as "B phase terminal" are counted, and the coordinate value of "B phase terminal" is taken as the shooting focus point. It should be noted that when there are multiple same features, there are multiple shooting focus points, which jointly realize the positioning of the shooting area.

[0038] Further, in response to the teaching demand, the spatial influence relationship, the noise correlation relationship and the focusing correlation relationship are called, and the sound amplification parameters and the camera parameters in the teaching are adjusted in real time.

[0039] Specifically, the distributed sound amplifier layout suggestion is output by the spatial influence relationship according to the current teaching scene information and the electrical screen cabinet information, comprising: The spatial influence relationship is matched according to the current teaching scene ID information and the electrical screen cabinet ID information, and the distributed sound amplifier layout suggestion is output according to the shooting point sound intensity drop point in the spatial influence relationship.

[0040] In the embodiment, according to the matching of the current teaching scene ID information, the current electrical screen cabinet ID information and the historical teaching scene ID information and the historical electrical screen cabinet ID information, the space influence relationship corresponding to the historical teaching scene ID information and the historical electrical screen cabinet ID information is called. If the space influence relationship corresponding to the historical teaching scene ID information and the historical electrical screen cabinet ID information is different, the space influence relationship corresponding to the current teaching scene ID information and the current electrical screen cabinet ID information is obtained by synthesizing the two space influence relationships. Thus, the space influence relationship corresponding to the teaching scene and the space influence relationship corresponding to the electrical screen cabinet are weighted and summed, and the weight coefficient is obtained according to the similarity of the teaching scene and the similarity of the electrical screen cabinet. The higher the similarity of the current electrical screen cabinet and the electrical screen cabinet in the historical teaching scene, the higher the weight coefficient of the space influence relationship corresponding to the teaching scene, and the higher the similarity of the current teaching scene and the historical teaching scene corresponding to the historical electrical screen cabinet, the higher the weight coefficient of the space influence relationship corresponding to the electrical screen cabinet.

[0041] According to the shooting point sound intensity drop point in the space influence relationship, the distributed loudspeaker layout suggestion is output, including: The loudspeaker range of the distributed loudspeaker is obtained, the layout recommendation point of the distributed loudspeaker is calculated according to the shooting point sound intensity drop point and the loudspeaker range, and the distributed loudspeaker layout suggestion is output at the layout recommendation point of the distributed loudspeaker.

[0042] The loudspeaker range of the distributed loudspeaker is calculated, which can contain all the layout recommendation points of the shooting point sound intensity drop point. In this process, the least number of distributed loudspeakers is taken as the optimization target to plan and calculate the layout recommendation point.

[0043] According to the teaching content in the teaching demand, the electrical screen cabinet predicted running parameter is obtained, and the predicted noise data is obtained according to the noise correlation relationship and the electrical screen cabinet predicted running parameter, including: According to the matching of the teaching content in the teaching demand and the historical teaching content, the electrical screen cabinet historical running parameter corresponding to the matched historical teaching content is obtained as the electrical screen cabinet predicted running parameter; According to the noise correlation relationship and the electrical screen cabinet predicted running parameter, the predicted noise data is obtained; wherein, the predicted noise data at least includes noise time sequence and noise frequency data.

[0044] In the embodiment, the noise time sequence and the noise frequency data caused by the change of the electrical screen cabinet running parameter are obtained through the change of the electrical screen cabinet running parameter caused by the teaching content, so as to adjust the distributed loudspeaker according to the noise data.

[0045] The loudspeaker parameters of the distributed loudspeaker are adjusted according to the predicted noise data, the actual layout of the distributed loudspeaker, and the distributed loudspeaker layout suggestion, including: The layout difference is obtained according to the actual layout of the distributed loudspeaker and the distributed loudspeaker layout suggestion, and the compensation parameter is calculated according to the basic parameter of the distributed loudspeaker and the layout difference; The basic gain and gain timing of the distributed loudspeaker are calculated according to the predicted noise data; The final gain of the distributed loudspeaker is obtained according to the compensation parameter and the basic gain, and the loudspeaker parameters of the distributed loudspeaker are obtained according to the final gain and the gain timing.

[0046] The layout difference at least includes position difference, angle difference and number difference, and the basic parameter of the distributed loudspeaker at least includes rated power, coverage angle and attenuation curve. The loudspeaker effect influence relationship of the distributed loudspeaker by position, angle and number and the loudspeaker range influence relationship are obtained according to the basic parameter of the distributed loudspeaker, the compensation parameter of the distributed loudspeaker is obtained according to the position difference, angle difference and number difference, for example, when the horizontal distance in the position difference increases by 0.5 meters, the gain compensation is +1.5dB, and when the height distance in the position difference decreases by 0.3 meters, the gain compensation is +1dB.

[0047] The predicted noise data at least includes noise timing, noise intensity and noise frequency band, the basic gain of the distributed loudspeaker is adjusted according to the noise intensity and the noise frequency band, and the gain timing is obtained according to the noise timing.

[0048] The compensation parameter of the sound field uniformity is obtained by the layout deviation, the gain parameter required for noise suppression is obtained by the intensity, frequency band and timing characteristics of the predicted noise, so that the gain parameter completely matches the noise change, the noise enhancement gain is improved, and the noise attenuation gain is reduced, which not only ensures that the voice always suppresses the noise, but also avoids the howling or auditory discomfort caused by too high gain when the noise is low, and at the same time, the actual layout of the distributed loudspeaker does not need to completely conform to the layout suggestion, improving the adaptability.

[0049] The camera position parameter and parameter order are output according to the teaching content and focusing association relationship in the teaching demand, including: The corresponding shooting focus point coordinates and coordinate change order are obtained according to the teaching content matching the focusing association relationship in the teaching demand, the camera angle parameter under the real-time camera coordinates is calculated according to the shooting focus point coordinates and the real-time camera coordinates, and the camera angle parameter change timing and parameter order are obtained according to the change timing and change order in the coordinate change order.

[0050] The camera angle parameter of the position where the teacher is currently located needs to be photographed and the subsequent angle parameter is calculated by photographing the focus point coordinates and real-time camera coordinates, and the camera angle parameter change time sequence and parameter sequence are obtained according to the change time sequence and change sequence in the coordinates, so as to realize the dynamic adjustment of the camera angle.

[0051] In some other cases, according to the matching of the teaching content and the teaching content description in the teaching requirement, the image feature corresponding to the teaching content description is obtained, that is, the photographing focus point, and the image feature of the current image is identified in real time in the teaching process, so that the image feature corresponding to the photographing focus point is always in the current image, and the quality of the teaching content photographing and recording is ensured.

[0052] In the embodiment, the teaching courseware generated by recording the live video further includes: The recorded live video is obtained, the video caption is generated by using the voice recognition technology, the teaching content description in the video caption is identified according to the teaching content description in the historical teaching courseware, the corresponding description jump node is obtained, and the teaching courseware containing the video caption and the description jump node is generated.

[0053] In some other embodiments, the teaching optimization method applied to the electrical screen cabinet type practical operation teaching further includes: The teaching content description in the historical teaching courseware is subjected to cluster analysis, and the historical teaching courseware with the same teaching content description is divided into the same type set; The historical teaching courseware in the same type set is subjected to equipment detail identification, portrait detail identification, image dynamic and static identification, and image range identification, so as to obtain the equipment detail feature, portrait detail feature, image dynamic and static feature, and image range feature related to the teaching content description; The newly generated teaching courseware is first subjected to type set matching, and then the equipment detail feature, portrait detail feature, image dynamic and static feature, and image range feature in the type set are called to identify the newly generated teaching courseware, to determine whether there is an abnormal image, and if so, the corresponding abnormal image node and abnormal content are output.

[0054] In this embodiment, clustering analysis algorithms, such as K-means clustering and K-medoids clustering, are first used to group historical teaching materials based on the similarity of the teaching content descriptions, classifying historical teaching materials in the same cluster into the same type set. Then, images in the historical teaching materials within the same type set are identified and analyzed, matching equipment detail features, human image detail features, image motion / static features, and image range features related to the teaching content description. For example, if a certain equipment point appears in all teaching materials in a teaching content description, then that equipment point is considered to belong to the equipment detail features in the teaching content description; if the teacher's hand appears in all teaching materials in a teaching content description, then that hand is considered to belong to the human image detail features in the teaching content description; if all teaching materials in a teaching content description are static images, then the teaching content description corresponds to the image static features; if the image range in a teaching content description is all wide-angle shooting range, then the wide-angle shooting range is the image range feature corresponding to the teaching content description.

[0055] Therefore, when generating new teaching courseware, the system first matches the type set, and then identifies the images corresponding to the teaching content description in the newly generated teaching courseware based on the device detail features, human image detail features, image motion and static features, and image range features in the type set. It judges whether the image content conforms to the device detail features, human image detail features, image motion and static features, and image range features. If it does, there are no abnormal images. If there are images that do not conform, the image is considered an abnormal image. The system outputs the node where the abnormal image is located and the abnormal content. The abnormal content includes at least the abnormal image and the feature information that did not appear.

[0056] As a second embodiment of this application, a teaching optimization system applied to practical teaching of electrical cabinets includes: A sound acquisition device is used to collect voice information in real time during the teaching process; The video acquisition device includes at least a camera and a camera parameter adjustment unit; The camera is used to collect image information in real time during the teaching process and to perform live teaching. The camera parameter adjustment unit pre-builds the focusing relationship between the content and the shooting focus point, and outputs the camera position parameters and parameter order according to the teaching content and focusing relationship in the teaching needs, so as to adjust the camera angle in real time during the teaching process; The sound processing device includes at least a distributed loudspeaker and a loudspeaker parameter adjustment unit; Distributed loudspeakers are used to amplify and play back the voice information collected by the sound acquisition device; The sound amplification parameter adjustment unit pre-establishes a spatial influence relationship of the sound information of the shooting point changing with the relative position of the shooting point and the electrical screen cabinet, and a noise correlation relationship of the device noise and the operation parameter, so as to output a distributed loudspeaker layout suggestion and adjust the sound amplification parameter of the distributed loudspeaker. The courseware generation unit is used for generating a teaching courseware according to the image information collected by the camera.

[0057] In the embodiment, the sound collecting device is a directional pickup microphone, which is a lapel microphone or a gun microphone with super cardioid directivity, and is worn on the training teacher or fixed near the operating point of the screen cabinet, so as to focus on the direct sound emitted from the mouth of the training teacher and suppress the environmental noise from the side and the back, thereby improving the signal-to-noise ratio from the source.

[0058] The sound amplification parameter adjustment unit is a digital audio processor with a built-in DSP chip, which realizes real-time adjustment of the sound amplification parameter. Specifically, the following steps are performed in the sound amplification parameter adjustment unit: The historical teaching scene information, the historical shooting point position information, the historical sound information of the shooting point and the historical position information of the electrical screen cabinet are acquired, and a spatial influence relationship of the sound information of the shooting point changing with the relative position of the shooting point and the electrical screen cabinet is established according to the distance between the teaching scene wall and the electrical screen cabinet; A noise correlation relationship of the device noise and the operation parameter is established according to the historical operation parameter of the electrical screen cabinet and the historical device noise data; In response to the teaching demand, a distributed loudspeaker layout suggestion is output according to the current teaching scene information and the electrical screen cabinet information through the spatial influence relationship; The predicted noise data are acquired according to the noise correlation relationship and the predicted operation parameter of the electrical screen cabinet according to the teaching content in the teaching demand; The sound amplification parameter of the distributed loudspeaker is adjusted according to the predicted noise data, the actual layout of the distributed loudspeaker and the distributed loudspeaker layout suggestion.

[0059] The distributed loudspeaker is a plurality of small active sound boxes in a decentralized layout.

[0060] In the embodiment, the voice of the training teacher is collected by the directional pickup microphone, the sound amplification parameter adjustment unit adjusts the sound amplification parameter of the distributed loudspeaker to play the collected voice data, and simultaneously records.

[0061] The camera in the video collecting device is equipped with a high-performance CMOS sensor and a wide-angle fixed-focus lens, which can ensure that clear and distortion-free operation details (such as terminal row connection, protection device key, etc.) can be captured under the condition of uneven light in the cabinet. In the embodiment, the camera is a head-mounted camera.

[0062] The following steps are performed in the camera parameter adjustment unit: According to the historical teaching content, the shooting focus points in the historical teaching courseware are matched, and a focus correlation relationship between the content and the shooting focus points is constructed; According to the teaching content in the teaching requirement and the focus correlation relationship, a camera position parameter and a parameter sequence are output, and a camera angle in a teaching process is adjusted in real time.

[0063] The courseware generation unit integrates a low-power SoC, is responsible for audio-video synchronization, H.264 / H.265 real-time hardware encoding, and greatly reduces the data volume.

[0064] In the present embodiment, the teaching optimization system applied to electrical screen cabinet type practical operation teaching is built-in with a large-capacity lithium battery to support continuous work for several hours, and integrates a Wi-Fi / 4G / 5G wireless communication module, which can realize communication transmission between different devices and units, and support stable and low-delay streaming of encoded stream data to self-built or third-party cloud servers through RTMP, RTSP and other standard streaming media protocols.

[0065] The courseware generation unit further includes a cloud service backend and a Web front end and management platform.

[0066] The cloud service backend includes: Streaming media receiving and recording service: receiving the streaming from the recording and broadcasting device, and automatically generating MP4 files according to time, course name, trainer and other information for storage.

[0067] Media asset management system: establishing metadata index (such as professional, equipment model, fault type, operation step label) for each video courseware, supporting full-text retrieval and screening.

[0068] Video processing engine: providing API-based cloud editing service, supporting video dotting, cropping, adding text annotation and subtitles in the browser.

[0069] The Web front end and management platform include: Student portal: providing video on demand, progress record, note annotation, fast playback, collection and download (after authorization) and other functions.

[0070] Teacher management background: supporting courseware management (uploading, classification, publishing, setting permissions), learning data analysis, course arrangement.

[0071] Open API interface: providing standardized RESTful API, allowing enterprises to integrate it with existing LMS, OA system or training archive, realizing single sign-on and data synchronization.

[0072] The above specific embodiments are the preferred embodiments of the teaching optimization method and system for the electrical cabinet class practical teaching application of the present application, and are not intended to limit the specific implementation range of the present application. The scope of the present application includes but is not limited to the specific embodiments. Any equivalent changes made in accordance with the shape and structure of the present application are within the protection scope of the present application.

Claims

1. A teaching optimization method applied to practical operation teaching of electrical screen cabinet, characterized in that: The method comprises the following steps: obtaining historical teaching scene information, historical shooting point position information, historical shooting point sound information, and historical electrical screen cabinet position information, and building a spatial influence relationship of the shooting point sound information changing with the relative position of the shooting point and the electrical screen cabinet according to the distance between the teaching scene wall and the electrical screen cabinet; building a noise correlation relationship between the device noise and the operation parameter according to the historical operation parameter of the electrical screen cabinet and the historical device noise data; matching the shooting focus point in the historical teaching courseware according to the historical teaching content, and building a focus correlation relationship between the content and the shooting focus point; in response to the teaching demand, outputting a distributed loudspeaker layout suggestion through the spatial influence relationship according to the current teaching scene information and the electrical screen cabinet information; obtaining the predicted noise data according to the noise correlation relationship and the predicted operation parameter of the electrical screen cabinet according to the teaching content in the teaching demand; adjusting the sound amplification parameter of the distributed loudspeaker according to the predicted noise data, the actual layout of the distributed loudspeaker, and the distributed loudspeaker layout suggestion; outputting the camera position parameter and the parameter sequence according to the focus correlation relationship between the teaching content and the focus, and adjusting the camera angle in the teaching process in real time to execute the teaching live broadcast and record the live broadcast video to generate the teaching courseware.

2. The teaching optimization method applied to the electrical screen cabinet type practical teaching according to claim 1, wherein: the building of the spatial influence relationship of the shooting point sound information changing with the relative position of the shooting point and the electrical screen cabinet according to the distance between the teaching scene wall and the electrical screen cabinet comprises: calculating the first position relationship under the historical teaching scene according to the position coordinates of the teaching scene wall and the position coordinates of the electrical screen cabinet; for the historical teaching scene with the same first position relationship, obtaining the second position relationship between the shooting point and the electrical screen cabinet, and building the spatial influence relationship corresponding to the first position relationship according to the change of the shooting point sound information with the second position relationship.

3. The teaching optimization method applied to the electrical screen cabinet type practical teaching according to claim 1, wherein: the matching of the shooting focus point in the historical teaching courseware according to the historical teaching content, and the building of the focus correlation relationship between the content and the shooting focus point comprises: taking the center point of the video image in the historical teaching courseware as the shooting focus point, and building the focus correlation relationship according to the shooting focus point coordinates and the coordinate change sequence in the same teaching content type.

4. The teaching optimization method applied to the electrical screen cabinet type practical teaching according to claim 1, wherein: the matching of the shooting focus point in the historical teaching courseware according to the historical teaching content, and the building of the focus correlation relationship between the content and the shooting focus point comprises: recognizing the teaching content description in the historical teaching courseware by using the voice recognition technology, and obtaining the image feature set corresponding to the teaching content description according to the video image under the same teaching content description by using the image recognition algorithm; taking the same feature in the image feature set as the shooting focus point, and building the focus correlation relationship between the content and the shooting focus point.

5. The teaching optimization method applied to the electrical screen cabinet type practical teaching according to claim 1, wherein: The predicted running parameters of the electrical screen cabinet are acquired according to the teaching content in the teaching requirement, the predicted noise data are acquired according to the noise correlation relationship and the predicted running parameters of the electrical screen cabinet, and the predicted noise data include: The historical running parameters of the electrical screen cabinet corresponding to the matched historical teaching content are acquired as the predicted running parameters of the electrical screen cabinet by matching the teaching content in the teaching requirement with the historical teaching content; The predicted noise data are acquired according to the noise correlation relationship and the predicted running parameters of the electrical screen cabinet; wherein the predicted noise data at least include noise time sequence and noise frequency data.

6. The teaching optimization method applied to the practical operation teaching of the electrical screen cabinet according to claim 1, wherein: The sound amplification parameters of the distributed sound amplifier are adjusted according to the predicted noise data, the actual layout of the distributed sound amplifier and the layout suggestion of the distributed sound amplifier, and the adjustment includes: The layout difference is acquired according to the actual layout of the distributed sound amplifier and the layout suggestion of the distributed sound amplifier, and the compensation parameters are calculated according to the sound amplification parameters of the distributed sound amplifier and the layout difference; The basic gain and the gain time sequence of the distributed sound amplifier are calculated according to the predicted noise data; The final gain of the distributed sound amplifier is acquired according to the compensation parameters and the basic gain, and the sound amplification parameters of the distributed sound amplifier are acquired according to the final gain and the gain time sequence.

7. The teaching optimization method applied to the practical operation teaching of the electrical screen cabinet according to claim 3, wherein: The camera position parameters and the parameter sequence are output according to the teaching content in the teaching requirement and the focusing correlation relationship, and the output includes: The corresponding shooting focus point coordinates and coordinate change sequence are acquired by matching the focusing correlation relationship according to the teaching content in the teaching requirement, the camera angle parameters under the real-time camera coordinates are calculated according to the shooting focus point coordinates and the real-time camera coordinates, and the camera angle parameter change time sequence and the parameter sequence are acquired according to the change time sequence and the change sequence in the coordinate change sequence.

8. The teaching optimization method applied to the practical operation teaching of the electrical screen cabinet according to claim 4, wherein: The teaching courseware is generated by recording the live video, and the generation includes: The recorded live video is acquired, the video subtitles are generated by using the speech recognition technology, the teaching content description in the video subtitles is recognized according to the teaching content description in the historical teaching courseware, the corresponding description jump nodes are acquired, and the teaching courseware containing the video subtitles and the description jump nodes is generated.

9. The teaching optimization method for practical operation teaching of electrical screen cabinet according to claim 4, characterized in that: Further including: The historical teaching courseware in the same type set is divided by clustering analysis on the teaching content description in the historical teaching courseware; The equipment detail features, the portrait detail features, the image dynamic and static features and the image range features related to the teaching content description are acquired by equipment detail recognition, portrait detail recognition, image dynamic and static recognition and image range recognition on the historical teaching courseware in the same type set; The newly generated teaching courseware is matched with the type set first, and then the equipment detail features, the portrait detail features, the image dynamic and static features and the image range features in the type set are called to identify the newly generated teaching courseware, and it is judged whether there is an abnormal image, if yes, the corresponding abnormal image node and abnormal content are output.

10. A teaching optimization system applied to practical operation teaching of electrical screen cabinet, used for realizing the method of any one of claims 1 to 9, characterized in that: a sound collecting device is used for collecting voice information in a teaching process in real time; a video collecting device at least comprises a camera and a camera parameter adjusting unit; the camera is used for collecting image information in the teaching process in real time and executing live teaching; the camera parameter adjusting unit pre-constructs a focus correlation between content and a shooting focus point, outputs camera position parameters and parameter sequences according to the focus correlation and teaching content in a teaching requirement, and adjusts a camera angle in the teaching process in real time; a sound processing device at least comprises a distributed loudspeaker and a loudspeaker parameter adjusting unit; the distributed loudspeaker is used for loudspeaker playing of voice information collected by the sound collecting device; the loudspeaker parameter adjusting unit pre-constructs a space influence relationship of sound information at a shooting point with a relative position change between the shooting point and the electrical screen cabinet, a noise correlation between equipment noise and an operation parameter, outputs a distributed loudspeaker layout suggestion, and adjusts loudspeaker parameters of the distributed loudspeaker; a courseware generating unit is used for generating a teaching courseware according to image information collected by the camera.

Images