A method and system for actively detecting mobile phone usage behavior in classroom
By combining polarized light images and natural light images, the system accurately identifies students' mobile phone usage behavior in the classroom, solving the problem of inaccurate identification in existing technologies and providing detailed classroom management information.
Patent Information
- Application Number
- CN202210174648.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-24
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2042-02-24
AI Technical Summary
Existing technologies struggle to accurately identify whether students are using mobile phones in the classroom, especially when the phone screen is dim, leading to inaccurate information collection and potential misjudgments, which negatively impacts teaching quality.
By combining polarized light image information with natural light image information, and by acquiring polarized light images and natural light images, flicker feature analysis is performed to remove interference information, and the flicker feature database is used to determine whether there is mobile phone usage behavior.
It improves the accuracy of mobile phone usage recognition, accurately records students' location, posture, usage time and other information, and provides intuitive classroom management decision support.
Smart Images

Figure CN114549949B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of classroom management, and in particular to a method and system for actively detecting mobile phone usage behavior in a classroom. Background Art
[0002] During classroom teaching, students usually use their mobile phones, which affects the teaching quality. There are many ways to control the use of mobile phones in the classroom, such as handing in mobile phones and placing them in centralized areas. However, there are problems such as students leaving spare mobile phones and forgetting to take them out of class or taking them by mistake.
[0003] The prior art discloses a classroom ban on mobile phone auxiliary management system and method, which includes a mobile phone storage device, a seat, a rotating motor, and a rotating motor control device. The seat is controlled to open or close according to the connection status between the mobile phone and the control terminal, so as to forcibly control the students from bringing mobile phones into the classroom. This method prohibits all use of mobile phones, which is not reasonable; and it requires the provision of special seats, which increases the teaching cost.
[0004] The prior art also discloses an early warning system for students playing with mobile phones in class, including a camera, a primary data collector, a secondary data collector, a processor, and an alarm terminal. The camera is used to collect information such as students' facial expressions, sitting postures, hand movements, and mobile phone brightness and transmit it to the primary data collector; the secondary data collector includes a secondary storage module and a secondary comparison and analysis module. Although this method can identify whether students use mobile phones to a certain extent, since there is no "standard action" for students to study in class, this method will lose its effect when the mobile phone is placed on the desktop to watch videos, and there is no significant difference in sitting posture and hand movements when looking at mobile phones and reading textbooks, and it is very difficult to distinguish. At the same time, there is a lot of information collected by a single camera; when the mobile phone screen is dark, the collected information is inaccurate, and it is not combined with the corresponding student's non-mobile phone state image, and the student information needs to be further verified. The recognition result is not intuitive enough, and it is very easy to misjudge and cause interference to the classroom teaching process. Summary of the invention
[0005] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a method and system for actively detecting mobile phone usage behavior in the classroom. Based on the imaging principle of the mobile phone screen and utilizing the fact that the light emitted by the mobile phone screen is the only polarized light source with a constantly changing flickering frequency in the classroom environment, the polarized light image information is combined with the natural light image information to more accurately confirm the user information and improve the detection accuracy.
[0006] In order to achieve the above object, the present invention is implemented through the following technical solutions:
[0007] In a first aspect, an embodiment of the present invention provides a method for actively detecting mobile phone usage behavior in a classroom, comprising:
[0008] Acquiring polarized light image information, wherein the polarized light image information is acquired through a recording module with a polarized light filter structure;
[0009] Perform stroboscopic feature analysis on polarized light image information to obtain feature data, compare the feature data with pre-stored information in a stroboscopic feature database, and determine whether there is a mobile phone use behavior;
[0010] The information pre-stored in the stroboscopic characteristic database includes the stroboscopic frequency of the LCD screen, the frequency variation law, the stroboscopic intensity at each position, and the brightness distribution area.
[0011] As a further implementation method, in the process of comparing the characteristic data with the pre-stored information, the interfering stroboscopic light information is eliminated.
[0012] As a further implementation method, when there is a mobile phone usage behavior, the target image information is transmitted to the terminal device in combination with the corresponding recorded data.
[0013] As a further implementation, the recorded data includes natural light images, location coordinates, usage time, and detection times.
[0014] In a second aspect, an embodiment of the present invention further provides a classroom mobile phone usage behavior active detection system, comprising:
[0015] A first video recording module, which has a polarized light filter structure for acquiring polarized light image information;
[0016] A stroboscopic characteristic database for storing pre-stored information;
[0017] The analysis module is used to perform stroboscopic characteristic analysis on polarized light image information to obtain characteristic data, compare the characteristic data with pre-stored information in a stroboscopic characteristic database, and determine whether there is a mobile phone use behavior.
[0018] As a further implementation, a recording module is also included, which is used to store the recorded data.
[0019] As a further implementation, a second video recording module is also included, which is used to obtain natural light image information and transmit the natural light image information to the recording module.
[0020] As a further implementation, the recorded data includes natural light images, location coordinates, usage time, and detection times.
[0021] As a further implementation, the analysis module is connected to the terminal device via a transmission module.
[0022] As a further implementation, the transmission module adopts a wireless or wired method.
[0023] The beneficial effects of the present invention are as follows:
[0024] The present invention is based on the basic principle of image display on the mobile phone LCD screen, and obtains polarized light image information through a first recording module with a polarized light filtering structure, and obtains natural light image information through a second recording module, and makes judgments accordingly. Since in a classroom environment, the mobile phone LCD screen is the only source of variable stroboscopic polarized light, compared with other existing mobile phone use identification methods (such as judging by students' movements and postures, judging by light brightness, judging by a mobile phone dedicated storage device, etc.), the present invention can accurately and efficiently determine the students who are using the mobile phone by identifying the variable stroboscopic polarized light reflected by the students' faces, lenses, chest and neck clothing. The identification process is simple, the technical implementation difficulty is low, and the identification accuracy rate is high.
[0025] After positioning based on polarized light image information, the present invention combines it with natural light image information to identify and record students' location, posture, usage time, number of times detected and other information. It can record and mark students' mobile phone usage behavior in more detail and clearly, helping teachers obtain more intuitive and detailed information, making it convenient to make appropriate decisions based on classroom conditions.
[0026] The present invention can perform stroboscopic characteristic analysis, compare it with pre-stored information in a stroboscopic characteristic database, and eliminate interfering stroboscopic light, thereby achieving the purpose of identifying mobile phone usage behavior. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The accompanying drawings in the specification, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.
[0028] Figure 1 is a schematic diagram of the detection principle according to one or more embodiments of the present invention;
[0029] Figure 2 is a schematic diagram of a detection system according to one or more embodiments of the present invention.
[0030] Among them, 1. mobile phone screen, 2. polarized light, 3. facial area, 4. polarized light filtering structure, 5. first recording module, 6. analysis module, 7. stroboscopic feature database, 8. recording module, 9. second recording module, and 10. transmission module. DETAILED DESCRIPTION
[0031] Embodiment 1:
[0032] This embodiment provides a method for actively detecting mobile phone usage behavior in a classroom, including:
[0033] Step 1: obtaining polarized light image information, wherein the polarized light image information is obtained through a recording module with a polarized light filter structure;
[0034] Specifically, polarized light image information of the mobile phone screen reflected by objects such as the facial area 3, glasses lenses, chest and neck clothing surface layers, etc. when using the mobile phone (when watching the mobile phone LCD screen) is obtained. The polarized light image information is obtained through the first recording module 5, grayscaled and analyzed to obtain the frequency characteristics of the light and dark changes in the target area.
[0035] Step 2: Detect and remove interference information from the polarized light image information, where the interference information includes polarized light from artificial light sources and polarized light generated by surrounding mobile phones;
[0036] Specifically, the flicker frequency of artificial light sources will not change, and natural light does not have a flickering phenomenon. If someone is using a mobile phone nearby, a different feature will be produced on the face of the person in the detection area that is significantly different from when the person is using the phone. Based on the above principle, interference information is detected and removed. The step 2 specifically includes:
[0037] Step 2.1: The polarized light of the artificial light source is obtained by pre-training against natural light and artificial light sources in various scenes, and the corresponding interference information is stored. When detecting interference information, the corresponding interference information is obtained according to the current artificial light source and eliminated;
[0038] Step 2.2: In order to more accurately monitor the mobile phone usage of each student, this embodiment further divides the polarized light image information into regions based on the seat division data, so that each region contains at most one student;
[0039] Step 2.2: Obtain continuous multi-frame polarized light image information including the current polarized light image information, and detect whether there are changing reflection features in the divided areas. If so, there is a situation where a mobile phone is used in the surrounding area. The changing reflection features are extracted and removed from the area.
[0040] Step 3: Perform stroboscopic feature analysis on the polarized light image information to obtain feature data, compare the feature data with pre-stored information in the stroboscopic feature database, and determine whether there is mobile phone use behavior.
[0041] Specifically, for the images of each area, feature comparison is performed based on a pre-built stroboscopic feature database to determine whether there are students using mobile phones. The stroboscopic feature database stores target stroboscopic intensity and target brightness distribution area information. As a judgment standard, when the stroboscopic intensity in the feature data meets the target stroboscopic intensity and the brightness distribution area information meets the target brightness distribution area information, it is considered that there is mobile phone use behavior. In the process of comparing feature data with pre-stored information, according to the basic principle of imaging of mobile phone LCD screens, the feature data obtained by the polarized light recording module analysis is compared with the pre-stored information.
[0042] As a more specific implementation method, the stroboscopic feature database includes the stroboscopic frequency and frequency variation rules of LCD screens of common mobile phone brands on the market (the mobile phone dimming method is to adjust the brightness of the screen by controlling the stroboscopic frequency), the stroboscopic intensity of each key monitoring reflection area of the user obtained in advance by analyzing and practicing various mobile phone usage methods, and the regional characteristics of brightness distribution. The parameters corresponding to the feature data are compared with the pre-stored information to determine whether they match. If they match, it means that the mobile phone usage behavior exists, otherwise it does not exist.
[0043] Step 4: If there is a mobile phone usage behavior, the current image information is combined with the corresponding recorded data and transmitted to the terminal device. Among them, the target image information refers to the polarized light image information obtained by the mobile phone user.
[0044] The recorded data includes natural light image information, location coordinates, usage time, and number of detections; the natural light image information is obtained through another recording module, and the polarized light image information combined with the natural light image information can more accurately confirm the user information.
[0045] This embodiment is based on the imaging principle of the mobile phone LCD screen and utilizes the characteristic that the light emitted by the mobile phone screen is stroboscopic polarized light. Through data analysis and comparison, it is determined whether there is mobile phone use behavior with high accuracy.
[0046] Embodiment 2:
[0047] This embodiment provides a classroom mobile phone use behavior active detection system, such as Figure 1 and Figure 2 As shown, it includes a first recording module 5, a second recording module 9, an analysis module 5, a stroboscopic characteristic database 7, a recording module 8, a transmission module 10 and a teacher terminal.
[0048] The first recording module 5 and the second recording module 9 are located in the same plane. The first recording module 5 has a polarized light filtering structure 4 for obtaining polarized light image information. The second recording module 9 is an ordinary camera for capturing natural light image information. The polarized light image information combined with the natural light image information can more accurately confirm the user information.
[0049] The analysis module 5 includes a mobile phone use behavior detection unit and a student lecture status recognition unit.
[0050] Among them, the mobile phone usage behavior detection unit is used to receive the polarized light image information transmitted by the first recording module 5, and perform stroboscopic feature analysis on the polarized light image information, and compare the analyzed feature data with the pre-stored information in the stroboscopic feature database 7 to determine whether there is a mobile phone usage behavior. For specific methods, please refer to Example 1.
[0051] The student listening status recognition unit is used to receive the natural light image information transmitted by the second recording module 9, and use the open source OpenCV visual library and convolutional neural network image recognition framework CAFFE to perform facial recognition processing on the captured natural light image. If it is found that the face is blocked and the first recording module 5 cannot function, in the classroom teaching situation, it can be directly determined that the student is not listening carefully and a prompt will be sent to the teacher's terminal immediately.
[0052] The recording module 8 is used to store the recorded data, which includes natural light image information, location coordinates, usage time, and number of detections. If there is any mobile phone usage behavior, the target polarized light image signal is transmitted to the recording module 8, combined with the natural light image taken by the recording module 9 at the same time, and the user's location coordinates, usage time, number of detections and other recorded data are added and sent to the teacher terminal via the transmission module 10.
[0053] In this embodiment, the transmission module 10 is wireless or wired.
[0054] This embodiment can automatically refresh the state according to the set clock setting, reset the count to zero, or reset according to the instruction sent by the terminal device.
[0055] The detection system of this embodiment can be provided in plurality to improve the shooting accuracy.
[0056] The above description is only the preferred embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims
1. A method for actively detecting mobile phone usage behavior in a classroom, characterized in that: include: Acquiring polarized light image information, wherein the polarized light image information is acquired through a recording module with a polarized light filter structure; Perform stroboscopic feature analysis on polarized light image information to obtain feature data, compare the feature data with pre-stored information in a stroboscopic feature database, and determine whether there is a mobile phone use behavior; The information pre-stored in the stroboscopic characteristic database includes the stroboscopic frequency of the LCD screen, the frequency variation law, the stroboscopic intensity at each position, and the brightness distribution area.
2. According to claim 1, a method for actively detecting mobile phone usage behavior in a classroom is characterized in that: In the process of comparing the characteristic data with the pre-stored information, the interfering stroboscopic light information is eliminated.
3. A method for actively detecting mobile phone usage behavior in a classroom according to claim 1 or 2, characterized in that: When a mobile phone is used, the target image information is transmitted to the terminal device in combination with the corresponding recorded data.
4. According to claim 3, a method for actively detecting mobile phone usage behavior in a classroom is characterized in that: The recorded data includes natural light images, location coordinates, usage time, and detection times.
5. A classroom mobile phone usage behavior active detection system, characterized in that: include: A first video recording module, which has a polarized light filter structure for acquiring polarized light image information; A stroboscopic characteristic database for storing pre-stored information; The analysis module is used to perform stroboscopic characteristic analysis on polarized light image information to obtain characteristic data, compare the characteristic data with pre-stored information in a stroboscopic characteristic database, and determine whether there is a mobile phone use behavior.
6. The active detection system for mobile phone usage in classroom according to claim 5 is characterized in that: It also includes a recording module for storing recording data.
7. The active detection system for mobile phone usage in classroom according to claim 6 is characterized in that: It also includes a second video recording module, which is used to obtain natural light image information and transmit the natural light image information to the recording module.
8. The active detection system for mobile phone usage in classroom according to claim 7, characterized in that: The recorded data includes natural light images, location coordinates, usage time, and detection times.
9. The active detection system for mobile phone usage in classroom according to claim 5, characterized in that: The analysis module is connected to the terminal device via the transmission module.
10. The active detection system for mobile phone usage in classroom according to claim 9, characterized in that: The transmission module adopts wireless or wired mode.
