System and method for monitoring learning posture

By designing a system that monitors learning postures including 3D image acquisition, position point recognition, calculation and alarm modules, the problem of difficulty in accurately monitoring learning postures in the prior art is solved, and it is possible to effectively prevent myopia and strabismus without increasing the burden on children.

CN113835096BActive Publication Date: 2025-05-16李超豪
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202111181081.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-11
Publication Date
2025-05-16
Estimated Expiration
2041-10-11

AI Technical Summary

Technical Problem

Existing techniques to prevent myopia and strabismus in children are difficult to accurately monitor learning postures, especially when the burden on children is not increased. How to ensure that the test equipment is accurately aligned with the eyes is a difficult problem.

Method used

A system for monitoring learning attitudes is designed, using 3D image acquisition module, position point recognition module, calculation module and alarm module to obtain the three-dimensional image of the person's face and the three-dimensional image of the target object by scanning, identify the position points of the human eye and the target object, calculate the distance and angle, and issue an alarm prompt when the distance or angle exceeds the preset threshold.

Benefits of technology

It realizes efficient monitoring of learning posture without the need for children to wear equipment, reminding children to adjust their visual distance and posture, thereby preventing health problems of myopia and strabismus.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113835096B_ABST
    Figure CN113835096B_ABST
Patent Text Reader

Abstract

The present invention is applicable to the field of teaching management technology, and provides a system and method for monitoring learning posture. The system for monitoring learning posture includes: at least one group of 3D image acquisition modules, scanning and acquiring a first three-dimensional image of the face of a person sitting in a seat and a test surface of a test space; and / or a second three-dimensional image of a target object located near the seat; a position point recognition module, identifying a first position point of a human eye in a three-dimensional space in the first three-dimensional image, and identifying a second position point of the target object in a three-dimensional space in the second three-dimensional image; a measurement module, using a test surface to measure the distance between the first position point and the second position point; and / or measuring the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located; and at least one alarm module, issuing an alarm when the distance is less than a preset first distance threshold and / or when the angle is greater than a preset first angle threshold. In this way, the present invention prevents the occurrence of health problems such as myopia and strabismus.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of teaching management, and in particular to a system and method for monitoring learning posture. Background Art

[0002] With the development of technology, there are many types of precise distance measurement technologies, and inventions of equipment and methods for preventing children from myopia are emerging in an endless stream. However, among the existing invention technologies for preventing children from myopia, how to make the test equipment align with the eye at any time, how to test the accurate distance from the eyes to the book without adding extra burden to the children, such as having to wear some equipment, etc., is a difficult problem to solve. As a result, the myopia rate of children in high school is as high as more than 80%, but at the same time there is no way to provide a set of simple and effective equipment and methods, and the strabismus problem is also as serious as 3%, and strabismus needs to be treated early, and the later it is cured, the greater the difficulty. How to solve this problem and design a set of equipment is imminent. However, there is no good technical solution to the above problems in the prior art.

[0003] In summary, the existing technology for monitoring and learning posture has many problems in practical use, so it is necessary to improve it. Summary of the invention

[0004] In view of the above-mentioned defects, the object of the present invention is to provide a system and method for monitoring learning posture to prevent the occurrence of health problems such as myopia and strabismus.

[0005] In order to achieve the above object, the present invention provides a system for monitoring learning posture, comprising:

[0006] At least one set of 3D image acquisition modules is arranged near the preset seat, and scans and acquires a first three-dimensional image of the face of the person sitting on the seat and a test surface of the test space where the first three-dimensional image is located; and / or a second three-dimensional image of a target object located near the seat;

[0007] a position point recognition module, which recognizes a first position point of a human eye in the first three-dimensional image in the three-dimensional space according to a preset first recognition standard, and recognizes a second position point of the target object in the second three-dimensional image in the three-dimensional space according to a preset second recognition standard;

[0008] A measuring module, using the test curved surface to measure the distance between the first position point and the second position point; and / or to measure the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located;

[0009] At least one alarm module issues a first alarm prompt when the distance is less than a preset first distance threshold; and / or issues a second alarm prompt when the angle is greater than a preset first angle threshold.

[0010] According to the system for monitoring learning posture, the at least one group of image acquisition modules includes:

[0011] at least one three-dimensional space imaging device, disposed at the front end of the seat, for scanning and acquiring a first three-dimensional image of the face of a person sitting on the seat and a test surface of the test space where the first three-dimensional image is located; and / or

[0012] At least one intelligent image recognition device is disposed at the proximal end of the target object and scans to acquire a second three-dimensional image of the target object.

[0013] According to the system for monitoring learning posture, the position point recognition module includes:

[0014] A first position point recognition submodule, which recognizes two eyes, a nose and a mouth of a person in the first three-dimensional image according to the first recognition standard, and recognizes the position of the center point of the pupil connection line of the two eyes in the three-dimensional space as the first position point;

[0015] The test curved surface recognition module recognizes the longitudinal angle s and the transverse angle t of a pixel point of the test curved surface.

[0016] The second position point recognition submodule recognizes the target object in the second three-dimensional image according to the second recognition standard, and uses the position of the target object in the three-dimensional space as the second position point.

[0017] According to the system for monitoring learning posture, the target object is the tip of a pen used by the person; or

[0018] The target object fixed point is the point where a plane passing through a line connecting the two eyes and perpendicular to the face and a plane passing through the first position point and perpendicular to a line connecting a tabletop disposed at the front end of the seat and perpendicular to the face intersect with a plane of the tabletop.

[0019] According to the system for monitoring learning posture, the position of the at least one three-dimensional space imaging device in the three-dimensional space is a third position point; the measurement module includes:

[0020] The computing model construction submodule constructs at least one triangle by connecting the first position point, the second position point, the third position point and one or more pixel points of the test surface using the triangle principle;

[0021] The operation submodule determines the positions of the pixel points corresponding to the first position point and the second position point in three-dimensional space, and the length of any side of the triangle required by solving the triangle operation formula, based on the at least one constructed triangle and the longitudinal angle s and the transverse angle t of the pixel points corresponding to the vertices of the triangle on the test surface.

[0022] The distance determination submodule selects a length representing the distance between the first position point and the second position point from the lengths of the multiple sides of the at least one constructed triangle as the distance between the two.

[0023] According to the system for monitoring learning posture, the measuring module includes:

[0024] a plane determination submodule, taking a plane where a line connecting the first position point and the second position point and a line passing through the first position point and perpendicular to the desktop are located as a first plane, and taking a facial plane determined by a plane where the two eyes and the mouth are located as a second plane;

[0025] The angle measurement submodule determines whether the first plane and the second plane are perpendicular. If not, the angle between the first plane and the second plane is measured; the angle is used as the angle between the plane where the first position point and the second position point are located and the plane where the character's face is located.

[0026] According to the system for monitoring learning posture, the alarm module includes:

[0027] The voice warning submodule issues a first voice warning prompt when the distance is less than a preset first distance threshold; and / or

[0028] When the angle is greater than a preset first angle threshold, a second voice warning prompt is issued;

[0029] a text warning submodule, which issues a first text warning prompt when the distance is less than a preset first distance threshold; and / or

[0030] When the angle is greater than a preset first angle threshold, a second text warning prompt is issued.

[0031] According to the system for monitoring learning posture, the system for monitoring learning posture further includes an outer shell; the alarm module includes two;

[0032] The at least one group of 3D image acquisition modules, location point recognition modules, measurement modules and one alarm module are arranged in the outer shell;

[0033] The system for monitoring learning posture also includes:

[0034] An alarm terminal, wherein one of the alarm modules is arranged in the alarm terminal, and the alarm terminal is a communication terminal.

[0035] According to the system for monitoring learning posture, the at least one three-dimensional space imaging device is a 3D TOF camera or a structured light 3D camera or a binocular camera;

[0036] The at least one three-dimensional space imaging device and the at least one intelligent image recognition device are the same device or different devices.

[0037] In order to achieve another object of the present invention, the present invention also provides a method for monitoring learning posture using any one of the above-mentioned systems, the method comprising:

[0038] At least one group of 3D image acquisition modules scans and acquires a first three-dimensional image of the face of a person sitting on the seat and a test surface of a test space where the first three-dimensional image is located; and / or a second three-dimensional image of a target object located near the seat;

[0039] The position point recognition module recognizes a first position point of a human eye in the first three-dimensional image in the three-dimensional space according to a preset first recognition standard, and recognizes a second position point of the target object in the second three-dimensional image in the three-dimensional space according to a preset second recognition standard;

[0040] The measuring module measures the distance between the first position point and the second position point using the test curved surface; and / or measures the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located;

[0041] At least one alarm module issues a first alarm prompt when the distance is less than a preset first distance threshold; and / or issues a second alarm prompt when the angle is greater than a preset first angle threshold.

[0042] The present invention scans and obtains a first three-dimensional image of the face of a person sitting on the seat and a test surface of a test space where the first three-dimensional image is located through at least one group of 3D image acquisition modules arranged at the near end of a preset seat by a system for monitoring learning posture; and / or a second three-dimensional image of a target object located at the near end of the seat; a position point recognition module recognizes a first position point of a human eye in the three-dimensional space in the first three-dimensional image, and recognizes a second position point of the target object in the three-dimensional space in the second three-dimensional image; a measurement module uses the test surface to measure the distance between the first position point and the second position point; and / or measures the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located; and at least one alarm module issues an alarm prompt when the distance is less than a preset first distance threshold and / or when the angle is greater than a preset first angle threshold. Thus, the person in the monitoring range of the system for monitoring learning posture is reminded to pay attention to the learning posture, and the person's viewing distance is too close or strabismus occurs, and the posture needs to be adjusted. At the same time, through the alarm terminal located at the parent or teacher end, parents or teachers who cannot accompany their children to study for a long time can be reminded to pay attention to the children's viewing posture in time, remind the children in time or go to the hospital for examination as soon as possible, thereby preventing the occurrence of health problems such as myopia and strabismus. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A structural block diagram of a system for monitoring learning posture provided by one embodiment of the present invention;

[0044] Figure 2 A structural block diagram of a system for monitoring learning posture provided by one embodiment of the present invention;

[0045] Figure 3 A schematic diagram of the placement of a system for monitoring learning posture provided by one embodiment of the present invention;

[0046] Figure 4 A scenario diagram of a system for monitoring learning posture provided by an embodiment of the present invention;

[0047] Figure 5 A schematic diagram of multiple position points acquired by a system for monitoring learning posture provided by an embodiment of the present invention;

[0048] Figure 6 A schematic diagram of calculating the distance between two points AB in a 3D space by a system for monitoring learning posture provided by an embodiment of the present invention;

[0049] Figure 7 A schematic diagram of determining a second position point in a system for monitoring learning posture provided by an embodiment of the present invention;

[0050] Figure 8A schematic diagram of a system for monitoring learning postures according to an embodiment of the present invention determining a person's squint. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0052] See also Figures 1 to 8 In one embodiment of the present invention, a system 100 for monitoring learning posture is provided, comprising:

[0053] At least one set of 3D image acquisition modules 10 is arranged near the preset seat 101, and scans and acquires the first three-dimensional image of the face of the person 102 sitting on the seat 101 and the test surface GHKJ of the test space where the first three-dimensional image is located; and / or the second three-dimensional image of the target object located near the seat; the first three-dimensional image of the face of the person 102 sitting on the seat 101 and the second three-dimensional image of the target object located near the seat are respectively acquired by at least one set of 3D image acquisition modules 10; the target object is usually a book, and of course it can also be an electronic product, such as IPAD, etc. Since it is necessary to detect the distance between the person's eyes and the target object, the space where the face of the person 102 on the seat 101 is located is the test space, and the acquired first three-dimensional image is the test surface GHKJ of the test space; at least one set of 3D image acquisition modules 10 can scan at a preset interval, such as an interval of 15, 20 minutes, etc., and the preferred interval can be set by the system administrator. Of course, scanning can also be performed by detecting changes in the position of the human body.

[0054] The position point recognition module 20 recognizes the first position point A of the human eye in the first three-dimensional image in the three-dimensional space according to the preset first recognition standard, and recognizes the second position point B of the target object in the second three-dimensional image in the three-dimensional space according to the preset second recognition standard; for the recognition of the first position point A of the human eye in the first three-dimensional image in the three-dimensional space, different recognition results will be obtained according to different first recognition standards. In one embodiment of the present invention, the first recognition standard can be that after the two eyes of the person are recognized, the center point of the line connecting the two eyes is used as the first position point A, or the center point of the two eye sockets is recognized as the first position point A, etc. Similarly, different recognition results will be obtained according to different second recognition standards. Generally speaking, when children study, a desk 201 is set in front of the seat 101. For the recognition of the target object, the target object is the current visual focus of the person, and the pen tip when the person uses the pen 202 can be recognized. It can also be that when the target object is a mobile phone, the second position point B can be the center point of the entire mobile phone, etc. Therefore, the target object may be the tip of the pen 202 used by the person 102; or the target object may be the center point of the book or electronic product that the person 102 is looking at. The fixed point is the point where the plane passing through the line connecting the two eyes and perpendicular to the face and the plane passing through the first position point A and perpendicular to the tabletop 201 arranged at the front of the seat 101 and perpendicular to the face intersect with the plane of the tabletop 201, that is, Figure 7 Point B shown. The measuring module 30 uses the test surface GHKJ to measure the distance between the first position point A and the second position point B; and / or measures the angle between the plane where the first position point A and the second position point B are located and the plane where the face of the person 102 is located; the measuring module 30 will use the test surface GHKJ to measure the distance between the first position point A and the second position point B, which represents the distance between the eyes and the book when the person is reading or writing. By measuring the distance, it can be known whether the person's learning posture is good. And measure the angle between the plane where the first position point A and the second position point B are located and the plane where the face of the person 102 is located. The angle represents whether the human eye has strabismus. Similarly, by measuring the angle, it can be known whether the person's learning posture is good.

[0055] At least one alarm module 40 issues a first alarm prompt when the distance is less than a preset first distance threshold; and / or issues a second alarm prompt when the angle is greater than a preset first angle threshold. After obtaining the measurement result, at least one alarm module 40 makes a judgment that the first distance threshold is usually a normal reading distance, such as 33 cm, or 35 cm. The first angle threshold is an angle without squint, such as less than 5°. When the distance is less than the preset first distance threshold or greater than the preset first angle threshold, the alarm module 40 issues an alarm prompt.

[0056] Therefore, this embodiment uses the system 100 for monitoring learning posture, and the system 100 can achieve efficient eye-to-book or pen tip testing, wherein at least one set of 3D image acquisition modules 10 only needs to be placed roughly in front of the child on the desk, approximately directly in front of the child, without adjustment or proofreading, and the child does not need to wear any equipment. When the child leaves for a certain period of time, the system automatically enters standby mode, and when the child sits down to study, the system automatically enters working mode. The system is simple and easy to use, intelligent and convenient, and promptly issues an alarm prompt when a bad learning posture occurs, prompting the child or the parent to pay attention to the child's learning posture, thereby preventing the child from developing myopia or strabismus.

[0057] See also Figures 1 to 8 In one embodiment of the present invention, the at least one group of 3D image acquisition modules includes:

[0058] At least one three-dimensional space imaging device 11 is arranged at the front end of the seat 101, scanning and acquiring a first three-dimensional image of the face of the person 102 sitting on the seat and a test surface GHKJ of the test space where the first three-dimensional image is located; and / or

[0059] At least one intelligent image recognition device 12 is disposed at the proximal end of the target object and scans to obtain a second three-dimensional image of the target object.

[0060] Preferably, the at least one three-dimensional space imaging device 11 is a 3D TOF (Time of flight) camera or a structured light 3D camera or a binocular camera; the at least one three-dimensional space imaging device 11 and the at least one intelligent image recognition device 12 are the same device or different devices. In one embodiment of the present invention, a plurality of three-dimensional space imaging devices 11 can be provided, and the plurality of three-dimensional space imaging devices 11 are provided at different angles in front of the person, so that the first three-dimensional image can be well captured when the person's sitting posture changes or when the target object such as a book being read blocks the person. Of course, the at least one intelligent image recognition device 12 can also be provided in plurality, and can be provided at different angles to the target object, such as in front or above, so that the second three-dimensional image can be well captured.

[0061] See also Figures 1 to 8 In one embodiment of the present invention, the location point identification module 20 includes:

[0062] The first position point recognition submodule 21 recognizes two eyes, a nose and a mouth of the person 102 in the first three-dimensional image according to the first recognition standard, and recognizes the position of the center point of the pupil connection line of the two eyes in the three-dimensional space as the first position point A;

[0063] A test curved surface recognition module 22 is configured to recognize one or more pixel points of the test curved surface GHKJ and calculate a longitudinal angle s and a transverse angle t of the one or more pixel points;

[0064] The second position point recognition submodule 23 recognizes the target object in the second three-dimensional image according to the second recognition standard, and uses the position of the target object in the three-dimensional space as the second position point B.

[0065] In this embodiment, the first position point recognition submodule 21 recognizes the two eyes, nose and mouth of the person 102 in the first three-dimensional image, and recognizes the position of the center point of the pupil connection line of the two eyes in the three-dimensional space as the first position point A according to the preset first recognition standard; the test surface recognition module 22 recognizes any pixel point on the test surface GHKJ to prepare for the subsequent measurement of distance and angle, specifically calculating the longitudinal angle s and transverse angle t of one or more of the pixel points; the second position point recognition submodule 23 recognizes the target object in the second three-dimensional image, and uses the position of the target object in the three-dimensional space as the second position point B.

[0066] See also Figures 1 to 8 In one embodiment of the present invention, the calculation module 30 further includes:

[0067] The plane determination submodule 34 takes the plane where the line connecting the first position point A and the second position point B and the line passing through the first position point A and perpendicular to the desktop are located as the first plane; and takes the facial plane determined by the plane where the two eyes and the mouth are located as the second plane;

[0068] The angle measuring submodule 35 determines whether the first plane and the second plane are perpendicular. If not, the angle between the first plane and the second plane is measured; the angle is used as the angle between the plane where the first position point A and the second position point B are located and the plane where the face of the person 102 is located.

[0069] See also Figures 1 to 8In one embodiment of the present invention, at least one three-dimensional space imaging device 11 is placed on the desktop 201 in front of the seat 101. At least one three-dimensional space imaging device 11 can be a 3DTOF camera or a structured light 3D camera or a binocular camera. The device is connected to peripheral components, including a power supply, a single-chip microcontroller, a 3D stereo detection sensor, and peripheral auxiliary circuits. The three-dimensional space imaging device 11 scans to achieve 3D TOF vision, or binocular stereo vision, or structured light stereo vision. When the person or child is not sitting at the desk to study, the system 100 for monitoring learning posture is in a low-power standby state. When the child sits at the desk to study, the device automatically enters the working state through the sensor, and performs 3D detection on the child's learning status at regular intervals. When the detected 3D stereo vision image point cloud data such as Figure 5 First, artificial intelligence recognition technology is used to perform face recognition to determine the position of the child's eye feature points and the center point of the line connecting the pupils of both eyes in 3D space, that is, the first position point A on the spherical surface GHKJ with the test image sensor chip as the core, and the second position point B of the book in space is identified by artificial intelligence method. The second position point identification submodule 23 can determine the second position point B by using artificial intelligence method to determine the position of the pen tip of the child when doing homework, or it can be the intersection of three planes of the vertical plane and the horizontal plane perpendicular to the center point of the line connecting the pupils of the child - the first position point A and the plane of the child's face, such as Figure 8 That is, the three-dimensional imaging device 11, the point R in the figure is the first position point A of the sphere MNYX with the core, and then the triangle principle is used to calculate the distance between the child's eyes and the pen tip, or the second position point B of the book, to determine whether the child's eyes are too close to the book and whether to make a reminder to adjust the sitting posture. At the same time, it can also be determined whether the child has strabismus based on the facial feature plane of the character, that is, whether the second plane is perpendicular to the line connecting the first position point A and the second position point B, such as Figure 8 The specific method for calculating the distance between eyes and books is as follows: Figure 6 , the distance between any physical point of interest and the lens can be directly measured by 3D TOF technology, structured light technology, or binocular camera technology. The longitudinal angle s and transverse angle t of any pixel point on the GHKJ test sphere (i.e. test) in the test space can be easily obtained based on the longitudinal FOV angle, transverse FOV angle of the lens and the longitudinal resolution and transverse resolution of the CMOS image sensor:

[0070] s = longitudinal FOV angle / longitudinal resolution;

[0071] t = lateral FOV angle / lateral resolution;

[0072] The height and width of a pixel on the GHKJ test sphere can be calculated as:

[0073] Pixel height = 2*pi*HR*t / 360;

[0074] Pixel width = 2*pi*HR*s / 360;

[0075] (HR is the straight-line distance from the test sphere GHKJ where point A is located to the image sensor R)

[0076] In addition, Figure 8 As shown, the plane determination submodule 34 can use the face detection method to detect the plane CDEF determined by the eyes and mouth of the child's face, as well as the second position point B where the pen tip is when the child is doing homework. When the angle measurement submodule 35 measures the plane HIJK where the center point of the pupil connection line of the child's eyes, that is, the line from the first position point A to the second position point B, is not perpendicular to the face plane CDEF, for example, the plane HIJ*K* is strabismus to the right, the size of angle 1 is the angle of strabismus. If the line from the first position point A to the second position point B** is on the plane HIJ**K**, it can be determined that the child may have strabismus to the left, and the size of angle 2 is used to determine the left strabismus and its severity, so that the parents can be notified early to go to the hospital for examination to prevent the strabismus from further deepening and correction.

[0077] See also Figures 1 to 8 In one embodiment of the present invention, the position of the at least one three-dimensional space imaging device 11 in the three-dimensional space is a third position point R; the calculation of the distance from the first position point A to the second position point B is implemented by multiple submodules in the measurement module 30, and the specific measurement module 30 includes:

[0078] The computing model building submodule 31 uses the triangle principle to connect the first position point A, the second position point B, the third position point R and one or more pixel points of the test surface GHKJ to build at least one triangle;

[0079] The operation submodule 32 solves the lengths of the multiple sides of the at least one triangle according to the constructed at least one triangle and the longitudinal angle s and the transverse angle t of the pixel points corresponding to the vertices of the triangle on the test surface GHKJ, and the triangle operation formula;

[0080] The distance determination submodule 33 selects a length representing the distance between the first position point A and the second position point B from the lengths of the plurality of edges as the distance between the two positions.

[0081] In this embodiment, after obtaining the longitudinal angle s and transverse angle of any pixel point on the GHKJ test sphere in the previous embodiment, in order to calculate the distance between the first position point A and the second position point B, the computational model construction submodule 31 will use the triangle principle to connect the first position point A, the second position point B, the third position point R and one or more pixel points of the test surface GHKJ to construct at least one triangle. For example, first extend the straight line from the third position point R to the second position point B to point C on the GHKJ test sphere where the first position point A is located, and then draw a line parallel to the lower chord KH of the GHKJ test sphere from point C, and intersect the straight line AE parallel to GH through the test point A at point D, then the angle b corresponding to the chord DC can be calculated as:

[0082] Angle b = number of pixels between DC * t; similarly

[0083] Angle e = number of pixels between AD*s;

[0084] Then AR, BR, CR, DR are the direct distances from points A, B, C, D to the third position point R, which can be directly measured. Therefore, according to the cosine theorem, we can get:

[0085] DC=(DR^2+CR^2-2*DR*CR*COS b)^1 / 2;

[0086] AD=(AR^2+DR^2-2*DR*AR*COS e)^1 / 2;

[0087] AC=(AD^2+DC^2)^1 / 2;

[0088] Thus we can get:

[0089] COS c=(AR^2+CR^2-AC^2) / (2*AR*CR);

[0090] AB=(AR^2+BR^2-2*AR*BR*COS c)^1 / 2;

[0091] AB=((AR^2+BR^2-2*AR*BR*(AR^2+CR^2-AC^2) / (2*AR*CR))^1 / 2;Thereby, the distance AB between the first position point A and the second position point B can be calculated. It should be noted that due to the calculation of the distance between two arbitrary position points in 3D space, such as the first position point A and the second position point B, different triangles and / or auxiliary lines can be constructed, and the auxiliary lines are parallel lines as described above, etc., and different triangle calculation formulas are used, so the calculation process will be diverse. The above calculation process in this embodiment is only used as an enumeration of the calculation process. If the distance AB is less than 33 cm, it can be judged that the child's eyes are too close to the book. When this state lasts too long, it is necessary to send a warning signal to the child to prompt the child to correct the sitting posture. In addition, the preferred usual learning status information of the child can also be uploaded to the system for storage at any time. The system can analyze the child's learning habits, and the child's parents can analyze the child's learning behavior in any set time period at any time and any place, so as to make a reasonable monitoring method to ensure the child's physical and mental health and learning efficiency.

[0092] See also Figures 1 to 8 In addition, in one embodiment of the present invention, the alarm module 40 includes:

[0093] The voice warning submodule 41 issues a first voice warning prompt when the distance is less than a preset first distance threshold; and / or

[0094] When the angle is greater than the preset first angle threshold, a second voice alarm prompt is issued; the voice alarm submodule 41 includes a voice player, which reminds by voice playback;

[0095] The text warning submodule 42 issues a first text warning prompt when the distance is less than a preset first distance threshold; and / or

[0096] When the angle is greater than the preset first angle threshold, a second text warning prompt is issued. The text warning submodule 42 includes a display screen, which reminds by text display; both reminder methods can be used at the same time to remind the child of bad learning posture.

[0097] In one embodiment of the present invention, the system 100 for monitoring learning posture further comprises an outer shell; the alarm module 40 comprises two;

[0098] The at least one group of 3D image acquisition modules 10, the position point recognition module 20, the measurement module 30 and the alarm module 40 are arranged in the outer shell;

[0099] The system 100 for monitoring learning posture also includes:

[0100] The alarm terminal 50, in which the alarm module 40 is disposed, is a communication terminal. The system for monitoring learning posture also includes the alarm terminal 50, which is connected to other modules or devices of the system in communication, such as through a wireless network connection, and sends reminder information to the alarm terminal 50 of the child's parents, which can also be called a smart device, through the network to remind the parents to pay attention to the child's sitting posture and vision protection issues.

[0101] In addition, the present invention also provides a method for monitoring learning posture using the system described in any one of the above embodiments, the method comprising:

[0102] At least one group of 3D image acquisition modules 10 scans and acquires a first three-dimensional image of the face of the person 102 sitting on the seat and a test curved surface GHKJ of the test space where the first three-dimensional image is located; and / or a second three-dimensional image of a target object located near the seat;

[0103] The position point recognition module 20 recognizes a first position point A of a human eye in the first three-dimensional image in the three-dimensional space according to a preset first recognition standard, and recognizes a second position point B of the target object in the second three-dimensional image in the three-dimensional space according to a preset second recognition standard;

[0104] The measuring module 30 measures the distance between the first position point A and the second position point B using the test curved surface GHKJ and the second test curved surface; and / or measures the angle between the plane where the first position point A and the second position point B are located and the plane where the face of the person 102 is located;

[0105] At least one alarm module 40 issues a first alarm prompt when the distance is less than a preset first distance threshold; and / or issues a second alarm prompt when the angle is greater than a preset first angle threshold.

[0106] In the above-mentioned multiple embodiments of the present invention, it has been described how to use the system 100 for monitoring learning posture to implement the method of monitoring learning posture, which will not be repeated in this embodiment.

[0107] In summary, the present invention scans and obtains the first three-dimensional image of the face of the person sitting in the seat and the test surface of the test space where the first three-dimensional image is located through at least one group of 3D image acquisition modules set at the near end of the preset seat by the system for monitoring learning posture; and / or the second three-dimensional image of the target object located at the near end of the seat; the position point recognition module recognizes the first position point of the human eye in the three-dimensional space in the first three-dimensional image, and recognizes the second position point of the target object in the three-dimensional space in the second three-dimensional image; the measurement module uses the test surface to measure the distance between the first position point and the second position point; and / or measures the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located; and at least one alarm module issues an alarm prompt when the distance is less than the preset first distance threshold and / or when the angle is greater than the preset first angle threshold. Thus, the person in the monitoring range of the system for monitoring learning posture is reminded to pay attention to the learning posture, and the viewing distance is too close or strabismus occurs, and the posture needs to be adjusted. At the same time, the alarm terminal located at the parent or teacher end can also be used to correspondingly remind these parents or teachers who are far away from the child to pay attention to the child's viewing posture in time, thereby preventing the occurrence of health problems such as myopia and strabismus.

[0108] Of course, the present invention may have many other embodiments. Without departing from the spirit and essence of the present invention, those skilled in the art may make various corresponding changes and modifications based on the present invention, but these corresponding changes and modifications should all fall within the scope of protection of the claims attached to the present invention.

Claims

1. A system for monitoring learning posture, characterized in that: include: At least one set of 3D image acquisition modules is arranged near the preset seat, and scans and acquires a first three-dimensional image of the face of the person sitting on the seat and a test surface of the test space where the first three-dimensional image is located; and / or a second three-dimensional image of a target object located near the seat; a position point recognition module, which recognizes a first position point of a human eye in the first three-dimensional image in the three-dimensional space according to a preset first recognition standard, and recognizes a second position point of the target object in the second three-dimensional image in the three-dimensional space according to a preset second recognition standard; A measuring module, using the test curved surface to measure the distance between the first position point and the second position point; and / or measuring the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located; At least one alarm module, when the distance is less than a preset first distance threshold, issues a first alarm prompt; and / or when the angle is greater than a preset first angle threshold, issues a second alarm prompt; The at least one group of image acquisition modules includes at least one three-dimensional space imaging device, which is arranged at the front end of the seat and scans and obtains a first three-dimensional image of the face of the person sitting on the seat and a test surface of the test space where the first three-dimensional image is located; The position point recognition module includes: a test curved surface recognition module, which recognizes one or more pixel points of the test curved surface and calculates the longitudinal angle s and the transverse angle t of the one or more pixel points; The position of the at least one three-dimensional imaging device in the three-dimensional space is a third position point; the measuring module includes: The computing model construction submodule constructs at least one triangle by connecting the first position point, the second position point, the third position point and one or more pixel points of the test surface using the triangle principle; An operation submodule, based on the at least one constructed triangle and the longitudinal angle s and the transverse angle t of the pixel points corresponding to the vertices of the triangle on the test surface, determines the positions of the pixel points corresponding to the first position point and the second position point in the three-dimensional space, and the length of any side of the triangle required by solving the triangle operation formula; The distance determination submodule selects a length representing the distance between the first position point and the second position point from the lengths of the multiple sides of the at least one constructed triangle as the distance between the two.

2. The system for monitoring learning posture according to claim 1, characterized in that: The at least one group of image acquisition modules comprises: At least one intelligent image recognition device is disposed at the proximal end of the target object and scans to acquire a second three-dimensional image of the target object.

3. The system for monitoring learning posture according to claim 2, characterized in that: The location point recognition module includes: A first position point recognition submodule, which recognizes two eyes, a nose and a mouth of a person in the first three-dimensional image according to the first recognition standard, and recognizes the position of the center point of the pupil connection line of the two eyes in the three-dimensional space as the first position point; The second position point recognition submodule recognizes the target object in the second three-dimensional image according to the second recognition standard, and uses the position of the target object in the three-dimensional space as the second position point.

4. The system for monitoring learning posture according to claim 3, characterized in that: The target object is the tip of a pen used by the person; or The target object fixed point is the point where a plane passing through a line connecting the two eyes and perpendicular to the face and a plane passing through the first position point and perpendicular to a line connecting a tabletop disposed at the front end of the seat and perpendicular to the face intersect with a plane of the tabletop.

5. The system for monitoring learning posture according to claim 4, characterized in that: The calculation module comprises: a plane determination submodule, taking a plane where a line connecting the first position point and the second position point and a line passing through the first position point and perpendicular to the desktop are located as a first plane, and taking a facial plane determined by a plane where the two eyes and the mouth are located as a second plane; The angle measurement submodule determines whether the first plane and the second plane are perpendicular. If not, the angle between the first plane and the second plane is measured; the angle is used as the angle between the plane where the first position point and the second position point are located and the plane where the character's face is located.

6. The system for monitoring learning posture according to claim 5, characterized in that: The alarm module comprises: The voice warning submodule issues a first voice warning prompt when the distance is less than a preset first distance threshold; and / or When the angle is greater than a preset first angle threshold, a second voice warning prompt is issued; a text warning submodule, which issues a first text warning prompt when the distance is less than a preset first distance threshold; and / or When the angle is greater than a preset first angle threshold, a second text warning prompt is issued.

7. The system for monitoring learning posture according to claim 1, characterized in that: The system for monitoring learning posture also includes an outer shell; the alarm module includes two; The at least one group of 3D image acquisition modules, location point recognition modules, measurement modules and one alarm module are arranged in the outer shell; The system for monitoring learning posture also includes: An alarm terminal, wherein one of the alarm modules is arranged in the alarm terminal, and the alarm terminal is a communication terminal.

8. The system for monitoring learning posture according to claim 2, characterized in that: The at least one three-dimensional imaging device is a 3D TOF camera, a structured light 3D camera, or a binocular camera; The at least one three-dimensional space imaging device and the at least one intelligent image recognition device are the same device or different devices.

9. A method for monitoring learning posture using the system according to any one of claims 1 to 8, characterized in that: The method comprises: At least one group of 3D image acquisition modules scans and acquires a first three-dimensional image of the face of a person sitting on the seat and a test surface of a test space where the first three-dimensional image is located; and / or a second three-dimensional image of a target object located near the seat; The position point recognition module recognizes a first position point of a human eye in the first three-dimensional image in the three-dimensional space according to a preset first recognition standard, and recognizes a second position point of the target object in the second three-dimensional image in the three-dimensional space according to a preset second recognition standard; The measuring module measures the distance between the first position point and the second position point using the test curved surface; and / or measures the angle between the plane where the first position point and the second position point are located and the plane where the face of the person is located; At least one alarm module issues a first alarm prompt when the distance is less than a preset first distance threshold; and / or issues a second alarm prompt when the angle is greater than a preset first angle threshold.

Citation Information

Patent Citations

  • Reminding method and device

    CN106919250A

  • Eyesight protection monitoring method, system and device, and storage medium

    CN110801229A

  • System for monitoring learning posture

    CN217133371U