Desktop far image read-write device and user use behavior monitoring method

Abstract

The invention discloses desktop remote image read-write equipment and a user use behavior monitoring method, and the equipment comprises a housing which is internally provided with an optical amplification system, and is provided with a window at the front side; the camera is connected with the shell and faces the exit pupil position, the image acquisition range of the camera takes the exit pupil position as the center and at least can cover the range corresponding to the human face located at the exit pupil position, and the camera is used for acquiring an image of the exit pupil position in the use process of the desktop remote image read-write equipment; and the data processor is used for performing image processing on the image acquired by the camera, identifying the face position of the user from the image, judging the use behavior of the user according to the face position, and generating a user use behavior monitoring result. According to the desktop remote image read-write device, the use behavior of the user is acquired through the camera, the sitting posture of the user is monitored, recorded and reminded, and the use behavior of the user is known, supervised and standardized, so that the use effect of the desktop remote image read-write device is ensured.

Description

Technical Field

[0001] The present invention relates to a desktop far-image reading and writing device, and also relates to a method for monitoring user behavior. Background Art

[0002] At present, the myopia problem among teenagers is becoming increasingly serious. The fundamental reason is that most of the time, teenagers' eyes focus on a relatively close range. In order to adapt to near-distance imaging, the eye axis gradually becomes longer. To solve this problem, various myopia prevention and control products have emerged on the market.

[0003] Among them, a desktop far-image reading and writing device is a device that uses optical means to pull near-distance reading and writing to a far distance for imaging, and is mostly applied to the field of teenagers' myopia prevention and control. The desktop far-image reading and writing device usually has a window facing the user. When in use, the desktop far-image reading and writing device is set above the desktop through a bracket. The area below the desktop far-image reading and writing device is the desktop area for placing books. The light reflected by the books placed on the desktop enters the desktop far-image reading and writing device from below. After being magnified by the optical magnification system inside the desktop far-image reading and writing device, it passes through the window glass and shoots towards the user's eyes, presenting a magnified and projected virtual image, thereby changing near-distance reading and writing into far-distance imaging.

[0004] However, the largest user group of the desktop far-image reading and writing device is children. A considerable number of people in this group have relatively insufficient self-control. When their parents are not around, they will lower their heads to peek or leave the desktop, thus completely losing the function of myopia management of the desktop far-image reading and writing device. Therefore, in order to monitor, remind, and track the user's sitting posture, it is necessary to further improve the function of the desktop far-image reading and writing device. Summary of the Invention

[0005] The primary technical problem to be solved by the present invention is to provide a method for monitoring user behavior of a desktop far-image reading and writing device.

[0006] Another technical problem to be solved by the present invention is to provide a desktop far-image reading and writing device for realizing user behavior monitoring.

[0007] To achieve the above technical objectives, the present invention adopts the following technical solutions:

[0008] According to the first aspect of the present invention, there is provided a method for monitoring user behavior of a desktop far-image reading and writing device, including the following steps:

[0009] A camera, connected to the housing and arranged facing the pupil position, for collecting images of the pupil position during the use of the desktop far-image reading and writing device;

[0010] A data processor is used to perform image processing on the images captured by a camera, identify the position of the user's face therefrom, and determine the user's usage behavior based on the face position to generate a monitoring result of the user's usage behavior. Then, the monitoring result of the user's usage behavior is stored in a data storage and / or sent to a remote terminal device.

[0011] Preferably, the performing image processing on the images captured by the camera and identifying the position of the user's face therefrom includes the following steps: The data processor identifies the position of the user's face from the images through a built-in sitting posture recognition AI model or through an image processing algorithm.

[0012] Preferably, the monitoring result of the user's usage behavior at least includes: normal usage behavior, the user lowering the head, and the user leaving.

[0013] Preferably, it further includes the following steps: The data processor counts the duration of the user's normal usage behavior based on the monitoring result of the user's usage behavior as the effective usage duration.

[0014] Preferably, it further includes the following steps: The data processor outputs at least one of sound, light, and electricity through a signal output module at least for the usage situation where the user lowers the head according to the monitoring result of the user's usage behavior to prompt the user that the usage behavior is not standard.

[0015] Preferably, it further includes the following steps: The data processor obtains a user concentration evaluation result based on the monitoring result of the user's usage behavior within a predetermined time.

[0016] According to a second aspect of the present invention, there is provided a desktop telephoto reading and writing device for implementing the user usage behavior monitoring method, including:

[0017] A housing, an optical magnification system is provided inside the housing, and a viewing window is provided on the front side of the housing; when in use, the housing is arranged above the desktop through a bracket, the light from the desktop direction enters from the bottom of the housing, and after passing through the optical magnification system, it shoots from the viewing window to the exit pupil position to form a virtual image at least 3 meters away from the exit pupil position.

[0018] A camera, connected to the housing and arranged facing the exit pupil position, the image acquisition range of the camera is centered on the exit pupil position and can at least cover the range corresponding to the face located at the exit pupil position; the camera is used to capture the image of the exit pupil position during the use of the desktop telephoto reading and writing device; and,

[0019] A data processor is used to perform image processing on the images captured by the camera, identify the position of the user's face therefrom, and determine the user's usage behavior based on the face position to generate a monitoring result of the user's usage behavior.

[0020] Preferably, the camera is disposed obliquely inside the housing facing the exit pupil position and is located above the window.

[0021] Preferably, the pitch angle α of the camera is greater than half of the vertical field of view angle β of the camera.

[0022] Preferably, the camera has an image acquisition range of at least ±15° and not greater than ±20°.

[0023] The desktop telephoto reading and writing device provided by the present invention monitors, records, and reminds the user's sitting posture by arranging a camera on one side of the housing facing the exit pupil position, realizes the understanding and supervision of the user's usage behavior, and standardizes the user's usage behavior to ensure the usage effect of the desktop telephoto reading and writing device and achieve the effect of preventing myopia. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a schematic structural diagram of the desktop telephoto reading and writing device;

[0025] Figure 2 is a schematic optical path diagram of the desktop telephoto reading and writing device;

[0026] Figure 3 is a schematic partial cross-sectional view of the desktop telephoto reading and writing device;

[0027] Figure 4 is a flowchart of the user usage behavior monitoring of the desktop telephoto reading and writing device. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0028] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

[0029] It should be noted that if there are directional indications (such as up, down, left, right, front, back...) involved in the embodiments of the present invention, the directional indications are only used to explain the relative position relationship and movement conditions between components in a specific posture (as shown in the drawings). If the specific posture changes, the directional indications will also change accordingly.

[0030] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, such descriptions of "first", "second", etc. are only for descriptive purposes and should not be construed as indicating or implying their relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include at least one such feature. In addition, the technical solutions between various embodiments may be combined with each other, but it must be based on the fact that those of ordinary skill in the art can implement it. When the combination of technical solutions results in contradictions or cannot be implemented, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0031] The desktop telephoto reading and writing device provided by the present invention can monitor the user's usage behavior. As Figures 1 to 3 shown, the desktop telephoto reading and writing device 1 is arranged on the desktop through a bracket 2 during use. Below the desktop telephoto reading and writing device 1 is a desktop area 3 for placing books. The desktop telephoto reading and writing device 1 includes: a housing 10, an optical magnification system is arranged inside the housing 10, and a viewing window 15 is arranged on the front side of the housing 10; the housing is arranged above the desktop through the bracket 2 during use, light from the desktop direction enters from the bottom of the housing 10, and after passing through the optical magnification system, it is emitted from the viewing window 15 to the exit pupil position 4, forming a virtual image at least 3 meters away from the exit pupil position; a camera 20, which is connected to the housing 10 and arranged facing the exit pupil position 4, the image acquisition range of the camera 20 is centered on the exit pupil position 4 and can at least cover the range corresponding to the face located at the exit pupil position, and the camera 20 is used to acquire an image of the exit pupil position 4 during the use of the desktop telephoto reading and writing device; and a data processor, which is used to perform image processing on the image acquired by the camera 20, identify the face position of the user therefrom, and judge the user's usage behavior based on the face position to generate a monitoring result of the user's usage behavior.

[0032] Specifically, the housing 10 includes a top cover 11, a rear plate, a bottom frame 13, an upper front shell 19, a lower front shell 12, and two side plates 14. Among them, the bottom frame 13 is provided with an opening for light from the desktop direction to enter from below, a lighting element is arranged on the bottom frame 13 for providing illumination to the desktop area 3, and a plurality of buttons 18 are arranged on the lower front shell 12 for controlling the lighting element 20. The reflectivity of the inner surface 17 of the two side plates 14 is less than 5%, so as to reduce the stray light reflected by the inner wall. Preferably, the inner surface 17 of the side plate 14 is non-mirror and black, so that even if a small amount of light is reflected, it is only scattered light rather than specular reflection. The optimal solution is that other areas inside the housing 10 that are not covered by optical elements are all set to black to reduce the stray light reflected by the inner wall.

[0033] An optical magnification system is arranged inside the housing 10, as Figure 2As shown, in this embodiment, the optical magnification system includes a long-image optical path and a defocus optical path. Among them, the long-image optical path includes a first reflector 22 and a planar beam splitter 21. The planar beam splitter 21 is inclined and arranged inside the housing 10 to form a viewing window 15. The first reflector 22 is arranged horizontally (or vertically) facing the planar beam splitter 21. The light reflected from the desktop area 3 is incident on the planar beam splitter 21 from below. After being split by the planar beam splitter 21, only part of the light is incident on the first reflector 22. The light reflected by the first reflector 22 is incident on the planar beam splitter 21 again and then passes through the planar beam splitter 21 to the exit pupil position 4. After entering the human eye, a long image with normal imaging is formed on the retina. The distance from this long image to the exit pupil position 4 is not less than 3 meters. The defocus optical path includes a second reflector 23 and the planar beam splitter 21. The second reflector 23 is arranged vertically (or horizontally) facing the planar beam splitter 21. The first reflector 22 and the second reflector 23 are respectively arranged on both sides of the planar beam splitter and are perpendicular to each other. The light reflected from the desktop area 3 is incident on the planar beam splitter 21 from below. After being split by the planar beam splitter 21, only part of the light is incident on the second reflector 23. The light reflected by the second reflector 23 is incident on the planar beam splitter 21 again and then passes through the planar beam splitter 21 to the exit pupil position 4. After entering the human eye, a defocused image is formed in front of the retina. The first reflector 22 and the second reflector 23 can use any one of a spherical reflector, an aspherical reflector, a free-form surface reflector, and a Fresnel reflector. The optical parameters of the first reflector 22 and the second reflector 23 are different, or the distances from the first reflector 22 and the second reflector 23 to the planar beam splitter 21 are different. The optical magnification system can also only include the long-image optical path.

[0034] The camera 20 can be arranged on the front side of the housing 10, specifically on the upper front housing 19 or the lower front housing 12, and can also be arranged inside the housing 10 and facing the exit pupil position 4.

[0035] Considering the image acquisition effect of the camera, the camera 20 is arranged at a position slightly above the rear side inside the housing 10. The camera 20 is arranged obliquely inside the housing 10 facing the exit pupil position, and is located above the viewing window 15 (i.e., the planar beam splitter 21) and below the horizontally arranged reflector (if any). The acquisition range of the camera 20 corresponds to the area between the lower edge of the viewing window 15 and the upper front housing 19.

[0036] As Figure 2As shown, when the horizontally arranged mirror 23 is a defocusing mirror, a light-shielding plate 24 is arranged in front of (i.e., below) the mirror 23. The light-shielding plate 24 is used to partially block the reflected light of the mirror 23, so that the light passing through the light-transmitting area of the light-shielding plate 24 forms a defocus pattern. Preferably, the light-shielding plate 24 is not planar. The light-shielding plate 24 uses a curved light-shielding plate and is concave towards the planar beam splitter 21. The camera 20 is located below the light-shielding plate 24 and at a position higher than the planar beam splitter 21. The light-shielding plate 24 is replaceable. By replacing the light-shielding plate 24 with different light-transmitting patterns, different defocus images are formed in the defocus optical path, thereby enhancing the myopia prevention and control effect. The upper front shell 19 of the housing 10 is detachably arranged above the window 15, and the upper front shell 19 is used to block the insertion position of the light-shielding plate 24.

[0037] As Figure 3 shown, the camera 20 is installed inside the housing 10 with a downward inclination. The pitch angle α of the camera 20 (i.e., the angle between the center line BO of the camera 20 and the horizontal plane AO) is greater than half of the vertical field of view angle β of the camera 20. For example, the camera is arranged at the rear side inside the housing 10 with a pitch angle of about 25°, and it is ensured that the camera 20 has an image acquisition range of at least ±15° and not greater than ±20°.

[0038] In addition, a light-blocking structure 16 is arranged on the front side of the housing 10. The light-blocking structure 16 is used to block the light that is obliquely incident from the desktop area 3 below the desktop far-image reading and writing device 1 to the pupil position 4 on the front side of the housing, thereby avoiding the possibility of the human eye directly viewing the desktop area 3 from the front side of the housing. At the same time, it can also prevent the reflected light of the desktop area 3 from directly entering the human eye and reduce the influence of ambient stray light on imaging. Specifically, the light-blocking structure 16 is arranged at a position on the front side of the housing 10 and below the window 15, and is arranged between the pupil position 4 and the desktop area 3 below the housing 10 to block the light from obliquely incident from the desktop area 3 to the pupil position 4.

[0039] The data processor and the memory are arranged inside the housing 10. The data processor is electrically connected to the camera and the memory respectively. The data processor can also be connected to the remote terminal device in different ways such as wired and wireless. The connection method is not limited here. A signal output module, such as an indicator light or a speaker, is also arranged on the housing 10 for outputting a prompt signal outward.

[0040] The present invention also provides a method for monitoring the user's usage behavior of the desktop far-image reading and writing device. The following combines Figure 4 the user usage behavior monitoring process shown to describe the working processes of the camera 20, the data processor, the memory, and the signal output module.

[0041] First, during the use of the desktop telephoto reading and writing device, the camera set facing the exit pupil position collects images at the exit pupil position. It can be understood that when the user turns on the power switch of the desktop telephoto reading and writing device, the fill light and the camera 20 start working, and the camera 20 starts to collect images at the exit pupil position.

[0042] Secondly, the data processor receives the data from the camera 20 and is used to perform image processing on the images captured by the camera 20 to identify the user's face position, and then judge the user's usage behavior based on the face position to generate user usage behavior monitoring results.

[0043] Among them, the data processor can identify the user's face position from the image through the built-in sitting posture recognition AI model or through the image processing algorithm, so as to determine the positional relationship between the user's face and the exit pupil position, for example, the human eye is within the exit pupil range, the human eye deviates from the exit pupil range, and the face is not monitored. The user usage behavior monitoring results at least include: normal usage behavior, user deviation and user leaving, where user deviation includes the user lowering his head and shaking left and right. It can be understood that: the human eye is within the exit pupil range, which corresponds to the normal user usage behavior; the human eye deviates from the exit pupil range, which corresponds to the user deviation, which is an irregular usage behavior; the face is not monitored, which corresponds to the user leaving.

[0044] The data processor can also count the effective usage time based on the user's usage behavior monitoring results. To be precise, the data processor counts the duration of the user's normal usage behavior based on the user's usage behavior monitoring results as the effective usage time.

[0045] The data processor can also output at least one of sound, light, and electricity signals to the outside through the signal output module according to the user's usage behavior monitoring results, at least for the user's usage situation of lowering the head, and also for the user's usage situation of shaking left and right, to remind the user of irregular usage behavior. Of course, for the user's usage situation of leaving, in addition to recording the user's leaving, the signal output module can also output at least one of sound, light, and electricity signals to remind the user.

[0046] Furthermore, the data processor can also obtain a user concentration evaluation result based on the user usage behavior monitoring results within a predetermined time. Specifically, the user concentration is evaluated based on the proportion of the user's normal usage time to the total usage time; or the user concentration is evaluated based on the proportion of the user's deviation time to the total usage time; wherein the total boot time minus the time when the user leaves is recorded as the total user usage time.

[0047] Finally, the data processor can store the above-mentioned user usage behavior monitoring results and user usage behavior analysis results in a data storage device and / or send them to a remote terminal device.

[0048] In summary, for the desktop telephoto reading and writing device and the user usage behavior monitoring method provided by the present invention, by arranging a camera on one side of the housing facing the pupil position, the sitting posture of the user is monitored, recorded, and reminded, so as to realize the understanding and supervision of the user's usage behavior, and standardize the user's usage behavior to ensure the usage effect of the desktop telephoto reading and writing device.

[0049] The above has described in detail a desktop telephoto reading and writing device and a user usage behavior monitoring method provided by the present invention. For those of ordinary skill in the art, any obvious changes made to it without departing from the essence of the present invention will constitute an infringement of the patent right of the present invention and will bear corresponding legal responsibilities.

Claims

1. A method for monitoring the user behavior of a desktop far-image reading and writing device, characterized in that The steps include: A camera connected to the housing and arranged facing the exit pupil position, for collecting images at the exit pupil position during use of the desktop telescopic reading and writing device; The data processor is used to process the images collected by the camera, identify the user's face position, and judge the user's usage behavior based on the face position, generate user usage behavior monitoring results, and then store the user usage behavior monitoring results in a data storage device and / or send them to a remote terminal device.

2. The method for monitoring user usage behavior of a desktop telescopic reading and writing device according to claim 1, characterized in that: The method for performing image processing on an image captured by a camera and identifying the user's face position therefrom comprises the following steps: identifying the user's face position from the image through a built-in sitting posture recognition AI model or through an image processing algorithm.

3. The method for monitoring user usage behavior of a desktop telescopic reading and writing device according to claim 1, characterized in that: The user usage behavior monitoring results at least include normal usage behavior, user deviation and user leaving.

4. The method for monitoring the user behavior of the desktop far-image reading and writing device according to claim 3, characterized in that The following steps are also included: The data processor counts the duration of the user's normal usage behavior according to the user usage behavior monitoring result as the effective usage duration.

5. The method for monitoring the user's usage behavior of the desktop far-image reading and writing device according to claim 3, characterized in that The following steps are also included: The data processor outputs any one of sound, light and electricity signals to the outside through the signal output module according to the user usage behavior monitoring results, at least for the user's head-down usage situation, to prompt the user that the usage behavior is not standardized.

6. The method for monitoring the user behavior of the desktop far-image reading and writing device according to claim 3, characterized in that The following steps are also included: The data processor obtains a user concentration evaluation result based on a user usage behavior monitoring result within a predetermined time.

7. A desktop long-distance imaging reading and writing device for implementing the user usage behavior monitoring method according to any one of claims 1 to 6, characterized in that include: A housing, wherein an optical magnification system is disposed inside the housing and a viewing window is disposed on the front side of the housing; When in use, the housing is arranged above the desktop through a bracket, and light from the desktop direction enters from the bottom of the housing, passes through the optical magnification system, and then is emitted from the window to the exit pupil position, forming a virtual image at least 3 meters away from the exit pupil position; A camera is connected to the housing and is arranged facing the exit pupil position, and the image acquisition range of the camera can at least cover the range corresponding to the face of a person located at the exit pupil position; the camera is used to acquire an image at the exit pupil position during the use of the desktop telescopic reading and writing device; and, The data processor is used to process the images collected by the camera, identify the user's face position, judge the user's usage behavior based on the face position, and generate user usage behavior monitoring results.

8. The desktop telescopic reading and writing device according to claim 7, characterized in that: The camera is arranged inside the housing at an angle facing the exit pupil position and is located above the viewing window.

9. The desktop telescopic reading and writing device according to claim 8, characterized in that: The pitch angle α of the camera is greater than half of the vertical field of view β of the camera.

10. The desktop telescopic reading and writing device according to claim 8, characterized in that: The camera has an image acquisition range of at least ±15° and no greater than ±20°.

Images