Ageing-suitable reading method and system based on visual tracking technology

Abstract

The invention provides an aged reading method and system based on a visual tracking technology, and relates to the technical field of aged sitting posture reading. Comprising a sight tracking module, a sitting posture monitoring module, an interface zooming module, an anti-misoperation module and a health management module. The sight tracking module captures eyeball movement data of the user in real time through an eye tracker and calculates coordinates of a sight focusing area; the sitting posture monitoring module measures the included angle between the back and legs of the old reader and the distance between the head and the screen; and the interface zooming module can associate the magnification scale of the sight focusing area with the position data of the elderly reader, so that the visual compensation effect is optimized. According to the method, the magnification scale of the sight focusing area is associated with the position data of the elderly reader in real time through a dynamic linkage mechanism, multi-scene adaptation is supported, and the problems that in the prior art, the interface magnification function is single, and health monitoring and operation scenes are separated are solved.

Description

Technical Field

[0001] The present invention relates to the technical field of aging-friendly reading, and particularly to an aging-friendly reading method and system based on visual tracking technology. Background Art

[0002] With the accelerating global aging process, the proportion of the population aged 65 and above has been continuously rising, and the dependence of the elderly group on digital devices has increased significantly. From online medical consultations, financial business handling to social communication, digital services have become an indispensable part of daily life. However, vision decline (such as presbyopia, macular degeneration) causes interface text to be blurred and operation buttons to be difficult to identify, and skeletal health problems (such as cervical spondylosis, lumbar muscle strain) are exacerbated by long-term fixed sitting postures. These obstacles severely limit the efficient use of electronic devices by the elderly.

[0003] Although existing technologies provide basic magnification functions or simple health reminder functions, there are generally problems of fragmented functions and insufficient adaptability. For example, traditional interface magnification cannot dynamically match the line of sight focus, or existing technologies are not combined with sitting posture correction, and health monitoring devices lack linkage with the operation scenario and cannot adapt to the elderly with different degrees of vision decline. Summary of the Invention

[0004] The purpose of the present invention is to provide an aging-friendly reading method and system based on visual tracking technology to solve the problems of fragmented functions and insufficient adaptability of existing aging-friendly electronic products mentioned in the above background art.

[0005] To achieve the above purpose, the present invention provides the following technical solutions: In the first aspect, the present invention provides an aging-friendly reading method based on visual tracking technology, and the method includes the following contents: Configure an eye tracker device opposite the elderly reader to capture the eye movement data of the elderly reader in real time and calculate the coordinates of the line of sight focus area where the line of sight focuses on the user interface; Obtain the spatial coordinates of the legs, back and head of the elderly reader through a camera, and calculate the distance Y between the head and the user interface in real time n , and the included angle θ between the back and the legs; Set the abnormal monitoring time, sitting posture threshold Y0, and the upper and lower limits of θ when the sitting posture is correct, monitor whether the value of Y n or / and θ changes, and record the change time. If the change time reaches the abnormal monitoring time, a dialog box for whether to adjust the interface magnification ratio will pop up on the user interface. If the elderly reader selects to keep the current magnification ratio unchanged by eye movement and continues reading, and if the elderly reader selects to perform interface scaling by eye movement, then according to the set sitting posture threshold Y0 and the current Y nDetermine whether the elderly reader is leaning forward or backward based on the difference value or / and whether the current θ exceeds the upper and lower limits, and automatically adjust the magnification ratio of the line-of-sight focusing area in the user interface to meet the reading needs of the elderly reader; Set the reading maintenance judgment time and the sedentary duration threshold. When the elderly reader maintains the current sitting posture for the reading maintenance judgment time, lock the magnification ratio of the line-of-sight focusing area at this time, start the sedentary timer, and give a reminder when the sedentary duration threshold is exceeded; if the reading time of the elderly reader does not reach the reading maintenance judgment time, continuously monitor whether the sitting posture of the elderly reader is normal, and adjust the magnification ratio of the line-of-sight focusing area in the interface when an abnormality is detected and the abnormal monitoring time is reached.

[0006] Furthermore, the abnormal monitoring time is set to 30s, the reading maintenance judgment time is set to 1min, and the sedentary duration threshold is set to 30min; the upper and lower limits of θ are set to 100° and 90° respectively.

[0007] In a second aspect, the present invention provides an aging-friendly reading system based on visual tracking technology, which is applied to an electronic device configured with a user interface, and the elderly reader reads while maintaining a sitting posture, including: A line-of-sight tracking module, which configures an eye tracker device opposite the elderly reader to capture the eye movement data of the elderly reader in real time and calculate the coordinates of the line-of-sight focusing area on the user interface; A sitting posture monitoring module, which is configured to obtain the spatial coordinates of the legs, back, and head of the elderly reader when sitting through a camera, and calculate the angle θ between the back and the legs and the distance Y between the head and the user interface in real time n , set a sitting posture threshold Y0, and select whether to run the maintenance mode or the adjustment mode according to whether the absolute value of the relative error value between Y0 and Y n is less than 5%; An interface zooming module, which is configured to associate the coordinates of the line-of-sight focusing area calculated by the above line-of-sight tracking module with the Y n calculated by the sitting posture monitoring module in real time, set the upper and lower limits of θ when the sitting posture is correct, and in the adjustment mode, when the distance between the head of the elderly reader and the user interface deviates from the sitting posture threshold Y0, or / and θ exceeds the upper and lower limit ranges, automatically adjust the magnification ratio of the line-of-sight focusing area in the user interface to meet the reading needs of the elderly reader; An anti-misoperation module, which is configured to automatically lock the magnification ratio of the line-of-sight focusing area in the user interface, and only readjust the magnification ratio of the line-of-sight focusing area when the elderly reader makes an action selection to execute interface zooming through eye movement; A health management module, configured to enable a sedentary timer when the sitting posture monitoring module determines it to be in the maintenance mode, set a sedentary duration threshold, and forcefully intervene when the stationary time of the elderly reader exceeds the set sedentary duration threshold to lock the user interface.

[0008] As a further improvement of the present invention, the sitting posture monitoring module pre-determines the sitting posture threshold Y0 of the elderly reader, that is, the reference distance between the head and the user interface. The system continuously monitors the sitting posture of the elderly reader through a camera and calculates Y n , and simultaneously operates different adjustment modes according to the absolute value of the relative error value between Y0 and Y n .

[0009] As a further improvement of the present invention, the adjustment mode is that if the absolute value of the relative error between Y0 and Y n is not less than 5%, then the difference between Y0 and Y n is transmitted to the interface zoom module and the adjustment mode is run; if the absolute value of the relative error between Y0 and Y n is less than 5%, then the magnification ratio of the line-of-sight focus area is maintained and the maintenance mode is entered.

[0010] As a further improvement of the present invention, the measurement method of the reference distance is the distance between the head of the elderly reader and the user interface measured when the elderly reader is in a comfortable and healthy reading sitting posture, that is, when Y0 is such that the included angle between the back and the legs is between 90° and 100°.

[0011] As a further improvement of the present invention, the interface zoom module sets the magnification ratio of the line-of-sight focus area within the user interface as the default ratio (100%) before running, and receives the difference between Y0 and Y n transmitted by the sitting posture monitoring module during operation, and executes different magnification ratio adjustment strategies according to the positive or negative of the difference.

[0012] As a further improvement of the present invention, the magnification ratio adjustment strategy is that if the value of (Y0 - Y n ) is less than 0, then the magnification ratio of the line-of-sight focus area is reduced by 5%, if the value of (Y0 - Y n ) is greater than 0, then the magnification ratio of the line-of-sight focus area is increased by 10%. After adjusting the magnification ratio of the line-of-sight focus area, if the elderly reader maintains the current sitting posture for one minute, the magnification ratio of the current line-of-sight focus area is locked and the anti-misoperation module is entered.

[0013] As a further improvement of the present invention, the anti-misoperation module can modify the magnification ratio of the line-of-sight focusing area according to different strategies after the sitting posture of the elderly reader changes. The strategies are as follows: when it is detected that the sitting posture of the elderly reader in the maintenance mode is in an abnormal state, the user interface prompts whether to adjust the interface magnification ratio. If the line-of-sight focusing area needs to be adjusted in terms of magnification ratio, the eyes slowly sweep across the user interface, and at this time, the interface scaling module is executed. If there is no need to adjust the magnification ratio of the line-of-sight focusing area, the eyes look outside the user interface to cancel the above prompt.

[0014] As a further improvement of the present invention, the abnormal state is that the included angle between the back and the legs of the elderly reader is lower than 90° or higher than 100°, and the current posture is maintained for more than 30 s.

[0015] As a further improvement of the present invention, the health management module is divided into a home reading mode and a public reading mode according to different reading scenarios of the elderly reader.

[0016] As a further improvement of the present invention, the home reading mode sets the sedentary duration threshold to 30 minutes. After exceeding the limit, the user interface is forcibly locked, and reading data such as the reading time and frequency of the elderly reader are statistically analyzed and a health report is generated, which is sent to the guardian or community hospital in the form of charts, etc.; the public reading mode only supports the sedentary reminder function and does not set functions such as generating health reports.

[0017] Compared with the prior art, the beneficial effects of the present invention are as follows: The present invention dynamically links and real-time correlates the magnification ratio of the line-of-sight focusing area with the position data of the elderly reader, supports multi-scenario adaptation, and aims to solve the problems of single interface magnification function and disconnection between health monitoring and operation scenarios in the prior art.

[0018] The present invention integrates line-of-sight tracking, sitting posture correction, and interface adaptation technologies. In public and home scenarios, combined with sedentary reminder and dynamic interface ratio adjustment, it can effectively relieve the eye and bone pressure of the elderly.

[0019] The present invention not only fills the gap in multi-dimensional collaborative intervention in the prior art, but also fundamentally improves the participation and quality of life of the elderly group in the digital age.

[0020] The present invention mainly targets the gap in the visual acuity level of elderly readers, sets corresponding thresholds and upper and lower limits according to its own conditions, adjusts the magnification ratio through the determination of the distance between the elderly and the screen and the angle between the back and the legs, and at the same time sets an anti-misoperation and health management module, which can not only ensure the normal setting of the interface magnification ratio during reading, but also effectively ensure the physical health of the elderly. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic structural diagram of an embodiment of an aging-friendly reading system based on vision tracking technology according to the present invention; Figure 2 It is a schematic flow diagram of the sitting posture detection module in the present invention; Figure 3 It is a schematic flow diagram of the interface zooming module in the present invention; Figure 4 It is a schematic flow diagram of the anti-misoperation module in the present invention; Figure 5 It is a schematic diagram of an application scenario of an embodiment of the present invention. Detailed implementation manners

[0022] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0023] In the description of the present invention, it should be noted that unless otherwise clearly defined and limited, the terms "installation", "connection", and "connection" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations. In addition, the technical features involved in different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0024] Embodiment 1: As Figure 1 and Figure 5 shown, an aging-friendly reading system based on vision tracking technology according to the present invention includes: A gaze tracking module 01, which arranges an eye tracker device 13 opposite to the elderly reader 11, is used to capture the eye movement data of the elderly reader 11 in real time, and calculate the gaze focus area coordinates on the user interface 12 by using a convolutional neural network model.

[0025] A sitting posture monitoring module 02, which is configured to obtain the spatial coordinates of the legs, back and head of the elderly reader 11 through a camera 14, and analyze the angle θ between the back and the legs and the distance Y between the head and the user interface based on the bone key point detection technology n , according to Y0 and Y nSelect to run the maintenance mode or the adjustment mode based on whether the absolute value of the relative error value is less than 5%.

[0026] An interface zooming module 05, configured to correlate the coordinates of the line-of-sight focus area calculated by the above-mentioned line-of-sight tracking module with the Y calculated by the sitting posture monitoring module 02 in real time. When the sitting posture of the elderly reader 11 deviates from the sitting posture threshold Y0, the magnification ratio of the line-of-sight focus area within the user interface 12 is automatically adjusted to meet the reading needs of the elderly reader 11. n In real-time association, when the sitting posture of the elderly reader 11 deviates from the sitting posture threshold Y0, the magnification ratio of the line-of-sight focus area within the user interface 12 is automatically adjusted to meet the reading needs of the elderly reader 11.

[0027] An anti-misoperation module 03, configured to automatically lock the magnification ratio of the line-of-sight focus area within the user interface 12, and only readjust the magnification ratio of the line-of-sight focus area when the elderly reader makes a specific action through eye movement to select to perform interface zooming.

[0028] The anti-misoperation module 03 obtains the data determined by the sitting posture monitoring module 02 to be in the maintenance mode, and performs real-time sitting posture monitoring in the maintenance mode. If an abnormal state is detected, it calls the visual tracking module to determine whether to perform interface zooming through eye movement. If interface zooming is selected, it gives an execution instruction to the interface zooming module. After the interface zooming module executes, it continues to perform sitting posture monitoring, realizing the dynamic linkage among the sitting posture monitoring module, the interface zooming module, and the anti-misoperation module.

[0029] A health management module 04, configured to enable a sedentary timer when the sitting posture monitoring module determines it to be in the maintenance mode, and forcefully intervene when the static time of the elderly reader exceeds the set sedentary duration threshold.

[0030] Embodiment 2: As Figure 2 shown, the sitting posture monitoring module 02 needs to pre-determine the sitting posture threshold Y0 of the elderly reader 11, that is, the reference distance between the head and the user interface. The system monitors the sitting posture of the elderly reader 11 through the camera 14 in real time and calculates Y n , and at the same time runs different adjustment modes according to the absolute value of the relative error value between Y0 and Y n .

[0031] The adjustment mode is: if the absolute value of the relative error between Y0 and Y n is not less than 5%, then the difference between Y0 and Y is transmitted to the interface zooming module 05 and the adjustment mode is run; if the relative error between Y0 and Y n is less than 5%, then the magnification ratio of the line-of-sight focus area is maintained and the maintenance mode is entered. n If the relative error between Y0 and Y is less than 5%, then the magnification ratio of the line-of-sight focus area is maintained and the maintenance mode is entered.

[0032] The measurement method of the reference distance is that when the elderly reader 11 is in a comfortable and healthy reading sitting posture, that is, when the included angle θ between the back and the leg is between 90° and 100°, the distance Y0 between the head of the elderly reader 11 and the user interface 12 is measured. Here, θ is the included angle between the central axis of the thigh and the central axis of the back in the sitting posture. The camera is located outside the middle area of the elderly reader and the user interface, and when shooting, it can simultaneously capture the area above the thighs of the elderly reader (including the head, thighs, waist, and back) and the user interface.

[0033] Embodiment 3: As Figure 3 shown, before running, the interface scaling module 05 sets the magnification ratio of the sight focus area in the user interface 12 to the default ratio (100%). When running, it receives the difference between Y0 and Y n transmitted by the sitting posture monitoring module 02, and executes different magnification ratio adjustment strategies according to the positive or negative of the difference. At this time, the absolute value of the relative error between Y0 and Y n is not less than 5%.

[0034] The magnification ratio adjustment strategy is as follows: Determine whether the sitting posture of the elderly reader is normal (in the normal situation less than 5%, 90° < θ < 100°). If it is not normal, then determine whether it is leaning forward or backward. If it is leaning backward, then reduce the magnification ratio of the sight focus area. That is, if the value of (Y0 - Y n ) is less than 0 and negative, then reduce the magnification ratio of the sight focus area by 5%; if it is leaning forward, then increase the magnification ratio of the sight focus area. That is, if the value of (Y0 - Y n ) is greater than 0 and positive, then increase the magnification ratio of the sight focus area by 10%. Then continuously determine whether the current sitting posture for reading is maintained for 1 minute. If the 1-minute requirement is met, then lock the magnification ratio of the sight focus area at this time; if the 1-minute requirement is not met, execute the sitting posture monitoring module again.

[0035] If the sitting posture of the elderly reader is normal, 90° < θ < 100°, no interface scaling is performed and it remains in the maintenance state. Determine whether this state meets the 1-minute requirement. If it does, lock the magnification ratio of the sight focus area after one minute and enter the anti-misoperation module 03.

[0036] During this process, determine whether the elderly reader is leaning forward or backward through the positive or negative of the difference between Y0 and Y n . If it is negative, the elderly reader is in a backward-leaning state; if it is positive, the elderly reader is in a forward-leaning state.

[0037] Embodiment 4: As Figure 4As shown, the anti-misoperation module 03 can modify the magnification ratio of the line-of-sight focusing area according to different strategies after the sitting posture of the elderly reader 11 changes. The strategies are as follows: When it is detected that the sitting posture of the elderly reader 11 in the maintenance mode is in an abnormal state (the angle between the back and the legs is less than 90° or greater than 100°, and this posture is maintained for more than 30 s), the user interface 12 prompts whether to adjust the interface magnification ratio. If the magnification ratio of the line-of-sight focusing area needs to be adjusted, the eyes slowly sweep across the user interface 12. After the eye movement device senses this operation, the interface scaling module 05 is executed at this time. Further, it is determined whether it is a forward tilt or a backward tilt according to whether the angle between the back and the legs is less than 90° or greater than 100°, and then the magnification ratio of the line-of-sight focusing area is increased or decreased.

[0038] If there is no need to adjust the magnification ratio of the line-of-sight focusing area, the eyes look outside the user interface 12 to cancel the above prompt and keep the current magnification ratio unchanged to continue reading.

[0039] The abnormal state is that the angle θ between the back and the legs of the elderly reader 11 is less than 90° or greater than 100°, and this posture is maintained for more than 30 s, so as to avoid frequent reminders when the elderly reader leaves the seat briefly due to something.

[0040] After adjustment, when the sitting posture is maintained for reading for 1 minute, the magnification ratio at this time can be locked and the maintenance mode is entered.

[0041] Embodiment 5: In this embodiment, the health management module 04 is divided into a home reading mode and a public reading mode according to different reading scenarios of the elderly reader.

[0042] The home reading mode sets the sedentary duration threshold to 30 minutes. After exceeding the limit, the interface is forcibly locked, and reading data such as the reading time and frequency of the elderly reader 11 is statistically analyzed and a health report is generated, which is sent to the guardian or community hospital in the form of charts, etc.; the public reading mode only supports the sedentary reminder function, reminding the elderly reader that they have read for a long time and need to rest, and does not set functions such as generating health reports.

[0043] Embodiment 6: As attached Figure 5 As shown, the present invention provides an embodiment. In this embodiment, the camera 14 (such as an AI somatosensory camera) is installed at the position of the wall on the side of the elderly reader 11. The elderly reader maintains a sitting posture for reading, and measures the angle θ between the back and the legs of the elderly reader 11 and the distance Y between the head and the user interface 12. n .

[0044] The eye tracker device 13 is installed on the opposite side of the elderly reader 11 and on the same side as the user interface 12, and can capture the eye movement data of the elderly reader 11 in real time, and use a convolutional neural network model to calculate the coordinates of the line of sight focus area where the line of sight is focused on the user interface 12.

[0045] The interface zoom module 05 firstly measures the distance Y0 between the head of the elderly reader 11 and the user interface 12 when the elderly reader 11 is in a standard sitting posture (90°<θ<100°) at the beginning of operation, and calculates the distance Y0 and Y n The difference between the values ​​of Y0 and Y1 is used to link the user interface 12 to zoom in on the sight focus area. Specifically, when the elderly reader 11 finds it difficult to see the text in the user interface 12 with a default zoom ratio of 100%, the body will lean forward (θ<90°) to bring the head close to the user interface 12. At this time, Y0>Y n , the magnification ratio of the sight focus area increases by 10%; when the magnification ratio of the sight focus area is too large or the elderly reader 11 wants to reduce the magnification ratio of the sight focus area, the distance Y between the head and the user interface 12 can be increased by leaning back (θ>100°) n , at this time Y0 <Y n , the magnification ratio of the sight focus area is reduced by 5%; when the distance Y between the head of the elderly reader 11 and the user interface 12 n When the absolute value of the relative error with the preset value Y0 is lower than 5%, and this state is maintained for one minute, the magnification ratio of the line of sight focus area is locked in the maintenance mode, and the anti-misoperation module 03 and the health management module 04 are entered.

[0046] In this embodiment, the anti-misoperation module 03 can ensure that after locking the magnification ratio of the line of sight focus area, the elderly reader 11 changes his sitting posture for a short time (less than 30s) (θ<90° or θ>100°), and the magnification ratio of the line of sight focus area is not changed due to postures such as leaning forward or leaning back. If the elderly reader 11 is in the changed posture (θ<90° or θ>100°) for a long time (more than 30s), a reminder whether to adjust the magnification ratio of the line of sight focus area will be displayed on the user interface 12. The elderly reader 11 can re-enter the interface zoom module 05 by scanning the screen horizontally with his eyes or look outside the screen to maintain the original magnification ratio of the line of sight focus area.

[0047] The health management module 04 records the single reading time of the elderly reader 11, sets the threshold of the sedentary time to 30 minutes, and automatically locks the interface for 10 minutes after exceeding the limit and prompts the reader to get up and move around. When the elderly reader 11 is only in private places such as home, the health management module will count reading data such as reading time and frequency and generate a health report, which will be sent to the guardian or community hospital in the form of charts and the like.

[0048] The main application scenario of the present invention is computer reading. At the same time, an anti-misoperation module is set up to ensure that when the elderly readers make actions other than reading, the original magnification ratio is maintained, so as to ensure that the elderly can read efficiently. At the same time, a health management module is also set up to fully guarantee the physical health of the elderly readers.

[0049] The technical features of the above-described embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.

[0050] The above-described embodiments only represent several implementation manners of the present invention. The description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can still be made, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the present invention patent shall be subject to the appended claims.

[0051] Matters not described in the present invention are applicable to the prior art.

Claims

1. An aging-friendly reading method based on visual tracking technology, characterized in that, The method includes the following: Configure an eye tracker device opposite the elderly reader to capture the eye movement data of the elderly reader in real time and calculate the coordinates of the gaze focus area where the line of sight focuses on the user interface; Obtain the spatial coordinates of the legs, back, and head of the elderly reader through the camera, and calculate the distance Y between the head and the user interface in real time n , and the angles θ between the back and the legs; Set the abnormal monitoring time, sitting posture threshold Y0, and the upper and lower limits of θ when the sitting posture is correct, and monitor Y n Or / and whether the value of θ changes, and record the change time. If the change time reaches the abnormal monitoring time, a dialog box for whether to adjust the interface magnification ratio will pop up on the user interface. If the elderly reader's eye movement selects to keep the current magnification ratio unchanged and continue reading; if the elderly reader's eye movement selects to perform interface zooming, determine whether the elderly reader leans forward or backward according to the difference between the set sitting posture threshold Y0 and the current Y n Or / and whether the current θ exceeds the upper and lower limits, and automatically adjust the magnification ratio of the line-of-sight focusing area within the user interface to meet the reading needs of the elderly reader; Set a reading maintenance judgment time and a sedentary duration threshold. When the elderly reader maintains the current sitting posture for the reading maintenance judgment time, lock the magnification ratio of the gaze focus area at this time, start the sedentary timer, and give a reminder when the sedentary duration threshold is exceeded; if the reading time of the elderly reader does not reach the reading maintenance judgment time, continuously monitor whether the sitting posture of the elderly reader is normal.

2. The aging-friendly reading method based on visual tracking technology according to claim 1, wherein The abnormal monitoring time is set to 30s, the reading maintenance judgment time is set to 1min, and the sedentary duration threshold is set to 30min; the upper and lower limits of θ are set to 100° and 90° respectively.

3. An aging-friendly reading system based on visual tracking technology, characterized in that, The system includes: A gaze tracking module that configures an eye tracker device opposite the elderly reader to capture the eye movement data of the elderly reader in real time and calculate the coordinates of the gaze focus area where the line of sight focuses on the user interface; Sitting posture monitoring module, configured to obtain the spatial coordinates of the legs, back, and head of the elderly reader in a sitting position through a camera, and calculate the angle θ between the back and the legs and the distance Y between the head and the user interface in real time n , set a sitting posture threshold Y0, and select whether to run the maintenance mode or the adjustment mode according to whether the absolute value of the relative error value between Y0 and Y n is less than 5%; An interface zooming module, where the interface zooming module is configured to correlate the coordinates of the line-of-sight focus area calculated by the above-mentioned line-of-sight tracking module with the Y calculated by the sitting posture monitoring module in real time, set the upper and lower limits of θ when the sitting posture is correct, and in the adjustment mode, when the distance between the head of the elderly reader and the user interface deviates from the sitting posture threshold Y0, and / or θ exceeds the range of the upper and lower limits, automatically adjust the zoom ratio of the line-of-sight focus area within the user interface to meet the reading needs of the elderly reader; n When the sitting posture is correct, set the upper and lower limits of θ. In the adjustment mode, when the distance between the head of the elderly reader and the user interface deviates from the sitting posture threshold Y0, and / or θ exceeds the range of the upper and lower limits, automatically adjust the zoom ratio of the line-of-sight focus area within the user interface to meet the reading needs of the elderly reader; An anti-misoperation module configured to automatically lock the magnification ratio of the gaze focus area within the user interface and only readjust the magnification ratio of the gaze focus area when the elderly reader makes an action selection to execute interface zooming through eye movement; A health management module configured to enable the sedentary timer and set a sedentary duration threshold when the sitting posture monitoring module determines it is in the maintenance mode. When the static time of the elderly reader exceeds the set sedentary duration threshold, lock the user interface.

4. The age-friendly reading system based on visual tracking technology according to claim 3, characterized in that: The sitting posture monitoring module pre-determines the sitting posture threshold Y0 of the elderly reader, and sets Y0 as the distance between the head and the user interface when the elderly reader is in the standard sitting posture of 90° < θ < 100° measured at the initial stage of operation.

5. The age-friendly reading system based on visual tracking technology according to claim 3, characterized in that: The adjustment mode is that if the absolute value of the relative error between Y0 and Y n is not less than 5%, the difference between Y0 and Y n is transmitted to the interface scaling module and the adjustment mode is run; if the absolute value of the relative error between Y0 and Y n is less than 5%, the magnification ratio of the line of sight focusing area is maintained and the maintenance mode is entered.

6. The age-friendly reading system based on visual tracking technology according to claim 5, characterized in that: The described interface zooming module sets the magnification ratio of the line-of-sight focusing area within the user interface to the default ratio of 100% before running. During operation, it receives the difference between Y0 and Y transmitted by the sitting posture monitoring module, and executes different magnification ratio adjustment strategies according to the positive or negative of the difference. n And perform different magnification adjustment strategies according to the positive or negative of the difference.

7. The age-friendly reading system based on visual tracking technology according to claim 6, characterized in that: The described magnification ratio adjustment strategy is as follows: If the value of Y0 - Y n is less than 0, the magnification ratio of the line of sight focusing area is reduced by 5%. If the value of Y0 - Y n is greater than 0, the magnification ratio of the line of sight focusing area is increased by 10%. After adjusting the magnification ratio of the line of sight focusing area, if the elderly reader maintains the current sitting posture and reads for one minute, the magnification ratio of the current line of sight focusing area is locked, and the anti-misoperation module is entered.

8. The age-friendly reading system based on visual tracking technology according to claim 5, characterized in that: The anti-misoperation module modifies the magnification ratio of the gaze focus area according to different strategies after the sitting posture of the elderly reader changes. The strategies are as follows: when it is detected that the sitting posture of the elderly reader in the maintenance mode is in an abnormal state, the user interface prompts whether to adjust the interface magnification ratio. If the magnification ratio of the gaze focus area needs to be adjusted, the eyes slowly sweep across the user interface, and at this time, execute the interface zooming module. If the magnification ratio of the gaze focus area does not need to be adjusted, the eyes look outside the user interface to cancel the prompt.

9. The age-friendly reading system based on visual tracking technology according to claim 8, wherein: The abnormal state is that the included angle between the back and legs of the elderly reader is less than 90° or greater than 100°, and the current posture is maintained for more than 30s.

10. The age-friendly reading system based on visual tracking technology according to claim 3, wherein: The health management module is divided into a home reading mode and a public reading mode according to different reading scenarios of the elderly reader; In the home reading mode, the sedentary duration threshold is set to 30 minutes. After exceeding the limit, the user interface is forcibly locked, and reading data including reading time and frequency of the elderly reader is statistically analyzed and a health report is generated and sent to the guardian or community hospital; the public reading mode only supports sedentary reminders and does not set health report generation.

Images