Visual acuity testing method and apparatus, and terminal, storage medium and electronic device
By dynamically adjusting the display position and size of the detection visual target, and randomly selecting the visual target from the detection visual target for display, the problem of inaccurate vision detection in the prior art is solved, and higher detection accuracy and convenience are achieved.
Patent Information
- Application Number
- PCT/CN2023/122663
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-28
- Publication Date
- 2025-06-26
AI Technical Summary
In the existing vision detection methods, users need to stand in a fixed position for detection, resulting in inaccurate and complex detection.
By obtaining the user's eye position information, dynamically adjusting the display position and size of the detection visual target, randomly selecting the visual target from the detection visual target for display, and responding to user feedback to determine the visual information.
The vision detection process is simplified, the accuracy and convenience of detection is improved, the detection time is reduced, and the vision information obtained is more accurate.
Smart Images

Figure CN2023122663_26062025_PF_FP_ABST
Abstract
Description
Vision detection method, device and terminal, storage medium and electronic equipment Technical Field
[0001] The present disclosure relates to the field of human-computer interaction technology, and in particular to a vision detection method, device and terminal, storage medium and electronic equipment. Background Art
[0002] During the existing vision test, all the sight marks on the eye chart are displayed and fixed in position. Some users may record the position of the eye chart, resulting in the inability to correctly detect the actual value of the user's vision.
[0003] When using an eye chart for testing, the user is required to stand at a certain distance from the center point of the eye chart as the testing position. The user is required to find the testing position by himself, and the testing process is complicated and inaccurate.
[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to ordinary technicians in the field.
[0005] Summary of the Invention
[0006] The present disclosure provides a vision detection method, device and terminal, storage medium and electronic device, which at least to a certain extent overcome the problem of inaccurate vision detection due to related technologies.
[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by practice of the present disclosure.
[0008] According to one aspect of the present disclosure, a vision detection method is provided, comprising:
[0009] Obtain user eye position information;
[0010] Determining the display position and display size of the detection sight mark in the display area of the detection terminal according to the user's eye position information;
[0011] Randomly select a test sight mark from the test vision chart, and display it at a display position in the display area of the test terminal according to the display size of the test sight mark;
[0012] In response to the user's feedback on the detection target, the user's vision information is determined.
[0013] In some embodiments, obtaining user eye position information includes:
[0014] Obtaining depth image data from the user distance detection terminal;
[0015] The user's eyes are identified and the position information of the user's eyes is determined based on the depth image data of the user distance detection terminal.
[0016] In some embodiments, determining the display position and display size of the detection sight mark in the display area of the detection terminal according to the user's eye position information includes:
[0017] Determining whether the user's eyes are within a visible range based on the user's eye position information; the visible range is a space formed by a set length range, width range, and height range in a three-dimensional coordinate system established by the detection terminal in the three-dimensional space;
[0018] When the user's eyes are within the visual range, determining the three-dimensional spatial point of the user's eyes in the three-dimensional coordinate system;
[0019] The display position and display size of the detection sight mark in the display area of the detection terminal are determined according to the three-dimensional space point of the human eye.
[0020] In some embodiments, determining the display position and display size of the detection sight mark in the display area of the detection terminal according to the three-dimensional space point of the human eye includes:
[0021] Obtaining the horizontal coordinate, vertical coordinate and vertical coordinate of the three-dimensional space point of the human eye;
[0022] Determine the projected abscissa and ordinate according to the orthographic projection of the abscissa and ordinate of the three-dimensional space point of the human eye on the display area of the detection terminal;
[0023] Determining a point formed by the projected horizontal coordinate and the projected vertical coordinate in the display area of the detection terminal as a display position of the detection sight mark in the display area of the detection terminal, wherein the display position of the detection sight mark in the display area of the detection terminal moves as the three-dimensional space point of the human eye moves;
[0024] Determining a vertical distance between the three-dimensional space point of the human eye and the display area of the detection terminal according to the vertical coordinate of the three-dimensional space point of the human eye;
[0025] The display size of the detection sight mark is determined according to the vertical distance.
[0026] In some embodiments, determining the display size of the detection sight mark according to the vertical distance includes:
[0027] Obtain the standard detection distance of the standard eye chart;
[0028] determining a distance ratio according to the vertical distance and the standard detection distance;
[0029] The current detection sight mark display size is determined based on the distance ratio, the last user vision information and the actual position offset of the human eye. The actual position offset of the human eye is determined by the center point of the intersection of the three-dimensional space point of the human eye and the diagonal of the display area of the detection terminal. The detection sight mark display size includes multiple vision levels.
[0030] In some embodiments, when the vision test is performed for the first time, the last user vision information is the average of the vision information of other users.
[0031] In some embodiments, when the user's eyes are not within the visual range, guidance information is displayed on the display area of the detection terminal, and the guidance information is used to instruct the user to move within the visual range;
[0032] The user's eye position is detected in real time until the user's eye is within the visual range, and the guidance information displayed on the display area of the detection terminal is deleted.
[0033] In some embodiments, randomly selecting a test sight mark from a test vision chart and displaying the test sight mark at a display position in a display area of the test terminal according to a display size of the test sight mark includes:
[0034] Displaying multiple patterns of the vision test chart on the display area of the detection terminal;
[0035] Determine the style of the detection sight mark according to the pattern style selected by the user;
[0036] A detection sight mark is randomly selected from the detection vision chart corresponding to the pattern style selected by the user, and the pattern of the detection sight mark is displayed at a display position in the display area of the detection terminal according to the display size of the detection sight mark.
[0037] In some embodiments, when there are multiple users, determining the display position and display size of the detection sight mark in the display area of the detection terminal includes:
[0038] According to the eye position information of each user among the multiple users, the display position and display size of the detection sight mark corresponding to each user in the display area of the monitoring terminal are determined, and the detection sight mark corresponds to the user's eyes one by one.
[0039] In some embodiments, when displaying the detection sight mark, obtaining the ambient light brightness;
[0040] Adjust the backlight intensity of the display area of the detection terminal according to the ambient light brightness.
[0041] In some embodiments, in response to the user's feedback on the detection target, determining the user's vision information includes:
[0042] Displaying a detection mode on the display area of the detection terminal, the detection mode including: monocular detection and binocular detection;
[0043] In response to the user selecting the detection mode, detecting the user's feedback on the detection sight mark displayed in the display area of the detection terminal, and determining feedback information;
[0044] The user's vision information is determined according to the feedback information.
[0045] In some embodiments, if the detection mode is monocular detection, after responding to the user selecting the detection mode, the method further includes:
[0046] Displaying a single-eye cover prompt message on the display area of the detection terminal, wherein the single-eye cover prompt message is used to instruct the user to cover one of the eyes;
[0047] When it is detected that the user has covered one of the eyes, the blocked single eye prompt information displayed on the display area of the detection terminal is deleted.
[0048] In some embodiments, if the detection sight mark is a pattern with a direction, the feedback made by the user to the detection sight mark displayed in the display area of the detection terminal is action pointing feedback;
[0049] Detecting user feedback on a detection visual mark displayed in a display area of the detection terminal and determining feedback information includes:
[0050] The user's action directional feedback on the detection visual mark displayed in the display area of the detection terminal is detected, and directional information obtained by performing action recognition on the action directional feedback is determined as feedback information.
[0051] In some embodiments, determining the user's vision information based on the feedback information includes:
[0052] Matching the directional information with the direction of the detection target;
[0053] If the directional information matches the direction of the detection sight mark, the vision level corresponding to the current display size of the detection sight mark is determined as the user vision information;
[0054] If the pointing information is inconsistent with the direction of the detection target, the vision level of the detection target display size is adjusted, and the user's feedback on the adjusted detection target display size is detected until the pointing information is consistent with the direction of the detection target, and the vision level corresponding to the current detection target display size is determined as the user's vision information.
[0055] In some embodiments, if the detection sight mark is a pattern with character meaning, the feedback made by the user to the detection sight mark displayed in the display area of the detection terminal is voice feedback;
[0056] Detecting user feedback on a detection sight mark displayed in a display area of the detection terminal and determining feedback information includes:
[0057] The user's voice feedback on the detection visual mark displayed in the display area of the detection terminal is detected, and text information obtained by performing voice recognition on the voice feedback is determined as feedback information.
[0058] In some embodiments, determining the user's vision information based on the feedback information includes:
[0059] Matching the text information with the meaning of the characters of the detection sight mark;
[0060] If the text information matches the meaning of the characters in the detection sight mark, the vision level corresponding to the current display size of the detection sight mark is determined as the user's vision information;
[0061] If the text information is inconsistent with the meaning of the characters of the detection sight mark, the vision level of the display size of the detection sight mark is adjusted, and the user's feedback on the adjusted display size of the detection sight mark is detected until the text information is consistent with the meaning of the characters of the detection sight mark, and the vision level corresponding to the current display size of the detection sight mark is determined as the user's vision information.
[0062] In some embodiments, if the pattern of the detection sight mark is a pattern array having similar patterns, the feedback made by the user to the detection sight mark displayed in the display area of the detection terminal is a selection feedback;
[0063] Detecting user feedback on a detection sight mark displayed in a display area of the detection terminal and determining feedback information includes:
[0064] A selection feedback made by a user on a detection visual mark displayed in a display area of the detection terminal is detected, and a result of the selection feedback is determined as feedback information.
[0065] In some embodiments, the pattern array includes: a check pattern and an interference pattern, the check pattern and the interference pattern are similar patterns, and the number of the interference patterns is greater than the number of the check patterns;
[0066] Determining user vision information based on the feedback information includes:
[0067] matching the result of the selection feedback with the position of the verification pattern in the pattern array;
[0068] If the result of the selection feedback matches the position of the verification pattern in the pattern array, the vision level corresponding to the display size of the current detection sight mark is determined as the user's vision information;
[0069] If the result of the selection feedback is inconsistent with the position of the verification pattern in the pattern array, the vision level of the detection target display size is adjusted, and the user's selection feedback on the adjusted detection target display size is detected until the result of the selection feedback is consistent with the position of the verification pattern in the pattern array, and the vision level corresponding to the current detection target display size is determined as the user's vision information.
[0070] In some embodiments, it further includes:
[0071] Recognizing user facial information based on the depth image data;
[0072] If it is determined based on the user's facial information that the user is using the mobile terminal for the first time, registration information is displayed in the display area of the detection terminal, where the registration information is used to instruct the user to register using the mobile terminal;
[0073] In response to receiving the registration data sent by the mobile terminal, the registration information displayed in the display area of the detection terminal is deleted.
[0074] In some embodiments, it further includes:
[0075] Detect user viewing time based on user facial information;
[0076] When the user's viewing time exceeds a time threshold, a vision detection option and an eye protection operation option are displayed in the display area of the detection terminal; the time threshold is determined based on the user's age obtained by recognizing the user's facial information;
[0077] According to the user's selection of the vision detection option or the eye protection operation option, the vision detection or the eye protection operation is performed.
[0078] In some embodiments, when the user selects the eye protection operation option, the eye protection graphic sub-option and the eye protection operation sub-option are displayed in the display area of the detection terminal;
[0079] When the user selects the eye protection graphic sub-option, an eye protection graphic is displayed in the display area of the detection terminal, and the eye protection graphic is used to instruct the user to move their eyes according to the set path;
[0080] When the user selects the eye protection exercise sub-option, an eye protection exercise video is displayed in the display area of the detection terminal, and the eye protection exercise video is used to instruct the user to perform the eye protection exercise according to standard eye protection exercise movements.
[0081] In some embodiments, when performing eye protection exercises, user posture information is obtained;
[0082] identifying an eye protection exercise performed by the user according to the user posture information;
[0083] When the difference between the eye protection exercise performed by the user and the standard eye protection exercise exceeds an error threshold, a reminder message is displayed in the display area of the detection terminal, and the reminder message is used to correct the eye protection exercise.
[0084] According to another aspect of the present disclosure, there is also provided a vision detection device, comprising:
[0085] A user eye position information acquisition module is used to obtain user eye position information;
[0086] A display position and display size determination module, configured to determine the display position and display size of the detection sight mark in the display area of the detection terminal according to the user's eye position information;
[0087] A detection sight mark display module, configured to randomly select a detection sight mark from a vision test chart and display the detection sight mark at a display position in the display area of the detection terminal according to the display size of the detection sight mark;
[0088] The user vision information determination module is used to determine the user vision information in response to the user's feedback on the detection target.
[0089] According to another aspect of the present disclosure, there is also provided a vision detection terminal, comprising: a display screen and a controller;
[0090] The controller is configured to obtain user eye position information, determine a display position and display size of a detection sight mark in a display area of a detection terminal based on the user eye position information, randomly select a detection sight mark from a vision test chart and send it to a display screen, and determine user vision information in response to user feedback on the detection sight mark;
[0091] The display screen is used to display the detection sight mark in the display area of the detection terminal according to the display size of the detection sight mark.
[0092] According to another aspect of the present disclosure, an electronic device is also provided, which includes: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any one of the above-mentioned vision detection methods by executing the executable instructions.
[0093] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, it implements any one of the above-mentioned vision detection methods.
[0094] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, which implements any one of the above-mentioned vision detection methods when executed by a processor.
[0095] The embodiments of the present disclosure provide a vision detection method, device, terminal, storage medium and electronic device, which determine the display position and display size of the detection target in the display area of the detection terminal according to the user's eye position, randomly select the detection target from the detection vision chart and display it according to the above display position and display size, and finally obtain the user's vision information by using the user's feedback on the detection target. The present disclosure determines the display position and display size of the detection target according to the user's eye position information, and can adaptively and dynamically adjust the display position and display size of the detection target according to the user's position information, so that there is no need to limit the detection position of the user when testing vision. The user can stand at will to perform vision testing, which simplifies the vision testing process and improves the accuracy and convenience of vision testing. Compared with the original fixed vision chart method, the method of randomly selecting the detection target for testing will greatly reduce the detection time and speed up the detection speed. Moreover, the method of randomly selecting the detection target makes it impossible for the user to predict the detection target in advance, so the user's vision information obtained is more accurate.
[0096] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0097] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and those skilled in the art can derive other drawings based on these drawings without inventive effort.
[0098] FIG1 is a schematic diagram showing a system structure of a vision detection method according to an embodiment of the present disclosure.
[0099] FIG2 shows a schematic diagram of an application scenario of a vision detection terminal in an embodiment of the present disclosure.
[0100] FIG3 shows a schematic diagram of a vision detection method according to an embodiment of the present disclosure.
[0101] FIG4 is a schematic diagram showing a process of obtaining user eye position information in a vision detection method according to an embodiment of the present disclosure.
[0102] FIG5 is a schematic diagram showing a process of determining the display position and display size of a detection sight mark in a vision detection method according to an embodiment of the present disclosure.
[0103] FIG6 is a schematic diagram showing a visual range of vision detection in a vision detection method according to an embodiment of the present disclosure.
[0104] FIG7 is a schematic diagram showing a specific process of determining the display position and display size of a vision detection method according to an embodiment of the present disclosure.
[0105] FIG8 is a schematic diagram showing the display position and display size of a detection sight mark in a vision detection method according to an embodiment of the present disclosure.
[0106] FIG9 is a schematic diagram showing a specific process of determining the display size of a detection sight mark in a vision detection method according to an embodiment of the present disclosure.
[0107] FIG10 is a schematic diagram showing a process of displaying a detection sight mark in a vision detection method according to an embodiment of the present disclosure.
[0108] FIG11 shows a schematic diagram of a multi-user detection scenario of a vision detection method according to an embodiment of the present disclosure.
[0109] FIG12 shows a schematic diagram of determining user vision information in a vision detection method according to an embodiment of the present disclosure.
[0110] FIG13 shows an E-shaped visual acuity chart and a C-shaped visual acuity chart for a method for visual acuity detection in an embodiment of the present disclosure.
[0111] FIG14 shows a schematic diagram of a first embodiment of a method for vision detection for determining user vision information in an embodiment of the present disclosure.
[0112] FIG15 shows a graphic vision chart, a Chinese character vision chart, and an alphabetic vision chart for a vision detection method in an embodiment of the present disclosure.
[0113] FIG16 shows a schematic diagram of a second embodiment of a method for vision detection for determining user vision information in an embodiment of the present disclosure.
[0114] FIG17 shows an interesting vision chart of a vision testing method in an embodiment of the present disclosure.
[0115] FIG18 shows a schematic diagram of a third embodiment of a method for vision detection for determining user vision information in an embodiment of the present disclosure.
[0116] FIG19 shows a detailed flow chart of vision detection of a vision detection method in an embodiment of the present disclosure.
[0117] FIG20 shows a flow chart of initializing a detection terminal of a vision detection method according to an embodiment of the present disclosure.
[0118] FIG21 shows an eye protection diagram of a vision detection method in an embodiment of the present disclosure.
[0119] FIG22 shows a flowchart of eye protection operations of a vision detection method in an embodiment of the present disclosure.
[0120] FIG23 shows a core flow chart of vision detection of a vision detection method in an embodiment of the present disclosure.
[0121] FIG24 shows a schematic diagram of a vision detection device in an embodiment of the present disclosure.
[0122] FIG25 shows a structural block diagram of a computer device for a vision detection method according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0123] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0124] In addition, the accompanying drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. Identical reference numerals in the figures denote identical or similar parts, and thus repetitive descriptions thereof will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities that do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.
[0125] The specific implementation of the embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.
[0126] FIG1 shows a schematic diagram of a vision detection terminal architecture that can be applied in embodiments of the present disclosure. As shown in FIG1 , the system architecture may include a display screen 101 and a controller 102 .
[0127] The vision detection terminal of the embodiment of the present disclosure can be various electronic devices with display screens, including but not limited to monitors, smart TVs, smart large screens, smart phones, tablet computers, laptop computers, desktop computers, augmented reality devices, virtual reality devices, etc.
[0128] The controller 102 may be a server that provides various services, such as a backend management server that processes user vision information based on user feedback on the sight mark. The backend management server may analyze and process the received request data and feedback the processing results to the display screen 101.
[0129] Alternatively, the server may be an independent physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The vision detection terminal may be a display, a smart TV, a smart screen, a smartphone, a tablet computer, a laptop computer, a desktop computer, an augmented reality device, a virtual reality device, etc., but is not limited thereto.
[0130] Those skilled in the art will appreciate that the number of display screens and controllers in FIG1 is merely illustrative, and any number may be provided based on actual needs, and the present disclosure does not limit this.
[0131] The above-mentioned controller is used to obtain the user's eye position information, determine the display position and display size of the detection mark in the display area of the detection terminal based on the user's eye position information, randomly select the detection mark from the detection vision chart and send it to the display screen, and determine the user's vision information in response to the user's feedback on the detection mark; the above-mentioned display screen is used to display the detection mark in the display area of the detection terminal according to the display size of the detection mark.
[0132] FIG2 shows an application scenario of the vision detection terminal disclosed herein, which mainly uses a large-size display device terminal A1 as the vision detection terminal, for example, a display device of 43 inches to 100 inches. The large-size display device terminal A1 includes the aforementioned controller and display screen, and displays the detection sight mark on the display area of the display screen. A depth camera A2 is configured on the large-size display device terminal A1. The user A3 is in front of the large-size display device terminal A1. The large-size display device terminal A1 is connected to a cloud server A4 via a wired network or a wireless network. The cloud server A4 is used to store user vision information and perform user registration. The mobile terminal A5 is in communication with the cloud server A4 for user registration. In addition, a remote control may also be included. The remote control is in communication with the large-size display device terminal A1, for example, by an infrared connection or a Bluetooth connection.
[0133] Under the above system architecture, an embodiment of the present disclosure provides a vision detection method, which can be executed by any electronic device with computing and processing capabilities.
[0134] In some embodiments, the vision detection method provided in the embodiments of the present disclosure can be executed by the vision detection terminal of the above system architecture.
[0135] FIG3 shows a schematic diagram of a vision detection method according to an embodiment of the present disclosure. As shown in FIG3 , the vision detection method provided in the embodiment of the present disclosure includes the following steps:
[0136] Step S302: Obtaining user eye position information;
[0137] Step S304: determining the display position and display size of the detection sight mark in the display area of the detection terminal according to the user's eye position information;
[0138] Step S306: randomly selecting a test sight mark from the test vision chart, and displaying the test sight mark at a display position in the display area of the test terminal according to the display size of the test sight mark;
[0139] Step S308: Determine the user's vision information in response to the user's feedback on the detection target.
[0140] This embodiment determines the display position and size of the detection sight mark based on the user's eye position information. It can adaptively and dynamically adjust the display position and size of the detection sight mark based on the user's position information, thereby eliminating the need to restrict the user's position during vision testing. The user can perform vision testing while standing freely, simplifying the vision testing process and improving the accuracy and convenience of vision testing. Since the detection sight mark is randomly selected from the vision chart for display, the user's vision information can be determined based on the user's feedback based on the detection sight mark. The random display of the detection sight mark replaces the fixed vision chart method in the prior art. The user cannot predict the detection sight mark by memorizing it in advance. Therefore, the user's vision information obtained is more realistic, which can greatly reduce the testing time, speed up the testing speed, and obtain more accurate user vision information.
[0141] As shown in FIG4 , in the embodiment, the step S302 of obtaining the user's eye position information includes:
[0142] Step S402: Acquire depth image data of the user distance detection terminal;
[0143] Step S404: identifying the user's eyes and determining the position information of the user's eyes according to the depth image data of the user distance detection terminal.
[0144] The depth data of the user's distance from the detection terminal can be obtained through the aforementioned depth camera. The depth camera can be set above the detection terminal and in the same plane as the display area of the detection terminal, so as to ensure that the distance between the user and the display area is the same as the distance between the user and the depth camera. The depth camera can not only obtain image data, but also obtain depth data, that is, the distance between the user and the detection terminal and the left and right positions of the user. The above image data and the distance between the user and the detection terminal and the left and right positions of the user together constitute the depth image data. Furthermore, based on the image data in the above depth data, the user's eyes are identified, and then the user's eye position information is obtained in combination with the distance between the user and the detection terminal and the left and right positions of the user. The eye position information may include the horizontal position, longitudinal position and vertical position in three-dimensional space. When determining the user's eye position information, the eye recognition algorithm SDK (Software Development Kit) can be used for calculation.
[0145] As shown in FIG5 , in the embodiment, the above step S304 determines the display position and display size of the detection sight mark in the display area of the detection terminal according to the user's eye position information, including:
[0146] Step S502: Determine whether the user's eyes are within a visible range based on the user's eye position information; the visible range is a space formed by a set length range, width range, and height range in a three-dimensional coordinate system established by the detection terminal in the three-dimensional space;
[0147] Step S504: when the user's eyes are within the visual range, determining the three-dimensional space point of the user's eyes in the three-dimensional coordinate system;
[0148] Step S506: Determine the display position and display size of the detection target in the display area of the detection terminal according to the three-dimensional space point of the human eye.
[0149] A three-dimensional coordinate system is established in three-dimensional space based on the detection terminal. The three-dimensional coordinate system includes a horizontal axis, a vertical axis, and a vertical axis. The horizontal axis corresponds to the horizontal coordinate, the vertical axis corresponds to the vertical coordinate, and the vertical axis corresponds to the vertical coordinate. When performing a vision test, the user needs to be in front of the detection terminal, that is, the depth camera needs to be able to detect and the user needs to be able to see the detection target in the display area, so a visual range needs to be determined. As shown in the schematic diagram of the visual range of vision detection shown in Figure 6, there are three criteria for judging the visual range: length range, width range, and height range.
[0150] The length range corresponds to the horizontal axis of the three-dimensional coordinate system, which can be the left-right distance w between the user's eyes and the detection terminal. The value range of w is w1 < w < w2. Taking a rectangular detection terminal as an example, for the width w' of the detection terminal, the value of w1 is w1 > -w' / 2; the value of w2 is w2 < w' / 2. Here, the center point perpendicular to the ground is taken as the zero point of the horizontal axis. Assuming w1 >= -1 m and w2 <= 1 m, then the length range in the horizontal axis direction is the range between -1 m and 1 m; the data ranges of -1 m and 1 m can be determined according to the size of the large-size screen. The larger the screen, the wider the width and the wider the radiation range of w.
[0151] The width range corresponds to the vertical axis of the three-dimensional coordinate system, which can be the up-down distance h between the user's eyes and the detection terminal. The value range of h is h1 < h < h2. Taking a rectangular detection terminal as an example, for the height h' of the detection terminal, the value of h1 is h1 > -h' / 2; the value of h2 is h2 < h' / 2. Here, the center point of the detection terminal's height is taken as the zero point of the vertical axis. Assuming h1 >= -1 m and h2 <= 1 m, then the width range in the vertical axis direction is the range between -1 m and 1 m; the data ranges of -1 m and 1 m can be determined according to the size of the large-size screen. The larger the screen, the longer the length and the wider the radiation range of h. Additionally, the value of h can also be determined according to the height of the detection terminal from the ground. For example, it can be assumed that h1 >= 0.5 m and h2 <= 2 m; the data of 2 m and 0.5 m can be dynamically adjusted according to the height of the large-size terminal device from the ground. The user can stand or sit, and the detection can be carried out normally without affecting the detection effect.
[0152] The height range corresponds to the vertical axis of the three-dimensional coordinate system, which can be the front-back distance d between the user's eyes and the detection terminal. The value range of d is d1 < d < d2. Taking a rectangular detection terminal as an example, with the plane where the display area of the detection terminal is located as the zero point, the value range of d is related to the recognition degree of the depth camera, so the value range of d can be dynamically adjusted. For example, it can be assumed that d1 >= 0.5 m and d2 <= 5 m, and the data of 0.5 and 5 m are determined according to the recognition degree of the large-size camera.
[0153] After constructing the visible range through the three-dimensional coordinate system, it is possible to determine whether the user's eyes are within the visible range based on the user's eye position information. In Figure 6, the smiley face icon represents the user's eye position. When it is determined that the user's eyes are within the visible range, for example, the positions of the three bold smiley face icons are within the visible range, combined with the user's eye position information, the user's eye position information can be determined as the three-dimensional space point of the eye in the three-dimensional coordinate system. In this embodiment, the user's eyes are merged into one point, so that it can be visualized as a three-dimensional space point of the eye in the three-dimensional coordinate system established above, so that the display position and display size of the detection visual mark can be calculated with greater accuracy. Within the visible range, the user can move dynamically, and can move arbitrarily within the visible range, and can also perform real-time human eye vision detection during activities. When it is detected that the eye position meets the conditions, the vision detection is started.
[0154] Furthermore, when the user's eyes are not within the visual range, guidance information is displayed on the detection terminal display area, and the guidance information is used to instruct the user to move within the visual range; the user's eye position is detected in real time until the user's eyes are within the visual range, and the guidance information displayed on the detection terminal display area is deleted. As shown in Figure 7, the non-bold smiley face icon indicates that the user's eyes are not within the visual range, such as when they are too high, too low, too close, too far, too left, or too right. Guidance information is displayed on the detection terminal display area. For example, when they are too right, the guidance information displayed on the detection terminal display area is used to instruct the user to move to the left. When the user moves, the user's eye position is detected in real time until the user's eyes are within the visual range, and the guidance information displayed on the detection terminal display area is deleted. For other situations where the eyes are too high, too low, too close, too far, or too left, similar guidance methods are used with reference to the situation where the eyes are too right, and no further description is given here.
[0155] As shown in FIG7 , in the embodiment, the above step S506 of determining the display position and display size of the detection target in the display area of the detection terminal according to the three-dimensional space point of the human eye includes:
[0156] Step S702: Obtain the horizontal coordinate, vertical coordinate, and vertical coordinate of the three-dimensional space point of the human eye;
[0157] Step S704: determining a projected abscissa and a projected ordinate according to the orthographic projection of the abscissa and ordinate of the three-dimensional space point of the human eye on the display area of the detection terminal;
[0158] Step S706: Determine the point formed by the projected horizontal coordinate and the projected vertical coordinate in the display area of the detection terminal as the display position of the detection target in the display area of the detection terminal, and the display position of the detection target in the display area of the detection terminal moves with the movement of the three-dimensional space point of the human eye;
[0159] Step S708: determining a vertical distance between the three-dimensional space point of the human eye and the display area of the detection terminal according to the vertical coordinate of the three-dimensional space point of the human eye;
[0160] Step S7010: Determine the display size of the detection sight mark according to the vertical distance.
[0161] As shown in the schematic diagram of the display position and display size of the detection sight mark shown in Figure 8, based on the position of the three-dimensional space point of the human eye in the three-dimensional coordinate system, the horizontal coordinate, vertical coordinate and vertical coordinate (x, y, z) of the three-dimensional space point of the human eye are obtained. Next, based on the orthographic projection of the horizontal coordinate and vertical coordinate of the three-dimensional space point of the human eye on the display area of the detection terminal, the projected horizontal coordinate and the projected vertical coordinate can be obtained. The projected horizontal coordinate and the projected vertical coordinate form a position point in the display area of the detection terminal, and this position point can be used as the display position of the detection sight mark in the display area of the detection terminal; the position of the detection sight mark in the detection terminal is determined by the horizontal coordinate and vertical coordinate of the three-dimensional space point of the human eye. When the human eye moves, since the horizontal coordinate and vertical coordinate of the three-dimensional space point of the human eye are orthographically projected onto the display area of the detection terminal, the detection sight mark will move with the movement of the human eye, thereby ensuring the accuracy of vision detection. Next, the vertical distance between the 3D space point and the detection terminal's display area is determined based on the vertical coordinate of the 3D space point. Based on the previously established 3D coordinate system, the zero point of the vertical coordinate lies on the plane of the detection terminal's display area. Therefore, the distance between the vertical coordinate and the zero point is the vertical distance between the 3D space point and the detection terminal's display area. Finally, the display size of the detection target can be determined based on the vertical distance between the 3D space point and the detection terminal's display area.
[0162] As shown in FIG9 , in the embodiment, the above step S7010 of determining the display size of the detection sight mark according to the vertical distance includes:
[0163] Step S902: Obtaining a standard detection distance of a standard vision chart;
[0164] Step S904: determining a distance ratio according to the vertical distance and the standard detection distance;
[0165] Step S906: Determine the current detection sight mark display size based on the distance ratio, the last user vision information and the actual position offset of the human eye. The actual position offset of the human eye is determined by the center point of the intersection of the three-dimensional space point of the human eye and the diagonal of the display area of the detection terminal. The detection sight mark display size includes multiple vision levels.
[0166] In the embodiment, the standard vision chart is usually required to perform vision testing at a standard detection distance, so that the vision information obtained is accurate. For example, the standard detection distance of a common standard vision chart is five meters. The standard vision chart can have multiple vision levels, for example, it can include: 5.2, 5.1, 5.0, 4.9, 4.8, 4.7, 4.6, 4.5, 4.4, 4.3, 4.2, 4.1 and 4.0 multiple vision levels, or another vision level can be used, which can include: 1.5, 1.2, 1.0, 0.8, 0.6, 0.5, 0.4, 0.3, 0.25, 0.2, 0.15, 0.12 and 0.1 multiple vision levels. According to the vertical distance between the three-dimensional space point of the human eye and the display area of the detection terminal obtained above and the standard detection distance, the distance ratio is calculated; next, the actual position offset of the human eye needs to be calculated, as shown in Figure 7, and the actual position offset of the human eye is determined by the center point where the three-dimensional space point of the human eye intersects the diagonal of the display area of the detection terminal. Next, the user's previous vision information is obtained. If this is the first instance test, the previous user's vision information can be the average of the vision information of other users. Finally, the display size of the current test target is calculated based on the distance ratio obtained above, the previous user's vision information, and the actual eye position offset.
[0167] In one example, the vision level M can be set from 1 to 14, representing a total of 14 levels. The range of M represents the 14 rows of data on a standard eye chart; 14 represents the smallest level, the last row, and 14 represents the largest level, the first row. The user's last vision information, M1, was one of the 14 levels. The standard distance, D, is 5 meters. a is the actual eye position offset, a parameter used for fine-tuning the upper and lower limits of the three-dimensional spatial point and vision test results, and is initially a fixed value. This parameter requires accurate measurement by multiple individuals. The current test target display size, M2, is calculated as M1 + a × (D / d), with M2 rounded off. For example, if M1 = 1, d = 2 meters, D = 5 meters, and a = 0.5, then M2 = 1 + 0.5 × (5 / 2) = 2.25. After rounding, M2 = 2, indicating that the current test target display size is the second vision level.
[0168] As shown in FIG10 , in the embodiment, the step S306 of randomly selecting a test sight mark from the test vision chart and displaying the test sight mark at a display position in the display area of the test terminal according to the display size of the test sight mark includes:
[0169] Step S1002: Displaying multiple patterns of the vision test chart on the display area of the test terminal;
[0170] Step S1004: determining the pattern of the detection target according to the pattern selected by the user;
[0171] Step S1006: randomly selecting a detection sight mark from the detection vision chart corresponding to the pattern style selected by the user, and displaying the pattern of the detection sight mark at a display position in the display area of the detection terminal according to the display size of the detection sight mark.
[0172] The eye test chart has a variety of pattern styles, and users can choose different eye test chart pattern styles. Different eye test chart pattern styles correspond to different test difficulty levels. First, a variety of pattern styles of the eye test chart are displayed on the display area of the detection terminal for users to view and select. According to the pattern style selected by the user, the style of the detection sight mark is determined. Next, the detection sight mark is randomly selected from the eye test chart corresponding to the pattern style selected by the user, and the style of the detection sight mark is displayed at the display position of the detection terminal display area according to the display size of the detection sight mark. When the user selects a certain pattern style, the complete vision pattern of the style will be previewed, and the preview time is t seconds. The time t can be changed through the eye test chart setting item, for example, it can be set to t = 5 seconds.
[0173] The existing vision test only supports single-person testing, which results in low testing efficiency. To solve the above problem, when there are multiple users, the display position and display size of the test sight mark in the display area of the test terminal are determined, including:
[0174] According to the eye position information of each user among the multiple users, the display position and display size of the detection sight mark corresponding to each user in the display area of the monitoring terminal are determined, and the detection sight mark corresponds to the user's eyes one by one.
[0175] As shown in the schematic diagram of the multi-user detection scenario in Figure 11, compared with the single-person detection scenario shown in Figure 8, when there are multiple users to be detected, it is necessary to display a detection sight mark corresponding to each user in the display area of the monitoring terminal. For example, when there are three users, the three users are located at position 1, position 2 and position 3 respectively, then position 1 has detection sight mark 1 in the display area of the monitoring terminal, position 2 has detection sight mark 2 in the display area of the monitoring terminal, and position 3 has detection sight mark 3 in the display area of the monitoring terminal. According to the eye position information of each user, the display position and display size of the detection sight mark corresponding to each user in the display area of the monitoring terminal are determined, thereby realizing a one-to-one correspondence between the detection sight mark and the user's eyes.
[0176] The present invention can carry out simultaneous testing for multiple people. When users stand in different positions, the testing sight mark can be displayed for each user, realizing simultaneous testing for multiple people. The user's vision information can be recorded in batches, and the user's vision can be tested in batches efficiently, in real time and accurately.
[0177] For example, when schools or testing institutions regularly conduct large-scale vision tests, this device can save on human labor, allowing users to automatically complete the test without the need for additional assistance. The test is fast and accurate, requiring only a few seconds for the user to stand in front of the large screen. For simultaneous testing of multiple people, users can simply stand in different positions. Multiple people can simultaneously test, and their vision information can be recorded in batches, providing efficient, real-time, and accurate data.
[0178] In this embodiment, when performing a vision test, the original screen backlight intensity set by the user may not meet the requirements of the eye chart test. To address this issue, it is necessary to obtain the ambient light brightness when displaying the test target; based on the ambient light brightness, the backlight intensity of the display area of the test terminal is adjusted. By obtaining the ambient light brightness, the backlight intensity is dynamically adjusted to meet the user's normal vision test conditions.
[0179] As shown in FIG12 , in the embodiment, the above step S308 of determining the user's vision information in response to the user's feedback on the detection sight mark includes:
[0180] Step S1202: Displaying a detection mode on the display area of the detection terminal, wherein the detection mode includes: monocular detection and binocular detection;
[0181] Step S1204: In response to the user selecting the detection mode, detecting the user's feedback on the detection sight mark displayed in the display area of the detection terminal, and determining feedback information;
[0182] Step S1206: Determine the user's vision information based on the feedback information.
[0183] Detection modes usually include monocular detection and binocular detection. Monocular detection, also known as left and right eye detection, is to detect the left eye or right eye separately. For example, when detecting the left eye, you need to cover the right eye with your hand or a baffle. There is no need to press the eyeball hard or close your eyes forcefully. Feedback is given by observing the detection mark with your left eye. After the left eye detection is completed, it is replaced with right eye detection. Cover the left eye with your hand or a baffle, and give feedback by observing the detection mark with your right eye. Binocular detection, also known as full eye detection, is to give feedback by looking at the detection mark with both eyes. First, the detection mode needs to be displayed on the display area of the detection terminal for the user to select. After the user selects the detection mode, in response to the user selecting the detection mode, the user's feedback on the detection mark displayed in the display area of the detection terminal is detected to determine the feedback information. Finally, the user's vision information is determined based on the feedback information.
[0184] In an embodiment, if the detection mode is monocular detection, after responding to the user selecting the detection mode, the method further includes:
[0185] Displaying a single-eye cover prompt message on the display area of the detection terminal, wherein the single-eye cover prompt message is used to instruct the user to cover one of the eyes;
[0186] When it is detected that the user has covered one of the eyes, the blocked single eye prompt information displayed on the display area of the detection terminal is deleted.
[0187] When the user selects monocular detection as the detection mode, a monocular occlusion prompt is displayed on the detection terminal display area, prompting the user to cover one eye. For example, text reminders may be displayed, or instructions may be provided in the form of images or videos. Depth image data is obtained through the depth camera for facial recognition to determine whether the user has covered one eye. If it is detected that the user has covered one eye, the monocular occlusion prompt displayed on the detection terminal display area is deleted.
[0188] When the detection mode selected by the user is binocular detection, after responding to the user selecting the detection mode, it also includes: detecting whether the user covers his eyes; if the user covers any one eye or both eyes, displaying a removal of occlusion prompt information on the display area of the detection terminal; the removal of occlusion prompt information is used to instruct the user to remove the occlusion of the eyes; when it is detected that both eyes of the user are unobstructed, the above-mentioned removal of occlusion prompt information is deleted.
[0189] In an embodiment, if the detection sight mark is a pattern with a direction, the feedback made by the user to the detection sight mark displayed in the display area of the detection terminal is action direction feedback;
[0190] Detecting user feedback on a detection sight mark displayed in a display area of the detection terminal and determining feedback information includes:
[0191] The user's action directional feedback on the detection visual mark displayed in the display area of the detection terminal is detected, and directional information obtained by performing action recognition on the action directional feedback is determined as feedback information.
[0192] As shown in Figure 13, the E-shaped and C-shaped eye charts both contain directional patterns. The E-shaped eye chart has only four opening directions: up, down, left, and right. It is widely applicable and can generally be used to test students' vision. The C-shaped eye chart has eight opening directions that are more difficult to identify, including up, down, left, right, upper right, lower right, upper left, and lower left. It is often used in pilot selection. The user needs to make a corresponding gesture to point to the opening direction of the detection symbol. To do this, a depth camera is used to capture depth image data. When the detection symbol is displayed in the display area of the test terminal, the user's gesture feedback on the displayed detection symbol is collected, and motion recognition is performed on this gesture feedback to obtain directional information, which is used as feedback information. For example, when the "E" detection symbol on the first row of the E-shaped eye chart is displayed, the "E" detection symbol is facing right. Therefore, the correct direction should be to the right. This can be done by pointing a finger to the right or by pointing an arm to the right. When the first "C" test sight mark on the first line of the C-shaped eye chart is displayed, the direction of the "C" test sight mark is to the upper right, so the correct direction should be to the upper right. You can point your finger to the upper right, or you can point your arm to the upper right.
[0193] As shown in FIG14 , in the first embodiment of determining the user's vision information, in the embodiment, the above step S1206 of determining the user's vision information according to the feedback information includes:
[0194] Step S1402: matching the directional information with the direction of the detected sight mark;
[0195] Step S1404: If the directional information matches the direction of the detection target, the vision level corresponding to the current display size of the detection target is determined as the user vision information;
[0196] Step S1406: If the pointing information does not match the direction of the detection target, the vision level of the detection target display size is adjusted, and the user's feedback on the adjusted detection target display size is detected until the pointing information is consistent with the direction of the detection target, and the vision level corresponding to the current detection target display size is determined as the user's vision information.
[0197] First, it is necessary to match the pointing information with the direction of the detection sight mark; if the pointing information is consistent with the direction of the detection sight mark, then it means that the user has correctly identified the target, and the vision level corresponding to the current detection sight mark display size is determined as the user's vision information. If the pointing information is inconsistent with the direction of the detection sight mark, then it means that the user has made an error in identification, that is, the user is seeing a blurry image of the current sight mark, then it is necessary to adjust the vision level of the detection sight mark display size, generally by increasing the vision level, and further detecting the user's recognition of the increased vision level, and detecting the user's feedback on the adjusted detection sight mark display size in real time until the pointing information is consistent with the direction of the detection sight mark. At this time, the user has correctly identified the target, and the vision level corresponding to the current detection sight mark display size is determined as the user's vision information.
[0198] In an embodiment, if the detection sight mark is a pattern with character meaning, the feedback made by the user to the detection sight mark displayed in the display area of the detection terminal is voice feedback;
[0199] Detecting user feedback on a detection sight mark displayed in a display area of the detection terminal and determining feedback information includes:
[0200] The user's voice feedback on the detection visual mark displayed in the display area of the detection terminal is detected, and text information obtained by performing voice recognition on the voice feedback is determined as feedback information.
[0201] As shown in Figure 15 , the graphic eye chart, Chinese character eye chart, and alphabet eye chart contain test sight signs with symbolic meanings. The graphic eye chart includes a variety of images, such as an apple, a flower, a duck, an umbrella, a cup, an apple, scissors, and a fish, and is often used by young children with limited Chinese character knowledge. The Chinese character eye chart includes multiple Chinese characters. The alphabet eye chart includes multiple letters. The user is required to speak the specific meaning of the test sight sign. The depth camera also has a recording function to capture the user's voice. The user's voice feedback on the test sight sign displayed in the display area of the test terminal is voice-recognized to obtain text information, which is then determined as feedback information. For example, when the character "apple" in the first row of the graphic eye chart is displayed, if the text information obtained through voice recognition of the user's voice feedback includes "apple", then the user's recognition is correct. When the character "cow" in the first row of the Chinese character eye chart is displayed, if the text information obtained through voice recognition of the user's voice feedback includes "cow", then the user's recognition is correct. When the character "A" in the first row of the graphic eye chart is displayed, if the text information obtained by performing voice recognition on the user's voice feedback includes "A", it means that the user's recognition is correct.
[0202] As shown in FIG16 , in the second embodiment of determining the user's vision information, in the embodiment, the above step S1206 of determining the user's vision information based on the feedback information includes:
[0203] Step S1602: matching the text information with the meaning of the characters of the detection sight mark;
[0204] Step S1604: If the text information matches the meaning of the characters in the detection optotype, the vision level corresponding to the current display size of the detection optotype is determined as the user's vision information;
[0205] Step S1606: If the text information does not match the meaning of the characters in the detection sight mark, the vision level of the detection sight mark display size is adjusted, and the user's feedback on the adjusted detection sight mark display size is detected until the text information matches the meaning of the characters in the detection sight mark, and the vision level corresponding to the current detection sight mark display size is determined as the user's vision information.
[0206] First, it is necessary to match the text information with the character meaning of the detection sight mark. The matching method can be calculated using the text similarity method. If the text similarity reaches the set similarity threshold, it means that the text information matches the character meaning of the detection sight mark, indicating that the user's recognition is correct, and the vision level corresponding to the current detection sight mark display size is determined as the user's vision. If the text information does not match the character meaning of the detection sight mark, that is, the text similarity does not reach the set similarity threshold, it indicates that the user has made an error in recognition, that is, the user is blurry when looking at the current sight mark, then it is necessary to adjust the vision level of the detection sight mark display size. Generally, the vision level can be increased, and the user's recognition of the increased vision level is further detected. The user's feedback on the adjusted detection sight mark display size is detected in real time until the text information is consistent with the character meaning of the detection sight mark. At this time, the user's recognition is correct, and the vision level corresponding to the current detection sight mark display size is determined as the user's vision information.
[0207] In an embodiment, if the pattern of the detection sight mark is a pattern array having similar patterns, the feedback made by the user to the detection sight mark displayed in the display area of the detection terminal is selection feedback;
[0208] Detecting user feedback on a detection sight mark displayed in a display area of the detection terminal and determining feedback information includes:
[0209] A selection feedback made by a user on a detection visual mark displayed in a display area of the detection terminal is detected, and a result of the selection feedback is determined as feedback information.
[0210] The interesting eye chart shown in Fig. 17 includes a pattern array with similar patterns, for example, finding "yi" in a pattern array composed of a group of "ji". The above is one way, mainly using methods such as quickly finding differences, finding Chinese characters, and finding lazy students during exercise, to find graphics within a set time, and is mostly used in interesting games and can be operated by multiple people simultaneously. At this time, a remote control is needed, and the user controls the remote control to find "yi" from the pattern array.
[0211] The third embodiment of determining user vision information shown in Fig. 18. In this embodiment, the pattern array includes: verification patterns and interference patterns. The verification patterns and the interference patterns are similar patterns, and the number of interference patterns is greater than the number of verification patterns.
[0212] Determining the user vision information according to the feedback information in the above step S1206 includes:
[0213] Step S1802: Match the result of the selection feedback with the position of the verification pattern in the pattern array;
[0214] Step S1804: If the result of the selection feedback matches the position of the verification pattern in the pattern array, determine the vision level corresponding to the current detected visual target display size as the user vision information;
[0215] Step S1806: If the result of the selection feedback does not match the position of the verification pattern in the pattern array, adjust the vision level of the detected visual target display size, detect the selection feedback made by the user for the adjusted detected visual target display size, until the result of the selection feedback is consistent with the position of the verification pattern in the pattern array, and determine the vision level corresponding to the current detected visual target display size as the user vision information.
[0216] In the interesting eye chart shown in Fig. 17, the verification pattern is "yi", and the interference pattern is "ji". "yi" and "ji" are similar patterns, and the number of "ji" is greater than the number of "yi". First, the result of the selection feedback needs to be matched with the position of the verification pattern in the pattern array.
[0217] If the result of the selection feedback matches the position of the verification pattern in the pattern array, indicating that the user has correctly recognized, then determine the vision level corresponding to the current detected visual target display size as the user vision information;
[0218] If the result of the selection feedback is inconsistent with the position of the verification pattern in the pattern array, it indicates that the user has made an error in recognition, that is, the user is seeing a blurry image of the current sight mark. In this case, it is necessary to adjust the vision level of the detection sight mark display size. Generally, the vision level can be increased, and the user's recognition of the increased vision level is further tested. For the adjusted vision level of the detection sight mark display size, the user's selection feedback on the adjusted detection sight mark display size is tested until the result of the selection feedback is consistent with the position of the verification pattern in the pattern array. At this time, the user's recognition is correct, and the vision level corresponding to the current detection sight mark display size is determined as the user's vision information. The above-mentioned increase in the vision level can be to enlarge the pattern array with similar patterns as a whole, or to enlarge the verification pattern alone.
[0219] The vision detection method provided by the embodiment of the present disclosure is, first of all, simpler and more intelligent in detecting distance than the existing vision chart detection scheme. At the same time, it uses random sight marks for detection instead of the original fixed vision chart detection method, which will greatly reduce the detection time and speed up the detection speed. It does not depend on the user's standing position. As long as the user is within the visual range in front of the detection terminal, it can be automatically detected. The detection terminal will intelligently detect the user's distance and make a comprehensive assessment and judgment based on the user's distance, the screen distance and the vision chart detection standard. For example, if the user is very close to the screen, a relatively small sight mark will be automatically played first for the user to identify. If the user cannot see clearly, the system will continue to randomly play a larger sight mark for identification until the user's vision condition is detected. On the contrary, if the user is far away from the screen, a relatively large sight mark will be played for identification. If the user can see clearly, the system will continue to automatically and randomly play a smaller sight mark for detection until the detection result is obtained. Furthermore, based on the user's location and the optotype style selected by the user, a random optotype symbol close to the user's vision condition will be popped up as a reference character for detection. If the user recognizes it, the recognition difficulty will be increased and different optotype symbols will be popped up in sequence. If the user cannot recognize it, the difficulty of the optotype recognition will be reduced and detection will be performed in sequence until the user confirms the recognition of the optotype three times. As shown in the detailed flow chart of vision detection in Figure 19:
[0220] 1901, obtaining depth image data through a depth camera;
[0221] 1902, obtain the last user vision information;
[0222] 1903, determining the user's eye position information based on the depth image data;
[0223] 1904, determining the display size and position of the current detection sight mark based on the user's eye position information, the previous user's vision information, and the actual eye position offset;
[0224] 1905, randomly select test sight marks from the test vision chart and display them in different opening directions;
[0225] 1906, the user selects the detection mode for monocular detection or binocular detection, and monocular detection is selected by default;
[0226] 1907, reminding users to cover one eye with one hand;
[0227] 1908, determine whether the user covers one eye. If it is detected that the user has covered one eye, jump to 1909; if it is not detected that the user has covered one eye, return to 1907;
[0228] 1909, displaying the randomly selected test sight mark according to the display size and display position;
[0229] 1910, determining whether the user recognizes the detection sight mark. If the detection sight mark is recognized, jump to 1913; if not, jump to 1911;
[0230] 1911, if the sight mark is not recognized within the specified time, jump to 1912;
[0231] 1912, increase the vision level by one and jump to 1909;
[0232] 1913, within the specified time, the user raises his hand and waves to indicate the up, down, left, and right directions of the opening (taking the detection sight mark as a directional pattern as an example);
[0233] In 1914, the sight signs with different openings were played three times in a row at the same gear and all of them could be recognized normally;
[0234] 1915. Record the test result of the user and save it as the user's vision information.
[0235] As shown in FIG20 , before using the disclosed embodiment to perform vision testing, the testing terminal needs to be initialized. The main steps include:
[0236] Recognizing user facial information based on the depth image data;
[0237] If it is determined based on the user's facial information that the user is using the mobile terminal for the first time, registration information is displayed in the display area of the detection terminal, where the registration information is used to instruct the user to register using the mobile terminal;
[0238] In response to receiving the registration data sent by the mobile terminal, the registration information displayed in the display area of the detection terminal is deleted.
[0239] The main process of initializing the detection terminal includes:
[0240] 2001, start the depth camera and collect depth image data;
[0241] 2002, identifying user face information based on the depth image data;
[0242] 2003, the user is in front of the detection terminal;
[0243] 2004, determine whether a face is detected; if a face is detected, jump to 2005, if not, jump to 2011;
[0244] 2005, Searching Face Database;
[0245] 2006, using the face database to compare and determine whether the user is a first-time user. If the user's face information determines that the user is a first-time user, jump to 2007; if the user is not a first-time user, jump to 2010 to perform vision testing;
[0246] 2007, the registration information is displayed in the display area of the detection terminal;
[0247] In 2008, users registered using their mobile terminals according to their registration information;
[0248] 2009, the mobile terminal fills in relevant user information;
[0249] In 2010, vision testing was started;
[0250] 2011, ended vision testing.
[0251] When a user first uses a large-format terminal device, that is, when the user stands in front of the large-format terminal device, the camera recognizes the user's face through facial detection and then accesses a local or server-side facial database to determine whether this is the user's first login. Upon first login, the terminal device will display a QR code, allowing the user to scan it using a mobile device such as a smartphone or tablet to register their user information. The user must enter relevant information such as their name, gender, age, occupation, left and right eye vision, and the preset automatic eye chart inspection time. This information is saved to a local or cloud database. First-time users must undergo a vision test. After registering and logging in by scanning the QR code, a vision test will automatically begin, requiring the user to test both eyes. The test results are then recorded, along with the test time and vision details. If the user is already logged in, when the camera detects the face, it will intelligently recommend starting a vision test based on the user's previously tested vision time.
[0252] The vision test process can be manually initiated. When the user stands in front of the test terminal, they click the vision test application icon to enter the vision chart test app, and the user actively performs a vision test. The vision test process can also be automatically initiated. For example, when the user uses the device for the first time, the vision chart test app will automatically start and require the user to complete the first vision test. When the user uses the device subsequently, according to the preset time value in the user's system settings, the vision test app will automatically pop up after the time reaches the time value, reminding the user to perform a vision test.
[0253] The disclosed embodiment also has an eye protection function. In a home use scenario, if the user watches for too long, especially children or teenagers, it is necessary to perform intelligent detection and reminders, and recommend various eye protection graphics or eye protection exercises to the user. In the embodiment, the vision detection method also includes:
[0254] Detect user viewing time based on user facial information;
[0255] When the user's viewing time exceeds a time threshold, a vision detection option and an eye protection operation option are displayed in the display area of the detection terminal; the time threshold is determined based on the user's age obtained by recognizing the user's facial information;
[0256] According to the user's selection of the vision detection option or the eye protection operation option, the vision detection or the eye protection operation is performed.
[0257] The depth camera is used to collect depth image data, and facial information is identified from the depth image data. Corresponding to different facial information, the viewing time of the user corresponding to each facial information is counted separately. Furthermore, a time threshold can be set according to the facial information. For example, the viewing time threshold for users under the age of 12 is 45 minutes, and the viewing time threshold for users aged 12-18 is 60 minutes. When the user's viewing time exceeds the time threshold and reaches the viewing time, the user will be reminded that the viewing time is too long, and eye protection operation is recommended or required. The vision detection option and eye protection operation option are displayed in the display area of the detection terminal; when the user selects the vision detection option, the above-mentioned vision detection process 1901-1915 is executed. When the user selects the eye protection operation option, the eye protection operation is performed. For child users (under 12 years old), it is necessary to force the eye protection operation, and for recognized users, a vision detection option or eye protection operation option is provided.
[0258] As shown in the eye protection graphic diagram of FIG21 , in the embodiment, when the user selects the eye protection operation option, the eye protection graphic sub-option and the eye protection operation sub-option are displayed in the display area of the detection terminal;
[0259] When the user selects the eye protection graphic sub-option, an eye protection graphic is displayed in the display area of the detection terminal, and the eye protection graphic is used to instruct the user to move their eyes according to the set path;
[0260] When the user selects the eye protection exercise sub-option, an eye protection exercise video is displayed in the display area of the detection terminal, and the eye protection exercise video is used to instruct the user to perform the eye protection exercise according to standard eye protection exercise movements.
[0261] The eye protection operation option has two sub-options: the eye protection graphic sub-option and the eye protection operation sub-option, which are displayed in the detection terminal display area;
[0262] When the user selects the eye protection graphic sub-option, the eye protection graphic shown in Figure 22 is displayed in the display area of the detection terminal. The eye protection graphic on the left is used to instruct the user to move the eyes according to the set path; for example, when exercising the eye muscles, follow the circles and arrows to exercise the eye muscles, while the farsightedness pattern on the right requires the user to diverge the focus of the eyes to achieve the purpose of relaxing the eye muscles.
[0263] When the user selects the eye protection exercise sub-option, an eye protection exercise video is displayed in the display area of the detection terminal. The eye protection exercise video is used to instruct the user to perform the eye protection exercise movements according to standard eye protection exercise movements.
[0264] In the embodiment, in order to ensure that the user can perform the eye protection exercise in a standard manner, the user's action standardization is detected, and the user's posture information is obtained when performing the eye protection exercise;
[0265] identifying an eye protection exercise performed by the user according to the user posture information;
[0266] When the difference between the eye protection exercise performed by the user and the standard eye protection exercise exceeds an error threshold, a reminder message is displayed in the display area of the detection terminal, and the reminder message is used to correct the eye protection exercise.
[0267] A depth camera is used to obtain depth image data, analyze the depth image data, obtain user posture information, identify the user posture information, and obtain the eye protection exercise performed by the user. When the difference between the eye protection exercise performed by the user and the standard eye protection exercise exceeds the error threshold, a reminder message is displayed in the display area of the detection terminal to remind the user to perform the eye protection exercise according to the standard eye protection exercise and correct the wrong eye protection exercise. Since there are many types of eye protection exercises, users can choose an eye protection exercise by themselves, or they can recommend an eye protection exercise to protect their eyes based on the user's current vision. At the same time, the user's action standardization can be detected in real time by the camera, and the existing human posture detection algorithm is used to standardize the user's eye protection action in combination with the action time of the eye protection exercise.
[0268] As shown in Figure 22, the main process of eye protection operation includes:
[0269] Step S2202: Detecting user viewing time in real time;
[0270] Step S2204: determining the viewing time threshold allowed for large-screen viewing based on the user's age;
[0271] Step S2206: When the viewing time threshold is reached, the user is reminded to check their eyesight or to do eye exercises.
[0272] Step S2208: Perform vision test to automatically check the user's vision status;
[0273] Step S22010: Check the vision of the user's left and right eyes and save the results;
[0274] Step S22012: recommending different eye protection graphics according to the different vision status of the two eyes;
[0275] Step S22014: Based on the current vision status, call appropriate eye exercises, start follow-up eye exercises, and detect in real time whether the user follows the standard movements.
[0276] As shown in FIG23 , the core steps of the vision test in the embodiment of the present disclosure mainly include:
[0277] 2301, start the depth camera;
[0278] 2302, enable the human eye detection algorithm;
[0279] 2303, the user is in front of the detection terminal;
[0280] 2304, determine whether the human eye is within the visual range. If so, jump to 2305; if not, jump to 2312;
[0281] 2305, perform vision testing;
[0282] 2306, randomly selecting a test sight mark for display according to the pattern style of the test vision chart selected by the user;
[0283] 2307, select monocular detection or binocular detection;
[0284] 2308, dynamically providing a set of minimized detection sight marks of different sizes based on user registration status for user identification;
[0285] 2309: Can the user be successfully identified three times in a row? If so, jump to 2310. If at least one identification fails, jump to 2308.
[0286] 23010, records the vision test information corresponding to the current sight mark;
[0287] 2311, ended;
[0288] 2312, remind the user to move within the visual range;
[0289] 2313, determine whether the user has moved into the visible range. If the user has moved into the visible range, jump to 2304; if the user has not moved into the visible range, jump to 2311.
[0290] First, the detection distance of the embodiment disclosed in the present invention is simpler and more intelligent than the existing vision chart detection solution. At the same time, random sight marks are used for detection instead of the original fixed vision chart detection method, which will greatly reduce the detection time and speed up the detection speed.
[0291] Users can monitor their vision at any time during leisure time, whether at home, at school, or in meetings. The chart uses intelligent design, adaptive user position, and random dynamic sight mark detection, making detection more accurate while significantly reducing and speeding up detection time. It can accurately monitor the user's current vision and perform corresponding follow-up eye exercises based on the current vision status to protect and improve the user's eye fatigue. It also intelligently tracks and periodically reminds users to enter eye protection mode or perform eye protection exercises to relieve eye fatigue and improve their current vision.
[0292] It should be noted that the acquisition, storage, use, and processing of data in the technical solution disclosed herein are in compliance with the relevant provisions of national laws and regulations. Various types of data such as personal identity data, operation data, behavioral data, etc. related to individuals, customers, and groups obtained in the embodiments of the present disclosure have been authorized.
[0293] Based on the same inventive concept, the present disclosure also provides a vision detection device, as described in the following embodiments. Since the principle of solving the problem in the device embodiment is similar to that in the above method embodiment, the implementation of the device embodiment can refer to the implementation of the above method embodiment, and the repeated parts will not be repeated.
[0294] FIG24 shows a schematic diagram of a vision detection device according to an embodiment of the present disclosure. As shown in FIG24 , the device includes:
[0295] User eye position information acquisition module 2401, used to acquire user eye position information;
[0296] A display position and display size determination module 2402 is configured to determine the display position and display size of the detection sight mark in the display area of the detection terminal according to the user's eye position information;
[0297] A detection sight mark display module 2403 is configured to randomly select a detection sight mark from a vision test chart and display the detection sight mark at a display position in the display area of the detection terminal according to the display size of the detection sight mark;
[0298] The user vision information determination module 2404 is configured to determine the user vision information in response to the user's feedback on the detection sight mark.
[0299] It should be noted that the user eye position information acquisition module 2401, display position and display size determination module 2402, sight mark detection display module 2403, and user vision information determination module 2404 correspond to S302 to S308 in the method embodiment. The examples and application scenarios implemented by these modules and corresponding steps are the same, but are not limited to the contents disclosed in the above method embodiment. It should be noted that the above modules, as part of the device, can be executed in a computer system, such as a set of computer-executable instructions.
[0300] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods, or program products. Therefore, various aspects of the present disclosure may be implemented in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits," "modules," or "systems."
[0301] An electronic device 2500 according to this embodiment of the present disclosure is described below with reference to FIG 25. The electronic device 2500 shown in FIG 25 is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.
[0302] As shown in Figure 25, electronic device 2500 is implemented as a general-purpose computing device. Components of electronic device 2500 may include, but are not limited to, the aforementioned at least one processing unit 2510, the aforementioned at least one storage unit 2520, and a bus 2530 connecting various system components (including storage unit 2520 and processing unit 2510).
[0303] The storage unit stores program code, and the program code can be executed by the processing unit 2510, so that the processing unit 2510 performs the steps described in the "Exemplary Method" section of this specification according to various exemplary embodiments of the present disclosure. For example, the processing unit 2510 can perform the following steps of the above-mentioned method embodiment: obtaining user eye position information; determining the display position and display size of the detection sight mark in the display area of the detection terminal based on the user eye position information; randomly selecting a detection sight mark from the detection vision chart and displaying it at the display position of the detection terminal display area according to the detection sight mark display size; and determining the user's vision information in response to the user's feedback on the detection sight mark.
[0304] The storage unit 2520 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 25201 and / or a cache memory unit 25202 , and may further include a read-only memory unit (ROM) 25203 .
[0305] The storage unit 2520 may also include a program / utility 25204 having a set (at least one) of program modules 25205, such program modules 25205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0306] Bus 2530 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0307] Electronic device 2500 can also communicate with one or more external devices 2540 (e.g., a keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with electronic device 2500, and / or any device that enables electronic device 2500 to communicate with one or more other computing devices (e.g., a router, modem, etc.). Such communication can occur via input / output (I / O) interface 2550. Furthermore, electronic device 2500 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via network adapter 2560. As shown, network adapter 2560 communicates with other modules of electronic device 2500 via bus 2530. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with electronic device 2500, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0308] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
[0309] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer program product, which includes: a computer program, which implements the above vision detection method when executed by a processor.
[0310] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided. The computer-readable storage medium may be a readable signal medium or a readable storage medium. A program product capable of implementing the above-mentioned method of the present disclosure is stored thereon. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes program code. When the program product is run on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the "Exemplary Methods" section above of this specification.
[0311] More specific examples of computer-readable storage media in the present disclosure may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0312] In the present disclosure, a computer-readable storage medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0313] Alternatively, the program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.
[0314] In a specific implementation, the program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, and the like, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a standalone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0315] It should be noted that although several modules or units of the device for action execution are mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.
[0316] Furthermore, although the steps of the method of the present disclosure are described in a particular order in the accompanying drawings, this does not require or imply that the steps must be performed in this particular order, or that all steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.
[0317] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.
[0318] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the appended claims.
Claims
1. A vision detection method, characterized in that, Including: Obtaining user's eye position information; Determining the display position of the detection target in the display area of the detection terminal and the display size of the detection target according to the user's eye position information; Randomly selecting a detection target from the detection eye chart and displaying it at the display position in the display area of the detection terminal according to the display size of the detection target; Determining the user's vision information in response to the feedback made by the user to the detection target.
2. The vision detection method according to claim 1, wherein Obtaining user's eye position information includes: Obtaining the depth image data of the user's distance from the detection terminal; Identifying the user's eyes according to the depth image data of the user's distance from the detection terminal and determining the user's eye position information.
3. The vision detection method according to claim 1, wherein Determining the display position of the detection target in the display area of the detection terminal and the display size of the detection target according to the user's eye position information includes: Judging whether the user's eyes are within the visible range according to the user's eye position information; the visible range is a space formed by using a set length range, width range and height range in the three-dimensional coordinate system established according to the detection terminal in the three-dimensional space; When the user's eyes are within the visible range, determining the three-dimensional eye space point of the user's eye position information in the three-dimensional coordinate system; Determining the display position of the detection target in the display area of the detection terminal and the display size of the detection target according to the three-dimensional eye space point.
4. The vision detection method according to claim 3, wherein Determining the display position of the detection target in the display area of the detection terminal and the display size of the detection target according to the three-dimensional eye space point includes: Obtaining the abscissa, ordinate and vertical coordinate of the three-dimensional eye space point; Determining the projected abscissa and projected ordinate according to the positive projection of the abscissa and ordinate of the three-dimensional eye space point in the display area of the detection terminal; Determining the point formed by the projected abscissa and projected ordinate in the display area of the detection terminal as the display position of the detection target in the display area of the detection terminal, and the display position of the detection target in the display area of the detection terminal moves with the movement of the three-dimensional eye space point; Determining the vertical distance between the three-dimensional eye space point and the display area of the detection terminal according to the vertical coordinate of the three-dimensional eye space point; Determining the display size of the detection target according to the vertical distance.
5. The vision detection method according to claim 4, wherein Determining the display size of the detection target according to the vertical distance includes: Obtaining the standard detection distance of the standard eye chart; Determining the distance ratio according to the vertical distance and the standard detection distance; Determining the current detection target display size according to the distance ratio, the previous user vision information and the actual eye position offset amount, where the actual eye position offset amount is determined by the center point where the three-dimensional eye space point intersects the diagonal of the display area of the detection terminal, and the display size of the detection target includes multiple vision grades.
6. The vision detection method according to claim 5, characterized in that When the vision detection is performed for the first time, the previous user vision information is the average value of the vision information of other users.
7. The vision detection method according to claim 3, wherein It also includes: When the user's eyes are not within the visible range, displaying guiding information on the display area of the detection terminal, where the guiding information is used to instruct the user to move to the visible range; Detect the user's eye position in real time until the user's eyes are within the visible range, and delete the guiding information displayed on the display area of the detection terminal.
8. The vision detection method according to claim 1, characterized in that Randomly select a test optotype from the detection eye chart and display it at the display position on the display area of the detection terminal according to the display size of the test optotype, including: Display various pattern styles of the detection eye chart on the display area of the detection terminal; Determine the style of the test optotype according to the pattern style selected by the user; Randomly select a test optotype from the detection eye chart corresponding to the pattern style selected by the user, and display the style of the test optotype at the display position on the display area of the detection terminal according to the display size of the test optotype.
9. The vision detection method according to claim 1, wherein When there are multiple users, determine the display position of the test optotype on the display area of the detection terminal and the display size of the test optotype, including: According to the eye position information of each user among multiple users, determine the display position of the test optotype corresponding to each user on the display area of the monitoring terminal and the display size of the test optotype, and the test optotype corresponds to the user's eyes one by one.
10. The vision detection method according to claim 1, characterized in that When displaying the test optotype, obtain the ambient light brightness; Adjust the backlight intensity of the display area of the detection terminal according to the ambient light brightness.
11. The vision detection method according to claim 8, characterized in that, In response to the feedback made by the user to the test optotype, determine the user's vision information, including: Display a detection mode on the display area of the detection terminal, and the detection mode includes: monocular detection, binocular detection; In response to the user selecting the detection mode, detect the feedback made by the user to the test optotype displayed on the display area of the detection terminal, and determine the feedback information; Determine the user's vision information according to the feedback information.
12. The vision detection method according to claim 11, characterized in that, If the detection mode is monocular detection, after the user selects the detection mode, it further includes: Display a monocular occlusion prompt message on the display area of the detection terminal, and the monocular occlusion prompt message is used to instruct the user to cover one of the eyes; When it is detected that the user has covered one of the eyes, delete the monocular occlusion prompt message displayed on the display area of the detection terminal.
13. The vision detection method according to claim 11, wherein If the style of the test optotype is a pattern with a direction, then the feedback made by the user to the test optotype displayed on the display area of the detection terminal is an action pointing feedback; Detect the feedback made by the user to the test optotype displayed on the display area of the detection terminal, and determine the feedback information, including: Detect the action pointing feedback made by the user to the test optotype displayed on the display area of the detection terminal, and determine the pointing information obtained by performing action recognition on the action pointing feedback as the feedback information.
14. The vision detection method according to claim 13, wherein Determine the user's vision information according to the feedback information, including: Match the pointing information with the direction of the test optotype; If the pointing information matches the direction of the test optotype, determine the vision grade corresponding to the current display size of the test optotype as the user's vision information; If the pointing information does not match the direction of the detection visual target, adjust the visual acuity level of the detection visual target display size, detect the feedback of the user on the adjusted detection visual target display size, until the pointing information is consistent with the direction of the detection visual target, and determine the visual acuity level corresponding to the current detection visual target display size as the user's visual acuity information.
15. The vision detection method according to claim 11, wherein, When the style of the detection visual target is a pattern with character meanings, the feedback of the user on the detection visual target displayed in the display area of the detection terminal is a voice feedback; Detect the feedback of the user on the detection visual target displayed in the display area of the detection terminal, and determine the feedback information, including: Detect the voice feedback of the user on the detection visual target displayed in the display area of the detection terminal, and determine the text information obtained by voice recognition of the voice feedback as the feedback information.
16. The vision detection method according to claim 15, characterized in that, According to the feedback information, determine the user's visual acuity information, including: Match the text information with the character meanings of the detection visual target; If the text information matches the character meanings of the detection visual target, determine the visual acuity level corresponding to the current detection visual target display size as the user's visual acuity information; If the text information does not match the character meanings of the detection visual target, adjust the visual acuity level of the detection visual target display size, detect the feedback of the user on the adjusted detection visual target display size, until the text information is consistent with the character meanings of the detection visual target, and determine the visual acuity level corresponding to the current detection visual target display size as the user's visual acuity information.
17. The vision detection method according to claim 11, wherein When the style of the detection visual target is an array of patterns with similar patterns, the feedback of the user on the detection visual target displayed in the display area of the detection terminal is a selection feedback; Detect the feedback of the user on the detection visual target displayed in the display area of the detection terminal, and determine the feedback information, including: Detect the selection feedback of the user on the detection visual target displayed in the display area of the detection terminal, and determine the result of the selection feedback as the feedback information.
18. The vision detection method according to claim 17, wherein, The pattern array includes: a verification pattern and interference patterns, the verification pattern and the interference patterns are similar patterns, and the number of interference patterns is greater than the number of verification patterns; According to the feedback information, determine the user's visual acuity information, including: Match the result of the selection feedback with the position of the verification pattern in the pattern array; If the result of the selection feedback matches the position of the verification pattern in the pattern array, determine the visual acuity level corresponding to the current detection visual target display size as the user's visual acuity information; If the result of the selection feedback does not match the position of the verification pattern in the pattern array, adjust the detection The visual acuity level of the visual target display size, detect the selection feedback of the user on the adjusted detection visual target display size, until the result of the selection feedback is consistent with the position of the verification pattern in the pattern array, and determine the visual acuity level corresponding to the current detection visual target display size as the user's visual acuity information.
19. The vision detection method according to claim 2, characterized in that, It further includes: Identify the user's face information according to the depth image data; If it is determined that the user is using for the first time according to the user's face information, display registration information in the display area of the detection terminal, and the registration information is used to instruct the user to register using a mobile terminal; In response to receiving the registration data sent by the mobile terminal, delete the registration information displayed in the display area of the detection terminal.
20. The vision detection method according to claim 19, characterized in that, It further includes: Detect the user's viewing duration according to the user's face information; When the user's viewing duration exceeds the time threshold, display vision detection options and eye protection operation options in the display area of the detection terminal; The time threshold is determined according to the user's age identified from the user's face information; Execute vision detection or eye protection operation according to the user's selection of vision detection options or eye protection operation options.
21. The vision detection method according to claim 20, characterized in that, When the user selects the eye protection operation option, display eye protection graphic sub-options and eye protection exercise sub-options in the display area of the detection terminal; When the user selects an eye protection graphic sub-option, display an eye protection graphic in the display area of the detection terminal, and the eye protection graphic is used to instruct the user to move the eyes along a set path; When the user selects an eye protection exercise sub-option, display an eye protection exercise video in the display area of the detection terminal, and the eye protection exercise video is used to instruct the user to perform eye protection exercise actions according to standard eye protection exercise actions.
22. The vision detection method according to claim 21, characterized in that, When performing eye protection exercise actions, obtain the user's posture information; Identify the eye protection exercise actions performed by the user according to the user's posture information; When the difference between the eye protection exercise actions performed by the user and the standard eye protection exercise actions exceeds the error threshold, display a reminder message in the display area of the detection terminal, and the reminder message is used to correct the eye protection exercise actions.
23. A vision detection device, characterized in that, It includes: A user's human eye position information acquisition module, which is used to acquire the user's human eye position information; A display position and display size determination module, which is used to determine the display position and display size of the detection visual target in the display area of the detection terminal according to the user's human eye position information; A detection visual target display module, which is used to randomly select a detection visual target from the detection visual acuity chart and display it at the display position in the display area of the detection terminal according to the display size; A user's vision information determination module, which is used to determine the user's vision information in response to the feedback made by the user to the detection visual target.
24. A vision detection terminal, characterized in that, It includes: A display screen and a controller; The controller is used to acquire the user's human eye position information, determine the display position and display size of the detection visual target in the display area of the detection terminal according to the user's human eye position information, randomly select a detection visual target from the detection visual acuity chart and send it to the display screen, and determine the user's vision information in response to the feedback made by the user to the detection visual target; The display screen is used to display the detection visual target in the display area of the detection terminal according to the display size of the detection visual target.
25. An electronic device, characterized in that, It includes: A processor; And A memory, which is used to store the executable instructions of the processor; Wherein, the processor is configured to execute the vision detection method described in any one of claims 1 to 22 by executing the executable instructions.
26. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the vision detection method described in any one of claims 1 to 22.