Image display method and device and eyeball tracker detection system

Abstract

The invention provides an image display method and device and an eyeball tracker detection system. The method comprises the following steps: acquiring current three-dimensional data and historical three-dimensional data when an eyeball tracker tracks and simulates eyeball movement; determining a rotation angle of the current three-dimensional data according to the current three-dimensional data and the historical three-dimensional data; rotating the current three-dimensional data according to the rotation angle; mapping the rotated current three-dimensional data into current two-dimensional data; and displaying the current two-dimensional data in the display area. According to the method, the rotation angle of the current three-dimensional data is determined through the current three-dimensional data and the historical three-dimensional data, the current three-dimensional data is rotated, the rotated three-dimensional data is mapped into the current two-dimensional data and is displayed, and error data and eyeball movement data can be displayed in a combined manner; therefore, a user can intuitively connect the distribution rule of the error data along with the change of the sight direction.

Description

Technical Field

[0001] This invention relates to the field of virtual reality equipment technology, and in particular to an image display method, apparatus, and eye tracker detection system. Background Technology

[0002] Eye-tracking technology is widely used in fields such as human-computer interaction, virtual reality, and user experience research. Its core objective is to accurately capture the trajectory of a user's eye movements.

[0003] Existing eye-tracking detection systems primarily focus on acquiring raw data from the eye tracker and performing simple error statistics. Visualization of error data is mainly done through numerical tables or two-dimensional scatter plots, and this error data is independent of gaze-related change data. The spatial correlation between error data and gaze-related change data is weak, making it difficult for users to intuitively understand the distribution pattern of error data as the gaze direction changes. Summary of the Invention

[0004] The main objective of this invention is to provide an image display method, device, and eye tracker detection system, which aims to solve the problem that users cannot intuitively understand the distribution pattern of error data as the viewing direction changes.

[0005] To achieve the above objectives, the present invention proposes an image display method, the method comprising: Acquire current and historical 3D data of the eye tracker when tracking simulated eye movements. The current 3D data includes: horizontal eye movement angle, vertical eye movement angle, and error data of the eye tracker. The rotation angle of the current 3D data is determined based on the current 3D data and the historical 3D data. Rotate the current 3D data according to the rotation angle; Map the rotated current 3D data to the current 2D data; The current two-dimensional data is displayed in the display area that includes the two-dimensional data corresponding to the historical three-dimensional data.

[0006] Optionally, determining the rotation angle of the current 3D data based on the current 3D data and the historical 3D data, and rotating the current 3D data according to the rotation angle, includes: Obtain the intersection data after mapping the historical 3D data and the current 3D data; Determine the display size of the intersection data within the display area; Calculate the rotation angle of the current 3D data based on the display size, and rotate the current 3D data according to the rotation angle.

[0007] Optionally, the image display method further includes: Obtain the maximum horizontal and maximum vertical movement angles of the simulated eyeball; A two-dimensional display coordinate system is constructed within the display area based on the maximum vertical movement angle and the maximum horizontal movement angle. The extended region of the two-dimensional display coordinate system is determined based on the error data of the eye tracker; The two-dimensional display coordinate system is expanded according to the expanded area; Accordingly, displaying the current two-dimensional data within the display area that includes the two-dimensional data corresponding to the historical three-dimensional data includes: The current two-dimensional data is displayed within the expanded two-dimensional display coordinate system.

[0008] Optionally, determining the extended region of the two-dimensional display coordinate system based on the error data of the eye tracker includes: Obtain the edge coordinates within the two-dimensional display coordinate system; the edge coordinates are the edge coordinates containing the maximum horizontal movement angle and the edge coordinates containing the maximum vertical movement angle. Extract the error data corresponding to each edge coordinate from the error data of the eye tracker; Obtain the maximum error data from the error data corresponding to each of the aforementioned edge coordinates; The extended area of ​​the two-dimensional display coordinate system is determined based on the display size required by the maximum error data.

[0009] Optionally, before mapping the rotated current 3D data to the current 2D data, the method further includes: Obtain the area size of the display area and the optimal field of view; Calculate the optimal focal length based on the optimal field of view and the region size; Accordingly, mapping the rotated current three-dimensional data to the current two-dimensional data includes: Based on the optimal focal length, the rotated current 3D data is mapped to the current 2D data.

[0010] Optionally, before displaying the current two-dimensional data within the display area, the method further includes: Based on a preset color, perform color linear interpolation on the error data within the current two-dimensional data to obtain the current two-dimensional data after color linear interpolation; Accordingly, displaying the current two-dimensional data within the display area that includes the two-dimensional data corresponding to the historical three-dimensional data includes: The current two-dimensional data after linear interpolation of the color is displayed within the display area.

[0011] Optionally, the step of performing color linear interpolation on the eye tracker error data within the current two-dimensional data based on a preset color to obtain the color-linearly interpolated current two-dimensional data includes: The color depth of the preset color is determined based on the error data within the current 3D data. Based on the color depth, perform color linear interpolation on the error data within the current two-dimensional data to obtain the current two-dimensional data after color linear interpolation.

[0012] Optionally, the step of displaying the current two-dimensional data within the display area further includes: Detect the current state of the eye tracker; When the current state is a stopped tracking state, acquire the three-dimensional data set of the eye tracker; Generate trajectory maps, heat maps, and / or time-lapse maps based on the three-dimensional data set; The trajectory diagram, the heat map, and / or the time delay diagram are displayed within the display area.

[0013] In addition, to achieve the above objectives, the present invention also provides an image display device, comprising: The data acquisition module is used to acquire the current three-dimensional data and historical three-dimensional data of the eye tracker when tracking the eye. The current three-dimensional data includes: the horizontal movement angle of the eye, the vertical movement angle of the eye, and the error data of the eye tracker. An angle determination module is used to determine the rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data. A data rotation module is used to rotate the current three-dimensional data according to the rotation angle; The data mapping module is used to map the rotated current three-dimensional data to current two-dimensional data; The data display module is used to display the current two-dimensional data within a display area that includes the two-dimensional data corresponding to the historical three-dimensional data.

[0014] In addition, to achieve the above objectives, the present invention also provides an eye tracker detection system, comprising: a controller, a drive motor, and a simulated eyeball; The controller is connected to the drive motor, the drive motor is mounted on the simulated eyeball, and the controller is used to drive the simulated eyeball to move through the drive motor; The controller is also connected to the eye tracker and the display device, and is used to execute the image display method described above during the simulated eye movement.

[0015] This invention provides an image display method, apparatus, and eye tracker detection system. The method includes: acquiring current three-dimensional data and historical three-dimensional data of an eye tracker tracking simulated eye movements; the current three-dimensional data includes: horizontal eye movement angle, vertical eye movement angle, and error data of the eye tracker; determining a rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data; rotating the current three-dimensional data according to the rotation angle; mapping the rotated current three-dimensional data to current two-dimensional data; and displaying the current two-dimensional data in a display area including the two-dimensional data corresponding to the historical three-dimensional data. This invention determines the rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data, rotates the current three-dimensional data, maps the rotated three-dimensional data to current two-dimensional data, and displays it. This allows for the combined display of error data and eye movement data, enabling users to intuitively connect the distribution pattern of error data with the direction of gaze. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the structures shown in these drawings without creative effort.

[0017] Figure 1 This is a flowchart illustrating the first embodiment of the image display method proposed in this invention; Figure 2 This is a flowchart illustrating a second embodiment of the image display method proposed in this invention; Figure 3 This is a schematic diagram of the first process of the third embodiment of the image display method proposed in this invention; Figure 4 This is a schematic diagram of the current two-dimensional data in the two-dimensional display coordinate system in this invention; Figure 5 This is a schematic diagram of the current two-dimensional data in the expanded two-dimensional display coordinate system in this invention; Figure 6 This is a schematic diagram of the second process of the third embodiment of the image display method proposed in this invention; Figure 7 This is a schematic diagram of the first process of the fourth embodiment of the image display method proposed in this invention; Figure 8 This is a schematic diagram of the second process of the fourth embodiment of the image display method proposed in this invention; Figure 9A comparison diagram showing the simulated eye movement trajectory detected by the eye tracker and the motor movement trajectory; Figure 10 This is a heatmap of the current two-dimensional data; Figure 11 This is a delay graph of the eye tracker's response; Figure 12 This is a schematic diagram of the structure of the image display device proposed in this invention; Figure 13 This is a schematic diagram of the eye tracker detection system proposed in this invention.

[0018] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0019] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0020] It should be noted that if the embodiments of the present invention involve directional indicators (such as up, down, left, right, front, back, etc.), the directional indicators are only used to explain the relative positional relationship and movement of the components in a specific posture. If the specific posture changes, the directional indicators will also change accordingly.

[0021] Furthermore, if the embodiments of this invention involve descriptions such as "first" or "second," these descriptions are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the use of "and / or" or "and / or" throughout the text includes three parallel solutions. For example, "A and / or B" includes solution A, solution B, or a solution where both A and B are satisfied simultaneously. Furthermore, the technical solutions of the various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. When the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed by this invention.

[0022] It should be noted that eye trackers can be used to detect specific changes in a user's eyes. During eye detection, eye trackers may introduce certain errors or delays. These errors and delays determine the accuracy and real-time performance of the eye tracker. In the eye tracker detection process, a simulated eye can be set up and controlled to move along a specific trajectory. The eye tracker then tracks this trajectory, and by comparing the simulated eye's set movement trajectory with the tracker's detected movement trajectory, the eye tracker's error data can be determined.

[0023] However, when analyzing data from eye trackers, the simulated eye movement trajectories collected are typically two-dimensional data, including horizontal and vertical eye movement angles. This current two-dimensional data can be directly displayed on a monitor or other display device. However, when evaluating the error data of the eye tracker, it is usually necessary to display the error data separately. Users need to constantly observe different display areas or switch between display areas to understand the regularity of the error data changing with the eye's gaze direction. The whole process is very cumbersome and prone to errors in judging the distribution pattern of the error data.

[0024] To address the above problems, this invention proposes an image display method. (Refer to...) Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the image display method proposed in this invention.

[0025] In this embodiment, the image display method includes: Step S10: Obtain the current 3D data and historical 3D data of the eye tracker when tracking simulated eye movements.

[0026] It is understood that the execution entity of the image display method can be an eye-tracking detection system or a controller within the eye-tracking detection system. In this embodiment and the following embodiments, the controller within the eye-tracking detection system is used as the execution entity to describe the image display method.

[0027] It should be noted that 3D data refers to the horizontal and vertical eye movement angles and the error data of the eye tracker during simulated eye movement. Current 3D data refers to the 3D data presented during the simulated eye movement from the starting point to the ending point within the current cycle. Historical 3D data refers to the 3D data presented during test cycles prior to the current cycle throughout the entire testing process. The historical 3D data and the current 3D data are generated during the same test process.

[0028] The horizontal eye movement angle is the data for simulating horizontal eye movement within a pre-set simulated eye movement trajectory during the test. The vertical eye movement angle is the data for simulating vertical eye movement within a pre-set simulated eye movement trajectory during the test. The eye tracker error data is the difference between the pre-set eye movement trajectory and the movement trajectory detected by the eye tracker.

[0029] In the specific acquisition process, the simulated eyeball can be controlled to move in multiple cycles, with positional changes occurring within each cycle. Within the current cycle, the pre-set horizontal and vertical movement angles of the simulated eyeball between the start and end points of the current cycle are extracted. Then, the horizontal and vertical movement angles detected by the eye tracker are received, and these pre-set angles are compared with those detected by the eye tracker to determine the eye tracker's error data. The pre-set horizontal and vertical movement angles, along with the calculated error data from the eye tracker, are recorded as the three-dimensional data for each cycle and stored. Within the current cycle, historical three-dimensional data can be directly extracted from previous cycles.

[0030] Step S20: Determine the rotation angle of the current 3D data based on the current 3D data and the historical 3D data, and rotate the current 3D data according to the rotation angle.

[0031] It should be understood that, given the acquired 3D data, displaying it on a 2D display device requires appropriate rotation of the 3D data to ensure it is fully displayed within the 2D display area. When observing a 3D image on a monitor, no two directions within the 3D space are perpendicular. For example, in a 3D coordinate system image, the X-axis and Y-axis, and the X-axis and Z-axis are not perpendicular. Therefore, before displaying 3D data, it is necessary to rotate it, i.e., change the viewing angle, to allow the 3D data to transcend the limitations of the 2D plane and be presented intuitively within the 2D display area.

[0032] It should be noted that during the eye tracker detection process, the 3D data of the eye tracker can be displayed in real time. The 3D data in each cycle can be displayed directly in the display area after the 3D data acquisition is completed; that is, the display process of the current 3D data is a real-time display process. Therefore, during the acquisition of 3D data in the current cycle, the 3D data of the previous cycle has already been displayed in the display area. Considering the display characteristics of 3D data in the 2D plane display area, there may be some occlusion when the current 3D data of the current cycle and the historical 3D data are displayed simultaneously, which may prevent the regularity of the 3D data from being effectively presented. For example, the two 3D coordinates (1, 1, 0) and (0, 0, √2) may coincide in the 2D plane display area. Therefore, in this embodiment, the rotation angle of the current 3D data can be determined by combining the historical 3D data before the current 3D data is rotated, thereby avoiding the problem of overlapping display areas between the current 3D data and the historical 3D data in the 2D plane.

[0033] In the specific determination process, we can first determine the display area of ​​the historical 3D data in the 2D plane, and then determine the number of coordinates of the current 3D data within the display area of ​​the historical 3D data after mapping. Based on this number of coordinates, we determine the rotation angle of the current 3D data. For example, if the number of coordinates within the display area of ​​the historical 3D data is large, it indicates a greater degree of occlusion between the current and historical 3D data when displayed simultaneously. In this case, a larger rotation angle is required for the current 3D data. Once the rotation angle is determined, the 3D data can be directly rotated according to this angle to obtain current 3D data that does not obstruct the historical 3D data within the 2D plane.

[0034] Step S30: Map the rotated current three-dimensional data to the current two-dimensional data.

[0035] It should be understood that the display medium for images is a two-dimensional plane. This two-dimensional plane can display data in two dimensions of three-dimensional data, but the third dimension cannot be directly displayed in physical space. Whether it's a computer screen, a mobile phone panel, a projector, or printed paper, all output media can only display pixels on two-dimensional coordinates. Therefore, it is necessary to map three-dimensional data to two-dimensional data in order to represent the third dimension of the three-dimensional data in the image.

[0036] In the specific mapping process, you can first set the focal length and the center point of the display area where the current 3D data needs to be displayed, and then map the current 3D data to the current 2D data based on the focal length and center point. The mapping process can directly use the mapping formula: ; ; in, Focal length The horizontal movement angle of the eyeball within the current 3D data. The vertical movement angle of the eyeball within the current 3D data. This is the error data of the eye tracker within the current 3D data. The x-coordinate of the current two-dimensional coordinate system. The ordinate of the current two-dimensional coordinate system. This displays the x-coordinate of the center point within a two-dimensional plane display area. This displays the ordinate of the center point within a two-dimensional plane display area.

[0037] Step S40: Display the current two-dimensional data in the display area that includes the two-dimensional data corresponding to the historical three-dimensional data.

[0038] Understandably, given the current 2D data mapped from the current 3D data, this current 2D data can be directly displayed within the display area of ​​the display device. The displayed 2D data directly reflects the distribution pattern between the error data within the current 3D data and the horizontal and vertical eye movement angles. The display area already contains 2D data corresponding to historical 3D data from previous periods within the same testing process.

[0039] This embodiment provides an image display method, which includes: acquiring current three-dimensional data and historical three-dimensional data of an eye tracker tracking simulated eye movements; the current three-dimensional data including: horizontal eye movement angle, vertical eye movement angle, and error data of the eye tracker; determining a rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data; rotating the current three-dimensional data according to the rotation angle; mapping the rotated current three-dimensional data to current two-dimensional data; and displaying the current two-dimensional data in a display area including the two-dimensional data corresponding to the historical three-dimensional data. This embodiment determines the rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data, rotates the current three-dimensional data, maps the rotated three-dimensional data to current two-dimensional data, and displays it. This allows for the combined display of error data and eye movement data, enabling users to intuitively connect the distribution pattern of error data with the direction of gaze.

[0040] Based on the first embodiment of the image display method described above, a second embodiment of the image display method of the present invention is proposed. (Refer to...) Figure 2 , Figure 2 This is a flowchart illustrating a second embodiment of the image display method proposed in this invention.

[0041] In this embodiment, step S20 includes: Step S201: Obtain the intersection data after mapping the historical 3D data and the current 3D data.

[0042] It should be understood that before mapping the current 3D data, it needs to be rotated to conform to the user's perspective to ensure that the mapped 3D data can be displayed within the 2D plane display area. This rotation primarily considers that the mapped current 3D data conforms to the user's natural viewing habits. For example, if the user is viewing the object from the right front side, rotating the current 3D data will result in an elevation angle of 30 degrees, i.e., tilted 30 degrees upwards from the XY plane. The corresponding azimuth angle of the current 3D data will be -37.5 degrees or 322.5 degrees, i.e., rotated 322.5 degrees counterclockwise or 37.5 degrees clockwise from the positive X-axis, corresponding to the user's right front view. At this point, the current 3D data can be clearly displayed within the 2D plane display area.

[0043] It should be noted that the intersection data is the set of identical coordinates within the display area of ​​the 2D plane under pre-mapping conditions, consisting of historical 3D data and the current 3D data after rotation adjustment to conform to the user's viewpoint. If the intersection data exists, it can be concluded that there is occlusion between the historical 3D data and the current 3D data after rotation adjustment to conform to the user's viewpoint.

[0044] In the specific acquisition process, the coordinates of the historical 3D data within the display area of ​​the 2D plane can be determined first; then, the current 3D data, after being rotated to match the user's perspective, can be initially mapped to 2D data. The coordinates of the mapped 2D data can be compared with the corresponding coordinates of the historical 3D data to determine the intersection data of the historical 3D data and the current 3D data after both have been mapped.

[0045] Step S202: Determine the display size of the intersection data within the display area.

[0046] It should be noted that the display size of the intersection data within the display area is the size of the display area in the two-dimensional plane after the intersection data has been mapped. This display size is smaller than the size of the entire display area.

[0047] It should be understood that the number of coordinate points included in the intersection data will lead to different occlusion areas. For example, a large number of coordinate points in the intersection data indicates a larger occlusion area between the current 3D data and historical 3D data within the 2D display area; a small number of coordinate points in the intersection data indicates a smaller occlusion area; and zero coordinate points in the intersection data indicates no occlusion between the current 3D data and historical 3D data within the 2D display area.

[0048] Therefore, to avoid the absence of occlusion between historical 3D data and current 2D data within the display area of ​​the mapped 2D plane, it is necessary to determine the corresponding display size of the intersecting data within the display area.

[0049] In the specific determination process, the mapping parameters in the current 3D data mapping process can be used to perform a preliminary mapping of the intersection data, thereby determining the display area of ​​the intersection data in the 2D plane, and then determining the display size of the display area. Alternatively, a relationship can be established between the number of coordinate points in the intersection data and the display size of the display area in the 2D plane based on the mapping parameters, and then the corresponding display size can be determined directly based on the number of coordinate points in the intersection data.

[0050] Step S203: Calculate the rotation angle of the current three-dimensional data based on the display size, and rotate the current three-dimensional data according to the rotation angle.

[0051] It should be understood that different display sizes for the intersection data result in different rotation angles for the current 3D data, which is necessary to avoid potential occlusion between the current and historical 3D data. A larger display size for the intersection data results in a larger rotation angle for the current 3D data; conversely, a smaller display size results in a smaller rotation angle. Of course, considering rotation angles that align with the user's viewing angle, a larger display size for the intersection data allows for greater adjustment of the rotation angle to match the user's perspective.

[0052] In practice, the rotation angle that matches the user's perspective can be used as the initial rotation angle. Then, the initial rotation angle can be adjusted using the display size, and the adjusted initial rotation angle can be used as the final rotation angle of the current 3D data.

[0053] In this process, the three coordinate axes corresponding to the current 3D data can be combined, and the rotation angle of each axis can be determined based on the display size corresponding to the intersection data. The rotation angle can include: the current 3D data rotating around the X-axis by an angle of... degrees, rotation angle around the Y-axis is degrees, rotation angle around the Z-axis is Degrees. Rotation angle around the X-axis is... The coordinates corresponding to the current 3D data after the degree are: ; in, .

[0054] Rotate the current 3D data around the X-axis And rotate around the Y-axis The coordinates corresponding to the degree are: ; Rotate the current 3D data around the X-axis degrees, rotation around the Y-axis And rotate around the Z-axis The coordinates after degrees are: .

[0055] The Spend, The rotation angle is calculated based on the display size, for example. The degree is 90 degrees. The degree is 45 degrees. The angle is 135 degrees. In the specific determination process, considering that the occlusion is mainly due to the error data of the eye tracker in the current 3D data, i.e., the Z-axis data, it is advisable to prioritize adjusting the rotation angle of the current 3D data around the Z-axis, for example, according to... The degree is 45 degrees. The degree is 90 degrees. The rotation angle is 150 degrees. At this point, the X-axis and Y-axis can be kept in the same position as before the rotation angle. The rotation angle of the Z-axis can be adjusted so that there is no overlap between the current 3D data and the historical 3D data.

[0056] Based on the first or second embodiment of the image display method described above, a third embodiment of the image display method of the present invention is proposed.

[0057] Reference Figure 3 , Figure 3 This is a schematic diagram of the first process of the third embodiment of the image display method proposed in this invention.

[0058] In this embodiment, the image display method further includes: Step S41: Obtain the maximum horizontal movement angle and the maximum vertical movement angle of the simulated eyeball.

[0059] It should be noted that the maximum horizontal and vertical movement angles are the maximum distances the eyeball can move in the horizontal and vertical directions during the testing of the eye tracker.

[0060] In practice, a drive motor can be used to control the simulated eyeball to move from one end to the other in each horizontal position, and the horizontal distance between the two ends can be recorded. The maximum horizontal distance determined from all recorded horizontal distances is then taken as the maximum horizontal movement angle. Similarly, a drive motor can be used to control the simulated eyeball to move from one end to the other in each vertical position, and the vertical distance between the two ends can be recorded. The maximum vertical distance selected from all recorded vertical distances is then taken as the maximum vertical movement angle.

[0061] Step S42: Construct a two-dimensional display coordinate system within the display area based on the maximum vertical movement angle and the maximum horizontal movement angle.

[0062] It should be understood that in displaying the current 3D data, the user needs to determine the error data at each position within the 2D display area. Therefore, a coordinate system needs to be planned within the display area. The 2D display coordinate system is a coordinate system within the display area used to represent the coordinate position of the current 3D data. The vertical direction of this 2D display coordinate system can display the error data of the eye tracker.

[0063] In practice, the maximum boundary value of the two-dimensional coordinate system can be determined based on the maximum horizontal and vertical movement angles, and then a two-dimensional display coordinate system can be constructed based on this maximum boundary value.

[0064] Step S43: Determine the extended region of the two-dimensional display coordinate system based on the error data of the eye tracker.

[0065] It should be understood that when current 3D data is displayed within the 2D display area, the eye tracker's error data will not be parallel to the coordinate axes of the 2D display coordinate system. At this point, errors occurring at the edges of the 2D display coordinate system at the maximum horizontal or vertical movement angle will not be displayed within the 2D display coordinate system. (Refer to...) Figure 4 ,exist Figure 4 The maximum horizontal and vertical movement angles of the simulated eye are both based on 10 units. The error data of the eye tracker at the -10 position cannot be displayed in the coordinate system.

[0066] It should be noted that the extended area is the region outside the edge of the two-dimensional display coordinate system, used to display the error data of the coordinate position corresponding to the maximum horizontal or vertical movement angle. Figure 4 In the example, the extended area is shown as 10 to 15 and -10 to -15.

[0067] In practical implementation, considering that the extended area is used to display the eye tracker's error data, the size of the extended area can be determined based on the eye tracker's error data. For example... Figure 4 As shown, if the maximum error data of the eye tracker is 5 units, then the single-side dimension of the extended region is 5 units.

[0068] Step S44: Expand the two-dimensional display coordinate system according to the expanded area.

[0069] Understandably, given a two-dimensional display coordinate system constructed based on the maximum horizontal and vertical movement angles, and the required extended area of ​​the two-dimensional display coordinate system, the extended area can be directly set outside the two-dimensional display coordinate system by superposition, thereby obtaining a two-dimensional display coordinate system that can fully display the current two-dimensional data after the current three-dimensional data mapping.

[0070] Accordingly, step S40 includes: Step S40': Display the current two-dimensional data within the expanded two-dimensional display coordinate system.

[0071] It should be understood that, referring to Figure 5 After forming an extended two-dimensional display coordinate system within the display area, the mapped current two-dimensional data can be directly displayed within the extended two-dimensional display coordinate system. This allows users to determine the error data of the eye tracker at different locations, i.e., the distribution pattern of the error data, based on the extended two-dimensional display coordinate system.

[0072] Step S43 includes: Step S431: Obtain the edge coordinates within the two-dimensional display coordinate system.

[0073] It should be understood that edge coordinates are the outermost coordinates of the two coordinate axes in a two-dimensional coordinate system. These edge coordinates include both the edge coordinates containing the maximum horizontal movement angle and the edge coordinates containing the maximum vertical movement angle. For example... Figure 4 In the middle, there are coordinates including -10 and coordinates including 10.

[0074] In actual display, error data for coordinates located inside the edge of the two-dimensional display coordinate system will be displayed in an outer region relative to that coordinate within the two-dimensional display coordinate system; no additional extended region is required. For example... Figure 4 The error data for the (-5,5) coordinate point can be displayed within the range of -5 to -10.

[0075] Therefore, in this embodiment, determining the extended area requires determining the edge coordinates within the two-dimensional display coordinate system. In a specific implementation, coordinates including the maximum horizontal movement angle and coordinates including the maximum vertical movement angle can be extracted from all coordinates within the two-dimensional display coordinate system. For example, extracting... Figure 4 In the middle, all coordinates including 10 and -10 are included.

[0076] Step S432: Extract the error data corresponding to each edge coordinate from the error data of the eye tracker.

[0077] It should be noted that the extended area is used to display the error data corresponding to the edge coordinates. When determining the extended area, its size also needs to be determined to ensure that the extended area can completely display the error data corresponding to the edge coordinates. For example, in an extended area of ​​10 to 12, if the error data corresponding to the coordinate 10 contains an error value of 5 units, a 2-unit extended area cannot completely display the error data with a value of 5 units.

[0078] Therefore, in this embodiment, it is also necessary to determine the error data corresponding to each edge coordinate. In a specific implementation, the edge coordinates can be determined based on the current two-dimensional coordinates after the current three-dimensional coordinates are mapped. Then, the horizontal and vertical eye movement angles of the edge coordinates in the current three-dimensional data are mapped to determine the error data of the eye tracker corresponding to the edge coordinates. For example, if the current three-dimensional data is (10, 10, 2), then the error data corresponding to the edge coordinate (10, 10) is 2.

[0079] Step S433: Obtain the maximum error data from the error data corresponding to each edge coordinate.

[0080] It should be understood that the maximum error data is the error data with the largest error value among all the error data corresponding to the edge coordinates. After determining the error data corresponding to each edge coordinate, in order to ensure that the expanded area can display the error data corresponding to all edge coordinates, the maximum error data can be selected from all the error data corresponding to the edge coordinates. In specific implementation, the error values ​​of all error data can be compared to determine the maximum error data.

[0081] Step S434: Determine the extended area of ​​the two-dimensional display coordinate system based on the display size required by the maximum error data.

[0082] It should be noted that, given a fixed maximum error value, the required extended area of ​​the two-dimensional display coordinate system can be calculated based on the display size required for that maximum error value within the two-dimensional display coordinate system. For example, if the maximum error value is 5 units, the shortest side of the extended area can be set to 5 units, thus ensuring that the error data corresponding to all edge coordinates can be displayed within the extended area.

[0083] Reference Figure 6 , Figure 6 This is a second flowchart illustrating the third embodiment of the image display method proposed in this invention.

[0084] In this embodiment, the method further includes the following step before step S40: Step S401: Perform color linear interpolation on the error data in the current two-dimensional data based on the preset color to obtain the current two-dimensional data after color linear interpolation.

[0085] It should be noted that the preset color is a pre-defined color used to highlight error data, and this preset color can be a relatively bright color. For example, in this embodiment, green can be selected as the preset color. Linear interpolation is an interpolation method that inserts color data into the error data in a linear manner. Linear interpolation can use the linear value between the bottom point and the fixed point of the histogram corresponding to the error data as the linear standard for linear interpolation. For example, in Figure 4 and Figure 5 In the absence of linear interpolation for the error data, some areas in the resulting histogram of error data may not have the preset color inserted. Figure 4 and Figure 5 If the angle between the error data at the (0,0) coordinate position and both coordinate axes is 45 degrees (or 135 degrees), then during the linear interpolation process, the angle of the preset color also needs to be 45 degrees (or 135 degrees) with both coordinate axes, which is the linear value between the bottom point and the fixed point of the column corresponding to the error data.

[0086] In practice, the angle between the error data and the coordinate axis in the two-dimensional display coordinate system can be determined first. Then, the angle can be used as the linear value in the interpolation process to perform linear interpolation of the error data in the current two-dimensional data with a preset color, thereby obtaining the current two-dimensional data after linear color interpolation.

[0087] Of course, during the linear interpolation of error data, the display size of the error data in the two-dimensional display coordinate system can also be considered. Furthermore, the display size and linearity can be combined to perform color linear interpolation on the error data in the current two-dimensional data, ensuring that the direction of the bar corresponding to the error data and each area are filled with a preset color.

[0088] Accordingly, step S40 includes: Step S40'': Display the current two-dimensional data after linear interpolation of the color within the display area.

[0089] Understandably, when the current two-dimensional data after linear color interpolation is determined, the current two-dimensional data after linear color interpolation can be directly displayed in the two-dimensional display coordinate system. At this time, the bar corresponding to each error data can be completely filled according to the angle of the bar, thus highlighting the distribution pattern of error data with the direction of view more clearly in the two-dimensional display coordinate system.

[0090] Step S401 includes: Step S4011: Determine the color depth of the preset color based on the error data within the current three-dimensional data.

[0091] It should be understood that in the process of linear interpolating the error data of the current two-dimensional data with preset colors, different error data use the same depth of color, which will result in the appearance of bars of the same color depth at each coordinate position. This will cause color interference due to the interference of the same color when the user has determined the distribution law of the error data as the viewing direction changes.

[0092] It should be noted that color depth is used to represent the error values ​​of different error data. For error data with larger error values, a preset color with a larger color depth can be used to represent it in the two-dimensional display coordinate system, while for error data with smaller error values, a preset color with a smaller color depth can be used. For example, when using green, a pure green with a chromaticity of (0, 255, 0) can be selected to represent the error data with the largest error value, while a pure white with a chromaticity of (255, 255, 255) can be used to represent the error data with the smallest error value (0 error).

[0093] In the specific process of determining the color depth, the error values ​​of all error data can be divided into regions. For example, if the error value is one unit, the preset color depth can be (0, 51, 0); if the error value is two units, the preset color depth can be (0, 102, 0); if the error value is three units, the preset color depth can be (0, 153, 0); if the error value is four units, the preset color depth can be (0, 204, 0); and if the error value is five units, the preset color depth can be (0, 255, 0).

[0094] Of course, the following formula can also be used for more detailed calculations. ; in The error value of the error data. This is the maximum error value, which is typically set to 5 units. This represents the color depth corresponding to the error value of the error data.

[0095] Step S4012: Perform color linear interpolation on the error data in the current two-dimensional data according to the color depth to obtain the current two-dimensional data after color linear interpolation.

[0096] Understandably, given that the color depth corresponding to each error data point is determined, color linear interpolation can be performed on the error data within the current two-dimensional data based on the color depth, linear value, and display size of the bar graph corresponding to each error value, to obtain the current two-dimensional data after color linear interpolation.

[0097] In this embodiment, by linearly interpolating the error data within the current two-dimensional data with a preset color depth, the error data can be effectively highlighted, thereby making the distribution pattern of the error data changing with the viewing direction more clearly displayed in the two-dimensional display coordinate system.

[0098] Based on any one of the first to third embodiments of the above-described image display method, a fourth embodiment of the image display method of the present invention is proposed.

[0099] Reference Figure 7 , Figure 7 This is a schematic diagram of the first process of the fourth embodiment of the image display method proposed in this invention.

[0100] The procedure preceding step S30 also includes: Step S31: Obtain the area size of the display area and the optimal field of view.

[0101] It should be noted that the display area size refers to the area within the display area used to display the current 2D data mapped from the current 3D data. Different display area sizes will result in different display effects. For example, if the display area size is large, but the area corresponding to the current 2D data mapped during the data mapping process is small, only a small portion of the display area will display the current 2D data, resulting in a poor user experience. Conversely, if the display area size is small, but the area corresponding to the current 2D data mapped during the data mapping process is large, especially if the area corresponding to the current 2D data is larger than the display area size, some data may not be displayed within the display area, preventing users from properly observing the error data and distribution patterns of the eye tracker at different locations.

[0102] It should be understood that the optimal viewing angle is the viewing angle within the display area that provides the clearest view of two-dimensional data. During the current two-dimensional data display process, different viewing angles will result in different optimal display positions for the image. Consequently, if the display area is not in the optimal display position, the image will not be clear.

[0103] In practical implementation, the display device used to display the current two-dimensional data can be determined based on the area size, and then the area size of the display area of ​​the display device can be determined, such as the size of the display area on the screen. Regarding the optimal viewing angle, the sharpness of the displayed image can be tested in advance using different viewing angles to determine the optimal viewing angle. In this embodiment, a viewing angle of 60 degrees can be selected as the optimal viewing angle.

[0104] Step S32: Calculate the optimal focal length based on the optimal field of view and the region size.

[0105] It should be noted that the optimal focal length is the focal length that produces the sharpest image corresponding to the current two-dimensional data within the display area. Given a fixed display area size, there is a certain mapping relationship between the optimal focal length and the optimal field of view.

[0106] In the specific determination process, the optimal focal length can be calculated based on the region size and the optimal field of view, given a fixed region size and optimal field of view. For example, the optimal focal length can be calculated using the following formula: ; in For the optimal focal length, The area size for displaying the region. This is the optimal field of view.

[0107] Accordingly, step S30 is as follows: Step S30': Map the rotated current 3D data to the current 2D data according to the optimal focal length.

[0108] Understandably, given a fixed optimal focal length, it can be guaranteed that the current 2D data obtained by mapping at that optimal focal length can be clearly displayed within the display area. In the actual mapping process, the optimal focal length can be directly used to map the current 3D data into the current 2D data.

[0109] Reference Figure 8 , Figure 8 This is a second flowchart illustrating the fourth embodiment of the image display method proposed in this invention.

[0110] In this embodiment, after step S40, the method further includes: Step S50: Detect the current state of the eye tracker.

[0111] It should be noted that the current state of the eye tracker refers to the state it exhibits at the current moment. The current state includes both tracking and stopped tracking states. In tracking state, the eye tracker tracks the simulated eye movement in real time and outputs the detected motion trajectory. In stopped tracking state, the eye tracker no longer tracks the simulated eye movement.

[0112] In practice, the current state of the eye tracker can be determined by detecting whether it continuously detects or outputs the detected motion trajectory over a period of time. For example, if the detection time is set to 5 seconds, and the eye tracker does not detect the simulated eye movement trajectory within 5 seconds and does not output any motion trajectory, then the eye tracker can be considered to be in a stopped detection state.

[0113] Step S60: If the current state is a stopped tracking state, obtain the three-dimensional data set of the eye tracker.

[0114] It should be understood that when the eye tracker is in tracking mode, the current mapped 2D data can be displayed in real time within the display area. However, when the eye tracker is in stopped tracking mode, there is no new motion trajectory output, and the current 2D data in the display area is no longer updated.

[0115] It should be noted that when the current state of the eye tracker is "stop tracking", it can be considered that the detection process of the eye tracker has been completed. At this time, the set of three-dimensional data detected by the eye tracker during the entire detection process can be obtained in order to analyze the detection results of the eye tracker in detail.

[0116] Step S70: Generate a trajectory map, a heat map, and / or a time-delay map based on the three-dimensional data set.

[0117] It should be noted that the trajectory diagram is a view showing the movement trajectory of the simulated eye detected by the eye tracker, as well as the simulated eye's set movement trajectory during the eye tracker's detection process. (See reference...) Figure 9 , Figure 9 This is a comparison chart of the simulated eye movement trajectory detected by the eye tracker and the motor movement trajectory. The x-axis represents the horizontal movement angle, the y-axis represents the vertical movement angle, and the position of each movement forms a data point. Connecting these data points forms the motion trajectory. The blue line represents the motion trajectory of the simulated eye driven by the motor, while the green line represents the motion trajectory detected by the eye tracker (covered by the blue line).

[0118] Heatmaps are used to display the horizontal and vertical movement angles of the simulated eyeball, as well as error data from the error tracker, during the detection of the eye tracker's status. (Refer to...) Figure 10 , Figure 10This is a heatmap of the current two-dimensional data. The x-axis represents the horizontal movement angle, the y-axis represents the vertical movement angle, and error data is represented by varying shades of a preset color in the scatter plot. In this embodiment, pure white can represent an error value of 0, and pure green can represent the maximum error value. Figure 10 The example shown is 5.

[0119] A time-delay graph is used to display the delay in detecting the simulated eye movement trajectory during the eye tracker's tracking of the simulated eye. During the eye tracker's detection process, there may be a certain delay in tracking the simulated eye's movement. This delay may be caused by the eye tracker's own untimely response or the untimely transmission of the detected movement trajectory data. The time-delay graph can reflect the real-time response status of the eye tracker. (Refer to...) Figure 11 , Figure 11 This is a time-delay graph of the eye tracker's response. Figure 10 The eye tracker starts up at the first detection point, resulting in a significant delay; there are also significant delays at the thirteenth and fifteenth detection points. The x-axis represents the sequence number of the simulated eye movement, and the y-axis represents the time delay detected by the eye tracker. Each delay point can be connected to form a line graph.

[0120] In the specific generation process, for the trajectory map, given the 3D data set of the eye tracker, the motion trajectory of the simulated eye detected by the eye tracker can be determined based on the horizontal and vertical movement angles of the simulated eye within the detected 3D data set. By combining the detected motion trajectory with the set motion trajectory during the detection process, the trajectory detection state of the eye tracker can be determined.

[0121] For heatmaps, the horizontal and vertical eye movement angles within the 3D data set can be directly displayed in a 2D coordinate system. Then, the error data corresponding to each coordinate point can be set with a preset color, and the error value of the error data can be determined by the color depth.

[0122] For the time-lapse graph, the time between the start of the simulated eye movement and the receipt of detection data from the eye tracker can be recorded as the time delay. Then, the time delays recorded during each simulated eye movement are concatenated to form the time-lapse graph.

[0123] Step S80: Display the trajectory diagram, the heat map, and / or the delay diagram within the display area.

[0124] Understandably, after the eye tracker completes its detection, the trajectory map, the heat map, and the delay map can be displayed in the display area, allowing users to understand the performance of different parameters of the eye tracker based on each map.

[0125] Of course, in the specific display process, the trajectory map, the heat map, and the delay map can be displayed in different areas, or any two maps can be set in the same display area. The best display method is to display the trajectory map, the heat map, and the delay map simultaneously in one display area, so that users can directly understand the different parameter performance of the eye tracker without frequently switching perspectives or display areas.

[0126] In addition, to achieve the above objectives, refer to Figure 12 , Figure 12 This is a schematic diagram of the structure of the image display device proposed in this invention. This invention also provides an image display device, comprising: The data acquisition module 10 is used to acquire the current three-dimensional data and historical three-dimensional data of the eye tracker when tracking the eye. The current three-dimensional data includes: the horizontal movement angle of the eye, the vertical movement angle of the eye, and the error data of the eye tracker. Angle determination module 20 is used to determine the rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data. Data rotation module 30 is used to rotate the current three-dimensional data according to the rotation angle; Data mapping module 40 is used to map the rotated current three-dimensional data to current two-dimensional data; The data display module 50 is used to display the current two-dimensional data in a display area that includes the two-dimensional data corresponding to the historical three-dimensional data.

[0127] In this embodiment, the image display device includes: a data acquisition module 10, an angle determination module 20, a data rotation module 30, a data mapping module 40, and a data display module 50. The data acquisition module 10 acquires current and historical 3D data from the eye tracker during simulated eye movements. The current 3D data includes: horizontal eye movement angle, vertical eye movement angle, and error data from the eye tracker. The angle determination module 20 determines the rotation angle of the current 3D data based on the current and historical 3D data. The data rotation module 30 rotates the current 3D data according to the rotation angle. The data mapping module 40 maps the rotated current 3D data into current 2D data. The data display module 50 displays the current 2D data within a display area that includes the 2D data corresponding to the historical 3D data. This image display device determines the rotation angle of the current 3D data using the current and historical 3D data, rotates the current 3D data, maps the rotated 3D data into current 2D data, and displays it. This allows for the combined display of error data and eye movement data, enabling users to intuitively connect the distribution pattern of error data with the direction of gaze.

[0128] Furthermore, in this embodiment, the image display device is also used to execute the method steps in any of the above-described image display methods. The specific implementation process can be referred to the above-described image display method embodiments, which will not be repeated here.

[0129] Furthermore, to achieve the above objectives, the present invention also provides an eye-tracking detection system, referring to... Figure 13 , Figure 13 This is a schematic diagram of the eye tracker detection system proposed in this invention.

[0130] The eye tracker detection system includes: a controller 1, a drive motor 2, and a simulated eyeball 3; The controller 1 is connected to the drive motor 2, the drive motor 2 is mounted on the simulated eyeball 3, and the controller 1 is used to drive the simulated eyeball 3 to move through the drive motor 2; The controller 1 is also connected to the eye tracker 4 and the display device 5, and is used to execute the image display method in any of the above embodiments during the simulated eye movement.

[0131] It should be understood that controller 1 is used to control simulated eye movements and receive simulated eye movement data detected by the eye tracker, and determine the error data of the eye tracker based on the movement data to obtain the current three-dimensional data.

[0132] The drive motor 2 is used to drive the eyeball to move according to the motion trajectory set by the controller 1. The simulated eyeball 3 is used to simulate the human eye and provide detection for the eye tracker 4. The display device 5 is used to display the mapped current two-dimensional data. The display device 5 can be a display screen, projector, or other devices. The controller 1 can output the current two-dimensional data to the display device 5, thereby displaying the current two-dimensional data.

[0133] During the specific detection process, controller 1 can pre-set the motion trajectory of the simulated eyeball 3, and then output the corresponding instruction to drive motor 2. When drive motor 2 receives the instruction, it controls the simulated eyeball to move according to the pre-set motion trajectory. During the movement of the simulated eyeball 3, eye tracker 4 detects the motion trajectory of the simulated eyeball 3 and outputs it to controller 1. Controller 1 compares the motion trajectory detected by the eye tracker with the pre-set motion trajectory to determine the error data of the eye tracker, and then obtains the current three-dimensional data. Controller 1 is also used to determine the rotation angle of the current three-dimensional data through the current three-dimensional data and the historical three-dimensional data, and rotate the current three-dimensional data. The rotated three-dimensional data is mapped to the current two-dimensional data and displayed. The error data and eye movement data can be combined for display, allowing users to intuitively connect the distribution pattern of the error data with the direction of the gaze.

[0134] The above description is merely an exemplary embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent structural transformations made using the contents of the present invention specification and drawings under the technical concept of the present invention, or direct / indirect applications in other related technical fields, are included within the patent protection scope of the present invention.

Claims

1. An image display method, characterized in that, The method includes: Acquire current and historical 3D data of the eye tracker when tracking simulated eye movements. The current 3D data includes: horizontal eye movement angle, vertical eye movement angle, and error data of the eye tracker. The historical 3D data and the current 3D data are 3D data generated in the same test process. The rotation angle of the current 3D data is determined based on the current 3D data and the historical 3D data, and the current 3D data is rotated according to the rotation angle; Map the rotated current 3D data to the current 2D data; The current two-dimensional data is displayed in the display area that includes the two-dimensional data corresponding to the historical three-dimensional data.

2. The image display method as described in claim 1, characterized in that, The step of determining the rotation angle of the current 3D data based on the current 3D data and the historical 3D data, and rotating the current 3D data according to the rotation angle, includes: Obtain the intersection data after mapping the historical 3D data and the current 3D data; Determine the display size of the intersection data within the display area; Calculate the rotation angle of the current 3D data based on the display size, and rotate the current 3D data according to the rotation angle.

3. The image display method as described in claim 1, characterized in that, The image display method further includes: Obtain the maximum horizontal and maximum vertical movement angles of the simulated eyeball; A two-dimensional display coordinate system is constructed within the display area based on the maximum vertical movement angle and the maximum horizontal movement angle. The extended region of the two-dimensional display coordinate system is determined based on the error data of the eye tracker; The two-dimensional display coordinate system is expanded according to the expanded area; Accordingly, displaying the current two-dimensional data within the display area that includes the two-dimensional data corresponding to the historical three-dimensional data includes: The current two-dimensional data is displayed within the expanded two-dimensional display coordinate system.

4. The image display method as described in claim 3, characterized in that, Determining the extended region of the two-dimensional display coordinate system based on the error data of the eye tracker includes: Obtain the edge coordinates within the two-dimensional display coordinate system; the edge coordinates are the edge coordinates containing the maximum horizontal movement angle and the edge coordinates containing the maximum vertical movement angle. Extract the error data corresponding to each edge coordinate from the error data of the eye tracker; Obtain the maximum error data from the error data corresponding to each of the aforementioned edge coordinates; The extended area of ​​the two-dimensional display coordinate system is determined based on the display size required by the maximum error data.

5. The image display method as described in claim 1, characterized in that, Before mapping the rotated current 3D data to the current 2D data, the process also includes: Obtain the area size of the display area and the optimal field of view; Calculate the optimal focal length based on the optimal field of view and the region size; Accordingly, mapping the rotated current three-dimensional data to the current two-dimensional data includes: Based on the optimal focal length, the rotated current 3D data is mapped to the current 2D data.

6. The image display method as described in claim 1, characterized in that, Before displaying the current two-dimensional data within the display area, the method further includes: Based on a preset color, perform color linear interpolation on the error data within the current two-dimensional data to obtain the current two-dimensional data after color linear interpolation; Accordingly, displaying the current two-dimensional data within the display area that includes the two-dimensional data corresponding to the historical three-dimensional data includes: The current two-dimensional data after linear interpolation of the color is displayed within the display area.

7. The image display method as described in claim 6, characterized in that, The step of performing color linear interpolation on the eye tracker error data within the current two-dimensional data based on a preset color to obtain the current two-dimensional data after color linear interpolation includes: The color depth of the preset color is determined based on the error data within the current 3D data. Based on the color depth, perform color linear interpolation on the error data within the current two-dimensional data to obtain the current two-dimensional data after color linear interpolation.

8. The image display method according to any one of claims 1 to 7, characterized in that, After displaying the current two-dimensional data within the display area, the method further includes: Detect the current state of the eye tracker; When the current state is a stopped tracking state, acquire the three-dimensional data set of the eye tracker; Generate trajectory maps, heat maps, and / or time-lapse maps based on the three-dimensional data set; The trajectory diagram, the heat map, and / or the time delay diagram are displayed within the display area.

9. An image display device, characterized in that, include: The data acquisition module is used to acquire the current three-dimensional data and historical three-dimensional data of the eye tracker when tracking the eye. The current three-dimensional data includes: the horizontal movement angle of the eye, the vertical movement angle of the eye, and the error data of the eye tracker. An angle determination module is used to determine the rotation angle of the current three-dimensional data based on the current three-dimensional data and the historical three-dimensional data. A data rotation module is used to rotate the current three-dimensional data according to the rotation angle; The data mapping module is used to map the rotated current three-dimensional data to current two-dimensional data; The data display module is used to display the current two-dimensional data within a display area that includes the two-dimensional data corresponding to the historical three-dimensional data.

10. An eye-tracking detection system, characterized in that, include: Controller, drive motor, and simulated eyeball; The controller is connected to the drive motor, the drive motor is mounted on the simulated eyeball, and the controller is used to drive the simulated eyeball to move through the drive motor; The controller is also connected to the eye tracker and the display device for executing the image display method according to any one of claims 1 to 8 during the simulated eye movement.

Images