Unilateral neglect parameter acquisition device based on visual spatial cognition

Abstract

The present application discloses a unilateral neglect parameter acquisition device based on visual-spatial cognition, which relates to the technical field of data analysis and processing, and the device comprises: a target shooting test device, a visual-spatial position relationship test device, a visual tracking test device and a parameter acquisition device; the target shooting test device is used to obtain target shooting parameters according to the bull's eye position, the eye position, the first eye movement point position and the target shooting hand position; the visual-spatial position relationship test device is used to obtain the visual-spatial position relationship parameters according to the relative position description parameters and the relative position movement parameters; the visual tracking test device is used to obtain the visual tracking parameters according to the position of the visual tracking image and the second eye movement point position; the parameter acquisition device is used to obtain the unilateral neglect parameters according to the target shooting parameters, the visual-spatial position relationship parameters and the visual tracking parameters. Through the integrated multi-mode test device, the visual-spatial cognition data is automatically collected and analyzed, and the individual's unilateral neglect parameters are accurately obtained.

Description

Technical Field

[0001] The present application relates to the technical field of data analysis and processing, and in particular to a device for acquiring unilateral neglect parameters based on visual spatial cognition. Background Art

[0002] Unilateral neglect disorder is manifested as an individual's neglect of one side when processing visual or spatial information, which may seriously affect daily life and safety. On this basis, unilateral attention assessment is a key technology that can test an individual's ability to process visual or spatial information on a specific side, and then further identify the individual's unilateral neglect cognitive state based on the test results. The existing unilateral attention assessment is based on static pictures or objects, and the unilateral neglect parameters are obtained based on the test results. The unilateral attention is evaluated by the unilateral neglect parameters, so it is very important to accurately obtain the unilateral neglect parameters.

[0003] However, there are situations where unilateral neglect parameters cannot be obtained through static images, but can be obtained by observing dynamically moving objects. In addition, current testing methods all use static objects or images to obtain unilateral neglect parameters, and there is no testing method that uses dynamic scenes to test and then obtain unilateral neglect parameters. Therefore, the existing method of obtaining unilateral neglect parameters using only static objects or images is inaccurate and cannot achieve the effect of accurate attention assessment.

[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present application is to provide a unilateral neglect parameter acquisition device based on visual spatial cognition, aiming to solve the technical problem of being unable to obtain accurate and reliable unilateral neglect parameters.

[0006] To achieve the above-mentioned purpose, the present application proposes a unilateral neglect parameter acquisition device based on visual spatial cognition, the device comprising: a target shooting test device, a visual spatial position relationship test device, a visual tracking test device and a parameter acquisition device;

[0007] The target shooting test device is used to obtain the target shooting parameters according to the bull's eye position, the eye position, the first eye movement point position and the target shooting hand position;

[0008] The visual space position relationship testing device is used to obtain the visual space position relationship parameters according to the relative position description parameters and the relative position movement parameters;

[0009] The visual tracking test device is used to obtain visual tracking parameters according to the position of the visual tracking image and the second eye movement point position;

[0010] The parameter acquisition device is used to obtain the unilateral neglect parameter according to the target shooting parameter, the visual space position relationship parameter and the visual tracking parameter.

[0011] In one embodiment, the target shooting test device includes a bull's eye generating device, a shooting angle acquiring device, an eye movement trajectory generating device, and a target shooting parameter acquiring device;

[0012] The bull's eye generating device is used to generate a bull's eye according to a preset motion trajectory and display the bull's eye on the target shooting test interface;

[0013] The shooting angle acquisition device is used to acquire the bull's eye position, the eye position, the first eye movement point position and the shooting hand position according to the shooting instruction and the bull's eye position, so as to obtain the shooting angle;

[0014] The eye movement trajectory generating device is used to obtain an eye heat map according to the first eye movement point position;

[0015] The target shooting parameter acquisition device is used to obtain the target shooting parameters according to the shooting angle and the eye thermal map.

[0016] In one embodiment, the shooting angle acquisition device includes a gaze angle acquisition device and a gesture angle acquisition device;

[0017] The gaze angle acquisition device is used to obtain the gaze angle according to the bull's eye position, the eye position and the first eye movement point position;

[0018] The gesture angle acquisition device is used to obtain the gesture angle according to the bull's eye position, the eye position and the shooting hand position;

[0019] The shooting angle acquisition device is further used to use one of the gaze angle and the gesture angle as the shooting angle.

[0020] In one embodiment, the visual space position relationship testing device includes a relative position generating device, a relative position describing device, a relative position moving device and a visual space position relationship parameter acquiring device;

[0021] The relative position generating device is used to generate a preset polyhedron and a preset three-dimensional object, and obtain a first relative position and a second relative position according to the position of the preset polyhedron and the position of the preset three-dimensional object;

[0022] The relative position description device is used to obtain a relative position description parameter according to the position of the preset three-dimensional object in the relative position description instruction and the first relative position;

[0023] The relative position moving device is used to move the preset three-dimensional object according to the first relative position and the second relative position, and obtain a relative position moving parameter according to a result of the movement;

[0024] The visual space position relationship parameter acquisition device is used to obtain the visual space position relationship parameter according to the relative position description parameter and the relative position movement parameter.

[0025] In one embodiment, the relative position moving device includes a polyhedron relative position moving device and a track relative position moving device;

[0026] The polyhedron relative position moving device is used to move the preset three-dimensional object according to the first relative position and the preset polyhedron to obtain the polyhedron relative position moving parameters;

[0027] The track relative position moving device is used to obtain a preset track position according to the preset polyhedron, and to move the preset three-dimensional object according to the second relative position and the preset track position to obtain track relative position moving parameters;

[0028] The visual space position relationship parameter acquisition device is further used to use one of the polyhedron relative position movement parameter and the track relative position movement parameter as the relative position movement parameter.

[0029] In one embodiment, the polyhedron relative position moving device comprises a polyhedron moving device, a polyhedron relative position recording device and a polyhedron relative position moving parameter acquiring device;

[0030] The polyhedron moving device is used to move the preset three-dimensional object according to the first relative position;

[0031] The polyhedron relative position recording device is used to record the relative position of the preset three-dimensional object and the polyhedron target of the preset polyhedron after the movement;

[0032] The polyhedron relative position movement parameter acquisition device is used to obtain the polyhedron relative position movement parameters according to the relative position of the polyhedron target.

[0033] In one embodiment, the track relative position moving device includes a track generating device, a track moving device, a track relative position recording device, a color matching device, and a track relative position moving parameter acquiring device;

[0034] The track generating device is used to generate preset tracks of preset colors and numbers on two faces of the preset polyhedron respectively;

[0035] The track moving device is used to move the preset three-dimensional object according to the second relative position, the color of the preset three-dimensional object, the position of the preset track and the color of the preset track;

[0036] The track relative position recording device is used to record the track relative position of the preset three-dimensional object and the preset track after the movement;

[0037] The color matching device is used to match the color of the preset three-dimensional object after the movement with the color of the preset track to obtain a color matching result;

[0038] The track relative position movement parameter acquisition device is used to obtain the track relative position movement parameter according to the track relative position and the color matching result.

[0039] In one embodiment, the visual tracking test device includes a visual tracking interface generating device, a visual tracking image generating device, a visual tracking image generating device, a sequential visual tracking image parameter acquiring device, a visual tracking frame parameter acquiring device, a visual tracking point parameter acquiring device, and a visual tracking parameter acquiring device;

[0040] The visual tracking interface generating device is used to generate a visual tracking interface according to the initial visual tracking interface, the visual tracking frame and a preset number of visual tracking points;

[0041] The visual tracking image generating device is used to generate a test mark in the middle of the visual tracking interface, hide the test mark when a preset time period has passed, and generate a visual tracking image on the visual tracking interface;

[0042] The visual tracking image generating device is further used to obtain a preset visual tracking image generating position according to the initial visual tracking interface and the preset visual tracking image generating order, and generate sequential visual tracking images according to the preset visual tracking image generating position;

[0043] The sequential visual tracking image parameter acquisition device is used to obtain the sequential visual tracking image parameters according to the eye position, the second eye movement point position and the sequential visual tracking image;

[0044] The visual tracking frame parameter acquisition device is used to obtain the visual tracking frame parameters according to the position of the visual tracking image, the second eye movement point position and the position of the visual tracking frame;

[0045] The visual tracking point parameter acquisition device is used to obtain the visual tracking point parameters according to the second eye movement point position, the position of the visual tracking point and the position of the test mark;

[0046] The visual tracking parameter acquisition device is used to use one of the sequential visual tracking image parameters, the visual tracking frame parameters and the visual tracking point parameters as a visual tracking parameter.

[0047] In one embodiment, the visual tracking interface generating device comprises a visual tracking frame interface generating device; the visual tracking frame parameter acquiring device comprises a relative position acquiring device;

[0048] The visual tracking frame interface generating device is used to generate a visual tracking frame interface according to the initial visual tracking interface and the visual tracking frame;

[0049] The relative position acquisition device is used to obtain the relative position of the image eye movement point according to the position of the visual tracking image and the position of the second eye movement point;

[0050] The relative position acquisition device is further used to obtain the relative position of the eye movement point of the tracking frame according to the position of the visual tracking frame and the position of the second eye movement point;

[0051] The visual tracking frame parameter acquisition device is also used to obtain the visual tracking frame parameters according to the relative position of the eye movement point of the image and the relative position of the eye movement point of the tracking frame.

[0052] In one embodiment, the visual tracking interface generating device further comprises a visual tracking point interface generating device; the visual tracking point parameter acquiring device further comprises a visual tracking angle acquiring device;

[0053] The visual tracking point interface generating device is used to generate a visual tracking point interface according to the initial visual tracking interface and a preset number of visual tracking points;

[0054] The visual tracking angle acquisition device is used to obtain the visual tracking angle according to the position of the visual tracking point, the position of the test mark and the position of the second eye movement point;

[0055] The visual tracking point parameter acquisition device is further used to obtain the visual tracking point parameter according to the visual tracking angle.

[0056] The unilateral neglect parameter acquisition device based on visual spatial cognition proposed in this application has at least the following technical effects:

[0057] The device comprises: a shooting test device, a visual space position relationship test device, a visual tracking test device and a parameter acquisition device; the shooting test device is used to obtain shooting parameters according to the bull's eye position, the eye position, the first eye movement point position and the shooting hand position; the visual space position relationship test device is used to obtain the visual space position relationship parameters according to the relative position description parameters and the relative position movement parameters; the visual tracking test device is used to obtain the visual tracking parameters according to the position of the visual tracking image and the second eye movement point position; the parameter acquisition device is used to obtain the unilateral neglect parameter according to the shooting parameters, the visual space position relationship parameters and the visual tracking parameters. The shooting test device realizes an accurate evaluation of the subject's spatial positioning ability and hand-eye coordination ability by capturing the relative positions of the bull's eye, the eye, the first eye movement point and the shooting hand. The visual space position relationship test device uses the relative position description and the movement parameters to test the subject's ability to recognize and understand the position relationship of objects in three-dimensional space. The visual tracking test device evaluates the subject's visual attention allocation and eye movement control ability by recording the visual tracking image and the position of the second eye movement point. Parameter acquisition device: The data obtained by the above-mentioned test device are integrated to extract the key unilateral neglect parameters. By integrating multiple test devices, this application can simulate different visual-spatial tasks and more comprehensively obtain the unilateral neglect parameters of the subjects in various situations. Then, the unilateral neglect parameters obtained can be used to more accurately evaluate unilateral attention, effectively solving the limitations of existing parameter acquisition methods and achieving a more accurate, comprehensive and efficient evaluation of unilateral neglect disorder. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0059] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0060] Figure 1 A schematic diagram of the module structure provided for the first embodiment of the device for obtaining unilateral neglect parameters based on visual spatial cognition of the present application;

[0061] Figure 2 A schematic diagram of generating a bull's eye provided in Embodiment 1 of the device for acquiring unilateral neglect parameters based on visual spatial cognition of the present application;

[0062] Figure 3A schematic diagram of the module structure provided for the second embodiment of the device for obtaining unilateral neglect parameters based on visual spatial cognition of the present application;

[0063] Figure 4 A schematic diagram of the module structure provided for the third embodiment of the unilateral neglect parameter acquisition device based on visual spatial cognition of the present application;

[0064] Figure 5 A schematic diagram of a preset visual tracking image generation sequence provided in Embodiment 3 of the device for acquiring unilateral neglect parameters based on visual spatial cognition of the present application;

[0065] Figure 6 A schematic diagram of obtaining visual tracking frame parameters provided in Embodiment 3 of the device for obtaining unilateral neglect parameters based on visual spatial cognition of the present application;

[0066] Figure 7 This is a schematic diagram of visual tracking point parameter acquisition provided in Embodiment 3 of the unilateral neglect parameter acquisition device based on visual spatial cognition of the present application.

[0067] Description of Figure Numbers:

[0068] Target shooting test device 10; visual space position relationship test device 20; visual tracking test device 30; parameter acquisition device 40.

[0069] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0070] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0071] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0072] Since the existing technology cannot obtain unilateral neglect parameters through static pictures, but can obtain unilateral neglect parameters by observing dynamically moving objects, and the current testing methods all use static objects or pictures to obtain unilateral neglect parameters, and there is no testing method that uses dynamic scenes to test and then obtain unilateral neglect parameters, therefore, the existing method of obtaining unilateral neglect parameters using only static objects or pictures is inaccurate and cannot achieve the effect of accurate attention assessment.

[0073] The present application provides a solution that integrates a target shooting test device, a visual-spatial position relationship test device, a visual tracking test device, and a parameter acquisition device, which can simulate different visual-spatial tasks and more comprehensively acquire the unilateral neglect parameters of the subjects in a variety of situations, thereby enabling more accurate unilateral attention assessment through the acquired unilateral neglect parameters, effectively solving the limitations of existing parameter acquisition methods and achieving a more accurate, comprehensive, and efficient assessment of unilateral neglect disorder.

[0074] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device capable of realizing the above functions, a mixed reality head-mounted display device (HoloLens 2 or HoloLens 3), an augmented reality device (AR), a mixed reality device (MR) and 3D glasses, etc. The following takes a mixed reality head-mounted display device as an example to illustrate this embodiment and the following embodiments.

[0075] Based on this, the embodiment of the present application provides a unilateral neglect parameter acquisition device based on visual space cognition, referring to Figure 1 , Figure 1 This is a schematic diagram of the module structure of the first embodiment of the unilateral neglect parameter acquisition device based on visual spatial cognition of the present application.

[0076] In this embodiment, the unilateral neglect parameter acquisition device based on visual space cognition includes: a target shooting test device 10, a visual space position relationship test device 20, a visual tracking test device 30 and a parameter acquisition device 40.

[0077] The target shooting test device 10 is used to obtain the target shooting parameters according to the bull's eye position, the eye position, the first eye movement point position and the target shooting hand position;

[0078] It should be noted that the bull's eye position refers to the exact position of the bull's eye displayed on the test software interface. The bull's eye will move along the preset motion trajectory and may pause at random positions during the movement.

[0079] In addition, it should be noted that the eye position refers to the physical position of the user's eyes relative to the device or environment during the test. This position is fixed and is used as a reference point to determine the starting point of the user's line of sight.

[0080] It should be noted that the first eye movement point position refers to the eye tracking data point where the user moves his eyes on the test interface during the test. Eye tracking technology captures the movement of the subject's line of sight and records the precise data points where the subject moves on the test interface.

[0081] In addition, it should be noted that the shooting hand position refers to the virtual hand controlled by the subject using an external device. This position is the screen coordinate position simulated by the virtual hand when the subject operates the device, which is used to simulate the actual shooting action.

[0082] It can be understood that by integrating the data of the bull's eye position, eye position, first eye movement point position and shooting hand position and calculating the relative relationship and angle between these positions, the accuracy of the subject's aiming at the bull's eye and the coordination of the shooting can be evaluated.

[0083] In a feasible implementation manner, the target shooting test device includes a bull's eye generating device, a shooting angle acquiring device, an eye movement trajectory generating device, and a target shooting parameter acquiring device;

[0084] The bull's eye generating device is used to generate a bull's eye according to a preset motion trajectory and display the bull's eye on the target shooting test interface;

[0085] It should be noted that the preset motion trajectory refers to the path and pattern of the target moving on the test interface, which are pre-defined. The trajectory may include straight-line movement, curved movement, or pause at a specific point.

[0086] In addition, it should be noted that the bull's eye is the target that the subject needs to aim at and shoot. It is usually a graphic or mark with identification. It needs to be distinguished from other components of the test interface so that the subject can lock the bull's eye without being affected by other factors.

[0087] It is understandable that the target test interface is the main test interface that the subject sees on the Hololens 2 device, and the bull's eye will be displayed on this interface.

[0088] It should be noted that the process of generating the test interface involves using a QR code to locate and expand the image to create an evaluation environment that matches the subject's height. First, a QR code is used as the center point. This QR code is fixed on a bracket that can be raised and lowered and displaced, and the height and position of the subject can be accurately matched through this bracket that can be raised and lowered and displaced. When the subject scans the QR code using a device (such as a head display), the image will be expanded according to the information in the QR code to form a test area, which is sized and positioned with the QR code as the center point. Based on the information in the QR code and the subject's height, a virtual test environment, such as a virtual table or other test objects, is generated. These objects are precisely placed in the test area to simulate the visual experience of the real world. Once the test area and objects are placed correctly, the test content selected by the subject will be displayed in the head display. For example, if the test content is a virtual table, the table will appear in front of the subject. When the subject is taking the test, the position of the virtual object is fixed, just like objects in the real world. The subjects can interact with virtual objects, such as looking back at the virtual table, to evaluate their visual tracking ability. At the same time, the subjects' eye movements and interactive behaviors will be recorded to evaluate their visual tracking ability.

[0089] In addition, it can be understood that the bull's eye generating device generates and displays the bull's eye on the target shooting test interface according to the preset motion trajectory, so that the subject can see and track the bull's eye. The bull's eye can pause for 4 seconds at a random position during its movement.

[0090] In the specific implementation process, the bull's eye generating device will generate a bull's eye on the screen according to a preset motion trajectory, such as a fixed path or a randomly generated path. The bull's eye will move along this trajectory and may pause for a few seconds at certain points to provide a method for obtaining unilateral neglect parameters in different states. During the movement, the bull's eye may appear on the left, right or middle position of the screen, with 5 tests each, and randomly pause at these positions to test the subject's ability to respond to bull's eyes in different positions. The movement and pause of the bull's eye can be automated and controlled by the bull's eye generating device. In another feasible implementation, the movement and pause of the bull's eye can also be manually controlled to provide different test environments and obtain unilateral neglect parameters in a targeted manner.

[0091] Reference Figure 2 , Figure 2 This is a schematic diagram of the bull's eye generation of the first embodiment of the unilateral neglect parameter acquisition device based on visual spatial cognition in the present application.

[0092] like Figure 2 As shown, first a red preset motion trajectory is generated on the target shooting test interface, and then a green bull's eye is generated on the preset motion trajectory. The subject needs to identify the bull's eye and issue a shooting command.

[0093] The shooting angle acquisition device is used to acquire the bull's eye position, the eye position, the first eye movement point position and the shooting hand position according to the shooting instruction and the bull's eye position, so as to obtain the shooting angle;

[0094] It should be noted that the shooting instruction is a clear signal from the subject that they have locked onto the bullseye and are ready to shoot. This can be a voice instruction (such as saying "shoot") or a specific hand gesture.

[0095] In addition, it should be noted that the position of the bull's eye is the coordinate point of the bull's eye on the test interface. It is the target that the subject needs to aim at, and the position of the bull's eye will change dynamically according to the preset trajectory.

[0096] It should be noted that the bull's eye position is the coordinate point of the bull's eye described above on the test interface. The eye position is the position of the subject's eyes relative to the device during the test. The first eye movement point position refers to the eye movement data point recorded by the eye tracking system when the subject first locks the bull's eye with his eyes. The shooting hand position refers to the position of the subject's virtual hand on the screen controlled by an external device.

[0097] It is understandable that the shooting angle is an angle determined by the bull's eye position, the eye position, the first eye movement point position and the shooting hand position. The shooting angle acquisition device obtains the shooting angle by calculating the relationship between these positions.

[0098] In a feasible implementation manner, the shooting angle acquisition device includes a gaze angle acquisition device and a gesture angle acquisition device;

[0099] The gaze angle acquisition device is used to obtain the gaze angle according to the bull's eye position, the eye position and the first eye movement point position;

[0100] It should be noted that the gaze angle is an angle determined by the position of the bull's eye, the eye position, and the first eye movement point position, which indicates the degree of alignment between the subject's line of sight and the bull's eye.

[0101] In the specific implementation process, in the target shooting test, the bull's eye moves on the screen according to a preset trajectory, and the subject needs to track and aim at the bull's eye. The subject wears a Hololens 2 device, which has an eye tracking function and can capture the subject's line of sight and eye point position. When the subject issues a shooting command, the eye tracking system records the first eye point position. The gaze angle acquisition device measures the angle between the bull's eye position, the eye position, and the first eye point position. This angle is the gaze angle. If the gaze angle is very small, close to 0 degrees, this indicates that the subject's line of sight is very accurately aimed at the bull's eye.

[0102] The gesture angle acquisition device is used to obtain the gesture angle according to the bull's eye position, the eye position and the shooting hand position;

[0103] It should be noted that the gesture angle is an angle determined by the position of the bull's eye, the eye position, and the shooting hand position, and represents the degree of alignment between the subject's gesture and the bull's eye.

[0104] During the specific implementation process, the bull's eye moves on the screen according to the preset trajectory, and the subject needs to use the eye tracking and gesture recognition functions on the Hololens2 device to aim at the bull's eye. The subject controls the virtual hand by moving the external device and tries to move it to the bull's eye position. At this time, the system records the screen coordinate position of the shooting hand. The gesture angle acquisition device measures the angle between the bull's eye position, the eye position, and the shooting hand position. This angle is the gesture angle. If the gesture angle is very small, close to 0 degrees, it means that the subject's gesture is very accurately aimed at the bull's eye, showing good hand-eye coordination.

[0105] The shooting angle acquisition device is further used to use one of the gaze angle and the gesture angle as the shooting angle.

[0106] It is understood that the shooting angle is the angle that is ultimately used to evaluate the subject's aiming accuracy. The shooting angle acquisition device will select one from the gaze angle and the gesture angle as the shooting angle. The shooting angle acquisition device compares the two angles and may select the gaze angle or the gesture angle as the shooting angle according to the design and purpose of the test. For example, if the test focuses more on evaluating the subject's visual attention, the gaze angle may be selected; if the test focuses more on evaluating the hand-eye coordination ability, the gesture angle may be selected.

[0107] In the specific implementation process, a practical example of the process of generating a shooting angle is that the subject wears a Hololens 2 device. When the bull's eye moves and pauses on the screen, the subject locks the bull's eye with his eyes through the eye tracking system. At this time, the eye tracking records the initial relative position of the bull's eye and the eye point, forming the bull's eye-eye-eye point angle. Then, the subject uses an external device to control the virtual hand to move to the bull's eye position, and the system records the relative position of the bull's eye and the virtual hand to form the bull's eye-eye-virtual hand angle. The accuracy of this shooting angle is crucial to evaluating the subject's visual attention and hand-eye coordination ability, because it directly reflects the accuracy of the subject's aiming at the bull's eye. If the shooting angle is very small, close to 0 degrees, this indicates that the subject has successfully focused his visual attention on the bull's eye and coordinated his hand movements with his sight, thereby effectively completing the shooting task.

[0108] The eye movement trajectory generating device is used to obtain an eye heat map according to the first eye movement point position;

[0109] It should be noted that the eye heat map is a data visualization tool used to show the distribution of the subject's visual attention during the test. Heat maps usually use different shades of color to indicate the length of time the subject's gaze stays or the frequency of gaze. Since the eye heat map mainly represents the area of ​​interest of the subject during the test, it can intuitively feel whether the subject can accurately view the test target.

[0110] Imagine the viewing plane as a piece of paper with countless small square grids, and the grid data is 0-100. The places where the eye movement trajectory passes through are at least >0. The longer the fixation time, the closer this value is to 100. The grids that the eye movement does not pass through have data of 0, and the range >0 is the observable range of the subject. 1-100 is the color displayed in the heat map. The data of each small grid in the eye heat map changes with the subject's eye movement. The time of passing through can be superimposed. For example, the test time is 0-10 seconds. In the first second, the subject passes through grid 1, and in the third second, he passes through grid 1 again, and in the seventh second, he passes through grid 1 again. These three times will be superimposed, and the eye heat map after the test is completed will produce the final eye heat map of this time.

[0111] In a specific embodiment, if a subject successfully hits the bull's eye multiple times in the test, the eye heat map will show a darker color in the bull's eye area, indicating that the subject has a higher gaze frequency and a longer gaze time in this area. On the contrary, if the area around the bull's eye is lighter in color, this may mean that the subject's attention is more scattered or not attracted to these areas. By analyzing this color distribution, the subject's visual concentration ability and neglect can be evaluated, thereby making a more accurate diagnosis of the subject's visual spatial cognitive ability.

[0112] The target shooting parameter acquisition device is used to obtain the target shooting parameters according to the shooting angle and the eye thermal map.

[0113] It should be noted that target shooting parameters are a series of quantitative indicators used to evaluate the performance of subjects in target shooting tests. These parameters may include but are not limited to shooting accuracy, reaction time, aiming stability, visual attention distribution, etc.

[0114] It can be understood that the target shooting parameter acquisition device can obtain the target shooting parameters of the subject by combining the accuracy of the shooting angle and the analysis results of the eye thermogram.

[0115] In a specific embodiment, assuming that the subject issues a shooting command when the bull's eye is paused, the shooting angle acquisition device measures and records the angle between the bull's eye, the subject's eye position and the eye movement point or the virtual hand. If this angle is less than a preset threshold, in this embodiment, the angle threshold is 1 degree, the shooting parameter acquisition device will consider that the subject has successfully locked the bull's eye. At the same time, the eye movement trajectory generation device tracks the subject's sight stay time and frequency on the bull's eye to obtain an eye heat map, which reflects the subject's high concentration of attention on the bull's eye. The shooting parameter acquisition device combines these data to evaluate the subject's aiming accuracy, reaction speed and stability of visual attention. For example, if the shooting angle is very precise and the eye heat map shows that the bull's eye area has a high density of dark colors, this indicates that the subject performed well in the target shooting test and has a high degree of aiming accuracy and concentrated visual attention.

[0116] The visual space position relationship testing device 20 is used to obtain the visual space position relationship parameters according to the relative position description parameters and the relative position movement parameters;

[0117] It should be noted that the relative position description parameter is based on the subject's verbal description or operational feedback of the relative positions of objects, and is used to evaluate the subject's ability to recognize and express spatial relationships.

[0118] In addition, it should be noted that the relative position movement parameters: these parameters are based on the subject's operation of moving objects to specific spatial positions in the test, and are used to evaluate the subject's understanding and operation ability of spatial relationships.

[0119] It should be noted that the visual-spatial position relationship parameters are the parameters obtained by combining the relative position description parameters and the relative position movement parameters, which reflect the subject's overall cognitive ability of the spatial relationship between objects.

[0120] It can be understood that the visual-spatial position relationship test reflects the subject's ability to recognize and operate the spatial relationship between objects, and ultimately obtains the visual-spatial position relationship parameters.

[0121] The visual tracking test device 30 is used to obtain visual tracking parameters according to the position of the visual tracking image and the second eye movement point position;

[0122] It should be noted that the visual tracking image is an image of the visual tracking task, and the position of the visual tracking image refers to the exact coordinate position of the image used for the visual tracking task on the test interface.

[0123] In addition, it should be noted that the second eye movement point position refers to the eye movement data point captured by the eye tracking system during the subject's visual tracking task, which is usually the position to which the subject's gaze moves.

[0124] It should be noted that the visual tracking parameters are parameters derived based on the performance of the subjects in tracking the visual tracking images, including but not limited to the accuracy and speed of tracking, etc., and are used to evaluate the visual tracking ability of the subjects.

[0125] It is understandable that visual tracking tests can provide a quantitative indicator of visual tracking ability, which can be used to evaluate unilateral attention.

[0126] The parameter acquisition device 40 is used to obtain the unilateral neglect parameter according to the target shooting parameter, the visual space position relationship parameter and the visual tracking parameter.

[0127] It is understandable that the shooting parameters are derived from the shooting test device and reflect the performance of the subjects in the aiming and shooting target tasks, including shooting accuracy, reaction time, aiming stability, and visual attention distribution. The visual spatial position relationship parameters are derived from the visual spatial position relationship test device and evaluate the subjects' ability to recognize and understand the spatial relationship between objects, including the relative position description of objects and the ability to move objects to specific spatial positions. The visual tracking parameters are derived from the visual tracking test device and measure the subjects' ability to track moving targets, including the accuracy, speed, and persistence of tracking.

[0128] It should be noted that the unilateral neglect parameter is the final evaluation result obtained by integrating all the above parameters, which is used to evaluate the unilateral attention of the subjects.

[0129] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 3 , Figure 3 This is a schematic diagram of the module structure of the second embodiment of the unilateral neglect parameter acquisition device based on visual space cognition of the present application, and the unilateral neglect parameter acquisition device based on visual space cognition includes: a target shooting test device 10, a visual space position relationship test device 20, a visual tracking test device 30 and a parameter acquisition device 40. Among them, the visual space position relationship test device 20 includes a relative position generation device 201, a relative position description device 202, a relative position movement device 203 and a visual space position relationship parameter acquisition device 204.

[0130] The relative position generating device 201 is used to generate a preset polyhedron and a preset three-dimensional object, and obtain a first relative position and a second relative position according to the position of the preset polyhedron and the position of the preset three-dimensional object;

[0131] It should be noted that the preset polyhedron is a geometric body with multiple faces used in the test, such as a cube or a rectangular solid, and its position and direction are preset in the test. In this embodiment, the preset polyhedron is a rectangular solid.

[0132] In addition, it should be noted that the preset three-dimensional object is another three-dimensional object used in the test, which can be moved relative to the preset polyhedron or placed in a specific position. In this embodiment, the preset three-dimensional object is a small ball.

[0133] It can be understood that the first relative position refers to the position of the preset three-dimensional object relative to one face of the preset polyhedron, for example, the ball is located outside the six faces of the cube: front, back, left, right, top, and bottom. The second relative position refers to the position of the preset three-dimensional object relative to the center of the preset polyhedron, for example, when the ball is located at the center of the cube, the position of the ball relative to the cube. The ball position appears three times on each of the six faces, but the position and order of appearance are randomized.

[0134] The relative position description device 202 is used to obtain a relative position description parameter according to the position of the preset three-dimensional object in the relative position description instruction and the first relative position;

[0135] It should be noted that the relative position description instruction is an instruction given by the subject in the visual space position relationship test, and this instruction is specifically the subject describing the position of the ball relative to the cube. In this embodiment, the relative position description instruction is obtained by oral description.

[0136] In the specific implementation process, the subject can see a cube with a small ball on it in the test interface. The test system requires the subject to describe the position of the small ball relative to the cube. After observation, the subject verbally answers, "The small ball is on the top of the cube." This description is captured by the speech recognition system and converted into text information. The relative position description device then analyzes the accuracy of this description and compares it with the actual position data of the small ball to obtain the relative position description parameters. This process evaluates the subject's ability to recognize and describe the spatial relationship between objects in language, providing important information for diagnosing visual-spatial cognitive disorders.

[0137] The relative position moving device 203 is used to move the preset three-dimensional object according to the first relative position and the second relative position, and obtain a relative position moving parameter according to the result of the movement;

[0138] It should be noted that the relative position movement parameters are based on the operation results of the subject moving the preset three-dimensional object, and are used to evaluate the subject's understanding and operation ability of spatial relationships.

[0139] It can be understood that, according to the first relative position and the second relative position, moving the preset three-dimensional object means that when the ball is located at the first relative position and the second relative position of the cube, the ball is moved to a position, and the result of the movement can be obtained. For example, the subject is asked to move the ball from one position to another position, such as from the front of the cube to the top. The relative position movement parameter can be obtained according to the result of this movement.

[0140] In a feasible implementation manner, the relative position moving device includes a polyhedron relative position moving device and a track relative position moving device;

[0141] The polyhedron relative position moving device is used to move the preset three-dimensional object according to the first relative position and the preset polyhedron to obtain the polyhedron relative position moving parameters;

[0142] It should be noted that the relative position movement parameters of the polyhedron record relevant data in the process of the ball moving from a first relative position to a new position, including but not limited to the movement path, speed, accuracy and time of the subject's operation.

[0143] In a feasible implementation manner, the polyhedron relative position moving device includes a polyhedron moving device, a polyhedron relative position recording device, and a polyhedron relative position moving parameter acquiring device;

[0144] The polyhedron moving device is used to move the preset three-dimensional object according to the first relative position;

[0145] It can be understood that the first relative position refers to the initial position of the ball relative to the cube, and the movement is to move the ball according to the first relative position. For example, when the ball is in front of the cube, the subject needs to move the ball from the front of the cube to the inside of the cube.

[0146] The polyhedron relative position recording device is used to record the relative position of the preset three-dimensional object and the polyhedron target of the preset polyhedron after the movement;

[0147] It should be noted that the pre-set 3D object after moving refers to the state after the subject operates the pre-set 3D object to move from one position to another in the test. The relative position of the polyhedron target refers to the final position of the pre-set 3D object relative to the pre-set polyhedron after the moving operation. This position is the key data for test analysis and evaluation.

[0148] The polyhedron relative position movement parameter acquisition device is used to obtain the polyhedron relative position movement parameters according to the relative position of the polyhedron target.

[0149] It can be understood that the relative position of the polyhedron target reflects the result of the subject's operation. If the ball is successfully moved to the expected target position, it shows that the subject has good spatial positioning ability and operation accuracy, and the corresponding polyhedron relative position movement parameters will reflect this.

[0150] During the specific implementation process, the subject observed a cube suspended in the center of the screen through the virtual reality device, and a small ball was located on the left side of the cube. According to the test instructions, the subject needs to move the small ball from the left side of the cube to the inside of the cube. During the subject's operation, the polyhedron relative position moving device tracks the movement path and speed of the small ball and records the new position of the small ball relative to the cube. Once the small ball is successfully moved to the inside of the cube, the polyhedron relative position recording device records the target relative position, and then the polyhedron relative position movement parameter acquisition device analyzes these data to generate polyhedron relative position movement parameters that describe the accuracy and efficiency of the subject's operation. This process not only simulates spatial operation tasks in the real world, but also provides important data for evaluating the subject's visual spatial cognitive ability.

[0151] The track relative position moving device is used to obtain a preset track position according to the preset polyhedron, and to move the preset three-dimensional object according to the second relative position and the preset track position to obtain track relative position moving parameters;

[0152] It should be noted that the preset track position refers to the position of the track preset on a specific surface or inside the cube. These tracks have different colors, and the track can be used to guide or restrict the movement of the ball.

[0153] It can be understood that the subject needs to move the ball from the second relative position to the target position, and the target position is associated with the position on the preset track.

[0154] In addition, it should be noted that the track relative position movement parameters record the relevant data in the process of the ball moving from the initial position to a specific position on the track, including but not limited to the movement path, speed, accuracy and the time of the subject's operation.

[0155] In a feasible implementation manner, the track relative position moving device includes a track generating device, a track moving device, a track relative position recording device, a color matching device, and a track relative position moving parameter acquiring device;

[0156] The track generating device is used to generate preset tracks of preset colors and numbers on two faces of the preset polyhedron respectively;

[0157] It should be noted that the preset number of color tracks refers to the number of generated tracks being related to the number of different colors. In this embodiment, a ball is generated separately at the center of a cube, and three tracks of red, blue, and green are generated on the left and right sides of the cube, for a total of six tracks. In the test, the subject is required to move the ball of the same color as the track to the track of the matching color.

[0158] The track moving device is used to move the preset three-dimensional object according to the second relative position, the color of the preset three-dimensional object, the position of the preset track and the color of the preset track;

[0159] It is understandable that the second relative position refers to the position where the ball is generated. In this embodiment, the second relative position refers to the center position of the cube. For example, the subject is asked to move a red ball from the center of the cube to the red track.

[0160] The track relative position recording device is used to record the track relative position of the preset three-dimensional object and the preset track after the movement;

[0161] It should be noted that the pre-set 3D object after moving refers to the state after the pre-set 3D object is moved from one position to another position by the subject or system operation during the test. The track relative position refers to the final position of the pre-set 3D object relative to the pre-set track after the moving operation. This position is the key data for test analysis and evaluation.

[0162] The color matching device is used to match the color of the preset three-dimensional object after the movement with the color of the preset track to obtain a color matching result;

[0163] It should be noted that the color matching result is the result obtained by the color matching device based on the color comparison between the three-dimensional object and the track, indicating whether the colors are correctly matched, so as to evaluate the color recognition and spatial matching ability of the subject based on this result.

[0164] It can be understood that, based on the color of the moving ball, the color of the track is compared. If the color of the ball is the same as the color of the track, the color matching device records a successful match; if the colors are different, a failed match is recorded.

[0165] The track relative position movement parameter acquisition device is used to obtain the track relative position movement parameter according to the track relative position and the color matching result.

[0166] It should be noted that the relative position of the track refers to the final position of the preset three-dimensional object relative to the preset track after the move operation. This position is the key data for test analysis and evaluation, which reflects the result of the subject's operation. It may be one of the results of placing the ball in the track of matching color, placing the ball in the track of wrong color, or failing to place the ball in the track.

[0167] In addition, it should be noted that the track relative position movement parameters are calculated based on the track relative position and color matching results, and are used to evaluate the subject's performance in the visual-spatial position relationship test. The track relative position movement parameters include but are not limited to the accuracy of movement, the accuracy of color matching, the time required for movement, and the accuracy of the subject's operation.

[0168] During the specific implementation process, the subject can see a colored ball in the center of the cube on the test interface, and there are several tracks of different colors on the left and right sides of the cube. The task requires the subject to move the ball to the track that matches the color of the ball. The subject successfully moved the red ball to the red track through the eye tracking and gesture control of the head-mounted device. The track relative position movement device records the starting position, movement path, end position and time required for the movement of the ball. Subsequently, the system analyzes this data, generates track relative position movement parameters, and evaluates the subject's completion of color matching and spatial positioning tasks. These parameters help diagnose and evaluate the subject's visual spatial processing ability.

[0169] The visual space position relationship parameter acquisition device is further used to use one of the polyhedron relative position movement parameter and the track relative position movement parameter as the relative position movement parameter.

[0170] It should be noted that the relative position movement parameter is a comprehensive parameter, which is one of the polyhedron relative position movement parameters or the track relative position movement parameters, and is used to represent the overall performance of the subject in the relative position movement task in the visual-spatial position relationship parameter acquisition device.

[0171] It can be understood that the polyhedron relative position movement parameters are obtained from the polyhedron relative position movement device, reflecting the performance of the subject in moving the ball from one position to another face of the cube, including the accuracy, speed and fluency of the movement. The track relative position movement parameters are obtained from the track relative position movement device, reflecting the performance of the subject in moving the ball along the preset track to a specific target position, also including the accuracy, speed and fluency of the movement.

[0172] The visual space position relationship parameter acquisition device 204 is used to obtain the visual space position relationship parameter according to the relative position description parameter and the relative position movement parameter.

[0173] It should be noted that the visual-spatial position relationship parameters are parameters obtained by combining the relative position description parameters and the relative position movement parameters, and are used to evaluate the subject's overall spatial cognitive ability, especially the understanding of the relative position relationship between objects.

[0174] It can be understood that the relative position description parameter is derived from the subject's description of the position of the preset three-dimensional object relative to the preset polyhedron, reflecting the subject's ability to recognize and express spatial relationships. The relative position movement parameter is derived from the subject's operation of moving the preset three-dimensional object to a specific position during the test, reflecting the subject's understanding and operation ability of spatial relationships. The relative position movement parameter can be obtained by comprehensive evaluation of the relative position description parameter and the relative position movement parameter.

[0175] Based on the first embodiment of the present application, in the third embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction, and will not be repeated in the following. Figure 4 , Figure 4 This is a schematic diagram of the module structure of the third embodiment of the unilateral neglect parameter acquisition device based on visual space cognition of the present application, and the unilateral neglect parameter acquisition device based on visual space cognition includes: a target shooting test device 10, a visual space position relationship test device 20, a visual tracking test device 30 and a parameter acquisition device 40. Among them, the visual tracking test device 30 includes a visual tracking interface generation device 301, a visual tracking image generation device 302, a sequential visual tracking image parameter acquisition device 303, a visual tracking frame parameter acquisition device 304, a visual tracking point parameter acquisition device 305 and a visual tracking parameter acquisition device 306.

[0176] The visual tracking interface generating device 301 is used to generate a visual tracking interface according to the initial visual tracking interface, the visual tracking frame and a preset number of visual tracking points;

[0177] It should be noted that the initial visual tracking interface refers to the basic interface at the beginning of the visual tracking test, which is usually a blank canvas or a background of a specified size, used to carry the subsequently generated visual tracking frame and tracking points.

[0178] In addition, it should be noted that the visual tracking frame is an interface element, usually a mark or a box, used to indicate the target area that the subject should focus on in the visual tracking task. In this embodiment, the number of target areas that should be focused on can be 24.

[0179] It should be noted that the preset number of visual tracking points is a series of points used in the visual tracking test, which represent the targets that the subject needs to track. The number of these points is pre-set, and their parameters such as position, order of appearance and duration on the interface are also pre-defined. In this embodiment, the number of visual tracking points is 25.

[0180] In addition, it should be noted that the visual tracking interface is the final generated interface, which includes a visual tracking box or a preset number of visual tracking points. This interface is the environment that the subject directly interacts with during the visual tracking test.

[0181] The visual tracking image generating device 302 is used to generate a test mark in the middle of the visual tracking interface, hide the test mark after a preset time period, and generate a visual tracking image on the visual tracking interface;

[0182] It should be noted that the test mark is an interface element, usually a specific graphic or mark, used to indicate the target or starting point that the subject should focus on in the visual tracking task. In this embodiment, the test mark is a cross that the subject is required to focus on before the test begins.

[0183] In addition, it should be noted that the preset time period is a pre-set time length in the test, which is used to control the display and hiding of the test mark. For example, the test mark may be displayed at the beginning of the test and then disappear after the preset time period. In this embodiment, the preset time period is 300ms.

[0184] It should be noted that the visual tracking image is an image generated after the test logo is hidden, which is used to guide the subject to perform visual tracking. This image may be a moving point, line or shape, and the subject is required to move his or her eyes along it.

[0185] The visual tracking image generating device 302 is further used to obtain a preset visual tracking image generation position according to the initial visual tracking interface and the preset visual tracking image generation order, and generate a sequential visual tracking image according to the preset visual tracking image generation position;

[0186] It should be noted that the preset visual tracking image generation order refers to the order in which the visual tracking images appear in the test, and this order is pre-set according to the test design.

[0187] The preset visual tracking image generation position refers to the position where the visual tracking image appears in advance on the visual tracking interface. These positions may be fixed or may change according to a certain pattern. In this embodiment, the preset visual tracking image generation position is the tracking image generation position obtained in sequence according to the preset visual tracking image generation order.

[0188] Please refer to Figure 5 , Figure 5 This is a schematic diagram of the preset visual tracking image generation sequence of the third embodiment of the unilateral neglect parameter acquisition device based on visual spatial cognition of the present application.

[0189] like Figure 5 As shown, balls are generated in sequence at positions corresponding to the numbers on the interface in the order of 101 to 128. The balls represent sequential visual tracking images. In the test, the blue balls will be used as the target of visual tracking, and the red dots represent the position of the subject's eye movement points, that is, the real-time tracking points of the subject's line of sight.

[0190] In addition, it should be noted that sequential visual tracking images refer to visual tracking images generated according to a preset generation order and position, and are used to guide the subject to perform visual tracking.

[0191] The sequential visual tracking image parameter acquisition device 303 is used to obtain the sequential visual tracking image parameters according to the eye position, the second eye movement point position and the sequential visual tracking image;

[0192] It should be noted that the second eye movement point position refers to the position of the eye movement data point captured by the eye tracking system when the subject tracks the target image in the visual tracking test. The eye position refers to the physical position of the subject's eyes, and this position will be used as a reference point to track the subject's line of sight.

[0193] In addition, it should be noted that the sequential visual tracking image parameters are calculated based on the analysis results of the eye position, the second eye movement point position and the position of the sequential visual tracking image, and are used to evaluate the subject's visual tracking ability. These parameters may include tracking accuracy, speed, stability and reaction time, etc. In this embodiment, the sequential visual tracking image parameters can be the angle size of angle ABC with the eye position as point A, the second eye movement point position as point B, the position of the sequential visual tracking image as point C. It can also be the straight-line distance from the second eye movement point position to the position of the sequential visual tracking image.

[0194] In a specific embodiment, the subject wears an eye tracking device and sits in front of the initial visual tracking interface and records the eye position (point A). A series of visual tracking images, such as a ball (point C), appear on the initial visual tracking interface in the order in which the visual tracking images are generated. They appear in the predetermined visual tracking image generation order and the position corresponding to the visual tracking image generation order. The subject's task is to quickly shift his or her sight to each newly appearing ball. The eye tracking system captures the subject's sight focus (the second eye movement point position, point B) in real time, and calculates the angle formed between point A, point B and point C, as well as the straight-line distance from point B to point C. These measurement results, namely the angle of angle ABC and the distance from point B to point C, constitute sequential visual tracking image parameters, which are used to evaluate the subject's visual tracking speed and accuracy. For example, if the subject can accurately track the ball in a short time, the angle will be close to 0 degrees and the distance will be short, indicating that the subject has good visual tracking ability.

[0195] The visual tracking frame parameter acquisition device 304 is used to obtain the visual tracking frame parameters according to the position of the visual tracking image, the second eye movement point position and the position of the visual tracking frame;

[0196] It should be noted that the position of the visual tracking image refers to the coordinate position of the target image on the interface used to guide the subject's line of sight in the visual tracking test. This position will change as the test progresses. The position of the visual tracking frame refers to the position of the frame on the visual tracking test interface that is used to define the tracking area or indicate the tracking target. The visual tracking frame parameters are calculated based on the position of the visual tracking image, the position of the second eye movement point, and the position of the visual tracking frame, and are used to evaluate the subject's visual tracking ability. The visual tracking frame parameters may include tracking accuracy, stability, and reaction time.

[0197] The visual tracking point parameter acquisition device 305 is used to obtain the visual tracking point parameters according to the second eye movement point position, the position of the visual tracking point and the position of the test mark;

[0198] It should be noted that the position of the visual tracking point refers to the coordinate position of the target point on the interface used for tracking in the visual tracking test. The position of the test mark refers to the position of the mark used to indicate the subject's gaze point at the beginning of the visual tracking test. The visual tracking point parameters are calculated based on the position of the second eye movement point, the position of the visual tracking point, and the position of the test mark, and are used to evaluate the subject's visual tracking ability. The visual tracking point parameters may include tracking accuracy, stability, and reaction time.

[0199] The visual tracking parameter acquisition device 306 is used to use one of the sequential visual tracking image parameters, the visual tracking frame parameters and the visual tracking point parameters as a visual tracking parameter.

[0200] In addition, it should be noted that the visual tracking parameter is a parameter selected from the sequential visual tracking image parameter, the visual tracking frame parameter, and the visual tracking point parameter, which is used to comprehensively evaluate the visual tracking ability of the subject. The selection conditions include but are not limited to the tracking accuracy, speed, persistence, and reaction time.

[0201] It is understood that if the focus of the test is to evaluate the subject's ability to track a fast-moving target, then the sequential visual tracking image parameter may be selected as the visual tracking parameter. If the focus of the test is to evaluate the subject's ability to focus in a complex visual environment, then the visual tracking box parameter may be selected as the visual tracking parameter. If the focus of the test is to evaluate the subject's ability to accurately fixate on a static target, then the visual tracking point parameter may be selected as the visual tracking parameter.

[0202] In this way, the visual tracking parameter acquisition device provides a comprehensive evaluation result to more accurately assess the subject's visual tracking ability, which is of great significance for the diagnosis and evaluation of visual processing disorders, attention deficits or visual-motor coordination problems.

[0203] In a feasible implementation manner, the visual tracking interface generating device includes a visual tracking frame interface generating device; the visual tracking frame parameter acquiring device includes a relative position acquiring device;

[0204] The visual tracking frame interface generating device is used to generate a visual tracking frame interface according to the initial visual tracking interface and the visual tracking frame;

[0205] It should be noted that the visual tracking frame interface is the final generated interface that includes the visual tracking frame, which is the part of the environment that the subjects directly interact with during the visual tracking test.

[0206] The relative position acquisition device is used to obtain the relative position of the image eye movement point according to the position of the visual tracking image and the position of the second eye movement point;

[0207] It should be noted that the position of the visual tracking image refers to the exact coordinates of the target image on the visual tracking test interface. This position changes dynamically, and the visual tracking image will move on the screen.

[0208] In addition, it should be noted that the position of the second eye point refers to the latest position of the subject's eye point captured in real time by the eye tracking system during the test. This eye point represents the focus of the subject's current line of sight.

[0209] It should be noted that the relative position of the eye movement point in the image is calculated by comparing the position of the visual tracking image with the position of the second eye movement point. This parameter reflects the accuracy of the subject's line of sight and the ability to track the target.

[0210] The relative position acquisition device is further used to obtain the relative position of the eye movement point of the tracking frame according to the position of the visual tracking frame and the position of the second eye movement point;

[0211] It should be noted that the relative position of the eye point in the tracking frame refers to the relative position between the subject's eye point and the visual tracking frame. The tracking frame is usually a static interface element. Under ideal test conditions, the subject's line of sight should remain within this frame.

[0212] The visual tracking frame parameter acquisition device is also used to obtain the visual tracking frame parameters according to the relative position of the eye movement point of the image and the relative position of the eye movement point of the tracking frame.

[0213] It should be noted that the visual tracking frame parameters are parameters calculated based on the relative position of the eye points in the image and the relative position of the eye points in the tracking frame, and are used to evaluate the subject's visual tracking ability, including but not limited to tracking accuracy, stability and persistence.

[0214] It is understandable that the visual tracking frame parameter evaluation method includes but is not limited to the patient's quasi-second eye movement point position coincident with the position of the visual tracking image within 2S; the second eye movement point is located in the visual tracking frame where the visual tracking image is located, but the position of the second eye movement point cannot coincide with the position of the visual tracking image; the second eye movement point cannot be located in the visual tracking frame where the visual tracking image is located within 2S. Only ensure that the visual tracking image appears 3 times in the visual tracking frame, a total of 72 rounds, and the visual tracking image cannot appear 3 times in succession in each visual tracking frame. The visual tracking frame parameters are obtained based on the average test level of each visual tracking frame.

[0215] In a specific implementation, the subject faces the test interface and first looks at the cross logo in the center. After the test starts, the cross logo disappears, and a blue box, i.e., the visual tracking image, is randomly generated on the screen and lasts for 2 seconds. The subject's task is to quickly shift his sight to the box, and the subject's sight, i.e., the second eye movement point, needs to be monitored in real time and compared with the position of the box. If the subject successfully locates the sight in the box and coincides with the box within 2 seconds, it is recorded as a completely correct response; if the sight is in the box but does not coincide with the box, it is recorded as a partially correct response; if the sight fails to locate the box, it is recorded as an incorrect response. The blue box will stay on the screen for 1 second. When the time exceeds 1 second or the subject accurately looks at the blue box, the blue box will disappear and the cross will appear again. The subject needs to look at the central cross again for 300 milliseconds, and repeat the above test process and search for the blue box again. The test was conducted for a total of 72 rounds, and the visual tracking image appeared randomly 3 times in each box, but it would not appear in the same box 3 times in a row to ensure the randomness and challenge of the test. By analyzing these data, the visual tracking frame parameters are finally obtained to evaluate the subjects' visual tracking ability and reaction speed.

[0216] Please refer to Figure 6 , Figure 6 This is a schematic diagram of visual tracking frame parameter acquisition according to the third embodiment of the unilateral neglect parameter acquisition device based on visual spatial cognition of the present application.

[0217] like Figure 6 As shown in the figure, there is a red cross in the center of the visual tracking frame interface as a test mark, which is used to indicate the starting point of the subject's gaze. Surrounding the center is a tracking interface composed of multiple visual tracking frames, which represent the target area that the subject needs to focus on in the visual tracking test. The eye indicates the position of the second eye movement point, and the blue box indicates the position of the visual tracking image.

[0218] In a feasible implementation manner, the visual tracking interface generating device further comprises a visual tracking point interface generating device; the visual tracking point parameter acquiring device comprises a visual tracking angle acquiring device;

[0219] The visual tracking point interface generating device is used to generate a visual tracking point interface according to the initial visual tracking interface and a preset number of visual tracking points;

[0220] It should be noted that the visual tracking point interface is the final generated interface, which includes all the preset number of visual tracking points. This interface is the environment in which the subject directly interacts in the visual tracking test. In this embodiment, the number of visual tracking points is 25.

[0221] The visual tracking angle acquisition device is used to obtain the visual tracking angle according to the position of the visual tracking point, the position of the test mark and the position of the second eye movement point;

[0222] It should be noted that the position of the visual tracking point refers to the exact coordinate position of the target point on the interface used to guide the subject's gaze movement in the visual tracking test. The position of the test mark refers to the position of the mark used to indicate the subject's gaze point at the beginning of the visual tracking test. The visual tracking angle is an angle calculated based on the position of the visual tracking point, the position of the test mark, and the position of the second eye movement point, and is used to evaluate the accuracy and angle deviation of the subject's gaze tracking target.

[0223] It can be understood that by taking the position of the visual tracking point as point A, the position of the test mark as point B, and the position of the second eye movement point as point C. The visual tracking angle is angle ABC, and if the angle ABC is greater than or equal to 1 degree, it is considered that the angle deviation is too large.

[0224] The visual tracking point parameter acquisition device is further used to obtain the visual tracking point parameter according to the visual tracking angle.

[0225] It should be noted that the visual tracking point parameters are calculated based on the visual tracking angle and are used to evaluate the performance of the subject in the visual tracking task. These parameters may include the accuracy of the tracking point, tracking speed, angle deviation, reaction time, etc.

[0226] In the specific implementation process, when the subject's eyes focus on the central fixed cross for 300 milliseconds, the cross disappears. 500 milliseconds after the cross disappears, a blue box appears on the visual tracking point of the visual tracking point interface, which is the visual tracking image. The blue box stays on the screen for 1 second. When the time exceeds 1 second or the subject accurately stares at the blue box, the blue box disappears and the cross appears again. The subject needs to stare at the central cross again for 300 milliseconds, repeat the above test process and search for the blue box again.

[0227] Please refer to Figure 7 , Figure 7 This is a schematic diagram of visual tracking point parameter acquisition according to the third embodiment of the unilateral neglect parameter acquisition device based on visual spatial cognition of the present application.

[0228] like Figure 7 As shown, first the subject fixates on the central red test mark for 300 milliseconds, then a blue box appears on the visual tracking point of the blue dot and lasts for 1 second, after which the blue box disappears and the subject fixates on the test mark again for 300 milliseconds. This process may be repeated in the visual tracking test to evaluate the subject's fixation accuracy and reaction time on the visual tracking point at different time points.

[0229] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the unilateral neglect parameter acquisition device based on visual spatial cognition. More simple transformations based on this technical concept are all within the protection scope of the present application.

Claims

1. A unilateral neglect parameter acquisition device based on visual spatial cognition, characterized in that: The device comprises: a target shooting test device, a visual space position relationship test device, a visual tracking test device and a parameter acquisition device; The target shooting test device is used to obtain the target shooting parameters according to the bull's eye position, the eye position, the first eye movement point position and the target shooting hand position; The visual space position relationship testing device is used to obtain the visual space position relationship parameters according to the relative position description parameters and the relative position movement parameters; The visual tracking test device is used to obtain visual tracking parameters according to the position of the visual tracking image and the second eye movement point position; The parameter acquisition device is used to obtain a unilateral neglect parameter according to the target shooting parameter, the visual space position relationship parameter and the visual tracking parameter; The visual space position relationship testing device comprises a relative position generating device, a relative position describing device, a relative position moving device and a visual space position relationship parameter acquiring device; The relative position generating device is used to generate a preset polyhedron and a preset three-dimensional object, and obtain a first relative position and a second relative position according to the position of the preset polyhedron and the position of the preset three-dimensional object; The relative position description device is used to obtain a relative position description parameter according to the position of the preset three-dimensional object in the relative position description instruction and the first relative position; The relative position moving device is used to move the preset three-dimensional object according to the first relative position and the second relative position, and obtain a relative position moving parameter according to a result of the movement; The visual space position relationship parameter acquisition device is used to obtain the visual space position relationship parameter according to the relative position description parameter and the relative position movement parameter.

2. The device according to claim 1, characterized in that The target shooting test device includes a bull's eye generating device, a shooting angle acquiring device, an eye movement trajectory generating device and a target shooting parameter acquiring device; The bull's eye generating device is used to generate a bull's eye according to a preset motion trajectory and display the bull's eye on the target shooting test interface; The shooting angle acquisition device is used to acquire the bull's eye position, the eye position, the first eye movement point position and the shooting hand position according to the shooting instruction and the bull's eye position, so as to obtain the shooting angle; The eye movement trajectory generating device is used to obtain an eye heat map according to the first eye movement point position; The target shooting parameter acquisition device is used to obtain the target shooting parameters according to the shooting angle and the eye thermal map.

3. The device according to claim 2, characterized in that The shooting angle acquisition device includes a gaze angle acquisition device and a gesture angle acquisition device; The gaze angle acquisition device is used to obtain the gaze angle according to the bull's eye position, the eye position and the first eye movement point position; The gesture angle acquisition device is used to obtain the gesture angle according to the bull's eye position, the eye position and the shooting hand position; The shooting angle acquisition device is further used to use one of the gaze angle and the gesture angle as the shooting angle.

4. The device according to claim 1, characterized in that The relative position moving device comprises a polyhedron relative position moving device and a track relative position moving device; The polyhedron relative position moving device is used to move the preset three-dimensional object according to the first relative position and the preset polyhedron to obtain the polyhedron relative position moving parameters; The track relative position moving device is used to obtain a preset track position according to the preset polyhedron, and to move the preset three-dimensional object according to the second relative position and the preset track position to obtain track relative position moving parameters; The visual space position relationship parameter acquisition device is further used to use one of the polyhedron relative position movement parameter and the track relative position movement parameter as the relative position movement parameter.

5. The device according to claim 4, characterized in that The polyhedron relative position moving device comprises a polyhedron moving device, a polyhedron relative position recording device and a polyhedron relative position moving parameter acquiring device; The polyhedron moving device is used to move the preset three-dimensional object according to the first relative position; The polyhedron relative position recording device is used to record the relative position of the preset three-dimensional object and the polyhedron target of the preset polyhedron after the movement; The polyhedron relative position movement parameter acquisition device is used to obtain the polyhedron relative position movement parameters according to the relative position of the polyhedron target.

6. The device according to claim 4, characterized in that The track relative position moving device comprises a track generating device, a track moving device, a track relative position recording device, a color matching device and a track relative position moving parameter acquiring device; The track generating device is used to generate preset tracks of preset colors and numbers on two faces of the preset polyhedron respectively; The track moving device is used to move the preset three-dimensional object according to the second relative position, the color of the preset three-dimensional object, the position of the preset track and the color of the preset track; The track relative position recording device is used to record the track relative position of the preset three-dimensional object and the preset track after the movement; The color matching device is used to match the color of the preset three-dimensional object after the movement with the color of the preset track to obtain a color matching result; The track relative position movement parameter acquisition device is used to obtain the track relative position movement parameter according to the track relative position and the color matching result.

7. The device according to claim 1, characterized in that The visual tracking test device includes a visual tracking interface generating device, a visual tracking image generating device, a visual tracking image generating device, a sequential visual tracking image parameter acquiring device, a visual tracking frame parameter acquiring device, a visual tracking point parameter acquiring device, and a visual tracking parameter acquiring device; The visual tracking interface generating device is used to generate a visual tracking interface according to the initial visual tracking interface, the visual tracking frame and a preset number of visual tracking points; The visual tracking image generating device is used to generate a test mark in the middle of the visual tracking interface, hide the test mark when a preset time period has passed, and generate a visual tracking image on the visual tracking interface; The visual tracking image generating device is further used to obtain a preset visual tracking image generating position according to the initial visual tracking interface and the preset visual tracking image generating order, and generate sequential visual tracking images according to the preset visual tracking image generating position; The sequential visual tracking image parameter acquisition device is used to obtain the sequential visual tracking image parameters according to the eye position, the second eye movement point position and the sequential visual tracking image; The visual tracking frame parameter acquisition device is used to obtain the visual tracking frame parameters according to the position of the visual tracking image, the second eye movement point position and the position of the visual tracking frame; The visual tracking point parameter acquisition device is used to obtain the visual tracking point parameters according to the second eye movement point position, the position of the visual tracking point and the position of the test mark; The visual tracking parameter acquisition device is used to use one of the sequential visual tracking image parameters, the visual tracking frame parameters and the visual tracking point parameters as a visual tracking parameter.

8. The device according to claim 7, characterized in that The visual tracking interface generating device includes a visual tracking frame interface generating device; the visual tracking frame parameter acquiring device includes a relative position acquiring device; The visual tracking frame interface generating device is used to generate a visual tracking frame interface according to the initial visual tracking interface and the visual tracking frame; The relative position acquisition device is used to obtain the relative position of the image eye movement point according to the position of the visual tracking image and the position of the second eye movement point; The relative position acquisition device is further used to obtain the relative position of the eye movement point of the tracking frame according to the position of the visual tracking frame and the position of the second eye movement point; The visual tracking frame parameter acquisition device is also used to obtain the visual tracking frame parameters according to the relative position of the eye movement point of the image and the relative position of the eye movement point of the tracking frame.

9. The device according to claim 7, characterized in that The visual tracking interface generating device further comprises a visual tracking point interface generating device; the visual tracking point parameter acquiring device comprises a visual tracking angle acquiring device; The visual tracking point interface generating device is used to generate a visual tracking point interface according to the initial visual tracking interface and a preset number of visual tracking points; The visual tracking angle acquisition device is used to obtain the visual tracking angle according to the position of the visual tracking point, the position of the test mark and the position of the second eye movement point; The visual tracking point parameter acquisition device is further used to obtain the visual tracking point parameter according to the visual tracking angle.

Images