A method, system and device for formulating a visual neural training program

Abstract

The embodiments of the present specification provide a method, system and device for formulating a visual nerve training program, the method comprising obtaining a stimulation content list of a target object, the stimulation content list comprising position information of a plurality of stimulation contents used for performing visual nerve training on a target eye of the target object; presenting a target stimulation content from a plurality of stimulation contents to a target eye of the target object via a virtual reality display device, the display position of the target stimulation content being determined based on its position information in the stimulation content list; updating the stimulation content list based on feedback information of the target object on the target stimulation content, so as to generate an updated stimulation content list for the next round of visual nerve training, the updated stimulation content list comprising position information of a plurality of updated stimulation contents.

Description

Technical Field

[0001] The present invention relates to the field of visual training, and in particular to a method, system and device for formulating a visual nerve training program. Background Art

[0002] Damage to the optic nerve in the brain may lead to impaired visual spatial discrimination and contrast discrimination abilities, and the natural repair capacity of the optic nerve is limited. It is usually necessary to intervene with drugs or perform surgery on the patient's optic nerve, or use specific visual training methods to help the patient achieve maximum recovery or improvement.

[0003] In the field of visual training and rehabilitation, with the deepening of scientific research, the results show that after visual training, the patients' visual field has been significantly improved, the visual field has been expanded, and the ability to identify objects and colors has been enhanced. Visual training has received widespread attention because it has the advantages of no drug intervention, high safety, and is suitable for people of all ages.

[0004] However, many factors such as individual age, gender, area of ​​visual field damage and its severity affect the effect of rehabilitation. Therefore, the training program needs to be personalized according to the actual situation of different individuals. At the same time, as the training progresses, the training content, training intensity, training duration, etc. also need to be adjusted according to the results of different training stages. In addition, traditional training often requires patients to go to a specific training place (such as a hospital) and conduct it with the assistance of a doctor. This limitation affects the convenience of training, may delay the treatment cycle, and even affect the effect of treatment.

[0005] Therefore, a method, system and device for formulating a visual nerve training program are provided, which can provide personalized training programs for different patients, and can also collect training feedback results in real time and quickly to dynamically adjust the training program, thereby improving training efficiency and treatment effects. Summary of the invention

[0006] One of the embodiments of the present specification provides a method for formulating a visual nerve training program, comprising: obtaining a stimulation content list of a target object, the stimulation content list comprising position information of a plurality of stimulation contents for performing visual nerve training on a target eye of the target object; presenting a target stimulation content from the plurality of stimulation contents to the target eye of the target object via a virtual reality display device, the display position of the target stimulation content being determined based on its position information in the stimulation content list; updating the stimulation content list based on feedback information of the target object on the target stimulation content, so as to generate an updated stimulation content list for the next round of visual nerve training, the updated stimulation content list comprising position information of a plurality of updated stimulation contents.

[0007] In some embodiments, the stimulation content list is generated based on the following steps: acquiring a visual field diagnostic image of the target object, the visual field diagnostic image displaying an impaired visual field area, a normal area, and a transition area between the impaired visual field area and the normal area of ​​the target eye; based on the visual diagnostic image, generating the stimulation content list, wherein, among the multiple stimulation contents, the density of the stimulation content located in the transition area, the stimulation content located in the impaired visual field area, and the stimulation content located in the normal area decreases in sequence.

[0008] In some embodiments, updating the stimulation content list based on the feedback information of the target object on the target stimulation content to generate an updated stimulation content list includes: dividing the impaired visual field area and the transition area into multiple sub-areas; determining the visual sensitivity and feedback accuracy of the stimulation content list based on the feedback information; and updating the stimulation content list based on the visual sensitivity and the feedback accuracy to generate the updated stimulation content list.

[0009] In some embodiments, the impaired visual field area and the transition area are divided into multiple sub-areas, the visual sensitivity and feedback accuracy include the visual sensitivity and feedback accuracy of each of the sub-areas, and updating the stimulation content list based on the visual sensitivity and the feedback accuracy includes: for each of the sub-areas, based on the visual sensitivity and the feedback accuracy of the sub-area, updating the density of the stimulation content in the sub-area.

[0010] In some embodiments, the method further includes: updating the training level based on the feedback information; and determining the display size of each updated stimulation content in the updated stimulation content list based on the updated training level and the position information of the updated stimulation content.

[0011] In some embodiments, the method further comprises: for each updated stimulation content in the updated stimulation content list, determining the display brightness of the updated stimulation content based on the position information of the updated stimulation content and the visual field diagnostic image of the target object.

[0012] In some embodiments, the method further comprises: while presenting the target stimulation content to the target eye of the target object, simultaneously presenting a cursor image to the target eye and a non-target eye of the target object via the virtual reality display device.

[0013] In some embodiments, the target stimulation content includes a fixed stimulation icon and a stimulation line for indicating the position of the stimulation icon; or the target stimulation content includes a rotating stimulation icon and a plurality of stimulation lines dispersed around the stimulation icon.

[0014] One of the embodiments of the present specification provides a system for formulating a visual nerve training program, including: an acquisition module, used to acquire a stimulation content list of a target object, the stimulation content list including position information of multiple stimulation contents used for visual nerve training of a target eye of the target object; a display module, used to present target stimulation content from the multiple stimulation contents to the target eye of the target object via a virtual reality display device, the display position of the target stimulation content being determined based on its position information in the stimulation content list; an update module, used to update the stimulation content list based on feedback information of the target object on the target stimulation content, so as to generate an updated stimulation content list for the next round of visual nerve training, the updated stimulation content list including position information of multiple updated stimulation contents.

[0015] One of the embodiments of the present specification provides a device for formulating a visual nerve training program, including a processor, wherein the processor is used to execute the above-mentioned method for formulating a visual nerve training program. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] This specification will be further described in the form of exemplary embodiments, which will be described in detail by the accompanying drawings. These embodiments are not restrictive, and in these embodiments, the same number represents the same structure, wherein:

[0017] Figure 1 is a schematic diagram of a system for formulating a visual neural training program according to some embodiments of the present specification;

[0018] Figure 2 is an exemplary module diagram of a system for formulating a visual neural training program according to some embodiments of this specification;

[0019] Figure 3a is an exemplary flow chart of a method for formulating a visual neural training program according to some embodiments of this specification;

[0020] Figure 3b is an exemplary schematic diagram of a cursor image according to some embodiments of this specification

[0021] Figure 4 is an exemplary schematic diagram of a method for updating a stimulus content list according to some embodiments of this specification;

[0022] Figure 5ais a schematic diagram of target stimulation content according to some embodiments of this specification;

[0023] Figure 5b It is a schematic diagram of another target stimulation content shown in some embodiments of this specification. DETAILED DESCRIPTION

[0024] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the following is a brief introduction to the drawings required for the description of the embodiments. Obviously, the drawings described below are only some examples or embodiments of this specification. For ordinary technicians in this field, this specification can also be applied to other similar scenarios based on these drawings without creative work. Unless it is obvious from the language environment or otherwise explained, the same reference numerals in the figures represent the same structure or operation.

[0025] It should be understood that the "system", "device", "unit" and / or "module" used herein are a method for distinguishing different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the words can be replaced by other expressions.

[0026] Unless the context clearly indicates an exception, the words "a", "an", "an" and / or "the" do not refer to the singular and may also include the plural. Generally speaking, the terms "include" and "comprise" only indicate the inclusion of the steps and elements that have been clearly identified, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0027] Flowcharts are used in this specification to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or following operations are not necessarily performed precisely in order. Instead, the steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes, or one or more operations may be removed from these processes.

[0028] Figure 1 It is a schematic diagram of a system for formulating a visual neural training program according to some embodiments of the present specification.

[0029] like Figure 1 As shown, the application scenario 100 of the system for formulating a visual neural training program may include an interactive device 110 , a network 120 , a terminal 130 , a processing device 140 and a storage device 150 .

[0030] The interactive device 110 may refer to a device that provides virtual reality services to users. The interactive device 110 may include various VR devices, keyboards, mice, handles, etc., or a combination thereof. Figure 1As shown, the interactive device 110 may include a display component 111 and an input component 112 .

[0031] The display component 111 can be used to view virtual content (such as visual stimulation content). In some embodiments, the display component 111 can include Figure 1 The VR devices shown (such as VR helmets, VR glasses, naked-eye 3D display devices) or other display devices (such as display screens), etc.

[0032] In some embodiments, the user can interact with the virtual content through the display component 111. For example, when the user wears the display component 111, the display component 111 can track the user's head movement and / or gaze direction, thereby presenting screen content for visual training of the user, thereby providing an immersive visual training experience that visually stimulates the user.

[0033] The input component 112 can enable a user (such as a trainee, a patient, etc.) to interact with virtual content (such as visual stimulation content) displayed on the display component 111. For example, the input component 112 can include a VR device (such as a VR glove) or other devices configured to receive user input (such as a keyboard, a mouse, a somatosensory control handle, a microphone, a touch sensor, etc.).

[0034] The input component 112 can obtain data and / or instructions input by the user. In some embodiments, the user can provide feedback on the visual stimulation content through the input component 112. For example, the position, color, rotation direction and other information of the stimulation content can be fed back through the input component 112.

[0035] In some embodiments, the display component 111 (or the processing device 120) can receive input signals from the input component 112 via a wired or wireless network, and update the visual stimulation content (such as the position, brightness, shape, size, etc. of the stimulation content) to realize an interactive process of visual training for the user.

[0036] The network 120 may include any suitable network that facilitates information and / or data exchange of the application scenario 100. In some embodiments, one or more components of the application scenario 100 (e.g., the interactive device 110, the terminal 130, the processing device 140, or the storage device 150) may transmit information and / or data to one or more other components of the application scenario 100 via the network 120. For example, the processing device 140 may obtain user feedback information on the stimulus content in the visual training from the interactive device 110 via the network 120. In some embodiments, the network 120 may be any one or more of a wired network or a wireless network. In some embodiments, the network may be a point-to-point, shared, centralized, or other topological structure or a combination of multiple topological structures.

[0037] The terminal 130 may include a mobile device 130-1, a tablet computer 130-2, a laptop computer 130-3, etc., or any combination thereof. In some embodiments, the terminal 130 may interact with other components in the application scenario 100 through the network 120. For example, the terminal 130 may receive data such as user feedback information sent by the interactive device 110. In some embodiments, the terminal 130 may receive information and / or instructions input by a user (such as a doctor, or a trainee, or a patient), and send the received information and / or instructions to the processing device 140 via the network 120. For example, a doctor may plan or adjust visual stimulation content (such as the position of the stimulation content, the brightness of the stimulation content, and the size) through the terminal 130 according to the visual training conditions of the patient at different stages.

[0038] In some embodiments, the terminal 130 may display the patient's training progress, training effect evaluation report, etc. For example, information such as visual sensitivity, feedback accuracy, and overall training effect evaluation results may be displayed.

[0039] The processing device 140 can process data and / or information obtained from the interactive device 110, the terminal 130 and / or the storage device 150. For example, the processing device 140 can obtain feedback information of the user on the stimulation content in the visual training through the interactive device 110. In some embodiments, the processing device 140 can process the stimulation content. For example, generate a list of stimulation content, adjust the display brightness and size of the target stimulation content, etc. In some embodiments, the processing device 140 can obtain data and / or instructions from the terminal 130 and perform corresponding processing. For example, update the list of stimulation content according to the adjustment instruction of the stimulation content by the user (such as a patient and / or a doctor, etc.).

[0040] In some embodiments, processing device 140 may be a single server or a server group. The server group may be centralized or distributed. In some embodiments, processing device 140 may be local or remote. Processing device 140 may be directly connected to interactive device 110, terminal 130, and storage device 150 to access stored or acquired information and / or data. In some embodiments, processing device 140 may be implemented on a cloud platform. As an example only, a cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an internal cloud, a multi-layer cloud, etc., or any combination thereof. In some embodiments, processing device 140 may be a part of interactive device 110.

[0041] The storage device 150 may store data and / or instructions. In some embodiments, the storage device 150 may store data obtained from the interactive device 110, the terminal 130 and / or the processing device 140. For example, the storage device 150 may store user feedback information obtained by the interactive device 110, etc. For another example, the storage device 150 may store the stimulus content of visual training and its corresponding parameter configuration (such as position, brightness, size), etc. In some embodiments, the storage device 150 may store data and / or instructions used by the processing device 140 to execute the exemplary methods described in this specification. For example, the storage device 150 may store instructions for the processing device 140 to execute the methods shown in each flowchart. In some embodiments, the storage device 150 may include a large-capacity storage device, a removable storage device, a volatile read-write memory, a read-only memory (ROM), etc., or any combination thereof. In some embodiments, the storage device 150 may be implemented on a cloud platform. In some embodiments, the storage device 150 may be part of the processing device 140.

[0042] The above description is for illustrative purposes only, and actual application scenarios may vary.

[0043] It should be noted that the application scenario 100 is provided for illustrative purposes only and is not intended to limit the scope of the present application. For those of ordinary skill in the art, various modifications or variations can be made according to the description of this specification. However, these variations and modifications will not deviate from the scope of the present application.

[0044] Figure 2 It is an exemplary module diagram of a system for formulating a visual neural training program according to some embodiments of this specification.

[0045] like Figure 2 As shown, the visual neural training program formulation system 200 (hereinafter referred to as the training system) may include an acquisition module 210, a display module 220 and an update module 230. In some embodiments, the training system may be composed of Figure 1 The processing device 140 is shown to implement.

[0046] The acquisition module 210 is used to acquire a stimulation content list of the target object, where the stimulation content list includes position information of a plurality of stimulation contents used for performing visual nerve training on a target eye of the target object.

[0047] In some embodiments, the acquisition module 210 can also be used to acquire a visual field diagnostic image of the target object, which displays the damaged visual field area, normal area, and transition area between the damaged visual field area and the normal area of ​​the target eye, and based on the visual diagnostic image, generates a list of stimulation contents, wherein, among the multiple stimulation contents, the density of the stimulation contents located in the transition area, the stimulation contents located in the damaged visual field area, and the stimulation contents located in the normal area decreases in sequence.

[0048] The display module 220 is used to present target stimulation content from among the multiple stimulation contents to the target eye of the target object via a virtual reality display device, and the display position of the target stimulation content is determined based on its position information in the stimulation content list.

[0049] In some embodiments, the target stimulation content includes a fixed stimulation icon and a stimulation line for indicating the position of the stimulation icon, or the target stimulation content includes a rotating stimulation icon and a plurality of stimulation lines dispersed around the stimulation icon.

[0050] In some embodiments, the display module 220 may also be configured to: while presenting the target stimulation content to the target eye of the target object, simultaneously present a cursor image to the target eye and non-target eye of the target object via a virtual reality display device.

[0051] The updating module 230 is used to update the stimulation content list based on the feedback information of the target object on the target stimulation content, so as to generate an updated stimulation content list for the next round of visual nerve training, and update the location information of multiple updated stimulation contents in the stimulation content list.

[0052] In some embodiments, the update module 230 can also be used to divide the visual field impaired area and the transition area into multiple sub-areas; determine the visual sensitivity and feedback accuracy of the stimulation content list based on the feedback information; and update the stimulation content list based on the visual sensitivity and feedback accuracy to generate an updated stimulation content list.

[0053] In some embodiments, the visual field impaired area and the transition area are divided into multiple sub-areas, and the visual sensitivity and feedback accuracy may include the visual sensitivity and feedback accuracy of each sub-area. The updating module 230 may be further used to: for each sub-area, based on the visual sensitivity and feedback accuracy of the sub-area, update the density of the stimulus content in the sub-area.

[0054] In some embodiments, the updating module 230 may also be used to: update the training level based on the feedback information; and determine the display size of each updated stimulation content in the updated stimulation content list based on the updated training level and the location information of the updated stimulation content.

[0055] In some embodiments, the update module 230 can be further used to: determine the target training level based on a first weight corresponding to the visual sensitivity and a second weight corresponding to the feedback accuracy, wherein the first weight is greater than the second weight, and update the training level based on the target training level.

[0056] In some embodiments, the updating module 230 may also be configured to: for each updated stimulation content in the updated stimulation content list, determine the display brightness of the updated stimulation content based on the position information of the updated stimulation content and the visual field diagnostic image of the target object.

[0057] In some embodiments, the training system may further include an analysis module 240 for performing feedback analysis on the feedback information to generate an updated stimulation content list.

[0058] In some embodiments, the analysis module 240 may be further used to generate an analysis report based on the feedback information of the target object, and to evaluate the visual rehabilitation effect of the target object.

[0059] In some embodiments, the training system may further include a timing module 250 for determining the duration of the stimulus response of the target object.

[0060] It should be noted that the above description of the training system and its modules is only for the convenience of description and does not limit this specification to the scope of the embodiments. It is understandable that for those skilled in the art, after understanding the principle of the system, it is possible to arbitrarily combine the modules or form a subsystem to connect with other modules without deviating from this principle. For example, the acquisition module 210, the display module 220 and the update module 230 can be different modules in the system, or one module can realize the functions of two or more of the above modules. For example, each module can share a storage module, or each module can have its own storage module. Such variations are all within the scope of protection of this specification.

[0061] Figure 3a It is an exemplary flow chart of a method for formulating a visual neural training program according to some embodiments of this specification.

[0062] In some embodiments, process 300 may be used for visual neural training. Visual neural training generally includes one or more rounds of training. In each round of training, process 300 may be executed to update the neural training scheme for the next round of visual neural training (hereinafter referred to as visual training). In some embodiments, process 300 may be executed by a training system. Figure 3a As shown, process 300 includes the following steps.

[0063] Step 310: Acquire a stimulation content list of the target object, where the stimulation content list includes position information of a plurality of stimulation contents used for performing visual nerve training on a target eye of the target object.

[0064] The target object refers to a trainee who needs visual nerve training to restore or enhance visual function. For example, it can be a person with visual field loss, a patient with amblyopia, or any other individual who needs visual training.

[0065] The target eye refers to the eye of the target object that will undergo visual training. For example, the left eye and / or the right eye. In some embodiments, the target eye can be one of the eyes, and the other is a non-target eye.

[0066] The stimulus content list is a collection of information related to multiple stimulus contents. The stimulus contents can be used to stimulate the target eyes to obtain the response information of the target object. The stimulus contents can include various forms of visual information, including but not limited to text, images, videos, etc.

[0067] In some embodiments, the stimulation content can be determined based on the actual conditions of different target objects. For example, the corresponding stimulation content can be determined based on the age, gender, etc. of the target object. The stimulation content can also be determined or changed based on the visual training conditions of the target object at different stages.

[0068] In some embodiments, when performing the first round of visual nerve training, the stimulus content list used may be generated before the entire visual nerve training (e.g., generated based on the visual field diagnostic image described below). When performing the second and subsequent rounds of visual training, the stimulus content list used may be the stimulus content list updated in the previous round of visual training.

[0069] In some embodiments, the training system can obtain a visual field diagnostic image of the target object, which displays the damaged visual field area, the normal area, and the transition area between the damaged visual field area and the normal area of ​​the target eye; and based on the visual diagnostic image, a list of stimulation contents is generated. Among the multiple stimulation contents, the density of the stimulation contents located in the transition area, the stimulation contents located in the damaged visual field area, and the stimulation contents located in the normal area decreases in sequence. In other words, the most dense stimulation contents can be set for the transition area, the second densest stimulation contents can be set for the damaged visual field area, and the least dense stimulation contents can be set for the normal area.

[0070] The visual field diagnostic image can be used to reflect the visual field damage of the target object. It may include information such as the distribution and area size of the damaged visual field area, normal area, and transition area. The damaged visual field area is the visual area that the target eye cannot correctly perceive, the normal area is the visual area that the target eye can correctly perceive, and the transition area is the area between the damaged visual field area and the normal area. There is uncertainty in the target eye's perception of the transition area, and the transition area is the key area for visual nerve training. Exemplarily, for a glaucoma patient, the visible visual field area (the patient's normal area) is located in the middle area of ​​the patient's forward visual field; the peripheral area of ​​the middle area is the damaged visual field area that the patient cannot perceive.

[0071] In some embodiments, the training system may determine a visual field diagnostic image based on the visual detection result of the target object. The visual detection may be a pre-training medical examination (such as an examination in a hospital), a visual field examination (such as a detection based on a preset diagnostic image, etc.). For example, diagnostic content (similar to the stimulation content) may be presented at different locations within the visual field of the target eye to determine whether different locations within the visual field of the target eye are damaged, thereby obtaining its visual detection result.

[0072] In some embodiments, the training system can adjust the position, size, etc. of each area in the visual field diagnostic image according to the visual training of the target eye. For example, when the training effect of a certain stage (or a certain round of training) is good (such as the feedback result accuracy of the stimulus content is high), the boundary / contour of the transition area can be gradually extended in the direction of the damaged visual field area. In other words, the range of the normal area will be expanded, and the range of the damaged visual field area will be reduced.

[0073] In some embodiments, when generating a visual diagnostic image, the initial impaired visual field area and the initial normal area of ​​the target eye can be first determined based on the visual detection results; and then the impaired visual field area, the normal area and the transition area can be determined based on the initial impaired visual field area and the initial normal area. Exemplarily, if the initial impaired visual field area is large, it indicates that the visual field defect of the target eye is more serious, and the area of ​​its transition area can be set smaller to reduce the intensity of training. At this time, a smaller part of the initial impaired visual field area and / or the initial normal area can be divided out as a transition area. For another example, for the initial impaired visual field area located directly in front of the field of vision, a larger part of it can be divided out as a transition area to reduce the overall training cycle, thereby improving the efficiency of training.

[0074] In some embodiments, the evaluation system can perform image sampling on the visual diagnostic image to determine multiple image sampling points of the visual field damaged area, the normal area and the transition area. Each image sampling point can correspond to a range of 1 degree of the image field angle, which can correspond to the position of a stimulus content, and the image sampling point at the center of the visual diagnostic image can correspond to the center position of the visual field diagnostic image.

[0075] In some embodiments, the list of stimulation contents includes information such as position information, display size, and display brightness of each stimulation content. The position information refers to the position of the stimulation content in the diagnostic image coordinate system. The training system can determine the diagnostic image coordinate system based on the visual field diagnostic image, which can be a plane coordinate system with the center position of the visual field diagnostic image as the origin, the horizontal direction of the visual field diagnostic image as the x-axis, and the vertical direction as the y-axis.

[0076] In some embodiments, the stimulation content list only includes the location information of each stimulation content. After determining the target stimulation content to be displayed to the target eye, the training system determines the display size and display brightness of the target stimulation content. In some embodiments, the stimulation content list also includes the display size and display brightness of each stimulation content, that is, the display size and display brightness of each stimulation content can be determined in advance.

[0077] In some embodiments of this specification, a transition area is set to perform visual training on the target eye of the target object, so that the training program is more targeted for the visual field impairment; at the same time, the transition area is dynamically adjusted gradually toward the visual field impairment area according to the training effect, which can improve the training efficiency. It can be understood that the visual field impairment area near the normal area often has a better training effect and can improve the efficiency of rehabilitation.

[0078] In some embodiments, for the generated list of stimulation contents, multiple stimulation contents therein can be set with different densities or quantities according to the transition area, the impaired visual field area, and the normal area. Among them, the stimulation contents in the transition area can be set more densely, the density of the stimulation contents in the impaired visual field area is second, and the density of the stimulation contents in the normal area is the smallest, so as to increase the training intensity of the transition area and improve the training effect. At the same time, such a setting can provide an evaluation reference for feedback information. For example, for the stimulation contents in the normal area, the target object should be able to perceive and the feedback should be correct. If the feedback is incorrect, it may be necessary to adjust the parameters of the training (such as display brightness, display size, etc.), or prompt the target object to rest because the target object is too tired.

[0079] Step 320: presenting target stimulation content from among the plurality of stimulation contents to a target eye of the target object via a virtual reality display device.

[0080] The virtual reality display device refers to a device for presenting stimulus content to the target eye of the target object. For example, it can be the display component 111 (such as a VR helmet, VR glasses, etc.) of the interactive device 110. The target stimulus content refers to the stimulus content presented to the target object in this round of training, which includes one or more stimulus contents in the stimulus content list. In some embodiments, the target stimulus content can be randomly selected from the stimulus content list. In some embodiments, the stimulus content corresponding to a sub-area in the transition area can be selected in the stimulus content list as the target stimulus content to train the sub-area in this round of training.

[0081] The display position of the target stimulation content is determined based on its position information in the stimulation content list. In some embodiments, as described above, the position information in the stimulation content list is the position in the diagnostic image coordinate system. The training system can establish a training coordinate system corresponding to the target eye, and based on the mapping relationship between the training coordinate system and the diagnostic image coordinate system, convert the position of the target stimulation content in the diagnostic image coordinate system into the position in the training coordinate system. The position in the training coordinate system is the display position of the target stimulation content.

[0082] In some embodiments, the training coordinate system can be established before performing visual training on the target object. In some embodiments, the training coordinate system is a spherical coordinate system.

[0083] In some embodiments, the training system can obtain the visual information of the target object through a virtual reality display device. The visual information includes, but is not limited to, the center position between the two eyes (such as the eyebrow point), the pupil and its center position point, the distance between the centers of the pupils of the two eyes (interpupillary distance), the direction of the two eyes, the length / width of the two eyes, and other information. The training system can further establish a training coordinate system based on the visual information of the target object. Exemplarily, a spherical coordinate system with the position of the target eye as the origin, the direction of the front view as the Z axis, and the direction of the binocular eyes (i.e., the direction of the line connecting the positions of the pupils of the two eyes) as the X axis can be established as a training coordinate system.

[0084] In some embodiments, the position of the target eye can be determined based on the information of the brow center point and the pupil distance. When the target eye is the left eye, the left eye position can be obtained by offsetting the brow center point by half the pupil distance to the left eye, and the position of the left eye is used as the origin of the training coordinate system; when the target eye is the right eye, the right eye position can be obtained by offsetting the brow center point by half the pupil distance to the right eye, and the position of the right eye is used as the origin of the training coordinate system.

[0085] In some embodiments, the training system may also determine the origin of the training coordinate system based on the pupil center position of the target eye. For example, the training system may determine the pupil center position of the target eye in real time based on the eye tracking function of the virtual reality display device, and use the pupil center position as the origin.

[0086] The mapping relationship between the diagnostic image coordinate system and the training coordinate system can reflect the transformation relationship between the coordinates in the two coordinate systems. In some embodiments, the origin of the diagnostic image coordinate system corresponds to the origin of the training coordinate system, and the unit coordinate values ​​on the x and y axes of the diagnostic image coordinate system correspond to the preset field of view angle (e.g., 2°) in the training coordinate system.

[0087] In some embodiments of the present specification, a training coordinate system is constructed according to the target object and its target eye, so that the subsequent training plan can be formulated more specifically in combination with the visual field impairment of the target eye. In addition, through the virtual reality display device, the movement of the target eye can be tracked in real time or dynamically to adaptively adjust the training coordinate system to make it more accurate, and also make the training process more humane.

[0088] In some embodiments, while presenting the target stimulus content to the target eye of the target object, the target eye and the non-target eye of the target object are simultaneously presented with a cursor image via a virtual reality display device. The cursor image may be an image of a preset shape. For example, it may be a cross cursor image, a square image, a circular image, an animal-shaped image, etc., with a preset initial size and brightness. In some embodiments, the cursor image may be presented in the normal viewing direction of the target eye (i.e., on the Z axis), with its position being stationary and its shape changing slightly.

[0089] Figure 3b is an exemplary schematic diagram of a cursor image according to some embodiments of the present specification.

[0090] like Figure 3b As shown, the evaluation system presents a cursor image as a graphic image (shown in the figure as a cartoon kitten) in the visual scene of the target eye and / or non-target eye of the target object through a virtual reality display device. The graphic image can be slightly changed, for example, the cartoon kitten's arm swings, the body turns, etc. Through the slight change of the graphic image, the target object can be attracted to look straight ahead in the visual field.

[0091] In some embodiments, the field of view of the cursor image can be set to a preset field of view angle range (e.g., the horizontal and vertical field of view angles are in the range of 0.25° to 1°). The training system can adaptively adjust the distance or brightness of the cursor image from the origin of the training coordinate system in the training coordinate system so that the cursor image remains clear while maintaining its actual field of view angle at the preset field of view angle.

[0092] For the non-target eye, the training system can present a scene with a dark background and a cursor image through a virtual reality display device. The target eye is presented with the cursor image and subsequent scenes with stimulating content. By presenting the cursor image to both eyes, the target object can be better guided to look straight ahead. At the same time, physiologically, it ensures that the target eye is not affected by the non-target eye, making the target object more comfortable during the training process and improving the user experience.

[0093] In some embodiments, the training system can present a cursor image to both eyes before presenting the stimulus content, thereby guiding the user to focus on the cursor image during the entire training process to ensure that the field of vision is looking straight ahead. The training system can also provide guidance to the target object in the form of voice, text, etc.

[0094] Step 330 , based on the target object's feedback information on the target stimulation content, the stimulation content list is updated to generate an updated stimulation content list for the next round of visual neural training, wherein the updated stimulation content list includes location information of multiple updated stimulation contents.

[0095] Feedback information refers to the recognition or judgment results made by the target object on one or more stimulus contents during visual training. For example, feedback information may include but is not limited to whether the stimulus contents can be seen, the recognition results of the location, color, rotation direction, etc. of the stimulus contents.

[0096] In some embodiments, the training system may determine feedback information based on the input signal and / or input instruction of the target object obtained by the interactive device (such as the interactive device 110). For example, the feedback information is determined by obtaining information such as gestures and voices of the target object through the interactive device. Figure 1 and its description.

[0097] It should be noted that the feedback information is related to the recognition requirements for the target stimulation content. The recognition requirements for different types or forms of target stimulation content may be different. Exemplarily, the recognition requirements for the target stimulation content include but are not limited to requiring the target object to recognize the rotation direction, orientation, etc. of the target stimulation content.

[0098] In some embodiments, the training system can record the target object's feedback information on each stimulus content in the stimulus content list, and count the feedback information after the current round of visual training is completed, so as to determine the visual field sensitivity and feedback accuracy of the stimulus content list, and then update the stimulus list to generate an updated stimulus list. For more information about generating an updated stimulus list, see Figure 4 and its description.

[0099] In some embodiments, the training system can determine whether the next round of training is needed based on the feedback information. For example, when all the stimulation contents in the stimulation content list are fed back, the current round of training ends. The training system can perform feedback analysis on the feedback to determine to update the stimulation list and perform the next round of training based on the above steps 310 to 330. In some embodiments, each round of training can be performed for different sub-areas of the transition area.

[0100] In some embodiments, the training system may also terminate the visual training based on a preset training termination condition, wherein the training termination condition includes but is not limited to one or a combination of the visual perception rate and / or feedback accuracy in the feedback information reaching a preset evaluation index, the training of all sub-areas of the transition area being completed, or the number of training rounds reaching a preset round threshold (e.g., 10 times).

[0101] The training termination condition may also include that the total training duration reaches a preset training duration (eg, 1 hour). The training termination condition may also be determined by the target object.

[0102] For more information about visual perception rate, feedback accuracy, and preset evaluation indicators, see Figure 4 and its description.

[0103] In some embodiments, the training system can generate an analysis report based on the feedback information of the target object. The analysis report may include an evaluation of changes in the visual field impairment area (such as changes in area size), visual perception rates corresponding to different visual field impairment areas or visual field impairment sub-areas, feedback accuracy, reaction time for each feedback, etc. The target object can view the analysis report through a display device (such as a display).

[0104] In some embodiments, the training system can also evaluate the visual rehabilitation effect of the target object based on a preset time interval (such as every 2 weeks). After multiple or multiple rounds of visual training within each preset time interval, the evaluation system can compare and analyze the visual field diagnostic images of the target object before and after visual training, determine the change information of the visual field diagnostic image, and determine the visual rehabilitation effect based on the change information of the visual field diagnostic image. The change information of the visual field diagnostic image may include whether the area of ​​the damaged visual field area is decreasing, or whether the area of ​​the normal visual field area is increasing, and whether the transition area is moving in the direction of the damaged area. When the change information of the visual field diagnostic image is less than the preset change threshold after a preset training cycle (such as 3 months, half a year), it indicates that the visual rehabilitation effect of the target object has stabilized and the visual training can be completed.

[0105] In some embodiments of the present specification, personalized light stimulation is provided for different visual field areas of patients in a virtual reality device, and the patient's feedback information is recorded, so that the patient's feedback on different stimulation contents can be collected in real time, so that the visual training conditions of the damaged visual field area and the normal area of ​​the target object can be analyzed in detail. In addition, based on the patient's feedback results and the analysis results, the training plan is automatically and dynamically adjusted, so that different patients can receive more targeted and personalized training, thereby improving the visual rehabilitation effect.

[0106] Figure 4 is an exemplary schematic diagram of a method for updating a stimulation content list according to some embodiments of the present specification.

[0107] In some embodiments, process 400 may be performed by a training system. Figure 4 As shown, the process 400 includes the following steps. In some embodiments, the process 400 can be used to implement step 330.

[0108] Step 410: Determine the visual sensitivity and feedback accuracy of the stimulus content list based on the feedback information.

[0109] Visual sensitivity refers to the proportion of perceived stimulus content in the stimulus content list. Among them, perceived stimulus content refers to the stimulus content to which the target object can make perceptual feedback. For example, a visual sensitivity of 0.5 (or 50%) means that the target object can make perceptual feedback (such as seeing) to half of the stimulus content in the stimulus list, and has no perceptual feedback (such as not seeing) to the other half.

[0110] Feedback accuracy refers to the proportion of stimulus contents with correct perceptual feedback in the perceptual stimulus contents. For example, a feedback accuracy of 0.5 means that in 50% of the multiple perceptual feedback stimulus contents, the target object gave correct feedback (for example, the color and rotation direction judged by the target object were consistent with the target stimulus content).

[0111] In some embodiments, the training system can record the target subject's feedback on each stimulus content, and perform statistics based on the total number of stimulus contents in the stimulus content list, the number of perceived stimulus contents, and the number of stimulus contents with correct perceived feedback to obtain visual sensitivity and feedback accuracy.

[0112] In some embodiments, the visual field impaired area and the transition area are divided into multiple sub-areas, and the visual sensitivity and feedback accuracy include the visual sensitivity and feedback accuracy of each sub-area. For example, the visual field impaired area and the transition area can be evenly divided into multiple sub-areas of the same size and shape. The training system can determine the visual sensitivity and feedback accuracy of the sub-area based on the feedback information of the target object on the target stimulus content displayed in each sub-area. In some embodiments, the division of the visual field impaired area and the transition area can be performed when generating a stimulus content list.

[0113] In some embodiments, the training system can determine the visual sensitivity and feedback accuracy (such as the visual sensitivity and feedback accuracy of each sub-area) based on the feedback information of the target object in the current training round and the feedback information of the target object in historical training rounds.

[0114] Step 420 , based on the visual sensitivity and the feedback accuracy, the stimulation content list is updated to generate an updated stimulation content list.

[0115] In some embodiments, the training system can perform feedback analysis on the feedback information of the current round of vision training to generate an updated stimulus content list, which can be used for the next round of vision training. The stimulus content in the updated stimulus content list can be referred to as the updated stimulus content. The information included in the updated stimulus content list is similar to the stimulus content list. For example, the updated stimulus content list includes the position information of each updated stimulus content.

[0116] In some embodiments, updating the stimulation content list may include but is not limited to updating the number of stimulation contents, the density of stimulation contents in the visual field impaired area, transition area, and normal area, the display size and brightness of the stimulation contents, etc.

[0117] Feedback analysis may include evaluating whether the visual sensitivity and feedback accuracy meet the preset training requirements. The training requirements may be different preset evaluation indicators determined according to the actual conditions of different target objects. For example, they may be preset according to the age, gender, and size of the damaged area of ​​the target eye's visual field.

[0118] The preset evaluation index may include a visual sensitivity threshold and a feedback accuracy threshold. For example, the visual sensitivity threshold may be preset to 0.6, the feedback accuracy threshold may be preset to 0.8, and the like.

[0119] If the current visual sensitivity is lower than the visual sensitivity threshold, it means that the target object's perception effect (i.e., whether it can be seen) in the transition area corresponding to the stimulus content list is poor, and it is necessary to continue to focus on training the transition area; if the current feedback accuracy is lower than the feedback accuracy threshold, it means that the target object's spatial recognition effect (i.e., whether it can be seen clearly) in the transition area corresponding to the stimulus content list is poor, and it is necessary to continue to focus on training the transition area. When it is necessary to focus on training the filter area, the training system can increase the density of the stimulus content in the transition area, thereby generating an updated stimulus content list. In other words, the proportion of updated stimulus content in the updated stimulus content list located in the transition area will increase.

[0120] In some embodiments, the preset evaluation index may also include the reaction time of the target object. The reaction time refers to the time (such as 3s, 1s) for the target object to respond to the stimulus content. If the reaction time is longer, it means that the target object's perception effect and / or spatial recognition effect in the transition area corresponding to the stimulus content list is poor, and it is necessary to continue to focus on training the transition area.

[0121] In some embodiments, the training system can determine the stimulus reaction duration of the target object through a timer. Among them, the training system can set the stimulation cycle corresponding to each stimulation content, which can represent the display duration of each stimulation content (such as 9s), including the waiting duration (such as the duration of preparation or prompting, such as 2s) and the stimulation duration (such as 7s) for the target object to make feedback. When a stimulation cycle ends, the current stimulation content is cleared, and after the waiting time, the next stimulation content is displayed. When the target object makes feedback within the stimulation duration, it can also enter the next stimulation cycle in advance, that is, wait for 2s (such as prompts) first, and then present the stimulation content.

[0122] It can be understood that the preset evaluation index can also reflect the quality of the training effect of the target object. By quantifying the preset evaluation index and its corresponding threshold, it can provide a good basis for updating the stimulation content list, making the visual training more targeted and improving the rehabilitation efficiency of the target object.

[0123] In some embodiments, when the visual sensitivity and feedback accuracy include the visual sensitivity and feedback accuracy of each sub-area of ​​the impaired visual field area and the transition area, the training system can update the density of the stimulation content in the sub-area based on the visual sensitivity and feedback accuracy of each sub-area. For example, when the visual perception rate and / or feedback accuracy of a sub-area is lower than its corresponding preset evaluation index, the density of the stimulation content in the sub-area can be increased, thereby increasing the training intensity of the sub-area. When the visual perception rate and feedback accuracy of a sub-area are both higher than its corresponding preset evaluation index, the density of the stimulation content in the sub-area can be reduced, thereby reducing the training intensity of the sub-area. After adjusting the density of the stimulation content in each sub-area, the updated stimulation content and its corresponding position information in each sub-area can be obtained.

[0124] In some embodiments, the training system may further determine the display size of the updated stimulation content based on steps 431 to 432 as shown below.

[0125] Step 431, updating the training level based on the feedback information.

[0126] The training level can be used to reflect the training intensity of this round of visual training. It can be in the form of a numerical value, such as 1, 2...n (n is a positive integer greater than 1). The larger the value of the training level, the higher the training intensity. Among them, the higher the training intensity, the more difficult it is to perceive (see) and recognize the stimulus content. The value of the training level can also be in other forms, such as low, medium, high, etc.

[0127] In some embodiments, the training system may determine the training level based on whether the visual sensitivity and feedback accuracy meet the preset evaluation indicators. For example, if the current visual sensitivity is lower than the visual sensitivity threshold, or if the current feedback accuracy is lower than the feedback accuracy threshold, the training level may be lowered.

[0128] In some embodiments, the training system may determine the target training level based on the first weight corresponding to the visual sensitivity and the second weight corresponding to the feedback accuracy. The first weight may be greater than the second weight. For example, the first weight is 0.6 and the second weight is 0.4. The training system may determine the comprehensive evaluation value by weighted summing the first weight and the second weight according to the current visual sensitivity and the current feedback accuracy. If the comprehensive evaluation value is lower than the preset comprehensive evaluation value, the training level is lowered, otherwise the training level is increased.

[0129] In some embodiments, different comprehensive evaluation values ​​may correspond to different target training levels. For example, the training system may determine the target training level corresponding to the current comprehensive evaluation value based on a preset training level table, and set the current training level as the target training level to update the training level.

[0130] In some embodiments of this specification, by setting the weights of visual sensitivity and feedback accuracy, the difficulty of training can be more accurately evaluated, so that the subsequent update of the stimulation content can be more in line with the actual training situation. At the same time, the setting of the first weight and the second weight can give priority to whether the target object can perceive the stimulation content, and then consider whether it can recognize the problem accurately, so that the determined training level is more accurate.

[0131] The training level may also be determined based on other methods, for example, it may be set by the target object.

[0132] Step 432: for each updated stimulation content in the updated stimulation content list, based on the updated training level and the position information of the updated stimulation content, determine the display size of the updated stimulation content.

[0133] The position information of each updated stimulus content in the updated stimulus content list may include an angle between the position of the updated stimulus content and the normal viewing direction of the visual field (such as the Z axis in the training coordinate system). In some embodiments, the position information of the updated stimulus content is its position in the diagnostic image coordinate system, and the training system can convert it into a position in the training coordinate system to obtain the angle between its position and the normal viewing direction of the visual field.

[0134] In some embodiments, the training system may determine the display size in the training coordinate system based on the target training level (ie, the updated training level) and the position information of the updated stimulation content using the following formula (1):

[0135] Size=(A *α*α+ B*α) / grade + C Formula (1)

[0136] Among them, Size represents the display size of the updated stimulus content in the training coordinate system; α represents the angle between the position of the updated stimulus content and the normal viewing direction of the visual field; grade represents the target training level. A, B, and C are preset coefficients. The closer the position of the updated stimulus content is to the center of the visual field, the larger the display size of the updated stimulus content. The higher the target training level, the smaller the display size of the updated stimulus content.

[0137] In some embodiments, the training system can obtain the display size corresponding to the updated stimulus content based on the above formula (1), and generate a new stimulus content list based on the multiple updated stimulus contents, that is, obtain an updated stimulus list. Figure 3a Steps 310 to 330 are shown to implement the next round of visual training.

[0138] In some embodiments, the training system may further determine to update the display brightness of the stimulation content based on step 441 as shown below.

[0139] Step 441 : for each updated stimulation content in the updated stimulation content list, based on the position information of the updated stimulation content and the visual field diagnostic image of the target object, determine the display brightness of the updated stimulation content.

[0140] In some embodiments, the training system can determine the display brightness of each updated stimulus content according to its position in the visual field diagnostic image. For example, when the updated stimulus content is located in the visual field impaired area, its corresponding display brightness can be set to a white highlight spot (40Nit); when the updated stimulus content is located in the normal area, its corresponding display brightness is a grayscale close to the background (8Nit).

[0141] The display brightness can also be determined based on the target object's feedback information on the stimulus content list. For example, if the visual sensitivity corresponding to the current round or consecutive rounds of visual training is lower than the visual sensitivity threshold, indicating that the target object is not adapted to the stimulus content of the current display brightness or has a poor perception effect, the display brightness can be increased.

[0142] It can be understood that the adjustment of the display brightness can make the training plan corresponding to the visual training more consistent with the training situation of the target object, thereby more accurately evaluating the training situation of the target object to improve the efficiency of the training.

[0143] In some embodiments of the present specification, an updated stimulation content list is generated through feedback information, so that the next round of visual training can be accurately adjusted based on the current round of visual training, and the updated stimulation content list can gradually help the target object to perform visual training, thereby better ensuring the rehabilitation effect.

[0144] In some embodiments, the target stimulation content includes a fixed stimulation icon and a stimulation line for indicating the position of the stimulation icon; or the target stimulation content includes a rotating stimulation icon and a plurality of stimulation lines dispersed around the stimulation icon.

[0145] Figure 5a It is a schematic diagram of target stimulation content according to some embodiments of this specification.

[0146] like Figure 5aAs shown, the target stimulation content 510 includes a stimulation icon (shown as a white highlight in the figure) and a stimulation line (white line in the figure) with a fixed display position. Among them, the display position of the stimulation icon corresponds to a stimulation content in the visual field diagnostic image, which can correspond to an impaired visual field area or a normal area, or a certain point in the transition area. The stimulation line is located near the stimulation icon, which connects the center point of the visual field (the central bright spot in the figure). The stimulation line is used to indicate the position of the stimulation icon to guide the target object to provide better feedback. During visual training, the target object needs to provide feedback on the relative orientation of the stimulation icon and the stimulation line. For example, the target object needs to provide feedback on whether the stimulation icon is located in the clockwise direction or counterclockwise direction of the stimulation line (for example, the stimulation icon in the figure can be expressed as being located in the clockwise direction of the stimulation line with the center point of the visual field as the reference point).

[0147] Figure 5b It is a schematic diagram of another target stimulation content shown in some embodiments of this specification.

[0148] like Figure 5b As shown, the target stimulation content 520 includes a rotating stimulation icon (shown as an icon surrounded by multiple gray dots in the figure) and multiple stimulation lines scattered around the stimulation icon (shown as gray rays around the stimulation icon in the figure). The stimulation icon can be an icon that rotates clockwise or counterclockwise.

[0149] During visual training, the target object needs to provide feedback on the rotation direction corresponding to the stimulus icon. Multiple stimulus lines can be used to provide assistance and guidance for the target object's feedback.

[0150] It should be noted that the target stimulation content may be in other forms. The training system may be customized for the target object according to the training situation (such as feedback) of the target object, the training duration, etc. Among them, a variety of different target stimulation contents may be pre-stored in a storage device (such as storage device 150). The target stimulation content may also be obtained from a third party (such as a hospital) and updated or adjusted.

[0151] In some embodiments of the present specification, a stimulation icon is set in the target stimulation content, which can provide targeted stimulation to the impaired visual field area of ​​the target eye. At the same time, a stimulation line is set to assist or guide the target to provide corresponding feedback, thereby improving the humanization and personalization of visual training.

[0152] It should be noted that the above description of the relevant process is only for example and explanation, and does not limit the scope of application of this specification. For those skilled in the art, various modifications and changes can be made to the process under the guidance of this specification. However, these modifications and changes are still within the scope of this specification.

[0153] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only for example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements and corrections to this specification. Such modifications, improvements and corrections are suggested in this specification, so such modifications, improvements and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0154] At the same time, this specification uses specific words to describe the embodiments of this specification. For example, "one embodiment", "an embodiment", and / or "some embodiments" refer to a certain feature, structure or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "one embodiment" or "an embodiment" or "an alternative embodiment" mentioned twice or more in different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures or characteristics in one or more embodiments of this specification can be appropriately combined.

[0155] In addition, unless explicitly stated in the claims, the order of the processing elements and sequences described in this specification, the use of alphanumeric characters, or the use of other names are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some invention embodiments that are currently considered useful through various examples, it should be understood that such details are only for illustrative purposes, and the attached claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0156] Similarly, it should be noted that in order to simplify the description disclosed in this specification and thus help understand one or more embodiments of the invention, in the above description of the embodiments of this specification, multiple features are sometimes combined into one embodiment, figure or description thereof. However, this disclosure method does not mean that the features required by the subject matter of this specification are more than the features mentioned in the claims. In fact, the features of the embodiments are less than all the features of the single embodiment disclosed above.

[0157] In some embodiments, numbers describing the number of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise specified, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may change according to the required features of individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the setting of such numerical values ​​is as accurate as possible within the feasible range.

[0158] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, documents, etc., cited in this specification are hereby incorporated by reference in their entirety. Except for application history documents that are inconsistent with or conflicting with the contents of this specification, documents that limit the broadest scope of the claims of this specification (currently or later attached to this specification) are also excluded. It should be noted that if the descriptions, definitions, and / or use of terms in the materials attached to this specification are inconsistent or conflicting with the contents described in this specification, the descriptions, definitions, and / or use of terms in this specification shall prevail.

[0159] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, as an example and not a limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly introduced and described in this specification.

Claims

1. A method for formulating a visual neural training program, characterized in that: include: Acquire a stimulation content list of a target object, wherein the stimulation content list includes position information of a plurality of stimulation contents for performing visual nerve training on a target eye of the target object; Presenting target stimulation content from among the plurality of stimulation contents to the target eye of the target object via a virtual reality display device, wherein a display position of the target stimulation content is determined based on position information thereof in a stimulation content list; Determining the visual sensitivity and feedback accuracy of the stimulation content list based on the feedback information of the target object on the target stimulation content; Based on the visual sensitivity and the feedback accuracy, the stimulation content list is updated to generate an updated stimulation content list for the next round of visual nerve training, wherein the updated stimulation content list includes location information of a plurality of updated stimulation contents; updating the training level based on a first weight corresponding to the visual sensitivity and a second weight corresponding to the feedback accuracy, wherein the first weight is greater than the second weight; For each updated stimulation content in the updated stimulation content list, based on the updated training level and the position information of the updated stimulation content, determining the display size of the updated stimulation content; For each updated stimulation content in the updated stimulation content list, the display brightness of the updated stimulation content is determined based on the position information of the updated stimulation content and the visual field diagnostic image of the target object.

2. The method according to claim 1, characterized in that The stimulus content list is generated based on the following steps: Acquire a visual field diagnostic image of the target object, wherein the visual field diagnostic image displays a damaged visual field area, a normal area, and a transition area between the damaged visual field area and the normal area of ​​the target eye; The stimulation content list is generated based on the visual field diagnostic image, wherein among the plurality of stimulation contents, the density of the stimulation content located in the transition area, the stimulation content located in the visual field impaired area, and the stimulation content located in the normal area decreases in sequence.

3. The method according to claim 2, characterized in that The updating of the stimulation content list based on the visual sensitivity and the feedback accuracy includes: In response to the visual sensitivity being lower than a visual sensitivity threshold, and / or in response to the feedback accuracy being lower than a feedback accuracy threshold, The density of the stimulation contents in the transition area is increased to update the stimulation content list.

4. The method according to claim 1, characterized in that: The step of determining the display brightness of the updated stimulation content based on the position information of the updated stimulation content and the visual field diagnostic image of the target object comprises: Based on the position of each of the updated stimulation contents in the visual field diagnostic image, the display brightness of the updated stimulation contents is determined.

5. The method according to claim 1, characterized in that The method further comprises: In response to the visual sensitivity being lower than a visual sensitivity threshold, the display brightness of the updated stimulus content is increased.

6. The method according to claim 2, characterized in that The visual field impaired area and the transition area are divided into a plurality of sub-areas, the visual sensitivity and feedback accuracy include the visual sensitivity and feedback accuracy of each sub-area, and updating the stimulation content list based on the visual sensitivity and the feedback accuracy includes: For each of the sub-regions, the density of the stimulation content in the sub-region is updated based on the visual sensitivity and feedback accuracy of the sub-region.

7. The method according to claim 1, characterized in that The method further comprises: While presenting the target stimulus content to the target eye of the target object, Via the virtual reality display device, the target eye and non-target eye of the target object are simultaneously presented with a cursor image.

8. The method according to claim 1, characterized in that The target stimulation content includes a fixed stimulation icon and a stimulation line for indicating the position of the stimulation icon; or The target stimulation content includes a rotating stimulation icon and a plurality of stimulation lines dispersed around the stimulation icon.

9. A system for formulating a visual neural training program, characterized in that: include: An acquisition module, used for acquiring a stimulus content list of a target object, wherein the stimulus content list includes position information of a plurality of stimulus contents for performing visual nerve training on a target eye of the target object; A display module, configured to present target stimulation content from among the plurality of stimulation contents to the target eye of the target object via a virtual reality display device, wherein a display position of the target stimulation content is determined based on position information thereof in a stimulation content list; An updating module, configured to determine the visual sensitivity and feedback accuracy of the stimulation content list based on the feedback information of the target object on the target stimulation content; based on the visual sensitivity and the feedback accuracy, update the stimulation content list to generate an updated stimulation content list for the next round of visual neural training, wherein the updated stimulation content list includes location information of a plurality of updated stimulation contents; updating the training level based on a first weight corresponding to the visual sensitivity and a second weight corresponding to the feedback accuracy, wherein the first weight is greater than the second weight; For each updated stimulation content in the updated stimulation content list, based on the updated training level and the position information of the updated stimulation content, determining the display size of the updated stimulation content; For each updated stimulation content in the updated stimulation content list, the display brightness of the updated stimulation content is determined based on the position information of the updated stimulation content and the visual field diagnostic image of the target object.

10. A device for formulating a visual nerve training program, characterized in that: The method comprises a processor configured to execute the method according to any one of claims 1 to 8.

Images