A visual enhancement method, device and system based on flexible electrode probe
Through the visual enhancement method based on flexible electrode probes, the shortcomings in the regulation of artificial visual display in the prior art are solved, the effects of closed-loop reading and writing are realized, and the flexibility and effect of visual enhancement are improved.
Patent Information
- Application Number
- CN202111323374.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-09
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2041-11-09
AI Technical Summary
The existing visual enhancement technology is difficult to effectively regulate artificial visual display, especially in terms of closed-loop reading and writing.
A visual enhancement method based on a flexible electrode probe is adopted to obtain the information to be displayed, a set of candidate positions is determined, and the electrical stimulation unit is used to stimulate these positions to obtain the EEG signal, and finally the target display information is determined based on the EEG signal and the information to be displayed.
The control of artificial visual display is realized, the effect of closed-loop reading and writing is achieved, and the flexibility and effect of visual enhancement is improved.
Smart Images

Figure CN114053582B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of visual neurotechnology, and in particular to a method, device and system for visual enhancement based on a flexible electrode probe. Background Art
[0002] For the visually impaired, effective visual function can greatly improve their independence in social activities and quality of life. Visual cortical visual prosthesis is a proven visual enhancement technology that creates artificial vision through micro-electrical stimulation of the visual cortex without the need for visual processing through the eyes or optic nerve. Therefore, visual cortical visual prosthesis can be used in the future to restore vision loss in blind people whose retina, eyes or optic nerves are injured or degenerated, but whose visual cortex is intact. Summary of the invention
[0003] The embodiments of the present application provide a method, device and system for visual enhancement based on a flexible electrode probe, which can realize regulation within artificial visual display and achieve the effect of closed-loop reading and writing.
[0004] The present application embodiment provides a method for visual enhancement based on a flexible electrode probe, comprising:
[0005] Get the information to be displayed;
[0006] Based on the information to be displayed, a set of candidate positions is determined from the area to be stimulated; a flexible electrode probe is implanted in the area to be stimulated;
[0007] Controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and obtaining an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neurons corresponding to each candidate position;
[0008] The target display information is determined according to the EEG signal corresponding to each candidate position and the information to be displayed.
[0009] Further, according to the EEG signal corresponding to each candidate position and the information to be displayed, the target display information is determined, including:
[0010] Determine candidate display information according to the EEG signal corresponding to each candidate position;
[0011] If the candidate display information matches the information to be displayed, the candidate display information is determined as the target display information.
[0012] Further, the flexible electrode probe has a plurality of channels, each of the plurality of channels including a plurality of electrode sites;
[0013] Before stimulating each candidate position in the candidate position set, the method further includes:
[0014] The multiple electrode sites of each channel are encoded to obtain an electrode encoding subset; each electrode code in the electrode encoding subset corresponds one-to-one to each electrode site in the multiple electrode sites, and the electrode code is the code at the candidate position corresponding to the channel to which the corresponding electrode site belongs.
[0015] Further, each candidate position in the candidate position set is stimulated to obtain an EEG signal corresponding to each candidate position, including:
[0016] Determine a target electrode code from each electrode code subset to obtain a target electrode code set;
[0017] Current is applied to the electrode site corresponding to each target electrode code in the target electrode code set, stimulation processing is performed on the candidate position corresponding to each target electrode code, and the EEG signal corresponding to each candidate position is obtained.
[0018] Accordingly, an embodiment of the present application provides a vision enhancement device based on a flexible electrode probe, comprising:
[0019] An acquisition module, used to acquire information to be displayed;
[0020] A first determination module is used to determine a set of candidate positions from an area to be stimulated based on information to be displayed; a flexible electrode probe is implanted in the area to be stimulated;
[0021] The stimulation module is used to control the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and obtain the EEG signal corresponding to each candidate position; the EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position;
[0022] The second determination module is used to determine the target display information according to the EEG signal corresponding to each candidate position and the information to be displayed.
[0023] Furthermore, the second determination module includes:
[0024] A first determination submodule is used to determine candidate display information according to the EEG signal corresponding to each candidate position;
[0025] The second determination submodule is configured to determine the candidate display information as target display information if the candidate display information matches the information to be displayed.
[0026] Further, the flexible electrode probe has a plurality of channels, each of the plurality of channels including a plurality of electrode sites;
[0027] The device also includes:
[0028] The encoding module is used for, before stimulating each candidate position in the candidate position set,
[0029] The multiple electrode sites of each channel are encoded to obtain an electrode encoding subset; each electrode code in the electrode encoding subset corresponds one-to-one to each electrode site in the multiple electrode sites, and the electrode code is the code at the candidate position corresponding to the channel to which the corresponding electrode site belongs.
[0030] Furthermore, the stimulation module comprises:
[0031] A third determination submodule is used to determine a target electrode code from each electrode code subset to obtain a target electrode code set;
[0032] The processing submodule is used to apply current to the electrode site corresponding to each target electrode code in the target electrode code set, perform stimulation processing on the candidate position corresponding to each target electrode code, and obtain the EEG signal corresponding to each candidate position.
[0033] Accordingly, the embodiment of the present application provides a vision enhancement system based on a flexible electrode probe, comprising:
[0034] A processor, used for obtaining information to be displayed;
[0035] Based on the information to be displayed, a set of candidate positions is determined from the area to be stimulated; a flexible electrode probe is implanted in the area to be stimulated;
[0036] Controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and obtaining an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neurons corresponding to each candidate position;
[0037] Determine the target display information according to the EEG signal corresponding to each candidate position and the information to be displayed;
[0038] An electrical stimulation unit, used for stimulating each candidate position in the candidate position set so that the neurons corresponding to each candidate position are stimulated to generate an electroencephalogram signal;
[0039] The EEG signal acquisition unit is used to collect the EEG signal corresponding to each candidate position and send it to the processor.
[0040] Accordingly, an embodiment of the present application also provides an electronic device, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the above-mentioned flexible electrode probe-based visual enhancement method.
[0041] Accordingly, an embodiment of the present application also provides a computer-readable storage medium, which stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the above-mentioned flexible electrode probe-based visual enhancement method.
[0042] The embodiments of the present application have the following beneficial effects:
[0043] The embodiments of the present application disclose a method, device and system for visual enhancement based on a flexible electrode probe, wherein the visual enhancement method includes obtaining information to be displayed, and based on the information to be displayed, determining a set of candidate positions from an area to be stimulated, wherein a flexible electrode probe is implanted in the area to be stimulated, and controlling an electrical stimulation unit to stimulate each candidate position in the candidate position set, and obtaining an EEG signal corresponding to each candidate position; the EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position, and the target display information is determined according to the EEG signal corresponding to each candidate position and the information to be displayed. Based on the embodiments of the present application, regulation within the artificial visual display can be realized, and the effect of closed-loop reading and writing can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present application or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0045] Figure 1 is a schematic diagram of an application environment provided by an embodiment of the present application;
[0046] Figure 2 It is a flow chart of a method for visual enhancement based on a flexible electrode probe provided in an embodiment of the present application;
[0047] Figure 3 is a schematic diagram of a flexible electrode probe provided in an embodiment of the present application;
[0048] Figure 4 is a schematic diagram of information to be displayed provided by an embodiment of the present application;
[0049] Figure 5 is a structural schematic diagram of a vision enhancement device based on a flexible electrode probe provided in an embodiment of the present application;
[0050] Figure 6 It is a structural schematic diagram of a vision enhancement system based on a flexible electrode probe provided in an embodiment of the present application. DETAILED DESCRIPTION
[0051] In order to make the purpose, technical scheme and advantages of the present application clearer, the embodiments of the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiment is only one embodiment of the present application, not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0052] The "embodiment" referred to herein refers to a specific feature, structure or characteristic that may be included in at least one implementation of the present application. In the description of the embodiments of the present application, it should be understood that the orientation or positional relationship indicated by the terms "upper", "lower", "top", "bottom", etc. is based on the orientation or positional relationship shown in the accompanying drawings, which is only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device / system or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present application. The terms "first", "second", and "third" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first", "second", and "third" may include one or more of the features explicitly or implicitly. Moreover, the terms "first", "second", and "third", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here. In addition, the terms "includes," "comprises," and "has," and any variations thereof, are intended to cover a non-exclusive inclusion.
[0053] See also Figure 1 , which is a schematic diagram of an application environment provided by an embodiment of the present application, including a processor 101, an electrical stimulation unit 103 and an EEG signal acquisition unit 105. Among them, the processor 101 can be connected to the electrical stimulation unit 103 through a wired link or a wireless link, and the processor 101 can be connected to the EEG signal acquisition unit 105 through a wired link or a wireless link. The processor can obtain information to be displayed, and based on the information to be displayed, determine a set of candidate positions from the area to be stimulated, the area to be stimulated is implanted with a flexible electrode probe, control the electrical stimulation unit 103 to stimulate each candidate position in the candidate position set, and obtain the EEG signal corresponding to each candidate position based on the EEG signal acquisition unit 105; the EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position, and the target display information is determined according to the EEG signal corresponding to each candidate position and the information to be displayed.
[0054] The following describes a specific embodiment of a visual enhancement method based on a flexible electrode probe of the present application. Figure 2 This is a flowchart of a visual enhancement method based on a flexible electrode probe provided in an embodiment of the present application. This specification provides method operation steps as shown in the embodiment or flowchart, but more or fewer operation steps may be included based on conventional or non-creative labor. The order of steps listed in the embodiment is only one of many execution orders and does not represent the only execution order. In actual execution, the method sequence shown in the embodiment or the drawings may be executed or executed in parallel (for example, in a parallel processor or multi-threaded processing environment). Specifically, Figure 2 As shown, the method includes:
[0055] S201: Obtain information to be displayed.
[0056] In the embodiment of the present application, the processor can obtain information to be displayed, and the information to be displayed can be triggered by the user based on the display interface of the processor, or can be input based on an input device adapted to the processor. In an optional implementation, the information to be displayed can be numbers, letters, text, or other information, which is not specifically limited in this specification.
[0057] In an optional implementation, the information to be displayed obtained by the processor may be the letter “A”.
[0058] S203: Based on the information to be displayed, determine a set of candidate positions from the area to be stimulated; a flexible electrode probe is implanted in the area to be stimulated.
[0059] In the embodiment of the present application, the cerebral cortex of the subject may have multiple areas, such as the motor area M1, the visual area V1, the auditory area H1, etc. In the embodiment of the present application, a flexible electrode probe may be implanted in the visual area of the cerebral cortex of the subject, i.e., the area to be stimulated, and optionally, an 81-channel flexible electrode probe may be implanted in the visual area V1.
[0060] Figure 33 is a schematic diagram of a flexible electrode probe provided in an embodiment of the present application, wherein the flexible electrode probe may include multiple channels, and each channel may include multiple electrode sites. As shown in 3, channel 300 may include a first electrode site 301 and a second electrode site 302. Since the cerebral cortex of the subject is curved, when the flexible electrode probe is implanted into the cerebral cortex of the subject, from the top view of the subject's head, each of the multiple channels corresponds to a different area of the visual cortex, but the coordinates of the multiple electrode sites on the same channel in the coordinate system corresponding to the cerebral cortex are consistent, that is, the multiple electrode sites on the same channel correspond to the same area of the visual cortex. Assume that the position corresponding to the first electrode site 301 in the spatial coordinate system is (2,1,0), and the position corresponding to the second electrode site 302 in the spatial coordinate system is (2,1,-1), but the positions of these two electrode sites in the coordinate system corresponding to the cerebral cortex are both (2,1). However, from the perspective of the subject's head, multiple electrode sites on the same channel are not at the same height, that is, their positions in the electrode site array are different. Assume that the first electrode site 301 corresponds to the position (6, 2) in the electrode site array, and the second electrode site 302 corresponds to the position (11, 2) in the electrode site array.
[0061] In an embodiment of the present application, multiple electrode sites of each channel can be encoded to obtain an electrode encoding subset, wherein each electrode code in the electrode encoding subset corresponds one-to-one to each electrode site in the multiple electrode sites, and the electrode code is the code at the candidate position corresponding to the channel to which the corresponding electrode site belongs. The code m corresponding to each electrode site has a one-to-one correspondence with the position of the corresponding electrode site in the electrode array, that is, f(m)→(x,y). For example, the first electrode site 301 and the second electrode site can be encoded to obtain a code m=1 corresponding to the first electrode site, and a code m=2 corresponding to the second electrode site, that is, code 1 corresponds to position (6,2), and code 2 corresponds to position (11,2).
[0062] In an optional embodiment, after acquiring the information to be displayed, the processor may determine a set of candidate positions from the area to be stimulated based on the information to be displayed, that is, determine a set of candidate positions corresponding to the information to be displayed "A" from multiple positions corresponding to the visual cortex.
[0063] In the embodiment of the present application, a 1024-channel flexible electrode probe can be implanted in the motor area M1, and the subject can be trained and the relevant EEG signals can be recorded. That is, the EEG signals when the subject intends to perform a certain function are recorded, and the intention is decoded in the processor to obtain the subject's motor intention, and then the intention is translated into computer instructions by the processor for regulating the point stimulation signal to achieve the regulation of the artificial visual display content. It can also be used as information to be displayed.
[0064] S205: Control the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neurons corresponding to each candidate position.
[0065] In an embodiment of the present application, the processor can determine the target electrode code from each electrode code subset to obtain a target electrode code set, and then apply current to the electrode site corresponding to each target electrode code in the target electrode code set, stimulate the candidate position corresponding to each target electrode code, and obtain the EEG signal corresponding to each candidate position.
[0066] In a specific embodiment, the processor can determine the channel corresponding to each candidate position in the candidate position set, and select at least one electrode site code corresponding to the channel corresponding to each candidate position as the target electrode code to obtain the target electrode code set, and then the electrical stimulation unit can be used to stimulate the electrode site corresponding to each target electrode code in the target electrode code set to stimulate the neurons corresponding to the candidate position, so as to produce a bright / dark artificial light sensation at a characteristic position in the subject's visual space and obtain an electroencephalogram signal. For example, after a flexible electrode probe is implanted in the visual area V1, the information to be displayed can be displayed on a display device adapted to the processor, and the display array corresponding to the information to be displayed can be determined, such as the display array corresponding to the information to be displayed "A" described above. Figure 4 This is a schematic diagram of information to be displayed provided by an embodiment of the present application. In the figure, the corresponding positions of the information to be displayed in the display array are (1,5), (2,4), (3,4), (4,3), (5,3), (6,2), (7,2), (8,1), (9,1), (2,6), (3,6), (4,7), (5,7), (6,8), (7,8), (8,9), (9,9), (5,4), (5,5), and (5,6). The processor can determine the target electrode code based on the above positions to obtain a target electrode code set, that is, assuming that the display array is consistent with the electrode site array, determine the target electrode code, and obtain a target electrode code set.
[0067] In a specific implementation, the processor may acquire a target electrode code set, and then may decode the target electrode code set to obtain a corresponding electrode site that needs to be stimulated.
[0068] S207: Determine target display information according to the EEG signal corresponding to each candidate position and the information to be displayed.
[0069] In an embodiment of the present application, the processor can determine the candidate display information based on the EEG signal corresponding to each candidate position, and then judge whether the candidate display information matches the information to be displayed. If it is determined that the candidate display information matches the information to be displayed, the candidate display information can be determined as the target display information.
[0070] If it is determined that the candidate display information does not match the information to be displayed, the target electrode code can be re-determined from each electrode code subset to obtain a new target electrode code set, and then the candidate position corresponding to each target electrode code can be stimulated based on the electrical stimulation unit, and the EEG signal corresponding to each candidate position can be obtained based on the EEG signal acquisition unit, and then the target display information can be determined based on the EEG signal corresponding to each candidate position and the information to be displayed.
[0071] By using the visual enhancement method based on the flexible electrode probe provided in the embodiment of the present application, it is possible to realize regulation within the artificial visual display and achieve the effect of closed-loop reading and writing.
[0072] The embodiment of the present application also provides a vision enhancement device based on a flexible electrode probe, Figure 5 is a schematic diagram of the structure of a visual enhancement device based on a flexible electrode probe provided in an embodiment of the present application, such as Figure 5 As shown, the device may include:
[0073] The acquisition module 501 may be used to acquire information to be displayed;
[0074] The first determination module 503 may be used to determine a set of candidate positions from the area to be stimulated based on the information to be displayed; the area to be stimulated is implanted with a flexible electrode probe;
[0075] The stimulation module 505 can be used to control the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and obtain the EEG signal corresponding to each candidate position; the EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position;
[0076] The second determination module 507 may be configured to determine target display information according to the EEG signal and the information to be displayed corresponding to each candidate position.
[0077] In the embodiment of the present application, the second determining module 507 may include:
[0078] A first determination submodule is used to determine candidate display information according to the EEG signal corresponding to each candidate position;
[0079] The second determination submodule is configured to determine the candidate display information as target display information if the candidate display information matches the information to be displayed.
[0080] In the embodiment of the present application, the flexible electrode probe has a plurality of channels, and each of the plurality of channels includes a plurality of electrode sites;
[0081] The device may also include:
[0082] The encoding module is used for, before stimulating each candidate position in the candidate position set,
[0083] The multiple electrode sites of each channel are encoded to obtain an electrode encoding subset; each electrode code in the electrode encoding subset corresponds one-to-one to each electrode site in the multiple electrode sites, and the electrode code is the code at the candidate position corresponding to the channel to which the corresponding electrode site belongs.
[0084] In the embodiment of the present application, the stimulation module 505 may include:
[0085] A third determination submodule is used to determine a target electrode code from each electrode code subset to obtain a target electrode code set;
[0086] The processing submodule is used to apply current to the electrode site corresponding to each target electrode code in the target electrode code set, perform stimulation processing on the candidate position corresponding to each target electrode code, and obtain the EEG signal corresponding to each candidate position.
[0087] The device and method embodiments in the embodiments of the present application are based on the same application concept.
[0088] By using the visual enhancement device based on the flexible electrode probe provided in the embodiment of the present application, it is possible to realize regulation within the artificial visual display and achieve the effect of closed-loop reading and writing.
[0089] The embodiment of the present application also provides a vision enhancement system based on a flexible electrode probe, Figure 6 is a structural schematic diagram of a visual enhancement system based on a flexible electrode probe provided in an embodiment of the present application, such as Figure 6 As shown, the device may include:
[0090] The processor 601 is used to obtain information to be displayed;
[0091] Based on the information to be displayed, a set of candidate positions is determined from the area to be stimulated; a flexible electrode probe is implanted in the area to be stimulated;
[0092] Controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and obtaining an electroencephalogram signal corresponding to each candidate position; the electroencephalogram signal is a signal obtained by stimulating the neurons corresponding to each candidate position;
[0093] Determine the target display information according to the EEG signal corresponding to each candidate position and the information to be displayed;
[0094] The electrical stimulation unit 603 is used to perform stimulation processing on each candidate position in the candidate position set so that the neurons corresponding to each candidate position are stimulated to generate an electroencephalogram signal;
[0095] The EEG signal acquisition unit 605 is used to acquire the EEG signal corresponding to each candidate position and send it to the processor.
[0096] The system and method embodiments in the embodiments of the present application are based on the same application concept.
[0097] By using the visual enhancement device based on the flexible electrode probe provided in the embodiment of the present application, it is possible to realize regulation within the artificial visual display and achieve the effect of closed-loop reading and writing.
[0098] An embodiment of the present application also provides an electronic device, which can be set in a server to store at least one instruction, at least one program, code set or instruction set related to a visual enhancement method based on a flexible electrode probe in a method embodiment. The at least one instruction, the at least one program, the code set or instruction set is loaded and executed by the memory to implement the above-mentioned visual enhancement method based on a flexible electrode probe.
[0099] An embodiment of the present application also provides a storage medium, which can be set in a server to store at least one instruction, at least one program, a code set or an instruction set related to a visual enhancement method based on a flexible electrode probe in a method embodiment. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the above-mentioned visual enhancement method based on a flexible electrode probe.
[0100] Optionally, in this embodiment, the storage medium may be located in at least one of the multiple network servers of the computer network. Optionally, in this embodiment, the storage medium may include, but is not limited to, various media that can store program codes, such as a USB flash drive, a read-only memory (ROM), a mobile hard disk, a magnetic disk, or an optical disk.
[0101] It can be seen from the embodiments of the visual enhancement method, device, system, electronic device or storage medium based on the flexible electrode probe provided by the present application that the method in the present application includes obtaining information to be displayed, and based on the information to be displayed, determining a set of candidate positions from the area to be stimulated, wherein the area to be stimulated is implanted with a flexible electrode probe, and controlling the electrical stimulation unit to stimulate each candidate position in the candidate position set, and obtaining the EEG signal corresponding to each candidate position; the EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position, and the target display information is determined according to the EEG signal corresponding to each candidate position and the information to be displayed. Based on the embodiments of the present application, regulation within the artificial visual display can be realized, and the effect of closed-loop reading and writing can be achieved.
[0102] In the present invention, unless otherwise clearly specified and limited, the terms "connected", "connection" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be a connection between two elements or an interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0103] It should be noted that the order of the above embodiments of the present application is only for description and does not represent the advantages and disadvantages of the embodiments. The above description describes specific embodiments, and other embodiments are also within the scope of the attached claims. In some cases, the actions or steps recorded in the claims can be performed in the order of different embodiments and can achieve the expected results. In addition, the processes depicted in the drawings do not necessarily require a specific order or connection order to achieve the desired results. In some embodiments, multi-task parallel processing is also possible or may be advantageous.
[0104] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the embodiments of the device and system, since they are based on similarities to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.
[0105] The above is a preferred embodiment of the present invention. It should be pointed out that a person skilled in the art can make several improvements and modifications without departing from the principle of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.
Claims
1. A visual enhancement device based on a flexible electrode probe, characterized in that: include: An acquisition module, used to acquire information to be displayed; A first determination module, configured to determine a set of candidate positions from the area to be stimulated based on the information to be displayed; A flexible electrode probe is implanted in the area to be stimulated; A stimulation module, used for controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set, and obtaining an electroencephalogram signal corresponding to each candidate position; The EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position; A second determination module is used to determine target display information according to the EEG signal corresponding to each candidate position and the information to be displayed; Determining the target display information according to the EEG signal corresponding to each candidate position and the information to be displayed comprises the following steps: Determine candidate display information according to the EEG signal corresponding to each candidate position, judge whether the candidate display information matches the information to be displayed, and if it is determined that the candidate display information matches the information to be displayed, determine the candidate display information as the target display information; If it is determined that the candidate display information does not match the information to be displayed, the target electrode code is re-determined from each electrode code subset to obtain a new target electrode code set, and stimulation processing is performed on the candidate position corresponding to each target electrode code in the new target electrode code set based on the electrical stimulation unit, and the EEG signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set is obtained based on the EEG signal acquisition unit, and the target display information is determined according to the EEG signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set and the information to be displayed.
2. The device according to claim 1, characterized in that The flexible electrode probe has a plurality of channels, each of the plurality of channels comprising a plurality of electrode sites; The device also includes: An encoding module, used for performing encoding processing on the multiple electrode sites of each channel to obtain the electrode encoding subset before performing stimulation processing on each candidate position in the candidate position set; Each electrode code in the electrode code subset corresponds one-to-one to each electrode site in the multiple electrode sites, and the electrode code is a code at a candidate position corresponding to the channel to which the corresponding electrode site belongs.
3. The device according to claim 2, characterized in that The stimulation module comprises: A third determination submodule is used to determine a target electrode code from each electrode code subset to obtain the target electrode code set; The processing submodule is used to apply current to the electrode site corresponding to each target electrode code in the target electrode code set, stimulate the candidate position corresponding to each target electrode code, and obtain the EEG signal corresponding to each candidate position.
4. A visual enhancement system based on a flexible electrode probe, characterized in that: include: A processor, used for obtaining information to be displayed; Based on the information to be displayed, determining a set of candidate positions from the area to be stimulated; A flexible electrode probe is implanted in the area to be stimulated; Controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; The EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position; Determining target display information according to the EEG signal corresponding to each candidate position and the information to be displayed; Determining the target display information according to the EEG signal corresponding to each candidate position and the information to be displayed comprises the following steps: Determine candidate display information according to the EEG signal corresponding to each candidate position, judge whether the candidate display information matches the information to be displayed, and if it is determined that the candidate display information matches the information to be displayed, determine the candidate display information as the target display information; If it is determined that the candidate display information does not match the information to be displayed, the target electrode code is re-determined from each electrode code subset to obtain a new target electrode code set, and the candidate position corresponding to each target electrode code in the new target electrode code set is stimulated based on the electrical stimulation unit, and the electroencephalogram signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set is obtained based on the electroencephalogram signal acquisition unit, and the target display information is determined according to the electroencephalogram signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set and the information to be displayed; An electrical stimulation unit, used for performing stimulation processing on each candidate position in the candidate position set, so that the neurons corresponding to each candidate position are stimulated to generate the electroencephalogram signal; The EEG signal acquisition unit is used to acquire the EEG signal corresponding to each candidate position and send it to the processor.
5. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to complete the following steps: Get the information to be displayed; Based on the information to be displayed, a set of candidate positions is determined from an area to be stimulated; a flexible electrode probe is implanted in the area to be stimulated; Controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; The EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position; Determine candidate display information according to the EEG signal corresponding to each candidate position, judge whether the candidate display information matches the information to be displayed, and if it is determined that the candidate display information matches the information to be displayed, determine the candidate display information as the target display information; If it is determined that the candidate display information does not match the information to be displayed, the target electrode code is re-determined from each electrode code subset to obtain a new target electrode code set, and stimulation processing is performed on the candidate position corresponding to each target electrode code in the new target electrode code set based on the electrical stimulation unit, and the EEG signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set is obtained based on the EEG signal acquisition unit, and the target display information is determined according to the EEG signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set and the information to be displayed.
6. The electronic device according to claim 5, characterized in that: The flexible electrode probe has a plurality of channels, each of the plurality of channels comprising a plurality of electrode sites; Before performing stimulation processing on each candidate position in the candidate position set, the method further includes: Performing encoding processing on the multiple electrode sites of each channel to obtain an electrode encoding subset; Each electrode code in the electrode code subset corresponds one-to-one to each electrode site in the multiple electrode sites, and the electrode code is a code at a candidate position corresponding to the channel to which the corresponding electrode site belongs.
7. The electronic device according to claim 6, characterized in that: The step of performing stimulation processing on each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position includes: Determine a target electrode code from each electrode code subset to obtain a target electrode code set; Current is applied to the electrode site corresponding to each target electrode code in the target electrode code set, stimulation processing is performed on the candidate position corresponding to each target electrode code, and the electroencephalogram signal corresponding to each candidate position is obtained.
8. A computer-readable storage medium, characterized in that: The storage medium stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to complete the following steps: Get the information to be displayed; Based on the information to be displayed, a set of candidate positions is determined from an area to be stimulated; a flexible electrode probe is implanted in the area to be stimulated; Controlling the electrical stimulation unit to perform stimulation processing on each candidate position in the candidate position set to obtain an electroencephalogram signal corresponding to each candidate position; The EEG signal is a signal obtained by stimulating the neurons corresponding to each candidate position; Determine candidate display information according to the EEG signal corresponding to each candidate position, judge whether the candidate display information matches the information to be displayed, and if it is determined that the candidate display information matches the information to be displayed, determine the candidate display information as the target display information; If it is determined that the candidate display information does not match the information to be displayed, the target electrode code is re-determined from each electrode code subset to obtain a new target electrode code set, and stimulation processing is performed on the candidate position corresponding to each target electrode code in the new target electrode code set based on the electrical stimulation unit, and the EEG signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set is obtained based on the EEG signal acquisition unit, and the target display information is determined according to the EEG signal corresponding to each candidate position corresponding to each target electrode code in the new target electrode code set and the information to be displayed.
Citation Information
Patent Citations
Device and method for directly inputting visual information into brain visual cortex
CN109620539A
Visual prosthesis device and system, control method thereof, and storage medium
CN112843467A