Non-image-forming visual response-based visual stimulation method and apparatus, device, and program product

Abstract

A non-image-forming visual response-based visual stimulation method and apparatus, a device, and a program product. A visual stimulation signal capable of triggering non-visual light stimulation is respectively applied to the two visual channels of a user in a time-asynchronous manner. Due to a non-image-forming visual response, the visual channel that preferentially senses the stimulation signal enables the stimulation signal to directly stimulate a corresponding sensing channel by means of photosensitive sensing cells, and image content of the stimulation signal can be sensed by the brain only after the stimulation signal is received in the other visual channel. Thus, the non-visual light stimulation generated by the light stimulation signal is time-asynchronous with a visual image stimulation, thereby reducing the mutual influence between the two processes, improving the stimulation effect of the non-visual light stimulation, and enhancing the shaping ability of the non-visual light stimulation with respect to the corresponding sensing channels.

Description

A visual stimulation method, device, equipment, and program product based on non-imaging visual responses.

[0001] This application claims priority to Chinese Patent Application No. 202411583495.5, filed on November 7, 2024, entitled "A Visual Stimulation Method, Apparatus, Device and Procedure Product Based on Non-Imaging Visual Response", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of electronic technology, specifically to a visual stimulation method, apparatus, device, and program product based on non-imaging visual response. Background Technology

[0003] Non-image-forming visual responses refer to the direct responses of retinal ganglion cells that do not depend on visual image content stimulation. That is, when a corresponding light stimulus enters the retina, retinal ganglion cells can directly perceive the light stimulus in addition to sensing the image content corresponding to the stimulus, thereby influencing human physiology and behavior through corresponding sensory channels, without perceiving and reacting through the formation of visual images.

[0004] Non-image visual responses are an important aspect of the interaction between light and the human body. They can be used to stimulate and control the body's biological rhythms, hormone secretion, and other vital signs (such as blood pressure and pulse).

[0005] Therefore, how to improve the stimulation effect of non-imaging visual response stimulus signals is a technical problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0006] In view of this, embodiments of this application provide a visual stimulation method, apparatus, device, and program product based on non-imaging visual response. By performing temporal asymmetric processing on the target stimulus signal, non-visual light stimulation and visual image stimulation are separated, thereby improving the stimulation effect of non-visual light stimulation.

[0007] In a first aspect, this application provides a visual stimulation method based on non-imaging visual responses, comprising: determining a target stimulus signal, wherein the target stimulus signal is used to stimulate a user's perceptual channel based on non-imaging visual responses; performing time-asymmetric processing on the target stimulus signal to determine a first visual stimulus component and a second visual stimulus component, wherein there is a display time difference between the first visual stimulus component and the second visual stimulus component; applying the first visual stimulus component to the user's first visual channel and applying the second visual stimulus component to the user's second visual channel.

[0008] Secondly, this application provides a visual stimulation device based on non-imaging visual responses. The visual stimulation device includes a rhythm point detection module, a stimulus signal determination module, and a differentiation processing module. The rhythm point detection module is used to determine the current rhythm point of the user wearing the visual stimulation device. The stimulus signal determination module is used to determine a rhythmic stimulus signal based on the current rhythm point, wherein the rhythmic stimulus signal is used to adjust the user's biorhythm to a target rhythm point. The differentiation processing module is used to perform differentiation processing based on the rhythmic stimulus signal to determine a first target stimulus signal and a second target stimulus signal, wherein the display difference between the first target stimulus signal and the second target stimulus signal includes at least one of a display time difference, a display content difference, and a display effect difference.

[0009] Thirdly, this application provides a computer program product, including a computer program / instruction that, when executed by a computer program / instruction processor, implements the visual stimulation method as described in the first aspect.

[0010] Fourthly, this application provides a visual stimulation device based on non-imaging visual responses, comprising: two displays respectively connected to two visual channels of a user; and a controller communicatively connected to the two displays. The controller is configured to: determine a target stimulus signal, wherein the target stimulus signal is used to stimulate the user's perceptual channels based on non-imaging visual responses; perform time-asymmetric processing on the target stimulus signal to determine a first visual stimulus component and a second visual stimulus component, wherein there is a display time difference between the first visual stimulus component and the second visual stimulus component; apply the first visual stimulus component to the user's first visual channel, and apply the second visual stimulus component to the user's second visual channel.

[0011] Therefore, based on the visual stimulation method, apparatus, device, and program product based on non-image visual response provided in this application, a visual stimulus signal capable of triggering non-visual light stimulation is creatively applied to two visual channels of the user in a time-asynchronous manner. The visual channel that perceives the stimulus signal first will, due to the non-image visual response, allow the stimulus signal to directly stimulate the corresponding sensory channel through photosensitive cells. The image content of the stimulus signal needs to be received by the other visual channel before it is perceived by the brain. Thus, based on the aforementioned visual stimulation method, the non-visual light stimulation generated by the light stimulus signal and the visual image stimulation are time-asynchronous, thereby reducing the mutual influence between the two processes, improving the stimulation effect of non-visual light stimulation, and enhancing the shaping ability of non-visual light stimulation on the corresponding sensory channel. Attached Figure Description

[0012] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the embodiments will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present invention and should not be regarded as a limitation on the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0013] Figure 1 is a schematic diagram of an application scenario of the visual stimulation device provided in an exemplary embodiment of this application.

[0014] Figure 2 is an exemplary flowchart of a visual stimulation method provided in an exemplary embodiment of this application.

[0015] Figure 3 is an exemplary flowchart of a target stimulus signal generation method based on an anomaly perception channel provided in an exemplary embodiment of this application.

[0016] Figure 4 is an exemplary flowchart of a target stimulus signal generation method based on physiological signals provided in an exemplary embodiment of this application.

[0017] Figure 5 is an exemplary flowchart of a time asymmetric processing method provided in an exemplary embodiment of this application.

[0018] Figure 6 is a system block diagram of a visual stimulation device provided in some embodiments of this application. Detailed Implementation

[0019] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0020] Application Overview:

[0021] In practical applications, visual stimuli based on non-image-forming visual responses are typically delivered to users through head-mounted display devices. These head-mounted display devices can be equipped with display devices corresponding to the user's left and right eyes, thereby delivering the corresponding visual stimuli.

[0022] In related technologies, visual stimuli based on non-image-forming visual responses are primarily used to regulate circadian rhythms. Circadian rhythms refer to the phenomenon where various functional activities of an organism change according to a specific time cycle. For example, the circadian rhythm controls the sleep-wake cycle and the diurnal variation of the basal metabolic rate. Circadian rhythms are self-regulating mechanisms developed by organisms over a long period of evolution to adapt to environmental changes and maintain physiological homeostasis.

[0023] Specifically, the principle behind the adjustment of circadian rhythms by visual stimuli in non-image-forming visual responses primarily involves intrinsically photosensitive retinal ganglion cells (ipRGCs). These ipRGCs are a special type of retinal ganglion cell that expresses melanopsin and is sensitive to light signals. These cells do not participate in the formation of visual images; instead, they directly transmit light signals to the suprachiasmatic nucleus (SCN), the brain's central nervous system responsible for regulating the biological clock. When light stimulates ipRGCs, these cells transmit signals to the SCN via axons. The SCN is the brain's primary biological clock; it receives light signals from ipRGCs and adjusts the cyclical rhythms of the body's physiological processes accordingly, including diurnal and seasonal rhythms. Furthermore, ipRGCs project to multiple nuclei involved in pupillary light reflex, cognition, learning, regulation of hormone levels, and behavioral response patterns, among others.

[0024] Considering that current visual stimuli based on non-image-forming visual responses primarily involve the adjustment of circadian rhythms, the aforementioned head-mounted display devices, similar to head-mounted virtual reality devices, generally take the form of an eye mask to block external light and house a display device within, thereby displaying corresponding visual stimulus signals. Specifically, in adjusting circadian rhythms (mainly sleep), blue light (446nm–483nm) stimulation signals are primarily involved. Blue light in the 446nm–483nm range can directly affect human melatonin secretion, alertness, and cognitive performance through the aforementioned sensory channels.

[0025] As science continues to advance, research into non-image-forming visual responses is deepening. Related studies have revealed that, in addition to the aforementioned biological rhythms, emotions can also be based on non-image-forming visual stimuli. For example, retinal ganglion cells can perceive imminent threat stimuli (such as the visual stimulus of an "expanding black disk" or a "falling rock animation"), thereby triggering defensive responses through the sensory pathways of the superior colliculus (SC), the posterior lateral nucleus of the thalamus (LP), and the amygdala (Am). Furthermore, the dorsal raphe nucleus (DRN) of tryptophaners can also be modulated through non-image-forming visual responses; that is, retinal ganglion cells can project signals directly to the dorsal raphe nucleus of tryptophaners (DRN) to regulate serotonin levels and emotional behavior.

[0026] Furthermore, in the actual user's bodily regulation process, in addition to the aforementioned non-image-forming visual stimuli, visual stimuli can also adjust bodily functions through visual image stimulation. That is, when a person perceives a light signal, the light signal enters the eye region and is perceived by retinal ganglion cells. These retinal ganglion cells generally convert the received external image information into neural image information and then transmit it to the relevant nuclei for encoding through visual and non-visual light information neural channels. In other words, the same ganglion cell can generally encode both visual and non-visual information simultaneously. The role of this ganglion cell in visual and non-visual encoding is closely related to the specific nucleus it projects to. For example, the Alpha RGC is generally recognized as a retinal ganglion cell used for visual encoding of motion information, but the axonal bifurcation of this cell can simultaneously project to the lateral geniculate nucleus of the visual nucleus and the dorsal raphe nucleus (DRN) of the non-visual nucleus.

[0027] Based on the above, actual external stimuli in nature can generally adjust the physiological characteristics of an organism simultaneously through two sensory channels (visual and non-visual). That is, when both eyes receive visual stimuli, the content of the visual stimulus is perceived, thus forming a visual image stimulus. At the same time, the visual stimulus may directly act on special retinal ganglion cells, thus forming a non-visual light stimulus.

[0028] However, considering that both sensory channels are often stimulated simultaneously, when a person has a defect, the sensory ability of the defective channel is often affected by the sensory status of the other channel, making it difficult to apply appropriate stimulation to one channel and thus difficult to train the defective channel. For example, autistic children lack defensive responses to approaching visual stimuli, and their superior colliculus-occipital lobe-amygdala pathway structure is weak. Conventional visual stimuli are usually perceived and modulated through the visual channel, making it difficult to train the aforementioned superior colliculus-occipital lobe-amygdala pathway.

[0029] To address the aforementioned issues, the patent application proposes a novel approach where visual stimuli that trigger non-visual optical stimulation are applied asynchronously to two of the user's visual channels. The visual channel that first perceives the stimulus signal will, due to its non-image-forming visual response, allow the stimulus signal to directly stimulate the corresponding sensory channel via photosensitive cells. The image content of this stimulus signal, however, is only perceived by the brain after the other visual channel receives the stimulus signal. Therefore, based on the aforementioned visual stimulation method, the non-visual optical stimulation generated by the optical stimulus signal and the visual image stimulation are asynchronous in time, thereby reducing the mutual influence between the two processes, improving the stimulation effect of the non-visual optical stimulation, and enhancing the shaping ability of the non-visual optical stimulation on the corresponding sensory channel.

[0030] For example, when the aforementioned proximity visual stimulus is applied to the user, the image acquired by the left eye can be 100 milliseconds faster than that acquired by the right eye, thus allowing the left eye to receive the proximity visual stimulus preferentially. Considering that the proximity visual stimulus is not acquired by the right eye at this time, it may not generate a visual image stimulus but directly generate a non-visual light stimulus for the left eye. This non-visual light stimulus then stimulates the aforementioned superior colliculus-occipital lobe-amygdala channel, enhancing its perceptual ability. The visual image stimulus, on the other hand, only generates a visual stimulus signal together with the proximity visual stimulus received by the left eye after the right eye receives the proximity visual stimulus, thus providing visual image stimulation and avoiding its influence on the non-visual light stimulus.

[0031] In view of the aforementioned situation, and considering that the aforementioned process requires time asymmetry processing of the visual stimulus signal, in the stimulation device of this application, there are different displays corresponding to each eye, and the displays can be driven independently, thereby providing time asymmetric visual stimulus signals.

[0032] To further illustrate the visual stimulation device provided in this application, this application provides a schematic diagram of an application scenario for a non-imaging visual response visual stimulation device (Figure 1).

[0033] As shown in Figure 1, in the application scenario using the visual stimulation device 100, the user 130 can wear the visual stimulation device 100. The visual stimulation device 100 generally resembles a virtual reality device (i.e., a VR device) in appearance. For example, the outer shell of the visual stimulation device 100 can completely cover the user 130's eye area to block external light from entering. Two displays (i.e., displays 110 and 120) can be installed within the visual stimulation device 100, corresponding to the user 130's left and right eyes respectively, to display corresponding visual stimuli for the corresponding visual channels.

[0034] Furthermore, under suitable usage conditions, the aforementioned visual stimulation device 100 can also be presented as an open device, similar to an augmented reality (AR) device. The visual stimulation device 100 itself does not block ambient light, thereby superimposing the stimulation signal onto natural light in a superimposed form.

[0035] In some embodiments, the aforementioned visual stimulation device 100 may also be equipped with a controller, wherein the controller may be connected to and driven by the two aforementioned displays respectively, thereby controlling the displays to independently play different content, so as to realize the aforementioned time-asymmetric visual stimulation signal.

[0036] In some embodiments, the aforementioned visual stimulation device 100 may further include stimulation devices for other sensory channels. For example, the aforementioned visual stimulation device 100 may further include two players, which play audio stimulation to the left and right ears of the user 130 respectively. As another example, the visual stimulation device 100 may further include multiple electrical stimulation devices, thereby connecting to the user 130 to provide electrical stimulation to the user 130.

[0037] In some embodiments, the aforementioned visual stimulation device 100 may have multiple built-in human body sensors and / or human body sensor communication connections to acquire physiological data of the human body during the stimulation process.

[0038] Based on the aforementioned visual stimulation device 100, the two displays can be controlled by a controller to execute the visual stimulation method provided in this application. Various non-limiting embodiments of the visual stimulation method of this application will now be described in detail with reference to Figures 2 to 6.

[0039] Exemplary visual stimulation methods:

[0040] Based on the aforementioned visual stimulation device, this application provides a visual stimulation method based on non-imaging visual responses. Figure 2 is an exemplary flowchart of a visual stimulation method based on non-imaging visual responses provided in some embodiments of this application.

[0041] In some embodiments, the process shown in FIG2 can be executed by a controller in the visual stimulation device 100.

[0042] As shown in Figure 2, P200 may include the following steps:

[0043] S210. Identify the target stimulus signal.

[0044] S220. Perform time-asymmetric processing on the target stimulus signal to determine the first visual stimulus component and the second visual stimulus component.

[0045] S230, Apply a first visual stimulus component to the user's first visual channel and apply a second visual stimulus component to the user's second visual channel.

[0046] In the aforementioned S220, the target stimulus signal can refer to a stimulus signal that can elicit a non-image-forming visual response from the user. That is, the target stimulus signal can stimulate the user's perceptual channels based on non-image-forming visual responses. For example, the target stimulus signal can be a stimulus signal of the rhythm regulation perceptual channel (i.e., the suprachiasmatic nucleus channel). As another example, the target stimulus signal can be a stimulus signal of the emotion regulation perceptual channel (i.e., the superior colliculus-occipital lobe-amygdala channel).

[0047] Considering that the visual stimulus applied in this application is time-asymmetric, the aforementioned target stimulus signal can be the original stimulus signal before the time-asymmetric processing.

[0048] In practical applications, the aforementioned S210 can be executed based on the operation of the user and / or relevant personnel. That is, the visual stimulation device can have multiple stimulation signals built-in, and the user or relevant personnel (such as medical staff) can select the corresponding stimulation signal according to actual needs. Then, when executing the aforementioned S210, the corresponding target stimulation signal can be determined based on this selection.

[0049] In this application, a sensory channel can refer to the collection of sensory organs that perceive or sense a stimulus signal when it is applied to the human body. Considering that this application mainly relates to optical stimulation, the sensory channel generally originates from retinal cells. When the retinal cells directly transmit the stimulus, the sensory channel can be regarded as a sensory channel for non-visual light stimulation; when the retinal cells transmit graphic signals, the corresponding sensory channel can be regarded as a sensory channel for visual image stimulation.

[0050] In some embodiments, considering the correspondence between the target stimulus signal and the sensory channel, the aforementioned S210 can be determined based on the user's different sensory channels, thereby generating a stimulus signal from an abnormal sensory channel as the target stimulus signal. For more information on determining the target stimulus signal based on the sensory channel, please refer to Figure 3 and its related description.

[0051] In some embodiments, the generation of the target stimulus signal can also be determined based on the user's test results, i.e., by collecting the user's physiological data to determine an appropriate target stimulus signal. For more information on determining the target stimulus signal based on physiological data, please refer to Figure 4 and its related description.

[0052] In the aforementioned S220, temporal asymmetry can refer to a time difference between the stimulus signal applied to the user's left channel and the stimulus signal applied to the user's right channel. Considering that this application mainly involves visual stimulation, the left and right channels can specifically be represented by the user's left and right eyes, that is, there is a time difference between the image seen by the user's left eye and the image seen by the user's right eye. For example, after the user's right eye sees an image, the same image will be applied to the user's left eye 50ms later.

[0053] Temporal asymmetry processing refers to the process of adjusting the timing of stimulus signals. Based on this, the stimulus signals applied to the left and right channels will have a time difference. Considering that this application mainly relates to visual stimulation methods based on non-imaging visual responses, the visual stimulus components in the target stimulus signal can be processed in the aforementioned S220 to determine the two visual stimulus components with a time difference.

[0054] For ease of description, the two visual stimulus components with a time difference can be referred to as the first visual stimulus component and the second visual stimulus component, respectively. The first visual stimulus component is presented to the user earlier than the second visual stimulus component.

[0055] In some embodiments, the aforementioned temporal asymmetry processing can also be implemented by generating a signal. That is, a time-delayed / advanced visual stimulus component can be generated based on the visual stimulus component in the target stimulus signal. This determines the first visual stimulus component and the second visual stimulus component. For example, a blank frame of a certain duration can be added before the stimulus image sequence of the aforementioned visual stimulus component to serve as the delayed visual stimulus component. Thus, the original visual stimulus component without the added blank frame is used as the first visual stimulus component, and the visual stimulus component with the added blank frame is used as the second visual stimulus component.

[0056] In some embodiments, the aforementioned time asymmetry processing can also be implemented through playback control of the visual stimulus component in the target stimulus signal. For example, in response to a stimulus command, the visual stimulus component can be directly displayed on one display, and then displayed on another display after a period of time. The visual stimulus component displayed directly can be understood as the aforementioned first visual stimulus component, and the one displayed after a period of time can be the second visual stimulus component.

[0057] In the aforementioned S230, the first visual channel and the second visual channel can be one of the left or right eyes, wherein the first visual channel corresponds to the aforementioned first visual stimulus component, and the second visual channel corresponds to the second visual stimulus component. When executing the aforementioned S230, the corresponding visual stimulus component can be applied through the display of the corresponding visual channel.

[0058] In some embodiments, the first visual channel and the second visual channel can be selected from the user's left and right eyes. Generally, when the perceptual abilities of the left and right channels are inconsistent (i.e., the perceptual abilities of the two visual channels are unbalanced), the channel with weaker perceptual ability can be used as the first channel (e.g., the visual channel with weaker perceptual ability can be used as the first visual channel), thereby improving the perceptual ability of that channel by preferentially applying stimulation.

[0059] When the user's left and right visual perception abilities are balanced, the first visual channel and the second visual channel can be randomly / rotated.

[0060] In some embodiments, considering the correspondence between visual channels and visual stimulus components, the step of determining the visual channel can be performed during S220. See Figure 5 and its related description for details.

[0061] Therefore, based on the above process, P200 creatively applies visual stimulus signals that can trigger non-visual light stimulation to the user's two visual channels in a time-asynchronous manner. The visual channel that perceives the stimulus signal first will, due to the non-image-forming visual response, allow the stimulus signal to directly stimulate the corresponding sensory channel through photosensitive cells. The image content of the stimulus signal will only be perceived by the brain after the other visual channel receives the stimulus signal. Thus, based on the aforementioned visual stimulation method, the non-visual light stimulation generated by the light stimulus signal and the visual image stimulation are time-asynchronous, thereby reducing the mutual influence between the two processes, improving the stimulation effect of non-visual light stimulation, and enhancing the shaping ability of non-visual light stimulation on the corresponding sensory channel.

[0062] For example, the structural connections of the superior colliculus-occipital lobe-amygdala pathway are weaker in children with autism. When implementing the visual stimulation method provided in this application for this situation, the stimulation signal of the aforementioned pathway can be used as the target stimulation signal, and temporal asymmetric control can be performed. After the stimulation signal is applied, the superior colliculus-occipital lobe-amygdala pathway preferentially responds to non-visual light stimulation and modulates. The visual encoder needs to adjust based on the image information after fully receiving the stimulation signal, thereby improving the expressive ability of the superior colliculus-occipital lobe-amygdala pathway during the aforementioned adjustment process, strengthening the superior colliculus-occipital lobe-amygdala pathway, and thus overcoming childhood autism.

[0063] In some embodiments, considering the diversity of human perception, the aforementioned target stimulus signal can be characterized as a multimodal signal, that is, in addition to the aforementioned visual stimulus component, it may also include stimulus signals of other modalities. For example, the target stimulus signal may also include electrical stimulation, auditory stimulation, tactile stimulation, etc. Therefore, when applying the aforementioned visual stimulus component, other modal stimulus signals may also be applied simultaneously. That is, during the aforementioned visual stimulation process, at least one accompanying stimulus signal can be determined from the target stimulus signal. At least one accompanying stimulus signal is applied to the user. The accompanying stimulus signal can be a stimulus signal of another modality from the target stimulus signal besides the visual stimulus component.

[0064] In some embodiments, the accompanying stimulus signal may also be processed with temporal asymmetry to achieve temporal asymmetry in its application. This process is similar to that of the visual stimulus component and will not be described in detail here.

[0065] An exemplary method for determining the target stimulus signal:

[0066] To further describe the process of determining the target stimulus signal, this application also provides a flowchart illustrating the method for determining the target stimulus signal. Figure 3 is an exemplary flowchart of a target stimulus signal generation method based on an anomaly perception channel provided in an exemplary embodiment of this application. Figure 4 is an exemplary flowchart of a target stimulus signal generation method based on physiological signals provided in an exemplary embodiment of this application.

[0067] As shown in Figure 3, process P300 may include the following steps:

[0068] S310, Determine the user's anomaly detection channel.

[0069] S320. Determine the stimulation signal requirements for the abnormal perception channel.

[0070] S330. Determine the target stimulus signal that meets the stimulus signal requirements.

[0071] In the aforementioned S310, the abnormal perceptual channel can be a perceptual channel with abnormal perceptual ability or abnormal working state. For example, as mentioned above, autistic children have an abnormal perceptual channel, specifically the superior colliculus-occipital lobe-amygdala channel. Another example is when there is abnormal circadian rhythm, the abnormal perceptual channel is related to the suprachiasmatic nucleus channel.

[0072] In some embodiments, the abnormality perception channel in the aforementioned S310 can be input by relevant staff / users, or it can be determined by the user's physiological signals (such as sleep cycles, hormone levels, etc.), and can be calibrated according to the actual situation.

[0073] In the aforementioned S320, the stimulus signal requirement can refer to the requirements that a stimulus signal capable of stimulating the abnormal perception channel must meet. That is, a stimulus signal that meets the stimulus signal requirement can stimulate the abnormal perception channel through non-imaging visual responses.

[0074] In some embodiments, considering the actual triggering of non-imaging visual responses, stimulus signal requirements generally include two parts: display requirements and content requirements. Display requirements can be understood as requirements related to the light in the stimulus signal. For example, display requirements may include light intensity requirements, wavelength requirements, etc. Content requirements can be understood as requirements regarding the signal content of the stimulus signal. For example, content requirements may include requirements related to the actions or objects displayed in the stimulus signal.

[0075] In some embodiments, the aforementioned S320 can generally be executed based on the specific type of the abnormal perception channel. When executing the aforementioned S320, the visual stimulation device can, in response to an abnormality in the rhythm regulation channel, determine the rhythmic stimulation signal requirement for the target rhythm point, wherein a stimulus signal that meets the rhythmic stimulation signal requirement can stimulate the rhythm regulation perception channel through a non-imaging visual response to adjust the user's biorhythm to the target rhythm point. The visual stimulation device can also, in response to an abnormality in the emotion regulation channel, determine the emotion stimulation signal requirement, wherein a stimulus signal that meets the emotion stimulation signal requirement can stimulate the emotion regulation channel through a non-imaging visual response.

[0076] In some embodiments, the aforementioned abnormal perception channels may include multiple perception channels, and the corresponding stimulus signals need to be capable of triggering each channel. For example, in cases of childhood autism, which is often accompanied by circadian rhythm disorders, the abnormal perception channels may include the superior colliculus-occipital lobe-amygdala channel and the suprachiasmatic nucleus channel. Therefore, the corresponding stimulus signals may include both emotional stimulus signals from the superior colliculus-occipital lobe-amygdala channel and rhythmic stimulus signals.

[0077] In the aforementioned S330, when determining the target stimulus signal, signal generation can be directly based on the aforementioned stimulus signal requirements to ensure that the stimulus signal requirements are met. Wherein, when there are multiple stimulus signal requirements, the target stimulus signal can be determined comprehensively based on multiple requirements to ensure that each specific requirement is met.

[0078] As mentioned above, considering that the aforementioned stimulus signal requirements include both content requirements and display requirements, the aforementioned S330 may include the following sub-steps:

[0079] S331. Determine the target display requirements and target content requirements of the target stimulus signal based on the stimulus signal requirements.

[0080] S332. Determine the initial stimulus signal that meets the requirements of the target content.

[0081] S333. Adjust the initial stimulus signal based on the target display requirements and determine the target stimulus signal.

[0082] In the aforementioned S331, the target display requirement can be the overall display requirement of the target stimulus signal, that is, the intersection of the display requirements corresponding to different sensory channels. Similarly, the target content requirement can be represented as the intersection of the content requirements corresponding to different sensory channels.

[0083] It should be noted that when the requirements corresponding to different sensory channels conflict, some abnormal sensory channels can be removed by user selection or automatic selection to ensure the normal execution of the stimulus. For example, in S310, multiple abnormal sensory channels of the user can be identified. When it is determined that there is a conflict between the requirements (display requirements and / or content requirements) corresponding to different abnormal sensory channels, the aforementioned P300 may further include: removing some abnormal sensory channels from the multiple abnormal sensory channels according to user selection or automatic selection. In this case, the aforementioned S330 may include: determining the target stimulus signal that meets the stimulus signal requirements of the remaining abnormal sensory channels. Wherein, the remaining abnormal sensory channels are the abnormal sensory channels remaining after removing the aforementioned partial abnormal sensory channels from the multiple abnormal sensory channels.

[0084] In the specific process of generating the target stimulus signal, the content can be generated first and then the representation form can be adjusted. That is, in the aforementioned S332, a stimulus signal that meets the target content requirements can be generated. In S333, the display effect of this stimulus signal will be adjusted based on the target display requirements, thereby generating the corresponding target stimulus signal.

[0085] For example, in the case of the aforementioned childhood autism, stimulation of the superior colliculus-occipital lobe-amygdala pathway is generally based on signal content to trigger the user's defensive behavior. That is, emotional stimuli are generally characterized by content that can stimulate the user's defensive behavior; for example, the content could be an expanding black disc stimulus or a falling rock animation. Rhythmic stimuli, on the other hand, are generally characterized by wavelength and brightness. For example, the aforementioned blue light can stimulate the user to reach sleep rhythm points.

[0086] At the practical execution level, considering the complexity of content requirements, corresponding stimulus signals can be generated in advance. When generating the initial stimulus signal, the corresponding stimulus signal can be invoked. For example, the aforementioned S332 may include: using the pre-generated stimulus signal that meets the target content requirements as the initial stimulus signal. The corresponding display requirements can be characterized as the adjustment of the image's color temperature, hue, and brightness.

[0087] Therefore, based on the aforementioned P300, the corresponding stimulus signal can be determined for the abnormal sensory channel, thereby realizing the stimulation and reconstruction of the abnormal sensory channel to adapt to the abnormality of various sensory channels.

[0088] As shown in Figure 4, process P400 may include the following steps:

[0089] S410, Apply test stimulus signals to the user's two visual channels.

[0090] S420. Determine the initial physiological data of the user's response to the test stimulus signal.

[0091] S430. Determine the target stimulus signal based on initial physiological data.

[0092] In the aforementioned S410, the test stimulus signal can be a stimulus signal that stimulates the user's bodily functions. In order to determine the user's perception status in the left and right channels, the aforementioned test stimulus signal can also be a time-asymmetric stimulus, so that the stimulation received by the left and right channels is asynchronous when the test stimulus signal is applied.

[0093] The specific content of the aforementioned test stimulus signals can be determined based on the user's functional needs for testing. Generally, parameters such as the difference in perception ability between the left and right channels, the user's circadian rhythm, and the perception ability of each sensory channel can be determined based on physiological data. Then, the corresponding test stimulus signals can be selected and combined accordingly.

[0094] In the aforementioned S420, physiological data refers to measurements and parameters that reflect an individual's health status and physiological functions. Considering that this application mainly involves the stimulation of human sensory channels, the aforementioned physiological data can be related to human sensory abilities. For example, physiological data may include electroencephalograms, electrooculograms, eye monitoring images, and results of detection of specific parameters in the body, which can directly or indirectly reflect human sensory abilities.

[0095] In some embodiments, considering that non-visual light stimulation is generally used for the control of circadian rhythms, the aforementioned physiological data may include physiological data that determines the user's current circadian rhythm point. For example, sleep-wake cycles, body temperature, hormone levels, heart rate and heart rate variability, cortisol levels, etc.

[0096] Initial physiological data can refer to physiological data after the application of the aforementioned test stimulus signal. During the execution of S420, it is generally only necessary to control the acquisition time to be after the application of the aforementioned test stimulus signal; the specific acquisition method is not limited in this application. For example, it can be executed directly through a sensor on the visual stimulation device, that is, the data acquired by that sensor can be used as physiological data. Alternatively, it can be achieved through external data (such as data acquired by an external sensor or data manually entered by the user).

[0097] In the aforementioned S430, the user's response to the test stimulus signal can be determined based on the initial physiological signals, thereby determining the target stimulus signal. For example, an abnormal perception channel can be identified based on the aforementioned initial physiological signals, thereby executing the relevant steps of the aforementioned P300 to determine the target stimulus signal.

[0098] In some embodiments, taking into account the user's response to the stimulus signal, after applying the target stimulus signal, the target stimulus signal can also be adjusted based on feedback physiological data to achieve feedback control of the stimulation process. The aforementioned P400 may further include the following steps:

[0099] S440. Determine the user's feedback physiological data in response to the target stimulus signal.

[0100] S450: Update the target stimulus signal based on feedback physiological data.

[0101] The feedback physiological data in S440 is similar to the initial physiological data mentioned above, and can be physiological data after the application of the target stimulus signal. The specific time period it corresponds to can correspond to the adjustment of the target stimulus signal. Generally, the adjustment process of the target stimulus signal depends on the physiological data within a certain period before the adjustment operation, that is, the physiological data within this period can be the feedback physiological data.

[0102] During the aforementioned adjustment process of S450, adjustments can be made based on changes in perceptual ability. For example, the intensity of the stimulus signal can be increased as the user gradually adapts to the current stimulus. As another example, the signal content can be adjusted based on improvements in perceptual deficiencies.

[0103] In some embodiments, as shown in P200, the aforementioned target stimulus signal can be subjected to time asymmetric processing. To further describe this process, this application also provides an exemplary flowchart of a time asymmetric processing method (Figure 5).

[0104] As shown in Figure 5, process P500 may include the following steps:

[0105] S510, Determine the first visual channel and the second visual channel from the user's two visual channels.

[0106] S520. Determine the perception time thresholds for the first visual channel and the second visual channel.

[0107] S530. Perform time asymmetric processing on the target stimulus signal based on the perception time threshold to determine the first visual stimulus component and the second visual stimulus component.

[0108] As mentioned above, in S510, the first visual channel and the second visual channel can be selected based on perceptual ability. That is, in response to an imbalance in the perceptual abilities of the two visual channels, the first visual channel and the second visual channel can be determined from the user's two visual channels based on the perceptual abilities of the two visual channels, so that the perceptual ability of the first visual channel lags behind that of the second visual channel.

[0109] Furthermore, when there is no imbalance in perceptual ability, the first visual channel and the second visual channel can be randomly selected or periodically adjusted. For example, the aforementioned S510 can specifically include: in response to the balance of perceptual ability between the two visual channels, randomly selecting one of the two visual channels as the first visual channel and the other as the second visual channel.

[0110] In the aforementioned S520, the perception time threshold can refer to the minimum time interval at which two consecutive visual stimuli can be distinguished. For visual stimuli, the perception time threshold can also be called the visual perception threshold, which refers to the minimum time interval at which the human eye can distinguish two consecutive visual stimuli.

[0111] In practical applications, the perception time threshold can be a preset value (such as 250 milliseconds) to ensure that the aforementioned time difference is less than the perception time threshold, thereby treating the asynchronous left and right stimuli as a single stimulus.

[0112] In some embodiments, considering individual differences in the human eye's perception time threshold, the aforementioned S520 can be performed by testing or receiving test results. For specific testing methods regarding the perception time threshold, please refer to related technologies.

[0113] In the aforementioned S530, based on the aforementioned perception time threshold, the first visual stimulus component and the second visual stimulus component have a display time difference that is less than the perception time threshold. Therefore, after the first visual stimulus component and the second visual stimulus component are applied to the left and right eyes respectively, although there is a time difference between the two, it does not exceed the perception time difference. The two stimuli are processed as synchronous stimuli in the human brain, thereby ensuring that the visual image stimulus is perceived by the human brain only after the second visual stimulus component is applied.

[0114] Furthermore, considering the differences in the human binocular system, differential processing can be performed when determining the aforementioned first visual component and second visual component to satisfy the spatial relationship between the two eyes.

[0115] Exemplary systems and control systems:

[0116] The method embodiments of this application have been described in detail above with reference to Figures 1 to 5. The apparatus embodiments of this application are described in detail below. It should be understood that the descriptions of the method embodiments correspond to the descriptions of the apparatus embodiments; therefore, any parts not described in detail can be referred to the foregoing method embodiments.

[0117] This application also provides a visual stimulation device, including modules for implementing the visual stimulation method provided in this application. For example, as shown in FIG6, FIG6 is a system block diagram of a visual stimulation device provided in an exemplary embodiment of this application. The visual stimulation device 600 may include a stimulation signal determination module 610, a differentiation processing module 620, and an execution module 630.

[0118] The stimulus signal determination module 610 can be used to determine a target stimulus signal, wherein the target stimulus signal is used to stimulate the user's perceptual channel based on non-imaging visual response.

[0119] The differentiation processing module 620 can be used to perform time asymmetric processing on the target stimulus signal to determine the first visual stimulus component and the second visual stimulus component, wherein there is a display time difference between the first visual stimulus component and the second visual stimulus component.

[0120] The execution module 630 can be used to apply a first visual stimulus component to the user's first visual channel and a second visual stimulus component to the user's second visual channel.

[0121] This application also provides a control system for a visual stimulation device, which can be characterized as the controller of the aforementioned visual stimulation device. The control system may include a memory, a processor, and an input / output interface. The memory, processor, and input / output interface are connected via an internal connection channel. The memory stores instructions, and the processor executes the instructions stored in the memory to control the input / output interface to receive input data and information and output data (such as the drive signals of the two aforementioned displays).

[0122] It should be understood that in the embodiments of this application, the processor may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, used to execute relevant programs to implement the technical solutions provided in the embodiments of this application.

[0123] The memory may include read-only memory and random access memory, and provides instructions and data to the processor. A portion of the processor may also include non-volatile random access memory. For example, the processor may also store information about the device type.

[0124] In implementation, each step of the above method can be completed through integrated logic circuits in the processor's hardware or through software instructions. The visual stimulation method disclosed in the embodiments of this application can be directly implemented by a hardware processor, or by a combination of hardware and software modules within the processor. The software modules can reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0125] This application also provides a computer program product, including a computer program / instructions. When the computer program / instruction processor in the computer program product provided in this application is executed, the visual stimulation method provided in this application can be implemented.

[0126] It should be understood that the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0127] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0128] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0129] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0130] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0131] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a driver's device, a core network device, an operation administration and maintenance (OAM) device, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can read or a data storage device such as a server or data center that integrates one or more available media. The available medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disc (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)). The computer-readable storage medium may be volatile or non-volatile, or may include both types.

[0132] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A visual stimulation method based on non-imaging visual responses, characterized in that, include: Determine a target stimulus signal, wherein the target stimulus signal is used to stimulate the user's perceptual channels based on non-imaging visual responses; The target stimulus signal is subjected to time asymmetric processing to determine a first visual stimulus component and a second visual stimulus component, wherein there is a display time difference between the first visual stimulus component and the second visual stimulus component. The first visual stimulus component is applied to the user's first visual channel, and the second visual stimulus component is applied to the user's second visual channel.

2. The visual stimulation method according to claim 1, characterized in that, The step of performing time-asymmetric processing on the target stimulus signal to determine the first visual stimulus component and the second visual stimulus component includes: Determine the first visual channel and the second visual channel from the user's two visual channels; Determine the perception time thresholds for the first visual channel and the second visual channel; Based on the perception time threshold, the target stimulus signal is subjected to time asymmetric processing to determine the first visual stimulus component and the second visual stimulus component, wherein the first visual stimulus component has a display time difference of less than the perception time threshold relative to the second visual stimulus component.

3. The visual stimulation method according to claim 2, characterized in that, Determining the first visual channel and the second visual channel from the user's two visual channels includes: In response to an imbalance in the perceptual capabilities of the two visual channels, the first visual channel and the second visual channel are determined from the user's two visual channels based on the perceptual capabilities of the two visual channels, wherein the perceptual capability of the first visual channel lags behind that of the second visual channel.

4. The visual stimulation method according to claim 2, characterized in that, Determining the first visual channel and the second visual channel from the user's two visual channels includes: In response to the balance of perception capabilities of the two visual channels, one of the two visual channels is randomly selected as the first visual channel and the other is selected as the second visual channel.

5. The visual stimulation method according to any one of claims 1-4, characterized in that, The determination of the target stimulus signal includes: Test stimulus signals are applied to the user's two visual channels, wherein the test stimulus signals are time-asymmetric stimuli; Determine the initial physiological data of the user's response to the test stimulus signal; The target stimulus signal is determined based on the initial physiological data.

6. The visual stimulation method according to claim 5, characterized in that, Also includes: Determine the user's feedback physiological data in response to the target stimulus signal; The target stimulus signal is updated based on the feedback physiological data.

7. The visual stimulation method according to any one of claims 1-4, characterized in that, The determination of the target stimulus signal includes: Determine the abnormal perception channel of the user; The stimulation signal requirements of the abnormality perception channel are determined, wherein a stimulation signal that meets the stimulation signal requirements can stimulate the abnormality perception channel through a non-imaging visual response. Determine the target stimulus signal that meets the requirements of the stimulus signal.

8. The visual stimulation method according to claim 7, characterized in that, The requirement for determining the stimulus signal of the abnormal perception channel includes: In response to an anomaly in the rhythm regulation channel, the rhythm stimulation signal requirements for the target rhythm point are determined, wherein the stimulation signal that meets the rhythm stimulation signal requirements can stimulate the rhythm regulation perception channel through a non-imaging visual response to adjust the user's biological rhythm to the target rhythm point; In response to an abnormality in the emotion regulation channel, an emotion stimulus signal requirement is determined, wherein a stimulus signal that meets the emotion stimulus signal requirement can stimulate the emotion regulation channel through a non-imaging visual response.

9. The visual stimulation method according to claim 7 or 8, characterized in that, The determination of the target stimulus signal that satisfies the stimulus signal requirements includes: Based on the stimulus signal requirements, determine the target display requirements and target content requirements of the target stimulus signal; Determine the initial stimulus signal that meets the target content requirements; The initial stimulus signal is adjusted based on the target display requirements to determine the target stimulus signal.

10. The visual stimulation method according to claim 9, characterized in that, The user has multiple anomaly detection channels. The target display requirement is the intersection of the display requirements corresponding to each of the multiple anomaly detection channels; And / or, The target content requirement is the intersection of the content requirements corresponding to each of the multiple anomaly perception channels.

11. The visual stimulation method according to claim 9, characterized in that, The determination of the initial stimulus signal that satisfies the target content requirements includes: The pre-generated stimulus signal that meets the target content requirements is used as the initial stimulus signal.

12. The visual stimulation method according to any one of claims 1-11, characterized in that, Also includes: Determine at least one accompanying stimulus signal from the target stimulus signal; The at least one accompanying stimulus signal is applied to the user.

13. A visual stimulation device based on non-imaging visual responses, characterized in that, include: A stimulus signal determination module is used to determine a target stimulus signal, wherein the target stimulus signal is used to stimulate the user's perceptual channel based on a non-imaging visual response. The differential processing module is used to perform time asymmetric processing on the target stimulus signal to determine a first visual stimulus component and a second visual stimulus component, wherein there is a display time difference between the first visual stimulus component and the second visual stimulus component. An execution module is configured to apply the first visual stimulus component to the user's first visual channel and apply the second visual stimulus component to the user's second visual channel.

14. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instruction processor is executed, the visual stimulation method as described in any one of claims 1 to 12 is implemented.

15. A visual stimulation device based on non-imaging visual responses, characterized in that, include: Two displays, each connected to one of the user's two visual channels; as well as A controller communicatively connected to the two displays, the controller being used for: Determine a target stimulus signal, wherein the target stimulus signal is used to stimulate the user's perceptual channels based on non-imaging visual responses; The target stimulus signal is subjected to time asymmetric processing to determine a first visual stimulus component and a second visual stimulus component, wherein there is a display time difference between the first visual stimulus component and the second visual stimulus component. The first visual stimulus component is applied to the user's first visual channel, and the second visual stimulus component is applied to the user's second visual channel.

Images