Consciousness state detection system and method

Abstract

Provided are a consciousness state detection system and method, wherein the system comprises: a visual stimulation apparatus (110) arranged in a visual field region of a target subject and configured for displaying visual stimulation information so as to perform, on the basis of the visual stimulation information, visual stimulation on the target subject (S310), wherein the visual stimulation information comprises visual field shadow stimulation and / or visual threat stimulation; a feedback behavior collection apparatus (120) connected to a consciousness state determination apparatus (130) and configured for collecting, when the visual stimulation information is displayed, a target feedback behavior of the target subject and sending the target feedback behavior to the consciousness state determination apparatus (S320); and the consciousness state determination apparatus (130), which is configured for receiving the target feedback behavior sent by the feedback behavior collection apparatus (120), and determining, on the basis of the target feedback behavior and a standard feedback behavior, the consciousness state of the target subject (S330). By adopting the technical solutions of the present invention, the consciousness state of the target subject can be quickly, conveniently, and accurately determined.

Description

Consciousness state detection system and method Technical Field

[0001] The present application belongs to the technical field of consciousness state detection, and in particular relates to a consciousness state detection system and method. Background Art

[0002] Consciousness is a complex and multidimensional concept that encompasses wakefulness, attention, self-awareness, cognitive processing, and more. Consciousness research is a key area for understanding the thinking, perception, and subjective experience of humans and other animals. By studying consciousness, we can reveal how the brain processes information, generates cognitive images, makes decisions, and makes conscious choices. This helps to elucidate the nature of human consciousness and understand the mechanisms of perception and thinking. This also has important guiding significance for improving fields such as artificial intelligence and cognitive neuroscience. It also has important value for the clinical diagnosis and treatment of patients with disorders of consciousness (such as vegetative patients, comatose patients, etc.) and medical applications.

[0003] However, most current methods for assessing the state of consciousness are based on behavioral observation, physiological indicators, EEG, brain imaging, or cognitive tests. Although these methods can provide a basis for consciousness assessment, they also have many limitations. For example, simple behavioral and cognitive observations are difficult to eliminate the influence of subjectivity and individual differences. Monitoring technology based on EEG signals has low spatial resolution and requires professional knowledge and experience to interpret. Brain imaging technology has high requirements for equipment and is complex and time-consuming to operate. Therefore, there is a lack of methods and means to quickly and accurately assess the state of consciousness.

[0004] Summary of the Invention

[0005] The present application provides a system and method for detecting a state of consciousness to solve the technical problems of cumbersome operation and poor accuracy of the state of consciousness detection method.

[0006] In a first aspect, the present application provides a consciousness state detection system (100), the system comprising: a visual stimulation device (110), a feedback behavior collection device (120), and a consciousness state determination device (130);

[0007] The visual stimulation device (110) is arranged in the visual field of the target object and is used for displaying the visual stimulation information so as to provide visual stimulation to the target object based on the visual stimulation information, wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation;

[0008] The feedback behavior collection device (120) is connected to the consciousness state determination device (130) and is used to collect the target feedback behavior of the target object when the visual stimulation information is displayed, and send the target feedback behavior to the consciousness state determination device (130);

[0009] The consciousness state determining device (130) is used to receive the target feedback behavior sent by the feedback behavior collecting device (120), and determine the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior.

[0010] In a second aspect, the present application provides a method for detecting a state of consciousness, which is applied to a state of consciousness detection system (100), wherein the state of consciousness detection system (100) comprises a visual stimulation device (110), a feedback behavior acquisition device (120), and a state of consciousness determination device (130), wherein the feedback behavior acquisition device (120) is connected to the state of consciousness determination device (130); wherein the state of consciousness detection method comprises:

[0011] Displaying visual stimulation information by means of the visual stimulation device (110) disposed in the visual field of the target object, so as to provide visual stimulation to the target object based on the visual stimulation information, wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation;

[0012] By means of a feedback behavior acquisition device (120), while displaying the visual stimulation information, a target feedback behavior of a target object is acquired, and the target feedback behavior is sent to the consciousness state determination device (130);

[0013] The target feedback behavior sent by the feedback behavior acquisition device (120) is received by the consciousness state determination device (130), and the consciousness state of the target object is determined based on the target feedback behavior and the standard feedback behavior.

[0014] The technical solution of the embodiment of the present application provides a consciousness state detection system (100), comprising: a visual stimulation device (110), a feedback behavior acquisition device (120) and a consciousness state determination device (130), wherein the visual stimulation device (110) is arranged in the visual field area of ​​the target object, and is used to display visual stimulation information to visually stimulate the target object based on the visual stimulation information, wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation; the feedback behavior acquisition device (120) is connected to the consciousness state determination device (130), and is used to acquire the target feedback behavior of the target object when the visual stimulation information is displayed, and send the target feedback behavior to the consciousness state determination device (130); the consciousness state determination device (130) is used to receive the target feedback behavior sent by the feedback behavior acquisition device (120), and determine the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior, so as to simply, quickly and effectively acquire the target feedback behavior, provide data support for the analysis of the consciousness state of the target object, solve the technical problems of cumbersome operation and poor accuracy of the consciousness state detection method, and achieve the effect of quickly, conveniently and accurately determining the consciousness state of the target object.

[0015] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] FIG1 is a schematic structural diagram of a consciousness state detection system provided in Example 1 of the present application.

[0017] FIG2 is a schematic structural diagram of a consciousness state detection system provided in Example 1 of the present application.

[0018] FIG3 is a schematic structural diagram of a consciousness state detection system provided in Example 1 of the present application.

[0019] FIG4 is a schematic structural diagram of a consciousness state detection system provided in Example 2 of the present application.

[0020] FIG5 is a schematic structural diagram of a consciousness state detection system provided in Example 2 of the present application.

[0021] FIG6 is a schematic structural diagram of a consciousness state detection system provided in Example 2 of the present application.

[0022] FIG7 is a schematic structural diagram of a consciousness state detection system provided in Example 2 of the present application.

[0023] FIG8 is a schematic structural diagram of a consciousness state detection system provided in Example 2 of the present application.

[0024] FIG9 is a schematic structural diagram of a consciousness state detection system provided in Example 2 of the present application.

[0025] FIG10 is a flow chart of a method for detecting a state of consciousness provided in Example 3 of the present application. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0029] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0030] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0031] Example 1

[0032] Figure 1 is a structural diagram of a consciousness state detection system provided in Example 1 of the present application. This embodiment is applicable to the situation of detecting the consciousness state of a target object. The consciousness state detection system 100 can be implemented in the form of hardware and / or software. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server, etc.

[0033] As shown in FIG1 , the consciousness state detection system 100 may specifically include: a visual stimulation device 110 , a feedback behavior acquisition device 120 and a consciousness state determination device 130 ; wherein the feedback behavior acquisition device 120 is connected to the consciousness state determination device 130 .

[0034] The visual stimulation device 110 is disposed in the visual field of the target object and is used to display visual stimulation information to provide visual stimulation to the target object based on the visual stimulation information, wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation.

[0035] In the present embodiment, the target object is an object for consciousness state detection, which can be a human body or other animal body, and the present embodiment does not limit this. It is understandable that the eyelids of the target object can be in an open state to ensure that the target object receives visual stimulation information. The visual field range of the target object at least partially includes the visual stimulation device 110, so that the target object receives the visual stimulation information displayed by the visual stimulation device 110, wherein the visual stimulation information is information that visually stimulates the target object, and the target object in the awake state can make behavioral feedback to the received visual stimulation information, and the visual stimulation device 110 is a device for displaying visual stimulation information. Optionally, the visual stimulation device 110 includes a display device 111 and / or a virtual reality device.

[0036] In this embodiment, the display device 111 is a device that directly displays visual stimulation information on a screen. For example, the display device 111 can be a liquid crystal display, an LED display, or a projector. In some embodiments, optionally, the visual stimulation device 110 includes at least one display screen. The display screen can be a flat display screen or a curved display screen. This embodiment is not limited to this. It can be used to visually stimulate small-sized target objects and can also save the cost of consciousness state detection. The visual stimulation device 110 can be an immovable device that does not change its position as the position of the target object changes, for example, a visual stimulation device 110 fixed by an immovable support frame; it can also be a movable device that is fixed in a relative position to the target object, for example, a visual stimulation device 110 fixed by a movable support frame (which can be raised and lowered and / or rotated). This embodiment is not limited to this. The movable visual stimulation device 110 can adjust the height and angle of the visual stimulation device 110 to achieve the best visual stimulation effect. For example, Figure 2 is a structural schematic diagram of a consciousness state detection system provided in Example 1 of the present application. As shown in Figure 2, the visual stimulation device 110 is fixed in position by a retractable bracket.

[0037] A virtual reality device is a device that projects visual stimulation information into the field of view of a target object and provides close-range visual stimulation. The virtual reality device includes, but is not limited to, virtual reality glasses 112 (shown with reference to FIG3 ). Virtual reality glasses 112 are glasses for presenting virtual reality visual stimulation information to the target object. During the state of consciousness detection process, virtual reality glasses 112 are fixed to the head of the target object. The virtual reality device can immerse the target object in a virtual visual stimulation environment and better receive the visual stimulation information displayed by the virtual reality glasses 112. When the visual stimulation device 110 includes a display device 111 and a virtual reality device, while the virtual reality device displays the visual stimulation information to the target object, the display device 111 can display the visual stimulation information to the user, so that the user can observe in real time the visual stimulation information received by the target object and the target object's feedback behavior on the visual stimulation information.

[0038] The visual stimulation information includes at least one of visual field shadow stimulation and visual threat stimulation. The visual field shadow stimulation is stimulation caused by a shadow appearing in the target object's visual field. The shadow can be generated by the target object or other objects blocking light. The brightness and shape of the shadow can be adjusted to provide different degrees of stimulation to the target object. In some embodiments, the visual stimulation device 110 is specifically configured to generate the visual field shadow stimulation by reducing or enlarging a shadow of a preset shape in the target display area, thereby providing visual stimulation to the target object based on the visual field shadow stimulation.

[0039] In this embodiment, the target display area is the area within the visual stimulation device 110 that displays visual stimulation information, and the preset shadow is a shadow with a preset shape and brightness. Visual stimulation information including visual field shadow stimulation is generated by regularly displaying enlarged or reduced preset shadows in the target display area based on a specific visual stimulation paradigm. The visual stimulation paradigm is a sequence of visual stimulation frames obtained by combining multiple visual stimulation frames. By displaying the visual field shadow stimulation to the target subject, the target subject is periodically visually stimulated.

[0040] Taking the above-mentioned visual field shadow (Looming) stimulation paradigm as an example, a complete Looming stimulation paradigm includes 15 sets of repeated visual stimulation frame sequences. The multiple visual stimulation frames of each set of visual stimulation frame sequences include a black disk. Within 5.5 seconds, the area of ​​the disk gradually expands, and the angle between the disk diameter and the target object's visual field increases from 2° to 40°. It is used to induce the target object's visual instinctive fear behavior, among which visual instinctive fear behavior is the target object's instinctive and rapid defensive response to the gradually approaching visual danger stimulus, including but not limited to freezing and running away.

[0041] Visual threat stimulation refers to the presence of threatening stimuli in the target subject's field of vision, which is used to induce anxiety or a sense of threat in the target subject. Threatening stimuli can include stimuli related to survival and safety, such as aggressive objects, steep cliffs, and fires. In some embodiments, visual stimulation device 110 is optionally configured to obtain visual threat data corresponding to the target subject and play the visual threat data, wherein the visual threat data includes at least a visual threat video or a visual threat image.

[0042] In the present embodiment, visual threat data are the data comprising threatening stimulus factors, wherein, threatening stimulus factors are corresponding to target object, and illustratively, threatening stimulus factors can be the natural enemy of target object. By real-time collection, or from the Internet or local calling, comprise video or image of threatening stimulus factors, obtain visual threat data, visual threat data can be processed, for example, video editing, image processing and format conversion etc., so that visual threat data can normally show in visual stimulation device 110. Visual threat data are transmitted or stored to visual stimulation device 110, so that visual stimulation device 110 obtains the visual threat data corresponding to target object, and visual threat data is played. Visual threat data can comprise visual threat video, and visual stimulation device 110 plays visual threat video with preset video playback mode, wherein, preset video playback mode includes but not limited to video multiple speed; Visual threat data can also comprise visual threat image, and visual stimulation device 110 plays visual threat image with preset image playback mode, wherein, preset image playback mode can be static display or dynamic display, and dynamic display comprises picture switching time interval.

[0043] In some embodiments, optionally, the consciousness state detection system 100 further includes: one or more of an olfactory stimulation device, an auditory stimulation device, and a tactile stimulation device, which is not limited in this embodiment.

[0044] The feedback behavior collection device 120 is connected to the consciousness state determination device 130 and is used to collect the target feedback behavior of the target object when the visual stimulation information is displayed, and send the target feedback behavior to the consciousness state determination device 130.

[0045] In this embodiment, the target feedback behavior is the behavior generated by the target subject when receiving visual stimulation information, such as body movements, facial movements, and eye movements. The feedback behavior collection device 120 is connected to the consciousness state determination device 130 via a data cable or Bluetooth. The feedback behavior collection device 120 is a device that collects the target feedback behavior of the target subject and transmits the collected target feedback behavior to the consciousness state determination device 130 via a data cable or Bluetooth to detect the target subject's consciousness state. Optionally, the feedback behavior collection device 120 includes a camera 121, and the target feedback behavior includes instinctive defensive behavior. The camera 121 is used to collect the target subject's instinctive defensive behavior when the visual stimulation information is displayed, where the instinctive defensive behavior includes avoiding stimulation and / or the facial state presenting a preset state.

[0046] In this embodiment, the camera device is used to capture the target subject's target feedback behavior. It is capable of recording the target subject's target feedback behavior in at least high-definition video when the visual stimulation device 110 displays visual stimulation information to the target subject. Target feedback behavior includes, but is not limited to, instinctive defensive behaviors, which are automatic and unconscious defensive behaviors performed by the target subject, including avoidance of stimuli, such as running away and eyelid closure, and also includes facial expressions exhibiting preset states, such as anger, fear, and anxiety. The feedback behavior collection device 120 includes at least one camera, each of which captures at least a portion of the target subject. The camera records the target subject's target feedback behavior in at least high-definition video, allowing analysis of the target subject's target feedback behavior to determine the target subject's state of consciousness. For example, the camera device is a high-definition camera with a frame rate of 30 frames per second and a resolution of 960×540, and is positioned 45 centimeters directly above the target subject.

[0047] In some embodiments, the camera device is optionally connected to a retractable and / or angle-adjustable support component. The support component is a component used to support the camera device. For example, the camera device can be supported by a non-retractable and / or non-angle-adjustable support component to ensure that the position of the camera device remains unchanged during the shooting process. Alternatively, the camera device can be supported by a retractable and / or angle-adjustable support component, and the user can use the support component to adjust the position of the camera device so that the camera device captures the target feedback behavior in the optimal position. Exemplarily, the support component can be a robotic arm with multiple degrees of freedom, and the camera device is connected to the end of the robotic arm; the support component can also include a slide rail and a retractable multi-angle rotating camera bracket, and the camera device is fixed to the camera bracket, and can be adjusted in position in the horizontal, vertical and / or rotational directions.

[0048] The eye movements of the target object can reflect the state of consciousness. Optionally, the feedback behavior collection device 120 includes an eye tracking device, and the target feedback behavior includes eye movement feedback information; the eye tracking device is arranged relative to the eyes of the target object, and is used to collect eye movement feedback information of the eyes, wherein the eye movement feedback information includes at least one of pupil size change information, pupil position change information and blinking information.

[0049] In this embodiment, eye movement feedback information refers to target feedback behavior of the target subject's eyes, including but not limited to pupil size change information, pupil position change information, and blink information. Pupil size change information can include pupil enlargement or reduction, or specific pupil size change; pupil position change information can include one or more of gaze point displacement, pupil displacement, and saccade distance; and blink information can include gaze duration and / or number of blinks. An eye tracking device is used to collect eye movement feedback information from the target subject, so as to determine the target subject's state of consciousness by analyzing the target subject's eye movement feedback information. The eye tracking device is positioned to directly collect the target subject's eye movement feedback information, ensuring the integrity of the collected eye movement feedback information while preventing the eye tracking device from blocking the target subject's reception of visual stimulation information. In some embodiments, the eye tracking device is optionally integrated into the visual stimulation device 110. For example, the visual stimulation device 110 including a display screen may have a built-in eye tracking device, or virtual reality glasses may have a built-in eye tracking device.

[0050] In some embodiments, the feedback behavior collection device 120 further includes a physiological indicator detection device, and the target feedback behavior includes physiological indicator feedback information. The physiological indicator detection device is a device for non-invasively detecting physiological indicators, such as a blood oximeter, a pulse detector, an electroencephalogram detector, and an electromyogram detector. The physiological indicator detection device can be a wearable physiological indicator detection device or a body-worn physiological indicator detection device, which is not limited in this embodiment. The physiological indicator feedback information is the physiological indicator information fed back by the target subject during the consciousness state detection process, such as pulse vasodilation, blood oxygen saturation, respiratory rate, and heart rate.

[0051] The consciousness state determining device 130 is used to receive the target feedback behavior sent by the feedback behavior collecting device 120, and determine the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior.

[0052] In this embodiment, the standard feedback behavior is the feedback behavior of the target object after receiving the visual stimulation information in the awake state. The consciousness state determination device 130 receives the target feedback behavior transmitted by the feedback behavior acquisition device 120 in real time, and stores and analyzes the target feedback behavior. By way of example, FIG3 is a structural diagram of a consciousness state detection system provided in Example 1 of the present application. As shown in FIG3 , the virtual reality glasses 112 are integrated with an eye tracking device, and the virtual reality glasses 112 are connected to the consciousness state determination device 130 via a data cable. The eye tracking device transmits the collected eye movement feedback information to the consciousness state determination device 130 via the data cable; the camera device 121 is connected to the consciousness state determination device 130 via a data cable, and the camera device 121 transmits the captured target feedback behavior of the target object to the consciousness state determination device 130 via the data cable.

[0053] The consciousness state determination device 130 also analyzes the target feedback behavior. Based on the behavior analysis model, the consciousness state determination device 130 compares the received target feedback behavior with the standard feedback behavior, and determines the consciousness state of the target object based on the behavior comparison result. Among them, the behavior analysis model is a model that analyzes the target feedback behavior. It can be a traditional image (or video) processing model or an image (or video) processing model based on deep learning. This embodiment does not limit this. The behavior analysis model takes the target feedback behavior as input and the consciousness state label of the target object as output. For example, the consciousness label of the awake state is 1, and the consciousness label of the non-awake state is 0.

[0054] When the target feedback behavior is the same as the standard feedback behavior, or the error is within the preset error range, it can be considered that the target object's response to the visual stimulation information is the same as that in the awake state, and the behavior analysis model outputs a consciousness label of the awake state, and the target object's state of consciousness can be determined to be the awake state; when the target feedback behavior is different from the standard feedback behavior, or the error is outside the preset error range, it can be considered that the target object's response to the visual stimulation information is different from that in the awake state, and the behavior analysis model outputs a consciousness label of the non-awake state, and the target object's state of consciousness can be determined to be the non-awake state.

[0055] Taking a small-volume target object as an example (for example, when the volume of the target object is smaller than a preset volume, the target object is considered to be a small-volume object), when the target feedback behavior of the target object includes instinctive defense behavior (for example, escape and freeze), and the parameters such as reaction latency, return time, return speed, and time after returning to the nest in the target feedback behavior are consistent with the parameters in the standard feedback behavior, the behavior analysis model in the consciousness state determination device 130 generates a consciousness label 1, indicating that the target object is in a wakeful state.

[0056] Taking a large-volume target object as an example (for example, when the volume of the target object is greater than or equal to the preset volume, the target object is considered to be a large-volume object), when the target feedback behavior of the target object includes instinctive defense behavior (for example, sudden dodging and facial expressions of fear), and the body movements and eye movement feedback information in the target feedback behavior are consistent with the body movements and eye movement feedback information in the standard feedback behavior, the behavior analysis model in the consciousness state determination device 130 generates a consciousness label 1, indicating that the target object is in a waking state.

[0057] The technical solution of the embodiment of the present application provides a consciousness state detection system 100, including: a visual stimulation device 110, a feedback behavior collection device 120 and a consciousness state determination device 130, wherein the visual stimulation device 110 is arranged in the visual field area of ​​the target object, and is used to display visual stimulation information to visually stimulate the target object based on the visual stimulation information, wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation; the feedback behavior collection device 120 is connected to the consciousness state determination device 130, and is used to collect target feedback behavior of the target object when the visual stimulation information is displayed, and send the target feedback behavior to the consciousness state determination device 130; the consciousness state determination device 130 is used to receive the target feedback behavior sent by the feedback behavior collection device 120, and determine the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior. The target feedback behavior can be collected simply, quickly and effectively, providing data support for the analysis of the consciousness state of the target object, solving the technical problems of cumbersome operation and poor accuracy of the consciousness state detection method, and achieving the effect of quickly, conveniently and accurately determining the consciousness state of the target object.

[0058] Example 2

[0059] FIG4 is a schematic diagram of the structure of a consciousness state detection system provided in Example 2 of the present application. As shown in FIG4, the technical solution of the embodiment of the present application is further optimized based on any of the above embodiments. For the specific implementation method, please refer to the description of this embodiment.

[0060] The consciousness state detection system 100 may specifically include: a visual stimulation device 110, a feedback behavior collection device 120, a consciousness state determination device 130 and a first space device 140;

[0061] The first space device 140 is used to provide a first activity space for the target object, and the first activity space corresponds to the stimulation space of the visual stimulation information. It should be understood that the stimulation space of the visual stimulation information can also indicate the target display area in the first embodiment.

[0062] In this embodiment, the first activity space is the interior of the first space device 140, which provides a location for the target subject to undergo state-of-consciousness testing. The volume of the first activity space is greater than the volume of the target subject. The stimulation space is the space within which the visual stimulation information displayed by the visual stimulation device 110 can be observed. The first space device 140 is located within the stimulation space to ensure that the target subject within the first space device 140 can receive the visual stimulation information. The first activity space is the interior of the stimulation space within which the visual stimulation information is displayed.

[0063] In some embodiments, optionally, the first space device 140 includes a restraint device, which is a device for restraining the position of a target object, such as a bed and a chair.

[0064] In some embodiments, the first spatial device 140 optionally includes a behavioral detection box 141 (see FIG5 ), which is made of a transparent material and has no hollow top surface. This technical solution is suitable for small-volume target objects and for visually stimulating the upper visual field of the target object.

[0065] In some embodiments, at least one side of the behavioral testing box may optionally include ventilation holes or ventilation gaps. For example, if the behavioral testing box is a cube or rectangular parallelepiped, ventilation holes or ventilation gaps may be provided on one or more sides of the behavioral testing box other than the bottom. This improves the behavioral testing box's ability to restrain the target subject while also meeting the target subject's breathing needs and ensuring their safety.

[0066] Among them, the behavioral detection box is used to isolate the target object from the external environment, prevent the target object from being affected by the external environment, and limit the target object's range of movement. The topless hollow structure of the behavioral detection box is used to ensure that the air inside the behavioral detection box is connected to the air in the external environment, ensuring the basic physiological needs of the target object. The behavioral detection box is made of transparent material to facilitate the behavior collection device to collect behavioral information of the target object. Among them, the transparent material can be colorless glass, colorless acrylic and other materials. The bottom of the behavioral detection box can be a frosted material to increase the friction of the behavioral detection box and facilitate the movement of the target object. The behavioral detection box may include a restraint device for restraining the target object in the behavioral detection box.

[0067] For example, Figure 5 is a schematic diagram of the structure of a consciousness state detection system provided in Example 2 of the present application. As shown in Figure 5, a visual stimulation device 110 is disposed on the side of a behavioral detection box 141. The visual stimulation device 110 has an eye tracking device built into it. The eye tracking device transmits the collected eye movement feedback information to the consciousness state determination device 130 via a data cable. The camera 120 is connected to the consciousness state determination device 130 via a data cable, and is used to transmit the target feedback behavior collected by the camera 120 to the consciousness state determination device 130 via the data cable.

[0068] In some embodiments, optionally, the eye tracking device is independent of the visual stimulation device 110, and the eye tracking device is provided on the behavioral detection box 141. For example, FIG6 is a structural diagram of a consciousness state detection system provided in Example 2 of the present application. As shown in FIG6 , the behavioral detection box 141 is equipped with an eye tracking device (not shown in FIG6 ), and the behavioral detection box is connected to the consciousness state determination device 130 via a data cable, and is used to transmit the eye information collected by the eye tracking device to the consciousness state determination device 130 via the data cable; the visual stimulation device 110 is connected to the consciousness state determination device 130 via a data cable, and is used to transmit the visual stimulation information displayed by the visual stimulation device 110 to the consciousness state determination device 130.

[0069] In some embodiments, optionally, the visual stimulation device 110 includes an independently arranged display device 111 and a control device 112 ; the display device 111 is arranged on the top or side of the behavioral detection box 141 .

[0070] Among them, the display device 111 is a component in the visual stimulation device 110 for displaying visual stimulation information, and the control device 112 is a component for automatically controlling and / or manually controlling the visual stimulation information displayed by the display device 111. The display device 111 is connected to the control device 112 via a data cable, and the control device 112 transmits the visual stimulation information to be displayed to the display device 111 via the data cable. Based on the independently arranged display device 111 and control device 112, the visual stimulation information displayed by the visual stimulation device 110 can be controlled, thereby improving the interactivity of the information acquisition system. For example, Figure 7 is a structural diagram of a consciousness state detection system provided in Example 2 of the present application. As shown in Figure 7, the display device 111 is a display screen arranged on the top of the behavioral detection box 141, and the control device 112 is a laptop computer connected to the display device 111 via a data cable.

[0071] In order to facilitate the observation of the target object's instinctive defensive behavior of escaping or dodging, the consciousness state detection system 100 optionally further includes: a second space device 150 connected to the first space device 140; wherein the second space device 150 is configured to be away from the stimulation space or located in the stimulation space, and is used to block the visual stimulation information of the visual stimulation device 110, thereby providing a second activity space for the target object.

[0072] In this embodiment, the second activity space is the interior space of the second space device 150, which is used as a hiding place for the target object, and the capacity of the second activity space is greater than the volume of the target object. When the target object is located in the second space device 150, it cannot receive the visual stimulation information transmitted by the visual stimulation device 110. The second space device 150 can be located within the stimulation space or outside the stimulation space, and this embodiment does not limit this. If the second space device 150 is located outside the first space device 140, the second space device 150 is outside the stimulation space of the visual stimulation device 110, and the visual stimulation information cannot be transmitted to the second space device 150. The material of the second space device 150 can be the same as or different from that of the first space device 140. If the second space device 150 is located inside the first space device 140, the material of the second space device 150 is different from that of the first space device 140, and is an opaque material. This can block the visual stimulation information from the visual stimulation device 110, preventing the visual stimulation information from being transmitted to the second space device 150, allowing the target object to quickly escape the visual stimulation. For example, FIG8 is a schematic diagram of the structure of a consciousness state detection system provided in Example 2 of the present application. As shown in FIG8 , the second space device 150 is located inside the first space device 140 .

[0073] In some embodiments, optionally, as shown in Figure 8, an infrared touch panel 160 is provided at the bottom of the first space device 140, and the infrared touch panel 160 is connected to the control device 112 of the visual stimulation device 110, wherein the infrared touch panel is used to collect the position information of the target object; the visual stimulation device 110 is used to display the visual stimulation information when it is detected that the position information meets the preset conditions.

[0074] In this embodiment, the infrared touch panel includes an infrared emitting element and a receiving sensing element. The receiving sensing element continuously scans to see if any infrared rays are blocked by the target object to detect the touch of the target object, thereby collecting the target object's position information. The position information is the target object's position information within the first spatial device 140. The infrared touch panel is connected to the control device 112 of the visual stimulation device 110 via a data cable. The infrared touch panel transmits the position information to the control device 112 of the visual stimulation device 110 via the data cable in real time. The control device 112 of the visual stimulation device 110 receives the position information transmitted by the infrared touch panel 160 and compares the position information with preset conditions. The preset conditions can be preset position coordinates, a preset position range, or the position information is not null, which is not limited in this embodiment. The preset position coordinates are the preset position information of the target object within the first spatial device 140; the preset position range is the preset position range of the target object within the first spatial device 140.

[0075] In some embodiments, optionally, the control device 112 of the visual stimulation apparatus 110 controls the display device 111 of the visual stimulation apparatus 110 to display the visual stimulation information when detecting that the position information is not empty, or that the position information is the same as the preset position coordinates, or that the received position information is within a preset position range. When the control device 112 of the visual stimulation apparatus 110 detects that the position information is empty, or that the position information is not the same as the preset position coordinates, or that the received position information is outside the preset position range, it controls the display device 111 of the visual stimulation apparatus 110 not to display the visual stimulation information, thereby reducing the acquisition cost of the information acquisition system.

[0076] In some embodiments, optionally, the visual stimulation device 110 may store stimulation display position information of the visual stimulation device 110 (including positions in the horizontal, vertical and / or rotational directions), and the position information of the visual stimulation device 110 corresponds to a preset position coordinate or a preset position range. The visual stimulation device 110 compares the received position information with the preset position coordinate or the preset position range. When the received position information is the same as the preset position coordinate, or the received position information is within the preset position range, the stimulation display position information corresponding to the preset position coordinate or the preset position range is called, and the position of the visual stimulation device 110 is automatically adjusted based on the stimulation display position information.

[0077] For example, Figure 9 is a schematic diagram of the structure of a consciousness state detection system provided in Example 2 of this application. As shown in Figure 9, an infrared touch panel 160 is disposed at the bottom of the behavioral detection box 141 and is connected to the control device 112 via a data cable, for transmitting the collected position information of the target object to the control device 112.

[0078] In some embodiments, optionally, the consciousness state detection system 100 further includes: a state warning device; wherein the consciousness state determination device 130 is also used to generate a warning control signal when it is detected that the consciousness state of the target object is a wakeful state; the state warning device is used to receive the warning control signal sent by the consciousness state determination device 130, and generate state warning information based on the warning control signal, and display the state warning information.

[0079] In this embodiment, the warning control signal is a signal for instructing the status warning device to generate status warning information. Exemplarily, the warning control signal can be a high-level signal. The status warning device is a device that warns the user when the target object is awake, so as to remind the user that the target object is in a waking state. The status warning device can be one or more of a sound alarm, an indicator light, and a display screen. The status warning device and the consciousness state determination device 130 can be connected via a data cable. When the status warning device receives the warning control signal transmitted by the consciousness state determination device 130, it triggers the status warning operation and generates status warning information, wherein the status warning information is information that indicates that the target object is in a waking state, and the status warning information can be displayed by electronic devices such as sound alarms, indicator lights, and display screens. The status warning device can prompt the target object's awake state in a timely manner to improve the efficiency of consciousness state detection.

[0080] The technical solution of the embodiment of the present application provides a consciousness state detection system 100, including: a visual stimulation device 110, a feedback behavior collection device 120, a consciousness state determination device 130 and a first space device 140. By accommodating the target object through the first space device 140, the activity range of the target object can be limited to the first activity space, and the first activity space is opposite to the stimulation space of the visual stimulation information. The target object at any position in the first space device 140 can be visually stimulated to facilitate the collection and storage of the target feedback behavior of the target object, which solves the technical problems such as high requirements for related equipment and complex and time-consuming operation. It can simply, quickly and effectively collect consciousness-related data, provide data support for the analysis of the consciousness state of the target object, so as to accurately determine the consciousness state of the target object.

[0081] Example 3

[0082] Figure 10 is a flow chart of a method for detecting a state of consciousness, as provided in Example 3 of this application. This method can be applied to a system for detecting a state of consciousness, which includes a visual stimulation device, a feedback behavior collection device, and a state of consciousness determination device, with the feedback behavior collection device connected to the state of consciousness determination device. Technical features identical or similar to those in the previous embodiments are not further described here.

[0083] As shown in FIG10 , the consciousness state detection method of this embodiment may specifically include:

[0084] S310, displaying visual stimulation information through a visual stimulation device disposed in a visual field of the target object, so as to provide visual stimulation to the target object based on the visual stimulation information;

[0085] The visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation.

[0086] S320. Using the feedback behavior collection device, while displaying visual stimulation information, collect the target feedback behavior of the target object, and send the target feedback behavior to the consciousness state determination device.

[0087] S330: Receive the target feedback behavior sent by the feedback behavior collection device through the consciousness state determination device, and determine the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior.

[0088] Based on the above embodiment, optionally, the visual stimulation device includes a display device 111 and / or a virtual reality device.

[0089] On the basis of the above embodiment, optionally, visual stimulation information is displayed by a visual stimulation device arranged in the field of view of the target object, so as to visually stimulate the target object based on the visual stimulation information, including: using the visual stimulation device to reduce or enlarge the shadow of a preset shape in the target display area to generate field of view shadow stimulation, so as to visually stimulate the target object based on the field of view shadow stimulation; or, obtaining visual threat data corresponding to the target object and playing the visual threat data, wherein the visual threat data at least includes a visual threat video or a visual threat image.

[0090] Based on the above embodiment, optionally, the feedback behavior collection device includes a camera device, and the target feedback behavior includes instinctive defensive behavior. Accordingly, the feedback behavior collection device collects the target feedback behavior of the target subject while displaying visual stimulation information, including: collecting the target subject's instinctive defensive behavior through the camera device while displaying visual stimulation information, wherein the instinctive defensive behavior includes avoiding stimulation and / or presenting a preset facial state.

[0091] Based on the above embodiment, optionally, the feedback behavior collection device includes an eye tracking device, and the target feedback behavior includes eye movement feedback information. Accordingly, the feedback behavior collection device collects the target feedback behavior of the target subject while displaying visual stimulation information, including: collecting eye movement feedback information from the target subject using an eye tracking device positioned relative to the target subject's eyes, wherein the eye movement feedback information includes at least one of pupil size change information, pupil position change information, and blink information.

[0092] Based on the above embodiment, the consciousness state detection system may optionally further include: a first space device. Accordingly, the consciousness state detection method may further include: providing a first activity space for the target object through the first space device, where the first activity space corresponds to the stimulation action space of the visual stimulation information.

[0093] Based on the above embodiment, optionally, the consciousness state detection method also includes: providing a second activity space for the target object through a second space device connected to the first space device; the second space device is away from the stimulation space, or is used to block the visual stimulation information of the visual stimulation device.

[0094] Based on the above embodiment, optionally, an infrared touch panel is provided at the bottom of the first space device, and the infrared touch panel is connected to the visual stimulation device. Accordingly, the consciousness state detection method may further include: collecting location information of the target object via the infrared touch panel; and displaying visual stimulation information via the visual stimulation device when the location information is detected to meet preset conditions.

[0095] Based on the above embodiment, the consciousness state detection system may optionally further include a state warning device. Accordingly, the consciousness state detection method may further include: generating a warning control signal by the consciousness state determination device upon detecting that the target subject is awake; receiving the warning control signal from the consciousness state determination device by the state warning device, generating state warning information based on the warning control signal, and displaying the state warning information.

[0096] The technical solution of the embodiment of the present application is to display visual stimulation information through a visual stimulation device arranged in the visual field area of ​​the target object, so as to visually stimulate the target object based on the visual stimulation information; wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation; through the feedback behavior acquisition device, when the visual stimulation information is displayed, the target feedback behavior of the target object is acquired, and the target feedback behavior is sent to the consciousness state determination device; through the consciousness state determination device, the target feedback behavior sent by the feedback behavior acquisition device is received, and the consciousness state of the target object is determined based on the target feedback behavior and the standard feedback behavior. The target feedback behavior can be acquired simply, quickly and effectively, and data support can be provided for the analysis of the consciousness state of the target object, thereby solving the technical problems of cumbersome operation and poor accuracy of the consciousness state detection method, and achieving the effect of quickly, conveniently and accurately determining the consciousness state of the target object.

[0097] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this application can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of this application can be achieved. This is not limited herein.

[0098] The above specific embodiments do not constitute a limitation on the scope of protection of this application. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application shall be included within the scope of protection of this application.

Claims

1. A consciousness state detection system, comprising: Visual stimulation device, feedback behavior acquisition device, and consciousness state determination device; wherein, The visual stimulation device is arranged within the visual field area of the target object and is used to display visual stimulation information to perform visual stimulation on the target object based on the visual stimulation information. Among them, the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation; The feedback behavior acquisition device is connected to the consciousness state determination device and is used to collect the target feedback behavior of the target object when the visual stimulation information is displayed and send the target feedback behavior to the consciousness state determination device; and The consciousness state determination device is used to receive the target feedback behavior sent by the feedback behavior acquisition device and determine the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior.

2. The consciousness state detection system according to claim 1, wherein, The visual stimulation device includes a display device and / or a virtual reality device.

3. The consciousness state detection system according to claim 1, wherein, The visual stimulation device is specifically used to generate visual field shadow stimulation by reducing or enlarging the display of a shadow with a preset shape in the target display area to perform visual stimulation on the target object based on the visual field shadow stimulation; or, it is used to obtain visual threat data corresponding to the target object and play the visual threat data, where the visual threat data includes at least a visual threat video or a visual threat image.

4. The consciousness state detection system according to claim 1, wherein, The feedback behavior acquisition device includes a camera device, and the target feedback behavior includes an instinctive defense behavior; The camera device is used to collect the instinctive defense behavior of the target object when the visual stimulation information is displayed, where the instinctive defense behavior includes a behavior of avoiding stimulation and / or a facial state presenting a preset state.

5. The consciousness state detection system according to claim 1, wherein, The feedback behavior acquisition device includes an eye tracking device, and the target feedback behavior includes eye movement feedback information; The eye tracking device is arranged opposite to the eyes of the target object and is used to collect the eye movement feedback information of the eyes, where the eye movement feedback information includes at least one of pupil size change information, pupil position change information, and blinking information.

6. The consciousness state detection system according to claim 1, further comprising: First space device; wherein, The first space device is used to provide a first activity space for the target object, and the first activity space corresponds to the stimulation space of the visual stimulation information.

7. The consciousness state detection system according to claim 6, further comprising: A second space device communicated with the first space device; wherein, The second space device is away from the stimulation space or located within the stimulation space and is used to block the visual stimulation information of the visual stimulation device to provide a second activity space for the target object.

8. The consciousness state detection system according to claim 6, wherein, An infrared touch panel is arranged at the bottom of the first space device, and the infrared touch panel is connected to the visual stimulation device, where, The infrared touch panel is used to collect the position information of the target object; and The visual stimulation device is specifically used to display the visual stimulation information when it detects that the position information meets a preset condition.

9. The consciousness state detection system according to claim 1, further comprising: State warning device; wherein, The consciousness state determination device is further used to generate a warning control signal when it detects that the consciousness state of the target object is a waking state; and The state warning device is configured to receive the warning control signal sent by the consciousness state determination device, generate state warning information based on the warning control signal, and display the state warning information.

10. A consciousness state detection method, which is applied to a consciousness state detection system, the consciousness state detection system includes a visual stimulation device, a feedback behavior acquisition device and a consciousness state determination device, the feedback behavior acquisition device is connected to the consciousness state determination device; wherein, The consciousness state detection method includes: Displaying visual stimulation information through the visual stimulation device disposed in the visual field area of the target object to perform visual stimulation on the target object based on the visual stimulation information, wherein the visual stimulation information includes visual field shadow stimulation and / or visual threat stimulation; Collecting, by the feedback behavior collection device, the target feedback behavior of the target object when the visual stimulation information is displayed, and sending the target feedback behavior to the consciousness state determination device; and Receiving, by the consciousness state determination device, the target feedback behavior sent by the feedback behavior collection device, and determining the consciousness state of the target object based on the target feedback behavior and the standard feedback behavior.

Images