Method, system and equipment for monitoring and evaluating psychological state and medium
By wearing AI glasses in the target object's life scenes, and using these data to evaluate the psychological state, the problem of inaccurate evaluation in fixed scenarios is solved, and the accuracy and effectiveness of the evaluation are improved.
Patent Information
- Application Number
- CN202411108446.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-13
- Publication Date
- 2024-12-03
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The existing psychological state evaluation methods cannot accurately judge the target's actual living psychological state in a fixed scenario, and traditional eye movement collection methods are difficult to collect effective data, which affects the accuracy of the evaluation.
Eye movement data, physiological data and vision scene data are obtained through the AI glasses worn by the target object, and combined with these data to evaluate the psychological state in real time. The shape of AI glasses is the same as that of conventional glasses, reducing psychological stress and interference and ensuring the authenticity of the data.
It improves the accuracy and effectiveness of psychological state monitoring and evaluation, ensures the authenticity and effectiveness of data, is applicable to the daily life scenarios of the target object, and reduces the impact of scene changes on the evaluation results.
Smart Images

Figure CN119055237A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, specifically to the field of smart medical technology, and in particular to a method, system, device and medium for monitoring and evaluating a psychological state. Background Art
[0002] Eye movement information is of great significance for judging the development of psychological state. However, in the existing psychological state assessment process, the eye movement information of the target object in a fixed scene is usually used for analysis.
[0003] The use of fixed scenes brings many disadvantages to the psychological state assessment. For example, 1. Fixed scenes cannot simulate the actual life scenes of each target object, which does not match the actual living environment and cannot correctly judge the psychological state; 2. When using traditional eye movement collection methods, the target object will try to suppress his or her psychological state when tested in a fixed scene in a fixed place, making it difficult to collect effective data; 3. When using VR and other eye movement collection methods, because the scene seen by the target object is fixed, it is difficult to judge the psychological state of the target object in the normal state after collecting the data. Therefore, the use of fixed scenes affects the effectiveness of the collected eye movement data, and thus affects the accuracy of psychological state assessment. Summary of the invention
[0004] Aiming at the technical problem of low accuracy of psychological state assessment in the prior art, a method, system, device and medium for monitoring and assessing psychological state are provided.
[0005] According to a first aspect, a method for monitoring and evaluating a psychological state is provided, comprising:
[0006] In a target object's life scene, the target object's eye movement data, physiological data, and visual field scene data are obtained through the AI glasses worn by the target object, wherein the form of the AI glasses is the same as that of conventional glasses;
[0007] Determining a fixation target situation within the field of view of the target object according to the field of view scene data;
[0008] Determining a gaze condition of the target object according to the gaze target condition and the eye movement data;
[0009] The fluctuation of the psychological state of the target object is evaluated in real time according to the gaze situation and the physiological data.
[0010] According to a second aspect, a system for monitoring and evaluating a psychological state is provided, comprising:
[0011] AI glasses, used to obtain eye movement data, physiological data and visual field scene data of a target object when the target object wears the AI glasses in a life scene of the target object, wherein the form of the AI glasses is the same as that of conventional glasses;
[0012] A scene analysis device, used to determine the fixation target situation within the field of view of the target object according to the field of view scene data;
[0013] A gaze situation analysis device, used for determining the gaze situation of the target object according to the gaze target situation and the eye movement data;
[0014] The psychological state evaluation device is used to evaluate the fluctuation of the psychological state of the target object in real time according to the gaze situation and the physiological data.
[0015] According to the third aspect, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a method as in any embodiment of a method for monitoring and evaluating a psychological state.
[0016] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, a method as in any embodiment of the method for monitoring and evaluating a psychological state is implemented.
[0017] According to the scheme of the present application, it is proposed to obtain the target object's eye movement data, physiological data and visual field scene data through the AI glasses worn by the target object in the target object's life scenes. Since the life scenes are the actual and daily life scenes of the respective target objects, relatively fixed places and fixed scenes, the life scenes will not bring interference factors such as inhibition to the target object's psychological state due to changes in the scenes or the scenes themselves. At the same time, by acquiring data through AI glasses with the same shape as conventional glasses, wearing AI glasses will not bring psychological pressure or psychological interference to the target object, so that the collected data is the target object's true reaction to the gaze target seen in the scene, ensuring the authenticity and effectiveness of the collected data, and then monitoring and evaluating the psychological state based on the collected data, which is conducive to improving the authenticity, effectiveness and accuracy of the monitoring and evaluation results. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:
[0019] Figure 1 is an exemplary system architecture diagram to which some embodiments of the present application may be applied;
[0020] Figure 2 is a flow chart of an embodiment of a method for monitoring and evaluating a psychological state according to the present application;
[0021] Figure 3 is a schematic diagram of an application scenario of the method for monitoring and evaluating the psychological state according to the present application;
[0022] Figure 4 is a structural schematic diagram of an embodiment of a system for monitoring and evaluating a psychological state according to the present application;
[0023] Figure 5 It is a block diagram of an electronic device used to implement the method for monitoring and evaluating the psychological state of an embodiment of the present application. DETAILED DESCRIPTION
[0024] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0025] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0026] Figure 1 An exemplary system architecture 100 is shown to which an embodiment of a method for monitoring and evaluating a psychological state or a system for monitoring and evaluating a psychological state of the present application can be applied.
[0027] like Figure 1 As shown, the system architecture 100 may include AI glasses 101, a network 102, and a computing device 103. The network 102 is used to provide a medium for a communication link between the AI glasses 101 and the computing device 103. The network 102 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
[0028] The user can use the AI glasses 101 to interact with the computing device 103 via the network 102 to receive or send messages, etc.
[0029] The computing device 103 here can be hardware or software. When the computing device 103 is hardware, it can be a computer and server with computing functions, etc. When the computing device 103 is software, it can be installed in a computer and a server. It can be implemented as multiple software or software modules (for example, multiple software or software modules for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.
[0030] The computing device 103 may be a computing device that provides various computing services, such as a background server that provides support for the AI glasses 101. The background server may analyze and process the received eye movement data, physiological data, and visual field scene data, and feed back the processing results (such as fluctuations in psychological state) to the AI glasses 101.
[0031] It should be noted that the psychological state monitoring and evaluation method provided in the embodiment of the present application can be executed by the AI glasses 101 or the computing device 103.
[0032] It should be understood that Figure 1 The number of computing devices in the embodiment is only illustrative. Any number of computing devices may be provided according to implementation requirements.
[0033] Continue to refer Figure 2 , shows a process 200 of an embodiment of a method for monitoring and evaluating a psychological state according to the present application. The method for monitoring and evaluating a psychological state comprises the following steps:
[0034] Step 201, in the target object's life scene, obtain the target object's eye movement data, physiological data and visual field scene data through the AI glasses worn by the target object, wherein the shape of the AI glasses is the same as that of conventional glasses.
[0035] Step 202: Determine the fixation target situation within the field of view of the target object according to the field of view scene data.
[0036] Step 203: determining the gaze condition of the target object according to the gaze target condition and the eye movement data.
[0037] Step 204: evaluating the fluctuation of the psychological state of the target object in real time according to the gaze situation and the physiological data.
[0038] In this embodiment, the shape of the AI glasses is the same as that of conventional glasses, so as to collect information without feeling around the clock. That is, the appearance of the AI glasses is the same as that of conventional glasses, for example, the shape of the glasses frame, the shape of the lenses, the color of the lenses, etc. are the same as those of conventional glasses.
[0039] In this embodiment, in order to collect the above-mentioned eye movement data, physiological data and visual field scene data in real time and accurately, the above-mentioned AI glasses can be embedded or integrated with an eye tracker, a sensor, an image acquisition device, etc.
[0040] In this embodiment, the eye movement data may include data such as eye movement speed, gaze time, gaze offset, pupil changes, blinking frequency, etc.
[0041] In this embodiment, the above physiological data may include psychological, blood pressure and other data.
[0042] In this embodiment, in order to accurately determine the gaze situation of the target object and further determine the psychological state of the target object, it is proposed to determine the gaze target situation in the field of view of the target object according to the field of view scene data, including:
[0043] A gaze target existing in the field of view of the target object and environmental features of the gaze target are determined according to the field of view scene data.
[0044] For example, the field of view scene data may be data in the form of video, picture, etc., and a gaze target may be determined in the field of view scene data. The gaze target may be a person or an object, and then environmental characteristics of the gaze target may be determined, such as the position of the gaze target in the scene.
[0045] In this embodiment, after determining the gaze target situation, in order to determine the effective and accurate gaze situation, it is proposed to combine the gaze target situation and the eye movement data to determine the gaze situation, for example, the gaze target situation and the eye movement data are matched to determine the current gaze target of the target object; according to the change of the current gaze target, it is determined whether the target object has an abnormal gaze situation. For example, the gaze position of the target object in the scene is determined according to the eye movement data, and then the gaze position is matched with the position information in the gaze target situation to determine the current gaze target of the target object, that is, the gaze target that the target object is currently gazing at, and then it is determined whether the target object has an abnormal gaze situation according to whether the current gaze target changes, the change of the gaze data, etc.
[0046] In this embodiment, the abnormal gaze situation may include any one or any combination of the following: the duration of gaze at the same gaze target is greater than a first preset duration; jitter occurs when gaze at the gaze target; and gaze at the same gaze target multiple times within a second preset duration.
[0047] In this embodiment, in order to further improve the accuracy of psychological state assessment, it is proposed to combine gaze conditions and physiological data to assess the fluctuation of the psychological state of the target object in real time, for example,
[0048] If the target object has an abnormal gaze, it is determined whether the physiological data has a sudden change; if so, it is determined that the target object has a sudden change in psychological state.
[0049] In this embodiment, whether a physiological data mutation occurs can be determined based on whether the blood pressure increases by a preset value. In order to more efficiently and effectively determine the psychological mutation, it is also proposed to determine whether the physiological data has a mutation, including:
[0050] Determine whether the heart rate in the physiological data suddenly increases by a preset value, and if so, determine that the physiological data has a sudden change. For example, whether the heart rate increases by a preset value at the current moment, or whether the heart rate increases by a preset value within a preset time, and if so, it can be determined that a sudden change in the physiological data related to the psychological state has occurred.
[0051] In this embodiment, in order to effectively maintain and calm the psychological state or mood of the target object while effectively monitoring and evaluating the psychological state, it is proposed that if the target object has multiple sudden changes in psychological state within the third preset time period, the AI glasses will output a reminder message, and the reminder message is used to prompt the target object to calm down and alleviate the psychological state. Alternatively, the reminder message can also prompt the target object to seek medical treatment in time.
[0052] In this embodiment, eye movement data, physiological data, visual field scene data, and fluctuations in psychological state data can also be sent to hospitals and monitoring structure terminals to provide data basis for the target object's psychological assessment, testing, diagnosis and other needs.
[0053] In this embodiment, the above-mentioned psychological state monitoring and evaluation method can be applied to individual daily psychological monitoring, psychological evaluation, psychological testing and other application scenarios, and can also be used in testing institutions, medical institutions, etc. for psychological monitoring, psychological evaluation, psychological testing and other application scenarios. The above-mentioned target object can be any person who needs to be monitored and evaluated for psychological state, for example, the elderly who need daily, home psychological monitoring, people who need psychological quality testing, etc.
[0054] The following is an introduction to the monitoring and evaluation method of the above-mentioned psychological state with specific examples, including the following steps:
[0055] Step 1: The target object needs to wear AI glasses. AI glasses are connected to the computer via a wireless network.
[0056] Step 2: After the target object wears the AI glasses, the information collection system collects the target object's eye movement data, heart rate data (i.e. the above physiological data), and scene pictures (i.e. the above visual field scene data). These parameters are transmitted to the computer in real time.
[0057] Step 3:
[0058] 1. After receiving the data uploaded by the information collection system, the computer sends the scene image to the scene analysis system. The scene analysis system analyzes the gaze target information (people and objects) in the scene and their position, as well as the current scene brightness based on the scene image.
[0059] 2. After the scene analysis system analyzes the scene, it transmits the analyzed gaze target information, its position, scene brightness and other data back to the computer.
[0060] 3. After receiving the scene information analyzed by the scene analysis system, the computer sends the eye movement data, heart rate data, gaze target information (people and objects) and their positions, and scene brightness uploaded by the information acquisition system to the psychological monitoring system.
[0061] 4. After receiving the eye movement data, heart rate data, gaze target information (people and objects) and their positions, and scene brightness, the psychological monitoring system matches the eye movement data with the gaze target information (people and objects) and their positions to determine the current gaze position of the target object. If the current target object is judged to be in the following situations:
[0062] Staring at a person or object for too long (e.g., the duration is longer than the first preset duration);
[0063] The eye's focus moves around a person or object;
[0064] and looking at the same person or object multiple times in a short period of time.
[0065] Then it starts to judge whether the heart rate of the heart rate data suddenly increases. If it increases, it is judged as a sudden psychological change of the target object. And the eye movement data, heart rate data, scene picture, gaze target information (people and objects) and their position, and scene brightness of the current target object are recorded.
[0066] 5. When the psychological monitoring system frequently detects sudden psychological changes of the target object in a short period of time, it will send a reminder instruction to the computer. After receiving the reminder instruction, the computer will send this instruction to the information collection system. At the same time, the psychological monitoring system will send the target object's eye movement data, heart rate data, scene pictures, gaze target information (people and objects) and their position, and scene brightness to the computer, and let the computer forward it to the doctor's machine.
[0067] Step 4: When the information collection system receives the reminder command, it will issue an alarm, prompting the target person to calm down and seek medical treatment in time.
[0068] Step 5: When the target subject seeks medical treatment, the doctor may use the target subject's eye movement data, heart rate data, scene images, gaze target information (people and objects) and their positions, scene brightness and other data as auxiliary data to conduct a condition analysis of the mental illness and medical condition.
[0069] Continue to see Figure 3 , Figure 3 FIG. 1 is a schematic diagram of an application scenario of the method for monitoring and evaluating the psychological state according to this embodiment. Figure 3 In the application scenario, the execution subject 301 obtains the target object's eye movement data 302, physiological data 303 and visual field scene data 304 through the AI glasses worn by the target object in the target object's life scene, wherein the shape of the AI glasses is the same as that of conventional glasses. The execution subject 301 determines the target gaze situation in the field of vision of the target object based on the visual field scene data. The execution subject 301 determines the target object's gaze situation based on the gaze target situation and the eye movement data. The execution subject 301 evaluates the fluctuation of the target object's psychological state 305 in real time based on the gaze situation and the physiological data.
[0070] Further references Figure 4 As an implementation of the methods shown in the above figures, the present application provides an embodiment of a monitoring and evaluation system for a psychological state, and the system embodiment is similar to Figure 2 Corresponding to the method embodiment shown, in addition to the features described below, the system embodiment may also include Figure 2 The method embodiments shown have the same or corresponding features or effects.
[0071] like Figure 4 As shown, the psychological state monitoring and evaluation system 400 of this embodiment includes: AI glasses 401, scene analysis device 402, gaze situation analysis device 403 and psychological state evaluation device 404. Among them, AI glasses 401 are configured to obtain eye movement data, physiological data and visual field scene data of the target object when the target object wears the AI glasses in the target object's life scene, wherein the form of the AI glasses is the same as that of conventional glasses; the scene analysis device 402 is configured to determine the gaze target situation in the visual field of the target object according to the visual field scene data; the gaze situation analysis device 403 is configured to determine the gaze situation of the target object according to the gaze target situation and the eye movement data; the psychological state evaluation device 404 is configured to evaluate the fluctuation of the psychological state of the target object in real time according to the gaze situation and the physiological data.
[0072] In this embodiment, the specific processing of the AI glasses 401, the scene analysis device 402, the gaze analysis device 403 and the psychological state evaluation device 404 of the psychological state monitoring and evaluation system 400 and the technical effects thereof can be referred to respectively. Figure 2The relevant descriptions of step 201, step 202, step 203 and step 204 in the corresponding embodiment are not repeated here. The scene analysis device 402, the gaze analysis device 403 and the psychological state assessment device 404 can be independent computing devices or units, or different devices or units integrated in the same computer.
[0073] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.
[0074] like Figure 5 , is a block diagram of an electronic device according to a monitoring and evaluation method of a psychological state according to an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples, and are not intended to limit the implementation of the present application described and / or required herein.
[0075] like Figure 5 As shown, the electronic device includes: one or more processors 501, a memory 502, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 5 A processor 501 is taken as an example.
[0076] The memory 502 is a non-transitory computer-readable storage medium provided in the present application. The memory stores instructions executable by at least one processor to enable at least one processor to perform the monitoring and evaluation method for the psychological state provided in the present application. The non-transitory computer-readable storage medium of the present application stores computer instructions, which are used to enable a computer to perform the monitoring and evaluation method for the psychological state provided in the present application.
[0077] The memory 502 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the method for monitoring and evaluating the psychological state in the embodiment of the present application (for example, the attached Figure 4 The processor 501 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 502, that is, the monitoring and evaluation method of the psychological state in the above method embodiment is realized.
[0078] The memory 502 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device of the method for monitoring and evaluating the psychological state, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 502 may optionally include a memory remotely arranged relative to the processor 501, and these remote memories may be connected to the electronic device of the method for monitoring and evaluating the psychological state via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0079] The electronic device of the method for monitoring and evaluating psychological state may further include: an input device 503 and an output device 504. The processor 501, the memory 502, the input device 503 and the output device 504 may be connected via a bus or other means. Figure 5 The example of connecting through bus is taken in the following.
[0080] The input device 503 can receive input digital or character information, and generate key signal input related to user settings and function control of the processing electronic device of the monitoring and evaluation method of the psychological state, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator rod, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 604 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.
[0081] Various implementations of the systems and techniques described herein can be realized in digital electronic circuit systems, integrated circuit systems, dedicated ASICs (application specific integrated circuits), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0082] These computer programs (also referred to as programs, software, software applications, or code) include machine instructions for programmable processors and can be implemented using high-level procedural and / or object-oriented programming languages, and / or assembly / machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, device, and / or means (e.g., disk, optical disk, memory, programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal for providing machine instructions and / or data to a programmable processor.
[0083] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0084] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0085] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.
[0086] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0087] As another aspect, the present application also provides a computer-readable medium, which may be included in the system described in the above embodiment; or it may exist independently and not be assembled into the system. The above computer-readable medium carries one or more programs. When the above one or more programs are executed by the system, the system: in the target object's life scene, through the AI glasses worn by the target object, obtain the target object's eye movement data, physiological data and visual field scene data, wherein the form of the AI glasses is the same as that of conventional glasses; according to the visual field scene data, determine the gaze target situation in the target object's visual field; according to the gaze target situation and the eye movement data, determine the gaze situation of the target object; according to the gaze situation and the physiological data, evaluate the fluctuation of the target object's psychological state in real time.
[0088] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other to form a technical solution.
Claims
1. A method for monitoring and evaluating a psychological state, the method comprising: In a target object's life scene, the target object's eye movement data, physiological data, and visual field scene data are obtained through the AI glasses worn by the target object, wherein the form of the AI glasses is the same as that of conventional glasses; Determining a fixation target situation within the field of view of the target object according to the field of view scene data; Determining a gaze condition of the target object according to the gaze target condition and the eye movement data; The fluctuation of the psychological state of the target object is evaluated in real time according to the gaze situation and the physiological data.
2. The method according to claim 1, wherein: Determining the gaze situation of the target object according to the gaze target situation and the eye movement data includes: Matching the gaze target situation with the eye movement data to determine the current gaze target of the target object; According to the change of the current gaze target, it is determined whether the target object has an abnormal gaze situation.
3. The method according to claim 2, wherein: According to the gaze situation and the physiological data, the fluctuation of the psychological state of the target object is evaluated in real time, including: If the target object has abnormal gaze, determining whether the physiological data has a mutation; If so, it is determined that the target object has a sudden change in psychological state.
4. The method according to claim 3, wherein: Determining whether the physiological data has a mutation includes: It is determined whether the heart rate in the physiological data increases by a preset value, and if so, it is determined that a sudden change occurs in the physiological data.
5. The method according to claim 2, wherein: The abnormal gaze condition includes any one or any combination of the following: The duration of fixation on the same fixation target is greater than a first preset duration; jitter occurs when looking at the fixation target; and The same fixation target is fixed multiple times within a second preset time period.
6. The method according to any one of claims 1 to 5, wherein: Also includes: If the target object has multiple sudden changes in its psychological state within the third preset time period, a reminder message is output through the AI glasses, and the reminder message is used to prompt the target object to calm down and alleviate its psychological state.
7. The method according to any one of claims 1 to 5, wherein: Determining the fixation target situation in the field of view of the target object according to the field of view scene data includes: A gaze target existing in the field of view of the target object and environmental features of the gaze target are determined according to the field of view scene data.
8. A system for monitoring and evaluating a psychological state, the system comprising: AI glasses, used to obtain eye movement data, physiological data and visual field scene data of a target object when the target object wears the AI glasses in a life scene of the target object, wherein the form of the AI glasses is the same as that of conventional glasses; A scene analysis device, used to determine the fixation target situation within the field of view of the target object according to the field of view scene data; A gaze situation analysis device, used for determining the gaze situation of the target object according to the gaze target situation and the eye movement data; The psychological state evaluation device is used to evaluate the fluctuation of the psychological state of the target object in real time according to the gaze situation and the physiological data.
9. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
Citation Information
Patent Citations
Psychological state adjusting method and device and computer readable storage medium
CN109480867A
Advertisement evaluation method and system based on eye movement tracking and emotional state
CN114648354A
Emotional feature determination method and device of target object, equipment and storage medium
CN115762772A
Eyewear, data collection system and data collection method
JP2021035499A
