Multi-modal fusion psychological counseling strategy evaluation method and device

Abstract

The invention discloses a multi-modal fusion psychological counseling strategy evaluation method and device. The method comprises the following steps: obtaining corpus data corresponding to a counseling subject when providing psychological counseling to a visiting subject; obtaining corresponding physiological index data of the visitor subject in the psychological consultation; and according to the corpus data and / or the physiological index data, obtaining consultation strategy evaluation data used for evaluating consultation strategy data adopted in the psychological consultation. According to the method, the consultation strategy evaluation data obtained by combining the corpus data and / or the physiological index data in the psychological consultation can be used for accurately evaluating the matching between the consultation strategy used in the psychological consultation and the real consultation demand of the visiting subject.

Description

Technical Field

[0001] This application relates to the field of mental health technology, specifically to a multimodal fusion method for evaluating psychological counseling strategies. This application also relates to a multimodal fusion device, electronic device, and computer-readable storage medium for evaluating psychological counseling strategies. Background Technology

[0002] In the field of psychological counseling, existing procedures suffer from a mismatch between the counseling strategies employed and the client's actual needs. Specifically, misunderstandings of the client's needs and rigid application of counseling strategies lead to a mismatch between counseling strategy data and the client's true needs, thus impacting the effectiveness of the counseling strategy. Therefore, achieving a precise match between counseling strategy data and the client's genuine needs is a problem that needs to be addressed. Summary of the Invention

[0003] This invention provides a multimodal fusion method for evaluating psychological counseling strategies, a multimodal fusion device for evaluating psychological counseling strategies, an electronic device, and a computer-readable storage medium to solve the problem of mismatch between counseling strategies and clients in existing psychological counseling processes.

[0004] To solve or partially solve the above-mentioned technical problems, according to one aspect of the present invention, a multimodal fusion method for evaluating psychological counseling strategies is provided, the method comprising: Obtain corpus data on the language used by the counselor when providing psychological counseling to the client; Obtain physiological indicator data of the client during the psychological counseling; Based on the corpus data and / or the physiological indicator data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling.

[0005] In one implementation, based on the corpus data and the physiological indicator data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling, including: Information about events related to psychological counseling was obtained by parsing the corpus data. Based on the corpus data and / or the physiological indicator data, determine the data on changes in the psychological state of the client during the psychological counseling. Based on the event information and the data on changes in psychological state, determine the psychological change-related events of the client during the psychological counseling. Determine whether the psychological state change data meets the expected effect of the first counseling strategy data corresponding to the psychological change-related event, and obtain the first counseling strategy evaluation data corresponding to the first counseling strategy data based on the determination result.

[0006] In one implementation, the psychological state change data includes psychological state change nodes and psychological state change attributes.

[0007] In one implementation, determining the changes in the client's psychological state during the psychological counseling based on the corpus data includes: The corpus data is subjected to speech recognition and / or semantic recognition. Based on the results of speech recognition and / or semantic recognition, a first emotional fluctuation curve of the client in the psychological counseling is determined, and the psychological state change data is obtained based on the analysis of the first emotional fluctuation curve.

[0008] In one implementation, determining the changes in the client's psychological state during the psychological counseling based on the physiological indicator data includes: Based on the analysis of the physiological indicator data, a second emotional fluctuation curve of the client during the psychological counseling is obtained, and based on the analysis of the second emotional fluctuation curve, data on changes in the psychological state are obtained.

[0009] In one implementation, determining the changes in the psychological state of the client during the psychological counseling based on the corpus data and the physiological indicator data includes: The corpus data is subjected to speech recognition and / or semantic recognition. Based on the results of speech recognition and / or semantic recognition, a first emotional fluctuation curve of the client in the psychological counseling is determined. Based on the analysis of the physiological indicator data, a second emotional fluctuation curve of the client in the psychological counseling is obtained. The psychological status change data is determined by comprehensively considering the first emotional fluctuation curve and the second emotional fluctuation curve.

[0010] In one implementation, based on the corpus data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling, including: Based on the corpus data, the communication behavior characteristics data of the visiting subject are obtained; The communication behavior evaluation data is obtained based on the communication behavior characteristic data to evaluate the communication behavior strategies in the psychological counseling.

[0011] In one implementation, based on the physiological index data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling, including: Based on the physiological index data, a relaxation curve representing the overall emotional change trend of the client is plotted, and the counseling strategy data is evaluated overall based on the relaxation curve to obtain the counseling strategy evaluation data.

[0012] In one implementation, the method further includes: determining consultation strategy improvement data for the visiting subject based on the consultation strategy evaluation data.

[0013] According to another aspect of the present invention, a multimodal fusion-based psychological counseling strategy evaluation device is also provided, the device comprising: The corpus data acquisition unit is used to acquire the corpus data corresponding to the psychological counseling provided by the counselor to the client. Physiological indicator data acquisition unit, used to acquire physiological indicator data corresponding to the client in the psychological counseling; The counseling strategy evaluation data acquisition unit is used to obtain counseling strategy evaluation data for evaluating the counseling strategy data used in the psychological counseling, based on the corpus data and / or the physiological indicator data.

[0014] According to another aspect of the present invention, an electronic device is also provided, including a processor and a memory; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the above-described method.

[0015] According to another aspect of the present invention, a computer-readable storage medium is also provided, on which one or more computer instructions are stored, which are executed by a processor to implement the above-described method.

[0016] Compared with the prior art, the present invention has the following advantages: The multimodal fusion-based psychological counseling strategy evaluation method provided by this invention includes: obtaining corpus data corresponding to the counselor's provision of psychological counseling to the client; obtaining physiological indicator data corresponding to the client's psychological counseling; and obtaining counseling strategy evaluation data based on the corpus data and / or physiological indicator data to evaluate the counseling strategy data used in psychological counseling. In this method, by analyzing the corpus data and / or physiological indicator data, the client's actual coping style and psychological state during the psychological counseling process can be obtained. This actual coping style and psychological state can characterize the client's actual counseling needs. Therefore, the counseling strategy evaluation data obtained by combining the corpus data and / or physiological indicator data in psychological counseling can be used to accurately evaluate the matching between the counseling strategies used in psychological counseling and the client's actual counseling needs; furthermore, based on this counseling strategy evaluation data, the counseling strategy data can be improved in a direction that matches the client's psychological counseling needs. Attached Figure Description

[0017] Figure 1 This is a flowchart of the multimodal fusion-based psychological counseling strategy evaluation method provided in the embodiments of this application; Figure 2 This is a block diagram of the multimodal fusion psychological counseling strategy evaluation device provided in the embodiments of this application; Figure 3 This is a schematic diagram of the logical structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0018] Many specific details are set forth in the following description to provide a full understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this application; therefore, this application is not limited to the specific embodiments disclosed below.

[0019] The terminology used in one or more embodiments of this specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of this specification. The singular forms “a,” “described,” and “the” as used in one or more embodiments of this specification and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in one or more embodiments of this specification refers to and includes any or all possible combinations of one or more associated listed items.

[0020] It should be understood that although the terms first, second, etc., may be used to describe various information in one or more embodiments of this specification, such information should not be limited to these terms. These terms are only used to distinguish information of the same type from one another. For example, first may also be referred to as second without departing from the scope of one or more embodiments of this specification, and similarly, second may also be referred to as first. Depending on the context, the word "if" as used herein may be interpreted as "when," "when," or "in response to a determination."

[0021] In this application, the term "multiple" may refer to two or more, and "at least one" may refer to one, two or more.

[0022] The term "and / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this application generally indicates that the preceding and following related objects have an "or" relationship.

[0023] The mismatch between counseling strategies and the client's true needs in psychological counseling stems from a failure to deeply explore those needs. This leads to superficial and rigid application of counseling strategies. Specifically, when determining the counseling strategy, the focus is often solely on overt symptoms like insomnia and interpersonal conflict, neglecting deeper, core needs. This results in strategies that target these symptoms rather than addressing deeper issues. For example, a working professional complaining of work stress may actually be driven by a lack of professional self-worth; similarly, a teenager exhibiting parent-child conflicts may be driven by a desire for autonomy. Rigid application of counseling strategies manifests as the counselor using a single approach for each client. For instance, exposure therapy might be used for traumatized clients seeking emotional support, or excessively tracing childhood trauma for clients needing short-term emotional relief. Furthermore, the counselor may ignore the evolving needs of the client, using emotional catharsis strategies from the early stages of counseling to address clients in later stages.

[0024] To address the mismatch between counseling strategies and the actual needs of clients in the aforementioned psychological counseling scenarios, this application provides a multimodal fusion-based psychological counseling strategy evaluation method, a corresponding multimodal fusion-based psychological counseling strategy evaluation device, an electronic device, and a computer-readable storage medium for counseling strategies. The following embodiments provide a detailed description of the above method, device, electronic device, and computer-readable storage medium.

[0025] This application provides a multimodal fusion method for evaluating psychological counseling strategies. The application subject of this method can be a computing device used to analyze the effects of psychological counseling. Figure 1 The flowchart of the multimodal fusion psychological counseling strategy evaluation method provided in the embodiments of this application is as follows, combined with Figure 1 This embodiment provides a detailed description of the multimodal fusion-based psychological counseling strategy evaluation method. The embodiments described below are for illustrative purposes only and are not intended to limit actual use.

[0026] like Figure 1 As shown in this embodiment, the multimodal fusion-based psychological counseling strategy evaluation method includes the following steps: S101, Obtain the corpus data corresponding to the psychological counseling provided by the counselor to the client.

[0027] This step is used to obtain the corpus data corresponding to the psychological counseling provided by the counselor to the client after the counseling session is completed. The counselor is the provider of psychological counseling, such as a counselor or other intelligent agent capable of providing psychological counseling services (such as a robot that provides psychological counseling services using artificial intelligence technology). The client is the recipient of psychological counseling, such as a user. The aforementioned corpus data includes voice data recorded during the counseling process, including tone of voice, speaking speed, speaking time, number of silences, silence time, emotional tone, etc., as well as counseling text reflecting the actual dialogue content between the client and the counselor during the counseling process.

[0028] S102, obtain physiological indicator data of the client during psychological counseling.

[0029] Before or after step S101, this step is used to obtain physiological indicator data corresponding to the client during psychological counseling. For example, during the counseling process, wearable devices are used to monitor and record physiological indicator data such as heart rate variability and skin conductance at various time points. After the counseling, the monitored and recorded physiological indicator data are exported, preprocessed, analyzed, and summarized. Compared with corpus data such as voice data and counseling text, physiological indicator data has stronger objectivity and can reflect the client's true psychological state, effectively avoiding misjudgments of needs caused by the client's defensive mentality or expression deviations.

[0030] S103, Based on corpus data and / or physiological indicator data, obtain counseling strategy evaluation data for evaluating the counseling strategies used in psychological counseling.

[0031] After obtaining the corpus data corresponding to the counselor's provision of psychological counseling to the client and the client's corresponding physiological indicator data during the aforementioned steps, this step is used to obtain counseling strategy evaluation data for evaluating the counseling strategy data used in the psychological counseling, based on at least one of the aforementioned corpus data and physiological indicator data. The counseling strategy data refers to the various counseling coping methods adopted by the counselor for the client, such as guiding the client to express emotions and relieve stress. These methods can correspond to different counseling schools of thought, such as exposure therapy and tracing childhood trauma. In this embodiment, the counseling strategy data used in psychological counseling can be extracted from the counseling text through a large language model, or it can be obtained by the counselor after annotating or summarizing the counseling text. This counseling strategy data corresponds to some or all of the client's behavioral performance during the counseling process; that is, some or all of the client's behavioral performance during the counseling process can be considered as the application result of the counseling strategy data.

[0032] In this embodiment, the counseling strategy evaluation data obtained from the corpus data and physiological indicator data for evaluating the counseling strategies used in psychological counseling can specifically refer to: First, we extract event information related to psychological counseling from the aforementioned corpus data. Event information related to psychological counseling refers to various categories of events described by the client during the counseling process, such as historical facts or subjective evaluations stated during the counseling session.

[0033] Secondly, based on the aforementioned corpus data and / or physiological indicator data, the data on changes in the psychological state of the client during psychological counseling is determined. This data includes psychological state change nodes and psychological state change attributes. Psychological state change nodes represent the time when the client's psychological state changes (e.g., the time when an emotional change occurs). Psychological state change attributes can refer to whether the client's psychological state changes from positive to negative or from negative to positive. In this embodiment, psychological state change attributes can also include the intensity of the change in the client's psychological state, such as whether the emotional change is mild or severe, the magnitude of the emotional change, etc.

[0034] Then, based on the event information obtained from the above analysis and the identified data on changes in the client's psychological state during psychological counseling, the relevant events related to the client's psychological changes during counseling are determined. For example, the event information corresponding to the nodes of psychological state changes is identified as the relevant events of the client's psychological changes.

[0035] Finally, it is determined whether the data on changes in psychological state meet the expected effect of the first counseling strategy data corresponding to the psychological change-related event, and the evaluation data of the first counseling strategy corresponding to the first counseling strategy data is obtained based on the determination result. Specifically, it can be determined whether the change in psychological state is an expected change or an unexpected change based on the counseling strategy adopted. For example, at a certain moment, a counseling strategy used by the counselor triggers the client's longing for deceased relatives, leading to abnormal emotional fluctuations. If these abnormal emotional fluctuations are an emotional change expected by the counselor, and their purpose is to allow the client to vent their psychological problems, then the corresponding counseling strategy used is evaluated as excellent.

[0036] In this embodiment, determining the psychological state change data of the client in the psychological counseling based on the corpus data can specifically refer to: performing speech recognition and / or semantic recognition on the corpus data, determining the client's first emotional fluctuation curve in the psychological counseling based on the results of speech recognition and / or semantic recognition, and analyzing the psychological state change data based on the first emotional fluctuation curve. For example, based on the recognition results of speech and / or semantics, the client's emotional state at each time point can be known, and a first emotional fluctuation curve representing the change of emotional state over time can be drawn accordingly. Each inflection point of the first emotional fluctuation curve indicates a change in the client's psychological state, and the time point corresponding to the inflection point is the node of emotional state change. The amplitude of the curve change before and after the inflection point can represent the intensity of the change in the client's psychological state.

[0037] Similarly, the aforementioned determination of the client's psychological status changes during the psychological counseling based on physiological indicator data can specifically refer to: obtaining the client's second emotional fluctuation curve during the psychological counseling based on physiological indicator data such as skin conductance data and heart rate variability, and obtaining the psychological status change data based on the analysis of the second emotional fluctuation curve.

[0038] In another implementation, the aforementioned determination of the client's psychological state changes during psychological counseling based on corpus data and physiological indicator data can specifically refer to: performing speech recognition and / or semantic recognition on the corpus data; determining a first emotional fluctuation curve for the client during psychological counseling based on the results of speech recognition and / or semantic recognition; obtaining a second emotional fluctuation curve for the client during psychological counseling based on physiological indicator data analysis; and comprehensively determining the psychological state change data based on the first and second emotional fluctuation curves. For example, comparing the inflection points of the first and second emotional fluctuation curves, if the two curves correspond to the same inflection point at the same or similar time points, then determining that inflection point as the node where the psychological state change occurred.

[0039] In one implementation, the counseling strategy data may further include communication behavior strategies used in psychological counseling, such as the duration of silence, number of pauses, speech rate, number of questions asked, and proportion of speaking time used by the counselor towards the client. Correspondingly, counseling strategy evaluation data is obtained based on the corpus data to evaluate the counseling strategy data used in psychological counseling. Specifically, this may refer to: obtaining communication behavior characteristic data of the client, such as the duration of silence, number of responses, and proportion of speaking time, based on corpus data analysis. This communication behavior characteristic data belongs to observable and measurable behavioral performance dimensions in interpersonal communication or interaction, and collectively reflects the behavioral patterns, rhythm, and participation status of communication participants in the interaction, thus it can be used to characterize the client's psychological state. Then, communication behavior evaluation data is obtained based on the communication behavior characteristic data to evaluate the communication behavior strategies in psychological counseling. For example, if a client speaks significantly faster than the counselor during a consultation, and the number and duration of silences increase, but the duration of each silence decreases, it may indicate that the client's original communication strategies have put them in an emotionally activated state and the pace of the conversation is relatively tense. Therefore, the counselor can appropriately extend the meaningful silence time to give the client more space for introspection. At the same time, the counselor can help the client slow down their expression by adjusting their own speaking speed and rhythm, thus promoting a deeper emotional exploration.

[0040] In one implementation, counseling strategy evaluation data is obtained based on physiological indicator data to evaluate the counseling strategies used in psychological counseling. Specifically, this can refer to: plotting a relaxation curve representing the overall emotional change trend of the client based on physiological indicator data such as skin conductance activity data and heart rate variability, and then performing an overall evaluation of the counseling strategy data based on this relaxation curve to obtain the counseling strategy evaluation data. For example, if the client's emotional state is predominantly negative in the early stages of the counseling process and predominantly positive and stable in the later stages, then the overall evaluation effect of the counseling strategy data is determined to be excellent.

[0041] In this embodiment, after obtaining the counseling strategy evaluation data used to evaluate the counseling strategies employed in psychological counseling, counseling strategy improvement data for the client can also be obtained based on the counseling strategy evaluation data.

[0042] In the multimodal fusion-based psychological counseling strategy evaluation method provided in this embodiment, by analyzing corpus data and / or physiological indicator data, the client's actual coping style and psychological state during the psychological counseling process can be obtained. This actual coping style and psychological state can characterize the client's actual counseling needs. Therefore, the counseling strategy evaluation data obtained by combining corpus data and / or physiological indicator data in psychological counseling can be used to accurately evaluate the matching between the counseling strategies used in psychological counseling and the client's actual counseling needs. Furthermore, based on this counseling strategy evaluation data, the counseling strategy data can be improved in a direction that matches the client's psychological counseling needs.

[0043] For example, linguistic data such as language expression and emotional tone can characterize a client's explicit needs (e.g., "work is tiring") and implicit expressions (lack of a sense of value in work). Physiological data (e.g., heart rate variability, skin conductance activity) can objectively reflect a client's true psychological state, effectively avoiding misjudgments of counseling needs due to defensiveness or expressive biases. By comprehensively analyzing and evaluating counseling strategy data using both linguistic and physiological data, and generating counseling strategy evaluation data, objective assessment of counseling strategies can be achieved from the following key dimensions: first, determining whether the counseling strategy used by the client aligns with the core needs in counseling; and second, monitoring whether the counseling strategy adapts to changes in needs at different stages. For example, when the counseling stage for the client transitions from "emotional catharsis" to "solution implementation," whether the counseling strategy is adjusted promptly and effectively. Furthermore, the counseling strategy evaluation data provides counselors with precise directions for optimizing strategies, significantly improving the match between counseling strategies and counseling needs.

[0044] The above embodiments provide a multimodal fusion method for evaluating psychological counseling strategies. Correspondingly, another embodiment of this application also provides a multimodal fusion device for evaluating psychological counseling strategies. Since the device embodiment is basically similar to the method embodiment, it is described simply. For details of the relevant technical features, please refer to the corresponding description of the method embodiment provided above. The following description of the device embodiment is merely illustrative.

[0045] Please refer to Figure 2 Understanding this embodiment, Figure 2 This is a block diagram of the multimodal fusion psychological counseling strategy evaluation device provided in this embodiment, such as... Figure 2 As shown, the device for analyzing the effectiveness of psychological counseling strategies provided in this embodiment includes: Corpus data acquisition unit 201 is used to acquire corpus data corresponding to the psychological counseling provided by the counselor to the client. Physiological indicator data acquisition unit 202 is used to acquire physiological indicator data corresponding to the client in the psychological counseling. The counseling strategy evaluation data acquisition unit 203 is used to obtain counseling strategy evaluation data for evaluating the counseling strategy data used in the psychological counseling, based on the corpus data and / or the physiological indicator data.

[0046] In one implementation, based on the corpus data and the physiological indicator data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling, including: Information about events related to psychological counseling was obtained by parsing the corpus data. Based on the corpus data and / or the physiological indicator data, determine the data on changes in the psychological state of the client during the psychological counseling. Based on the event information and the data on changes in psychological state, determine the psychological change-related events of the client during the psychological counseling. Determine whether the psychological state change data meets the expected effect of the first counseling strategy data corresponding to the psychological change-related event, and obtain the first counseling strategy evaluation data corresponding to the first counseling strategy data based on the determination result.

[0047] In one implementation, the psychological state change data includes psychological state change nodes and psychological state change attributes.

[0048] In one implementation, determining the changes in the client's psychological state during the psychological counseling based on the corpus data includes: The corpus data is subjected to speech recognition and / or semantic recognition. Based on the results of speech recognition and / or semantic recognition, a first emotional fluctuation curve of the client in the psychological counseling is determined, and the psychological state change data is obtained based on the analysis of the first emotional fluctuation curve.

[0049] In one implementation, determining the changes in the client's psychological state during the psychological counseling based on the physiological indicator data includes: Based on the analysis of the physiological indicator data, a second emotional fluctuation curve of the client during the psychological counseling is obtained, and based on the analysis of the second emotional fluctuation curve, data on changes in the psychological state are obtained.

[0050] In one implementation, determining the changes in the psychological state of the client during the psychological counseling based on the corpus data and the physiological indicator data includes: The corpus data is subjected to speech recognition and / or semantic recognition. Based on the results of speech recognition and / or semantic recognition, a first emotional fluctuation curve of the client in the psychological counseling is determined. Based on the analysis of the physiological indicator data, a second emotional fluctuation curve of the client in the psychological counseling is obtained. The psychological status change data is determined by comprehensively considering the first emotional fluctuation curve and the second emotional fluctuation curve.

[0051] In one implementation, based on the corpus data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling, including: Based on the corpus data, the communication behavior characteristics data of the visiting subject are obtained; The communication behavior evaluation data is obtained based on the communication behavior characteristic data to evaluate the communication behavior strategies in the psychological counseling.

[0052] In one implementation, based on the physiological index data, counseling strategy evaluation data is obtained for evaluating the counseling strategy data used in the psychological counseling, including: Based on the physiological index data, a relaxation curve representing the overall emotional change trend of the client is plotted, and the counseling strategy data is evaluated overall based on the relaxation curve to obtain the counseling strategy evaluation data.

[0053] In one implementation, the method further includes: determining consultation strategy improvement data for the visiting subject based on the consultation strategy evaluation data.

[0054] This application also provides an electronic device that can be programmed with the aforementioned multimodal fusion psychological counseling strategy evaluation device to execute the multimodal fusion psychological counseling strategy evaluation method provided in this embodiment of the invention. Optionally, one possible hardware structure of the electronic device may be as follows: Figure 3 As shown, it includes: at least one processor 301, at least one communication interface 302, at least one memory 303 and at least one communication bus 304; Optionally, the communication interface 302 can be an interface of a communication module, such as the interface of a GSM module; The processor 301 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.

[0055] Memory 303 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0056] The memory 303 stores a program, and the processor 301 calls the program stored in the memory 303 to execute the analysis method of psychological counseling strategies provided in this embodiment of the invention.

[0057] In the above embodiments, a multimodal fusion-based psychological counseling strategy evaluation method, a multimodal fusion-based psychological counseling strategy evaluation device, and an electronic device are provided. Furthermore, another embodiment of this application provides a computer-readable storage medium for implementing the above-described multimodal fusion-based psychological counseling strategy evaluation method. The computer-readable storage medium embodiments provided in this application are described in a relatively simple manner; relevant parts can be found in the corresponding descriptions of the above method embodiments. The embodiments described below are merely illustrative.

[0058] The computer-readable storage medium provided in this embodiment stores computer instructions, which, when executed by a processor, perform the following steps: In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0059] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0060] 1. Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include non-transitory computer-readable media, such as modulated data signals and carrier waves.

[0061] 2. Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0062] Although this application discloses preferred embodiments as described above, it is not intended to limit this application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of this application. Therefore, the scope of protection of this application should be determined by the scope defined in the claims of this application.

Claims

1. A multi-modal fusion psychological counseling strategy evaluation method, characterized in that, The method comprises: obtaining corpus data corresponding to a counselor providing psychological counseling to a visit subject; obtaining physiological index data corresponding to the visit subject in the psychological counseling; obtaining counseling strategy evaluation data for evaluating counseling strategy data adopted in the psychological counseling according to the corpus data and / or the physiological index data.

2. The method of claim 1, wherein, According to the corpus data and the physiological index data, obtaining counseling strategy evaluation data for evaluating counseling strategy data adopted in the psychological counseling, comprises: obtaining psychological counseling related event information from the corpus data; determining psychological condition change data of the visit subject in the psychological counseling based on the corpus data and / or the physiological index data; determining psychological change related events corresponding to the visit subject in the psychological counseling according to the event information and the psychological condition change data; determining whether the psychological condition change data meets the expected effect of the first counseling strategy data corresponding to the psychological change related events, and obtaining first counseling strategy evaluation data corresponding to the first counseling strategy data based on the determination result.

3. The method of claim 2, wherein, The psychological condition change data comprises psychological condition change nodes and psychological condition change attributes.

4. The method of claim 2, wherein, The determination of the psychological condition change data of the visit subject in the psychological counseling based on the corpus data comprises: performing voice recognition and / or semantic recognition on the corpus data, determining a first emotional fluctuation curve of the visit subject in the psychological counseling based on the results of voice recognition and / or semantic recognition, and obtaining the psychological condition change data based on the first emotional fluctuation curve analysis.

5. The method of claim 2, wherein, The determination of the psychological condition change data of the visit subject in the psychological counseling based on the physiological index data comprises: obtaining a second emotional fluctuation curve of the visit subject in the psychological counseling based on the physiological index data analysis, and obtaining the psychological condition change data based on the second emotional fluctuation curve analysis.

6. The method of claim 2, wherein, The determination of the psychological condition change data of the visit subject in the psychological counseling based on the corpus data and the physiological index data comprises: performing voice recognition and / or semantic recognition on the corpus data, determining a first emotional fluctuation curve of the visit subject in the psychological counseling based on the results of voice recognition and / or semantic recognition, obtaining a second emotional fluctuation curve of the visit subject in the psychological counseling based on the physiological index data analysis, and determining the psychological condition change data comprehensively according to the first emotional fluctuation curve and the second emotional fluctuation curve.

7. The method of claim 1, wherein, According to the corpus data, obtaining counseling strategy evaluation data for evaluating counseling strategy data adopted in the psychological counseling, comprises: obtaining communication behavior characteristic data of the visit subject based on the corpus data; obtaining communication behavior evaluation data for evaluating communication behavior strategy in the psychological counseling based on the communication behavior characteristic data.

8. The method of claim 1, wherein, According to the physiological index data, obtaining counseling strategy evaluation data for evaluating counseling strategy data adopted in the psychological counseling, comprises: Based on the physiological index data, a relaxation degree curve representing a comprehensive emotional change trend of the visitor is drawn, and the counseling strategy data is overall evaluated according to the relaxation degree curve, so as to obtain the counseling strategy evaluation data.

9. The method of claim 1, wherein, Also comprising: Based on the counseling strategy evaluation data, counseling strategy improvement data for the visitor subject is determined. 10.A multi-modal fusion psychological counseling strategy evaluation device, characterized in that, The device comprises: A corpus data obtaining unit is configured to obtain corpus data corresponding to the counseling subject providing psychological counseling to the visitor subject; A physiological index data obtaining unit is configured to obtain physiological index data corresponding to the visitor subject in the psychological counseling; A counseling strategy evaluation data obtaining unit is configured to obtain counseling strategy evaluation data for evaluating the counseling strategy data adopted in the psychological counseling according to the corpus data and / or the physiological index data.

11. An electronic device, comprising: The device comprises: A processor and a memory; wherein 12. A computer-readable storage medium having stored thereon one or more computer instructions, wherein, The memory is configured to store one or more computer instructions, wherein the one or more computer instructions are executed by the processor to implement the method according to any one of claims 1-9. The instructions are executed by the processor to implement the method according to any one of claims 1-9.

Images