Prisoner psychological health state assessment method and system based on multi-modal information

A technology for serving prisoners and their mental state, applied in psychological devices, medical science, diagnosis, etc., can solve the problems of not taking into account the collection of physiological signals by electronic equipment, not taking into account the special groups of prisoners, etc., and achieve the effect of improving accuracy

Active Publication Date: 2019-11-29
SHANDONG UNIV +1
View PDF17 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The existing mental state assessment does not take into account the special group of prisoners, and also does not take into account the use of some electronic equipment to collect physiological signals and pro

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Prisoner psychological health state assessment method and system based on multi-modal information
  • Prisoner psychological health state assessment method and system based on multi-modal information
  • Prisoner psychological health state assessment method and system based on multi-modal information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] Embodiment one, the present embodiment provides the method for assessing the mental health status of prisoners based on multimodal information;

[0053] The method for evaluating the mental health status of prisoners based on multimodal information, said method is not used for the diagnosis of disease; said method includes:

[0054] Obtain the physiological signal, facial expression image and voice signal of the transformed prisoner after experiencing the virtual reality scene, and extract the physiological signal feature, facial expression image feature and voice signal feature from the acquired signal;

[0055] Obtain the physiological signal, facial expression image and voice signal of the prisoner to be tested after experiencing the virtual reality scene, and extract the physiological signal feature, facial expression feature and voice signal feature from the acquired signal;

[0056] Input the physiological signal features, facial expression image features and voic...

Embodiment 2

[0097] Embodiment two, present embodiment also provides the evaluation system of mental health status of inmates based on multimodal information;

[0098] Such as figure 1 As shown, the evaluation system for the mental health status of prisoners based on multi-modal information includes:

[0099] Data collection module for reformed prisoners: acquire physiological signals, facial expression images and voice signals of reformed prisoners after experiencing virtual reality scenarios;

[0100] Renovate the data feature extraction module of good prisoners: extract physiological signal features, facial expression image features and voice signal features from the acquired signals;

[0101] Data acquisition module of the prisoner to be tested: obtain the physiological signal, facial expression image and voice signal of the prisoner to be tested after experiencing the virtual reality scene;

[0102] Data feature extraction module of inmates to be tested: extract physiological signal...

Embodiment 3

[0113] Embodiment 3. This embodiment also provides an electronic device, including a memory, a processor, and computer instructions stored in the memory and run on the processor. When the computer instructions are executed by the processor, the first implementation is completed. The steps of the method described in the example.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a prisoner psychological health state assessment method and a system based on multi-modal information. The method comprises the following steps: obtaining physiological signals, facial expression images and voice signals of reformed prisoners and prisoners to be tested after they experience virtual reality scenes, and extracting physiological signal features, facial expression image features and voice signal features from the obtained signals; inputting the physiological signal features, facial expression image features and voice signal features of the reformed prisonerinto a pre-trained neural network model, and outputting a psychological state assessment vector of the reformed prisoners; inputting the physiological signal features, the facial expression featuresand the voice signal features of the prisoners to be tested into a pre-trained neural network model, and outputting a psychological state assessment vector of the prisoners to be tested; calculating the psychological state assessment vector distance between the prisoners to be tested and the reformed prisoners; and assessing the mental health state of the prisoners according to the distance.

Description

technical field [0001] The present disclosure relates to a method and system for assessing mental health status of prisoners based on multi-modal information. Background technique [0002] The statements in this section merely mention background art related to the present disclosure and do not necessarily constitute prior art. [0003] Mental health of criminals refers to the measures and methods to keep criminals mentally healthy while serving their sentences, and to reduce and avoid the occurrence of mental diseases. Mainly include: (1) Optimizing the environment for serving sentences. (2) Help and guide criminals to learn to use the mechanism of self-psychological adjustment correctly, and carry out self-psychological adjustment in time to avoid psychological imbalance. (3) Establish psychological counseling and treatment institutions to provide timely psychological counseling and treatment for criminals who have mental illnesses and encounter serious psychological setb...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): A61B5/16
CPCA61B5/165
Inventor 刘治姚佳
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products