The invention discloses an
intent recognition system and method for disabled old people based on
gaze and environment interaction, and belongs to the technical field of intelligent old people care and
artificial intelligence. The invention aims to solve the problem of difficult communication of disabled old people caused by language and
dyskinesia. The
system comprises a multi-
modal data acquisition unit which is used for acquiring
staring target sequences and multi-dimensional situation information such as
physiology, time, space and the like of old people; the situation
feature fusion and construction unit is used for integrating the multi-source heterogeneous data into structured comprehensive situation representation; the core of the intention reasoning unit is a large
language model, and the intention reasoning unit is used for carrying out deep semantic understanding and
logical reasoning on the comprehensive situation and generating a candidate intention
list with confidence; and the man-
machine interaction output unit is used for presenting the recognition result to
nursing personnel. According to the method, the
staring behaviors and the rich situation information are deeply fused, the powerful reasoning ability of the large
language model is utilized, the complex and dynamic intentions of the disabled old people can be accurately recognized in a natural and low-cognitive-load mode, and the communication efficiency and the
nursing quality are remarkably improved.