The application provides an old person medical self-service
machine intelligent interaction
system and method based on a BP neural network, binocular cameras collect near-
infrared and visible light dual-mode image data of a user's face, a first sub-network calculates an old person identity similarity P1; the relationship between the old person identity similarity P1 and a preset threshold T1 is judged, if P1 >= T1, it is considered that an old person is operating, an
infrared sensor is triggered to collect hand behavior data; hand behavior features are extracted according to the hand behavior data collected by the
infrared sensor, the hand behavior features are used as inputs of a second sub-network, and a behavior compliance degree P2 is calculated; the relationship between the behavior compliance degree P2 and a preset threshold T4 is judged, if P2 < T4, and the hovering duration >= T2 or the click frequency <= T3, it is determined that an operation difficulty state exists; an interaction
adaptation and multi-level early warning mechanism is triggered. The application has the characteristics of high intelligence, multi-
modal data fusion, active intelligent
adaptation, three-level early warning service
closed loop, adaptive parameter configuration and
small sample learning ability.