The application discloses an
autism child social interaction behavior
video image analysis method and
system, belongs to the technical field of
computer vision and medical
image analysis, and comprises the following steps: a video acquisition step, wherein video images of a child and an assessor performing a structured social interaction task are acquired through a multi-angle camera; a
human body posture
estimation step, wherein two-person skeleton key point detection is performed and posture parameter sequences are calculated; a social
signal detection step, wherein key
social behavior events such as eye contact, social smile, directional gesture and
body orientation response are identified; an interaction
synchronism analysis step, wherein the time
coupling degree of posture changes of both parties is calculated through cross-
correlation analysis; and an evaluation
report generation step, wherein a social interaction ability evaluation report is generated in the form of a
radar chart by comprehensively considering multi-dimensional features. The application realizes objective quantitative evaluation of the social interaction ability of an
autism child and improves the consistency and
repeatability of evaluation.