The invention provides a quadruped
robot terrain classification method and
system based on sound feature and IMU
information fusion, and relates to the field of
terrain perception, and the method specifically comprises the steps: collecting an
audio signal,
processing the
audio signal to obtain a Mel
spectrogram, collecting an IMU
signal, drawing a triaxial IMU
signal time domain graph, dividing the
time domain graph into a plurality of IMU information graphs, and obtaining a quadruped
robot terrain classification result. The feature value of each
time domain graph window is calculated, an IMU information graph corresponding to the Mel-frequency
spectrogram in time relation can be established, then the Mel-frequency
spectrogram and the IMU information graph are spliced according to the
time sequence, and the spliced Mel-frequency spectrogram and IMU information graph are input into a neural
network model for
terrain classification; according to the method, the classification capability of the unstructured outdoor terrain is enhanced in a mode of fusing
sound perception and ontology
perception, and the spliced input image not only contains audio features, but also retains IMU information, so that a neural
network model can learn from two different
perception sources, terrain features can be comprehensively understood, and the classification efficiency of the unstructured outdoor terrain is improved. Therefore, the recognition capability of the complex environment is improved.