Cooking processing method and device, electronic equipment and storage medium

Abstract

The application discloses a cooking processing method and device, electronic equipment and storage medium. The method comprises the following steps: in the cooking process, the eye movement data, gesture data and voice data of an operation subject to a cooking object are respectively subjected to feature extraction to obtain eye movement features and corresponding first confidence, gesture features and corresponding second confidence, and voice features and corresponding third confidence; based on the first confidence, the second confidence, the third confidence, and the correlation features among the eye movement features, the gesture features and the voice features, the weight information corresponding to each of the eye movement features, the gesture features and the voice features is determined, and then the fusion feature information is determined by combining the eye movement features, the gesture features and the voice features; the fusion feature information is input into an intention recognition network to determine the target intention of the operation subject to the cooking object, and the cooking object is controlled to interact. The application can improve the accuracy and intelligence of cooking collaborative interaction.

Images