The invention discloses an intelligent
cockpit gesture recognition method fusing attention and map updating, and the method comprises the steps: building a
space model of a
cockpit, presetting a local attention interval for each seat of the
cockpit, associating the local attention interval with a multi-
camera matrix, and constructing a seat-interval-camera mapping relation; the method comprises the following steps: synchronously acquiring image data in a cabin through a multi-
camera matrix, operating a hand detection model to detect a hand image, and preliminarily classifying the hand image into a local attention interval; performing
gesture recognition on the hand image, and outputting a
gesture recognition result; building a cockpit
knowledge graph, and dynamically updating a node and edge relationship of the cockpit
knowledge graph according to the passenger state change and / or the gesture recognition result; and performing authority
verification and conflict arbitration based on a gesture recognition result and the cabin
knowledge graph, sending a control instruction passing arbitration to a corresponding cabin
actuator, and performing closed-
loop optimization based on
user feedback. According to the invention, the accuracy, real-time performance and
system robustness of gesture recognition can be improved.