The application discloses a kind of gesture-based computer-aided
engineering software intelligent agent application human-computer
interaction method, and the structured command
stream including translation, rotation, scaling, point selection and other operation types and parameters is output by pre-trained deep neural network. The operation precision is significantly improved by
smoothing and correcting the recognition parameters through the secondary fine correction link. The CAE
intelligent agent receives the corrected command
stream, calls the
software API to execute the operation, and feeds back the next step suggestion to the user after obtaining the execution state. The application solves the problem that
natural language is difficult to accurately describe high-dimensional space constraints, and breaks the
closed loop from instruction understanding to actual operation execution of the
intelligent agent. At the same time, the
visual interaction without external device is adopted, which completely eliminates the dependence of mouse and keyboard on the flat
workbench, adapts to outdoor, clean workshop and high-altitude work and other limited working conditions, eliminates the operation failure and precision deficiency problem caused by the environmental constraints of traditional external devices, and realizes full-process, high-precision CAE
simulation contactless control.