The invention discloses an acoustic processing device based on a multi-core modular framework. The acoustic processing device comprises at least two processing cores, each processing core comprises atleast one algorithm core module and at least one control core module, and further comprises an audio and video input module, an interface module, a voice pickup module, a voice preprocessing module,a reference signal input module, a control and algorithm module, a voice output module, a network module and a power management module. The acoustic processing process is divided into different modules, and different functional modules are independent of each other and are managed and controlled by different processing cores. The processing cores cooperate through the inter-core communication anda shared memory, and different modules are handed to different cores for management and control. Through reasonable module control and system resource allocation, computing resources of the processorare made full use of, the computing power and effective availability of a sound processing system are improved, the processing delay is reduced, and the system resource scheduling capabilities are improved.