The invention discloses a device and a method for
processing an image and an audio based on MZI network
time division multiplexing. The method comprises the following steps: S1, dividing an
image signal and an
audio signal into an image data block and an audio data block; s2, inputting the image data blocks and the audio data blocks into an MZI network through a
time division multiplexing controller; s3, the MZI network adjusts the phase shift, the image data block is processed by the MZI network to output an optical
signal after matrix operation, and
spectrum analysis is performed on the audio data block; s4, converting the optical
signal into an
electric signal through a
photoelectric conversion module; and S5, performing nonlinear
activation function processing on the
electric signal, and transmitting the processed
signal to a next layer of output module. And S6, outputting the signal subjected to nonlinear activation
processing to external equipment, and outputting feature and distribution information, a
frequency spectrum and a feature signal. And S7, the
time division multiplexing controller iteratively optimizes the
photon MZI network. The method is low in
delay and high in precision, and image audio efficient processing and
feature extraction are achieved.