The invention relates to the technical field of radiation dose measurement, in particular to an energy spectrum acquisition-based portable radiation dose measuring device, which comprises a CZT detector module, a signal shaping amplifying circuit, a high-speed AD conversion circuit and a digital signal processing module, wherein the CZT detector module is used for converting particle energy information of a to-be-measured radiation field to corresponding electrical signals; the signal shaping amplifying circuit is used for amplifying the amplitude of the electrical signals outputted by the CZTdetector; the high-speed AD conversion circuit is used for continuously sampling pulse signals outputted by the signal shaping amplifying circuit and converting the pulse signals to a digital quantity for being outputted; and the digital signal processing module is used for performing amplitude information extraction and energy spectrum accumulation on the digital signal waveform outputted by thehigh-speed AD conversion circuit, and after energy spectrum accumulation is completed, based on an energy spectrum dose conversion function, the incident particle type and the radiation dose information of the to-be-measured radiation field are calculated and obtained. In comparison with the prior art, the detailed information of the particle type, the energy and the radiation dose of the to-be-measured radiation field can be provided, the circuit structure is simple and reliable, and popularization is convenient.