The invention discloses a learning and playing method by means of a virtual musical instrument. The method includes that a laser and a camera are used to acquire the user's body image information, the body image information is transmitted to a host, by means of AR, VR, motion sensing game technology, a real body controls a virtual body in a virtual world displayed by a projector or a display screen 5 in a cross-eye manner to operate the virtual world musical instrument, or the host determines the physical movement positions of the real body so as to control the virtual body to operate the musical instrument displayed beside the virtual body. The invention further discloses a learning and playing device by means of a virtual musical instrument, the device includes a pair of glasses or a helmet, 1 refers to a host (mobile phone system, CUP, GPU, ROM, RAM, harddisc, external memory, bluetooth, wireless connection, and battery etc.), 2 refers to a loudspeaker, 3 refers to a laser, 4 refers to a camera, 5 refers to a projector or a display screen, and 6 refers to a microphone.