The invention provides a multi-user panoramic video transmission method, which is characterized by comprising the following steps of: 1, a model is defined for a multi-user panoramic video transmission problem, and a QoE index is quantified; 2, the code rate decision maker records the states of all clients participating in streaming media transmission, if the number of users is smaller than or equal to 5, a global optimization algorithm is used for distributing panoramic video transmission bandwidth, and a traversal code rate distribution scheme is used for solving a global QoE optimal solution of multiple users; if the number of the users is greater than 5, a panoramic video transmission bandwidth is allocated by using a heuristic allocation method based on the length of a user cache queue; and 3, the client side requests the video block, the server side responds to the video block i and pushes data, and in the step 1, for the QoE of the user c to the video block i, the QoE is specifically defined as the weighted sum of four factors including viewport definition Q, intra-frame quality smoothness VI, inter-frame quality smoothness ViB and pause duration TiS.