Multimedia data transmission method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a multimedia data transmission method and device, electronic equipment and a storage medium, and relates to the field of multimedia data transmission. The method comprises the following steps: in response to first multimedia data of a first object collected by collection equipment, sending a first request to a server, obtaining a first plug flow address and the first multimedia data sent by the server, and uploading the first multimedia data as plug flow data to the first plug flow address; a second request is sent to the server, second multimedia data serving as a second object of the pull stream data are obtained from the first pull stream address, and the second multimedia data are used for being played by the playing device; wherein the acquisition device and the playing device are different devices. According to the embodiment of the invention, multi-device cooperation for collecting and playing the multimedia data is realized, and the collecting and playing tasks can be distributed according to the performance of different devices.

Description

Technical Field

[0001] This application relates to the technical field of multimedia data transmission. Specifically, this application relates to a multimedia data transmission method, apparatus, electronic device, and computer-readable storage medium. Background Art

[0002] In the prior art, the device for collecting the multimedia data of one party and playing the multimedia data of the other party is the same device. For example, during a live connection, the mobile phone needs to collect the multimedia data of the mobile phone user and also play the multimedia data of the other party. That is, the collection of the multimedia data of one party and the playback of the multimedia data of the other party depend on the hardware performance of the same device. If a device wants to have good functions for both collecting multimedia data and playing multimedia data, the hardware requirements for this device are high. Summary of the Invention

[0003] The embodiments of this application provide a multimedia data transmission method, which can solve the above problems of the prior art. The technical solutions are as follows:

[0004] According to the first aspect of the embodiments of this application, a multimedia data transmission method is provided. The method includes:

[0005] In response to the collection device collecting the first multimedia data of the first object, send a first request to the server, where the first request is used to obtain the first push stream address;

[0006] Obtain the first push stream address and the first multimedia data sent by the server, and upload the first multimedia data as push stream data to the first push stream address;

[0007] Send a second request to the server, where the second request is used to obtain the first pull stream address, and obtain the first pull stream address sent by the server;

[0008] Obtain the second multimedia data of the second object as pull stream data from the first pull stream address, where the second multimedia data is used for playback by the playback device; wherein, the collection device and the playback device are different devices.

[0009] According to the second aspect of the embodiments of this application, a multimedia data transmission apparatus is provided. The apparatus is applied to the first device and includes:

[0010] The first sending module is configured to send a first request to the server in response to the collection device collecting the first multimedia data of the first object, where the first request is used to obtain the first push stream address;

[0011] The first acquisition module acquires the first push stream address and the first multimedia data sent by the server, and uploads the first multimedia data as push stream data to the first push stream address;

[0012] The second sending module is used to send a second request to the server, where the second request is used to obtain a first pull stream address, and acquires the first pull stream address sent by the server;

[0013] The second acquisition module acquires the second multimedia data of the second object as pull stream data from the first pull stream address, and the second multimedia data is used for a playback device to play; wherein, the acquisition device and the playback device are different devices.

[0014] According to the third aspect of the embodiments of the present application, there is provided an electronic device, which includes a memory, a processor, and a computer program stored on the memory, and the processor executes the computer program to implement the steps of the above method.

[0015] According to the fourth aspect of the embodiments of the present application, there is provided a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0016] According to the fifth aspect of the embodiments of the present application, there is provided a computer program product, including a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0017] The beneficial effects brought by the technical solutions provided by the embodiments of the present application are as follows:

[0018] By sending a first request to the server, the first push stream address is acquired. This first push stream address is equivalent to a transfer station for the first multimedia data provided by the server. When there are multiple acquisition devices, there are multiple first multimedia data, and the first device can upload the multiple first multimedia data provided by the first object to the server through this first push stream address, improving the transmission efficiency of the first multimedia data; by sending a second request to the server, the first pull stream address is acquired. This first pull stream address is equivalent to a transfer station for the second multimedia data provided by the server. When there are multiple playback devices, the first device acquires multiple second multimedia data provided by the second object according to this first pull stream address, so that the multiple playback devices can play the corresponding second multimedia data; therefore, the embodiments of the present application realize the interaction of the multimedia data of the first object and the second object. By using different devices to separately execute the acquisition task of the first multimedia data provided by the first object and the playback task of the second multimedia data provided by the second object, the acquisition task and the playback task are reasonably allocated according to the performance advantages of different devices, improving the processing ability of the multimedia data during the acquisition and playback processes. Description of the Drawings

[0019] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description in the embodiments of the present application.

[0020] Figure 1 Schematic diagram of the system architecture of the multimedia data transmission method provided in the embodiments of the present application;

[0021] Figure 2 Schematic diagram of the process of the multimedia data transmission method provided in the embodiments of the present application;

[0022] Figure 3 Schematic diagram of the process of obtaining the second pull stream address provided in the embodiments of the present application;

[0023] Figure 4 Schematic diagram of the process of obtaining the second push stream address provided in the embodiments of the present application;

[0024] Figure 5a Another schematic diagram of the process of the multimedia data transmission method provided in the embodiments of the present application;

[0025] Figure 5b Another schematic diagram of the process of the multimedia data transmission method provided in the embodiments of the present application;

[0026] Figure 5c Another schematic diagram of the process of the multimedia data transmission method provided in the embodiments of the present application;

[0027] Figure 6a Schematic diagram of the process of a first multimedia data transmission provided in the embodiments of the present application;

[0028] Figure 6b Schematic diagram of the process of a second multimedia data transmission provided in the embodiments of the present application;

[0029] Figure 6c Another schematic diagram of the process of a second multimedia data transmission provided in the embodiments of the present application;

[0030] Figure 6d Another schematic diagram of the process of a first multimedia data transmission provided in the embodiments of the present application;

[0031] Figure 7 Application scenario diagram of the multimedia data transmission provided in the embodiments of the present application;

[0032] Figure 8 Schematic diagram of the structure of a multimedia data transmission device provided in the embodiments of the present application;

[0033] Figure 9 Schematic diagram of the structure of an electronic device provided in the embodiments of the present application. Detailed implementation manners

[0034] The embodiments of the present application will be described below with reference to the accompanying drawings in the present application. It should be understood that the implementation manners described below in conjunction with the accompanying drawings are exemplary descriptions for explaining the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions of the embodiments of the present application.

[0035] Those skilled in the art of the present technology can understand that unless specifically stated otherwise, the singular forms "a", "an", "the" and "said" used herein may also include the plural forms. It should be further understood that the terms "including" and "comprising" used in the embodiments of the present application mean that the corresponding features can be implemented as the presented features, information, data, steps, operations, elements, and / or components, but do not exclude being implemented as other features, information, data, steps, operations, elements, components, and / or their combinations supported by the art of the present technology. It should be understood that when we say an element is "connected" or "coupled" to another element, the one element can be directly connected or coupled to the other element, or it can mean that the one element and the other element establish a connection relationship through an intermediate element. In addition, the "connection" or "coupling" used herein may include a wireless connection or a wireless coupling. The term "and / or" used herein indicates at least one of the items defined by the term, for example, "A and / or B" can be implemented as "A", or implemented as "B", or implemented as "A and B".

[0036] In the embodiments of the present application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works together with other related parts to achieve a predetermined goal, and can be fully or partially implemented by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of the overall module or unit that includes the function of the module or unit.

[0037] To make the purpose, technical solutions, and advantages of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0038] First, several terms related to the present application will be introduced and explained:

[0039] A host, or a host user, refers to a user who performs in a live broadcast service and shares the performance.

[0040] A live broadcast audience is the audience of the performance of the host user in the live broadcast service.

[0041] A data stream is a code stream formed by encoding the video and audio collected by the host user and is suitable for transmission in a network, supporting immediate decoding and playback by the receiving end without waiting to receive all the data.

[0042] A live broadcast room, corresponding to the host user, is an application in the live broadcast platform for the host user to publish different live broadcast services.

[0043] A live broadcast service is the video and / or audio content performed and published by the host user in the live broadcast room. According to the business rules of the live broadcast platform, there are restrictions on the time length, capacity, etc. of the live broadcast service.

[0044] Pushing stream: It refers to the process of transmitting the encapsulated audio and video content in the acquisition stage to the server.

[0045] Pulling stream: It refers to the process of obtaining the encapsulated audio and video content from the server and transmitting it to the client. It is usually used in scenarios such as watching live broadcasts and on-demand videos.

[0046] Pushing stream address: The unified locator (Uniform Resource Locator, URL) used for pushing stream.

[0047] Pulling stream address: The unified locator used for pulling stream.

[0048] Live broadcast connection: Interaction of audio and video between the host and the host, or interaction of audio and video between the host and the audience.

[0049] Pulse Code Modulation (PCM) is the audio information after digital conversion and is also the most primitive audio format. Essentially, it is a series of numerical values after digital conversion of audio signals.

[0050] 3A processing: It is a general term for the three core technologies of audio processing, including Acoustic Echo Cancelling (AEC), Automatic Gain Control (AGC), and Automatic Noise Suppression (ANS).

[0051] Acoustic Echo Cancelling (AEC) means that in two directions of two-wire transmission, the line is occupied simultaneously and with the same spectrum. The signals transmitted in two directions of the line are completely mixed together, and the echo of the local transmitted signal becomes the interference signal of the local signal. An adaptive filter can be used to cancel the echo to achieve better received signal quality. The principle of acoustic echo cancellation is to compare the received audio with the locally collected audio, add an inverted artificial echo, and cancel the sound from the far end.

[0052] Acoustic Noise Suppression (ANS) refers to the process of identifying and eliminating background noise in sound. Background noise is divided into balanced noise and instantaneous noise. The spectrum of steady noise is stable, and the variance of the spectrum energy of instantaneous noise is small. By utilizing the characteristics of noise and adding reverse waveform processing to audio data, the noise can be eliminated.

[0053] Automatic Gain Control (AGC) means that when the repeater operates at the maximum gain and the output is at the maximum power, increasing the input signal level to improve the repeater's ability to control the output signal level. It is mainly used to adjust the volume amplitude and improve the performance of the voice communication system in a noisy environment.

[0054] Moving Picture Experts Group Audio Layer III (MP3) is an audio compression technology. Since the full name of this compression method is MPEG Audio Layer 3, people simply call it MP3.

[0055] Waveform Audio File Format (WAVE), also known as WAV, adopts the Resource Interchange File Format (RIFF) file format structure. It is usually used to store the original audio data in PCM format and is therefore usually referred to as lossless audio. However, strictly speaking, WAV can also store audio data in other compressed formats.

[0056] YUV is a color encoding method, often used in various video processing components. When encoding photos or videos, YUV takes into account the human perception ability and allows reducing the bandwidth of chrominance.

[0057] H.264 is the latest encoding format defined by the MPEG-4 standard and is also one of the video encoding formats with the highest technical content and representing the latest technical level. The H.264 video format is lossy compressed, but technically it tries to achieve better image quality and fast transmission of low-bandwidth images while reducing the storage volume as much as possible.

[0058] The multimedia data transmission method, device, electronic device, computer-readable storage medium, and computer program product provided by the embodiments of this application are intended to solve the above technical problems.

[0059] The technical solutions of the embodiments of this application and the technical effects produced by the technical solutions of this application will be described below through the description of several exemplary embodiments. It should be noted that the following embodiments can be referred to, learned from, or combined with each other. For the same terms, similar features, and similar implementation steps in different embodiments, they will not be described repeatedly.

[0060] Figure 1 This is the system architecture diagram for multimedia data transmission provided by the embodiments of this application. A software for network live broadcast is installed on the first device 101. The user of the first device 101 is the first object, and the first object can be a live streamer. The object watching the first multimedia data provided by the first object is the second object, and the second object can conduct a live connection with the first object. The first device 101 and the server 102 perform multimedia data transmission through a wireless network. The first device 101 uploads the first multimedia data of the first object collected by the collection device 103 to the server 102, and the first device 101 can obtain the second multimedia data of the second object from the server 102 and play the second multimedia data through the playback device 104. Streaming service tools are installed in the collection device 103 and the playback device 104. The collection device 103 can push the first multimedia data, and the playback device 104 can pull the second multimedia data. The collection device 103 and the playback device 104 are not the same device. The first device 101 can be the same device as the collection device 103, and the first device 101 can also be the same device as the playback device 104. The collection device 103 in the embodiments of this application can be a collection device cluster, that is, the first multimedia data can be collected by multiple collection devices, and the playback device 104 can be a playback device cluster, that is, the second multimedia data can be played by multiple playback devices.

[0061] The first device 101, the collection device 103, and the playback device 104 can all be a mobile phone, a tablet computer, a notebook computer, a laptop computer, a desktop computer, etc. The collection device 103 has the function of collecting multimedia data and can perform multimedia data transmission with the server 102 through a wireless network. The playback device 104 has the function of playing multimedia data and can perform multimedia data transmission with the server 102 through a wireless network.

[0062] Optionally, the above-mentioned wireless network or wired network uses standard communication technologies and / or protocols. The network is usually the Internet, but can also be any network, including but not limited to any combination of a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a mobile, wired or wireless network, a private network or a virtual private network). In some embodiments, technologies and / or formats including Hyper Text Mark-up Language (HTML), Extensible Markup Language (XML), etc. are used to represent data exchanged through the network. In addition, conventional encryption technologies such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Network (VPN), Internet Protocol Security (IPsec), etc. can be used to encrypt all or some of the links. In other embodiments, customized and / or dedicated data communication technologies can be used to replace or supplement the above data communication technologies.

[0063] The multimedia data transmission method in the embodiments of this application is completed by a first device. The solutions in the embodiments of this application will be described below.

[0064] An embodiment of this application provides a multimedia data transmission method, as Figure 2 shown, the method includes steps S101, S102, S103, and S104.

[0065] S101. In response to the acquisition device acquiring first multimedia data of a first object, send a first request to the server, where the first request is used to obtain a first streaming address.

[0066] The embodiments of this application can be applied to a live broadcast scenario or an audio and video call scenario. In the live broadcast scenario, the first object can be the anchor who uses the first device to conduct an online live broadcast, or the audience who uses the first device to watch the online live broadcast. In the audio and video call scenario, the first object can be any party participating in the audio and video call. It should be noted that since the application scenarios of this application are all scenarios involving multiple parties, each party in the scenario can transmit multimedia data through the multimedia data transmission method provided in the embodiments of this application.

[0067] In the embodiments of the present application, the multimedia data provided by the first object is the first multimedia data. The multimedia data includes at least one of audio data and video data. The first multimedia data is collected by a collection device. In the embodiments of the present application, the collection device and the first device may be the same device or different devices. If the collection device and the first device are the same device, it means that the collection of the first multimedia data of the first object is also completed by the first device, that is, the first multimedia data does not need to be transmitted across devices from the collection device to the first device. If the collection device and the playback device are different devices, it means that after the audio device collects the first multimedia data, the first multimedia data needs to be transmitted to the first device through a preset method.

[0068] In the embodiments of the present application, the first push stream address is the address in the server for storing the first multimedia data. When the first device is connected to multiple collection devices, when the first device obtains multiple first multimedia data uploaded by the multiple collection devices, it does not need to obtain different first push stream addresses for different collection devices, but encapsulates all the first multimedia data and sends the encapsulated first multimedia data to the first push stream address. That is, in the embodiments of the present application, when pushing multiple first multimedia data, all the first multimedia data is uniformly sent to the same first push stream address, improving the transmission efficiency.

[0069] S102. Obtain the first push stream address and the first multimedia data sent by the server, and upload the first multimedia data as push stream data to the first push stream address.

[0070] After the collection device collects the first multimedia data, the first device sends a first request to the server. The first request is used to obtain the first push stream address. The server may be a network server, which can receive the first request sent by the first device and return the first push stream address to the first device. After the first device receives the first push stream address returned by the server, it uploads the first multimedia data to the first push stream address, that is, the first device uploads the first multimedia data to the server.

[0071] During the live broadcast, after uploading the first multimedia data to the server, the audience can apply to the server through the live broadcast software to pull the first multimedia data, so as to watch the first multimedia data. That is, the first push stream address in the embodiments of the present application is equivalent to a data transfer station provided by the server, facilitating subsequent post-processing of pulling the first multimedia data by other devices.

[0072] In the embodiment of the present application, by uploading the first multimedia data to the first push stream address, real-time transmission of the first multimedia data can be achieved. At the same time, the first push stream address can transmit the first multimedia data to multiple viewers simultaneously, which is applicable to scenarios such as live broadcasts and meetings that require large-scale viewing. And by uploading the first multimedia data to the first push stream address, based on the stability of the server where the first push stream address is located, the stability and reliability of the transmission of the first multimedia data can be guaranteed.

[0073] S103. Send a second request to the server. The second request is used to obtain the first pull stream address, and obtain the first pull stream address sent by the server.

[0074] In the embodiment of the present application, step S103 can be carried out before step S101, can also be carried out after step S101, or can be carried out simultaneously with step S101. The first device has a subscription function, that is, it can send a second request to the server according to the second multimedia data that the first object wants to obtain. The second request is used to request to obtain the first pull stream address of the server. The first pull stream address is the address where the second multimedia data that the first object wants to obtain is stored. After receiving the second request sent by the first device, the server returns the first pull stream address to the first device.

[0075] S104. Obtain the second multimedia data of the second object as the pull stream data from the first pull stream address. The second multimedia data is used for the playback device to play; wherein, the acquisition device and the playback device are different devices.

[0076] In the live broadcast scenario, if the first device is a device on the host side, then the second multimedia data of the second object in the first pull stream address can be the multimedia data uploaded by the viewer side. If the first device is a device on the viewer side, then the second multimedia data of the second object in the first pull stream address can be the multimedia data uploaded by the host side.

[0077] In the audio and video call scenario, the second multimedia data of the second object in the first pull stream address is the multimedia data uploaded by the other call party.

[0078] In the embodiment of the present application, the second object is the object that makes an audio and video call with the first object, or can also be the object that has a joint mic with the first object during the live broadcast. The second multimedia data is the multimedia data provided by the second object. This multimedia data is uploaded by the second object to the server. After the first device receives the first pull stream address returned by the server, it obtains the second multimedia data provided by the second object according to the first pull stream address. The second multimedia data obtained by the first device is played by the playback device.

[0079] In the embodiments of the present application, the playback device and the first device may be the same device or different devices. If the playback device and the first device are the same device, it means that the playback of the second multimedia data of the second object is also completed by the first device, and there is no need to transmit the second multimedia data across devices between the first device and the playback device. If the acquisition device and the first device are different devices, it means that after the first device obtains the second multimedia data, it needs to transmit the second multimedia data to the first device through a preset method.

[0080] In the embodiments of the present application, the first pull stream address is the address for storing the second multimedia data. When the first device is connected to multiple playback devices, the first device obtains the encapsulated second multimedia data according to the first pull stream address. The second multimedia data is unpacked into multiple second multimedia data, and then the multiple playback devices play the second multimedia data correspondingly. That is, the second multimedia data in the embodiments of the present application is obtained through one first pull stream address. That is, when pulling the second multimedia data in the embodiments of the present application, only one first pull stream address needs to be obtained, which improves the transmission efficiency.

[0081] It can be understood that in the process of multimedia data interaction, there is no restriction on the order of the first device sending the first multimedia data and obtaining the second multimedia data.

[0082] In the embodiments of the present application, by sending a first request to the server, the first push stream address is obtained. The first push stream address is equivalent to the first multimedia data transfer station provided by the server. When there are multiple acquisition devices, there are multiple first multimedia data. The first device can upload the multiple first multimedia data provided by the first object to the server through the first push stream address, improving the transmission efficiency of the first multimedia data; by sending a second request to the server, the first pull stream address is obtained. The first pull stream address is equivalent to the transfer station of the second multimedia data provided by the server. When there are multiple playback devices, the first device obtains the multiple second multimedia data provided by the second object according to the first pull stream address, so that the multiple playback devices can play the corresponding second multimedia data; Therefore, the embodiments of the present application realize the interaction of the multimedia data of the first object and the second object. By using different devices to separately execute the acquisition task of the first multimedia data provided by the first object and the playback task of the second multimedia data provided by the second object, the acquisition task and the playback task are reasonably allocated according to the performance advantages of different devices, improving the processing ability of the multimedia data in the acquisition and playback processes.

[0083] Based on the above embodiments, as an optional embodiment, the first device and the acquisition device are not the same device;

[0084] Obtaining the first multimedia data includes:

[0085] S201. Obtain a second pull stream address, where the first multimedia data collected by the acquisition device is stored in the second pull stream address;

[0086] S202. Obtain the first multimedia data from the second pull stream address.

[0087] In the embodiments of the present application, the acquisition device and the first device are not the same device. The acquisition device does not send the first multimedia data to the first device through Bluetooth connection or wired connection. Instead, the acquired first multimedia data is stored in the server so that the first device can obtain the first multimedia data from the second pull stream address. Therefore, the process of cross-device transmission between the acquisition device and the first device is not restricted by distance, has a wider coverage range, and can realize the transmission of multimedia data in different locations.

[0088] In the embodiments of the present application, the first multimedia data is stored in the second pull stream address in the server. After the first device obtains the second pull stream address, it obtains the first multimedia data according to the obtained second pull stream address.

[0089] The first device in the embodiments of the present application can continuously obtain the first multimedia data from the first pull stream address. The first pull stream address can store real-time first multimedia data or pre-collected first multimedia data. Therefore, the first multimedia data obtained by the first device in the present application can be the first multimedia data generated in real time by the acquisition device or the pre-collected first multimedia data. In a live broadcast scenario, the first object can be the host using the first device or the audience who has a joint live video call with the host. When the first object is the host, the first device can obtain the real-time first multimedia data generated by the host, such as the audio data and video data generated in real time by the host, or the first multimedia data pre-collected by the first object and intended to be shown to the audience through the acquisition device.

[0090] In some embodiments, the first multimedia data is encoded by the acquisition device and then uploaded to the first push stream address of the server. For example, the audio data in PCM format is encoded into audio data in MP3 or WAV format, and the video data in YUV or GRB format is converted into video data in H.264 format. The purpose is to compress the first multimedia data, reduce the bandwidth of the first multimedia data during transmission, and improve the transmission efficiency of the first multimedia data.

[0091] When the first device needs to perform output processing on the first multimedia data, the first device first performs decoding processing on the first multimedia data. For example, it decodes audio data in MP3 or WAV format into audio data in PCM format, and decodes video data in H.264 format into video data in YUV format or RGB format. When the first device processes the first multimedia data, it should be understood that this data processing process needs to be performed on the decompressed first multimedia data. Therefore, it is necessary to perform decoding processing on the encoded first multimedia data.

[0092] The data processing on the first multimedia data may include: mixing multiple channels of audio data into one channel of audio data, performing 3A processing, sound effect processing, etc. on the audio data. Among them, the sound effect processing may include voice conversion processing; performing image style conversion processing on the video data.

[0093] After processing the first multimedia data, the first multimedia data is encoded. For example, audio data in PCM format is encoded into audio data in MP3 or WAV format, and video data in YUV or RGB format is encoded into video data in H.264 format. The encoded first audio data is pushed to the first push stream address. When the first device does not need to process the first multimedia data, the first multimedia data obtained from the second pull stream address is directly uploaded to the first push stream address.

[0094] In the embodiment of the present application, by storing the first multimedia data in the second pull stream address of the server, the first device can obtain the first multimedia data according to the second pull stream address, that is, obtain the first multimedia data collected by the acquisition device, realizing the cross-device transmission of the first multimedia data between the acquisition device and the first device. And the present application obtains the first multimedia data in the form of pulling a stream, which has less distance limitation between devices compared with file transmission via Bluetooth. At the same time, in the embodiment of the present application, only a general protocol is required during the process of pulling a stream, and no exclusive protocol within the manufacturer is needed. Therefore, the acquisition device and the first device in the embodiment of the present application can be devices provided by different manufacturers. At the same time, when the embodiment of the present application performs multimedia data transmission, encoding operations are performed on the multimedia data, which can greatly improve the audio transmission speed and reduce the network bandwidth pressure.

[0095] Based on the above embodiments, as an optional embodiment, the first device and the playback device are not the same device; obtaining the second multimedia data of the second object as the pull stream data from the first pull stream address, and then further including:

[0096] Obtaining a second push stream address, and uploading the second multimedia data as the push stream data to the second push stream address, so that the playback device obtains and plays the second multimedia data from the third pull stream address corresponding to the second push stream address;

[0097] In the embodiment of the present application, the first device and the playback device are not the same device, that is, the acquisition device, the first device, and the playback device are not the same device. Since the first device and the playback device are not the same device, after the first device obtains the second multimedia data, it is necessary to perform cross-device transmission of the second multimedia data between the first device and the playback device.

[0098] The first device first obtains the second push stream address of the server, and then uploads the second multimedia data as push stream data to the second push stream address. The server stores the second multimedia data in the second push stream address to the third pull stream address. That is, in the embodiment of the present application, the second push stream address is the push stream address of the second multimedia data, and the third pull stream address is the pull stream address corresponding to the second push stream address for storing the second multimedia data. The second push stream address and the third pull stream address in the embodiment of the present application are equivalent to the data transfer station provided by the server, and the cross-device transmission of the second multimedia data is realized through the second push stream address and the third pull stream address.

[0099] The playback device obtains the second multimedia data from the third pull stream address, and plays the second multimedia data after obtaining it. When the second multimedia data is video data, the playback device plays the second multimedia data including rendering the second multimedia data.

[0100] In some embodiments, the first device can perform data processing on the second multimedia data. After the first device obtains the second multimedia data in the first pull stream address, it can store the second multimedia data in the cache area of the first device. The first device can read the second multimedia data stored in the cache area. The second multimedia data is stored in the first pull stream address after encoding, that is, the second multimedia data obtained by the first device is encoded data. For example, the audio data in PCM format is encoded into audio data in MP3 or WAV format, and the video data in YUV or RGB format is encoded into video data in H.264 format.

[0101] After the first device obtains the second multimedia data, if it needs to perform data processing on the second multimedia data, the first device needs to perform decoding processing on the encoded second multimedia data. For example, decoding the audio data in MP3 or WAV format into audio data in PCM format, decoding the data in H.264 format into YUV format or RGB format. Performing data processing on the second multimedia data may include: performing 3A processing, sound effect processing, etc. on the audio data. The sound effect processing includes voice conversion processing; performing image style conversion processing on the video data.

[0102] After processing the second multimedia data, the second multimedia data is encoded. For example, audio data in PCM format is encoded into audio data in MP3 or WAV format, and video data in YUV or RGB format is encoded into video data in H.264 format. The encoded second audio data is pushed to the second push stream address.

[0103] When the first device does not need to process the second multimedia data, the second multimedia data obtained from the first pull stream address is directly uploaded to the second push stream address.

[0104] In the embodiment of the present application, after the acquisition device obtains the second pull stream address, the encoded second multimedia data is decoded, and the decoded second multimedia data is played.

[0105] In the embodiment of the present application, by uploading the second multimedia data to the second push stream address, the playback device can obtain the second multimedia data from the third pull stream address corresponding to the second push stream address. That is, it realizes collecting the first multimedia data of the first object through the acquisition device and playing the second multimedia data of the second object through the playback device, enabling the first object and the second object to perform multimedia data interaction. At the same time, by uploading the second multimedia data as push stream data to the second push stream address, cross-device transmission of the second multimedia data between the first device and the playback device is achieved. And the embodiment of the present application performs cross-device transmission through the push stream method, which has less distance limitation between devices compared with file transmission via Bluetooth. At the same time, the embodiment of the present application only requires a general protocol during the push stream process and does not require a proprietary protocol within the manufacturer. Therefore, the first device and the playback device in the embodiment of the present application can be devices provided by different manufacturers, that is, the acquisition device, the playback device, and the first device in the embodiment of the present application can be devices provided by different manufacturers, such as at least one of a mobile phone, a tablet computer, and a laptop computer.

[0106] Based on the above embodiments, as an optional embodiment, the first device and the playback device are the same device; after obtaining the second multimedia data as pull stream data from the first pull stream address, it further includes:

[0107] Play the second multimedia data.

[0108] In the embodiment of the present application, the first device and the playback device are the same device, and the acquisition device and the first device are different devices. In this case, after the first device obtains the second multimedia data from the first pull stream address, it can play the second multimedia data. In the embodiment of the present application, the transmission of multimedia data between the first object and the second object is realized through two devices.

[0109] It should be understood that the first device and the playback device are the same device. Therefore, after the first device obtains the second multimedia data from the first pulling stream address, there is no need for cross-device transmission. Thus, the first device in the embodiments of the present application also has the function of playing multimedia data, that is, in the embodiments of the present application, the first multimedia data is collected by the acquisition device and the second multimedia data is played by the first device respectively in the multimedia data transmission process.

[0110] Based on the above embodiments, as an optional embodiment, the acquisition device is further configured to send a third request to the server, where the third request is used to request a third pushing stream address and a second pulling stream address corresponding to the third pushing stream address; the acquisition device is further configured to display the second pulling stream address after obtaining the second pulling stream address, and upload the first multimedia data to the third pushing stream address;

[0111] Obtaining the second pulling stream address includes:

[0112] Obtaining the second pulling stream address displayed by the acquisition device.

[0113] As Figure 3 shown, Figure 3 Exemplarily, a schematic flow diagram of obtaining the second pulling stream address provided by the embodiments of the present application is shown. In the embodiments of the present application, the acquisition device sends a third request to the server so that the server can generate a third pushing stream address and a second pulling stream address. The acquisition device receives the third pushing stream address and the second pulling stream address generated by the server, and displays the third pushing stream address and the second pulling stream address. That is, the acquisition device in the embodiments of the present application has a display interface. The acquisition device uploads the first multimedia data to the third pushing stream address of the server, and the server stores the first multimedia data in the third pushing stream address to the second pulling stream address. The first device obtains the first multimedia data according to the second pulling stream address displayed by the acquisition device.

[0114] In the embodiments of the present application, the third pushing stream address and the second pulling stream address displayed on the acquisition device may be address links of the third pushing stream address and the second pulling stream address. To improve the acquisition of the second multimedia data, the third pushing stream address and the second pulling stream address may also be converted into a QR code form for display.

[0115] In the embodiment of the present application, the acquisition device sends a third request to the server to obtain a third push stream address and a second pull stream address corresponding to the third push stream address. The acquisition device uploads the first multimedia data to the third inference address and displays the second pull stream address. The server stores the first multimedia data at the second pull stream address so that the first device can obtain the first multimedia data according to the second pull stream address. Therefore, the embodiment of the present application realizes cross-device transmission of the first multimedia data between the acquisition device and the first device through the push stream and pull stream method. And only a general protocol needs to be used in this push stream and pull stream process, without using the exclusive protocol of the manufacturer. Therefore, the acquisition device and the first device in the embodiment of the present application can be devices of different manufacturers, and devices with good acquisition capabilities and performance can be more freely selected for the acquisition of the first multimedia data. At the same time, compared with the method of using Bluetooth for transmission, cross-device transmission through the form of push stream and pull stream can utilize the high bandwidth and high speed of the network for multimedia data transmission and support high-definition multimedia data transmission.

[0116] On the basis of the above embodiments, as an alternative embodiment, the first device and the acquisition device are the same device; after obtaining the second multimedia data of the second object as the pull stream data from the first pull stream address, it further includes:

[0117] Obtain a second push stream address, and upload the second multimedia data as the push stream multimedia data to the second push stream address so that the playback device can obtain and play the second multimedia data from the third pull stream address corresponding to the second push stream address;

[0118] Wherein, when the server generates the second push stream address, it also generates a third pull stream address corresponding to the second push stream address.

[0119] In the embodiment of the present application, on the premise that the acquisition device and the playback device are not the same device, the acquisition device and the first device are the same device, that is, the first device and the playback device are not the same device. Therefore, after the acquisition device obtains the second multimedia data of the second object, cross-device transmission needs to be performed with the playback device.

[0120] The first device first obtains the second push stream address of the server, and then uploads the second multimedia data as the push stream data to the second push stream address. The server stores the second multimedia data in the second push stream address at the third pull stream address. That is, the second push stream address in the embodiment of the present application is the push stream address of the second multimedia data, and the third pull stream address is the pull stream address corresponding to the second push stream address for storing the second multimedia data. The second push stream address and the third pull stream address in the embodiment of the present application are equivalent to the transfer station of the second multimedia data provided by the server, realizing cross-device transmission of the second multimedia data.

[0121] The playback device obtains the second multimedia data from the third stream pulling address, and plays the second multimedia data after obtaining it.

[0122] In some embodiments, the first device may perform data processing on the second multimedia data. The second multimedia data is encoded and stored at the first stream pull address, that is, the second multimedia data obtained by the first device is encoded data, for example, audio data in PCM format is encoded into audio data in MP3 or WAV format, and video data in YUV or RGB format is encoded into H.264 video data.

[0123] After the first device obtains the second multimedia data, if data processing is required on the second multimedia data, the first device needs to decode the encoded second multimedia data, for example, decoding audio data in MP3 or WAV format into audio data in PCM format, and decoding data in H.264 format into YUV format or RGB format.

[0124] Data processing of the second multimedia data may include: mixing multiple channels of audio data into one channel of audio data, performing 3A processing, sound effect processing, etc. on the audio data. The sound effect processing may include voice changing processing, and image style conversion processing on the video data. After data processing of the second multimedia data, the second multimedia data is encoded, for example, audio data in PCM format is encoded into audio data in MP3 or WAV format, and video data in YUV or RGB format is encoded into video data in H.264 format. The encoded second audio data is pushed to the second push address. When the first device does not need to perform data processing on the second multimedia data, the second multimedia data obtained from the first pull address is directly uploaded to the second push address.

[0125] In the embodiments of the present application, by uploading the second multimedia data to the second push stream address, the playback device can obtain the second multimedia data from the third pull stream address corresponding to the second push stream address, that is, it realizes collecting the first multimedia data of the first object through the collection device and playing the second multimedia data of the second object through the playback device, enabling the first object and the second object to perform multimedia data interaction. At the same time, by uploading the second multimedia data as push stream data to the second push stream address, cross-device transmission of the second multimedia data between the first device and the playback device is achieved. Moreover, the embodiments of the present application perform cross-device transmission in the form of push streaming, which has less distance limitation between devices compared to file transmission via Bluetooth. Additionally, in the push streaming process of the embodiments of the present application, only a general protocol is required, without the need for a proprietary protocol within the manufacturer. Therefore, the first device and the playback device in the embodiments of the present application can be devices provided by different manufacturers, that is, the collection device, the playback device, and the first device in the embodiments of the present application can be devices provided by different manufacturers, such as at least one of a mobile phone, a tablet computer, and a laptop computer.

[0126] Based on the above embodiments, as an alternative embodiment, obtaining the second push stream address includes:

[0127] S701. Send a fourth request to the server, where the fourth request is used to obtain the second push stream address and the third pull stream address corresponding to the second push stream address;

[0128] S702. Receive the second push stream address and the third pull stream address sent by the server, and display the third pull stream address.

[0129] As Figure 4 shown, Figure 4 exemplarily shows a schematic flow diagram of obtaining the second push stream address provided by the embodiments of the present application. In the embodiments of the present application, the method for obtaining the second push stream address is that the first device sends a fourth request to the server, where the fourth request is used to obtain the second push stream address and the third pull stream address corresponding to the second push stream address. After receiving the fourth request, the server returns the second push stream address and the third pull stream address to the first device.

[0130] The first device receives the second push stream address and the third pull stream address returned by the server, and displays the second push stream address and the third pull stream address. The first device uploads the second multimedia data to the second push stream address, and the playback device obtains the second multimedia data according to the third pull stream address displayed by the first device.

[0131] In an embodiment of the present application, the second multimedia data obtained by the first device from the first pulling address of the server is uploaded to the second pushing address, and the playback device obtains the second multimedia data from the third pulling address corresponding to the second pushing address, so that the playback device can play the second multimedia data. Moreover, in the pushing and pulling process of the embodiment of the present application, only a general protocol needs to be used, and there is no need to use the manufacturer's exclusive protocol. Therefore, the first device and the playback device in the embodiment of the present application can be devices from different manufacturers, and devices with good playback capabilities and performance can be more freely selected for the acquisition of the first multimedia data. At the same time, compared with the method of using Bluetooth for transmission, cross-device transmission through the form of pushing and pulling can utilize the high bandwidth and high speed of the network for multimedia data transmission, supporting the transmission of high-definition multimedia data.

[0132] To more clearly describe the multimedia data transmission method provided by the embodiment of the present application, the following gives a complete embodiment for realizing multimedia data transmission when the acquisition device, the first device, and the playback device are not the same device in the embodiment of the present application, as Figure 5a shown Figure 5a Exemplarily shows another flowchart of the multimedia data transmission method provided by the embodiment of the present application:

[0133] S801. Obtain the second pulling address displayed by the acquisition device;

[0134] S802. Obtain the first multimedia data from the second pulling address, and the first multimedia data is collected by the acquisition device;

[0135] S803. Send a first request to the server to obtain the first pushing address sent by the server;

[0136] S804. Upload the first multimedia data as the pushing data to the first pushing address;

[0137] S901. Send a second request to the server to obtain the first pulling address;

[0138] S902. Obtain the second multimedia data of the second object as the pulling data from the first pulling address;

[0139] S903. Send a fourth request to the server to obtain the third pushing address and the second pulling address corresponding to the third pushing address;

[0140] S904. Upload the second multimedia data to the third pushing address and display the second pulling address, so that the playback device can obtain the second multimedia data according to the second pulling address and play the second multimedia data.

[0141] As Figure 5aAs shown, the embodiments of the present application include a push-streaming process and a pull-streaming process. Among them, steps S801-S804 are the process of pushing the first multimedia data to the first push-streaming address after collecting the first multimedia data, and steps S901-S904 are the process of pulling the second multimedia data from the first pull-streaming address. The push-streaming process and the pull-streaming process in the embodiments of the present application can be carried out simultaneously or not simultaneously. Steps S901-S904 for the second multimedia data can be carried out before steps S801-S804, can be carried out after step S801, or can be carried out simultaneously with step S801.

[0142] The following gives a complete embodiment of realizing multimedia data transmission when the acquisition device provided in the embodiments of the present application is not the same device as the first device, and the first device is the same device as the playback device, as Figure 5b shown Figure 5b Exemplarily shows another flowchart of the multimedia data transmission method provided in the embodiments of the present application:

[0143] S1001. Obtain the second pull-streaming address displayed by the acquisition device;

[0144] S1002. Obtain the first multimedia data from the second pull-streaming address, and the first multimedia data is collected by the acquisition device;

[0145] S1003. Send a first request to the server to obtain the first push-streaming address sent by the server;

[0146] S1004. Upload the first multimedia data as push-streaming data to the first push-streaming address;

[0147] S1101. Send a second request to the server to obtain the first pull-streaming address;

[0148] S1102. Obtain the second multimedia data of the second object as pull-streaming data from the first pull-streaming address;

[0149] S1103. Play the second multimedia data.

[0150] As Figure 5bAs shown in the figure, the embodiment of the present application includes a push stream process and a pull stream process. Among them, steps S1001 - S1004 are the process of pushing the first multimedia data to the first push stream address after collecting the first multimedia data, and steps S1101 - S1103 are the process of pulling the second multimedia data from the first pull stream address. The push stream process and the pull stream process in the embodiment of the present application can be carried out simultaneously or not simultaneously. Steps S1101 - S1103 can be carried out before steps S1001 - S1004, can be carried out after steps S1001 - S1004, or can be carried out simultaneously with steps S1001 - S1004.

[0151] The following gives a complete embodiment of realizing multimedia data transmission when the acquisition device provided by the embodiment of the present application is the same device as the first device and the first device is not the same device as the playback device, as Figure 5c shown Figure 5c Exemplarily shows another flow schematic diagram of the multimedia data transmission method provided by the embodiment of the present application:

[0152] S1201. Collect the first multimedia data;

[0153] S1202. Send a first request to the server to obtain the first push stream address sent by the server;

[0154] S1203. Upload the first multimedia data as push stream data to the first push stream address;

[0155] S1301. Send a second request to the server to obtain the first pull stream address;

[0156] S1302. Obtain the second multimedia data of the second object as pull stream data from the first pull stream address;

[0157] S1303. Send a fourth request to the server to obtain the third push stream address and the second pull stream address corresponding to the third push stream address;

[0158] S1304. Upload the second multimedia data to the third push stream address and display the second pull stream address, so that the playback device can obtain the second multimedia data according to the second pull stream address and play the second multimedia data.

[0159] As Figure 5cAs shown, the embodiment of the present application includes a streaming process and a streaming process. Steps S1201-S1203 are the process of streaming the first multimedia data to the first streaming address after collecting the first multimedia data, and steps S1301-S1304 are the process of streaming the second multimedia data from the first streaming address. The streaming process and the streaming process in the embodiment of the present application can be performed simultaneously or at different times. Steps S1301-S1304 can be performed before steps S1201-S1203, after steps S1201-S1203, or simultaneously with steps S1201-S1203.

[0160] In addition, if Figure 6a As shown, Figure 6a The flowchart of the first multimedia data transmission provided by the embodiment of the present application is shown as an example. In the embodiment of the present application, the acquisition device 103 and the first device 101 are different devices. Figure 6a As shown, the acquisition device acquires the first multimedia data and sends a third request to the server 102. After receiving the third request, the server sends a third push stream address and a second pull stream address to the acquisition device. The acquisition device receives and displays the third push stream address and the second pull stream address, uploads the first multimedia data to the third push stream address, and the server stores the first multimedia data to the second pull stream address. The first device obtains the second pull stream address displayed by the acquisition device from the display interface of the acquisition device, obtains the first multimedia data according to the second pull stream address, and uploads the multimedia data to the first push stream address.

[0161] like Figure 6b As shown, Figure 6b A flow chart of the transmission of a second multimedia data is provided for an embodiment of the present application. In the embodiment of the present application, the first device 101 and the playback device 104 are different devices. The first device obtains the second multimedia data from the first streaming address and sends a fourth request to the server 102. After receiving the fourth request, the server sends the second push streaming address and the third streaming address to the first device. The first device receives and displays the second push streaming address and the third streaming address, and uploads the second multimedia data to the second push streaming address. The server stores the second multimedia data to the third streaming address. The playback device obtains the third streaming address displayed by the first device according to the display interface of the first device, obtains the second multimedia data according to the third streaming address, and plays the second multimedia data.

[0162] In addition, if Figure 6c As shown, Figure 6cExemplarily shown is another schematic flow diagram of second multimedia data transmission provided by an embodiment of the present application. In the embodiment of the present application, the playback device and the first device are the same device. The first device obtains the second multimedia data from the first pulling stream address and then plays the second multimedia data.

[0163] As Figure 6d shown, Figure 6d is another schematic flow diagram of first multimedia data transmission provided by an embodiment of the present application. In the embodiment of the present application, the first device and the acquisition device are the same device. The first device acquires the first multimedia data and uploads the first multimedia data to the first pushing stream address.

[0164] As Figure 7 shown, Figure 7 is an application scenario diagram of multimedia data transmission provided by an embodiment of the present application. When the anchor conducts a live broadcast, the devices on the anchor side include the first device 101, the server 102, the audio acquisition device 103a, the video acquisition device 103b, the audio playback device 104a, and the video playback device 104b. The multimedia data is audio data and video data. Among them, the audio acquisition device 103a includes an audio acquisition module, an audio encoding module, and an audio pushing stream module. The video acquisition device 103b includes a video acquisition module, a video encoding module, and a video inference module. The audio playback device 104a includes an audio pulling stream module, an audio decoding module, and an audio playback module. The video playback device 104b includes a video pulling stream module, a video decoding module, and a video playback module.

[0165] The audio acquisition device 103a is responsible for acquiring audio data. Specifically, the audio acquisition device 103a acquires the audio data that the anchor wants to show to the audience through the audio acquisition module, performs an encoding operation on the audio data through the audio encoding module, and uploads the encoded audio data to the server 102 through the audio pushing stream module;

[0166] The video acquisition device 103b is responsible for acquiring video data. Specifically, the video acquisition device 103a acquires the video data that the anchor wants to show to the audience through the video acquisition module, performs an encoding operation on the video data through the video encoding module, and uploads the encoded video data to the server 102 through the video pushing stream module;

[0167] The first device 101 acquires the audio data uploaded by the acquisition device 103a from the server 102 through the audio pulling stream module, performs a decoding operation on the audio data through the audio decoding module, performs a data processing on the audio data through the audio data processing module, performs an encoding operation on the audio data after data processing through the audio encoding module, and uploads the encoded audio data to the server 102 through the audio pushing stream module;

[0168] The first device 101 obtains the video data uploaded by the acquisition device 103b from the server 102 through the video streaming pulling module, performs decoding operations on the video data through the video decoding module, performs data processing on the video data through the video data processing module, performs encoding operations on the video data after data processing through the video encoding module, and uploads the encoded video data to the server 102 through the video streaming pushing module;

[0169] Before the first device 101 uploads the audio data and video data to the server 102, it is necessary to perform encapsulation processing on the audio data and video data

[0170] The first device 101 is also responsible for obtaining the audio data uploaded by the audience during the live video call from the server 102 through the audio streaming pulling module, performing decoding operations on the audio data through the audio decoding module, performing data processing on the audio data through the audio data processing module, performing encoding operations on the audio data after data processing through the audio encoding module, and uploading the encoded audio data to the server 102 through the audio streaming pushing module;

[0171] The first device 101 is also responsible for obtaining the audio data uploaded by the audience during the live video call from the server 102 through the audio streaming pulling module, performing decoding operations on the audio data through the audio decoding module, performing data processing on the audio data through the audio data processing module, performing encoding operations on the audio data after data processing through the audio encoding module, and uploading the encoded audio data to the server 102 through the audio streaming pushing module;

[0172] When the first device 101 pulls the audio data and video data of the audience, it can perform de-encapsulation processing on the audio-visual data of the audience side

[0173] The audio playback device 104a is responsible for playing the audio data of the audience. Specifically, it obtains the audio data from the server 102 through the audio streaming pulling module, performs decoding operations on the audio data through the audio decoding module, and plays the decoded audio data through the audio playback module;

[0174] The video playback device 104b is responsible for playing the video data of the audience. Specifically, it obtains the video data from the server 102 through the video streaming pulling module, performs decoding operations on the video data through the video decoding module, and plays the decoded video data through the video playback module.

[0175] The embodiment of the present application provides a multimedia data transmission device, as Figure 8 shown, the multimedia data transmission device may include: a first sending module 801, a first obtaining module 802, a second sending module 803, and a second obtaining module 804, wherein,

[0176] The first sending module 801 is configured to send a first request to a server in response to a capture device capturing first multimedia data of a first object, wherein the first request is used to obtain a first streaming address.

[0177] The first acquisition module 802 acquires a first streaming address and first multimedia data sent by the server, and uploads the first multimedia data as streaming data to the first streaming address.

[0178] The second sending module 803 is configured to send a second request to the server, where the second request is used to obtain the first stream pulling address, and obtain the first stream pulling address sent by the server.

[0179] The second acquisition module 804 acquires second multimedia data as a second object of the stream data from the first stream address, and the second multimedia data is used for playback by a playback device; wherein the acquisition device and the playback device are different devices.

[0180] In an alternative embodiment, an electronic device is provided, such as Figure 9 As shown, Figure 9 The electronic device 4000 shown includes: a processor 4001 and a memory 4003. The processor 4001 and the memory 4003 are connected, for example, via a bus 4002. Optionally, the electronic device 4000 may further include a transceiver 4004, which may be used for data exchange between the electronic device and other electronic devices, such as data transmission and / or data reception. It should be noted that in actual applications, the number of transceivers 4004 is not limited to one, and the structure of the electronic device 4000 does not constitute a limitation on the embodiments of the present application.

[0181] Processor 4001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 4001 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0182] Bus 4002 may include a path for transmitting information between the above components. Bus 4002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. Bus 4002 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 9 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0183] The memory 4003 may be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media, other magnetic storage devices, or any other medium that can be used to carry or store computer programs and can be read by a computer, without limitation herein.

[0184] The memory 4003 is used to store the computer program for executing the embodiment of the present application, and the execution is controlled by the processor 4001. The processor 4001 is used to execute the computer program stored in the memory 4003 to implement the steps shown in the above method embodiment.

[0185] Among them, the electronic equipment package may include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., as well as fixed terminals such as digital TVs, desktop computers, etc. Figure 9 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0186] An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps and corresponding content of the foregoing method embodiment can be implemented. Compared with the prior art, it can be achieved that: by sending a first request to the server, a first push stream address is obtained. This first push stream address is equivalent to a first multimedia data transfer station provided by the server. When there are multiple acquisition devices, there are multiple first multimedia data. The first device can upload the multiple first multimedia data provided by the first object to the server through this first push stream address, improving the transmission efficiency of the first multimedia data; by sending a second request to the server, a first pull stream address is obtained. This first pull stream address is equivalent to a transfer station for the second multimedia data provided by the server. When there are multiple playback devices, the first device obtains the multiple second multimedia data provided by the second object according to this first pull stream address, so that the multiple playback devices can play the corresponding second multimedia data; Therefore, the embodiment of the present application realizes the interaction of the multimedia data of the first object and the second object. By using different devices to separately execute the acquisition task of the first multimedia data provided by the first object and the playback task of the second multimedia data provided by the second object, the acquisition task and the playback task are reasonably allocated according to the performance advantages of different devices, improving the processing ability of multimedia data during the acquisition and playback processes.

[0187] It should be noted that the above-mentioned computer-readable medium in the present disclosure can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, and this computer-readable signal medium can send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on a computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0188] The embodiments of the present application also provide a computer program product, including a computer program, which can implement the steps and corresponding contents of the foregoing method embodiments when executed by a processor. Compared with the prior art, the following can be achieved: by sending a first request to the server, a first push stream address is obtained. This first push stream address is equivalent to the first multimedia data transfer station provided by the server. When there are multiple acquisition devices, there are multiple first multimedia data. The first device can upload the multiple first multimedia data provided by the first object to the server through this first push stream address, improving the transmission efficiency of the first multimedia data; by sending a second request to the server, a first pull stream address is obtained. This first pull stream address is equivalent to the transfer station of the second multimedia data provided by the server segment. When there are multiple playback devices, the first device obtains the multiple second multimedia data provided by the second object according to this first pull stream address, so that the multiple playback devices can play the corresponding second multimedia data; Therefore, the embodiments of the present application realize the interaction of the multimedia data of the first object and the second object. By using different devices to separately execute the acquisition task of the first multimedia data provided by the first object and the playback task of the second multimedia data provided by the second object, the acquisition task and the playback task are reasonably allocated according to the performance advantages of different devices, improving the processing ability of the multimedia data in the acquisition and playback processes.

[0189] The terms "first", "second", "third", "fourth", "1", "2", etc. (if any) in the specification, claims and above-mentioned drawings of the present application are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application described here can be implemented in an order other than that shown or described in words.

[0190] It should be understood that although the flowchart of the embodiments of the present application indicates each operation step by an arrow, the execution order of these steps is not limited to the order indicated by the arrow. Unless there is a clear description in this article, in some implementation scenarios of the embodiments of the present application, the implementation steps in each flowchart can be executed in other orders according to requirements. In addition, some or all of the steps in each flowchart may include multiple sub-steps or multiple stages based on the actual implementation scenario. Some or all of these sub-steps or stages can be executed at the same time, and each sub-step or stage in these sub-steps or stages can also be executed at different times respectively. In the scenario where the execution times are different, the execution order of these sub-steps or stages can be flexibly configured according to requirements, and the embodiments of the present application do not limit this.

[0191] The above are only optional implementation manners of some implementation scenarios of the present application. It should be noted that for those of ordinary skill in the art, without departing from the technical concept of the solution of the present application, adopting other similar implementation means based on the technical idea of the present application also belongs to the protection scope of the embodiments of the present application.

Claims

1. A multimedia data transmission method, characterized in that, The method is executed by a first device, and the method includes: In response to the acquisition device acquiring first multimedia data of a first object, sending a first request to a server, where the first request is used to obtain a first push stream address; Obtaining the first push stream address and the first multimedia data sent by the server, and uploading the first multimedia data as push stream data to the first push stream address; Sending a second request to the server, where the second request is used to obtain a first pull stream address, and obtaining the first pull stream address sent by the server; Obtaining second multimedia data of a second object as pull stream data from the first pull stream address, where the second multimedia data is used for a playback device to play; where the acquisition device and the playback device are different devices.

2. The method according to claim 1, characterized in that The first device and the acquisition device are not the same device; Obtaining the first multimedia data includes: Obtaining a second pull stream address, where the second pull stream address stores the first multimedia data collected by the acquisition device; Obtaining the first multimedia data from the second pull stream address.

3. The method according to claim 2, wherein The first device and the playback device are not the same device; After obtaining the second multimedia data of the second object as pull stream data from the first pull stream address, further includes: Obtaining a second push stream address, and uploading the second multimedia data as push stream data to the second push stream address, so that the playback device obtains and plays the second multimedia data from a third pull stream address corresponding to the second push stream address.

4. The method according to claim 2, characterized in that, The first device and the playback device are the same device; After obtaining the second multimedia data as pull stream data from the first pull stream address, further includes: Playing the second multimedia data.

5. The method according to claim 4, wherein The acquisition device is further configured to send a third request to the server, where the third request is used to request a third push stream address and the second pull stream address corresponding to the third push stream address; the acquisition device is further configured to display the second pull stream address after obtaining the second pull stream address, and upload the first multimedia data to the third push stream address; Obtaining the second pull stream address includes: Obtaining the second pull stream address displayed by the acquisition device.

6. The method according to claim 1, characterized in that, The first device and the acquisition device are the same device; After obtaining the second multimedia data of the second object as pull stream data from the first pull stream address, further includes: Obtaining a second push stream address, and uploading the second multimedia data as push stream multimedia data to the second push stream address, so that the playback device obtains and plays the second multimedia data from a third pull stream address corresponding to the second push stream address.

7. The method according to claim 3 or 6, characterized in that Obtaining the second push stream address includes: Sending a fourth request to the server, where the fourth request is used to obtain the second push stream address and the third pull stream address corresponding to the second push stream address; Receiving the second push stream address and the third pull stream address sent by the server, and displaying the third pull stream address.

8. A multimedia data transmission device, characterized in that, The apparatus is applied to a first device, and the apparatus includes: A first sending module, configured to send a first request to a server in response to the acquisition device acquiring first multimedia data of a first object, where the first request is used to obtain a first streaming address; A first obtaining module, obtains the first streaming address and the first multimedia data sent by the server, and uploads the first multimedia data as streaming data to the first streaming address; A second sending module, configured to send a second request to the server, where the second request is used to obtain a first pulling address, and obtains the first pulling address sent by the server; A second obtaining module, obtains second multimedia data of a second object as pulling data from the first pulling address, where the second multimedia data is used for a playback device to play; where the acquisition device and the playback device are different devices.

9. An electronic device, comprising a memory, a processor, and a computer program stored on the memory, characterized in that, The processor executes the computer program to implement the steps of the method according to any one of claims 1-7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, the method according to any one of claims 1-7 is implemented.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, the method according to any one of claims 1-7 is implemented.

Images