Collaborative playing method and terminal based on multimedia copyright

Abstract

The invention provides a collaborative playing method based on multimedia copyright and a terminal. The method comprises the following steps: after a first terminal receives first indication information from a second terminal, carrying out equipment playing copyright identification on at least one multimedia identifier contained in a multimedia information list to be played indicated by the first indication information, and when the first terminal has the equipment playing copyright of the first multimedia identifier, carrying out equipment playing copyright identification on at least one multimedia identifier contained in the multimedia information list to be played; according to the method, the multimedia file corresponding to the first multimedia identifier can be downloaded from the service equipment, the multimedia file is played, when the first terminal does not have the equipment playing copyright of the first multimedia identifier, the second indication information can be sent to the second terminal, and the multimedia data stream corresponding to the first multimedia identifier from the second terminal is received. And playing the multimedia data stream. Therefore, the method can realize that the first terminal independently plays the multimedia file corresponding to the multimedia identifier with the equipment playing copyright, and can bring non-perceptual multi-terminal collaborative playing experience to a user.

Description

[0001] This application is a divisional application. The application number of the original application is 202211679660.8, and the original application date is December 26, 2022. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of communication technology, and in particular to a collaborative playback method and terminal based on multimedia copyright. Background Art

[0003] With the rapid development of science and technology and the improvement of people's living standards, more and more people are beginning to use multimedia services (such as listening to music) to enrich their spiritual lives. For example, taking a user using multimedia services at home as an example, in order to improve the user's experience of using multimedia services at home, the user's terminal (such as a smart phone) can use multimedia collaborative playback to play the multimedia data to be played in the terminal through another terminal (such as a speaker).

[0004] At present, there are mainly the following solutions for multi-terminal collaborative multimedia playback.

[0005] Solution 1: A terminal (such as terminal A) and another terminal (such as terminal B) realize the collaborative playback of multimedia data through the Bluetooth protocol or the mirroring screen projection protocol. For example, taking the communication protocol as the Bluetooth protocol, in the collaborative playback implementation process, first, terminal A and terminal B establish a Bluetooth communication link through the Bluetooth protocol, and then terminal A transmits the multimedia data to be played in terminal A (such as the audio stream of a song) to terminal B for playback through the Bluetooth communication link.

[0006] However, the above solution 1 needs to rely on the playback source of terminal A when implementing Bluetooth playback or mirrored screen playback, and terminal B cannot play multimedia data independently. At the same time, terminal A needs to transcode multimedia data before transmitting it, which damages the details of the multimedia data and affects the playback experience.

[0007] Solution 2: A terminal (such as terminal A) and another terminal (such as terminal B) realize the collaborative playback of multimedia data through the Digital Living Network Alliance (DLNA) screen projection protocol. In the collaborative playback implementation process, first, terminal A and terminal B establish a DLNA screen projection communication link through the DLNA screen projection protocol, and then terminal A transmits the multimedia data to be played in terminal A (such as the audio stream of a song) to terminal B for playback through the DLNA screen projection communication link.

[0008] However, in the above solution 2, terminal B needs to rely on terminal A to transmit the multimedia data to be played in order to independently play the multimedia data. At the same time, terminal A and terminal B need to support the DLNA screen projection protocol at the same time. Summary of the invention

[0009] The embodiments of the present application provide a collaborative playback method and terminal based on multimedia copyright, so as to solve the problem in the prior art that the terminal as the collaborative playback side cannot automatically and independently play multimedia data.

[0010] In the first aspect, the embodiment of the present application provides a collaborative playback method based on multimedia copyright, which can be executed by a first terminal or a component (such as a chip system or circuit, etc.) that can support the first terminal to implement the functions required by the method. Optionally, taking the first terminal executing the collaborative playback method based on multimedia copyright as an example, in the method, after receiving the first indication information from the second terminal, the first terminal can identify the device playback copyright of at least one multimedia identifier included in the list of multimedia information to be played indicated by the first indication information; when the first terminal has the device playback copyright of the first multimedia identifier, the first terminal can download the multimedia file corresponding to the first multimedia identifier from the service device and play the multimedia file, wherein the first multimedia identifier is any one of the at least one multimedia identifier; when the first terminal does not have the device playback copyright of the first multimedia identifier, the first terminal can send a second indication information to the second terminal and receive the multimedia data stream corresponding to the first multimedia identifier from the second terminal; thereafter, the first terminal plays the multimedia data stream, wherein the second indication information is used to indicate that the first terminal does not have the device playback copyright of the first multimedia identifier.

[0011] In the above design, the first terminal can determine which multimedia identifiers the first terminal has the device playback copyright and which multimedia identifiers the first terminal does not have the device playback copyright by identifying the device playback copyright of at least one multimedia identifier included in the multimedia information list to be played. For multimedia identifiers for which the first terminal has the device playback copyright, the first terminal can independently download the multimedia file corresponding to the multimedia identifier from the service device for playback, so that the first terminal can independently play the multimedia file corresponding to the multimedia identifier with the device playback copyright, which can effectively reduce the loss of transcoding details during the transmission of multimedia data, thereby improving the playback experience of multimedia data. For multimedia identifiers for which the first terminal does not have the device playback copyright, the first terminal can promptly send the second indication information to the second terminal so that the second terminal can promptly transmit the multimedia data stream corresponding to the multimedia identifier to the first terminal for playback, so that the multi-terminals can automatically and collaboratively play the multimedia content corresponding to the multimedia identifier for which a certain terminal (such as the first terminal) does not have the device playback copyright, thereby providing users with an imperceptible multi-terminal collaborative playback experience.

[0012] In one possible design, the method further includes:

[0013] The first terminal may first obtain device copyright support information of the first multimedia identifier;

[0014] When it is determined according to the device copyright support information of the first multimedia identifier that the device type of the first terminal exists in at least one device type authorized for playback by the first multimedia identifier, the first terminal may determine that the first terminal has the device playback copyright of the first multimedia identifier; or

[0015] When it is determined according to the device copyright support information of the first multimedia identifier that the device type of the first terminal does not exist in at least one device type authorized for playback by the first multimedia identifier, the first terminal may determine that the first terminal does not have the device playback copyright of the first multimedia identifier.

[0016] In the above design, the first terminal can timely and accurately determine whether the first terminal has the device playback copyright of the first multimedia identifier based on the device copyright support information of the first multimedia identifier.

[0017] Optionally, in one example, the first terminal may also obtain the result of device playback copyright identification for the first multimedia identifier through the cloud or other devices. This can reduce the computational pressure on the first terminal to identify the device playback copyright support information for the first multimedia identifier, and help reduce the computing resource consumption generated by identifying the device playback copyright support information for the first terminal with the first multimedia identifier.

[0018] In one possible design, a first terminal receives a multimedia data stream from a second terminal, including:

[0019] The first terminal may receive the multimedia data stream from the second terminal through a communication link corresponding to a target collaborative playback mode negotiated between the first terminal and the second terminal, wherein the target collaborative playback mode is used to indicate a collaborative playback mode corresponding to the first multimedia identifier.

[0020] In the above design, when the first terminal does not have the device playback copyright of the first multimedia identifier, the first terminal can automatically negotiate with the second terminal for a target collaborative playback mode for playing the multimedia content corresponding to the first multimedia identifier for which the first terminal does not have the device playback copyright, thereby enabling the second terminal to transmit the multimedia data stream corresponding to the first multimedia identifier to the first terminal for playback via a communication link corresponding to the target collaborative playback mode established between the first terminal and the second terminal.

[0021] In a possible design, the target collaborative playback mode may be selected by the second terminal and the first terminal through negotiation from at least one collaborative playback mode that they share.

[0022] In the above design, the first terminal and the second terminal can negotiate to select a collaborative playback mode as the target collaborative playback mode from at least one collaborative playback mode supported by both the first terminal and the second terminal, so that the first terminal and the second terminal can effectively complete the collaborative playback of multimedia content corresponding to the multimedia identifier for which the first terminal does not have the device playback copyright.

[0023] In a possible design, when the first terminal negotiates with the second terminal to select a target collaborative playback mode, the target collaborative playback mode may be any one of the at least one collaborative playback modes randomly selected; or

[0024] The target collaborative playback mode may be a collaborative playback mode with the highest priority among the at least one collaborative playback mode.

[0025] In the above design, the implementation method of selecting the target collaborative playback mode is flexible and diverse, which can meet the application requirements of different application scenarios. For example, the first terminal and the second terminal can select the target collaborative playback mode in two possible implementation methods through negotiation. One possible implementation method is to randomly select a collaborative playback mode as the target collaborative playback mode from at least one collaborative playback mode supported by both the first terminal and the second terminal. Another possible implementation method is to select the collaborative playback mode with the highest priority as the target collaborative playback mode from at least one collaborative playback mode supported by both the first terminal and the second terminal.

[0026] In a possible design, the target collaborative playback mode may be one of the following collaborative playback modes: Bluetooth playback mode, mirror screen playback mode, DLNA screen playback mode or streaming playback mode.

[0027] In the above design, the collaborative playback mode is diverse, which can meet the different usage requirements of the terminals, and is helpful for the first terminal and the second terminal to negotiate a collaborative playback mode that meets the requirements of both parties as the target collaborative playback mode.

[0028] In a possible design, the first terminal sends second indication information to the second terminal, including:

[0029] When it is detected that the remaining playback time of the multimedia file or multimedia data stream corresponding to the second multimedia identifier is less than or equal to the time threshold, the first terminal may generate second indication information, and then the first terminal may send the second indication information to the second terminal.

[0030] The second multimedia identifier is a multimedia identifier that is located before the first multimedia identifier in the multimedia information list in the playback order. For example, the second multimedia identifier is located before the first multimedia identifier and is adjacent to the first multimedia identifier.

[0031] In the above design, when the first terminal does not have the device playback copyright of the first multimedia identifier, if the playback order of the first multimedia identifier is not at the starting position, the first terminal detects that the remaining playback time of the multimedia file or multimedia data stream corresponding to the second multimedia identifier whose playback order is before the first multimedia identifier in the multimedia information list is less than or equal to the duration threshold, and a second indication information can be generated and sent to the second terminal in a timely manner, so that the second terminal can promptly determine the device playback copyright support information of the first multimedia identifier for the second terminal, thereby facilitating the second terminal to negotiate with the first terminal in a timely and effective manner for the target collaborative playback mode for playing the multimedia content corresponding to the first multimedia identifier, thereby achieving automatic collaborative playback between multiple terminals of the multimedia content corresponding to the multimedia identifier for which a certain terminal (such as the first terminal) does not have the device playback copyright, and can bring an imperceptible playback experience to the user to whom the terminal belongs.

[0032] Optionally, when the first terminal does not have the device playback copyright of the first multimedia identifier, if the playback sequence of the first multimedia identifier is at the start position, the first terminal may directly generate the second indication information and send the second indication information to the second terminal.

[0033] In the second aspect, the embodiment of the present application provides a collaborative playback method based on multimedia copyright, which can be executed by a second terminal or a component (such as a chip system or circuit, etc.) that can support the second terminal to implement the functions required by the method. Optionally, taking the second terminal executing the collaborative playback method based on multimedia copyright as an example, in this method, when the second terminal receives the collaborative playback instruction issued by the user, it can send a first indication message to the first terminal, wherein the collaborative playback instruction is used to instruct the first terminal and the second terminal to collaboratively play the multimedia to be played in the second terminal through data interaction; the first indication message is used to indicate a list of multimedia information to be played in the second terminal, and the multimedia information list includes at least one multimedia identifier, and at least one multimedia identifier includes a first multimedia identifier. Then, when the second terminal receives the second indication message from the first terminal, it sends the multimedia data stream corresponding to the first multimedia identifier to the first terminal. Optionally, the second indication message can be used to indicate that the first terminal does not have the device playback copyright of the first multimedia identifier, or the second indication message can also carry the first multimedia identifier.

[0034] In the above design, during the process of the first terminal and the second terminal cooperating to play the multimedia to be played in the second terminal, for the multimedia identifier of the first terminal having the device playback copyright, the first terminal can independently play the multimedia file corresponding to the multimedia identifier, so that the first terminal can independently play the multimedia file corresponding to the multimedia identifier with the device playback copyright, which can effectively reduce the loss of transcoding details during the transmission of multimedia data, thereby improving the playback experience of multimedia data. For the multimedia identifier of the first terminal that does not have the device playback copyright, the first terminal needs to feed back the multimedia identifier to the second terminal, and then the second terminal transmits the multimedia data stream corresponding to the multimedia identifier to the first terminal for playback, so that the automatic cooperative playback of multimedia content corresponding to the multimedia identifier of a certain terminal (such as the first terminal) that does not have the device playback copyright can be achieved between multiple terminals, and the user to whom the terminal belongs can be given an imperceptible playback experience.

[0035] In one possible design, the second indication information may be generated by the first terminal when it detects that the remaining playback time of the multimedia file or multimedia data stream corresponding to the second multimedia identifier is less than or equal to the duration threshold, wherein the second multimedia identifier is a multimedia identifier whose playback order in the multimedia information list is before the first multimedia identifier.

[0036] In the above design, when the first terminal does not have the device playback copyright of the first multimedia identifier, if the playback order of the first multimedia identifier is not at the starting position, the first terminal detects that the remaining playback time of the multimedia file or multimedia data stream corresponding to the second multimedia identifier whose playback order is before the first multimedia identifier in the multimedia information list is less than or equal to the duration threshold, and a second indication information can be generated and sent to the second terminal in a timely manner, so that the second terminal can promptly determine the device playback copyright support information of the first multimedia identifier for the second terminal, thereby facilitating the second terminal to negotiate with the first terminal in a timely and effective manner for the target collaborative playback mode for playing the multimedia content corresponding to the first multimedia identifier, thereby achieving automatic collaborative playback between multiple terminals of the multimedia content corresponding to the multimedia identifier for which a certain terminal (such as the first terminal) does not have the device playback copyright, and can bring an imperceptible playback experience to the user to whom the terminal belongs.

[0037] Optionally, when the first terminal does not have the device playback copyright of the first multimedia identifier, if the playback sequence of the first multimedia identifier is at the start position, the first terminal may directly generate the second indication information and send the second indication information to the second terminal.

[0038] In one possible design, the second terminal sends a multimedia data stream corresponding to the first multimedia identifier to the first terminal, including:

[0039] The second terminal may negotiate with the first terminal about the target collaborative playback mode corresponding to the first multimedia identifier. After that, the second terminal may establish a communication link corresponding to the target collaborative playback mode with the first terminal, and then the second terminal may send the multimedia data stream corresponding to the first multimedia identifier to the first terminal through the communication link corresponding to the target collaborative playback mode.

[0040] In the above design, when the first terminal does not have the device playback copyright of the first multimedia identifier, the first terminal can automatically negotiate with the second terminal for a target collaborative playback mode for playing the multimedia content corresponding to the first multimedia identifier for which the first terminal does not have the device playback copyright, thereby enabling the second terminal to transmit the multimedia data stream corresponding to the first multimedia identifier to the first terminal for playback via a communication link corresponding to the target collaborative playback mode established between the first terminal and the second terminal.

[0041] In a possible design, the target collaborative playback mode may be selected by the second terminal and the first terminal through negotiation from at least one collaborative playback mode that they share.

[0042] In the above design, the first terminal and the second terminal can negotiate to select a collaborative playback mode as the target collaborative playback mode from at least one collaborative playback mode supported by both the first terminal and the second terminal, so that the first terminal and the second terminal can effectively complete the collaborative playback of multimedia content corresponding to the multimedia identifier for which the first terminal does not have the device playback copyright.

[0043] In a possible design, when the first terminal negotiates with the second terminal to select a target collaborative playback mode, the target collaborative playback mode may be any one of the at least one collaborative playback modes randomly selected; or

[0044] The target collaborative playback mode may be a collaborative playback mode with the highest priority among the at least one collaborative playback mode.

[0045] In the above design, the implementation method of selecting the target collaborative playback mode is flexible and diverse, which can meet the application requirements of different application scenarios. For example, the first terminal and the second terminal can select the target collaborative playback mode in two possible implementation methods through negotiation. One possible implementation method is to randomly select a collaborative playback mode as the target collaborative playback mode from at least one collaborative playback mode supported by both the first terminal and the second terminal. Another possible implementation method is to select the collaborative playback mode with the highest priority as the target collaborative playback mode from at least one collaborative playback mode supported by both the first terminal and the second terminal.

[0046] In a possible design, the target collaborative playback mode may be one of the following collaborative playback modes: Bluetooth playback mode, mirror screen playback mode, DLNA screen playback mode or streaming playback mode.

[0047] In the above design, the collaborative playback mode is diverse, which can meet the different usage requirements of the terminals, and is helpful for the first terminal and the second terminal to negotiate a collaborative playback mode that meets the requirements of both parties as the target collaborative playback mode.

[0048] In a third aspect, an embodiment of the present application provides a first terminal, and the beneficial effects can be found in the description of the first aspect, which will not be repeated here. The first terminal has the function of implementing the behavior in the method example of the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In a possible design, the first terminal includes a first transceiver module and a first processing module. The first transceiver module is used to receive a first indication message from a second terminal, wherein the first indication message is used to indicate a list of multimedia information to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The first processing module is used to download a multimedia file corresponding to the first multimedia identifier from a service device and play the multimedia file when the first terminal has a device playback copyright of the first multimedia identifier; or when the first terminal does not have a device playback copyright of the first multimedia identifier, send a second indication message to the second terminal, receive a multimedia data stream corresponding to the first multimedia identifier from the second terminal, and play a media data stream from the second terminal, wherein the second indication message is used to indicate that the first terminal does not have a device playback copyright of the first multimedia identifier. These modules can execute any corresponding function in the design that may be implemented in the first aspect mentioned above. Please refer to the detailed description in the method example for details, which will not be repeated here.

[0049] In a fourth aspect, an embodiment of the present application provides a first terminal, the first terminal including a first communication interface and a first processor. Optionally, the first terminal also includes a first memory. The first memory is used to store a computer program or instruction, and the first processor is coupled to the first memory and the first communication interface. When the first processor executes the computer program or instruction, the first terminal executes the method in any possible design of the first aspect.

[0050] In a fifth aspect, an embodiment of the present application provides a second terminal, and the beneficial effects can be found in the description of the second aspect, which will not be repeated here. The second terminal has the function of implementing the behavior in the method example of the second aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions. In a possible design, the second terminal includes a second transceiver module and a second processing module. The second transceiver module is used to receive a collaborative playback instruction issued by a user, wherein the collaborative playback instruction is used to instruct the first terminal and the second terminal to collaboratively play the multimedia to be played in the second terminal through data interaction. The second processing module is used to send a first indication message to the first terminal according to the collaborative playback instruction, wherein the first indication message is used to indicate a list of multimedia information to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The second processing module is also used to send a multimedia data stream corresponding to the first multimedia identifier to the first terminal when receiving a second indication message from the first terminal, wherein the second indication message is used to indicate that the first terminal does not have the device playback copyright of the first multimedia identifier. These modules can perform the corresponding functions in any possible implementation design of the second aspect above, and refer to the detailed description in the method example for details, which will not be repeated here.

[0051] In a sixth aspect, an embodiment of the present application provides a second terminal, wherein the second terminal includes a second communication interface and a second processor. Optionally, the second terminal also includes a second memory. The second memory is used to store a computer program or instruction, and the second processor is coupled to the second memory and the second communication interface. When the second processor executes the computer program or instruction, the second terminal executes the method in any possible design of the second aspect.

[0052] In the seventh aspect, an embodiment of the present application provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer executes a method in any possible design of the first aspect or a method in any possible design of the second aspect.

[0053] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program or instructions are stored. When the computer program or instructions are executed by a computer, the computer executes a method in any possible design of the first aspect or a method in any possible design of the second aspect.

[0054] In the ninth aspect, an embodiment of the present application further provides a chip, which is coupled to a memory, and is used to read a computer program stored in the memory to execute any possible method in the design of the first aspect or any possible method in the design of the second aspect.

[0055] In a tenth aspect, an embodiment of the present application further provides a chip system, which includes a processor for supporting a computer device to implement any possible method in the design of the first aspect or any possible method in the design of the second aspect. In one possible design, the chip system also includes a memory, which is used to store programs and data necessary for the computer device. The chip system can be composed of chips, or it can include chips and other discrete devices.

[0056] Based on the implementations provided in the above aspects, this application can also be further combined to provide more implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 A schematic diagram of a possible application scenario provided by an embodiment of the present application is exemplified;

[0058] Figure 2 A schematic diagram showing the structure of a terminal provided by an embodiment of the present application is exemplified;

[0059] Figure 3 A flowchart of a collaborative playback method based on multimedia copyright provided by an embodiment of the present application is exemplified;

[0060] Figure 4 A flowchart of another method for collaborative playback based on multimedia copyright provided in an embodiment of the present application is exemplified;

[0061] Figure 5 A schematic diagram showing a possible structure of a first terminal provided in an embodiment of the present application is exemplified;

[0062] Figure 6 A schematic diagram showing a possible structure of a first terminal provided in an embodiment of the present application is exemplified;

[0063] Figure 7 A schematic diagram showing a possible structure of a second terminal provided in an embodiment of the present application is exemplified;

[0064] Figure 8 A schematic diagram of the structure of a possible second terminal provided in an embodiment of the present application is exemplified. DETAILED DESCRIPTION

[0065] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0066] The following is an introduction to possible application scenarios of the present application. It should be noted that these introductions are intended to facilitate understanding by those skilled in the art and do not constitute a limitation on the scope of protection claimed by the present application.

[0067] Figure 1 The following is a schematic diagram of a possible application scenario to which the present application embodiment is applicable. Figure 1 As shown, the application scenario includes a terminal 100 and a terminal 200 .

[0068] The terminal 100 or the terminal 200 may be an entity on the user side with a signal receiving and sending function, and may provide the user with service functions such as audio, video, voice, and data connectivity. Optionally, the terminal 100 or the terminal 200 may also have data processing capabilities. Optionally, a multimedia application may be installed on the terminal 100, and a multimedia application may be installed on the terminal 200.

[0069] Exemplarily, the terminal 100 or the terminal 200 may be a smart phone, a tablet computer, a desktop computer, a computer with wireless transceiver function (such as a laptop computer, etc.), a PPD (Personal Digital Assistant), a mobile internet device (MID), a vehicle terminal (such as a cockpit vehicle computer, which may also be referred to as a vehicle infotainment system), a wearable device with wireless communication function (such as a smart watch, a smart bracelet, smart glasses or a smart helmet, etc.), a virtual reality (VR) device, an augmented reality (AR) device or a smart home device (such as a smart speaker or a smart TV, etc.), etc. It should be understood that the present application does not limit the specific device form of the terminal.

[0070] Optionally, the terminal 100 may be connected to the terminal 200 for communication. For example, the terminal 100 may be connected to the terminal 200 for communication via a wired network, or via a wireless network, which is not limited in the present embodiment.

[0071] Optionally, when the terminal 100 and the terminal 200 are connected to each other via a wireless network, the wireless network may be a wireless local area network (WLAN), such as a wireless fidelity (wifi) network, a ZigBee network, a Bluetooth (BT) network, or a short-range communication network such as a nearfield communication technology (NFC) network, or may be other forms of communication networks, which are not limited in the embodiments of the present application.

[0072] Exemplarily, the following takes terminal 100 as a smart phone and terminal 200 as a smart speaker as an example to introduce the multimedia collaborative playback scenario between terminal 100 and terminal 200. Optionally, a multimedia application (such as a music application or a video application or an application software for playing TV series, movies, etc.) is installed on the smart phone, and a multimedia application is installed on the smart speaker. For example, when a user wants to play the music to be played in the smart phone through a smart speaker at home or other places, or when the user listens to songs outdoors using a music application installed in the smart phone he owns, and wants to play the music to be played in the smart phone through the smart speaker when he returns home, the user can perform the corresponding collaborative playback indication operation in the smart phone (for example, the user can enter a collaborative playback command in the smart phone or click a collaborative playback button), and the collaborative playback indication operation is used to indicate that the smart phone can play the songs to be played in the smart phone through the smart speaker.

[0073] After receiving the user's collaborative playback instruction operation, the smartphone can establish a streaming communication link with the smart speaker, and transfer the music information list to be played in the smartphone to the smart speaker through the streaming communication link. Optionally, the music information list contains at least one music identifier. After receiving the song information list, the smart speaker can perform device copyright identification on at least one music identifier contained in the music information list. Optionally, for a music identifier for which the smart speaker has the playback copyright, the smart speaker can download the music file corresponding to the music identifier from the music platform alone, and can play the music file alone, which can provide users with a lossless music experience; for a music identifier for which the smart speaker does not have the device playback copyright, the smart speaker can send corresponding instruction information to the smartphone. Among them, the instruction message is used to indicate that the smart speaker does not have the device playback copyright of the music identifier. Optionally, the music identifier can be included in the instruction message.

[0074] After receiving the instruction information from the smart speaker, the smartphone can automatically negotiate with the smart speaker and select a collaborative playback mode from the collaborative playback modes (also referred to as collaborative playback capabilities) supported by the smartphone and the smart speaker respectively to play the music corresponding to the music identifier. Optionally, the collaborative playback mode may include but is not limited to: Bluetooth playback mode, mirror screen playback mode, DLNA screen playback mode or streaming playback mode, etc. Exemplarily, taking the negotiated collaborative playback mode as the Bluetooth playback mode as an example, the smartphone can establish a Bluetooth communication link with the smart speaker, and can transmit the music data stream (i.e., audio stream) corresponding to the music identifier to the smart speaker through the Bluetooth communication link for playback. At this time, the smart speaker acts as a Bluetooth sound device.

[0075] It should be noted that the above Figure 1 The application scenario shown is only an example, which is intended to more clearly illustrate the technical solution of the embodiment of the present application and does not limit the application scenario of the image processing method provided by the present application. Figure 1 The form and quantity of each structure in the application scenario shown are only for example and do not constitute a limitation of the present application. Figure 1 The names of the various structures in the application scenario shown are only examples. The names of the various structures in the specific implementation may also be other names, and this application does not make specific limitations on this.

[0076] based on Figure 1 The present application also provides a schematic diagram of the structure of a terminal. Figure 2 According to the logical functions, the terminal can be divided into the following functional modules: multimedia application, streaming module and collaborative playback module. Optionally, the multimedia application may include but is not limited to at least one of the following: streaming management module, task management module, collaborative management module, transmission management module or copyright management module. Optionally, the collaborative playback module may include but is not limited to at least one of the following: Bluetooth module, mirror screen projection module or DLNA screen projection module.

[0077] It should be noted that Figure 2 The connection relationship between the functional modules shown is only an example and does not constitute a limitation of the present application. The functions of each functional module are described below.

[0078] The streaming module is used to establish a streaming communication link between multiple terminals using a certain communication protocol (such as a streaming protocol) when multiple terminals need to play multimedia collaboratively.

[0079] The collaborative playback module is used to realize the function of collaborative multimedia playback by terminals. For example, the collaborative playback module can be used to realize the collaborative playback of multimedia between multiple terminals using a certain collaborative playback mode (such as Bluetooth playback mode, mirror screen playback mode or DLNA screen playback mode, etc.).

[0080] The Bluetooth module is used to establish a Bluetooth communication link between multiple terminals using the Bluetooth protocol when multiple terminals choose to play multimedia in the Bluetooth playback mode through negotiation.

[0081] The mirroring screen projection module is used to establish a mirroring screen projection communication link between multiple terminals using the mirroring screen projection protocol when multiple terminals negotiate and choose to play multimedia in the mirroring screen projection mode.

[0082] The DLNA screen projection module is used to establish a DLNA screen projection communication link between multiple terminals using the DLNA screen projection protocol when multiple terminals negotiate and choose to play multimedia in the DLNA screen projection playback mode.

[0083] Multimedia applications are used to enable a terminal to play multimedia. For example, multimedia applications can be used to enable multiple terminals to play multimedia in a coordinated manner.

[0084] Optionally, the multimedia application may be an application program installed on the terminal. For example, taking the multimedia application as a music application, the music application may include but is not limited to: or wait.

[0085] The flow management module is used to manage the call flow module.

[0086] The task management module is used to manage and call the collaborative management module according to the device playback copyright support information of the multimedia identification to be played.

[0087] The collaborative management module is used to implement negotiation of collaborative playback modes among terminals where multimedia applications are located.

[0088] The transmission management module is used to transmit and manage the coordinated playback mode negotiated between multiple terminals, multimedia playback status information, multimedia identification information or multimedia streaming media data, etc.

[0089] The copyright management module is used to identify the device playback copyright support information of the multimedia identification to be played.

[0090] Exemplarily, taking two terminals (such as terminal 100 and terminal 200) as an example, when terminal 100 needs to perform data interaction with terminal 200 and jointly play the multimedia to be played in terminal 100, terminal 100 can call the streaming module through the streaming management module in the multimedia application, and terminal 200 also calls the streaming module through the streaming management module in the multimedia application to establish a streaming communication link between terminal 100 and terminal 200. Afterwards, terminal 100 can stream the multimedia information list to be played in terminal 100 to terminal 200 through the streaming communication link. Optionally, the multimedia information list contains at least one multimedia identifier.

[0091] After receiving the multimedia information list, terminal 200 can perform device copyright identification on at least one multimedia identifier included in the multimedia information list through the copyright management module in the multimedia application, and determine the device playback copyright support information of at least one multimedia identifier for terminal 200, such as which multimedia identifiers are authorized to play back device types that include the device type of terminal 200 (i.e., which multimedia identifiers have device playback copyrights that terminal 200 has), and which multimedia identifiers are authorized to play back device types that do not include the device type of terminal 200 (i.e., which multimedia identifiers do not have device playback copyrights that terminal 200 has).

[0092] Optionally, when the terminal 200 has the device playback rights of a certain multimedia identifier, the multimedia application in the terminal 200 can download the multimedia file corresponding to the multimedia identifier from the corresponding multimedia platform, and can play the multimedia file corresponding to the multimedia identifier.

[0093] Optionally, when the terminal 200 does not have the device playback rights of a certain multimedia identifier, the multimedia application in the terminal 200 may send corresponding indication information to the terminal 100 through the streaming communication link. The indication information is used to indicate that the terminal 200 does not have the device playback rights of the multimedia identifier. Optionally, the indication information may include the multimedia identifier. After receiving the indication information, when the terminal 100 recognizes through the copyright management module in the multimedia application that the terminal 100 has the device playback rights of the multimedia identifier, the task management module in the multimedia application may be used to call the collaborative management module in the multimedia application to negotiate with the terminal 200 the target collaborative playback mode (such as the mirror projection playback mode) corresponding to the multimedia identifier. Afterwards, the terminal 100 uses the mirror projection protocol according to the mirror projection playback mode to establish a mirror projection communication link with the terminal 200, and transmits the multimedia data stream corresponding to the multimedia identifier to the terminal 200 for playback through the mirror projection communication link.

[0094] For example, taking the multimedia application as a video application and the multimedia information list as a video information list as an example, it is assumed that there are three video identifiers, namely, video identifier a, video identifier b, and video identifier c, and it is assumed that the playback order corresponding to video identifier a is before the playback order corresponding to video identifier b, and the playback order corresponding to video identifier b is before the playback order corresponding to video identifier c. Among them, terminal 200 has the device playback copyright of video identifier a, terminal 200 does not have the device playback copyright of video identifier b, and terminal 200 has the device playback copyright of video identifier c.

[0095] When the video identifier currently to be played is identified as video identifier a according to the playback order corresponding to each video identifier, since the terminal 200 has the device playback copyright of video identifier a, the video application in the terminal 200 can download the video file corresponding to video identifier a from the corresponding video platform, and can play the video file corresponding to video identifier a. When it is detected that the playback of the video file corresponding to video identifier a is about to end (for example, the remaining duration of the video playback is 10s) and the next video identifier to be played is video identifier b, since the terminal 200 does not have the device playback copyright of video identifier b, the video application in the terminal 200 needs to send the corresponding indication information to the terminal 100. Among them, the indication information is used to indicate that the terminal 200 does not have the device playback copyright of video identifier b. Optionally, the indication information may include video identifier b. After receiving the indication information, when the terminal 100 identifies that the terminal 100 has the device playback copyright of video identifier b through the copyright management module in the video application, the task management module in the video application can be called to call the collaborative management module in the video application to negotiate with the terminal 200 the target collaborative playback mode corresponding to video identifier b (such as DLNA screen projection playback mode). Afterwards, the video application in terminal 100 can establish a DLNA projection communication link with terminal 200 using the DLNA projection protocol according to the DLNA projection playback mode, and transmit the video data stream corresponding to the video identifier b to terminal 200 for playback through the DLNA projection communication link.

[0096] When it is detected that the video corresponding to video identifier b has finished playing and the next video identifier to be played is video identifier c, since terminal 200 has the device playback rights of video identifier c, the video application in terminal 100 can send corresponding indication information to terminal 200. The corresponding indication information is used to indicate that the video data stream corresponding to video identifier b has finished playing. Optionally, the corresponding indication information can include video identifier b. After receiving the corresponding indication information, when the video identifier that is located after video identifier b in the playback order is video identifier c, since terminal 200 has the device playback rights of video identifier c, the video application in terminal 200 can download the video file corresponding to video identifier c from the corresponding video platform, and can play the video file corresponding to video identifier c.

[0097] The following is based on Figure 1 The application scenario shown provides a detailed introduction to the specific implementation of the collaborative playback method based on multimedia copyright in the embodiment of the present application.

[0098] Figure 3 The flowchart of a method for collaborative playback based on multimedia copyright provided by an embodiment of the present application is exemplarily shown. The method is applicable to Figure 1 The method flow can be implemented by data interaction between multiple terminals. For example, taking two terminals (such as terminal A and terminal B) as an example, terminal A can be as follows: Figure 1 The terminal 100 shown in FIG. 1 may be a terminal B. Figure 1 The terminal 200 shown in FIG. 1 , or the terminal A may be a terminal 200 shown in FIG. Figure 1 The terminal 200 shown in the figure, the terminal B can be as follows Figure 1 The terminal 100 is shown. In order to facilitate the introduction of the technical solution provided by the embodiment of the present application, the following is an example of the process of implementing a collaborative playback method based on multimedia copyright by data interaction between two terminals (for example, one terminal is a first terminal and the other terminal is a second terminal). Figure 3 As shown, the method includes:

[0099] Step 301: When receiving a collaborative playback instruction sent by a user, the second terminal sends first indication information to the first terminal.

[0100] Optionally, the collaborative play instruction may be used to instruct the first terminal and the second terminal to collaboratively play multimedia to be played in the second terminal through data interaction.

[0101] Exemplarily, when the user belonging to the second terminal wants to collaboratively play the multimedia to be played in the second terminal (such as music, TV series, movies, videos or animations, etc.) through other terminals (such as the first terminal), the user belonging to the second terminal can perform corresponding collaborative playback instruction operations in the second terminal (for example, the user belonging to the second terminal can enter a collaborative playback command in the second terminal or click a collaborative playback button), thereby forming a collaborative playback instruction issued by the user belonging to the second terminal to the second terminal.

[0102] Optionally, after identifying the presence of a first terminal nearby that interacts with the second terminal and collaboratively plays the multimedia to be played on the second terminal, the second terminal may display a collaborative playback prompt interface to the user of the second terminal. The user of the second terminal may trigger a corresponding operation on the collaborative playback prompt interface (for example, the user of the second terminal may input a collaborative playback command on the collaborative playback prompt interface or click a collaborative playback button on the collaborative playback prompt interface), thereby forming a collaborative playback instruction issued by the user of the second terminal to the second terminal.

[0103] Exemplarily, the first indication information may be used to indicate a multimedia information list to be played in the second terminal, and the multimedia information list may include one or more multimedia identifiers, such as a first multimedia identifier or a second multimedia identifier.

[0104] Optionally, before sending the first indication information to the first terminal, the second terminal may establish a streaming communication link with the first terminal according to the collaborative playback instruction issued by the user to which the second terminal belongs. For example, the second terminal and the first terminal may establish a streaming communication link between the second terminal and the first terminal based on the streaming protocol. Exemplarily, the streaming communication link can be used to transmit the first indication information (such as the first indication information carrying a multimedia information list or multimedia playback progress, etc.), the second indication information (such as the second indication information carrying one or more multimedia identifiers that do not have the device playback copyright), multimedia playback status or negotiated collaborative playback mode, etc.

[0105] For example, taking the first terminal as a smart speaker and the second terminal as a smart phone, the user of the smart phone listens to music outdoors using a music application installed in the smart phone. After returning indoors from outdoors, the smart phone can display a collaborative playback prompt interface to the user when it detects that there is a smart speaker indoors that can interact with the smart phone for data and collaboratively play the music to be played in the smart phone. The user triggers a corresponding operation in the collaborative playback prompt interface (for example, the user of the smart phone enters a collaborative playback command in the collaborative playback prompt interface or clicks a collaborative playback button in the collaborative playback prompt interface), forming an instruction for instructing the smart phone to interact with the smart speaker through data to collaboratively play the multimedia to be played in the smart phone. After receiving the instruction, the smart phone sends corresponding instruction information to the smart speaker. Optionally, the corresponding instruction information carries a list of music information that the user currently needs to play (for example, music identifiers 1 to 5), or can also carry the playback progress of a certain music identifier that the user is currently playing (for example, music identifier 1 has been played to 30s).

[0106] Step 302: When the first terminal has the device playing copyright of the first multimedia identifier, the first terminal downloads the multimedia file corresponding to the first multimedia identifier from the service device and plays the multimedia file.

[0107] Optionally, after receiving the first indication information, the first terminal may perform device playback copyright identification on one or more multimedia identifiers included in the multimedia information list, and determine the device playback copyright support information of the one or more multimedia identifiers for the first terminal, such as which multimedia identifiers have device playback copyrights, or which multimedia identifiers do not have device playback copyrights. For example, taking the first multimedia identifier included in the multimedia information list as an example, when the first terminal has the device playback copyright of the first multimedia identifier, the first terminal can download the multimedia file corresponding to the first multimedia identifier from the corresponding service device (such as a multimedia service device), and can play the multimedia file corresponding to the first multimedia identifier.

[0108] Exemplarily, based on the above content, the following describes the implementation process of the first terminal performing device playback copyright identification on one or more multimedia identifiers included in the multimedia information list through the following possible examples.

[0109] Example 1: When a multimedia identifier is included in the multimedia information list, the first terminal can identify the device playback copyright of the multimedia identifier based on the device copyright support information of multiple pre-stored multimedia identifiers (such as a device playback copyright mapping relationship table), and determine whether the device type of the first terminal exists in at least one device type authorized for playback by the multimedia identifier. When the device type of the first terminal exists in at least one device type authorized for playback by the multimedia identifier, the first terminal determines that the first terminal has the device playback copyright of the multimedia identifier. When the device type of the first terminal does not exist in at least one device type authorized for playback by the multimedia identifier, the first terminal determines that the first terminal does not have the device playback copyright of the multimedia identifier. Among them, the device copyright support information of multiple multimedia identifiers (such as a device playback copyright mapping relationship table) contains the correspondence between multimedia identifiers and device types with playback permissions.

[0110] Exemplarily, taking the device playback copyright mapping relationship table as an example, the representation form of the device playback copyright mapping relationship table can be seen in Table 1.

[0111] Table 1

[0112] Multimedia Logo Device types with playback permission Logo 1 Device Type 1 or Device Type 2, etc. Logo 2 Device Type 1, Device Type 3, or Device Type 4, etc. Logo 3 Device Type 2 or Device Type 5, etc. …… ……

[0113] It should be noted that Table 1 is only a simple example for the purpose of illustrating the technical solution in the embodiments of the present application, and does not constitute a limitation on the technical solution in the embodiments of the present application.

[0114] Example 2: When the multimedia information list contains multiple multimedia identifiers, the first terminal can identify the device playback copyright of the multiple multimedia identifiers based on the device copyright support information of the multiple multimedia identifiers stored in advance, and determine whether the device type of the first terminal exists among the one or more device types authorized for playback by the multiple multimedia identifiers (for example, which device types authorized for playback by the multiple multimedia identifiers contain the device type of the first terminal, and which device types authorized for playback by the multiple multimedia identifiers do not contain the device type of the first terminal). For example, taking the first multimedia identifier as an example, when the device type of the first terminal exists among the one or more device types authorized for playback by the first multimedia identifier, the first terminal determines that the first terminal has the device playback copyright of the first multimedia identifier. When the device type of the first terminal does not exist among the one or more device types authorized for playback by the first multimedia identifier, the first terminal determines that the first terminal does not have the device playback copyright of the first multimedia identifier. Among them, the first multimedia identifier is any one of the multiple multimedia identifiers.

[0115] Exemplarily, taking the multimedia information list containing three multimedia identifiers (such as identifier 1, identifier 2, and identifier 3), and the device copyright support information of multiple multimedia identifiers being a device playback copyright mapping relationship table as an example, it is assumed that the device type of the first terminal is device type 1. The first terminal can determine, based on the pre-stored device playback copyright mapping relationship table, that the first terminal has the device playback copyrights of identifiers 1 and 2, and the first terminal does not have the device playback copyright of identifier 3.

[0116] Optionally, the device copyright support information of multiple multimedia identifiers mentioned in the above Example 1 or Example 2 can be obtained in advance by the first terminal from the cloud (also known as the cloud or cloud server, etc.) or other devices (such as a distributed computer or data center that stores the device copyright support information of multiple multimedia identifiers).

[0117] Optionally, after receiving the first indication information, the first terminal may also send the multimedia information list to the cloud or other devices. After receiving the multimedia information list, the cloud or other devices may identify the device playback copyright of one or more multimedia identifiers included in the multimedia information list based on the device copyright support information of multiple multimedia identifiers, and determine the device playback copyright support information of one or more multimedia identifiers for the first terminal, such as which multimedia identifiers the first terminal has device playback copyrights, or which multimedia identifiers the first terminal does not have device playback copyrights. Then, the cloud or other devices may send the device playback copyright support information of one or more multimedia identifiers for the first terminal to the first terminal.

[0118] For example, continuing to take the first multimedia identifier included in the multimedia information list as an example, when the first terminal receives the first multimedia identifier from the cloud or other devices for the device playback copyright support information of the first terminal, it can be known whether the first terminal has the device playback copyright of the first multimedia identifier. When the first terminal has the device playback copyright of the first multimedia identifier, the first terminal can download the multimedia file corresponding to the first multimedia identifier through the corresponding service device (such as a multimedia service device), and can play the multimedia file corresponding to the first multimedia identifier.

[0119] Exemplarily, based on the above content, the following describes the implementation process of the cloud or other devices performing device playback copyright identification on one or more multimedia identifiers included in the multimedia information list through the following possible examples.

[0120] Example 1: When a multimedia identifier is included in the multimedia information list, the cloud or other device identifies the device playback copyright of the multimedia identifier based on the device copyright support information of multiple multimedia identifiers (such as a device playback copyright mapping relationship table), and determines whether the device type of the first terminal exists in at least one device type authorized for playback by the multimedia identifier. When the device type of the first terminal exists in at least one device type authorized for playback by the multimedia identifier, the cloud or other device determines that the first terminal has the device playback copyright of the multimedia identifier. When the device type of the first terminal does not exist in at least one device type authorized for playback by the multimedia identifier, the cloud or other device determines that the first terminal does not have the device playback copyright of the multimedia identifier. Then, the cloud or other device can send to the first terminal whether the first terminal has the device playback copyright of the multimedia identifier or whether the first terminal does not have the device playback copyright of the multimedia identifier.

[0121] Example 2: When the multimedia information list contains multiple multimedia identifiers, the cloud or other devices identify the device playback copyrights of the multiple multimedia identifiers according to the device copyright support information of the multiple multimedia identifiers, and determine whether the device type of the first terminal exists among the one or more device types authorized for playback by the multiple multimedia identifiers. For example, taking the first multimedia identifier as an example, when the device type of the first terminal exists among the one or more device types authorized for playback by the first multimedia identifier, the first terminal determines that the first terminal has the device playback copyright of the first multimedia identifier. When the device type of the first terminal does not exist among the one or more device types authorized for playback by the first multimedia identifier, the first terminal determines that the first terminal does not have the device playback copyright of the first multimedia identifier. Among them, the first multimedia identifier is any one of the multiple multimedia identifiers. Then, the cloud or other devices can send the device playback copyright support information of the multiple multimedia identifiers for the first terminal (such as which of the multiple multimedia identifiers the first terminal has the device playback copyright, or which of the multiple multimedia identifiers the first terminal does not have the device playback copyright) to the first terminal.

[0122] Step 303: When the first terminal does not have the device playback copyright of the first multimedia identifier, the first terminal sends second indication information to the second terminal.

[0123] Step 304: the second terminal sends the multimedia data stream corresponding to the first multimedia identifier to the first terminal according to the second indication information.

[0124] Optionally, when the first terminal does not have the device playback rights of the first multimedia identifier, the first terminal may send a second indication message to the second terminal through a streaming communication link or other communication link that can be used to transmit indication information, and the second indication message is used to indicate that the first terminal does not have the device playback rights of the first multimedia identifier. Optionally, the first multimedia identifier may be carried in the second indication message. In addition, in some other examples, the second indication message may also be used to indicate that the first terminal does not have the device playback rights of multiple consecutive multimedia identifiers, for example, the second indication message may be used to indicate that the first terminal does not have the device playback rights of multimedia identifier 5, multimedia identifier 6, and multimedia identifier 7, or may also be used to indicate that the first terminal does not have the device playback rights of multiple discontinuous multimedia identifiers, for example, the second indication message may be used to indicate that the first terminal does not have the device playback rights of multimedia identifier 3, multimedia identifier 6, and multimedia identifier 7.

[0125] After receiving the second indication information, the second terminal can obtain the multimedia data stream corresponding to the first multimedia identifier, and send the multimedia data stream corresponding to the first multimedia identifier to the first terminal. Optionally, after receiving the second indication information, the second terminal can also first determine whether the second terminal has the device playback rights of the first multimedia identifier. When the second terminal has the device playback rights of the first multimedia identifier, the second terminal can query the multimedia data stream corresponding to the first multimedia identifier locally, or can also download the multimedia file corresponding to the first multimedia identifier from the corresponding service device (such as a multimedia service device), and can convert the multimedia file corresponding to the first multimedia identifier into the multimedia data stream corresponding to the first multimedia identifier. Then, the second terminal can send the multimedia data stream corresponding to the first multimedia identifier to the first terminal.

[0126] Optionally, the implementation method of determining the device playback rights of the second terminal having the first multimedia identifier in the above steps 303 to 304 can refer to the implementation method of determining the device playback rights of the first terminal having the first multimedia identifier in the above step 302, which will not be repeated here.

[0127] Exemplarily, based on the above content, the implementation process of the first terminal sending the second indication information to the second terminal is introduced below through the following possible examples.

[0128] Example 1: When the first terminal does not have the device playback copyright of the first multimedia identifier, the first terminal can generate a second indication message when it detects that the remaining playback time of the multimedia file corresponding to the second multimedia identifier is less than or equal to the time threshold, and can send the second indication message to the second terminal through the streaming communication link.

[0129] The second multimedia identifier may be a multimedia identifier whose playback order in the multimedia information list is before the first multimedia identifier, the first terminal has the device playback rights of the second multimedia identifier, and the playback order of the first multimedia identifier is not at the starting position in the multimedia information list.

[0130] Optionally, when the first terminal does not have the device playback copyright of the first multimedia identifier, if the playback order of the first multimedia identifier is at the starting position in the multimedia information list, the first terminal can directly generate the second indication information and send the second indication information to the second terminal.

[0131] Example 2: When the first terminal does not have the device playback copyright of the first multimedia identifier, the first terminal can generate a second indication message when it detects that the remaining playback time of the multimedia data stream corresponding to the second multimedia identifier is less than or equal to the time threshold, and can send the second indication message to the second terminal through the streaming communication link.

[0132] The second multimedia identifier may be a multimedia identifier whose playback order in the multimedia information list is before the first multimedia identifier. The first terminal does not have the device playback copyright of the second multimedia identifier, and the playback order of the first multimedia identifier is not at the starting position in the multimedia information list.

[0133] Optionally, before the second terminal sends the multimedia data stream corresponding to the first multimedia identifier to the first terminal, the second terminal may negotiate with the first terminal a target collaborative playback mode corresponding to the first multimedia identifier, and the target collaborative playback mode is used to play the multimedia data stream corresponding to the first multimedia identifier. Afterwards, the second terminal may establish a communication link corresponding to the target collaborative playback mode with the first terminal according to the target collaborative playback mode. Then, the second terminal may send the multimedia data stream corresponding to the first multimedia identifier to the first terminal for playback through the communication link corresponding to the target collaborative playback mode.

[0134] Optionally, during the process of negotiating the target collaborative playback mode with the first terminal, the second terminal may transmit at least one collaborative playback mode that the second terminal has or supports to the first terminal through the streaming communication link between the first terminal and the second terminal. Of course, the first terminal may also transmit at least one collaborative playback mode that the first terminal has or supports to the second terminal through the streaming communication link between the first terminal and the second terminal. In this way, the first terminal and the second terminal can obtain the collaborative playback mode that the other party has or supports through the streaming communication link, so that the first terminal and the second terminal can negotiate a target collaborative playback mode that meets the requirements of both parties in a timely and effective manner.

[0135] Exemplarily, the collaborative playback mode may include, but is not limited to: a Bluetooth playback mode, a mirror screen playback mode, a DLNA screen playback mode or a streaming playback mode, etc.

[0136] By way of example, based on the above content, the following describes the implementation process of the second terminal negotiating with the first terminal on the target collaborative playback mode corresponding to the first multimedia identifier through the following possible implementation modes.

[0137] Mode 1: The second terminal negotiates with the first terminal and randomly selects one of the at least one collaborative playback modes shared by the second terminal and the first terminal as a target collaborative playback mode.

[0138] Mode 2: The second terminal negotiates with the first terminal and selects the collaborative playback mode with the highest priority as the target collaborative playback mode from at least one collaborative playback mode shared by the second terminal and the first terminal according to the priorities of the multiple collaborative playback modes.

[0139] Method three: The second terminal negotiates with the first terminal to sort the priority of at least one collaborative playback mode shared by the second terminal and the first terminal in order from high to low priority, and can take any collaborative playback mode among the top m collaborative playback modes in priority as the target collaborative playback mode.

[0140] Step 305: The first terminal plays the multimedia data stream corresponding to the first multimedia identifier.

[0141] Optionally, the second terminal may play the multimedia data stream corresponding to the first multimedia identifier through the first terminal serving as a sound-emitting device in a target collaborative playback manner.

[0142] Exemplarily, taking the Bluetooth playback mode as the target collaborative playback mode negotiated by the first terminal and the second terminal, the second terminal plays the multimedia data stream corresponding to the first multimedia identifier through the first terminal as a Bluetooth sound device in accordance with the Bluetooth playback mode.

[0143] Optionally, in one example, when the first terminal finishes playing the multimedia data stream corresponding to the first multimedia identifier, if the first terminal has the device playback rights of the third multimedia identifier, the second terminal can send a third indication information to the first terminal through the streaming communication link, and the third indication information is used to indicate that the multimedia data stream corresponding to the first multimedia identifier has finished playing. Optionally, the third indication information can include the first multimedia identifier, and the third multimedia identifier can be a multimedia identifier that is located after the first multimedia identifier in the playback order in the multimedia information list.

[0144] After receiving the third indication information, when the first terminal detects that the multimedia identifier that is located after the first multimedia identifier in the playback order in the multimedia information list is the third multimedia identifier, since the first terminal has the device playback copyright of the third multimedia identifier, the first terminal can download the multimedia file corresponding to the third multimedia identifier from the corresponding service device (such as the multimedia service device) and can play the multimedia file corresponding to the third multimedia identifier.

[0145] For example, based on the technical solutions provided in steps 301 to 305 above, see Figure 4 , taking the first terminal as a smart speaker, the second terminal as a smartphone, and the multimedia as music as an example, this paper introduces the implementation process of data interaction between the smartphone and the smart speaker and collaborative playback of music in the smartphone. Among them, the smartphone has a music application installed, the smart speaker has a music application installed, and the cloud identifies the copyright support information for the smart speaker or smartphone device playback. Figure 4 As shown, the method includes:

[0146] Step 401: The smart phone and the smart speaker establish a flow communication link through the flow module.

[0147] Exemplarily, the streaming communication link can be used to stream music information lists, music playback progress or music playback status (such as the end of playback of a music file or music data stream corresponding to a certain music identifier), etc., or it can also be used for the first terminal and the second terminal to negotiate a target collaborative playback mode.

[0148] Optionally, the smartphone can call the flow module through the flow management module in the music application installed on the smartphone, and the smart speaker can also call the flow module through the flow management module in the music application installed on the smart speaker, thereby establishing a flow communication link between the smartphone and the smart speaker.

[0149] Step 402: The smartphone sends the music information list and music playing progress to the smart speaker via the streaming communication link.

[0150] Optionally, the music information list may include at least one music identifier, for example, 10 music identifiers (ie, identifier information of 10 songs), namely, music identifiers 001 to 010.

[0151] Exemplarily, taking the music ID 001 currently being played by the smart phone as an example, it is assumed that the playing progress of the music ID 001 currently being played by the smart phone is 45 seconds.

[0152] Optionally, the smartphone can transfer music IDs 001 to 010 and the playing progress 45s of music ID 001 currently being played by the smartphone to the smart speaker via a streaming communication link.

[0153] Step 403: The smart speaker sends the music information list to the cloud.

[0154] In one example, after receiving the music information list and the music playback progress, the smart speaker can send the music information list to the cloud (i.e., a platform deployed by the developer of the music application to identify the device playback copyright), or the music information list can be sent to the cloud through the music application installed on the smart speaker, and the cloud will identify the device playback copyright of at least one music identifier (such as music identifier 001 to music identifier 010) contained in the music information list.

[0155] In another example, after receiving the music information list and the music playback progress, the smart speaker can also identify the device playback copyright of at least one music identifier included in the music information list based on the device copyright support information of multiple music identifiers obtained from the cloud or other devices.

[0156] Step 404: The cloud performs device playback copyright identification on at least one music identifier included in the music information list, and determines device playback copyright support information of the at least one music identifier for the smart speaker.

[0157] Optionally, taking the cloud side identifying the device playback copyright of at least one music identifier included in the music information list as an example, after receiving the music information list, the cloud side can determine whether the device type authorized for playback by each music identifier in at least one music identifier includes the device type of the smart speaker based on the device copyright support information of multiple music identifiers. When the device type authorized for playback by the music identifier includes the device type of the smart speaker, the cloud side can determine that the smart speaker has the device playback copyright of the music identifier. When the device type authorized for playback by the music identifier does not include the device type of the smart speaker, the cloud side can determine that the smart speaker does not have the device playback copyright of the music identifier.

[0158] Exemplarily, continuing with the example of a music information list containing 10 music identifiers (such as music identifiers 001 to music identifier 010), the cloud determines the device playback copyright support information of the 10 music identifiers for the smart speaker based on the device copyright support information of multiple music identifiers. For example, the smart speaker has the device playback copyright of music identifiers 001 to music identifier 003 and music identifiers 007 to music identifier 010, but the smart speaker does not have the device playback copyright of music identifiers 004 to music identifier 006.

[0159] Step 405: The cloud sends the device playback copyright support information of at least one music identifier for the smart speaker to the smart speaker.

[0160] Optionally, after the cloud determines the device playback copyright support information of at least one music identifier for the smart speaker (for example, the smart speaker has the device playback copyright of music identifiers 001 to 003 and music identifiers 007 to 010, but the smart speaker does not have the device playback copyright of music identifiers 004 to 006), the cloud can send the device playback copyright support information of at least one music identifier for the smart speaker to the smart speaker.

[0161] Step 406: When the smart speaker has the device playback copyright of the first music identifier, the smart speaker downloads the music file corresponding to the first music identifier from the music service device and plays the music file.

[0162] Step 407: When the smart speaker does not have the copyright to play the device with the first music identifier, the smart speaker sends a first notification message to the smart phone.

[0163] Optionally, the first music identifier is any one of at least one music identifier included in the music information list.

[0164] Optionally, the first notification message may carry indication information for indicating that the smart speaker does not have the device playback copyright of the first music identifier, or may also carry the first music identifier.

[0165] Exemplarily, continuing with the example of a music information list containing 10 music identifiers (such as music identifiers 001 to music identifier 010), after the smart speaker receives the device playback copyright support information for the 10 music identifiers for the smart speaker from the cloud, it can be learned that the smart speaker has the device playback copyrights of music identifiers 001 to music identifier 003 and music identifiers 007 to music identifier 010, but does not have the device playback copyright of music identifiers 004 to music identifier 006.

[0166] Optionally, for music identifiers for which the smart speaker has device playback rights, the smart speaker can directly and independently play the music corresponding to the music identifiers. For example, the smart speaker has device playback rights for music identifiers 001 to 003, and the smart speaker can download the music files corresponding to music identifiers 001 to 003 from the music service device (i.e., the server deployed by the developer of the music application). Since the playback progress of music identifier 001 is 45s, the smart speaker can start playing from the 45s playback position of the music file corresponding to music identifier 001, and continue playing until the music file corresponding to music identifier 003. In addition, since the smart speaker does not have device playback rights for music identifiers 004 to 006, the smart speaker can send a first notification message to the smart phone through the streaming communication link when the playback of the music file corresponding to music identifier 003 is about to end (for example, the remaining playback time of the music file corresponding to music identifier 003 is less than or equal to 15s). Optionally, the first notification message may carry music identifiers 004 to 006, or may also carry indication information for indicating that the smart speaker does not have the device playback copyright of music identifiers 004 to 006.

[0167] In one example, after receiving the first notification message, the smartphone can send the music identifiers 004 to 006 carried in the first notification message to the cloud, or can send the music identifiers 004 to 006 to the cloud through a music application installed on the smartphone, and the cloud will perform device playback copyright identification on the music identifiers 004 to 006 to determine the device playback copyright support information of the music identifiers 004 to 006 for the smartphone.

[0168] Optionally, the cloud can determine whether the device type of the smartphone is included in the device type of each music identifier in the music identifiers 004 to 006 according to the device copyright support information of the multiple music identifiers. When the device type of the smartphone is included in the device type of the smartphone, the cloud can determine that the smartphone has the device playback copyright of the music identifier 004. When the device type of the smartphone is not included in the device type of the smartphone, the cloud can determine that the smartphone does not have the device playback copyright of the music identifier 004. When the device type of the smartphone is included in the device type of the smartphone, the cloud can determine that the smartphone does not have the device playback copyright of the music identifier 004. When the device type of the smartphone is included in the device type of the smartphone, the cloud can determine that the smartphone has the device playback copyright of the music identifier 005. When the device type of the smartphone is not included in the device type of the smartphone, the cloud can determine that the smartphone does not have the device playback copyright of the music identifier 005. When the device type of the smartphone is included in the device type of the smartphone, the cloud can determine that the smartphone has the device playback copyright of the music identifier 006. When the device type of the smartphone is not included in the device type of the smartphone, the cloud can determine that the smartphone does not have the device playback copyright of the music identifier 006.

[0169] In another example, after receiving the first notification message, the smartphone can also identify the device playback copyright of music identifiers 004 to 006 based on the device copyright support information of multiple music identifiers obtained from the cloud or other devices, and determine the device playback copyright support information of music identifiers 004 to 006 for the smartphone.

[0170] Optionally, the smartphone may determine whether the device type of the smartphone is included in the device type of each music identifier in the music identifiers 004 to 006 according to the device copyright support information of the multiple music identifiers. When the device type of the smartphone is included in the device type of the smartphone when the music identifier 004 is authorized to play, the smartphone may determine that the smartphone has the device play copyright of the music identifier 004. When the device type of the smartphone is not included in the device type of the smartphone when the music identifier 004 is authorized to play, the smartphone may determine that the smartphone does not have the device play copyright of the music identifier 004. When the device type of the smartphone is included in the device type of the smartphone when the music identifier 005 is authorized to play, the smartphone may determine that the smartphone has the device play copyright of the music identifier 005. When the device type of the smartphone is not included in the device type of the smartphone when the music identifier 005 is authorized to play, the smartphone may determine that the smartphone does not have the device play copyright of the music identifier 005. When the device type of the smartphone is included in the device type of the smartphone when the music identifier 006 is authorized to play, the smartphone may determine that the smartphone has the device play copyright of the music identifier 006. When the device type of the smartphone is not included in the device type of the smartphone when the music identifier 006 is authorized to play, the smartphone may determine that the smartphone does not have the device play copyright of the music identifier 006.

[0171] Step 408: The smartphone and the smart speaker negotiate, through a streaming communication link, a target collaborative playback method for playing music content corresponding to a music identifier (such as the first music identifier) ​​for which the smart speaker does not have the device playback copyright.

[0172] Optionally, the smartphone can negotiate with the smart speaker through a streaming communication link to a target collaborative playback method for playing the music content (such as a music data stream) corresponding to the first music identifier (such as music identifier 004).

[0173] Exemplarily, taking the case where the smart speaker does not have the device playback rights of music identifiers 004 to 006, when the smart phone does not have the device playback rights of music identifiers 004 to 006, the smart phone can determine that the smart phone does not have the authority to play the music content corresponding to music identifiers 004 to 006, and there is no need to negotiate the target collaborative playback mode with the smart speaker. When the smart phone has the device playback rights of at least one of music identifiers 004 to 006, the smart phone can negotiate with the smart speaker on the streaming communication link for the target collaborative playback mode for playing the at least one music identifier. For example, the smart phone and the smart speaker can first send their respective collaborative playback modes to each other through the streaming communication link, and then the smart phone can negotiate with the smart speaker a target collaborative playback mode for playing the at least one music identifier from at least one collaborative playback mode shared by the smart phone and the smart speaker.

[0174] Exemplarily, the collaborative playback modes of smart phones and smart speakers and the device copyright support of music identifiers 001 to 010 for smart phones and smart speakers can be seen in Table 2.

[0175] Table 2

[0176]

[0177]

[0178] It should be noted that Table 2 is only a simple example for the purpose of illustrating the technical solution in the embodiments of the present application, and does not constitute a limitation on the technical solution in the embodiments of the present application.

[0179] Based on Table 2, it can be seen that the collaborative playback modes that both the smartphone and the smart speaker have include streaming playback mode, DLNA screen projection playback mode and Bluetooth playback mode. For example, taking the smartphone and the smart speaker as an example, according to the priority of the collaborative playback mode, the priority of the mirror screen projection playback mode is higher than the priority of the Bluetooth playback mode, and the priority of the Bluetooth playback mode is higher than the priority of the DLNA screen projection playback mode. It is assumed that the smartphone and the smart speaker negotiate and select the Bluetooth playback mode as the target collaborative playback mode from the streaming playback mode, DLNA screen projection playback mode and Bluetooth playback mode.

[0180] Step 409: The smart phone and the smart speaker establish a communication link corresponding to the target collaborative playback mode.

[0181] Step 410: The smart phone sends the music content corresponding to the first music identifier to the smart speaker through the communication link corresponding to the target collaborative playback mode.

[0182] Exemplarily, taking the Bluetooth playback mode as an example, when the smart speaker finishes playing the music file corresponding to the music identifier 003 (such as music 3.mp3), the smart speaker can send a second notification message to the smart phone through the streaming communication link. Optionally, the second notification message can carry an indication information indicating that the music file corresponding to the music identifier 003 has finished playing, or can be used to notify the smart phone that the music file corresponding to the music identifier 003 has finished playing, or can be used to notify the smart phone to start playing the music content (such as music data stream) corresponding to the music identifier for which the smart speaker does not have the device playback copyright. After receiving the second notification message, the smart phone can establish a Bluetooth communication link with the smart speaker. Then, the smart phone can transmit the music data stream corresponding to the music identifier (such as music identifier 004 to music identifier 006) for which the smart speaker does not have the device playback copyright to the smart speaker through the Bluetooth communication link in the Bluetooth playback mode to the smart speaker for playback.

[0183] Step 411: When the smart phone finishes playing the music content corresponding to the first music identifier in accordance with the target collaborative playback mode, a third notification message is sent to the smart speaker.

[0184] Optionally, the third notification message may carry indication information for indicating that the music content corresponding to a music identifier (such as the first music identifier) ​​for which the smart speaker does not have the copyright to play the device has ended, or may be used to notify the smart speaker that the music content corresponding to a music identifier for which the smart speaker does not have the copyright to play the device has ended, or may be used to notify the smart speaker that the music content corresponding to a music identifier for which the smart speaker does not have the copyright to play the device has ended in collaborative playback.

[0185] For example, taking the example that the smart speaker does not have the device playback copyright of music identifiers 004 to 006, the third notification message may carry indication information for indicating that the music content corresponding to music identifiers 004 to 006 has ended playing, or may be used to notify the smart speaker that the music content corresponding to music identifiers 004 to 006 has ended playing, or may be used to notify the smart speaker that the music content corresponding to music identifiers 004 to 006 has ended playing collaboratively.

[0186] Exemplarily, continuing to take the Bluetooth playback mode as the target collaborative playback mode negotiated by the smartphone and the smart speaker, when the smartphone completes playing the music content corresponding to music identifiers 004 to 006 in accordance with the Bluetooth playback mode, a third notification message can be sent to the smart speaker through the flow communication link.

[0187] Step 412: The smart speaker downloads the music file corresponding to the second music identifier from the music service device, and plays the music file corresponding to the second music identifier.

[0188] Optionally, the second music identifier is any other music identifier in the music information list except the music identifier that has been played, the playing order of the second music identifier is after the playing order of the first music identifier, and the smart speaker has the device playback copyright of the second music identifier.

[0189] Exemplarily, when the smart speaker receives the third notification message, it can independently play the music files corresponding to the music identifiers (such as music identifiers 007 to music identifiers 010) that the smart speaker has the device playback copyright. Optionally, the smart speaker can download the music files corresponding to music identifiers 007 to music identifiers 010 (such as music 7.mp3, music 8.mp3, music 9.mp3 and music 10.mp3) from the music service device. After the smart speaker completes downloading music 7.mp3, music 8.mp3, music 9.mp3 and music 10.mp3 from the music service device, it can play music 7.mp3, music 8.mp3, music 9.mp3 and music 10.mp3.

[0190] It should be noted that in the description of the present application, "at least one" refers to one or more, and "more than one" refers to two or more.

[0191] "And / or" describes the relationship between the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including single items.

[0192] (individual) or any combination of multiple items (individual). For example, "at least one of A, B and C" includes A, B, C, AB, AC, BC or ABC. And, unless otherwise specified, the ordinal numbers such as "first", "second", "third" mentioned in the embodiments of the present application are used to distinguish multiple objects and are not used to limit the order, timing, priority or importance of multiple objects. In addition, the terms "including", "comprising", "having" and their variations appearing in this application all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0193] In addition, it should be noted that each step involved in the above embodiments can be performed by a corresponding device, or by a chip, processor, or chip system in the device, and the embodiments of the present application do not limit them. The above embodiments are only described by taking the corresponding device as an example.

[0194] It should be noted that in the above embodiments, some steps can be selected for implementation, and the order of the steps in the diagram can be adjusted for implementation, and this application does not limit this. It should be understood that executing some steps in the diagram, adjusting the order of the steps, or combining them for specific implementation all fall within the scope of protection of this application.

[0195] It is understandable that, in order to implement the functions in the above embodiments, the various devices involved in the above embodiments include hardware structures and / or software modules corresponding to the execution of the various functions. It should be easily appreciated by those skilled in the art that, in combination with the units and method steps of the various examples described in the embodiments disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application scenario and design constraints of the technical solution.

[0196] It should be noted that the "steps" in the embodiments of the present application are only for illustration, and are a method of expression used to better understand the embodiments, and do not constitute a substantial limitation on the execution of the scheme of the present application. For example, the "steps" can also be understood as "features". In addition, the steps do not constitute any limitation on the execution order of the scheme of the present application. Any changes in the order of steps, step merging, or step splitting made on this basis that do not affect the implementation of the overall scheme, and the resulting new technical solutions are also within the scope of the disclosure of the present application.

[0197] Based on the same concept, the embodiment of the present application also provides a possible first terminal, which is suitable for Figure 1 The first terminal is used to implement the technical solution involved in the first terminal in the above embodiment, or the module (such as a chip) of the first terminal is used to implement the technical solution involved in the first terminal in the above embodiment, so the beneficial effects of the first terminal in the above embodiment can also be achieved. In the embodiment of the present application, the first terminal can be as follows Figure 1 The illustrated terminal 100 (or terminal 200).

[0198] See also Figure 5, the first terminal 500 includes a first transceiver module 501 and a first processing module 502. The first transceiver module 501 is used to receive a first indication message from a second terminal, wherein the first indication message is used to indicate a list of multimedia information to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The first processing module 502 is used to download a multimedia file corresponding to the first multimedia identifier from a service device and play the multimedia file when the first terminal has the device playback copyright of the first multimedia identifier; or when the first terminal does not have the device playback copyright of the first multimedia identifier, send a second indication message to the second terminal, receive a multimedia data stream corresponding to the first multimedia identifier from the second terminal, and play the media data stream from the second terminal, wherein the second indication message is used to indicate that the first terminal does not have the device playback copyright of the first multimedia identifier.

[0199] For a more detailed description of the first transceiver module 501 and the first processing module 502, reference may be made to the relevant description of the first terminal in the above method embodiment, which will not be repeated here.

[0200] It should be understood that the first transceiver module 501 in the embodiment of the present application can be implemented by a first communication interface or a first communication interface related circuit component, and the first processing module 502 can be implemented by a first processor or a first processor related circuit component.

[0201] It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0202] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, or a server, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.

[0203] Based on the same concept, the present application also provides a possible first terminal, which is suitable for Figure 1 The first terminal is used to implement the technical solution involved in the first terminal in the above embodiment, so it can also achieve the beneficial effects of the first terminal in the above method embodiment. Figure 6 , the first terminal 600 includes: a first communication interface 601, a first processor 602. Optionally, the first terminal 600 also includes a first memory 603. The first communication interface 601, the first processor 602 and the first memory 603 are connected to each other. When the first terminal 600 is used to implement the technical solution involved in the first terminal provided in the above embodiment, the first communication interface 601 can be used to implement the function of the above-mentioned first transceiver module 501, and the first processor 602 is used to implement the function of the above-mentioned first processing module 502.

[0204] Optionally, the first communication interface 601, the first processor 602 and the first memory 603 are interconnected via a bus 604. The bus 604 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0205] The first communication interface 601 is used to receive and send data. For example, when the first terminal is Figure 1 In the terminal 100 shown in FIG. 1 , the first communication interface 601 is implemented with Figure 1 The terminal 200 shown in the figure can communicate with the Figure 1 The first terminal can communicate with other devices (such as cloud or service devices) outside the application scenario shown. Optionally, the first communication interface 601 can be an input and output interface. For example, the first terminal can use the first communication interface to communicate with the cloud or service device.

[0206] The functions of the first processor 602 can refer to the description of the corresponding functions involved in the first terminal in the above embodiment, and will not be repeated here. Among them, the first processor 602 can be a central processing unit (CPU), a network processor (NP) or a combination of CPU and NP, etc. The first processor 602 can further include a hardware chip. The above-mentioned hardware chip can be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof. When the first processor 602 implements the above-mentioned functions, it can be implemented by hardware, and of course, it can also be implemented by executing the corresponding software through hardware.

[0207] The first memory 603 is used to store program instructions, etc. Specifically, the program instructions may include program codes, and the program codes include computer operation instructions. The first memory 603 may include a random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. The first processor 602 executes the program instructions stored in the first memory 603 to implement the above functions, thereby implementing the method steps required to be executed by the first terminal in the above embodiment.

[0208] Based on the same concept, the embodiment of the present application also provides a possible second terminal, which is suitable for Figure 1 The second terminal is used to implement the technical solution involved in the second terminal in the above embodiment, or the module (such as a chip) of the second terminal is used to implement the technical solution involved in the second terminal in the above embodiment, so the beneficial effects of the second terminal in the above embodiment can also be achieved. In the embodiment of the present application, the second terminal can be as follows Figure 1 The illustrated terminal 200 (or terminal 100).

[0209] See also Figure 7, the second terminal 700 includes a second transceiver module 701 and a second processing module 702. The second transceiver module 701 is used to receive a collaborative playback instruction issued by a user, wherein the collaborative playback instruction is used to instruct the first terminal and the second terminal to collaboratively play the multimedia to be played in the second terminal through data interaction. The second processing module 702 is used to send a first indication message to the first terminal according to the collaborative playback instruction, wherein the first indication message is used to indicate a list of multimedia information to be played in the second terminal, and the multimedia information list includes a first multimedia identifier. The second processing module 702 is also used to send a multimedia data stream corresponding to the first multimedia identifier to the first terminal when receiving a second indication message from the first terminal, wherein the second indication message is used to indicate that the first terminal does not have the device playback copyright of the first multimedia identifier.

[0210] For a more detailed description of the second transceiver module 701 and the second processing module 702, reference may be made to the relevant description of the second terminal in the above method embodiment, which will not be repeated here.

[0211] It should be understood that the second transceiver module 701 in the embodiment of the present application can be implemented by a second communication interface or a second communication interface related circuit component, and the second processing module 702 can be implemented by a second processor or a second processor related circuit component.

[0212] It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application may be integrated into a processing unit, or may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0213] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, or a server, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.

[0214] Based on the same concept, the present application also provides a possible second terminal, which is suitable for Figure 1 The second terminal is used to implement the technical solution involved in the second terminal in the above embodiment, so it can also achieve the beneficial effects of the second terminal in the above method embodiment. Figure 8 , the second terminal 800 includes: a second communication interface 801, a second processor 802. Optionally, the second terminal 800 also includes a second memory 803. The second communication interface 801, the second processor 802 and the second memory 803 are interconnected. When the second terminal 800 is used to implement the technical solution involved in the second terminal provided in the above embodiment, the second communication interface 801 can be used to implement the function of the second transceiver module 701, and the second processor 802 is used to implement the function of the second processing module 702.

[0215] Optionally, the second communication interface 801, the second processor 802 and the second memory 803 are interconnected via a bus 804. The bus 804 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0216] The second communication interface 801 is used to receive and send data. For example, when the first terminal is Figure 1 In the terminal 200 shown in FIG. 1 , the second communication interface 801 is implemented with Figure 1 The terminal 100 shown in the figure can communicate with the Figure 1 The second terminal can communicate with other devices (such as cloud or service devices) outside the application scenario shown. Optionally, the second communication interface 801 can be an input and output interface. For example, the second terminal can use the second communication interface to communicate with the cloud or service device.

[0217] The functions of the second processor 802 can refer to the description of the corresponding functions involved in the second terminal in the above embodiment, and will not be repeated here. Among them, the second processor 802 can be a central processing unit (CPU), a network processor (NP) or a combination of CPU and NP, etc. The second processor 802 can further include a hardware chip. The above-mentioned hardware chip can be an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof. When the second processor 802 implements the above-mentioned functions, it can be implemented by hardware, and of course, it can also be implemented by executing the corresponding software through hardware.

[0218] The second memory 803 is used to store program instructions, etc. Specifically, the program instructions may include program codes, and the program codes include computer operation instructions. The second memory 803 may include a random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory. The second processor 802 executes the program instructions stored in the second memory 803 to implement the above functions, thereby implementing the method steps required to be executed by the second terminal in the above embodiment.

[0219] Based on the same concept, an embodiment of the present application further provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are executed on a computer, the computer executes the method provided in the above embodiment.

[0220] Based on the same concept, an embodiment of the present application also provides a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed by a computer, the computer executes the method provided in the above embodiment.

[0221] The storage medium may be any available medium that can be accessed by a computer. For example, but not limited to, a computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer.

[0222] Based on the same concept, an embodiment of the present application further provides a chip, which is coupled to a memory, and is used to read a computer program stored in the memory to implement the method provided in the above embodiment.

[0223] Based on the same concept, an embodiment of the present application also provides a chip system, which includes a processor for supporting a computer device to implement the functions involved in the terminal device (such as the first terminal or the second terminal) in the above embodiment. In one possible design, the chip system also includes a memory, which is used to store the necessary programs and data for the computer device. The chip system can be composed of a chip, or it can include a chip and other discrete devices.

[0224] In the method provided in the embodiment of the present application, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).

[0225] The steps of the method described in the embodiments of the present application can be directly embedded in the hardware, the software unit executed by the processor, or the combination of the two. The software unit can be stored in RAM, ROM, EEPROM, register, hard disk, removable disk, CD-ROM or other storage media of any form in the art. Exemplarily, the storage medium can be connected to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Optionally, the storage medium can also be integrated into the processor. The processor and the storage medium can be arranged in an ASIC.

[0226] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0227] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0228] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A collaborative playback method based on multimedia copyright, characterized in that: include: The first client receives first indication information from the second client, where the first indication information is used to indicate a list of multimedia information to be played in the second client, where the list of multimedia information includes a first multimedia identifier; When the terminal where the first client is located does not have the device playback copyright of the first multimedia identifier, the first client sends a second indication message to the second client, negotiates with the second client a target collaborative playback mode corresponding to the first multimedia identifier, receives the multimedia data stream corresponding to the first multimedia identifier from the second client through the target collaborative playback mode, and plays the multimedia data stream from the second client, wherein the second indication message is used to indicate that the terminal where the first client is located does not have the device playback copyright of the first multimedia identifier, and the target collaborative playback mode is used to play the multimedia data stream corresponding to the first multimedia identifier.

2. The method according to claim 1, characterized in that The method further comprises: The first client obtains device copyright support information of the first multimedia identifier; When it is determined according to the device copyright support information of the first multimedia identifier that the device type of the terminal where the first client is located exists in at least one device type authorized for playback by the first multimedia identifier, the terminal where the first client is located has the device playback copyright of the first multimedia identifier; or When it is determined according to the device copyright support information of the first multimedia identifier that the device type of the terminal where the first client is located does not exist in at least one device type authorized for playback by the first multimedia identifier, the terminal where the first client is located does not have the device playback copyright of the first multimedia identifier.

3. The method according to claim 1, characterized in that The target collaborative play mode is selected by the second client and the first client through negotiation from at least one collaborative play mode that they share.

4. The method according to claim 3, characterized in that The target collaborative play mode is any one of the at least one collaborative play modes randomly selected; or The target collaborative playback mode is a collaborative playback mode with the highest priority among the at least one collaborative playback mode.

5. The method according to any one of claims 1 to 4, characterized in that: The target collaborative playback mode is one of the following collaborative playback modes: Bluetooth playback mode, mirror screen playback mode, DLNA screen playback mode or streaming playback mode.

6. The method according to any one of claims 1 to 5, characterized in that: The first client sends second indication information to the second client, including: When it is detected that the remaining playback time of the multimedia file or multimedia data stream corresponding to the second multimedia identifier is less than or equal to the time threshold, the first client generates second indication information; The first client sends the second indication information to the second client; The second multimedia identifier is a multimedia identifier that is before the first multimedia identifier in the playback order in the multimedia information list.

7. A collaborative playback method based on multimedia copyright, characterized in that: include: The second client receives a collaborative playback instruction sent by a user, where the collaborative playback instruction is used to instruct the first client and the second client to collaboratively play the multimedia to be played in the second client through data interaction; The second client sends first indication information to the first client according to the collaborative playback instruction, where the first indication information is used to indicate a list of multimedia information to be played in the second client, where the list of multimedia information includes a first multimedia identifier; When receiving the second indication information from the first client, the second client negotiates with the first client about the target collaborative playback mode corresponding to the first multimedia identifier, and sends the multimedia data stream corresponding to the first multimedia identifier to the first client through the target collaborative playback mode, the second indication information is used to indicate that the terminal where the first client is located does not have the device playback copyright of the first multimedia identifier, and the target collaborative playback mode is used to play the multimedia data stream corresponding to the first multimedia identifier.

8. The method according to claim 7, characterized in that The second indication information is generated by the first client when it detects that the remaining playback time of the multimedia file or multimedia data stream corresponding to the second multimedia identifier is less than or equal to the duration threshold, and the second multimedia identifier is a multimedia identifier whose playback order in the multimedia information list is before the first multimedia identifier.

9. The method according to claim 7, characterized in that The target collaborative play mode is selected by the second client and the first client through negotiation from at least one collaborative play mode that they share.

10. The method according to claim 9, characterized in that The target collaborative play mode is any one of the at least one collaborative play modes randomly selected; or The target collaborative playback mode is a collaborative playback mode with the highest priority among the at least one collaborative playback mode.

11. The method according to any one of claims 7 to 10, characterized in that: The target collaborative playback mode is one of the following collaborative playback modes: Bluetooth playback mode, mirror screen playback mode, DLNA screen playback mode or streaming playback mode.

12. A first terminal, characterized in that: The first terminal is installed with a first client, including: A first communication interface, used for receiving and sending data; A first memory for storing computer program instructions and data; The first processor is used to execute and call the computer program instructions and data in the first memory, so that the first terminal executes the method according to any one of claims 1 to 6.

13. A second terminal, characterized in that: The second terminal is installed with a second client, including: A second communication interface, used for receiving and sending data; a second memory for storing computer program instructions and data; The second processor is used to execute and call the computer program instructions and data in the second memory, so that the second terminal executes the method as claimed in any one of claims 7 to 11.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program or instruction. When the computer program or instruction is executed by a computer, the computer executes the method according to any one of claims 1 to 6 or the method according to any one of claims 7 to 11.

15. A computer program product, characterized in that The computer program product comprises a computer program or instructions, and when the computer program or instructions are run on a computer, the computer is caused to execute the method according to any one of claims 1 to 6 or the method according to any one of claims 7 to 11.

Images