Playing control method, system and equipment and storage medium

Abstract

The invention discloses a playing control method, system and device and a storage medium, and relates to the technical field of computers and the Internet. The method comprises the following steps: first equipment establishes communication connection with second equipment through a server; the first equipment obtains media set information from the server, the media set information is used for indicating N pieces of multimedia content, and N is a positive integer; the first device sends a playing control instruction to the server, wherein the playing control instruction is used for indicating playing control for the first multimedia content in the N pieces of multimedia content; the server sends a playing control instruction to the second equipment; and the second device performs playing control on the first multimedia content according to the playing control instruction. According to the method, the communication connection between the control equipment and the controlled equipment and the stability of multimedia content playing are effectively improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer and Internet technologies, and in particular to a playback control method, system, device, and storage medium. Background Art

[0002] A music player platform is a network platform or application that provides music streaming services. Users can play music on the Internet through the music player platform. With the development of computer technology, music player platforms provide more and more functions.

[0003] In the related art, a first device and a second device establish a Bluetooth connection by approaching each other, and the first device is used to control the second device to play music. The first device transmits audio data to the second device via Bluetooth transmission, and controls the second device to play the audio data via Bluetooth.

[0004] In the above method, the first device and the second device need to maintain a close distance to maintain the Bluetooth connection, and in a location where the Bluetooth signal is relatively crowded, the connection between the first device and the second device will be unstable, which will cause the second device to play audio data intermittently. Summary of the Invention

[0005] The embodiments of the present application provide a playback control method, system, device, and storage medium. The technical solutions provided by the embodiments of the present application are as follows:

[0006] According to one aspect of an embodiment of the present application, a playback control method is provided, the method comprising:

[0007] The first device establishes a communication connection with the second device through the server;

[0008] The first device obtains media set information from the server, where the media set information is used to indicate N multimedia contents, where N is a positive integer;

[0009] The first device sends a playback control instruction to the server, where the playback control instruction is used to instruct playback control of a first multimedia content among the N multimedia contents;

[0010] The server sends the playback control instruction to the second device;

[0011] The second device controls the playback of the first multimedia content according to the playback control instruction.

[0012] According to one aspect of an embodiment of the present application, a computer system is provided, the system comprising:

[0013] The first device is configured to establish a communication connection with the second device through the server;

[0014] The first device is further configured to obtain media set information from the server, where the media set information is used to indicate N multimedia contents, where N is a positive integer;

[0015] The first device is further configured to send a playback control instruction to the server, where the playback control instruction is used to instruct playback control of a first multimedia content among the N multimedia contents;

[0016] The server is configured to send the playback control instruction to the second device;

[0017] The second device is configured to control the playback of the first multimedia content according to the playback control instruction.

[0018] According to one aspect of an embodiment of the present application, a computer device is provided, comprising a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the above-mentioned playback control method.

[0019] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the above-mentioned playback control method.

[0020] According to one aspect of an embodiment of the present application, a computer program product is provided, wherein the computer program product includes a computer program, and the computer program is loaded and executed by a processor to implement the above-mentioned playback control method.

[0021] The technical solutions provided by the embodiments of the present application include at least the following beneficial effects:

[0022] A controlling device (first device) and a controlled device (second device) establish a communication connection through a server. The server then forwards playback control commands sent by the controlling device to the controlled device, enabling the controlling device to control the playback of multimedia content on the controlled device. This approach, where the controlling device and the controlled device communicate through the server, allows the controlling device to control the controlled device regardless of the distance between the devices, effectively improving the stability of the communication connection and multimedia content playback between the two devices.

[0023] In addition, the server indicates multiple playable multimedia contents to the control device through the media set information. The control device determines the first multimedia content from the multiple playable multimedia contents, and sends a playback control instruction for the first multimedia content to the second device through the server to control the playback control of the first multimedia content by the second device, which helps to improve the playback control and control efficiency of the multimedia content by the first device over the second device. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a schematic diagram of a broadcasting system provided by one embodiment of the present application;

[0025] Figure 2 This is a flowchart of a playback control method provided by an embodiment of the present application;

[0026] Figure 3 is a schematic diagram of a first playback interface provided by an embodiment of the present application;

[0027] Figure 4 This is a schematic diagram of entering a connection state provided by an embodiment of the present application;

[0028] Figure 5 This is a flowchart of a playback control method in an audio playback scenario provided by an embodiment of the present application;

[0029] Figure 6 is a block diagram of a computer system provided by one embodiment of the present application;

[0030] Figure 7 This is a structural block diagram of a computer device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0031] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0032] Please refer to Figure 1 , which shows a schematic diagram of a broadcasting system provided by an embodiment of the present application. The broadcasting system may include: a first device 10, a second device 20 and a server 30.

[0033] In some embodiments, the first device 10 and the second device 20 are different terminal devices. In some embodiments, the first device 10 and the second device 20 have communication capabilities.

[0034] In some embodiments, the first device 10 may include, but is not limited to, at least one of the following: a mobile phone, a tablet computer, a PC (Personal Computer), a wearable device, a VR (Virtual Reality) device, an AR (Augmented Reality) device, etc., and may also include other terminal devices, which are not limited in this embodiment of the present application. In some embodiments, the first device 10 is a client for running a target application (such as a music playback application). Optionally, the target application may be an application that needs to be downloaded and installed, or it may be in the form of a web page or a small program, which is not limited in this embodiment of the present application. In some embodiments, the first device 10 also needs to have the ability to scan graphic codes.

[0035] In some embodiments, the second device 20 may include, but is not limited to, at least one of the following: a mobile phone, a tablet computer, a PC (Personal Computer), a wearable device, a VR (Virtual Reality) device, an AR (Augmented Reality) device, a vehicle-mounted terminal, a smart home appliance, a multimedia playback system, etc., and may also include other terminal devices, which are not limited in this embodiment of the present application. In some embodiments, the second device 20 may include a display screen, or may not include a display screen, which is not limited in this embodiment of the present application. In some embodiments, the second device 20 is used to run a client of a target application (such as a music playback application). Optionally, the target application may be an application that needs to be downloaded and installed, or it may be in the form of a web page or a small program, which is not limited in this embodiment of the present application. In some embodiments, the second device 20 also needs to have the ability to display graphic codes.

[0036] In an embodiment of the present application, the target application may include, but is not limited to, at least one of the following: a music playback application, a live broadcast application, a video playback application, a remote conference application, a game application, an educational application, an instant messaging application, a social application, a shopping application, a radio playback application, an audio reading application, a screen reading application, etc. It may also be other applications that have the need to play media content, which is not limited in the embodiment of the present application.

[0037] The server 30 is used to provide background services for the client of the target application running in the first device 10 and the second device 20. In some embodiments, the background service may include a broadcast service, which is used to establish a broadcast connection for the first device 10 and the second device 20, and to enable the first device 10 to control the playback behavior of the media content in the second device 20. In some embodiments, the background service may also include but is not limited to at least one of the following: user account management service, playback record and history management service, data analysis and user behavior analysis service, search and recommendation service, etc., and may also include other background services, which are not limited in the embodiments of the present application. Exemplarily, the server 30 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), and basic cloud computing services such as big data and artificial intelligence platforms, but is not limited to this.

[0038] In some embodiments, the first device 10 and the second device 20 respectively establish a communication connection with the server 30. The first device 10 can control the playback control of the media content on the second device 20 through the server 30. In some embodiments, the above-mentioned communication connection can be wired communication or wireless communication, which is not limited in the embodiments of the present application.

[0039] Please refer to Figure 2 , which shows a flow chart of a playback control method provided by an embodiment of the present application. The execution subject of each step of the method may be a broadcasting system, for example, the broadcasting system may be Figure 1 The broadcasting system shown. The broadcasting system includes a first device, a second device and a server. The method may include at least one of the following steps (210-250):

[0040] In step 210, the first device establishes a communication connection with the second device through the server.

[0041] The first device is used to control the second device to play or display multimedia content. In some embodiments, the first device can be referred to as a controlling device. The second device is controlled by the first device to display, play, and view multimedia content. In some embodiments, the second device can be referred to as a controlled device.

[0042] A communication connection refers to a data exchange path established between two devices through a communication method. In some embodiments, the communication connection between the first device and the second device is implemented based on TCP / IP (Transmission Control Protocol / Internet Protocol). In some embodiments, the connection direction of the communication connection between the first device and the second device can be any of the following: unidirectional, half-duplex, or full-duplex.

[0043] In some embodiments, the communication connection between the first device and the second device includes: a communication connection between the first device and a server, and a communication connection between the second device and the server. In other words, the first device and the second device do not communicate directly, but communicate through the server.

[0044] In some embodiments, the communication connection between the first device and the server is a TCP / IP connection, and the communication connection between the second device and the server is a TCP / IP connection. In some embodiments, the communication connection between the first device and the server is a TCP / IP-based WebSocket socket long connection, and the communication connection between the second device and the server is a TCP / IP-based WebSocket socket long connection.

[0045] WebSocket persistent connections are a persistent, full-duplex communication mechanism based on TCP / IP connections, supporting persistent connections between clients and servers. WebSocket simplifies data exchange between clients and servers, allowing servers to proactively push data to clients. In the WebSocket API (Application Programming Interface), browsers and servers only need to complete a single handshake to establish a persistent connection and enable bidirectional data transmission.

[0046] In some embodiments, the first device sends a device connection request to the server, where the device connection request is used to request establishment of a communication connection between the first device and the second device, and the device connection request includes device identification information of the second device; the server establishes a communication connection between the first device and the second device based on the device identification information of the second device.

[0047] The device connection request is used to request to establish a communication connection between the first device and the second device, so that the first device can control the second device to play multimedia content through the communication connection between the first device and the second device.

[0048] The device identification information is a unique identifier used to distinguish different devices. That is, the device identification information of the second device is used to uniquely identify the second device. In some embodiments, the device identification information may include but is not limited to at least one of the following: a device unique identifier (Device Identifier), a MAC (Media Access Control Address, Media Access Control Address) address, a device name, a user account, an IP (Internet Protocol, Internet Protocol) address, a token, etc., and may also include other identification information, which is not limited in the embodiments of the present application. Among them, the device unique identifier is a string or code used to uniquely identify a device. In some embodiments, the device unique identifier may include but is not limited to at least one of the following: a universally unique identifier (UUID), a device serial number (SN), an international mobile equipment identity (IMEI), a device hardware identifier, etc., which is not limited in the embodiments of the present application.

[0049] The server associates and binds the first device with the second device to establish a communication relationship (communication connection) between the first device and the second device.

[0050] In some embodiments, the server sets the output device of the first device as the second device, meaning that the output device of the second device is used to play or display the multimedia content to be played or displayed by the first device.

[0051] In some embodiments, when a first device enters the casting function, the first device sends a first connection establishment request to a server, where the first connection establishment request is used to request establishment of a communication connection between the first device and the server. The casting function is a function that casts multimedia content on one device to another device for playback or display.

[0052] In some embodiments, when the second device enters the casting function, the second device sends a second connection establishment request to the server, where the second connection establishment request is used to request establishment of a communication connection between the second device and the server.

[0053] In some embodiments, a first playback interface is displayed on the first device, and a first casting control is displayed on the first playback interface. In response to an operation on the first casting control, the first device enables the casting function, triggering the step of sending a device connection request to the server. Optionally, in response to the operation on the first casting control, a first casting interface is displayed, and the first casting interface is used to select an output device for the first device.

[0054] For example, please refer to Figure 3 , which shows a schematic diagram of a first playback interface provided by an embodiment of the present application, Figure 3 A first device 300 is shown, which displays a first playback interface 310. A first casting control 321 is displayed in the first playback interface 310. A user can click the first casting control 321 to establish a communication connection with a second device by sending a device connection request to the server.

[0055] In the above manner, by carrying the identification information of the second device in the device connection request, the server can accurately locate the target device and quickly establish a communication connection between the first device and the second device, avoiding blind broadcasting or complex pairing processes.

[0056] In some embodiments, the first device performs a scanning operation on the graphic code corresponding to the second device to obtain device information of the second device, where the device information includes device identification information of the second device; the first device sends a device connection request containing the device identification information of the second device to the server.

[0057] A graphic code is a coding system that stores and transmits information through the ordered combination of a collection of graphics. In this application, the graphic code is used to store device information of the second device. In some embodiments, the graphic code may include at least one of the following: a barcode, a QR code, a customized graphic code, etc. Other types of graphic codes may also be included, which are not limited in this embodiment of the application.

[0058] Device information is a set of information related to a specified device (e.g., a second device). In some embodiments, the device information may include, but is not limited to, at least one of the following: device identification information, device name, device type information, operating system information, geographic location information, device parameters, network information, version information, manufacturer information, and certification information. Other information may also be included, which is not limited in the embodiments of this application.

[0059] The device name is the display name of the specified device. Optionally, the device name can be customized by the user or assigned by the system by default. Device type information distinguishes the functional category or physical type of the specified device and is used to indicate the purpose or function of the specified device. In some embodiments, the device type may include, but is not limited to, at least one of the following: a mobile phone, a television, a stereo, a tablet, a display, an in-vehicle terminal, a multimedia device, an AR device, a VR device, etc., and may also include other types, which are not limited in this embodiment of the present application. Operating system information is used to indicate the type and version information of the operating system running on the specified device. Geographic location information is used to indicate the geographic location of the specified device. Device parameters refer to a set of specific values, identifiers, or configuration items that describe the device's hardware, software, functional configuration, operating status, or characteristics. In some embodiments, device parameters may include, but are not limited to, at least one of the following: CPU (Central Processing Unit) parameters, GPU (Graphics Processing Unit) parameters, memory capacity, battery capacity, resolution, etc., and may also include other information, which are not limited in this embodiment of the present application. Network information is used to indicate the network identification information when the specified device accesses the network. In some embodiments, the network information may include but is not limited to at least one of the following: IP address, MAC address, network type, etc., and may also include other information, which is not limited in the embodiments of the present application. Version information is used to indicate the version of the client of the target application running in the specified device. Manufacturer information is used to indicate the manufacturer information of the factory-specified device. Authentication information is used to verify the legitimacy or access rights of the specified device. In some embodiments. Authentication information may include but is not limited to at least one of the following: authorization token, signature, timestamp, password, session code, etc., and may also include other information, which is not limited in the embodiments of the present application.

[0060] In some embodiments, the method for obtaining the graphic code of the second device may include at least one of the following: locally generated by the second device and displayed on the second device, obtained by the second device from a server and displayed on the second device, posted on the second device, stored locally on the first device, obtained by the first device from a server, etc., and may also include other acquisition methods, which are not limited in the embodiments of the present application.

[0061] In some embodiments, when the second device enters the casting function, the second device generates a graphic code of the second device according to the device identification information of the second device; and the second device displays the graphic code of the second device.

[0062] In some embodiments, the first device uses a camera function to scan a graphic code displayed by the second device to obtain device information of the second device; the first device sends a device connection request containing device identification information of the second device to the server.

[0063] For example, after the second device turns on the casting function, it automatically generates a QR code for the second device locally based on its device identification information, and displays the QR code of the second device on the second device. The first device scans the QR code displayed on the second device by turning on the camera function, which triggers the first device to send a device connection request to the server.

[0064] In some embodiments, the first broadcast interface also displays a scanning control, which is used to trigger a scanning operation on the graphic code; in response to the operation on the scanning control, the first device opens the camera and performs a scanning operation on the graphic code of the second device to obtain the device information of the second device.

[0065] In some embodiments, a historical device interface is also displayed in the first playback interface, and the historical device interface displays at least one historical device. The historical device is a device that has established a communication connection with the first device, and at least one historical device includes a second device; in response to an operation on the second device in at least one historical device, the first device triggers the first device to send a device connection request containing the device identification information of the second device to the server.

[0066] That is, historical devices that have established communication connections with the first device are directly displayed in the first playback interface of the first device, allowing the user to directly select a device to be re-established from the devices with which communication connections have been established to restore the communication connection.

[0067] In some embodiments, the historical device interface further displays the connection status of at least one historical device.

[0068] For example, Figure 3 As shown, the first play interface 310 also displays a history device interface 320 , and the history device interface 320 displays five history devices, namely history device 1 , history device 2 , history device 3 , history device 4 and history device 5 .

[0069] In the above method, the pairing operation can be quickly completed by scanning the graphic code, and then the pairing information (device identification information) is sent to the server to establish a communication connection between the devices, which improves the portability and flexibility of establishing a communication connection between the devices.

[0070] In some embodiments, after the first device and the second device successfully establish a communication connection, the first device displays a playback control interface.

[0071] For example, please refer to Figure 4 , which shows a schematic diagram of entering a connection state provided by an embodiment of the present application. After the first device 300 and the second device 400 successfully establish a communication connection, the first device 300 displays a playback control interface 330.

[0072] In some embodiments, after the first device and the second device successfully establish a communication connection, the second device displays a second casting interface, which is used to display relevant information of the first multimedia content.

[0073] In some embodiments, when the first multimedia content is in the form of music, the relevant information of the first multimedia content may include but is not limited to at least one of the following: music name, artist name, album name, cover image, lyrics information, music genre, playback progress information, etc., and may also include other information, which is not limited in this embodiment of the present application.

[0074] For example, Figure 4 As shown, after the first device 300 and the second device 400 successfully establish a communication connection, the second device 400 displays a second casting interface 410. Figure 4 The broadcasting scenario shown is an audio broadcasting scenario, so the first multimedia content played by the first device 300 and the second device 400 is music. Therefore, the second broadcasting interface 410 displays the music title, artist name information, lyrics information, playback progress and other information of the first multimedia content.

[0075] In some embodiments, at the first moment, the number of devices in communication connection with the first device may be one or more. It should be noted that the first moment may be any moment. That is, when limiting the number of devices in communication connection with the first device to one, the first device can only control the playback control of multimedia content on one device at any one time. When the number of devices in communication connection with the first device is not limited, the first device can be in communication connection with any number of devices at any one time, and can control the devices in communication connection with the first device separately.

[0076] In step 220 , the first device obtains media set information from the server. The media set information is used to indicate N multimedia contents, where N is a positive integer.

[0077] The media set information corresponds to a media set. In some embodiments, the media set includes the N multimedia contents described above. In some embodiments, the media set can be any of the following: an audio playlist, a video collection, an image collection, a live channel collection, a media album, etc. It can also be other types of media sets, which are not limited in this embodiment of the present application.

[0078] An audio playlist is a collection of several audio files. In some embodiments, the types of audio files may include, but are not limited to, at least one of the following: music, podcasts, audio books, radio programs, voice messages, sound effects, ambient sounds, radio dramas, etc., and may also include other types, which are not limited in the embodiments of the present application.

[0079] A video collection refers to a collection of multiple video files. In some embodiments, the types of video files may include, but are not limited to, at least one of the following: film and television dramas, variety shows, short videos, live broadcasts, instructional videos, animations, comics, game videos, user-generated content, news, music videos, etc. Other types may also be included, which are not limited in the present embodiment.

[0080] An image set is a collection of several images. In some embodiments, the types of images may include, but are not limited to, at least one of the following: photos, illustrations, icons, graphic codes, charts, map images, etc., and may also include other types, which are not limited in the present embodiment.

[0081] A live channel set is a collection of multiple live channel entries. A live channel is a logical channel or playback entry for real-time broadcast of live content and is bound to a specific live audio or video stream.

[0082] A media album is a collection of multimedia content with a related or unified theme. In some embodiments, the types of media albums may include, but are not limited to, at least one of the following: a music album, a learning course album, a podcast album, a film and television drama collection, etc., and may also include other types of media albums, which are not limited in this embodiment of the application.

[0083] In some embodiments, the media set information may include but is not limited to at least one of the following: content identification information of the multimedia content, content name of the multimedia content, media path, media type, duration, format, arrangement order, etc., and may also include other information, which is not limited in the embodiments of the present application.

[0084] Multimedia content refers to resources stored in digital form that can be decoded and presented by a terminal device. In some embodiments, the form of multimedia content may include, but is not limited to, at least one of the following: audio, video, image, real-time streaming, mixed, etc., and may also include other forms, which are not limited in the embodiments of this application. A mixed form is obtained by combining two or more forms.

[0085] In some embodiments, the first device filters M multimedia contents supported for playback from N multimedia contents, where M is a positive integer less than or equal to N; the first device sends the filtered media set information to the server, where the filtered media set information is used to indicate the M multimedia contents; and the server sends the filtered media set information to the second device.

[0086] The multimedia content supported for playback by the first device refers to multimedia content that the first device has permission or capability to play.

[0087] In some embodiments, when the multimedia content supported for playback by the first device is multimedia content that the first device has permission to play, the first device selects M multimedia content supported for playback from N multimedia content based on first permission information, where the first permission information indicates the first device's access control permission for the multimedia content. In some embodiments, the first permission information may include, but is not limited to, at least one of the following: user identity information, membership type, account binding information, regional restrictions, and playback limit. It may also include other information, which is not limited in this embodiment of the present application.

[0088] User identity information is used to distinguish different user accounts. The membership type is used to indicate the membership level or subscription status of the user account on the target application. In some embodiments, the membership type may include at least one of the following: non-member, ordinary member, VIP (Very Important Person) member, SVIP (Super Very Important Person) member, etc., and may also include other membership types, which are not limited in the embodiments of the present application. It is understandable that different membership types correspond to different levels of permissions, that is, the multimedia content that can be viewed is different. Account binding information is used to indicate the binding status of the user account with the device or other user accounts. Regional restriction refers to determining whether the first device has the authority to access the specified multimedia content based on the geographical location of the first device. For example, different regions have different corresponding permissions, that is, different regions support different multimedia content for playback. The play count limit is used to indicate the number of times or duration of playback of specified multimedia content.

[0089] In some embodiments, when the multimedia content supported for playback by the first device is multimedia content that the first device is capable of playing, the first device, based on the first device information, filters M multimedia content supported for playback by the first device from N multimedia content, where the first device information is used to indicate the playback capability of the first device. In some embodiments, the first device information may include, but is not limited to, at least one of the following: device type information, operating system information, GPU capabilities, CPU capabilities, screen parameters, system version, storage space, playback component support capabilities, etc., and may also include other information, which is not limited in the embodiments of the present application.

[0090] The device type information of the first device is used to indicate the type of the first device. In some embodiments, the type of the first device may include, but is not limited to, at least one of the following: a mobile phone, a tablet, a smart speaker, a television, an in-vehicle terminal, etc., and may also include other types, which are not limited in this embodiment of the application.

[0091] The operating system information of the first device is used to indicate the operating system running on the first device. The GPU capability and CPU capability are used to indicate the hardware decoding of a specific format. The screen parameters are used to indicate screen information such as the screen resolution and refresh rate of the first device. The system version of the first device is used to indicate the software version information of the operating system running on the first device. Whether the storage space of the first device has sufficient cache or download space. The playback component support capability is used to indicate whether the first device has the ability to play certain multimedia content.

[0092] In some embodiments, the first device transmits the filtered media set information to the second device via a server through transparent transmission. Transparent transmission, also known as transparent transmission, means that the filtered media set information sent by the first device is forwarded directly to the second device without any modification, parsing, or processing by the server.

[0093] In the above method, a plurality of multimedia contents are filtered by the first device, and the filtered multimedia contents are sent to the second device through the server, ensuring that the first device and the second device can access the same multimedia content, which helps the first device to deliver the specified multimedia content to the second device for playback, and subsequently synchronize the playback status of the specified multimedia content.

[0094] The first device sends the filtered media set information to the second device through the server, and the second device can determine the multimedia content that the first device can support for playback, which helps to subsequently obtain the multimedia content to be played by the first device from the server.

[0095] Step 230: The first device sends a play control instruction to the server, where the play control instruction is used to instruct play control of the first multimedia content among the N multimedia contents.

[0096] In some embodiments, the instruction content of the playback control instruction may include but is not limited to at least one of the following information: playback operation type, content identification information, playback status information, control time information, playback sequence information, etc., and may also include other information, which is not limited in the embodiments of the present application. The playback operation type is used to indicate the playback control type. The content identification information is identification information indicating the multimedia content to be controlled. The playback status information is used to indicate the real-time status of the currently playing content. In some embodiments, the playback status information may include but is not limited to at least one of the following: playback progress information, playback status, playback speed, volume, etc., and may also include other information, which is not limited in the embodiments of the present application. The control time information is used to indicate the time when the playback control instruction is issued. The playback sequence information is used to indicate the playback order of N multimedia contents.

[0097] In some embodiments, the first playback control interface displays at least one playback control control, which is used to trigger sending a playback control instruction to the server. In some embodiments, the first playback control interface also displays playback status information of the first multimedia content.

[0098] In some embodiments, in response to an operation on a first playback control control among the at least one playback control control, the first device sends a playback control instruction corresponding to the first playback control control to the server.

[0099] In some embodiments, the playback control controls include at least one of the following: a previous control, a play / pause control, a next control, a volume control, a playback progress bar, a playback order control, a favorites control, a MV (Music Video) lyrics switch control, a sound quality adjustment control, a subtitle switch control, and the like. Other controls may also be included, which are not limited in the embodiments of the present application. The previous control is used to switch to the previous multimedia content. The play / pause control is used to play or pause the current multimedia content. The next control is used to switch to the next multimedia content. The volume control is used to adjust the volume of the multimedia content. The playback progress bar is used to display the playback progress of the current multimedia content. In some embodiments, the playback progress of the current multimedia content is adjusted in response to an operation on the playback progress bar. In some embodiments, the operation on the playback progress bar includes at least one of the following: dragging the playback progress bar with a mouse, touch-dragging the playback progress bar, issuing a voice command to adjust the playback progress of the current multimedia content, entering a playback time, and the like. Other operations may also be included, which are not limited in the embodiments of the present application. The playback order control is used to control the playback mode of the multimedia content and determine the logic for playing the next multimedia content. In some embodiments, the playback mode includes at least one of the following: sequential playback, single song loop, list playback, random playback, etc., and may also include other playback modes, which are not limited in the embodiments of the present application. The collection control is used to collect the current multimedia content into a specified collection. In some embodiments, the specified collection can be a collection pre-created by relevant technical personnel, or a collection created by the user. The MV lyrics switching control is used to switch the display of the lyrics information or MV of the current multimedia content. The subtitle switch control is used to control the display of the subtitles corresponding to the current multimedia content on or off. The sound quality adjustment control is used to adjust the audio quality output by the first multimedia content. The list control is used to display a list of multimedia content to be played.

[0100] For example, Figure 4 As shown, the playback control interface 330 displayed by the first device 300 includes a volume increase control 331, a volume decrease control 332, a previous control 333, a next control 334, a play pause control 335, a lyrics MV switch control 336, a playback progress bar 337, a playback order control 338, a sound quality adjustment control 339, a collection control 340 and a list control 341.

[0101] Step 240: The server sends a playback control instruction to the second device.

[0102] It can be understood that the playback control instruction sent by the first device is a playback control instruction forwarded to the second device through the server, and the playback control instruction is used to control the playback of the first multimedia content by the second device.

[0103] Step 250: The second device controls the playback of the first multimedia content according to the playback control instruction.

[0104] After receiving the playback control instruction, the second device performs a playback control operation on the specified multimedia content according to the instruction content of the playback control instruction.

[0105] In some embodiments, the playback control instruction includes a playback operation type and content identification information of the first multimedia content, and the playback operation type is used to indicate a playback control operation for the first multimedia content; when the playback operation type is a playback operation for the first multimedia content, the second device sends a content acquisition request including content identification information to the server, and the content acquisition request is used to acquire the first multimedia content; the server sends the first multimedia content to the second device based on the content acquisition request; and the second device plays the first multimedia content.

[0106] The playback operation type is used to clearly indicate to the second device a specific playback control operation for the first multimedia content. In some embodiments, the playback operation type may include, but is not limited to, at least one of the following: a playback operation for the first multimedia content, a pause operation for the first multimedia content, a MV lyrics switching operation for the first multimedia content, a playback progress adjustment operation for the first multimedia content, a volume increase operation for the first multimedia content, a volume decrease operation for the first multimedia content, a fast-forward operation for the first multimedia content, a favorite operation for the first multimedia content, a sound quality adjustment operation for the first multimedia content, etc. Other types may also be included, which are not limited in the embodiments of the present application.

[0107] Content identification information is used to distinguish different multimedia content. In some embodiments, content identification information may include, but is not limited to, at least one of the following: a content ID, a URL (Uniform Resource Locator) address, a hash value, a resource path identifier, a combination of media metadata identifiers, and other information. This embodiment of the present application does not limit this.

[0108] In some embodiments, when the second device receives the playback control instruction, the second device obtains the first multimedia content from the server based on the content identification information of the first multimedia content. This operation can also be referred to as the second device downloading or pulling the first multimedia content from the server based on the content identification information of the first multimedia content.

[0109] When the play operation type is a play operation for the first multimedia content, the second device pulls the first multimedia content from the server according to the content identification information of the first multimedia content.

[0110] The content acquisition request is used to indicate to the server the multimedia content required by the second device, so that the server returns the corresponding multimedia content to the second device.

[0111] In some embodiments, when a second device receives the first multimedia content, the second device performs a play operation on the first multimedia content. Optionally, the play operation may include, but is not limited to, at least one of the following: decoding the first multimedia content, rendering the first multimedia content, playing the first multimedia content, etc., and may also include other operations, which are not limited in this embodiment of the present application.

[0112] In the above method, the control device (first device) only needs to issue a playback control instruction, which is forwarded to the controlled device (second device) through the server. The controlled device automatically pulls the multimedia content corresponding to the content instruction information from the server according to the content instruction information in the playback control instruction, and plays the obtained multimedia content on the controlled device, without the need for the control device to transmit the multimedia content to the controlled device. This effectively reduces the consumption of network bandwidth and computing resources, and improves the response speed and energy efficiency of the controlled device. In other words, the content data of the multimedia content does not need to be transferred through the control device, avoiding the problem of increased playback control delay of the control device due to secondary transmission of the content data of the multimedia content, and improving the overall playback efficiency and stability of the control device controlling the controlled device for multimedia content.

[0113] In some embodiments, the playback control instruction includes playback mode information, which is used to indicate the playback order of multimedia content; when the second device completes playing the first multimedia content, the second device determines the next second multimedia content to be played based on the playback mode information and the filtered media set information; and the second device plays the second multimedia content.

[0114] The play mode information is used to indicate the play order of the M multimedia contents.

[0115] In some embodiments, the playback order of multimedia content may include but is not limited to at least one of the following: sequential playback, single song loop, list loop, random playback, single playback, etc., and may also include other playback orders, which are not limited in the embodiments of the present application.

[0116] In the above manner, the control device can instruct the controlled device on the playback order of multimedia content, so that when the controlled device completes playing the currently played multimedia content, it can automatically play the next multimedia content, without the control device having to send a playback control instruction again to instruct the next multimedia content to be played, which helps to improve the continuity and stability of the playback of the controlled device.

[0117] In some embodiments, the second device sends status feedback information to the server, where the status feedback information is used to indicate the playback status of the first multimedia content; the server synchronizes the playback status of the first device and the second device for the first multimedia content based on the status feedback information.

[0118] It can be understood that the status feedback information is used to indicate the playback status of the first multimedia content in the second device. In some embodiments, the status feedback information may include but is not limited to at least one of the following: content identification information of the first multimedia content, playback progress information, playback status, playback speed, volume, abnormal information, etc., and may also include other information, which is not limited in the embodiments of the present application. The abnormal information is used to indicate an abnormal state or error information that occurs when the second device plays the first multimedia content. In some embodiments, the abnormal information may include but is not limited to at least one of the following: decoding failure, loading failure, playback interruption, network abnormality, permission error, resource non-existence, media output error, etc., and may also include other abnormal information, which is not limited in the embodiments of the present application.

[0119] In some embodiments, the server sends status feedback information to the first device; the first device adjusts the playback status of the first multimedia content based on the status feedback information. In some embodiments, the first device adjusts the playback status information of the first multimedia content displayed on the first casting interface based on the status feedback information.

[0120] In some embodiments, the first playback control interface of the first device further displays device information of the first device. For example, the first playback control interface further displays information such as the device name, device type, and device model of the first device, and may also display other device information.

[0121] In some embodiments, the second casting interface of the second device further displays device information of the second device. For example, the second casting interface further displays information such as the device name, device type, and device model of the second device, and may also display other device information.

[0122] For example, Figure 4 As shown, the device name 420 of the second device 400 is displayed in the second casting interface 410 of the second device 400.

[0123] It should be noted that the device information has been introduced above and will not be repeated here.

[0124] In some embodiments, the second casting interface displays at least one playback control control, which is used to control the playback of multimedia content on the second device.

[0125] In some embodiments, in response to an operation on a second playback control control of at least one playback control control in the second projection interface, the second device performs a playback control operation corresponding to the second playback control control on the first multimedia content.

[0126] That is to say, the user does not need to control the playback of the multimedia content played on the second device through the first device, but can directly control the playback of the multimedia content played on the second device through the second casting interface of the second device.

[0127] For example, Figure 4 As shown, the second broadcast interface 410 of the second device 400 displays a playback progress bar 411, a playback order control 412, an MV lyrics playback control 413, a previous control 414, a next control 415, a play pause control 416, a sound quality adjustment control 417, a collection control 418, and a list control 419.

[0128] In some embodiments, when the second device performs a playback control operation corresponding to the second playback control control on the first multimedia content, the second device performs the step of sending status feedback information to the server, thereby synchronizing the playback status of the first multimedia content on the first device and the second device.

[0129] In some embodiments, the first device sends control status information to the server, where the control status information is used to indicate the playback status of the first multimedia content in the first device; the server synchronizes the playback status of the first multimedia content between the first device and the second device based on the control status information and status feedback information.

[0130] In some embodiments, the control status information may include but is not limited to at least one of the following: content identification information of the first multimedia content, playback progress information, playback status, playback speed, volume, abnormal information, etc., and may also include other information, which is not limited in this embodiment of the present application.

[0131] That is, although the first device transfers the output task of the first multimedia content to the second device, the current playback status of the first multimedia content is still stored and displayed on the first device. Therefore, the first device needs to upload control status information and the second device needs to upload status feedback information so that the server can synchronize the playback status of the first multimedia content on the first and second devices.

[0132] In the above method, the controlled device (second device) transmits status feedback information for the currently playing multimedia content to the server, so that the server can maintain the consistency of the playback status of the currently playing multimedia content between the controlled device and the control device (first device) based on the status feedback information, thereby realizing collaborative playback and seamless control experience among multiple devices.

[0133] In summary, the technical solution provided by the embodiments of the present application enables the control device (first device) and the controlled device (second device) to establish a communication connection through a server, and forward the playback control instructions sent by the control device to the controlled device through the server, thereby enabling the control device to control the playback of multimedia content on the controlled device. In this manner, the control device and the controlled device are connected through the server, so that the control device's control over the controlled device is not limited by the distance between the devices, effectively improving the stability of the communication connection between the control device and the controlled device and the playback of multimedia content.

[0134] In addition, the server indicates multiple playable multimedia contents to the control device through the media set information. The control device determines the first multimedia content from the multiple playable multimedia contents, and sends a playback control instruction for the first multimedia content to the second device through the server to control the playback control of the first multimedia content by the second device, which helps to improve the playback control and control efficiency of the multimedia content by the first device over the second device.

[0135] The following describes the process of applying the playback control method to the audio playback scenario.

[0136] Please refer to Figure 5 , which shows a flowchart of a playback control method in an audio playback scenario provided by an embodiment of the present application.

[0137] Step 1: The second device generates a QR code according to the device identification information.

[0138] In some embodiments, the second device displays the QR code, which includes device identification information of the second device.

[0139] Step 2: The second device enters the broadcast function and establishes a WebSocket communication connection with the server.

[0140] That is to say, after the second device generates and displays the QR code corresponding to the second device, the second device can enter the casting function and wait for the control device to establish a communication connection with the second device.

[0141] Step 3: The first device enters the broadcast function and establishes a WebSocket communication connection with the server.

[0142] Step 4: The first device sets the second device as the output device of the first device by scanning the QR code of the second device.

[0143] The first device scans the QR code of the second device to obtain the device identification information of the second device, and triggers the sending of a device connection request containing the device identification information of the second device to the server. After receiving the device connection request from the first device, the server sets the output device of the first device to the second device.

[0144] Step 5: The server returns the song collection information of the first device to the first device.

[0145] The song collection information is used to indicate N songs, where N is a positive integer. In some embodiments, the N songs are songs corresponding to the first device. In some embodiments, the N songs are all songs stored in the server.

[0146] Step 6: The first device sends the filtered song collection information to the server.

[0147] The filtered song collection information is used to indicate M songs, where M is a positive integer less than or equal to N. In some embodiments, the first device filters M songs supported for playback from the N songs.

[0148] Step 7: The server transparently transmits the filtered song collection information to the second device.

[0149] Step 8: The first device sends a playback control instruction to the server.

[0150] Step 9: The server forwards the playback control instruction to the second device.

[0151] Step 10: The second device executes the playback control logic corresponding to the playback control instruction.

[0152] In some embodiments, the second device pulls the song corresponding to the playback control instruction from the server according to the playback control instruction.

[0153] Step 11: The second device sends status feedback information to the server.

[0154] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0155] Please refer to Figure 6, which shows a block diagram of a computer system provided by an embodiment of the present application. The device has the functions of implementing the above examples, and the functions can be implemented by hardware or by hardware executing corresponding software. The device can be the computer system described above, or it can be set in a computer system. Figure 6 As shown, the apparatus 600 may include a first device 610 , a server 620 , and a second device 630 .

[0156] The first device 610 is configured to establish a communication connection with the second device through the server.

[0157] The first device 610 is further configured to obtain media set information from the server, where the media set information is used to indicate N multimedia contents, where N is a positive integer.

[0158] The first device 610 is further configured to send a playback control instruction to the server, where the playback control instruction is used to instruct playback control of a first multimedia content among the N multimedia contents.

[0159] The server 620 is configured to send the playback control instruction to the second device.

[0160] The second device 630 is configured to control the playback of the first multimedia content according to the playback control instruction.

[0161] In some embodiments, the first device is further used to filter M multimedia contents supported for playback by the first device from the N multimedia contents, where M is a positive integer less than or equal to N; the first device is further used to send the filtered media set information to the server, where the filtered media set information is used to indicate the M multimedia contents; the server is further used to send the filtered media set information to the second device.

[0162] In some embodiments, the playback control instruction includes playback mode information, and the playback mode information is used to indicate the playback order of the multimedia content. When the second device completes playing the first multimedia content, the second device is further used to determine the next second multimedia content to be played based on the playback mode information and the filtered media set information; the second device is also used to play the second multimedia content.

[0163] In some embodiments, the playback control instruction includes a playback operation type and content identification information of the first multimedia content, and the playback operation type is used to indicate a playback control operation for the first multimedia content; when the playback operation type is a playback operation for the first multimedia content, the second device is further used to send a content acquisition request including the content identification information to the server, and the content acquisition request is used to acquire the first multimedia content; the server is further used to send the first multimedia content to the second device based on the content acquisition request; the second device is further used to play the first multimedia content.

[0164] In some embodiments, the first device is further used to send a device connection request to the server, wherein the device connection request is used to request establishment of the communication connection between the first device and the second device, and the device connection request includes device identification information of the second device; the server is further used to establish the communication connection between the first device and the second device based on the device identification information of the second device.

[0165] In some embodiments, the first device is further used to perform a scanning operation on the graphic code corresponding to the second device to obtain device information of the second device, where the device information includes device identification information of the second device; the first device is further used to send a device connection request containing the device identification information of the second device to the server.

[0166] In some embodiments, the second device is further used to send status feedback information to the server, where the status feedback information is used to indicate the playback status of the first multimedia content; the server is further used to synchronize the playback status of the first device and the second device for the first multimedia content based on the status feedback information.

[0167] In summary, the technical solution provided by the embodiments of the present application enables the control device (first device) and the controlled device (second device) to establish a communication connection through a server, and forward the playback control instructions sent by the control device to the controlled device through the server, thereby enabling the control device to control the playback of multimedia content on the controlled device. In this manner, the control device and the controlled device are connected through the server, so that the control device's control over the controlled device is not limited by the distance between the devices, effectively improving the stability of the communication connection between the control device and the controlled device and the playback of multimedia content.

[0168] In addition, the server indicates multiple playable multimedia contents to the control device through the media set information. The control device determines the first multimedia content from the multiple playable multimedia contents, and sends a playback control instruction for the first multimedia content to the second device through the server to control the playback control of the first multimedia content by the second device, which helps to improve the playback control and control efficiency of the multimedia content by the first device over the second device.

[0169] It should be noted that the apparatus provided in the above embodiments, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0170] Please refer to Figure 7 , which shows a block diagram of a computer device 700 provided in one embodiment of the present application. The computer device 700 may be Figure 1 The first device 10 in the computer system shown may also be Figure 1 The second device 20 in the computer system shown can also be Figure 1 The server 30 in the computer system shown is used to implement the playback control method provided in the above embodiment. Specifically:

[0171] Typically, the computer device 700 includes a processor 710 and a memory 720 .

[0172] The processor 710 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 710 may be implemented in at least one hardware form of digital signal processing (DSP), field programmable gate array (FPGA), and programmable logic array (PLA). The processor 710 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a central processing unit (CPU); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 710 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 710 may also include an AI processor for processing computing operations related to machine learning.

[0173] The memory 720 may include one or more computer-readable storage media, which may be non-transitory. The memory 720 may also include high-speed random access memory and non-volatile memory, such as one or more magnetic disk storage devices or flash memory storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 720 is used to store a computer program, which is configured to be executed by one or more processors to implement the above-mentioned playback control method.

[0174] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the computer device 700, and the computer device 700 may include more or fewer components than shown in the figure, or combine some components, or adopt a different component arrangement.

[0175] In an exemplary embodiment, a computer-readable storage medium is further provided, wherein a computer program is stored in the storage medium, and when the computer program is executed by the processor, the computer program implements the above-mentioned playback control method. Optionally, the computer-readable storage medium may include: read-only memory (ROM), random access memory (RAM), solid state drive (SSD), or optical disk, etc. Among them, the random access memory may include resistance random access memory (ReRAM) and dynamic random access memory (DRAM).

[0176] In an exemplary embodiment, a computer program product is further provided, comprising a computer program stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium and executes the computer program, causing the computer device to perform the aforementioned playback control method.

[0177] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application do not limit this.

[0178] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A playback control method, characterized in that: The method comprises: The first device establishes a communication connection with the second device through the server; The first device obtains media set information from the server, where the media set information is used to indicate N multimedia contents, where N is a positive integer; The first device sends a playback control instruction to the server, where the playback control instruction is used to instruct playback control of a first multimedia content among the N multimedia contents; The server sends the playback control instruction to the second device; The second device controls the playback of the first multimedia content according to the playback control instruction.

2. The method according to claim 1, characterized in that The method further comprises: The first device selects M multimedia contents supported for playback from the N multimedia contents, where M is a positive integer less than or equal to N; The first device sends the filtered media set information to the server, where the filtered media set information is used to indicate the M multimedia contents; The server sends the filtered media set information to the second device.

3. The method according to claim 2, characterized in that The playback control instruction includes playback mode information, where the playback mode information is used to indicate a playback order of the multimedia content. The method further includes: When the second device completes playing the first multimedia content, the second device determines a second multimedia content to be played next according to the play mode information and the filtered media set information; The second device plays the second multimedia content.

4. The method according to any one of claims 1 to 3, characterized in that The playback control instruction includes a playback operation type and content identification information of the first multimedia content, wherein the playback operation type is used to indicate a playback control operation for the first multimedia content; The second device controls the playback of the first multimedia content according to the playback control instruction, including: When the playback operation type is a playback operation for the first multimedia content, the second device sends a content acquisition request including the content identification information to the server, where the content acquisition request is used to acquire the first multimedia content; The server sends the first multimedia content to the second device based on the content acquisition request; The second device plays the first multimedia content.

5. The method according to any one of claims 1 to 4, characterized in that The first device establishes a communication connection with the second device through the server, including: The first device sends a device connection request to the server, where the device connection request is used to request establishment of the communication connection between the first device and the second device, and the device connection request includes device identification information of the second device; The server establishes the communication connection between the first device and the second device according to the device identification information of the second device.

6. The method according to claim 5, characterized in that The first device sending a device connection request to the server includes: The first device performs a scanning operation on the graphic code corresponding to the second device to obtain device information of the second device, where the device information includes device identification information of the second device; The first device sends a device connection request including the device identification information of the second device to the server.

7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: The second device sends status feedback information to the server, where the status feedback information is used to indicate a playback status of the first multimedia content; The server synchronizes the playback status of the first multimedia content between the first device and the second device according to the status feedback information.

8. A computer system, characterized in that: The system comprises: The first device is configured to establish a communication connection with the second device through the server; The first device is further configured to obtain media set information from the server, where the media set information is used to indicate N multimedia contents, where N is a positive integer; The first device is further configured to send a playback control instruction to the server, where the playback control instruction is used to instruct playback control of a first multimedia content among the N multimedia contents; The server is configured to send the playback control instruction to the second device; The second device is configured to control the playback of the first multimedia content according to the playback control instruction.

9. A computer device, characterized in that: The computer device includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The storage medium stores a computer program, and the computer program is configured to be executed by a processor to implement the method according to any one of claims 1 to 7.

11. A computer program product, characterized in that The computer program product comprises a computer program, which is loaded and executed by a processor to implement the method according to any one of claims 1 to 7.

Images