Audio playing control method and device, equipment, system, storage medium

Abstract

Embodiments of the present application provide an audio playing control method and device, equipment, system and storage medium, wherein the audio playing control method based on a sound box cloud server comprises: searching target audio metadata in a cloud sound box private music library in response to an on-demand instruction of a target audio, the cloud sound box private music library storing local audio metadata, the local audio metadata comprising an audio name, an audio ID and a local playing address of the audio; and performing local playing according to the searched target audio metadata, the local playing comprising sending an audio playing instruction to a sound box, the audio playing instruction comprising the local playing address of the target audio. The technical solution provided by the present application does not need to upload local audio of a local device to a cloud database, avoids occupying a large amount of cloud space, and avoids the problem of data leakage.

Description

Technical Field

[0001] This invention relates to the field of audio processing technology, and in particular to an audio playback control method, apparatus, device, system, and storage medium. Background Technology

[0002] Existing smart speakers offer voice control for playback, and their cloud-based music libraries provide online audio content. For example, ... Figure 1 As shown, when a user requests music via voice, the user gives the voice command "play music". At this time, the speaker requests the playback content from the speaker cloud server. The speaker cloud server queries the cloud music library to obtain the playback content and returns the ID of the audio content or the online playback address from the cloud music library. Based on the obtained audio content ID or online playback address, the speaker downloads the audio content from the third-party content provider (CP) and plays it.

[0003] like Figure 2 As shown, in the prior art, in order to play music on a user's terminal via voice command through a smart speaker, the audio files of the user's terminal's music need to be uploaded and stored in the terminal's cloud music library. When the user gives the voice command "play music", the speaker requests the playback content from the speaker cloud server. The speaker cloud server queries the cloud music library to obtain the playback content and returns the online playback address of the audio content to the speaker. The speaker then plays the audio based on the online playback address.

[0004] In the existing technology, the above-mentioned solution of playing user-owned music on a smart speaker via voice requires the user to upload the music on the terminal to the terminal's cloud music library, which requires a lot of cloud space, and the data stored in the cloud music library is also at risk of content leakage. Summary of the Invention

[0005] This invention provides an audio playback control method, apparatus, system, and storage medium. The control method synchronizes audio metadata from a local device to a private cloud-based speaker music library on a speaker cloud server. Based on the user's voice request, the speaker cloud server searches for target audio metadata in the cloud-based private music library and sends an audio playback command containing the audio playback address to the speaker, enabling voice-activated playback of local audio from the local device. This invention eliminates the need to upload local audio from the local device to a cloud database, avoiding the consumption of large amounts of cloud space and preventing data leakage.

[0006] This invention provides an audio playback control method based on a speaker cloud server, comprising:

[0007] In response to the on-demand command for the target audio, the system searches for the target audio metadata in the cloud speaker's private music library. The cloud speaker's private music library stores local audio metadata, which includes the audio name, audio ID, and the local playback address of the audio.

[0008] Local playback is performed based on the target audio metadata found. Local playback includes sending an audio playback command to the speaker, which includes the local playback address of the target audio.

[0009] Furthermore, the local audio metadata also includes the device ID of the corresponding local device, the rights type of the audio, and the source application information. The rights type includes shared rights and exclusive rights.

[0010] Local playback includes:

[0011] If the rights type of the target audio metadata found is shared rights, a shared rights audio playback instruction is sent to the speaker. The shared rights audio playback instruction includes the local playback address of the target audio.

[0012] If the target audio metadata found has a privilege type of exclusive privilege, then send an exclusive privilege audio playback command to the speaker. The exclusive privilege playback command includes the device ID, source application information and audio ID from the target audio metadata.

[0013] Furthermore, before performing local playback, it also includes:

[0014] In response to the on-demand command for the target audio, the system searches for the target audio metadata in the public music library of the cloud speaker. The public music library of the cloud speaker stores cloud audio metadata, which includes the audio name, audio ID, audio quality, and the cloud playback address of the audio. The local audio metadata also includes the audio quality.

[0015] If the target audio metadata is found in both the public music library and the private music library of the cloud speaker, and the target audio quality in the public music library is higher than that in the private music library, then a cloud playback command is sent to the speaker. The cloud playback command includes the cloud playback address of the target audio in the public music library of the cloud speaker.

[0016] If the target audio metadata is found in both the public and private music libraries of the cloud speaker, and the target audio quality in the public music library is lower than that in the private music library, then local playback will be performed.

[0017] Furthermore, the method also includes:

[0018] Obtain device information of the local device sent by the speaker application and store it in the cloud speaker device information database.

[0019] Furthermore, the method also includes:

[0020] Based on the device information, a local audio metadata update command is sent to the speaker. The audio metadata update command includes the device address, access protocol, and access credentials of each local device.

[0021] Retrieve the updated list of local audio metadata from the speaker;

[0022] Update the private music library of the cloud speaker based on the audio metadata update list.

[0023] Furthermore, the method also includes:

[0024] Get the local device address update information sent by the speaker. The local device address update information includes the device ID of the local device and the device update address.

[0025] Based on the device ID, determine the corresponding device information in the cloud device information database, and update the device address in the corresponding device information according to the device update address.

[0026] This invention also provides an audio playback control method based on a local device, comprising:

[0027] Get audio metadata from the local device;

[0028] Send the acquired audio metadata from the local device to the speaker cloud server;

[0029] The audio metadata includes: audio ID, audio name, performer name, audio quality, local playback address, rights type, source application information, and device ID.

[0030] Furthermore, before obtaining the list of audio metadata for the local device, the method also includes:

[0031] Identify the local devices providing local audio in the distributed network, and obtain the access protocols of the local devices through distributed queries;

[0032] After determining that the local device requires login authorization, perform the login operation and cache the access credentials;

[0033] Send the device information of the local device to the speaker cloud server;

[0034] The device information includes: device ID, device address, access protocol, access credentials, device name, and user ID.

[0035] Furthermore, the local device stores local audio and its audio metadata, including the following methods:

[0036] Obtain the exclusive rights playback instruction sent by the speaker cloud server. The exclusive rights playback instruction includes the device ID, source application information, and audio ID from the target audio metadata.

[0037] Launch the appropriate audio playback application based on the source application information;

[0038] The system determines whether the target audio exists in the audio playback application's music library based on the audio ID. If so, it sends a cloud playback command to the speaker, which includes the cloud playback address of the target audio in the audio playback application's music library.

[0039] This invention also provides a speaker-based audio playback control method, comprising:

[0040] Send a play command for the target audio to the speaker cloud server;

[0041] Obtain audio playback commands sent by the speaker cloud server;

[0042] Play the target audio according to the local playback address of the target audio in the audio playback command.

[0043] Furthermore, the audio playback command is a shared rights audio playback command;

[0044] The method also includes:

[0045] Obtain the speaker cloud playback command sent by the speaker cloud server, and play the target audio according to the cloud playback address of the target audio in the speaker cloud playback command;

[0046] Obtain the exclusive audio playback instruction sent by the speaker cloud server, and send the exclusive audio playback instruction to the corresponding local device according to the device ID in the exclusive audio playback instruction. The exclusive audio playback instruction includes the device ID, source application information and audio ID in the target audio metadata.

[0047] Alternatively, obtain the application cloud playback command sent by the local device, and play the target audio according to the cloud playback address of the target audio in the application cloud playback command.

[0048] Furthermore, the method also includes:

[0049] Obtain the audio metadata update command sent by the speaker cloud server;

[0050] Based on the device address, access protocol, and access credentials in the audio metadata update instruction, the corresponding local device is accessed periodically to periodically obtain the local device's audio metadata update list;

[0051] Send the updated list of audio metadata obtained in the current period to the speaker cloud server.

[0052] Furthermore, the method also includes:

[0053] It has been determined that the speaker cannot access the local device.

[0054] Get the device update address of the local device;

[0055] Send local device address update information to the speaker cloud server. The local device address update information includes the device update address and device ID of the local device.

[0056] This invention also provides a speaker-based audio playback control method, comprising:

[0057] Send a local device audio playback command to the speaker cloud server. The local device audio playback command contains the device name of the corresponding local device.

[0058] Obtain device information sent by the speaker cloud server based on the device name. The device information includes at least the device address, access protocol, and access credentials.

[0059] Distributed query of audio metadata for the corresponding local device based on device information;

[0060] Perform local playback based on audio metadata;

[0061] Local playback includes:

[0062] Determine the rights type in the audio metadata as a shared rights, and play the local audio from the local device based on the local playback address in the audio metadata; or

[0063] The rights type in the audio metadata is determined to be exclusive rights, and an exclusive rights audio playback instruction is sent to the local device based on the device ID in the audio metadata. The exclusive rights playback instruction includes the source application information of the target audio and the audio ID.

[0064] This invention also provides an audio playback control device based on a speaker cloud server, comprising:

[0065] The processor and memory are used to store at least one instruction, which is loaded and executed by the processor to implement the above-described audio playback control method based on the speaker cloud server.

[0066] This invention also provides an audio playback control device based on a local device, comprising:

[0067] The processor and memory, wherein the memory is used to store at least one instruction, which is loaded by the processor and executed to implement the above-described local device-based audio playback control method.

[0068] This invention also provides a speaker-based audio playback control device, comprising:

[0069] The processor and memory, wherein the memory is used to store at least one instruction, which is loaded by the processor and executed to implement any of the speaker-based audio playback control methods described above.

[0070] This invention also provides a speaker cloud server, including: an audio playback control device based on the speaker cloud server.

[0071] This invention also provides a local device, comprising:

[0072] Audio playback control device based on local device.

[0073] This invention also provides a speaker, including: an audio playback control device based on the speaker.

[0074] This invention also provides an audio playback control system, comprising:

[0075] One or more local devices;

[0076] Speakers; and

[0077] Speaker cloud server.

[0078] This invention also provides a computer-readable storage medium storing a computer program thereon. When the computer program is executed by a processor, it implements the above-described audio playback control method based on a speaker cloud server, the audio playback control method based on a local device, or any of the above-described audio playback control methods based on a speaker.

[0079] The above technical solution synchronizes audio metadata from the local device to the private music library of the speaker cloud server. Based on the user's voice request, the speaker cloud server searches for the target audio metadata in the private music library and sends an audio playback command containing the local audio playback address to the speaker, enabling users to play local audio from the local device via voice request. This invention eliminates the need to upload local audio from the local device to the cloud database, avoiding the consumption of large amounts of cloud space and preventing data leakage. Attached Figure Description

[0080] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0081] Figure 1 This is a schematic diagram of the cloud-based online audio process for voice-activated speakers in existing technologies.

[0082] Figure 2 This is a schematic diagram of the local audio flow in a voice-on-demand terminal in the prior art;

[0083] Figure 3 This is a schematic diagram of the system architecture provided in an embodiment of the present invention;

[0084] Figure 4 This is a schematic diagram of the device information acquisition process for a local device provided in an embodiment of the present invention;

[0085] Figure 5 This is a schematic diagram of the audio metadata acquisition process for local audio provided in an embodiment of the present invention;

[0086] Figure 6 This is a schematic diagram of the audio playback process provided in an embodiment of the present invention;

[0087] Figure 7 This is a schematic diagram of the exclusive audio playback process provided in an embodiment of the present invention;

[0088] Figure 8 This is a schematic diagram of the device address update process provided in an embodiment of the present invention;

[0089] Figure 9 A schematic diagram of the structure of an audio playback control device based on a speaker cloud server provided in an embodiment of the present invention;

[0090] Figure 10 This is a schematic diagram of the structure of an audio playback control device based on a local device provided in an embodiment of the present invention;

[0091] Figure 11 A schematic diagram of the structure of a speaker-based audio playback control device provided in an embodiment of the present invention;

[0092] Figure 12 This is a schematic diagram of the structure of the audio playback control system provided in an embodiment of the present invention. Detailed Implementation

[0093] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0094] Figure 3The diagram illustrates a system architecture provided by an embodiment of the present invention, as shown in the illustration. Figure 3 As shown, the system architecture provided by this invention includes a local device, a speaker, a speaker application, and a speaker cloud server.

[0095] The local device provides local audio content and corresponding audio metadata. This local device can be, for example, a mobile phone, tablet, or television, and both the local device and the speaker belong to the same distributed network.

[0096] This speaker application supports browsing local audio content on local devices and uploading the corresponding audio metadata to the speaker cloud server. The speaker application runs on at least one local device. Login can be performed through the speaker application, and access credentials can be cached so that the speaker can query the local device using the access credentials and the access protocol provided by the local device.

[0097] The speaker cloud server includes a private music library (storing audio metadata of local audio from local devices), a public music library (storing audio metadata of online audio from the speaker cloud), and a device information library (storing device information of local devices). It can simultaneously search for target audio metadata in the private and public music libraries in response to voice-activated playback commands, and issue different audio playback commands based on the audio information. The audio playback commands can be sent directly to the speaker or sent from the speaker to the corresponding local device that provides the target audio.

[0098] This speaker supports playing corresponding audio according to audio playback commands.

[0099] The above is a brief description of the system architecture and the functions of each part within the architecture.

[0100] The following pre-operation is required before playing audio according to voice-activated playback commands:

[0101] Operation 1: The speaker application obtains device information of each local device in the distributed network and uploads the obtained device information to the speaker cloud server;

[0102] Operation 2: The speaker application obtains the audio metadata of the local audio in the corresponding local device based on the device information, and uploads the obtained audio metadata to the speaker cloud server.

[0103] Regarding Operation 1

[0104] Figure 4 This diagram illustrates the device information acquisition process for a local device according to an embodiment of the present invention. Figure 4 As shown, the following steps can be used to obtain and upload device information for a local device:

[0105] Step 401: The speaker application identifies the local device providing local audio in the distributed network and obtains the access protocol of the local device through distributed query;

[0106] Step 402: After the speaker application determines that the local device needs to log in and authorize, it performs the login operation and caches the access credentials;

[0107] Step 403: Customize the device name of the local device in the speaker application interface;

[0108] Step 404: The speaker application sends the device information of the local device to the speaker cloud server.

[0109] Specific instructions for steps 401-404:

[0110] Local devices in a distributed network store local audio and its metadata. The speaker application is installed on one of these local devices (devices that support the speaker application). This means other local devices providing local audio in the distributed network do not need to have the speaker application installed or support it. To upload the audio metadata to the speaker cloud server, the speaker application first needs to perform a distributed query of the access protocols of each local device in the distributed network. If it determines that the local device requires login authorization, the speaker application performs the authorization login operation and caches the access credentials. Furthermore, the device name of the local device can be customized, and the device ID, device address, and user ID of the local device can be determined. The speaker application integrates the above information to obtain the device information of the local device as shown in Table 1.

[0111] Table 1

[0112] Device ID Device address Access Protocol Access credentials Device Name User ID XXXXXX XXXXXX XXXXXX XXXXXX XXXXXX XXXXXX

[0113] The device ID is a unique identifier for the local device.

[0114] The device address is a network-accessible address and supports audio access;

[0115] This access protocol supports multiple audio content lists;

[0116] This access credential is the information used by the speaker to access the local device.

[0117] The device name is a user-defined name for the local device, and users can make voice requests based on the device name.

[0118] This user ID represents the user ID of the local device, and only this user can access the local device through the speaker application.

[0119] The speaker application sends the integrated device information to the speaker cloud server. After receiving the device information of the local device sent by the speaker application, the speaker cloud server stores the device information in the cloud speaker device information database.

[0120] In one feasible embodiment, the process of acquiring device information for the local device can also be triggered by the speaker. Specifically, after joining the distributed network where the local device resides, the speaker can obtain the access protocols of each local device in the distributed network through distributed queries. If it is determined that the local device requires login authorization, the speaker application is triggered to perform an authorization login operation and cache the access credentials. After the speaker application authorizes the login, the speaker will determine the device ID, device address, and user ID of the local device. The acquired information is integrated to obtain the device information of the local device as shown in Table 1. The speaker sends the integrated device information to the speaker cloud server. After receiving the device information of the local device sent by the speaker, the speaker cloud server stores the device information in the cloud speaker device information database.

[0121] The above is an explanation of the equipment information acquisition process.

[0122] Regarding Operation 2

[0123] After determining the device information of the local device, such as Figure 5 As shown, the speaker application can obtain audio metadata of local audio in the local device based on the relevant information in the device information.

[0124] Specifically, the acquisition and uploading of device information is achieved according to the following steps:

[0125] Step 501: The speaker application obtains the list of audio content in the local device (i.e., the audio metadata of the local audio) based on the access protocol provided by the local device.

[0126] Step 502: The speaker application sends the obtained local audio metadata to the speaker cloud server and stores the local audio metadata in the cloud speaker private music library.

[0127] The audio metadata is shown in Table 2:

[0128] Table 2

[0129]

[0130] In one feasible embodiment, the speaker may also perform step 503: periodically refresh its own music library;

[0131] Regarding step 503

[0132] The speaker periodically retrieves audio metadata from the local audio on the local device and sends the retrieved audio metadata to the speaker cloud server. The speaker cloud server then replaces the original data (the audio metadata of the previously stored local audio) in the cloud speaker's private music library with the retrieved audio metadata to update the audio metadata.

[0133] In one feasible embodiment, the audio metadata acquisition process for local audio in the local device can also be initiated by controlling the speaker to trigger the audio metadata acquisition process after the speaker cloud server obtains the device information of the local device (the device information is stored in the cloud speaker device information database).

[0134] Specifically, the acquisition and uploading of device information is achieved according to the following steps:

[0135] Step 504: The speaker cloud server sends an audio metadata update command to the speaker;

[0136] Step 505: The speaker periodically accesses the corresponding local device based on the device address, access protocol, and access credentials in the received audio metadata update instruction, and obtains the audio metadata update list of the local device;

[0137] Step 506: The speaker sends the updated list of audio metadata obtained in the current period to the speaker cloud server. The speaker cloud server updates the original data (audio metadata of the previously stored local audio) in the cloud speaker's private music library according to the received audio metadata update list.

[0138] In one feasible embodiment, the speaker cloud server can send a local audio metadata update instruction to the speaker to update the data in the cloud speaker's private music library as described in step 503 above.

[0139] The above is an explanation of how to obtain audio metadata.

[0140] With the device information of the local device and the audio metadata of the local audio stored in the speaker cloud server, local playback can be executed according to the voice-on-demand command.

[0141] Figure 6 A schematic diagram of the audio playback process provided in an embodiment of the present invention is shown, such as... Figure 6 As shown, audio voice playback can be achieved through the following steps:

[0142] Step 601: The speaker sends a playback command for the target audio to the speaker cloud server;

[0143] Step 602: In response to the on-demand command for the target audio, the speaker cloud server searches for the target audio metadata in the cloud speaker private music library and / or the cloud speaker public music library;

[0144] Step 603: The speaker cloud server sends a corresponding audio playback command based on the audio information of the target audio metadata found in the search;

[0145] Step 604: The speaker plays the target audio according to the audio playback command.

[0146] Regarding step 601:

[0147] The user verbally commands the speaker to play a specific song, such as "Play Jay Chou's 'Rice Fragrance'"; or all audio files from a local device, such as "Play songs from 'Huawei Phone'", where "Huawei Phone" is a user-defined device name for that device. The speaker then sends this command to its cloud server.

[0148] Regarding step 602:

[0149] In response to the on-demand instruction for the target audio, the speaker cloud server searches for the target audio metadata in the cloud speaker private music library and / or the cloud speaker public music library. Specifically, if the target audio can be directly determined to be local audio from a local device based on the on-demand instruction, the speaker cloud server only searches for the target audio metadata in the cloud speaker private music library.

[0150] For example, if the playback command for the target audio is "play a song from Huawei phone", then the target audio can be directly identified as an offline song from the local device (Huawei phone). The speaker cloud server can associate the device information in the cloud speaker device information database with the device ID of the local device named "Huawei phone". Then, the speaker cloud server searches for the corresponding target audio metadata in the cloud speaker private music library based on the device ID, and builds a list of audio metadata for the audio to be played based on the searched target audio metadata.

[0151] For example, if the play request for the target audio cannot determine whether the target audio is local audio, but only contains song information (audio name, performer name), then the target audio metadata will be searched in both the private music library and the public music library of the cloud speaker based on the song information.

[0152] Regarding step 603:

[0153] The speaker cloud server searches for target audio metadata in both the public and private music libraries of the cloud-based speaker, resulting in the following different scenarios:

[0154] Scenario 1: If the target audio metadata is found only in the public music library of the cloud speaker, the speaker cloud server sends a speaker cloud playback instruction to the speaker. This speaker cloud playback instruction includes the cloud playback address of the target audio in the public music library of the cloud speaker, and then the speaker plays the target audio according to the cloud playback address in the speaker cloud playback instruction.

[0155] Scenario 2: If the target audio metadata is only found in the private music library of the cloud speaker, the speaker cloud server determines the rights type of the target audio based on the rights type information in the target audio metadata;

[0156] The types of rights include shared rights and exclusive rights. Exclusive rights audio can only be played through audio playback applications provided by operators with exclusive rights, or the audio playback application can designate other devices (such as speakers) to play the target audio according to the online audio playback address provided by the audio playback application; while shared rights audio does not restrict the audio playback application to which it can be played.

[0157] It's important to clarify that the cloud-based speaker's public music library and the audio playback application's music library are two separate libraries. The cloud-based speaker's public music library is an online music database provided by the speaker operator, while the audio playback application's music library is an online music database provided by third-party applications (such as QQ Music and NetEase Cloud Music). However, there are also cases where the audio playback application and the speaker belong to the same operator. For example, if the speaker is a Huawei smart speaker and the audio playback application is the Huawei Music app installed on the local device, then the cloud-based speaker's public music library and the audio playback application's music library can be the same library—the Huawei Music online music library.

[0158] If the rights type of the target audio metadata found is shared rights, the speaker cloud server sends a shared rights audio playback instruction to the speaker. This shared rights audio playback instruction includes the local playback address of the target audio, and then the speaker plays the target audio according to the local playback address in the shared rights audio playback instruction.

[0159] like Figure 7 As shown, if the target audio metadata's rights type is exclusive rights, then the audio playback will be achieved according to the following steps:

[0160] Step 701: The speaker cloud server sends an exclusive rights audio playback command to the speaker. The exclusive rights audio playback command includes the device ID (the device ID of the local device providing the target audio), the source application information of the target audio, and the audio ID. After receiving the exclusive rights audio playback command sent by the speaker cloud server, the speaker sends an exclusive rights audio playback command to the corresponding local device based on the device ID in the searched target audio metadata. The exclusive rights audio playback command includes the source application information of the target audio and the audio ID.

[0161] Step 702: The local device launches the corresponding audio playback application based on the source application information, and obtains the cloud playback address of the target audio in the music library of the audio playback application based on the audio ID;

[0162] Step 703: The local device sends the application cloud playback command to the speaker. The application cloud playback command includes the cloud playback address of the target audio in the music library of the audio playback application.

[0163] Step 704: The speaker plays the target audio according to the cloud playback address in the application's cloud playback command.

[0164] Regarding steps 701-704, specifically:

[0165] Because the target audio has exclusive rights, the speaker cloud server cannot directly distribute the cloud playback address of the target audio to the speaker for audio playback. Instead, the corresponding audio playback application must act as the controlling entity to distribute the cloud playback address of the target audio to the speaker. Therefore, the speaker cloud server needs to send an exclusive rights audio playback command to the corresponding local device based on the device ID in the target audio metadata. This exclusive rights playback command includes the source application information of the target audio, the audio name, the audio ID, and the speaker address information.

[0166] The local device receives the exclusive rights playback command sent by the speaker cloud server, and launches the corresponding audio playback application (such as a third-party music app) according to the source application information in the exclusive rights playback command;

[0167] The audio playback application determines whether the target audio exists in its music library based on the audio ID in the exclusive rights playback command. If so, it determines whether the application can stream the target audio's cloud playback address from its music library to the speaker. If so, the local device sends a cloud playback command to the speaker, including the target audio's cloud playback address from the application's music library. The speaker can then play the target audio based on the cloud playback address in the cloud playback command.

[0168] If the target audio is not present in the audio playback application's music library, or if the cloud playback address for the target audio in the audio playback application's music library cannot be routed to the speaker, the local device, after confirming a Bluetooth connection with the speaker, will control the audio playback application to play the target audio (downloaded offline audio). In this case, the audio output will be handled by the speaker. If the local device is not currently connected to the speaker via Bluetooth, the user will be prompted to perform a Bluetooth connection operation. After confirming a Bluetooth connection between the local device and the speaker, the audio playback application will be controlled to play the target audio.

[0169] Scenario 3: If the target audio metadata is found in both the public and private music libraries of the cloud speaker, the speaker cloud server first determines the target audio with the higher audio quality based on the audio quality information in the target audio metadata. Specifically, if the target audio quality in the public music library is higher than that in the private music library, the speaker cloud server sends a cloud playback command to the speaker, which includes the cloud playback address of the target audio in the public music library. The speaker then plays the target audio online according to the cloud playback address in the cloud playback command.

[0170] Scenario 4: If the target audio metadata is found in both the public music library and the private music library of the cloud speaker, and the quality of the target audio in the public music library is lower than that in the private music library, the rights type of the target audio will be further determined based on the rights type information in the target audio metadata.

[0171] If the rights type of the target audio metadata found is shared rights, the speaker cloud server sends a shared rights audio playback instruction to the speaker. This shared rights audio playback instruction includes the local playback address of the target audio, and then the speaker plays the target audio according to the local playback address in the shared rights audio playback instruction.

[0172] like Figure 7 As shown, if the target audio metadata's rights type is exclusive rights, then the audio playback will be achieved according to the following steps:

[0173] Step 701: The speaker cloud server sends an exclusive rights audio playback command to the speaker. The exclusive rights audio playback command includes the device ID (the device ID of the local device providing the target audio), the source application information of the target audio, and the audio ID. After receiving the exclusive rights audio playback command sent by the speaker cloud server, the speaker sends an exclusive rights audio playback command to the corresponding local device based on the device ID in the searched target audio metadata. The exclusive rights audio playback command includes the source application information of the target audio and the audio ID.

[0174] Step 702: The local device launches the corresponding audio playback application based on the source application information, and obtains the cloud playback address of the target audio in the music library of the audio playback application based on the audio ID;

[0175] Step 703: The local device sends the application cloud playback command to the speaker. The application cloud playback command includes the cloud playback address of the target audio in the music library of the audio playback application.

[0176] Step 704: The speaker plays the target audio according to the cloud playback address in the application's cloud playback command.

[0177] Regarding steps 701-704, specifically:

[0178] Because the target audio has exclusive rights, the speaker cloud server cannot directly distribute the cloud playback address of the target audio to the speaker for audio playback. Instead, the corresponding audio playback application must act as the controlling entity to distribute the cloud playback address of the target audio to the speaker. Therefore, the speaker cloud server needs to send an exclusive rights audio playback command to the corresponding local device based on the device ID in the target audio metadata. This exclusive rights playback command includes the source application information of the target audio, the audio name, the audio ID, and the speaker address information.

[0179] The local device receives the exclusive rights playback command sent by the speaker cloud server, and launches the corresponding audio playback application (such as a third-party music app) according to the source application information in the exclusive rights playback command;

[0180] The audio playback application determines whether the target audio exists in its music library based on the audio ID in the exclusive rights playback command. If so, it determines whether the application can stream the target audio's cloud playback address from its music library to the speaker. If so, the local device sends a cloud playback command to the speaker, including the target audio's cloud playback address from the application's music library. The speaker can then play the target audio based on the cloud playback address in the cloud playback command.

[0181] If the target audio is not present in the audio playback application's music library, or if the cloud playback address for the target audio in the audio playback application's music library cannot be routed to the speaker, the local device, after confirming a Bluetooth connection with the speaker, will control the audio playback application to play the target audio (downloaded offline audio). In this case, the audio output will be handled by the speaker. If the local device is not currently connected to the speaker via Bluetooth, the user will be prompted to perform a Bluetooth connection operation. After confirming a Bluetooth connection between the local device and the speaker, the audio playback application will be controlled to play the target audio.

[0182] Figure 8 This diagram illustrates a device address update process provided in an embodiment of the present invention. Figure 8 As shown, if the speaker determines that it cannot access the local device, it needs to re-obtain the device address of the local device. The specific steps are as follows:

[0183] Step 801: Determine that the speaker cannot access the local device;

[0184] Step 802: The speaker uses the device ID of the local device to perform a distributed query for the device update address of the local device;

[0185] Step 803: The speaker sends the address update information of the local device to the speaker cloud server. The address update information includes the obtained device update address and device ID of the local device.

[0186] Step 804: The speaker cloud server retrieves the corresponding device information from the device ID in the address update information, updates the device address in the device information with the device update address, and triggers the speaker application to log in and obtain new access credentials. The speaker cloud server then updates the corresponding device information with the new access credentials obtained by the speaker application.

[0187] The above describes the process of playing audio according to a play-on command when the audio metadata is stored in the speaker's own music library on the speaker cloud server.

[0188] The following is an embodiment of the present invention providing an audio playback control method for specifying local audio on a local device for on-demand playback when the device information of the local device is stored in the speaker cloud server but the audio metadata is not stored. The specific process is as follows:

[0189] The speaker cloud server responds to the on-demand command for the target audio, such as "Play songs from 'Huawei Phone'", where "Huawei Phone" is a user-defined device name for the local device. The server retrieves the corresponding device information based on the device name in the on-demand command. Then, the speaker cloud server sends a local audio playback command to the speaker, which includes the device address, access protocol, and access credentials corresponding to the target device ("Huawei Phone"). The speaker uses the device address, access protocol, and access credentials to perform a distributed query of the audio metadata list for the local audio on the target device. Finally, it executes local audio playback based on the retrieved audio metadata list for the local audio on the target device.

[0190] Specifically, the speaker determines the rights type of the audio to be played based on the acquired audio metadata; if the rights type of the target audio metadata is shared rights, the speaker directly plays the audio based on the audio address in the audio metadata.

[0191] If the target audio metadata has a privilege type of exclusive privilege, the speaker will send an exclusive privilege audio playback instruction to the corresponding local device based on the device ID in the target audio metadata. The exclusive privilege playback instruction includes the source application information of the target audio, the audio name, the audio ID, and the speaker address information.

[0192] The local device receives the exclusive rights playback command sent by the speaker and launches the corresponding audio playback application (such as a third-party music app) based on the source application information in the exclusive rights playback command;

[0193] The audio playback application determines whether the target audio exists in its music library based on the audio ID and audio name in the exclusive rights playback command. If so, the local device sends a cloud playback command to the speaker, which includes the cloud playback address of the target audio in the audio playback application's music library. The speaker can then play the target audio based on the cloud playback address in the cloud playback command.

[0194] If the target audio is not present in the audio playback application's music library, or if the cloud playback address for the target audio in the audio playback application's music library cannot be routed to the speaker, the local device, after confirming a Bluetooth connection with the speaker, will control the audio playback application to play the target audio (downloaded offline audio). In this case, the audio output will be handled by the speaker. If the local device is not currently connected to the speaker via Bluetooth, the user will be prompted to perform a Bluetooth connection operation. After confirming a Bluetooth connection between the local device and the speaker, the audio playback application will be controlled to play the target audio.

[0195] This invention also provides an audio playback control device based on a speaker cloud server, such as... Figure 9 As shown, the device includes a processor 10A and a memory 20A. The memory 20A is used to store at least one instruction, which is loaded and executed by the processor 10A to implement an audio playback control method based on a speaker cloud server.

[0196] This invention also provides an audio playback control device based on a local device, such as... Figure 10 The device shown includes a processor 10B and a memory 20B, the memory 20B being used to store at least one instruction, which is loaded by the processor 10B and executed to implement an audio playback control method based on a local device.

[0197] This invention also provides a speaker-based audio playback control device, such as... Figure 11 As shown, the device includes a processor 10C and a memory 20C, the memory 20C being used to store at least one instruction, which, when loaded and executed by the processor 10C, implements any of the speaker-based audio playback control methods described above.

[0198] This invention also provides a local device, which includes an audio playback control device based on the local device.

[0199] This invention also provides a speaker, which includes an audio playback control device based on the speaker.

[0200] This invention also provides a speaker cloud server, which includes an audio playback control device based on the speaker cloud server.

[0201] This invention also provides an audio playback control system, such as... Figure 12 As shown, the system includes one or more local devices P1 to Pn, a speaker Ab, and a speaker cloud server Ac. The one or more local devices P1 to Pn and the speaker Ab are located in the same distributed network, for example, connected to the same router. One or more local devices P1 to Pn can provide audio content, and at least one of the one or more local devices P1 to Pn supports the installation of speaker applications.

[0202] It should be noted that the terminals involved in the embodiments of the present invention may include, but are not limited to, personal computers (PCs), personal digital assistants (PDAs), wireless handheld devices, tablet computers, mobile phones, MP3 players, MP4 players, etc.

[0203] It is understood that the application can be a native application installed on the terminal, or it can be a web application in a browser on the terminal. This embodiment of the invention does not limit this.

[0204] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0205] In the embodiments provided by this invention, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.

[0206] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0207] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0208] The integrated units implemented as software functional units described above can be stored in a computer-readable storage medium. These software functional units, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute partial steps of the methods of the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0209] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

[0210] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for controlling audio playback based on a sound box cloud server, characterized in that, The method comprises: in response to an on-demand instruction of target audio, searching target audio metadata in a cloud-end audio box private music library, the cloud-end audio box private music library storing local audio metadata, the local audio metadata comprising an audio name, an audio ID and a local playing address of the audio; performing local playing according to the searched target audio metadata, the local playing comprising sending an audio playing instruction to an audio box, the audio playing instruction comprising the local playing address of the target audio; the local audio metadata further comprising a device ID of a corresponding local device, an interest type of the audio and source application information, the interest type comprising a shared interest and an exclusive interest; the local playing comprising: if the interest type of the searched target audio metadata is a shared interest, sending a shared interest audio playing instruction to the audio box, the shared interest audio playing instruction comprising the local playing address of the target audio; if the interest type of the searched target audio metadata is an exclusive interest, sending a first exclusive interest audio playing instruction to the audio box, the first exclusive interest playing instruction comprising the device ID, the source application information and the audio ID in the target audio metadata; wherein the first exclusive interest playing instruction is used to instruct the audio box to send a second exclusive interest playing instruction to the corresponding local device based on the device ID, the second exclusive interest playing instruction comprising the source application information and the audio ID, the second exclusive interest playing instruction being used for the corresponding local device to obtain a cloud-end playing address of the target audio, the cloud-end playing address of the target audio being used for the audio box to play the target audio.

2. The method of claim 1, wherein, Before the performing local playing, the method further comprises: in response to the on-demand instruction of the target audio, searching the target audio metadata in a cloud-end audio box public music library, the cloud-end audio box public music library storing cloud-end audio metadata, the cloud-end audio metadata comprising an audio name, an audio ID, an audio quality and a cloud-end playing address of the audio, the local audio metadata further comprising an audio quality; if the target audio metadata is searched in both the cloud-end audio box public music library and the cloud-end audio box private music library, and the target audio quality in the cloud-end audio box public music library is higher than the target audio quality in the cloud-end audio box private music library, sending an audio box cloud-end playing instruction to the audio box, the audio box cloud-end playing instruction comprising the cloud-end playing address of the target audio in the cloud-end audio box public music library; if the target audio metadata is searched in both the cloud-end audio box public music library and the cloud-end audio box private music library, and the target audio quality in the cloud-end audio box public music library is lower than the audio quality in the cloud-end audio box private music library, performing the local playing.

3. The method of claim 1, wherein, The method further comprises: obtaining device information of the local device sent by an audio box application and storing the device information in a cloud-end audio box device information library.

4. The method of claim 3, wherein, The method further comprises: According to the device information, a local audio metadata update instruction is sent to the sound box, wherein the audio metadata update instruction contains the device address, access protocol and access credential of each local device; A local audio metadata update list fed back by the sound box is acquired; The cloud sound box private music library is updated according to the audio metadata update list.

5. The method of claim 3, wherein, The method further comprises: Local device address update information sent by the sound box is acquired, wherein the local device address update information contains the device ID and device update address of the local device; According to the device ID, corresponding device information in the cloud device information library is determined, and the device address in the corresponding device information is updated according to the device update address.

6. An audio playing control device based on a sound box cloud server, characterized in that, The device comprises: A processor and a memory, wherein the memory is used to store at least one instruction, and the instruction is loaded and executed by the processor to implement the audio playing control method based on the sound box cloud server as claimed in any one of claims 1-5.

7. A sound box cloud server, characterized in that, The sound box cloud server comprises the audio playing control device based on the sound box cloud server as claimed in claim 6.

8. An audio playback control system, characterized by, The system comprises: One or more local devices; A sound box; and The sound box cloud server as claimed in claim 7.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the audio playing control method based on the sound box cloud server as claimed in any one of claims 1-5.

Images