Audio control method and device, equipment and storage medium

Abstract

The invention provides an audio control method and device, equipment and a storage medium, and the method comprises the steps: responding to an audio and video playing request for a target audio and video, and playing the target audio and video through a target player; responding to a playing state synchronization request of a target external loudspeaker box, and detecting an audio and video playing state and a media session registration state of a target player; adjusting the sound box playing state of the target external sound box according to the audio and video playing state and the media session registration state; and driving the target external sound box to output target audio data in the target audio and video according to the sound box playing state. According to the technical scheme provided by the invention, the playing state of the target player can be correctly synchronized to the target external sound box when the player does not register the media session instance, so that the abnormal silent playing condition of the external sound box is avoided, and the audio and video playing compatibility is improved.

Description

Technical Field

[0001] The present application relates to the field of audio technology, and in particular to an audio control method, device, equipment and storage medium. Background Art

[0002] At present, with the rapid development of the smart TV industry and speaker peripherals, more and more homes, offices and other commercial places are using TVs. Most existing smart TVs are equipped with wireless communication modules, which can establish a communication connection with Bluetooth speakers, so as to play audio using the Bluetooth speakers. However, existing smart TV audio and video players may not be compatible with the Media Session function such as Bluetooth-related playback, resulting in abnormal silent playback of wireless speaker devices such as Bluetooth speakers. Summary of the invention

[0003] The embodiments of the present application provide an audio control method, apparatus, device and storage medium, which are intended to solve the technical problem in the prior art that a terminal player causes abnormal playback of a wireless speaker device when the terminal player is not compatible with a media session function.

[0004] In one aspect, an embodiment of the present application provides an audio control method, the audio control method comprising the following steps:

[0005] Responding to an audio or video playback request for a target audio or video, and playing the target audio or video using a target player;

[0006] Responding to the playback status synchronization request of the target external speaker, detecting the audio and video playback status and media session registration status of the target player;

[0007] Adjusting the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state;

[0008] The target external speaker is driven to output the target audio data in the target audio and video according to the playing state of the speaker.

[0009] In a possible implementation of the present application, responding to the playback status synchronization request of the target external speaker and detecting the audio and video playback status and media session registration status of the target player include:

[0010] Receiving a playback control instruction triggered by the target external speaker based on a target control protocol, and determining that the playback control instruction is a playback state synchronization request;

[0011] The audio and video playback status and the media session registration status of the target player are detected based on the playback status synchronization request.

[0012] In a possible implementation of the present application, the detecting the audio and video playback status and the media session registration status of the target player based on the playback status synchronization request includes:

[0013] Obtaining a target player identifier of the target player and a target media session list;

[0014] Acquire a media session instance in the target media session list and a session instance identifier corresponding to the media session instance;

[0015] Determine a target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determine a media session registration state of the target media session instance;

[0016] The audio and video playback status of the target player is determined based on the audio and video focus of the target player.

[0017] In a possible implementation of the present application, determining the target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determining the media session registration state of the target media session instance includes:

[0018] Filtering the target media session instances in the media session instances whose session instance identifier is the same as the target player identifier;

[0019] Performing instance registration detection on the target media session instance according to the target detection strategy to obtain instance registration detection parameters;

[0020] If the instance registration detection parameter is the first detection parameter, determining that the media session registration state of the target media session instance is a registration active state;

[0021] If the instance registration detection parameter is the second detection parameter, it is determined that the media session registration state of the target media session instance is an unregistered state.

[0022] In a possible implementation of the present application, determining the audio and video playback state of the target player based on the audio and video focus of the target player includes:

[0023] Registering an audio focus listener associated with the target player, and using the audio focus listener to detect the audio and video focus of the target player;

[0024] The audio and video playback state of the target player is determined based on the focus change state of the audio and video focus.

[0025] In a possible implementation of the present application, adjusting the speaker playback state of the target external speaker according to the audio and video playback state and the media session registration state includes:

[0026] If the media session registration state is an unregistered state and the audio and video playback state is a playing state, synchronizing the speaker playback state of the target external speaker to an audio output state by using a target control protocol;

[0027] If the media session registration state is an unregistered state and the audio and video playback state is a non-playing state, the target control protocol is used to synchronize the audio and video playback state of the target external speaker to an audio suspension state.

[0028] In a possible implementation of the present application, before responding to the playback status synchronization request of the target external speaker and detecting the audio and video playback status and the media session registration status of the target player, the method further includes:

[0029] In response to a wireless connection request for a target external speaker, obtaining connection identification information of the target external speaker;

[0030] A wireless connection is established with the target external speaker according to the connection identification information and a preset connection protocol.

[0031] In another aspect, the present application provides an audio control device, the audio control device comprising:

[0032] The data playing module is configured to respond to an audio or video playing request for a target audio or video and play the target audio or video using a target player;

[0033] A state detection module is configured to respond to a playback state synchronization request of a target external speaker and detect an audio and video playback state and a media session registration state of the target player;

[0034] A speaker control module is configured to perform current limiting control on the target upgrade request of the target upgrade platform according to the current limiting percentage and current limiting attribute of the target limiting strategy;

[0035] The audio control module is configured to drive the target external speaker to output the target audio data in the target audio and video according to the playing state of the speaker.

[0036] On the other hand, the present application also provides an audio control device, the audio control device comprising:

[0037] one or more processors;

[0038] Memory; and

[0039] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the audio control method.

[0040] On the other hand, the present application also provides a computer-readable storage medium on which a computer program is stored. The computer program is loaded by a processor to execute the steps in the audio control method.

[0041] In this application, by responding to the audio and video playback request for the target audio and video, the target audio and video is played by the target player; responding to the playback status synchronization request of the target external speaker, the audio and video playback status and the media session registration status of the target player are detected; the speaker playback status of the target external speaker is adjusted according to the audio and video playback status and the media session registration status; the target external speaker is driven to output the target audio data in the target audio and video according to the speaker playback status. When playing audio and video data using the specified target player and target external speaker, the media session registration status of the target player can be detected, and the speaker playback status of the target external speaker can be personalized controlled according to the media session registration status, so that when the player is not registered with the media session instance, the playback status of the target player can be correctly synchronized to the target external speaker, thereby avoiding the abnormal situation of silent playback of the external speaker and improving the audio and video playback compatibility. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0043] Figure 1 A schematic diagram of a scenario of an audio control method according to an embodiment of the present application;

[0044] Figure 2 A flowchart of an embodiment of an audio control method in an embodiment of the present application;

[0045] Figure 3 A flowchart of an embodiment of determining the media session registration status of a target player in the audio control method provided in an embodiment of the present application;

[0046] Figure 4 A schematic diagram of a flow chart of an embodiment of determining the audio and video playback status in the audio control method provided in an embodiment of the present application;

[0047] Figure 5A schematic diagram of the structure of an embodiment of an audio control device provided in an embodiment of the present application;

[0048] Figure 6 A schematic diagram of the structure of an embodiment of an audio control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0050] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0051] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as being preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the invention can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0052] At present, with the rapid development of the smart TV industry and speaker peripherals, more and more homes, offices and other commercial places are using TVs. Most existing smart TVs are equipped with wireless communication modules, which can establish a communication connection with Bluetooth speakers, so as to play audio using the Bluetooth speakers. However, existing smart TV audio and video players may not be compatible with the Media Session function such as Bluetooth-related playback, resulting in abnormal silent playback of wireless speaker devices such as Bluetooth speakers.

[0053] Based on this, the present application proposes an audio control method, apparatus, device and computer-readable storage medium to solve the technical problem in the prior art that a wireless speaker device may experience playback abnormalities when a terminal player is not compatible with a media session function.

[0054] The audio control method in the embodiment of the present invention is applied to an audio control device, which is arranged in an audio control device. The audio control device is provided with one or more processors, a memory, and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the audio control method; wherein the audio control device can be an intelligent terminal, such as a mobile phone, a tablet computer, a smart TV, a network device, and a smart computer, etc.; optionally, the audio control device can also be a server, or a service cluster consisting of multiple servers.

[0055] like Figure 1 As shown, Figure 1 The following is a scene diagram of the audio control method of the present application embodiment. The audio control scene in the present invention embodiment includes an audio control device 100 (an audio control device is integrated in the audio control device 100) and a target external speaker 200. A computer-readable storage medium corresponding to the audio control method is run in the audio control device 100 to execute the steps of the audio control method. The target external speaker 200 is a speaker terminal that is wirelessly connected to the audio control device 100 and can synchronously play the audio and video content played by the target player.

[0056] Understandably, Figure 1 The audio control device in the audio control method scenario shown, or the apparatus included in the audio control device, does not constitute a limitation on the embodiments of the present invention, that is, the number and type of audio control devices included in the audio control method scenario, or the number and type of apparatus included in each device, do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution claimed to be protected in the embodiments of the present invention.

[0057] The audio control device 100 in the embodiment of the present invention is mainly used to: respond to an audio or video playback request for a target audio or video, and play the target audio or video using a target player;

[0058] Responding to the playback status synchronization request of the target external speaker, detecting the audio and video playback status and media session registration status of the target player;

[0059] Adjusting the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state;

[0060] The target external speaker is driven to output the target audio data in the target audio and video according to the playing state of the speaker.

[0061] The audio control device 100 in the embodiment of the present invention can be an independent audio control device, such as a smart terminal such as a mobile phone, a tablet computer, a smart TV, a network device, a server and a smart computer, or it can be an audio control network or an audio control cluster composed of multiple audio control devices.

[0062] The embodiments of the present application provide an audio control method, apparatus, device, and computer-readable storage medium, which are described in detail below.

[0063] It can be understood by those skilled in the art that Figure 1 The application environment shown in is only one of the application scenarios related to the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer audio control devices, or audio control network connection relationships shown, such as Figure 1 Only one audio control device is shown in the figure. It can be understood that the scenario of the audio control method can also include one or more audio control devices, which is not specifically limited here. The audio control device 100 can also include a memory for storing audio and video data and other data.

[0064] It should be noted that Figure 1 The scenario diagram of the audio control method shown is only an example. The scenario of the audio control method described in the embodiment of the present invention is to more clearly illustrate the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention.

[0065] Based on the scenario of the above audio control method, various embodiments of the audio control method disclosed in the present invention are proposed.

[0066] like Figure 2 As shown, Figure 2This is a flow chart of an embodiment of an audio control method in an embodiment of the present application. The audio control method includes the following steps 201 to 204:

[0067] 201. Respond to an audio or video playback request for a target audio or video, and play the target audio or video using a target player;

[0068] The audio control method in this embodiment is applied to audio control devices, and the type and number of audio control devices are not specifically limited. That is, the audio control device can be one or more smart terminals that can play audio and video. In a specific embodiment, the audio control device is a smart TV.

[0069] Specifically, the audio control device can include at least one audio and video player, for example, the audio and video player is a player application that can play specified audio-visual content. For example, the audio and video player can be an audio player or video player produced by a specified manufacturer. Optionally, the audio and video player can also be an audio player or video player that comes with the audio control device or an audio player or video player that comes with the operating system.

[0070] Specifically, during operation, the audio control device responds to an audio and video playback request for the target audio and video, wherein the audio and video playback request can be an operation event that drives the audio control device to use a specified target player to play the target audio and video. The triggering method of the audio and video playback request is not specifically limited here, that is, the audio and video playback request can be actively triggered by the user, for example, the user clicks an audio playback button pointing to the target audio and video, or selects the playback control of the target audio and video in a specified interface, thereby triggering the audio and video playback request. Optionally, the audio and video playback request can also be automatically triggered by the audio control device, for example, a timed playback process is set in the audio control device, which automatically triggers the audio and video playback request at a preset time point, or triggers the audio and video playback request through other application associations.

[0071] Specifically, after obtaining the audio and video playback request, the audio control device parses the audio and video playback request, obtains the target audio and video corresponding to the audio and video playback request, and uses the target player to play the target audio and video. The target player is an audio player or a video player in the audio control device for playing the target audio and video. Optionally, in a specific embodiment, the target player can be an HDMI player.

[0072] 202. Respond to the playback status synchronization request of the target external speaker, and detect the audio and video playback status and media session registration status of the target player;

[0073] Specifically, the audio control device also has a wireless communication module, and the audio control device can communicate with the target external speaker through the wireless communication module, so that the audio control device can connect to the target external speaker to achieve a wireless surround sound scene, or increase the external volume / loudness of the target player.

[0074] Optionally, the wireless communication module can be any one or more of a Bluetooth communication module / WiFi communication module and a 2.4G communication module, and correspondingly, the target external speaker can also be any one or more of a Bluetooth speaker, a WiFi wireless speaker and a 2.4G speaker. Optionally, the target external speaker can also be a multi-mode wireless speaker integrating multiple wireless communication modules.

[0075] Optionally, during operation, the audio control device also responds to a wireless connection request for the target external speaker, obtains the connection identification information of the target external speaker, and establishes a wireless connection with the target external speaker through the connection identification information and a preset connection protocol. For example, in a specific embodiment, the target external speaker is a Bluetooth speaker. The connection identification information corresponding to the target external speaker may be the Bluetooth device identification of the target external speaker or the Bluetooth address information of the target external speaker. The audio control device establishes a Bluetooth connection with the target external speaker through the Bluetooth device identification of the target external speaker or the Bluetooth address information of the target external speaker, and the Bluetooth connection protocol, thereby connecting to the target external speaker.

[0076] Specifically, after the audio control device establishes a wireless connection with the target external speaker, the audio control device can also use the target external speaker to output the target audio data in the target audio and video when using the target player to play the target audio and video. However, since all existing audio and video players are not adapted to the media session instance (MediaSession) functions of related wireless playback such as Bluetooth playback, when the audio and video player is not adapted to the media session instance functions of such related wireless playback, it will cause the target external speaker to synchronize the target player to the audio control device, and the audio control device will synchronize the audio suspension state (i.e., the synchronization stop state) to the target external speaker through the target control protocol, causing the target external speaker to be silent when the target player plays the target audio and video. In a specific embodiment, the target control protocol is the AVRCP protocol.

[0077] Therefore, when the audio control device uses the target player to play the target audio and video, the target external speaker that establishes a wireless communication connection with the audio control device sends a playback synchronization request to the audio control device, driving the audio control device to detect the audio and video playback status and media session registration status of the target player.

[0078] Specifically, after establishing a wireless connection with the target external speaker, the audio control device also interacts through the target control protocol, that is, the target external speaker can send a playback control instruction to the audio control device based on the target control protocol. After the audio control device receives the playback control instruction triggered by the target external speaker based on the target control protocol, the audio control device parses the playback control instruction and determines that the playback control instruction is a playback status synchronization request.

[0079] Specifically, after obtaining the playback status synchronization request, in order to avoid the inability to synchronize the correct playback status due to the target player not registering the media session instance, the audio control device also detects the audio and video playback status and media session registration status of the target player, so that in subsequent steps, the correct playback status can be synchronized to the target external speaker according to the audio and video playback status and the media session registration status, thereby controlling the playback status of the target external speaker.

[0080] The audio and video playing state is state information indicating whether the target audio and video is being played in the target player. Optionally, the audio and video playing state includes a playing state and a not playing state.

[0081] The media session registration state is registration state information indicating whether the target player has registered the media session instance. Optionally, the media session registration state includes an unregistered state and a registered state.

[0082] Optionally, in a specific embodiment, the audio control device can determine the media session registration state of the target player according to the target player and the target media session list corresponding to the target media player.

[0083] That is, after obtaining the target media session list, the audio control device also obtains the media session instances in the target media session list and the session instance identifiers corresponding to the media session instances. The audio control device determines the target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determines the media session registration state of the target media session instance, which is the media session registration state of the target player.

[0084] Specifically, the audio control device also determines the audio and video playing state of the target player according to the focus change state of the audio and video focus of the target player.

[0085] 203. Adjust the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state;

[0086] Specifically, after obtaining the audio and video playback status and media session registration status of the target player, the audio control device synchronizes the correct audio and video playback status to the target external speaker through the audio and video playback status and the media session registration status, and then uses the audio and video playback status to adjust the speaker playback status of the target external speaker, so that the speaker playback status is synchronized with the audio and video playback status, thereby avoiding abnormal conditions such as silence in the target external speaker.

[0087] Specifically, after obtaining the audio and video playback status and media session registration status of the target player, the audio control device reads the media session registration status to determine whether the target player is adapted to the media session instance function of wireless playback, and then synchronizes the corresponding audio and video playback status to the target external speaker according to the audio and video playback status.

[0088] Optionally, if the media session registration status of the target player is registered, the audio control device determines that the target player is an audio and video player adapted for wireless playback, and the audio control device directly uses the target control protocol to communicate the audio and video playback status to the target external speaker, so that the target external speaker sets the corresponding speaker playback status.

[0089] Optionally, if the media session registration state of the target player is unregistered and the audio and video playback state is playing, the audio control device determines that the target player is an audio and video player that is not adapted to wireless playback, and the audio control device intercepts the unplayed state notification synchronized by the target control protocol to the target external speaker, and uses the target control protocol to synchronize the notification information corresponding to the playing state to the target external speaker, so as to synchronize the speaker playback state of the target external speaker to the audio output state. The audio output state is the audio and video playback state that drives the target external speaker to output the target audio and video.

[0090] Optionally, if the media session registration state of the target player is unregistered and the audio and video playback state is unplayed, the audio control device determines that the target player is an audio and video player that is not adapted to wireless playback, and the audio control device uses the target control protocol to synchronize the unplayed state notification to the target external speaker to synchronize the speaker playback state of the target external speaker to the audio suspension state. The audio output state is the audio and video playback state that drives the target external speaker to stop outputting the target audio and video.

[0091] 204. Drive the target external speaker to output the target audio data in the target audio and video according to the playback state of the speaker.

[0092] Specifically, after synchronizing the correct audio and video playback status to the target external speaker according to the media session registration status of the target player to adjust the speaker playback status of the target external speaker, the audio control device also drives the target external speaker to output the target audio data in the target audio and video according to the speaker playback status.

[0093] Optionally, the audio control device utilizes the target control protocol to synchronize the notification information corresponding to the playing status to the target external speaker, so as to synchronize the speaker playing status of the target external speaker to the audio output status, and then drive the target external speaker to output the target audio data in the target audio and video according to the audio output status, thereby realizing the synchronous playback of the audio data of the target player using the target external speaker.

[0094] Optionally, the audio control device utilizes the target control protocol to synchronize the non-playing status notification to the target external speaker, so as to synchronize the speaker playing status of the target external speaker to the audio suspension status, and then drive the target external speaker to stop outputting the target audio data in the target audio and video.

[0095] In this embodiment, the audio control device responds to the audio and video playback request for the target audio and video, and plays the target audio and video using the target player; responds to the playback status synchronization request of the target external speaker, and detects the audio and video playback status and media session registration status of the target player; adjusts the speaker playback status of the target external speaker according to the audio and video playback status and the media session registration status; and drives the target external speaker to output the target audio data in the target audio and video according to the speaker playback status. When playing audio and video data using the designated target player and target external speaker, the target player's media session registration status can be detected, and the speaker playback status of the target external speaker can be personalized controlled according to the media session registration status, so that when the player is not registered with the media session instance, the playback status of the target player can be correctly synchronized to the target external speaker, thereby avoiding the abnormal situation of silent playback of the external speaker and improving the audio and video playback compatibility.

[0096] like Figure 3 As shown, Figure 3 The present invention provides an embodiment of the audio control method for determining the media session registration status of a target player. Figure 3 As shown, in this embodiment, the audio control method further includes steps 301 to 304:

[0097] 301. Filter the target media session instances whose session instance identifier is the same as the target player identifier in the media session instance;

[0098] 302. Perform instance registration detection on the target media session instance according to the target detection strategy to obtain instance registration detection parameters;

[0099] 303. If the instance registration detection parameter is the first detection parameter, determine that the media session registration state of the target media session instance is a registration active state;

[0100] 304. If the instance registration detection parameter is a second detection parameter, determine that the media session registration state of the target media session instance is an unregistered state.

[0101] Based on the above embodiments, in this embodiment, the audio control device can determine the media session registration state of the target player according to the target player and the target media session list corresponding to the target media player.

[0102] Specifically, after obtaining the target media session list, the audio control device also obtains the media session instances in the target media session list and the session instance identifiers corresponding to the media session instances. The audio control device determines the target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determines the media session registration state of the target media session instance, which is the media session registration state of the target player.

[0103] Specifically, the audio control device obtains the target media session list and each media session instance in the target media session list, and matches the session instance identifier of each media session instance with the target player identifier, thereby filtering out the target media session instance in the media session instance whose session instance identifier and the target player identifier are the same. The target media session instance is the media session instance associated with the target player.

[0104] Specifically, after acquiring the target media session instance, the audio control device also performs instance registration detection on the target media session instance according to the target detection strategy to obtain an instance registration detection parameter representing the registration state of the target media session instance, wherein the instance registration detection parameter includes a first detection parameter and a second detection parameter. The first detection parameter represents that the registration state of the target media session instance is a registered state. The second detection parameter represents that the registration state of the target media session instance is an unregistered state.

[0105] Specifically, the audio control device sends the instance detection method included in the target detection policy to the target media session instance, performs instance registration detection on the target media session instance using the instance detection method, and obtains instance registration detection parameters returned by the instance detection method.

[0106] Optionally, if the instance registration detection parameter is the first detection parameter, the audio control device determines that the target media session instance is in an active state, that is, the target media session instance is registered and running, then the audio control device determines that the media session registration state of the target media session instance is a registered active state, that is, the media session registration state of the target player is a registered active state.

[0107] Optionally, if the instance registration detection parameter is the second detection parameter, the audio control device determines that the target media session instance is in an inactive state, that is, the target media session instance is not registered or has stopped being active, then the audio control device determines that the media session registration state of the target media session instance is an unregistered state, that is, the media session registration state of the target player is an unregistered state.

[0108] In this embodiment, the audio control device screens the target media session instances whose session instance identifier and the target player identifier are the same in the media session instance; performs instance registration detection on the target media session instance according to the target detection strategy to obtain instance registration detection parameters; if the instance registration detection parameter is the first detection parameter, the media session registration state of the target media session instance is determined to be a registered active state; if the instance registration detection parameter is the second detection parameter, the media session registration state of the target media session instance is determined to be an unregistered state. The media session registration state of the target player is accurately determined, so that the correct audio and video playback state is synchronized according to the media session registration state, so as to improve the playback compatibility of the target external speaker.

[0109] like Figure 4 As shown, Figure 4 This is a flow chart of an embodiment of determining the audio and video playback status in the audio control method provided in the embodiment of the present application. Specifically, in this embodiment, the audio control method further includes steps 401 to 402:

[0110] 401. Register an audio focus listener associated with the target player, and use the audio focus listener to detect the audio and video focus of the target player;

[0111] 402. Determine the audio and video playback state of the target player based on the focus change state of the audio and video focus.

[0112] Based on the above embodiments, in this embodiment, the audio control device also determines the audio and video playback status of the target player according to the focus change state of the audio and video focus of the target player, and then in subsequent steps synchronizes the correct audio and video playback status to the target external speaker according to the media session registration status.

[0113] Specifically, the audio control device registers an audio focus listener associated with the target player, and uses the audio focus listener to detect the audio and video focus of the target player, thereby determining the focus change state of the audio and video focus.

[0114] Optionally, in a specific embodiment, the audio focus listener can be an audio and video focus listener obtained by creating an AudioFocusChangeListener object and registering the listener using the requestAudioFocus() method of AudioManager.

[0115] Specifically, after registering the audio focus listener, the audio control device uses the audio focus listener to monitor the focus change state of the audio and video focus, and determines the audio and video playing state of the target player according to the focus change state.

[0116] Optionally, if the focus change state is a focus acquisition state, the audio control device determines that the audio and video playback state of the target player is a playing state.

[0117] Optionally, if the focus change state is a focus loss state, the audio control device determines that the audio and video playback state of the target player is a non-playing state.

[0118] In this embodiment, the audio control device registers the audio focus listener associated with the target player, uses the audio focus listener to detect the audio and video focus of the target player, and determines the audio and video playback state of the target player based on the focus change state of the audio and video focus. The audio focus listener is used to accurately determine the focus change state of the target player, and then determine the audio and video playback state of the target player, so as to improve the accuracy of obtaining the audio and video playback state.

[0119] In order to better implement the audio control method in the embodiment of the present application, based on the audio control method, an audio control device is also provided in the embodiment of the present application, such as Figure 5 As shown, Figure 5 This is a structural diagram of an audio control device provided in an embodiment of the present application. Specifically, the audio control device 500 includes:

[0120] The data playing module 501 is configured to respond to an audio or video playing request for a target audio or video and play the target audio or video using a target player;

[0121] The state detection module 502 is configured to respond to the playback state synchronization request of the target external speaker and detect the audio and video playback state and media session registration state of the target player;

[0122] The speaker control module 503 is configured to perform current limiting control on the target upgrade request of the target upgrade platform according to the current limiting percentage and current limiting attribute of the target limiting strategy;

[0123] The audio control module 504 is configured to drive the target external speaker to output the target audio data in the target audio and video according to the playing state of the speaker.

[0124] In a possible implementation of this embodiment, the audio control device responds to the playback status synchronization request of the target external speaker and detects the audio and video playback status and media session registration status of the target player, including:

[0125] Receiving a playback control instruction triggered by the target external speaker based on a target control protocol, and determining that the playback control instruction is a playback state synchronization request;

[0126] The audio and video playback status and the media session registration status of the target player are detected based on the playback status synchronization request.

[0127] In a possible implementation of this embodiment, the audio control device detects the audio and video playback state and the media session registration state of the target player based on the playback state synchronization request, including:

[0128] Obtaining a target player identifier of the target player and a target media session list;

[0129] Acquire a media session instance in the target media session list and a session instance identifier corresponding to the media session instance;

[0130] Determine a target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determine a media session registration state of the target media session instance;

[0131] The audio and video playback status of the target player is determined based on the audio and video focus of the target player.

[0132] In a possible implementation of this embodiment, the audio control device determines the target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determines the media session registration state of the target media session instance, including:

[0133] Filtering the target media session instances in the media session instances whose session instance identifier is the same as the target player identifier;

[0134] Performing instance registration detection on the target media session instance according to the target detection strategy to obtain instance registration detection parameters;

[0135] If the instance registration detection parameter is the first detection parameter, determining that the media session registration state of the target media session instance is a registration active state;

[0136] If the instance registration detection parameter is the second detection parameter, it is determined that the media session registration state of the target media session instance is an unregistered state.

[0137] In a possible implementation of this embodiment, the audio control device determines the audio and video playing state of the target player based on the audio and video focus of the target player, including:

[0138] Registering an audio focus listener associated with the target player, and using the audio focus listener to detect the audio and video focus of the target player;

[0139] The audio and video playback state of the target player is determined based on the focus change state of the audio and video focus.

[0140] In a possible implementation of this embodiment, the audio control device adjusts the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state, including:

[0141] If the media session registration state is an unregistered state and the audio and video playback state is a playing state, synchronizing the speaker playback state of the target external speaker to an audio output state by using a target control protocol;

[0142] If the media session registration state is an unregistered state and the audio and video playback state is a non-playing state, the target control protocol is used to synchronize the audio and video playback state of the target external speaker to an audio suspension state.

[0143] In a possible implementation of this embodiment, the audio control device responds to the playback status synchronization request of the target external speaker, and before detecting the audio and video playback status and the media session registration status of the target player, further includes:

[0144] In response to a wireless connection request for a target external speaker, obtaining connection identification information of the target external speaker;

[0145] A wireless connection is established with the target external speaker according to the connection identification information and a preset connection protocol.

[0146] In this embodiment, the audio control device plays the target audio and video by using the target player in response to the audio and video playback request for the target audio and video; detects the audio and video playback status and media session registration status of the target player in response to the playback status synchronization request of the target external speaker; adjusts the speaker playback status of the target external speaker according to the audio and video playback status and the media session registration status; and drives the target external speaker to output the target audio data in the target audio and video according to the speaker playback status. When playing audio and video data using the designated target player and target external speaker, the target player's media session registration status can be detected, and the speaker playback status of the target external speaker can be personalized controlled according to the media session registration status, so that the playback status of the target player can be correctly synchronized to the target external speaker when the player is not registered with the media session instance, thereby avoiding the abnormal situation of silent playback of the external speaker and improving the audio and video playback compatibility.

[0147] The embodiment of the present invention also provides an audio control device, such as Figure 6 As shown, Figure 6 This is a schematic diagram of the structure of an embodiment of the audio control device provided in the embodiments of the present application.

[0148] The audio control device integrates any one of the audio control devices provided in the embodiments of the present invention, and the audio control device includes:

[0149] one or more processors;

[0150] Memory; and

[0151] One or more applications, wherein the one or more applications are stored in the memory and are configured so that the processor executes the steps of the audio control method described in any of the above audio control method embodiments.

[0152] Specifically, the audio control device may include one or more processing core processors 601, one or more computer-readable storage media memories 602, a power supply 603, an input unit 604, and other components. Those skilled in the art will appreciate that Figure 6 The structure of the audio control device shown in the figure does not constitute a limitation on the audio control device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0153] The processor 601 is the control center of the audio control device. It uses various interfaces and lines to connect various parts of the entire audio control device. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it executes various functions of the audio control device and processes data, thereby monitoring the audio control device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.

[0154] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the audio control device, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0155] The audio control device also includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, so as to manage charging, discharging, power consumption management and other functions through the power management system. The power supply 603 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

[0156] The audio control device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0157] Although not shown, the audio control device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 601 in the audio control device will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602, thereby realizing various functions, as follows:

[0158] Responding to an audio or video playback request for a target audio or video, and playing the target audio or video using a target player;

[0159] Responding to the playback status synchronization request of the target external speaker, detecting the audio and video playback status and media session registration status of the target player;

[0160] Adjusting the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state;

[0161] The target external speaker is driven to output the target audio data in the target audio and video according to the playing state of the speaker.

[0162] To this end, an embodiment of the present invention provides a computer-readable storage medium, which may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any audio control method provided in an embodiment of the present invention. For example, the computer program can be loaded by a processor to execute the following steps:

[0163] Responding to an audio or video playback request for a target audio or video, and playing the target audio or video using a target player;

[0164] Responding to the playback status synchronization request of the target external speaker, detecting the audio and video playback status and media session registration status of the target player;

[0165] Adjusting the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state;

[0166] The target external speaker is driven to output the target audio data in the target audio and video according to the playing state of the speaker.

[0167] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above, and will not be repeated here.

[0168] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments, which will not be repeated here.

[0169] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0170] The above is a detailed introduction to an audio control method provided in an embodiment of the present application. Specific embodiments are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. An audio control method, characterized in that: The audio control method comprises: Responding to an audio or video playback request for a target audio or video, and playing the target audio or video using a target player; Responding to the playback status synchronization request of the target external speaker, detecting the audio and video playback status and media session registration status of the target player; Adjusting the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state; The target external speaker is driven to output the target audio data in the target audio and video according to the playing state of the speaker.

2. The audio control method according to claim 1, characterized in that: The responding to the playback status synchronization request of the target external speaker and detecting the audio and video playback status and the media session registration status of the target player includes: Receiving a playback control instruction triggered by the target external speaker based on a target control protocol, and determining that the playback control instruction is a playback state synchronization request; The audio and video playback status and the media session registration status of the target player are detected based on the playback status synchronization request.

3. The audio control method according to claim 2, characterized in that: The detecting the audio and video playback status and the media session registration status of the target player based on the playback status synchronization request includes: Obtaining a target player identifier of the target player and a target media session list; Acquire a media session instance in the target media session list and a session instance identifier corresponding to the media session instance; Determine a target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determine a media session registration state of the target media session instance; The audio and video playback status of the target player is determined based on the audio and video focus of the target player.

4. The audio control method according to claim 3, characterized in that: The step of determining the target media session instance corresponding to the target player according to the session instance identifier and the target player identifier, and determining the media session registration state of the target media session instance includes: Filtering the target media session instances in the media session instances whose session instance identifier is the same as the target player identifier; Performing instance registration detection on the target media session instance according to the target detection strategy to obtain instance registration detection parameters; If the instance registration detection parameter is the first detection parameter, determining that the media session registration state of the target media session instance is a registration active state; If the instance registration detection parameter is the second detection parameter, it is determined that the media session registration state of the target media session instance is an unregistered state.

5. The audio control method according to claim 3, characterized in that: The step of determining the audio and video playback state of the target player based on the audio and video focus of the target player includes: Registering an audio focus listener associated with the target player, and using the audio focus listener to detect the audio and video focus of the target player; The audio and video playback state of the target player is determined based on the focus change state of the audio and video focus.

6. The audio control method according to any one of claims 1 to 5, characterized in that: The adjusting the speaker playing state of the target external speaker according to the audio and video playing state and the media session registration state includes: If the media session registration state is an unregistered state and the audio and video playback state is a playing state, synchronizing the speaker playback state of the target external speaker to an audio output state by using a target control protocol; If the media session registration state is an unregistered state and the audio and video playback state is a non-playing state, the target control protocol is used to synchronize the speaker playback state of the target external speaker to an audio suspension state.

7. The audio control method according to claim 1, characterized in that: Before responding to the playback status synchronization request of the target external speaker and detecting the audio and video playback status and media session registration status of the target player, the method further includes: In response to a wireless connection request for a target external speaker, obtaining connection identification information of the target external speaker; A wireless connection is established with the target external speaker according to the connection identification information and a preset connection protocol.

8. An audio control device, characterized in that: The audio control device comprises: The data playing module is configured to respond to an audio or video playing request for a target audio or video and play the target audio or video using a target player; A state detection module is configured to respond to a playback state synchronization request of a target external speaker and detect an audio and video playback state and a media session registration state of the target player; A speaker control module is configured to perform current limiting control on the target upgrade request of the target upgrade platform according to the current limiting percentage and current limiting attribute of the target limiting strategy; The audio control module is configured to drive the target external speaker to output the target audio data in the target audio and video according to the playing state of the speaker.

9. An audio control device, characterized in that: The audio control device comprises: one or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the processor to implement the steps of the audio control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the audio control method according to any one of claims 1 to 7.

Images