Audio interaction method and device of video-on-demand system and storage medium

Abstract

The invention discloses an audio interaction method and device of a video-on-demand system and a storage medium, and the method comprises the steps: constructing an interactive equipment pool, enabling a plurality of mobile terminals to establish an associated playlist through a network and Bluetooth pairing dual connection mode, binding multimedia resource key information clicked by a user with a Bluetooth address of the corresponding mobile terminal, and playing the multimedia resource key information. Uniform on-demand management carriers which are arranged in sequence and support interactive adjustment are formed; and during switching, the current connection is automatically disconnected and the logic of the temporary connection is activated, so that orderly switching of multiple sound sources is completed. According to the invention, by constructing the multi-terminal interactive device pool, multi-user on-demand in advance is supported to improve efficiency and adapt to a multi-user scene; by means of the associated playlist, accurate binding and unified management of the multimedia and the terminal are achieved, and playing continuity is guaranteed; and based on standard protocol construction, compatibility of mainstream equipment and usability of users are considered, and interaction experience of a multi-person on-demand scene is comprehensively improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, in particular to an audio interaction method and device of a pointcast system and a storage medium. BACKGROUND

[0002] With the maturity and popularity of Bluetooth technology, as a short-range wireless communication technology, it has been widely used in the audio and video transmission scene of mobile terminals (such as mobile phones, tablets) and pointcast systems (including set-top boxes, song ordering machines and other devices). In the familiar social scene of family gatherings, class reunions, etc., users often need to transmit songs to the pointcast system through personal mobile terminals for playback to meet the needs of multiple people enjoying together.

[0003] In the prior art, the Bluetooth connection between the mobile terminal and the pointcast system generally adopts a "one-to-one" mode, that is, only one mobile terminal can be paired and audio and video data transmission with the pointcast system at a time. This mode has significant defects in the multi-person pointcast scene:

[0004] Low pointcast efficiency: when multiple people gather, if they want to play songs in different mobile terminals, they must wait for the current mobile terminal to disconnect the Bluetooth connection with the pointcast system before the next mobile terminal can re-initiate pairing and establish a connection. This cannot pre-book a pointcast, resulting in a long waiting time for users and seriously affecting the entertainment experience; and manual operation is required to disconnect the current device connection, search for and pair the next device, which is a cumbersome process and can cause playback interruption due to human error (such as pairing failure, command misfire), which cannot guarantee the continuity of audio playback. Moreover, the above solution cannot centrally manage the pointcast needs of multiple mobile terminals, which can cause problems such as disordered song playback order and incorrect audio source and song matching. SUMMARY

[0005] In view of the above problems, the present application provides an audio interaction method of a pointcast system to solve the technical problems of low pointcast efficiency and disorder of the above pointcast system.

[0006] To achieve the above purpose, the present application provides an audio interaction method of a pointcast system, comprising the following steps:

[0007] Two or more mobile terminals establish a network connection with the pointcast system and pair via Bluetooth, and the paired mobile terminals are included in an interactive device pool;

[0008] The pointcast system receives pointcast requests from each mobile terminal, generates a playlist, and each multimedia resource in the playlist is associated with the corresponding pointcast mobile terminal;

[0009] When playing the current multimedia resource, the on-demand system initiates a connection request to the mobile terminal corresponding to the next multimedia resource to be played based on the playlist, and establishes a temporary Bluetooth connection with the mobile terminal corresponding to the next multimedia resource to be played in advance; when the current multimedia resource is played out or a switching instruction is triggered, the playing resource is switched to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played.

[0010] Further, the switching of the playing resource to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played includes:

[0011] The on-demand system performs the following two operations in parallel through a Bluetooth module protocol:

[0012] sending a disconnection instruction to the mobile terminal corresponding to the current playing multimedia resource to automatically disconnect the Bluetooth connection therebetween and release the Bluetooth channel resource;

[0013] sending an activation instruction to the mobile terminal corresponding to the next multimedia resource to be played which has established the temporary Bluetooth connection, immediately connecting the Bluetooth audio source of the mobile terminal to the playing channel of the on-demand system to realize seamless switching of the audio source.

[0014] Further, the switching of the playing resource to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played further includes a playing state synchronization step:

[0015] After the switching of the audio source is completed, the on-demand system controls the connected display interface to synchronously update the key information of the current playing multimedia resource and the identifier of the corresponding mobile terminal, the key information including any one or more of the resource name, the performer and the playing duration, and the mobile terminal identifier including the device name.

[0016] Further, before the temporary Bluetooth connection is established, the following steps are further included:

[0017] When the on-demand system detects that the remaining playing time of the current multimedia resource is less than a preset threshold, the Bluetooth address of the mobile terminal corresponding to the next multimedia resource to be played is extracted from the playlist, and a prompt information is sent to the mobile terminal through the network connection to prompt the mobile terminal to automatically or manually open the audio player, so as to ensure that the audio source file is in a state of being able to be output.

[0018] Further, a mobile terminal offline processing step is further included:

[0019] The on-demand system detects whether the mobile terminal corresponding to the to-be-played multimedia resource is in an offline state, and if so, sends an offline notification to the offline mobile terminal, marks the multimedia resource corresponding to the mobile terminal as "to be activated" in the play list, skips the multimedia resource, and preferentially plays the multimedia resource corresponding to the next mobile terminal in an online state in the play list; when the offline mobile terminal is online again, a user can manually trigger playing of the "to-be-activated" multimedia resource.

[0020] Further, the application further comprises a multi-device simultaneous on-demand conflict processing step: when multiple mobile terminals simultaneously send on-demand instructions within a preset time, the on-demand system generates a unique play order according to the instruction time stamp; and the application supports opening an administrator mode after authority verification, and adjusting the play order of the multimedia resources in the play list in the administrator mode.

[0021] To solve the above technical problems, the application further provides another technical solution:

[0022] An audio interaction device of an on-demand system, comprising:

[0023] A device pool construction module: used for establishing network connection between two or more mobile terminals and the on-demand system, and performing Bluetooth pairing, and adding the paired mobile terminals into an interactive device pool;

[0024] A play list management module: used for receiving on-demand requests of the mobile terminals, and generating a play list, wherein each to-be-played multimedia resource in the play list is associated with a corresponding on-demand mobile terminal;

[0025] An audio source switching module: used for initiating a connection request to a next to-be-played multimedia resource corresponding mobile terminal based on the play list when playing a current multimedia resource, and pre-establishing a temporary Bluetooth connection with the next to-be-played multimedia resource corresponding mobile terminal; and used for switching a play resource to a Bluetooth audio source of the next to-be-played multimedia resource corresponding mobile terminal when the current multimedia resource is played to the end or a switching instruction is triggered.

[0026] Further, the switching of the play resource to the Bluetooth audio source of the next to-be-played multimedia resource corresponding mobile terminal comprises:

[0027] The on-demand system performs the following two operations in parallel through a Bluetooth module protocol:

[0028] Sending a disconnection instruction to the current play multimedia resource corresponding mobile terminal, automatically disconnecting the Bluetooth connection between them, and releasing Bluetooth channel resources;

[0029] An activation instruction is sent to the mobile terminal corresponding to the next to-be-played multimedia resource which has established a temporary Bluetooth connection, the Bluetooth sound source of the mobile terminal is immediately connected to the playing channel of the on-demand system, and seamless switching of the sound source is realized.

[0030] Further, the reminder module and the offline processing module are further included.

[0031] The reminder module is configured to send a reminder message to the mobile terminal corresponding to the to-be-played multimedia resource before the temporary Bluetooth connection is established, and instruct the mobile terminal to prepare the sound source output.

[0032] The offline processing module is configured to detect the offline state of the mobile terminal, send an offline notification to the offline mobile terminal, mark the multimedia resource corresponding to the mobile terminal as "to be activated" in the playing list, and skip the multimedia resource, and preferentially play the multimedia resource corresponding to the next mobile terminal in the playing list which is in an online state; when the offline mobile terminal is online again, the user can manually trigger the playing of the "to be activated" multimedia resource.

[0033] To solve the above technical problems, the application further provides another technical scheme:

[0034] A computer readable storage medium, the storage medium has a computer program stored thereon, the computer program is executed by a processor, and the audio interaction method of the on-demand system of the on-demand system is realized.

[0035] Different from the prior art, the above technical scheme first constructs an interactive device pool, allows multiple mobile terminals to be connected to the on-demand system through network and Bluetooth pairing, and updates the online state of the devices in real time; an associated playing list is established, the multimedia resource key information selected by the user is bound to the Bluetooth address of the corresponding mobile terminal, and a unified on-demand management carrier which is arranged in sequence and supports interactive adjustment is formed; finally, automatic switching of the sound source is realized, the temporary Bluetooth connection of the to-be-played terminal is pre-established before playing, the current connection is automatically disconnected and the temporary connection is activated when switching, and the ordered switching of multiple sound sources is completed. The technical scheme breaks through the limitation of "one-to-one" connection of Bluetooth by constructing a multi-terminal interactive device pool, supports multi-user on-demand in advance to improve efficiency and adapt to multi-person scenarios; the multimedia resource and the terminal are accurately bound and uniformly managed by means of the associated playing list, the problems of playing sequence disorder and sound source matching error are solved; the temporary connection is pre-established before playing, and the automatic operation is performed when the playing resource is switched, so as to eliminate manual operation and ensure the continuity of playing; and the construction is based on a standard protocol, and the compatibility of mainstream devices and the user friendliness are taken into account, so that the interactive experience of the multi-person on-demand scenario is comprehensively improved.

[0036] The above summary related to the invention is only a summary of the technical solutions of the present application. In order to enable those skilled in the art to more clearly understand the technical solutions of the present application, and then implement the same according to the content of the description and the drawings, and in order to enable the above and other purposes, characteristics and advantages of the present application to be more easily understood, the following will be described in combination with the specific embodiments of the present application and the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0037] The accompanying drawings are only used to show the principles, implementation manners, applications, characteristics and effects of the specific embodiments of the present application and other related contents, and cannot be considered as limitations to the present application.

[0038] In the drawings of the specification:

[0039] Figure 1 The flow chart of the audio interaction method of the on-demand system described in the specific embodiments;

[0040] Figure 2 The schematic diagram of the on-demand system connecting with the mobile terminal described in the specific embodiments;

[0041] Figure 3 The flow chart of the automatic switching of the Bluetooth audio source described in the specific embodiments;

[0042] Figure 4 The module block diagram of the audio interaction device of the on-demand system described in the specific embodiments;

[0043] Figure 5 The schematic diagram of the computer readable storage medium described in the specific embodiments.

[0044] The reference signs involved in the above drawings are explained as follows:

[0045] 400, the audio interaction device of the on-demand system; 401, the device pool construction module; 402, the playlist management module; 403, the audio source switching module; 404, the reminding module; 405, the offline processing module;

[0046] 500, the computer readable storage medium. DETAILED DESCRIPTION

[0047] In order to explain the possible application scenarios, technical principles, implementable specific solutions, and the purposes and effects that can be achieved of the present application in detail, the following will be described in combination with the specific embodiments listed and the accompanying drawings. The embodiments described in the present document are only used to more clearly explain the technical solutions of the present application, and therefore only serve as examples, and cannot limit the protection scope of the present application.

[0048] The term "embodiment" is mentioned herein means that the specific features, structures, or characteristics described in connection with the embodiment can be included in at least one embodiment of the present application. The term "embodiment" appearing in various places in the specification does not necessarily refer to the same embodiment, nor does it particularly limit the independence or association between other embodiments. In principle, in the present application, as long as there is no technical contradiction or conflict, each technical feature mentioned in each embodiment can be combined in any way to form a corresponding implementable technical solution.

[0049] Unless otherwise defined, the meaning of technical terms used herein is the same as commonly understood by one of ordinary skill in the art to which this application belongs; the use of related terms in the present application is only for the purpose of describing specific embodiments, and is not intended to limit the present application.

[0050] In the description of the present application, the phrase "and / or" is a description of the logical relationship between the objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases: A exists, B exists, and A and B exist at the same time. In addition, the character " / " in this article generally represents that the associated objects before and after are a "or" logical relationship.

[0051] In the present application, such as "first" and "second", the terms are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual quantity, primary and secondary or order relationship between the entities or operations.

[0052] In the present application, without more limitation, the "includes", "contains", "has" or other similar open expressions used in the sentence are intended to cover non-exclusive inclusion, and these expressions do not exclude the presence of other elements in the process, method or product including the described elements, so that the process, method or product including a series of elements can not only include those limited elements, but also include other elements not explicitly listed, or also include the elements inherent in such process, method or product.

[0053] As the same as the understanding in the "Guidelines for Examination", in the present application, "greater than", "less than", "exceed" and other expressions are understood as not including the number; "above", "below", "within" and other expressions are understood as including the number. In addition, in the description of the embodiments of the present application, the meaning of "multiple" is more than two (including two), and similar expressions related to "multiple" are also understood in this way, for example, "multiple groups", "multiple times" and the like, unless otherwise explicitly limited.

[0054] In the description of the embodiments of the present application, the spatially-related expressions such as "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "back", "left", "right", "vertical", "horizontal", "perpendicular", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", and the like, indicate the orientation or positional relationship shown in the specific embodiments or the drawings, and are only for the convenience of describing the specific embodiments of the present application or for the reader to understand, and do not indicate or imply that the indicated device or component must have a specific position, a specific orientation, or be constructed or operated in a specific orientation, and therefore cannot be understood as a limitation on the embodiments of the present application.

[0055] Unless otherwise explicitly specified or limited, in the description of the embodiments of the present application, the terms "mount", "connect", "connect", "fix", "set", and the like should be understood broadly. For example, the "connection" can be a fixed connection, or a detachable connection, or an integral setting; it can be a mechanical connection, or an electrical connection, or a communication connection; it can be directly connected, or indirectly connected through an intermediate medium; it can be the internal communication of two elements or the interaction relationship between two elements. For those skilled in the art to which the present application belongs, the specific meaning of the above terms in the embodiments of the present application can be understood according to the specific circumstances.

[0056] In the prior art, when multiple people request on-demand, they need to frequently disconnect and reconnect, resulting in long waiting time and low on-demand efficiency; relying on manual song cutting can easily cause playback interruption and cannot guarantee audio continuity; and there is a lack of association mechanism between "multimedia resources - terminal", which can easily cause playback sequence disorder, audio source matching error, and no unified on-demand management.

[0057] Please refer to Figures 1 to 3 To solve the above technical problems, the present embodiment provides an audio interaction method of an on-demand system. The audio interaction method of the on-demand system can be widely applied to multi-terminal alternately transmitting audio to the on-demand system in multi-person entertainment scenes, including but not limited to family party singing, KTV box song ordering, hotel banquet hall party, enterprise team building activity, small bar entertainment, etc., to meet the needs of multiple users playing audio by taking turns to order songs through personal mobile terminals (mobile phones, tablets).

[0058] As Figure 1 shown, the audio interaction method of the on-demand system of the present embodiment includes the following steps:

[0059] S101, two or more mobile terminals establish network connection with the on-demand system and perform Bluetooth pairing, and the mobile terminals that have successfully paired are included in the interactive device pool;

[0060] S102, the on-demand system receives the on-demand request of each mobile terminal, and generates a play list, each to-be-played multimedia resource in the play list is associated with a corresponding on-demand mobile terminal;

[0061] S103, when playing the current multimedia resource, the on-demand system initiates a connection request to the next to-be-played multimedia resource corresponding mobile terminal based on the play list, and pre-establishes a temporary Bluetooth connection with the next to-be-played multimedia resource corresponding mobile terminal; when the current multimedia resource is played or the switching instruction is triggered, the play resource is switched to the Bluetooth audio source of the next to-be-played multimedia resource corresponding mobile terminal.

[0062] In step S101, when performing Bluetooth pairing, the on-demand system records and verifies the Bluetooth address of each mobile terminal, and then includes the paired mobile terminal into the interactive device pool.

[0063] In step S102, each mobile terminal initiates an on-demand operation, and sends multimedia resource information to the on-demand system; after receiving the on-demand instruction, the on-demand system generates a play list associated with the multimedia resource and the corresponding mobile terminal according to the key information of the multimedia resource, the Bluetooth address of the mobile terminal initiating the on-demand, and the order of receiving the on-demand instruction.

[0064] In step S103, before the connection request to the next to-be-played multimedia resource corresponding mobile terminal is initiated, the on-demand system can first monitor the play progress of the current multimedia resource, and establish a temporary Bluetooth connection with the next to-be-played multimedia resource corresponding mobile terminal before the current multimedia resource is played; when the current multimedia resource is played or the switching instruction is triggered, the on-demand system automatically switches the audio to the Bluetooth audio source of the next to-be-played multimedia resource corresponding mobile terminal. In some other embodiments, the on-demand system can also not monitor the play progress of the current multimedia resource, but establish a temporary Bluetooth connection with the next to-be-played multimedia resource corresponding mobile terminal after the current multimedia resource is played for a preset time (for example, 1-2 minutes).

[0065] As shown in the accompanying drawings, Figure 2 By constructing a multi-terminal interactive device pool, an associated play list and an automatic audio source switching mechanism, the present patent realizes three technical effects: first, it breaks through the "one-to-one" connection limit, supports multi-terminal pre-on-demand, and greatly improves the on-demand efficiency in multi-person scenarios; second, it realizes seamless switching through pre-establishing a temporary Bluetooth connection without manual intervention, and guarantees the continuity of audio play; third, it realizes accurate binding of "multimedia resource-terminal" and unified on-demand management, avoids play order confusion and audio errors, and is compatible with mainstream devices, reducing the application threshold.

[0066] To make the technical solutions of the present embodiment clearer, the following will be described in detail in combination with a specific implementation scenario, i.e., a family gathering scenario. Illustratively, the family gathering involves 10 people, 5 mobile terminals (e.g., mobile phones), 1 on-demand system set-top box, 1 display TV, 1 set of sound box, and multimedia resources are song audios.

[0067] The on-demand system set-top box, the display TV, and the sound box constitute an on-demand system. In terms of hardware devices, the on-demand system includes a set-top box supporting Wi-Fi and Bluetooth 5.0 and having a built-in local database; the display TV is a 42-inch TV and is connected to the set-top box via an HDMI interface; the sound box is a 2.1-channel sound box and is connected to the set-top box via an audio output interface; and the 5 mobile terminals can be Android mobile phones and / or iPhones and all support Wi-Fi and Bluetooth functions. The set-top box is installed with software (integrating various functional modules) of the audio interaction method of the present embodiment; the mobile terminals are installed with an on-demand system supporting APP (supporting song ordering, reminder receiving, and state checking); and preset parameters are: a song change reminder threshold of 30 seconds, a temporary connection establishment time of 10 seconds, and a reminder mode of APP pop-up window + SMS.

[0068] Network environment: a home Wi-Fi network (bandwidth 100 Mbps, coverage range covering the gathering area), ensuring that all mobile terminals and the set-top box can access.

[0069] In step S101 of constructing the pool of interactive devices, the multiple mobile terminals are all connected to the home Wi-Fi (in a Wi-Fi-free scenario, the mobile data network can also be used to connect to the on-demand system), and through the APP, the network pairing code displayed on the screen of the set-top box is scanned to establish an exclusive network connection with the set-top box. After the connection is successful, the APP displays "Accessed the on-demand system".

[0070] Each mobile terminal starts Bluetooth, and the set-top box sends a pairing invitation through Bluetooth broadcasting. After the user confirms the pairing on the mobile terminal APP, the set-top box records the Bluetooth address of each terminal (such as Android mobile phone A: AA:BB:CC:DD:EE:FF; iPhone mobile phone B: FF:EE:DD:CC:BB:AA), and after verification, the 5 terminals are included in the pool of interactive devices. The set-top box display interface refreshes the device pool status in real time, indicating "5 devices online".

[0071] In the song ordering operation in step S102, taking song ordering as an example, the user can order multimedia resources in the following two ways: ① User 1 scans the set-top box screen QR code with mobile phone A and selects a song (e.g., "Friends"); ② User 2 selects a song (e.g., "Happy Birthday") through the APP with iPhone mobile phone B. The remaining 3 terminals select "Little Apple", "Later", and "Sky Blue" respectively through the above two ways.

[0072] In step S102, the set-top box receives each on-demand instruction, extracts the key information of each multimedia resource (such as a song), generates an associated playlist, and sorts the playlist according to the on-demand time in the order of "Friends" -> "Happy Birthday Song" -> "Little Apple" -> "Later" -> "Horizon". After the user 1 views the list on the APP, the "Happy Birthday Song" is placed at the top (adjusted to the second song, and the original second to fifth songs are sequentially extended), and the set-top box interface synchronously updates the list order.

[0073] In step S103, a temporary Bluetooth connection of the next to-be-played multimedia resource corresponding to the mobile terminal is established before the current multimedia resource (such as a song) is played to the end; for example, when the song "Friends" is played to the remaining 10 seconds, the set-top box establishes a temporary Bluetooth connection with the iPhone B, verifies the consistency of the Bluetooth address, and keeps the connection in standby state without transmitting audio data. When the current multimedia resource is played to the end or a song switching instruction is triggered, the on-demand system automatically switches the audio to the Bluetooth audio source of the next to-be-played multimedia resource corresponding to the mobile terminal.

[0074] As shown in Figure 3 the switching of the playing resource to the Bluetooth audio source of the next to-be-played multimedia resource corresponding to the mobile terminal includes:

[0075] The on-demand system performs the following two operations in parallel through the Bluetooth module protocol:

[0076] S301, a disconnect instruction is sent to the mobile terminal corresponding to the current playing multimedia resource, the Bluetooth connection between the two is automatically disconnected, and the Bluetooth channel resource is released;

[0077] S302, an activation instruction is sent to the mobile terminal corresponding to the next to-be-played multimedia resource which has established a temporary Bluetooth connection, the Bluetooth audio source of the mobile terminal is immediately connected to the playing channel of the on-demand system, and seamless switching of the audio source is realized.

[0078] For example, when the "Friends" is played to the end, the set-top box audio decoding module detects the end of the audio stream and automatically generates a song switching instruction; the audio source switching module performs the following operations in parallel: ① disconnect the Bluetooth connection with the Android phone A and release the resource; ② activate the temporary Bluetooth connection with the iPhone B and connect the audio signal of "Happy Birthday Song" to the audio amplifier. The switching process takes a short time and the user has no perceptual interruption, and the "Happy Birthday Song" is played smoothly on the audio amplifier.

[0079] It should be noted that in the present embodiment, the temporary Bluetooth connection is a pre-ready connection mode designed for multi-terminal on-demand seamless song switching, which is significantly different from the conventional Bluetooth connection: the conventional Bluetooth connection needs to be established immediately when switching songs, the connection establishment (including search and pairing) and audio transmission are started synchronously, which consumes a lot of time and easily causes playback interruption, only serves single-terminal single-audio-source playback, and occupies resources with high load throughout the connection; while the temporary Bluetooth connection is established in advance at the end of the current multimedia resource (for example, a song) playback (remaining preset threshold time), only completes device identity verification and link negotiation, does not transmit audio data, and remains in a low-power standby state, so that seamless switching can be achieved by simply activating when switching songs, without the need for manual device identity verification and link negotiation again, such as username or password, thereby shortening the Bluetooth audio source switching time, improving the Bluetooth audio source switching efficiency, and in the present embodiment, the mobile terminal is precisely bound to each multimedia resource in the playlist, and is automatically activated or deactivated along with the multimedia resource playback process, which not only avoids switching interruption, but also greatly reduces resource occupation, and perfectly adapts to the multi-terminal alternating on-demand scenario.

[0080] In the present embodiment, the audio is switched to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played, which is not to send the unresolved song audio file (such as an MP3 format audio file) to the on-demand system, but to parse the audio file of the multimedia resource by the mobile terminal, and then send the parsed raw audio stream to the on-demand system through Bluetooth for direct playback by the on-demand system. Specifically, taking song ordering as an example, after the mobile terminal receives the song ordering instruction of the user, it first parses the audio file (supporting MP3, FLAC, WAV, AAC, OGG, etc.) stored locally or obtained from the cloud: through the built-in audio decoding engine of the terminal (such as MediaCodec of the Android system and AVAudioPlayer of the iOS system), the raw audio file is decoded into a PCM (Pulse Code Modulation) format raw audio stream (specific parameters: sampling rate 44.1kHz, bit depth 16bit, channel number 2.0, meeting the standard audio transmission requirements of Bluetooth A2DP protocol). PCM format as uncompressed raw audio data, which can be directly recognized and driven by the on-demand system to play through the loudspeaker, without the need for secondary decoding. The parsed PCM audio stream is transmitted to the on-demand system through Bluetooth A2DP (Advanced Audio Distribution Profile): the mobile terminal acts as the audio source (Source), and the Bluetooth module of the on-demand system acts as the audio receiving end (Sink), and a dedicated synchronous connection (SCO link) is established between the two to ensure real-time transmission of the audio stream at a constant bit rate (1.4Mbps), avoiding stuttering or delay.

[0081] Therefore in the embodiment, the compatibility of the format of the multimedia resource such as the song breaks through the dependence of the traditional on-demand system on its decoding capability, and only supports limited formats (such as only supporting MP3 and WAV), and cannot process special audio files such as FLAC lossless format and DSD high-resolution format. The embodiment transfers the decoding responsibility to the mobile terminal, uses the powerful decoding capability (supporting more than 95% of mainstream audio formats) of the smart phone and other devices, so that the on-demand system can play files of various formats without upgrading the hardware decoding module, and significantly reduces the compatibility threshold of the system. Moreover, the on-demand system can directly convert into an analog signal through a digital-to-analog converter (DAC) after receiving, so as to save the time-consuming step of "receiving compressed files - local decoding" in the traditional process, and further shorten the response time of the sound source switching by cooperating with the temporary Bluetooth connection established in advance.

[0082] In the embodiment, by constructing a multi-terminal interactive device pool, the limitation of "one-to-one" connection of Bluetooth is broken through, multi-user on-demand is supported in advance to improve efficiency and adapt to a multi-person scene; by means of an associated playlist, multimedia resources and terminals are accurately bound and uniformly managed, and the problems of chaotic playing order and incorrect sound source matching are solved; by pre-establishing a temporary connection before playing and automatically switching when the song is changed, manual operation is eliminated, and the continuity of playing is ensured; and based on a standard protocol, the compatibility of mainstream devices and the user friendliness are taken into account, and the interactive experience of the multi-person on-demand scene is comprehensively improved.

[0083] In the embodiment, before the temporary Bluetooth connection is established, the following steps are further included:

[0084] When the on-demand system detects that the remaining playing time of the current multimedia resource is less than a preset threshold, the Bluetooth address of the mobile terminal corresponding to the next to-be-played multimedia resource is extracted from the playlist, and a prompt message is sent to the mobile terminal through the network connection to prompt the mobile terminal to automatically or manually open the audio player, so as to ensure that the sound source file is in a state of being able to be output.

[0085] For example, the set-top box of the on-demand system starts playing "Friends", and when it is detected that the playing time is 30 seconds, a prompt is triggered: the set-top box sends an APP pop-up window to iPhone B (the terminal corresponding to "Happy Birthday Song") through the network connection, prompting "The song "Happy Birthday Song" selected by you will be played soon, please open the audio player", and sends a short message prompt; after user 2 confirms on iPhone B, the APP automatically opens the audio player and loads the sound source file of "Happy Birthday Song".

[0086] Therefore, by detecting the remaining playing time of the multimedia resource and triggering the prompt, the mobile terminal corresponding to the next to-be-played multimedia resource can be timely notified to make playing preparation, so that the switching is more smooth.

[0087] In some embodiments, the on-demand system automatically performing audio switching further comprises a playing state synchronizing step:

[0088] After the audio source switching is completed, the on-demand system controls the connected display interface to synchronously update the key information of the currently played multimedia resource and the identification of the corresponding mobile terminal, the key information including any one or more of the resource name, the performer and the playing time length. When the multimedia resource is a song, the key information includes any one or more of the song name, the singer and the song time length, and the mobile terminal identification includes the device name.

[0089] After the on-demand system switches the song "Friends" to "Birthday Song", it synchronously controls the display TV to update and display: "Current playing: Birthday Song | Audio source device: iPhone mobile phone B", so that all users can clearly understand the current playing state.

[0090] In some embodiments, the audio interaction method of the on-demand system further comprises a mobile terminal offline processing step, which comprises:

[0091] The on-demand system detects whether the mobile terminal corresponding to the to-be-played multimedia resource is in an offline state. If yes, it sends an offline notification to the offline mobile terminal, marks the multimedia resource corresponding to the mobile terminal as "to be activated" in the play list, and skips the multimedia resource to preferentially play the multimedia resource corresponding to the next mobile terminal in an online state in the play list; when the offline mobile terminal is reconnected, the user can manually trigger the playing of the "to be activated" multimedia resource.

[0092] For example, when "Birthday Song" is played for 30 seconds, the on-demand system detects that the next song "Little Apple" corresponds to a terminal (Android mobile phone C) that is offline (user 3 mistakenly turns off Bluetooth), at which time the mobile terminal offline processing step is performed. Specifically, the on-demand system sends a short message to Android mobile phone C reminding "You selected "Little Apple" cannot be played due to device offline, please turn on Bluetooth again"; marks "Little Apple" as "to be activated" in the associated play list; skips the song and extracts the next song "Later" corresponding to the terminal (Android mobile phone D) to perform sending a reminder and establishing a temporary connection.

[0093] After a period of time (for example, 10 minutes), Android mobile phone C reopens Bluetooth and accesses the network, and the interactive device pool identifies that it is online, user 3 sees the "to be activated" mark of "Little Apple" on the APP and clicks "play immediately", the song is inserted after the currently played "Later", realizing flexible scheduling.

[0094] In an embodiment, the audio interaction method of the on-demand system further comprises a multi-mobile terminal simultaneous on-demand conflict processing step:

[0095] When multiple mobile terminals send on-demand instructions to the on-demand system at the same time within a preset time interval (e.g., ≤1 second), the on-demand system extracts the receiving time stamps of each on-demand instruction, sorts the corresponding multimedia resources in chronological order, generates a unique playing order and updates it to the playing list; at the same time, the on-demand system supports administrator mode, and the administrator can adjust the playing order of the multimedia resources in the playing list (including top, queuing, adjusting priority) after starting the mode by inputting preset permission verification information (such as password, verification code), so as to meet the playing requirements in special scenarios.

[0096] In this embodiment, based on the instruction scheduling and interaction design of the on-demand system, through the triple mechanism of "time stamp fine sorting + active conflict avoidance + permission control", the mobile terminal is prevented from on-demanding at the same time within a preset time interval (e.g., ≤1 second) from two aspects of "conflict prevention" and "conflict resolution".

[0097] The set-top box of the on-demand system marks the receiving time stamp (such as "2025-10-21 20:30:45.123" "2025-10-21 20:30:45.128") of each received on-demand instruction to the millisecond level, so that even if the receiving time difference of multiple terminal on-demand instructions is only a few milliseconds, the time stamp can also distinguish the chronological order. The on-demand system sets a temporary on-demand instruction cache queue, when multiple on-demand instructions are received within a preset time interval, all instructions are first stored in the queue, then sorted in chronological order according to the time stamp from small to large, a unique playing order is generated and updated to the playing list, so as to avoid the sorting disorder caused by parallel instruction reception, and eliminate the disorder problem of "on-demanding at the same time" from the bottom logic. The on-demand interface (such as APP, two-dimensional code on-demand page) of the mobile terminal synchronizes the "on-demand multimedia resource list" of the on-demand system in real time, and displays the "on-demand time" and "expected playing period" of each multimedia resource. Before on-demanding, the user can directly see whether other users are on-demanding at the moment, and actively stagger the on-demanding time.

[0098] As shown in Figure 4 Another embodiment provides an audio interaction device 400 of an on-demand system. The audio interaction device of the on-demand system comprises a device pool construction module 401, a playing list management module 402 and an audio source switching module 403.

[0099] The device pool construction module 401 is used to realize the network connection between two or more mobile terminals and the on-demand system, and the Bluetooth pairing, and the paired mobile terminals are included in the interactive device pool;

[0100] The playing list management module 402 is used to receive the on-demand request of each mobile terminal, generate a playing list, and associate each to-be-played multimedia resource in the playing list with the corresponding on-demand mobile terminal;

[0101] The audio source switching module 403 is configured to, when playing a current multimedia resource, initiate a connection request to a next multimedia resource to be played based on a play list, and pre-establish a temporary Bluetooth connection with a mobile terminal corresponding to the next multimedia resource to be played; and when the current multimedia resource is played to the end or a switching instruction is triggered, switch the play resource to a Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played.

[0102] In this embodiment, the switching of the play resource to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played includes:

[0103] The on-demand system performs the following two operations in parallel through a Bluetooth module protocol:

[0104] sending a disconnection instruction to the mobile terminal corresponding to the current multimedia resource to automatically disconnect the Bluetooth connection between them and release the Bluetooth channel resource;

[0105] sending an activation instruction to the mobile terminal corresponding to the next multimedia resource to be played which has established a temporary Bluetooth connection, immediately connecting the Bluetooth audio source of the mobile terminal to a play channel of the on-demand system, and realizing seamless switching of the audio source.

[0106] As shown in FIG. 4, in an embodiment, the audio interaction device of the on-demand system further includes a reminding module 404 and an offline processing module 405. Figure 4

[0107] The reminding module 404 is configured to, before establishing a temporary Bluetooth connection, send a reminding message to the mobile terminal corresponding to the multimedia resource to be played, instructing it to prepare an audio source output; and the offline processing module 405 is configured to detect an offline state of the mobile terminal, send an offline notification to the offline mobile terminal, mark the multimedia resource corresponding to the mobile terminal as "to be activated" in the play list, and skip the multimedia resource, and preferentially play a multimedia resource corresponding to a next mobile terminal in an online state in the play list; when the offline mobile terminal is online again, a user can manually trigger the play of the "to be activated" multimedia resource.

[0108] In this embodiment, by constructing a multi-terminal interactive device pool, the limitation of Bluetooth "one-to-one" connection is broken through, multi-user on-demand is supported in advance to improve efficiency and adapt to multi-person scenarios; with the aid of an associated play list, multimedia resources and terminals are accurately bound and uniformly managed, and the problems of chaotic play order and incorrect audio source matching are solved; by pre-establishing a temporary connection before playing and automatically switching when switching, manual operation is eliminated, and the continuity of playing is ensured; and based on a standard protocol, mainstream device compatibility and user ease of use are taken into account, and the interactive experience of the multi-person on-demand scenario is comprehensively improved.

[0109] As shown in FIG. 4, in an embodiment, the audio interaction device of the on-demand system further includes a reminding module 404 and an offline processing module 405. Figure 5 ​As shown, another embodiment provides a computer readable storage medium 500 having stored thereon a computer program which, when executed by a processor, implements the audio interaction method of the on-demand system of the on-demand system according to any one of the above embodiments.

[0110] The computer readable storage medium can be a volatile memory or a non-volatile memory, and can also include both a volatile memory and a non-volatile memory. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a ferromagnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM).

[0111] The volatile memory can be a Random Access Memory (RAM) used as an external cache. By way of example, and not limitation, many forms of RAM can be used, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Sync Link Dynamic Random Access Memory (SLDRAM), Direct Rambus Random Access Memory (DRRAM). The computer readable storage medium of the embodiments described herein are intended to include these and any other suitable types of memory.

[0112] In some embodiments, the processor can be implemented by software, hardware, firmware or a combination thereof, and can use at least one of circuit, single or multiple Application Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (FPGA), Central Processing Unit (CPU), controller, microcontroller, microprocessor, so that the processor can execute part or all of the steps or any combination of the steps in the audio interaction method of the on-demand system in various embodiments of the present application.

[0113] Finally, it should be noted that the above-mentioned embodiments have been described in the specification and drawings of the present application, but this does not limit the patent protection scope of the present application. Any technical solutions obtained by replacing or modifying the equivalent structure or equivalent process based on the essential concept of the present application, using the content described in the specification and drawings of the present application, and directly or indirectly implementing the technical solutions of the above embodiments in other related technical fields, are all included in the patent protection scope of the present application.

Claims

1. An audio interaction method for a video-on-demand system, characterized in that, Includes the following steps: Two or more mobile terminals establish a network connection with the video-on-demand system and pair them via Bluetooth. The successfully paired mobile terminals are then added to the pool of interactive devices. The on-demand system receives on-demand requests from various mobile terminals and generates a playlist, wherein each multimedia resource to be played in the playlist is associated with the corresponding on-demand mobile terminal. When playing the current multimedia resource, the on-demand system initiates a connection request to the mobile terminal corresponding to the next multimedia resource to be played based on the playlist, and pre-establishes a temporary Bluetooth connection with the mobile terminal corresponding to the next multimedia resource to be played; when the current multimedia resource finishes playing or a switching command is triggered, the playback resource is switched to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played.

2. The audio interaction method of the on-demand system according to claim 1, characterized in that, The step of switching the playback resource to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played includes: The on-demand system performs the following two operations in parallel via Bluetooth module protocol: Send a disconnect command to the mobile terminal corresponding to the currently playing multimedia resource to automatically disconnect the Bluetooth connection between the two and release the Bluetooth channel resources; An activation command is sent to the mobile terminal corresponding to the next multimedia resource to be played, which has already established a temporary Bluetooth connection, and the Bluetooth audio source of the mobile terminal is immediately connected to the playback channel of the on-demand system to achieve seamless switching of audio sources.

3. The audio interaction method of the on-demand system according to claim 1, characterized in that, The step of switching the playback resource to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played also includes a playback status synchronization step: After the audio source switching is completed, the on-demand system controls the connected display interface to synchronously update the key information of the currently playing multimedia resource and the identifier of the corresponding mobile terminal. The key information includes any one or more of the resource name, performer, and playback duration, and the mobile terminal identifier includes the device name.

4. The audio interaction method of the on-demand system according to claim 1, characterized in that, Before establishing the temporary Bluetooth connection, the following steps are also included: When the on-demand system detects that the remaining playback time of the current multimedia resource is less than a preset threshold, it extracts the Bluetooth address of the mobile terminal corresponding to the next multimedia resource to be played from the playlist and sends a reminder message to the mobile terminal through the network connection to prompt the mobile terminal to automatically or manually open the audio player and ensure that the audio source file is in an output state.

5. The audio interaction method of the on-demand system according to claim 1, characterized in that, It also includes offline processing steps for mobile terminals: The on-demand system detects whether the mobile terminal corresponding to the multimedia resource to be played is offline. If so, it sends an offline notification to the offline mobile terminal, marks the multimedia resource corresponding to the mobile terminal as "to be activated" in the playlist, skips the multimedia resource, and prioritizes playing the next multimedia resource corresponding to an online mobile terminal in the playlist. When the offline mobile terminal comes back online, the user can manually trigger the playback of the "to be activated" multimedia resource.

6. The audio interaction method of the on-demand system according to claim 1, characterized in that, It also includes a multi-device simultaneous on-demand conflict handling step: when multiple mobile terminals send on-demand instructions simultaneously within a preset time, the on-demand system generates a unique playback order based on the instruction reception timestamp. It also supports enabling administrator mode after permission verification, allowing users to adjust the playback order of multimedia resources in the playlist.

7. An audio interaction device for a video-on-demand system, characterized in that, include: Device pool construction module: used to enable two or more mobile terminals to establish network connection with the video-on-demand system, perform Bluetooth pairing, and add the successfully paired mobile terminals to the interactive device pool; Playlist management module: Receives on-demand requests from various mobile terminals and generates a playlist, wherein each multimedia resource to be played in the playlist is associated with the corresponding on-demand mobile terminal; Audio source switching module: When playing the current multimedia resource, it initiates a connection request to the mobile terminal corresponding to the next multimedia resource to be played based on the playlist, and pre-establishes a temporary Bluetooth connection with the mobile terminal corresponding to the next multimedia resource to be played; when the current multimedia resource finishes playing or a switching command is triggered, the playback resource is switched to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played.

8. The audio interaction device of the on-demand system according to claim 7, characterized in that, The step of switching the playback resource to the Bluetooth audio source of the mobile terminal corresponding to the next multimedia resource to be played includes: The on-demand system performs the following two operations in parallel via Bluetooth module protocol: Send a disconnect command to the mobile terminal corresponding to the currently playing multimedia resource to automatically disconnect the Bluetooth connection between the two and release the Bluetooth channel resources; An activation command is sent to the mobile terminal corresponding to the next multimedia resource to be played, which has already established a temporary Bluetooth connection, and the Bluetooth audio source of the mobile terminal is immediately connected to the playback channel of the on-demand system to achieve seamless switching of audio sources.

9. The audio interaction device of the on-demand system according to claim 7, characterized in that, It also includes a reminder module and an offline processing module; The reminder module is used to send a reminder message to the mobile terminal corresponding to the multimedia resource to be played before establishing a temporary Bluetooth connection, instructing it to prepare for audio source output. Offline processing module: Used to detect the offline status of a mobile terminal, send an offline notification to the offline mobile terminal, mark the multimedia resource corresponding to the mobile terminal as "to be activated" in the playlist, skip the multimedia resource, and prioritize playing the multimedia resource corresponding to the next online mobile terminal in the playlist; when the offline mobile terminal comes back online, the user can manually trigger the playback of the "to be activated" multimedia resource.

10. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which, when executed by a processor, implements the audio interaction method of the on-demand system as described in any one of claims 1-6.

Images