Audio output method and device and storage medium

Abstract

The invention relates to an audio output method and device and a storage medium. The audio output method comprises the steps of displaying an audio operation interface in response to detection of one or more audios to be output; and in response to the detected selection operation of the user on the audio operation interface, outputting the audio identified by the audio identifier having the corresponding relationship with the audio playing module. Through the selection operation performed by the user on the audio operation interface, autonomous selection of the audio playing module is realized, and the use experience of the user on the terminal is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of information processing, and in particular to an audio output method, device and storage medium. Background Art

[0002] With the development of terminal technology, users have an increasing demand for multi-mode use of terminal audio applications.

[0003] When using a terminal, users are no longer limited to playing audio from a single hardware device for a single category of audio, and there will be more complex usage requirements. For example, users need to play audio from different playback devices of the terminal for different categories of audio at the same time. For example: when driving, the user needs to play music on the car Bluetooth speaker, and also needs to output the call audio through the Bluetooth headset. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides an audio output method, device and storage medium.

[0005] According to the first aspect of an embodiment of the present disclosure, there is provided an audio output method, which is applied to a terminal, and includes: in response to detecting one or more audios to be output, displaying an audio operation interface, and displaying audio identifiers of the one or more audios and one or more audio output modules on the audio operation interface; in response to detecting a selection operation of a user on the audio operation interface, outputting the corresponding audio to be output through the target audio output module selected by the selection operation.

[0006] In one embodiment, after displaying the audio operation interface, the method further includes: in response to detecting the presence of a new access module, and the new access module is a module with an audio output function, displaying an identifier of the new access module in the audio operation interface.

[0007] In another embodiment, the method further includes: in response to detecting the presence of an audio identifier corresponding to the newly added audio to be output, adding the audio identifier to the audio operation interface.

[0008] In another embodiment, the method further includes: in response to detecting a deletion operation performed by the user on the audio operation interface, the deletion operation being used to delete the audio identification and / or audio output module identification, deleting the audio identification and / or audio output module identification corresponding to the deletion operation from the audio operation interface.

[0009] In another embodiment, the detecting of the user's selection operation on the audio operation interface includes: if it is detected that the user drags the audio identifier within the audio operation interface to the area displayed by the audio module identifier, it is determined that the user's selection operation on the audio operation interface is detected.

[0010] In another embodiment, the detection of the user's deletion operation on the audio operation interface includes: if it is detected that the user removes the audio identifier and / or removes the audio output module identifier on the audio operation interface, it is determined that the user's deletion operation on the audio operation interface is detected.

[0011] In another embodiment, the target audio output module selected by the selection operation outputs the corresponding audio to be output, including: determining the target thread identifier based on the correspondence between the thread identifier, the audio output module, and the audio, the target thread identifier being the audio output module identified by the audio output module identifier selected by the selection operation and the identifier of the thread corresponding to the audio to be output; based on the target thread corresponding to the target thread identifier, controlling the audio output module to output the audio identified by the audio identifier having the correspondence relationship with the audio output module.

[0012] According to a second aspect of an embodiment of the present disclosure, there is provided an audio output device, applied to a terminal, comprising:

[0013] A display unit, configured to display an audio operation interface in response to detecting one or more audios to be output, and displaying audio identifiers of the one or more audios and one or more audio playback modules on the audio operation interface;

[0014] The processing unit is used to respond to detecting a selection operation of the user on the audio operation interface and output the corresponding audio to be output through the target audio output module selected by the selection operation.

[0015] In one embodiment, the display unit is also used for: after displaying the audio operation interface, in response to monitoring the existence of a new access module, and the new access module is a module with an audio output function, displaying the logo of the new access module in the audio operation interface.

[0016] In another embodiment, the display unit is further used for: in response to detecting the presence of an audio identifier corresponding to the newly added audio to be output, adding the audio identifier to the audio operation interface.

[0017] In another embodiment, the display unit is also used for: in response to detecting a deletion operation of the user on the audio operation interface, the deletion operation is used to delete the audio identification and / or audio output module identification, deleting the audio identification and / or audio output module identification corresponding to the deletion operation from the audio operation interface.

[0018] In another embodiment, the processing unit detects the user's selection operation on the audio operation interface in the following manner: if it is detected that the user drags the audio identifier within the area displayed by the audio module identifier on the audio operation interface, it is determined that the user's selection operation on the audio operation interface is detected.

[0019] In another embodiment, the processing unit detects the user's deletion operation on the audio operation interface in the following manner: if it is detected that the user removes the audio identifier and / or removes the audio output module identifier on the audio operation interface, it is determined that the user's deletion operation on the audio operation interface is detected.

[0020] In another embodiment, the processing unit adopts the following method to output the audio identified by the audio identifier having the corresponding relationship with the audio playback module through the audio playback module identified by the audio output module identifier selected by the selection operation: based on the correspondence between the thread identifier, the audio playback module, and the audio, determine the target thread identifier, the target thread identifier being the identifier of the thread corresponding to the audio playback module identified by the audio output module identifier selected by the selection operation and the audio to be output; based on the target thread corresponding to the target thread identifier, control the audio playback module to output the audio identified by the audio identifier having the corresponding relationship with the audio playback module.

[0021] According to a third aspect of an embodiment of the present disclosure, an audio output device is provided, comprising: a processor; and a memory for storing processor executable commands; wherein the processor is configured to: execute the audio output method described in the first aspect or any one implementation of the first aspect.

[0022] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a device, the device is enabled to execute the audio output method described in the first aspect or any one of the implementations of the first aspect.

[0023] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: in response to determining that there are one or more audios to be output, the audio operation interface is displayed, and based on the user's selection operation on the audio operation interface, the audio to be output is output on the selected audio playback device. In this way, the user can independently select the playback device for outputting the audio to be output, thereby improving the user's experience of using the terminal.

[0024] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0026] Figure 1 The figure is a flowchart of an audio playing method according to an exemplary embodiment.

[0027] Figure 2 The figure is a schematic diagram of an audio operation interface according to an exemplary embodiment.

[0028] Figure 3 The figure is a schematic diagram showing an audio operation interface after a selection operation according to an exemplary embodiment.

[0029] Figure 4 The figure is a schematic diagram showing another audio operation interface after a selection operation according to an exemplary embodiment.

[0030] Figure 5 The present invention is a flow chart of a method for updating an access module identification in an audio operation interface according to an exemplary embodiment.

[0031] Figure 6 The present invention is a schematic diagram showing an audio operation interface updating access module identification according to an exemplary embodiment.

[0032] Figure 7 The present invention is a flow chart of a method for updating audio to be played in an audio operation interface according to an exemplary embodiment.

[0033] Figure 8 The present invention is a schematic diagram showing an audio operation interface updating an audio identifier to be played according to an exemplary embodiment.

[0034] Fig. 9 The present invention is a flow chart of a method for deleting an audio operation interface according to an exemplary embodiment.

[0035] Fig.10The figure is a schematic diagram of an audio operation interface removal operation according to an exemplary embodiment.

[0036] Fig.11 is a schematic diagram of yet another audio operation interface removal operation according to an exemplary embodiment.

[0037] Fig.12 The present invention is a flow chart of a method for implementing audio playback based on threads according to an exemplary embodiment.

[0038] Fig.13 The invention is a block diagram of an audio output device according to an exemplary embodiment.

[0039] Fig.14 The present invention is a block diagram of an audio output device according to an exemplary embodiment.

[0040] Fig.15 The present invention is a block diagram of an audio output device according to an exemplary embodiment. DETAILED DESCRIPTION

[0041] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0042] The audio application operation method involved in the embodiment of the present disclosure is applied to the terminal. The terminal involved in the present disclosure may also be referred to as a terminal device, a user equipment (User Equipment, UE), a mobile station (Mobile Station, MS), a mobile terminal (Mobile Terminal, MT), etc., which is a device that provides voice and / or data connectivity to users. For example, the terminal can be a handheld device with a wireless connection function, a vehicle-mounted device, etc. At present, some examples of terminals are: a smart phone (Mobile Phone), a customer premise equipment (Customer Premise Equipment, CPE), a pocket computer (Pocket Personal Computer, PPC), a handheld computer, a personal digital assistant (Personal Digital Assistant, PDA), a laptop computer, a tablet computer, a wearable device, or a vehicle-mounted device, etc. It should be understood that the embodiment of the present disclosure does not limit the specific technology and specific device form adopted by the terminal.

[0043] It should be noted that, in order to facilitate understanding of the technical solution, the following embodiments are described using a terminal in the form of a smart phone as an example.

[0044] With the continuous development of terminal technology, the functions of terminals are becoming more and more abundant, which can meet more and more needs of current users. Correspondingly, users are gradually putting forward higher requirements for terminal functions.

[0045] Take the audio playback function of the terminal as an example. In the related art, the functions and scenarios of audio playback of the terminal are relatively fixed, and it is not possible to play multiple audios in the same scenario or use different audio output devices for different audio playback at the same time. For example: in the related art, when a user uses a terminal to connect to a car stereo for music playback, the output of the car stereo is the audio playback task currently executed by the terminal, such as playing song A or playing broadcast B. When the terminal receives a call request, if the user accepts the call request using the terminal, the A song or broadcast B currently being played by the terminal will be paused, and the call content will be played through the car stereo connected to the terminal. In summary, the problem of being unable to independently select the corresponding hardware playback device for multiple audio playback tasks will reduce the user's experience with the terminal.

[0046] In view of this, the embodiment of the present disclosure provides an audio application operation method, which performs a selection operation on the audio operation interface based on user needs, establishes a correspondence between the audio to be output and the audio playback device, and thus selects the audio playback device required by the user to output the audio to be output. In this way, the autonomous selection of the playback device for outputting the audio to be output is realized, thereby improving the user's experience of using the terminal.

[0047] It should be noted that the audio playback module involved in the embodiments of the present disclosure can be understood as a device (including a terminal) that has a data stream connection with a terminal and can be used for audio playback, such as: Bluetooth headsets, Bluetooth speakers, and car speakers.

[0048] It should be noted that "audio output" includes at least one of the following situations: audio files are played based on hardware devices (for example, playing music through speakers, etc.), or audio files are transmitted based on data streams (for example, transmitting the audio files to be played in the terminal to a device that establishes a data stream connection module with the terminal, etc.).

[0049] Therefore, in the embodiments of the present disclosure, when "audio output" represents related semantics such as "audio file playback based on hardware devices" in the embodiments, it can be replaced with words such as "audio playback", or when "audio output" represents related semantics such as "audio file transmission based on data stream" in the embodiments, it can be replaced with words such as "audio transmission" and "data transmission".

[0050] It should be noted that the audio output module involved in the embodiments of the present disclosure, in addition to the above-mentioned audio playback device, also includes a hardware playback module set up by the terminal itself (for example: speakers, receivers, etc.) and software modules that can be used for audio processing (for example: recording modules, etc.).

[0051] Therefore, in the embodiments of the present disclosure, "audio output module" can be replaced with words such as "audio playback device" and "hardware playback module" when representing the meanings of "audio playback device, hardware playback module set by the terminal itself" in the embodiments, or "audio output module" can be replaced with words such as "software", "application" or "program" when representing the meanings of "software module that can be used for audio processing-related".

[0052] It should be understood that the module having a data stream connection with the terminal is not limited to being connected to the terminal via the Bluetooth protocol, but also includes a module that can be used for audio playback based on a connection such as Wireless Fidelity (Wi-Fi) or a cellular network.

[0053] It should be understood that the module having a data stream connection with the terminal also includes a module that can be used for audio playback by establishing a data connection with the terminal via a Universal Serial Bus (USB), such as a wired headset and a wired speaker.

[0054] Figure 1 is a flowchart of an audio output method according to an exemplary embodiment. Figure 1 As shown, the audio output method includes the following steps.

[0055] In step S11 , in response to detecting one or more audios to be output, an audio operation interface is displayed.

[0056] In one implementation of the embodiment of the present disclosure, one or more audio identifiers of audio and one or more audio output module identifiers are displayed on the audio operation interface.

[0057] In one implementation of the embodiment of the present disclosure, in the audio operation interface, each audio identifier represents an audio to be output, and each audio output module identifier represents an audio output module having a data stream connection with the terminal.

[0058] In step S12, in response to detecting a selection operation of the user on the audio operation interface, the corresponding audio to be output is output through the target audio output module selected by the selection operation.

[0059] Optionally, the corresponding audio to be output may be understood as audio having a corresponding relationship with the audio playback module.

[0060] Optionally, the target audio output module may be understood as an audio playback module identified by the audio output module identifier.

[0061] In one implementation of the embodiments of the present disclosure, in response to detecting a selection operation of a user on an audio operation interface, the audio identified by an audio identifier having a corresponding relationship with the audio output module is output through the target audio output module selected by the selection operation.

[0062] In one implementation of the embodiment of the present disclosure, the detection of one or more audios to be output may be implemented in the following manner:

[0063] Poll the buffer area to obtain relevant information of the audio to be output (such as the category information of the audio to be output or the ID of the audio to be output);

[0064] It should be understood that, taking the audio playback of the Android system in the related art as an example, in the audio playback system, the buffer area is used to cache the audio data indicated by the audio track (AudioTrack), wherein the audio data includes the audio to be output.

[0065] Based on the relevant information of the audio to be output, one or more audios to be output are determined.

[0066] In one implementation of the embodiment of the present disclosure, the area of ​​the audio operation interface is smaller than or equal to the screen display area of ​​the terminal.

[0067] For example, Figure 2 FIG. 1 is a schematic diagram of an audio operation interface according to an exemplary embodiment. Figure 2 As shown, the display screen 12 of the terminal 11 can be used to display an audio operation interface 13. The audio operation interface 13 mainly includes a module area 14 for displaying an audio output module having a data stream connection with the terminal and an audio area 15 for displaying audio to be output.

[0068] In the module area 14, the audio output modules currently connected to the terminal with data streams may be displayed, including: speakers, recording modules, wired headphones, receivers, Bluetooth headphones, and Bluetooth speakers, etc. Each audio output module may be represented by a corresponding audio output module identifier, for example, by an ID or name corresponding to each module to identify the corresponding audio output module.

[0069] In the audio area 15, the audio to be outputted by the current terminal can be displayed, including: A song, B broadcast, C recording, and call request from D, etc. Each audio to be outputted can be represented by a corresponding audio identifier, for example, the identifier "①" represents the song, the identifier "②" represents the broadcast, the identifier "③" represents the recording, and the identifier "④" represents the call request from D.

[0070] It should be understood that the above-mentioned audio identification and audio output module identification can be identified in the above-mentioned forms, or can be represented in the form of corresponding pictures or texts.

[0071] In one implementation of the embodiment of the present disclosure, the selection operation is used to select an audio identifier and an audio output module identifier, and to create a corresponding relationship between the selected audio identifier and the audio output module identifier.

[0072] In one implementation of the disclosed embodiment, for the selection operation on the audio interface, the user can drag the audio identifier to the corresponding audio output module identifier to establish a correspondence between the audio identifier and the audio output module, so as to achieve the output of the corresponding audio using the corresponding audio output module.

[0073] For example, Figure 3 FIG. 1 is a schematic diagram showing an audio operation interface after selecting an operation according to an exemplary embodiment. Figure 3 As shown, continued Figure 2 In the embodiment, the user drags the audio mark "①" to the "Bluetooth speaker" mark, which can be understood as using a Bluetooth speaker that has a data stream connection with the terminal to output the audio of song A.

[0074] The user drags the audio mark "②" to the "wired headset" mark, which can be understood as using the wired headset that has a data stream connection with the terminal to output the audio of B broadcast.

[0075] The user drags the audio mark "③" to the "recording module" mark, which can be understood as using the recording module that has a data stream connection with the terminal to record C recording.

[0076] The user drags the audio mark "④" to the "Bluetooth headset" mark, which can be understood as using the Bluetooth headset that has a data stream connection with the terminal to output the audio of the call request from D (that is, to make a call with D).

[0077] It should be understood that in the above embodiment, the user "dragging the audio identifier to the corresponding audio output module identifier" to achieve the use of the corresponding audio output module to output the corresponding audio is only an exemplary description of establishing a correspondence between the audio output module identifier and the audio identifier to be played. Figure 4 FIG. 1 is a schematic diagram showing another audio operation interface after selecting an operation according to an exemplary embodiment. Figure 4 As shown, the information display of the audio operation interface can also be displayed in the form of a connection to establish a corresponding relationship between the audio output module identifier and the audio identifier to be played.

[0078] It should be understood that the embodiments of the present disclosure are merely illustrative examples of display forms for establishing a corresponding relationship between an audio output module identifier and an audio identifier to be played. Other display forms that can play the same role as the embodiments of the present disclosure can be considered to be the same or similar to the display forms provided by the embodiments of the present disclosure. For other display forms, the embodiments of the present disclosure will no longer list and describe them one by one.

[0079] The audio output method provided in the embodiment of the present disclosure provides the user with an audio output module that can be used for selection operation in the audio display interface so as to perform corresponding audio output through the selected audio output module. This realizes the autonomous selection of the audio output mode and the independent playback of multiple audios through different audio output modules. This improves the user experience of the terminal.

[0080] In one implementation of the embodiment of the present disclosure, for a selection operation performed by a user on an audio operation interface, it may be determined that the performed operation is a selection operation based on a corresponding operation of the user.

[0081] In one example, if it is detected that the user drags the audio logo to within the area displayed by the audio module logo on the audio operation interface, it is determined that the user's selection operation on the audio operation interface is detected.

[0082] For example, the specific user operation process can be found in Figure 3 The corresponding embodiments are described in detail in detail here.

[0083] It should be understood that if it is detected that the user connects the audio output module identifier with the audio identifier, it can also be determined that the user's selection operation on the audio operation interface is detected.

[0084] For example, specific user operations can be found in Figure 4 The corresponding embodiments are described in detail in detail here.

[0085] In one implementation of the embodiments of the present disclosure, when it is determined that there are multiple (at least two) audios to be played in the terminal, independent processing of the multiple audios to be played can be achieved by a multi-channel audio processing chip pre-set inside the terminal.

[0086] It should be understood that a multi-channel audio processing chip is an integrated circuit used to process, mix and manage multiple audio signal channels. Such chips are often used in various audio applications, such as home theater systems, car audio, professional audio modules, and other scenarios that require processing multiple audio signal channels. Multi-channel audio processing chips can independently process different audio output time periods, and can also independently control different audio output channels, including on / off control of different audio output channels and volume output control.

[0087] In one implementation of the embodiment of the present disclosure, the display of the audio operation interface may also be triggered by performing relevant audio adjustment operations on the terminal when it is determined that there are one or more audios to be output.

[0088] Exemplarily, on the premise of determining that the terminal is playing song A and broadcast B, in response to the user's operation of adjusting the volume of song A and / or broadcast B, an audio operation interface is displayed.

[0089] In one implementation of the embodiment of the present disclosure, the display of the audio operation interface may also be triggered by a disconnection of the audio output module when it is determined that there are one or more audios to be output.

[0090] For example, when it is determined that the terminal uses a Bluetooth speaker that has a data stream connection with the terminal to play song A, when the Bluetooth speaker disconnects the data stream connection with the terminal, the play of song A is interrupted, and in response to the Bluetooth speaker disconnecting the data stream connection with the terminal, an audio operation interface is displayed. It is used to provide the user with an audio output module selection.

[0091] In one implementation of the embodiment of the present disclosure, in response to the disconnected audio output module restoring the data stream connection with the terminal, the audio output module continues to output the audio before the disconnection.

[0092] For example, when the Bluetooth speaker is playing song A, when the Bluetooth speaker disconnects the data stream connection with the terminal, the playing of song A is interrupted, and in response to the disconnection of the data stream connection between the Bluetooth speaker and the terminal, when the Bluetooth speaker reestablishes the data stream connection relationship with the terminal at a subsequent time, the Bluetooth speaker will continue to play song A.

[0093] In one implementation of the embodiments of the present disclosure, with respect to the information in the audio operation interface, the terminal can detect in real time whether there is a new audio output module connected to the terminal by a data stream, and update the new module.

[0094] In one example, Figure 5 FIG. 1 is a flow chart of a method for updating an access module identifier in an audio operation interface according to an exemplary embodiment. Figure 5As shown, the following steps are included:

[0095] In step S21, an audio output module having a data stream connection with a terminal is monitored.

[0096] It should be understood that each audio module connected to the terminal with a data stream has an independent identity document (ID). Based on this, the terminal can perform ID detection on the audio output module currently connected to the terminal with a data stream, and can count the number of audio output modules connected to the terminal with a data stream.

[0097] In step S22, in response to monitoring the presence of a new access module, and the new access module is a module with an audio output function, an identifier of the new access module is displayed in the audio operation interface.

[0098] In one implementation of the embodiments of the present disclosure, monitoring the presence of a new access module can be achieved by at least one of the following methods, including: detecting a newly accessed ID, and / or monitoring that the number of audio output modules currently connected to the terminal with a data stream is newly increased compared to the last detection.

[0099] In one implementation of the embodiment of the present disclosure, if the newly connected module has an audio output function, the newly connected module can report it to the terminal or the terminal can actively acquire the function of the newly connected module.

[0100] For example, Figure 6 FIG. 1 is a schematic diagram showing an audio operation interface updating access module identifier according to an exemplary embodiment. Figure 2 Examples, such as Figure 6 As shown, the terminal is newly connected to a car speaker with an audio output function. Therefore, a "car speaker" logo is added at the module area 14.

[0101] The audio output method provided in the embodiment of the present disclosure updates the audio operation interface by monitoring in real time whether there is a new audio output module in the module connected to the terminal, and accurately feedbacks the module currently available for audio output to the user, thereby improving the user's experience of using the terminal.

[0102] In one example, when it is detected that an audio output module connected to a terminal is disconnected from the terminal, an identifier of the corresponding disconnected audio output module is deleted in the audio operation interface.

[0103] The audio output method provided in the embodiment of the present disclosure monitors in real time whether the module connected to the terminal is disconnected from the audio output module to update the audio operation interface, and accurately feedbacks the module that is currently unavailable for audio output to the user, thereby improving the user's experience of using the terminal.

[0104] In one implementation of the embodiment of the present disclosure, with respect to the information in the audio operation interface, the terminal can detect in real time whether there is any new audio to be output, and update the audio identifier corresponding to the newly added audio to be output.

[0105] In one example, Figure 7 FIG. 1 is a flow chart of a method for updating audio to be played in an audio operation interface according to an exemplary embodiment. Figure 7 As shown, the following steps are included:

[0106] In step S31, the audio to be output by the terminal is monitored.

[0107] It should be understood that in the audio output structure in the related art, each audio to be played has an independent ID (which can be understood as an audio identifier). Based on this, the terminal can perform ID monitoring on the audio to be played (for example, performing ID detection in a buffer area or a task list to be played), and can count the number of audios to be played.

[0108] In step S32, in response to detecting the presence of an audio identifier corresponding to the newly added audio to be output, the audio identifier is added to the audio operation interface.

[0109] For example, Figure 8 FIG. 1 is a schematic diagram showing an audio operation interface updating an audio identifier to be played according to an exemplary embodiment. Figure 2 Examples, such as Figure 8 As shown, the new audio "E alarm clock" to be output is added to the queue to be output. Therefore, a "⑤" mark is added at the audio area 15.

[0110] The audio output method provided in the embodiment of the present disclosure monitors in real time whether there is any new audio to be output in the audio queue to be output of the terminal, so as to update the audio operation interface, and accurately feedback the current audio to be output to the user, thereby improving the user's experience of using the terminal.

[0111] In one example, when it is monitored that the amount of audio to be output in the audio queue to be output of the terminal is reduced, the identifier of the corresponding disconnected audio output module is deleted in the audio operation interface.

[0112] The audio output method provided in the embodiment of the present disclosure monitors in real time whether there is reduced audio to be output in the audio queue to be output of the terminal to update the audio operation interface, and accurately feeds back the audio that cannot be output currently to the user, thereby improving the user's experience of using the terminal.

[0113] In one implementation of the embodiment of the present disclosure, for a deletion operation performed by a user on the audio operation interface, a corresponding interface update is performed based on the deletion operation performed by the user.

[0114] In one example, Fig. 9 FIG. 1 is a flow chart of a method for deleting an audio operation interface according to an exemplary embodiment. Fig. 9 As shown, the method comprises the following steps:

[0115] In step S41, it is detected whether the user performs a deletion operation on the audio operation interface.

[0116] In one implementation of the embodiment of the present disclosure, the deletion operation is used to delete the audio identifier and / or the audio output module identifier.

[0117] In step S42, in response to detecting a deletion operation of the user on the audio operation interface, the audio identifier and / or the audio output module identifier corresponding to the deletion operation is deleted from the audio operation interface.

[0118] In one implementation of the embodiment of the present disclosure, if it is detected that the user performs a deletion operation on the audio identifier in the audio operation interface, the corresponding audio identifier on which the deletion operation is performed is deleted.

[0119] In one implementation of the embodiment of the present disclosure, if it is detected that the user performs a deletion operation on the audio output module identifier in the audio operation interface, the corresponding audio output module identifier on which the deletion operation is performed is deleted.

[0120] In one implementation of the embodiment of the present disclosure, if it is detected that the user performs a deletion operation on the audio identifier and the audio output module identifier in the audio operation interface, the corresponding audio identifier and the corresponding audio output module identifier on which the deletion operation is performed are deleted.

[0121] The audio output method provided in the embodiment of the present disclosure can meet the user's need to delete the identifier by setting a deletion function on the audio operation interface, avoid identifiers that are not required by the user occupying interface space, and thus improve the user's experience of using the terminal.

[0122] In one implementation of the embodiment of the present disclosure, for a deletion operation performed by a user on an audio operation interface, it may be determined that the performed operation is a deletion operation based on a corresponding operation of the user.

[0123] In one example, if it is detected that the user removes the audio identifier and / or removes the audio output module identifier on the audio operation interface, it is determined that the deletion operation of the user on the audio operation interface is detected.

[0124] In one implementation of the embodiment of the present disclosure, if it is detected that the user removes the audio identifier on the audio operation interface, it is determined that the deletion operation of the user on the audio operation interface is detected.

[0125] In one implementation of the embodiment of the present disclosure, if it is detected that the user removes the audio output module identifier on the audio operation interface, it is determined that the deletion operation of the user on the audio operation interface is detected.

[0126] In one implementation of the embodiment of the present disclosure, if it is detected that the user removes the audio identifier and the audio output module identifier on the audio operation interface, it is determined that the deletion operation of the user on the audio operation interface is detected.

[0127] In one implementation of the present disclosure, Fig.10 FIG. 1 is a schematic diagram showing an audio operation interface removal operation according to an exemplary embodiment. Fig.10 As shown, continued Figure 3 In the embodiment, the user drags the audio identifier "②" to the deletion area 16, which can be understood as deleting the B broadcast of the audio identifier "②".

[0128] In one implementation of the present disclosure, Fig.11 FIG. 1 is a schematic diagram showing another audio operation interface removal operation according to an exemplary embodiment. Fig.11 As shown, continued Figure 3 In the embodiment, the user can perform a corresponding instruction operation on the screen (for example, long press a certain area or long press a certain mark), and when the delete button 17 appears, remove the mark that needs to be deleted.

[0129] It should be understood that the embodiments of the present disclosure are merely illustrative examples of the form of determining the removal operation displayed by the user on the audio operation interface. Other display forms that can play the same role as the embodiments of the present disclosure can be considered to be the same or similar to the display form provided by the embodiments of the present disclosure. For other display forms, the embodiments of the present disclosure will no longer list them one by one.

[0130] In one implementation of the disclosed embodiment, the user instructs the corresponding audio output module to play the audio by operating in the audio operation interface, and this part of the function can be implemented through the interaction between the thread and the audio operation interface.

[0131] In one example, Fig.12 FIG. 1 is a flow chart of a method for implementing audio output based on threads according to an exemplary embodiment. Fig.12 As shown, the method comprises the following steps:

[0132] In step S51, a target thread identifier is determined based on the correspondence between the thread identifier, the audio output module, and the audio.

[0133] In one implementation of the embodiment of the present disclosure, each thread has an independent thread identifier.

[0134] For example, in an audio output system in the related art, a thread may instruct a corresponding audio output module to play a specified audio to be output. Here, the audio output of an Android system is taken as an example:

[0135] After the system obtains the Android application package (APK) of the audio to be output, the APK of the audio to be output creates a thread by calling the application programming interface (API) of the audio scheduler (AudioFlinger) to transfer the music data in the audio track (AudioTrack) buffer to the hardware abstraction layer (HardwareAbstractionLayer, HAL), and instructs the corresponding audio output module hardware to play.

[0136] It should be understood that since the tasks executed by the threads are independent of each other and may be different, each thread has an independent thread identifier. Since the threads are independent of each other and the thread identifiers are independent of each other, when there are multiple audios to be played, the audios to be played can be operated independently based on the threads (or thread identifiers) corresponding to each audio to be played, without affecting each other.

[0137] In one implementation of the embodiment of the present disclosure, the target thread identifier is the identifier of the audio output module identified by the audio output module identifier selected by the selection operation and the identifier of the thread corresponding to the audio to be output.

[0138] It should be understood that the target thread can be understood as the specified audio output module used to play the specified audio to be output after the user selects it. The target threads are independent of each other like threads, and based on the independence of the target threads, the target thread identifiers are independent of each other.

[0139] For example, after the user selects the operation, the audio output task of "playing song A using Bluetooth headset" is executed by target thread a, and the audio output task of "playing radio B using earpiece" is executed by target thread b. "a" and "b" are target thread identifiers.

[0140] In step S52, based on the target thread, the audio output module is controlled to output the audio identified by the audio identifier having a corresponding relationship with the audio output module.

[0141] In the audio output method provided in the embodiment of the present disclosure, corresponding threads are established for different audio output tasks, and based on the independence between threads, the independence of audio output tasks in the multi-audio output process is achieved without being affected by multiple tasks.

[0142] In one implementation of the embodiment of the present disclosure, based on the target thread corresponding to the target thread identifier, the audio output module is controlled to output the audio identified by the audio identifier having a corresponding relationship with the audio output module.

[0143] It is understandable that the various embodiments of the present disclosure can be implemented separately or in combination with each other. For example, the embodiment in which the user performs a selection operation on the audio operation interface can be implemented independently, or the embodiment in which the deletion operation is performed can be implemented together. The present disclosure only lists the independent implementation methods of the various embodiments, and the implementation methods of the combined application of the various embodiments should not be considered to exceed the scope of the technical solutions of the embodiments of the present disclosure.

[0144] Based on the same concept, an embodiment of the present disclosure also provides an audio output device.

[0145] It is understandable that the audio output device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0146] Fig.13 is a block diagram of an audio output device according to an exemplary embodiment. Fig.13 The device 100 includes a display unit 101 and a processing unit 102.

[0147] The display unit 101 is used to display an audio operation interface in response to detecting one or more audios to be output, and display the audio identifiers of the one or more audios and one or more audio output modules on the audio operation interface;

[0148] The processing unit 102 is configured to, in response to detecting a selection operation of a user on the audio operation interface, output the corresponding audio to be output by selecting a target audio module selected by the selection operation.

[0149] In one implementation of the embodiment of the present disclosure, the display unit 101 is also used to: after displaying the audio operation interface, in response to monitoring the existence of a new access module, and the new access module is a module with an audio output function, display the logo of the new access module in the audio operation interface.

[0150] In one implementation of the embodiment of the present disclosure, the display unit 101 is further used for: in response to detecting the presence of an audio identifier corresponding to the newly added audio to be output, adding the audio identifier to the audio operation interface.

[0151] In one implementation of the embodiment of the present disclosure, the display unit 101 is also used for: in response to detecting a deletion operation performed by a user on the audio operation interface, the deletion operation is used to delete the audio identification and / or audio output module identification, and the audio identification and / or audio output module identification corresponding to the deletion operation is deleted from the audio operation interface.

[0152] In one implementation of the embodiment of the present disclosure, the processing unit 102 detects the user's selection operation on the audio operation interface in the following manner: if it is detected that the user drags the audio logo within the area displayed by the audio module logo on the audio operation interface, it is determined that the user's selection operation on the audio operation interface is detected.

[0153] In one implementation of the embodiment of the present disclosure, the processing unit 102 detects a deletion operation performed by a user on the audio operation interface in the following manner: if it is detected that the user removes the audio identifier and / or removes the audio output module identifier on the audio operation interface, it is determined that a deletion operation performed by the user on the audio operation interface is detected.

[0154] In one implementation of the embodiments of the present disclosure, the processing unit 102 adopts the following method to output the audio identified by the audio output module identifier selected by the selection operation and the audio identified by the audio identifier having the corresponding relationship with the audio output module: based on the corresponding relationship between the thread identifier, the audio output module, and the audio, determine the target thread identifier, the target thread identifier being the identifier of the thread corresponding to the audio output module identified by the audio output module identifier selected by the selection operation and the audio to be output; based on the target thread corresponding to the target thread identifier, control the audio output module to output the audio identified by the audio identifier having the corresponding relationship with the audio output module.

[0155] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0156] Fig.14 2 is a block diagram of a device 200 for screen display according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0157] Reference Fig.14, the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0158] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0159] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0160] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0161] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0162] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0163] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0164] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0165] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0166] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0167] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0168] Fig.15 is a block diagram of a device 300 for screen display according to an exemplary embodiment. For example, the device 300 can be provided as a server. Fig.15 The apparatus 300 includes a processing component 322, which further includes one or more processors, and a memory resource represented by a memory 332 for storing instructions executable by the processing component 322, such as an application. The application stored in the memory 332 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 322 is configured to execute instructions to perform the above-mentioned screen display method.

[0169] The device 300 may also include a power supply component 326 configured to perform power management of the device 300, a wired or wireless network interface 350 configured to connect the device 300 to a network, and an input / output (I / O) interface 358. The device 300 may operate based on an operating system stored in the memory 332, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0170] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0171] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0172] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0173] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0174] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0175] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0176] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. An audio output method, characterized in that: Applied to terminals, including: In response to detecting one or more audios to be output, displaying an audio operation interface, and displaying audio identifiers of the one or more audios and one or more audio output modules on the audio operation interface; In response to detecting a selection operation of the user on the audio operation interface, the corresponding audio to be output is output through the target audio output module selected by the selection operation.

2. The audio output method according to claim 1, characterized in that: After displaying the audio operation interface, the method further includes: In response to detecting the presence of a new access module, and the new access module is a module with an audio output function, an identifier of the new access module is displayed in the audio operation interface.

3. The audio output method according to claim 1 or 2, characterized in that: The method further comprises: In response to detecting the presence of an audio identifier corresponding to the newly added audio to be output, the audio identifier is added to the audio operation interface.

4. The audio output method according to claim 1, characterized in that: The method further comprises: In response to detecting a deletion operation performed by the user on the audio operation interface, the deletion operation is used to delete the audio identifier and / or the audio output module identifier, and the audio identifier and / or the audio output module identifier corresponding to the deletion operation is deleted from the audio operation interface.

5. The audio output method according to claim 1, characterized in that: The detecting a selection operation of the user on the audio operation interface includes: If it is detected that the user drags the audio identifier within the area displayed by the audio module identifier on the audio operation interface, it is determined that the user's selection operation on the audio operation interface is detected.

6. The audio output method according to claim 4, characterized in that: The detecting a deletion operation of the user on the audio operation interface includes: If it is detected that the user removes the audio identifier and / or removes the audio output module identifier on the audio operation interface, it is determined that a deletion operation of the user on the audio operation interface is detected.

7. The audio output method according to claim 1, characterized in that: The target audio output module selected by the selection operation outputs the corresponding audio to be output, including: Determine a target thread identifier based on a correspondence between a thread identifier, an audio output module, and audio, wherein the target thread identifier is an identifier of a thread corresponding to the audio output module identified by the audio output module identifier selected by the selection operation and the audio to be output; Based on the target thread corresponding to the target thread identifier, the audio output module is controlled to output the audio identified by the audio identifier having the corresponding relationship with the audio output module.

8. An audio output device, characterized in that: Applied to terminals, including: A display unit, configured to display an audio operation interface in response to detecting one or more audios to be output, and displaying audio identifiers of the one or more audios and one or more audio playback modules on the audio operation interface; The processing unit is used to respond to detecting a selection operation of the user on the audio operation interface and output the corresponding audio to be output through the target audio output module selected by the selection operation.

9. The audio output device according to claim 8, characterized in that: The display unit is also used for: after displaying the audio operation interface, in response to monitoring the existence of a new access module, and the new access module is a module with an audio output function, displaying the identifier of the new access module in the audio operation interface.

10. The audio output device according to claim 8 or 9, characterized in that: The display unit is also used for: In response to detecting the presence of an audio identifier corresponding to the newly added audio to be output, the audio identifier is added to the audio operation interface.

11. The audio output device according to claim 8, characterized in that: The display unit is also used for: In response to detecting a deletion operation performed by the user on the audio operation interface, the deletion operation is used to delete the audio identifier and / or the audio output module identifier, and the audio identifier and / or the audio output module identifier corresponding to the deletion operation is deleted from the audio operation interface.

12. The audio output device according to claim 8, characterized in that: The processing unit detects a selection operation of the user on the audio operation interface in the following manner: If it is detected that the user drags the audio identifier within the area displayed by the audio module identifier on the audio operation interface, it is determined that the user's selection operation on the audio operation interface is detected.

13. The audio output device according to claim 11, characterized in that: The processing unit detects a deletion operation of the user on the audio operation interface in the following manner: If it is detected that the user removes the audio identifier and / or removes the audio output module identifier on the audio operation interface, it is determined that a deletion operation of the user on the audio operation interface is detected.

14. The audio output device according to claim 8, characterized in that: The processing unit outputs the audio identified by the audio identifier having the corresponding relationship with the audio output module through the audio output module identified by the audio output module identifier selected by the selection operation in the following manner: Determine a target thread identifier based on a correspondence between a thread identifier, an audio output module, and audio, wherein the target thread identifier is an identifier of a thread corresponding to the audio output module identified by the audio output module identifier selected by the selection operation and the audio to be output; Based on the target thread corresponding to the target thread identifier, the audio output module is controlled to output the audio identified by the audio identifier having the corresponding relationship with the audio output module.

15. An audio output device, characterized in that: include: processor; a memory for storing processor executable instructions; Wherein, the processor is configured to: execute the audio output method described in any one of claims 1 to 7.

16. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the audio output method according to any one of claims 1 to 7.

Images