Multi-audio playing method and device, electronic equipment and storage medium

Abstract

The invention discloses a multi-audio playing method and device, electronic equipment and a storage medium, and the method comprises the steps: calling out a holographic audio playing interface in response to a first playing operation corresponding to at least two pieces of first audio data under the condition that a holographic audio function is started, displaying visual identifiers corresponding to the at least two pieces of first audio data in a focus area and a non-focus area of the holographic audio playing interface; and in response to a second playing operation corresponding to the holographic audio playing interface, executing display processing corresponding to the second playing operation in the holographic audio playing interface.

Description

Technical Field

[0001] The present invention relates to the technical field of audio playback, and in particular to a multi-audio playback method and device, electronic equipment and storage medium. Background Art

[0002] At present, there are two common methods for playing multiple audio streams. One is to directly linearly superimpose different audio stream data and then play them out. The other is to selectively duck certain audio streams (i.e., lower the volume) to highlight the audio streams that have not been ducked.

[0003] However, the common method of playing multiple audio streams has the problem of confusing sound or incomplete content, which cannot take into account the clarity and integrity of the audio content and leads to poor playback effect. Summary of the invention

[0004] The embodiments of the present application provide a multi-audio playback method and device, an electronic device, and a storage medium, which can take into account both the clarity and integrity of the audio content and effectively improve the multi-audio playback effect.

[0005] The technical solution of the embodiment of the present application is implemented as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for playing multiple audios, the method comprising:

[0007] When the holographic audio function is turned on, in response to a first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and visual identifiers corresponding to the at least two first audio data are displayed in a focus area and a non-focus area of ​​the holographic audio playback interface;

[0008] In response to a second playback operation corresponding to the holographic audio playback interface, display processing corresponding to the second playback operation is performed in the holographic audio playback interface.

[0009] In a second aspect, an embodiment of the present application provides a multi-audio playback device, the multi-audio playback device comprising: a calling unit, a display unit,

[0010] The calling unit is used to call out the holographic audio playing interface in response to the first playing operation corresponding to at least two first audio data when the holographic audio function is turned on;

[0011] The display unit is used to display the visual identifiers corresponding to the at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, perform display processing corresponding to the second playback operation in the holographic audio playback interface.

[0012] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory storing instructions executable by the processor, wherein when the instructions are executed by the processor, the method described in the first aspect above is implemented.

[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the method described in the first aspect above is implemented.

[0014] The embodiment of the present application provides a multi-audio playback method and device, an electronic device and a storage medium. When the holographic audio function is turned on, in response to the first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and at least two visual identifiers corresponding to the first audio data are displayed in the focus area and the non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface. It can be seen that in the embodiment of the present application, in the process of multi-audio parallel playback, the visual identifiers corresponding to different audio data can be displayed in the focus area and the non-focus area of ​​the holographic audio playback interface, so that different audio data can be played at different virtual space positions respectively, and the virtual space positions corresponding to different audio data can be displayed through the holographic audio playback interface. That is to say, the multi-audio playback method proposed in the embodiment of the present application can not only play each audio data completely, but also assign virtual space positions that do not interfere with each other to different audio data for rendering and playback, so as to take into account the clarity and integrity of the audio content and effectively improve the playback effect of multi-audio. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of the implementation flow of the multi-audio playback method proposed in the embodiment of the present application;

[0016] Figure 2 A schematic diagram of a holographic audio playback interface proposed in an embodiment of the present application;

[0017] Figure 3 A graphical display of the spatial position relationship of audio data in an embodiment of the present application Figure 1 ;

[0018] Figure 4 A schematic diagram of visual identification of each sound source in different display states proposed in an embodiment of the present application;

[0019] Figure 5 Schematic diagram of the preset center position proposed in the embodiment of the present application Figure 1 ;

[0020] Figure 6 Schematic diagram of the preset center position proposed in the embodiment of the present application Figure 2 ;

[0021] Figure 7 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 1 ;

[0022] Figure 8 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 2 ;

[0023] Fig. 9 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 3 ;

[0024] Fig.10 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 4 ;

[0025] Fig.11 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 5 ;

[0026] Fig.12 Schematic diagram of the holographic audio setting interface proposed in the embodiment of the present application Figure 1 ;

[0027] Fig.13 Schematic diagram of the holographic audio setting interface proposed in the embodiment of the present application Figure 2 ;

[0028] Fig.14 Schematic diagram of the implementation of the first setting operation proposed in the embodiment of the present application Figure 1 ;

[0029] Fig.15 Schematic diagram of the implementation of the first setting operation proposed in the embodiment of the present application Figure 2 ;

[0030] Fig.16 Schematic diagram of the implementation of the first setting operation proposed in the embodiment of the present application Figure 3 ;

[0031] Fig.17 This is a schematic diagram of the implementation flow of another interface display method in an embodiment of the present application;

[0032] Fig.18 A graphical display of the spatial position relationship of audio data in an embodiment of the present application Figure 2 ;

[0033] Fig.19A graphical display of the audio source playback status in the embodiment of the present application Figure 1 ;

[0034] Fig. 20 A graphical display of the audio source playback status in the embodiment of the present application Figure 2 ;

[0035] Fig.21 A schematic diagram of the spatial position relationship of the sound source in the intelligent mode in the embodiment of the present application;

[0036] Fig. 22 A graphical display of the position change strategy in the embodiment of the present application Figure 1 ;

[0037] Fig.23 A graphical display of the position change strategy in the embodiment of the present application Figure 2 ;

[0038] Fig.24 A graphical display of the position change strategy in the embodiment of the present application Figure 3 ;

[0039] Fig.25 A graphical display of the position change strategy in the embodiment of the present application Figure 4 ;

[0040] Fig.26 A graphical display of the position change strategy in the embodiment of the present application Figure 5 ;

[0041] Fig. 27 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 1 ;

[0042] Fig.28 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 2

[0043] Fig.29 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 1 ;

[0044] Fig.30 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 2 ;

[0045] Fig.31 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 3 ;

[0046] Fig.32 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 4 ;

[0047] Fig.33 A schematic diagram of the structure of a multi-audio playback device proposed in an embodiment of the present application;

[0048] Fig.34 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. It is understood that the specific embodiments described herein are only used to explain the related applications, rather than to limit the applications. It should also be noted that, for ease of description, only the parts related to the related applications are shown in the drawings.

[0050] With the continuous development of terminal devices, the functions of terminal devices are becoming more and more abundant, and they can integrate different functions required by users. For example, taking a mobile phone as an example, in one possible scenario, a user can open a game application to play a game, and at the same time, the user can also open a music application to listen to music. During this process, the phone may receive an incoming call and ring. Therefore, in the scenario where multiple applications play audio in parallel, the terminal device also faces the problem of how to play multiple audio streams.

[0051] At present, there are two common methods for playing multiple audio streams. One is to directly linearly superimpose different audio stream data and then play them out. The other is to selectively duck certain audio streams (i.e., lower the volume) to highlight the audio streams that have not been ducked.

[0052] However, directly adding different audio streams linearly and then playing them back usually results in serious problems such as confusion, inability to highlight the key points, and even unclear audio content. Using ducking processing can only ensure that the sound that is not suppressed can be heard relatively clearly, while the sound that is suppressed usually cannot be heard clearly.

[0053] When adjusting the sound, the volume adjustment bar of each sound source will appear on the interface, following the system media volume. However, it is focused audio adjustment, that is, multiple sound sources are still in the same position, only the sound volume is different, and there is no improvement in the spatial dimension experience.

[0054] In another implementation, a sound source button appears in the interface. Clicking it can independently adjust multiple sound sources playing simultaneously. However, the volume adjustment button is small and not obvious in complex scenarios. In addition, it is focused audio adjustment, that is, multiple sound sources are still in the same position, with only differences in sound volume, and no improvement in spatial dimension experience.

[0055] At present, although the common multi-audio playback interface can independently adjust the volume of each application playing simultaneously, which reduces the interference problem of multi-audio parallel playback to a certain extent, when multiple applications adjust the volume, they are still in the same position, there is an interference problem, and there is no improvement in the spatial dimension sound effect experience, lack of immersion.

[0056] That is to say, the common method of playing multiple audio streams has problems of confusing sound or incomplete content, and cannot take into account the clarity and integrity of the audio content, resulting in poor playback effect.

[0057] In order to solve the above problems, in an embodiment of the present application, when the holographic audio function is turned on, in response to the first playback operation corresponding to at least two first audio data, the holographic audio playback interface is called out, and the visual identification corresponding to at least two first audio data is displayed in the focus area and non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface. It can be seen that in an embodiment of the present application, in the process of multi-audio parallel playback, the visual identification corresponding to different audio data can be displayed in the focus area and non-focus area of ​​the holographic audio playback interface, so that different audio data can be played in different virtual space positions respectively, and the virtual space positions corresponding to different audio data can be displayed through the holographic audio playback interface. That is to say, the multi-audio playback method proposed in the embodiment of the present application can not only play each audio data completely, but also assign virtual space positions that do not interfere with each other to different audio data for rendering and playback, so as to take into account the clarity and integrity of the audio content and effectively improve the playback effect of multi-audio.

[0058] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0059] An embodiment of the present application provides a multi-audio playback method, which can be applied to a multi-audio playback device or electronic device, or to an electronic device integrated with a multi-audio playback device. The multi-audio playback device or electronic device can simultaneously play different audio data created by different applications, which is not specifically limited in the present application.

[0060] It should be noted that, in the embodiments of the present application, the multi-audio playback method can be used to play at least two different audio data. Below, an exemplary description is given by taking the multi-audio playback device playing at least two audio data at the same time as an example.

[0061] Of course, the multi-audio playback method proposed in the embodiment of the present application can also be applied to any other device with a playback function, and can also complete the playback processing of any other number of different audio data. This application does not make specific limitations.

[0062] Furthermore, in the embodiments of the present application, Figure 1 This is a schematic diagram of the implementation flow of the multi-audio playback method proposed in the embodiment of the present application, such as Figure 1 As shown, the method for playing multiple audios by a multiple audio playback device may include the following steps:

[0063] Step 101: When the holographic audio function is turned on, in response to a first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and visual identifiers corresponding to at least two first audio data are displayed in a focus area and a non-focus area of ​​the holographic audio playback interface.

[0064] In an embodiment of the present application, when the holographic audio function is turned on, after receiving a first playback operation corresponding to at least two first audio data, the multi-audio playback device can respond to the first playback operation corresponding to the at least two first audio data, call out the holographic audio playback interface, and then display the visual identification corresponding to the at least two first audio data in the focus area and non-focus area of ​​the holographic audio playback interface.

[0065] It should be noted that in the embodiments of the present application, the holographic audio function is an audio technology that can present music or sound through holographic imaging technology. This sound can come from different directions, distances and heights, giving the audience an immersive experience.

[0066] Accordingly, in an embodiment of the present application, when realizing the holographic audio function, a corresponding virtual space position is set for the original audio data of each sound source, and then the position information and the original audio data are processed by a spatial audio rendering algorithm so that each sound source appears to be emitted from a different position. In this way, the sounds of multiple sound sources can be separated, thus solving the problem of mutual interference caused by simultaneous playback of multiple audios.

[0067] It should be noted that, in the embodiment of the present application, the at least two first audio data may include data from different audio sources. The at least two first audio data may be audio data created by the system or audio data created by an application.

[0068] Exemplarily, in some embodiments, the at least two first audio data may be any type of audio data. For example, the at least two first audio data may include any different audio data such as music, voice, ringtone, video, etc.

[0069] That is to say, in the embodiments of the present application, the sound source may specifically include: incoming call ringtones, alarm clocks, game voices, videos, audio books, music, notifications, and navigation, etc.

[0070] Furthermore, in an embodiment of the present application, when the holographic audio function is turned on, if a first playback operation corresponding to at least two first audio data is received, the multi-audio playback device can call out the holographic audio playback interface while playing at least two first audio data at the same time.

[0071] It should be noted that in the embodiments of the present application, the holographic audio playback interface can display the spatial position relationship of all predefined sound sources. When one or more sound sources enter the playback state, the holographic audio playback interface can also display the spatial position relationship of the visual identification of one or more sound sources entering the playback state on the holographic audio playback interface, and delete the visual identification of the sound source when exiting the playback state.

[0072] It should be noted that, in an embodiment of the present application, the at least two first audio data include a first focus audio and a first non-focus audio.

[0073] It should be noted that in the embodiments of the present application, after acquiring different audio data created by different applications, the multi-audio playback device can further determine the audio scene corresponding to each audio data. For example, the audio scenes corresponding to different audio data can be the same or different, and the present application does not specifically limit this.

[0074] It can be understood that in the embodiments of the present application, when determining the audio scene corresponding to the audio data, the audio scene corresponding to each audio data can be divided based on any parameters such as the function, content, created application, etc. corresponding to the audio data, and the present application does not make specific limitations.

[0075] Exemplarily, in some embodiments, the audio scene corresponding to the audio data may be determined according to the application or system that creates the audio data. For example, for an audio data, the scene type of the application that creates the audio data may be determined first, wherein the scene type of the application refers to the playback scene type or application type to which the application belongs, and then the scene type of the application is determined as the audio scene corresponding to the audio data.

[0076] Exemplarily, in some embodiments, the audio scene of the audio data determined based on the scene type of the application or system may include games, music, audio books, navigation, notifications, voice, incoming call ringtones, alarm ringtones or videos, etc.

[0077] Exemplarily, in some embodiments, assuming that the first audio data is created by a music application, the corresponding audio scene may be music; assuming that the first audio data is created by a social application, the corresponding audio scene may be an Internet call.

[0078] Furthermore, in an embodiment of the present application, after determining the audio scenes corresponding to at least two first audio data, the multi-audio playback device can further determine the first focus audio and the first non-focus audio in the at least two first audio data according to the audio scenes.

[0079] It should be noted that, in the embodiments of the present application, the first focus audio can be understood as a holographic focus, which is similar to the concept of audio focus in Android. When multiple applications play sounds at the same time, there is only one holographic focus.

[0080] That is to say, in the embodiment of the present application, corresponding to the multi-audio playback scenario, there is one focus audio among the multiple audio data, that is, there is one holographic focus.

[0081] Accordingly, in the embodiment of the present application, the first non-focus audio can be understood as other audio outside the holographic focus. Among them, when multiple applications play sounds at the same time, there can be a holographic focus, and other audio outside the holographic focus can be understood as non-focus audio.

[0082] Further, in an embodiment of the present application, when determining the first focus audio and the first non-focus audio in at least two first audio data according to an audio scene, the corresponding priority can be first determined according to the audio scene, and then the first focus audio and the first non-focus audio can be determined in at least two first audio data according to the corresponding priority.

[0083] It can be understood that in the embodiment of the present application, for more than three audio data, since there is only one holographic focus, one focus audio and multiple non-focus audios can be determined.

[0084] It should be noted that in an embodiment of the present application, the priority corresponding to the audio scene of the audio data can be determined first, and then the priorities corresponding to the audio data can be compared, so as to further determine the importance of the audio data based on the comparison result, and then determine the focus audio and non-focus audio therein.

[0085] Furthermore, in an embodiment of the present application, the priority corresponding to the audio scene may be determined based on a correspondence between a preset scene and a priority.

[0086] It is understandable that in the embodiment of the present application, for different audio scenes, corresponding priorities can be preset, that is, the correspondence between the preset scenes and the priorities can be determined. The correspondence between the preset scenes and the priorities can be continuously adjusted and updated.

[0087] For example, in some embodiments, Table 1 is a correspondence between a preset scene and a priority, wherein the smaller the value of the priority, the higher the priority. For different audio scenes, the corresponding priorities may be the same or different. For example, the priorities corresponding to a ringtone and an alarm are the same, while the priorities corresponding to a ringtone and a video are different, and the priority of a video is higher than that of a ringtone.

[0088] Table 1

[0089] Audio Scene Priority Internet calling 1 Game Live Broadcast 1 video 2 Audiobook 3 music 4 Navigation broadcast 5 ring 6 Alarm clock 6 Notification Tone 7

[0090] It should be noted that in an embodiment of the present application, when using the priority corresponding to the audio data to determine the focus audio and non-focus audio, the priorities can be compared and the audio data with the highest priority can be determined as the focus audio, while the other audio data can be used as non-focus audio.

[0091] Accordingly, in an embodiment of the present application, when using the priority corresponding to the audio data to determine the focus audio and non-focus audio, if there are at least two audio data with the highest priority, then the creation time corresponding to the audio data with the highest priority can be further determined, and then the creation time can be used to determine the focus audio in the audio data with the highest priority.

[0092] It can be understood that in an embodiment of the present application, when determining the focus audio among the audio data with the highest priority according to the creation time corresponding to the audio data, the audio data created later can be selected as the focus audio, that is, the audio data with the largest creation time can be selected as the focus audio.

[0093] It is understandable that in the embodiments of the present application, the larger the creation time, the later the corresponding audio data was created, and the audio data can be considered to be more important, so the audio data with the largest creation time can be used as the focus audio. For example, if the first creation time is greater than the second creation time, it can be considered that the first audio data is more important, so the first audio data can be determined as the focus audio.

[0094] It should be noted that, in the embodiment of the present application, for audio data with the same creation time and the highest priority, one of the audio data can be randomly selected as the focus audio.

[0095] It should be noted that in an embodiment of the present application, the holographic audio playback interface includes a focus area and a non-focus area, wherein the focus area can be used to display the visual identification of the focus audio, and the non-focus area can be used to display the visual identification of the non-focus audio.

[0096] Exemplarily, in some embodiments, Figure 2 This is a schematic diagram of a holographic audio playback interface proposed in an embodiment of the present application, such as Figure 2 As shown, the holographic audio playback interface includes at least one focus area and multiple non-focus areas, wherein the focus area is closer to the center of the virtual space than the non-focus area.

[0097] It can be understood that, in the embodiment of the present application, the holographic audio playback interface is a hemispherical three-dimensional space, and the center position is the center position of the hemispherical three-dimensional space.

[0098] It should be noted that, in the embodiment of the present application, in the display effect of the holographic audio playback interface, the visual identification of the non-focus audio is distributed around the center position of the virtual space.

[0099] In some embodiments, the virtual space may be a spherical three-dimensional space, a hemispherical three-dimensional space, a cubic three-dimensional space, etc. The holographic audio playback interface displays the three-dimensional spatial position relationship of multiple audio data, and the position information of the corresponding audio data may include three-dimensional coordinates.

[0100] In other embodiments, the virtual space may be a two-dimensional space, and the holographic audio playback interface displays the two-dimensional spatial position relationship of multiple audio sources, and the corresponding position information may include two-dimensional coordinates.

[0101] Figure 3 A graphical display of the spatial position relationship of audio data in an embodiment of the present application Figure 1 ,like Figure 3 As shown, a two-dimensional spatial position relationship of audio data is shown, 1-7 correspond to the virtual spatial positions of 7 audio data respectively, and each audio data is distributed around the center position.

[0102] Furthermore, in an embodiment of the present application, the focus area and the non-focus area in the holographic audio playback interface are distributed with the center position of the holographic audio playback interface as the center; wherein the first distance between the focus area and the center position is smaller than the second distance between the non-focus area and the center position.

[0103] That is to say, in an embodiment of the present application, the holographic audio playback interface used to represent the virtual space can be a hemispherical three-dimensional space, wherein the visual mark of the focus audio can be displayed in an area closer to the center of the sphere, and the visual mark of the non-focus audio can be displayed in an area farther from the center of the sphere.

[0104] It should be noted that, in the embodiment of the present application, for the same audio data, the visual identifier of the unplayed state and the visual identifier of the played state displayed in the holographic audio playback interface are different.

[0105] Exemplarily, in some embodiments, for an audio data, when in a playing state, the visual identifier of the audio data is superimposed with an identifier representing the playing state, otherwise the identifier representing the playing state is removed. The identifier representing the playing state may be a dynamic identifier or a static identifier.

[0106] In some embodiments, the playing state includes a circular sound wave dynamic mark or a fan-shaped sound wave dynamic mark.

[0107] Figure 4 Schematic diagram of visual identification of each sound source in different display states proposed in the embodiment of the present application, such as Figure 4 As shown in the figure, it is divided into selected state and unselected state according to whether the user manually selects the audio; it is divided into playing state and unplayed state according to whether the current audio is playing. The playing state is a graphic superimposed with the playing sound wave effect logo, and the playing sound wave effect logo is superimposed on both the selected and unselected states.

[0108] Furthermore, in an embodiment of the present application, the holographic audio playback interface may include at least one focus area and multiple non-focus areas; wherein different non-focus areas may display different visual identifications of non-focus audio based on the correspondence between the scene and the non-focus position.

[0109] Accordingly, in an embodiment of the present application, based on the division of focus audio and non-focus audio, the virtual space positions corresponding to different audio data may be divided into two categories: center position and home position.

[0110] It can be understood that in the embodiment of the present application, the center position can be the position of the sound and image of the application holding the holographic focus, that is, it can be the virtual space position corresponding to the audio data serving as the focus audio.

[0111] It is understandable that in the embodiment of the present application, the home position can be the position of the sound and image of the application that does not have a holographic focus, that is, it can be the virtual space position corresponding to the audio data as non-focus audio. Among them, the audio data of different audio scenes correspond to different home positions.

[0112] Furthermore, in an embodiment of the present application, the correspondence between a scene and a non-focus position can be determined. Specifically, for each audio scene, a non-focus position adapted to the audio scene can be set, and when the audio data corresponding to the audio scene is used as non-focus audio, the non-focus position can be used to determine the virtual spatial position of the audio data.

[0113] It should be noted that in the embodiments of the present application, the correspondence between the scene and the non-focal position can be set based on the preset distribution principle. Among them, the core of the preset distribution principle is that the home position (non-focal position) of different audio scenes is different, that is, different audio scenes correspond to different non-focal positions. Among them, the overall home position layout must ensure that the sound position of the entire sound field distribution can be distributed as balanced as possible in the front, back, left and right.

[0114] For example, in some embodiments, the distribution of the home position can be multiple. Based on the preset distribution principle, for audio scenes with rich audio content, such as music and video, the home position can be set in a central symmetrical position, which will have a better stereo effect. For audio scenes with relatively simple sound content, such as Internet calls, listening to books, prompt sounds, etc., the home position can be set in a position biased in a certain direction.

[0115] It should be noted that in the embodiments of the present application, the correspondence between the scene and the non-focus position can be determined in a variety of ways, and the present application does not make any specific limitations.

[0116] Exemplarily, in some embodiments, when determining the correspondence between a scene and a non-focus position, the preset correspondence between the scene and the non-focus position may be directly acquired.

[0117] Exemplarily, in some embodiments, when determining the correspondence between scenes and non-focus positions, the setting instructions corresponding to the first application can be obtained first; then the non-focus position corresponding to the audio category created by the first application is determined based on the setting instructions, thereby determining the correspondence between scenes and non-focus positions.

[0118] Exemplarily, in some embodiments, when determining the correspondence between scenes and non-focus positions, custom information of the first application can be obtained first; the non-focus position corresponding to the audio category created by the first application is determined based on the custom information, so that the correspondence between the scene and the non-focus position can be determined.

[0119] Furthermore, in an embodiment of the present application, when at least two visual identifiers corresponding to the first audio data are displayed in the focus area and the non-focus area of ​​the holographic audio playback interface, the visual identifier of the first focus audio can be displayed in the focus area according to the first preset animation effect; at the same time, the visual identifier of the first non-focus audio can be displayed in the first target area corresponding to the first non-focus audio in the non-focus area according to the second preset animation effect.

[0120] It can be understood that, in the embodiment of the present application, the first target area is the area where the visual mark corresponding to the first non-focus audio is displayed, which is determined based on the correspondence between the scene and the non-focus position.

[0121] It should be noted that, in an embodiment of the present application, when the visual logo of the first focus audio is displayed in the focus area, you can choose to call out the visual logo of the first focus audio at a preset center position in the focus area; correspondingly, when the visual logo of the first non-focus audio is displayed in the non-focus area, you can choose to call out the visual logo of the first non-focus audio at a virtual space position in the non-focus area corresponding to the first non-focus audio.

[0122] Exemplarily, in some embodiments, Figure 5 Schematic diagram of the preset center position proposed in the embodiment of the present application Figure 1 ,like Figure 5 As shown, taking dual channels as an example, the preset center positions are fixed, symmetrical spatial positions A and B.

[0123] Exemplarily, in some embodiments, Figure 6 Schematic diagram of the preset center position proposed in the embodiment of the present application Figure 2 ,like Figure 6 As shown, taking dual channels as an example, assuming that the preset center position is adaptively changed, for one audio data, the corresponding preset center position is the symmetrical two spatial positions A and B; for another audio data, the corresponding preset center position is the spatial position C centered on one point.

[0124] It should be noted that in an embodiment of the present application, after the focus audio and the non-focus audio are determined in multiple audio data, the virtual space position corresponding to each audio data can be determined based on the focus audio and the non-focus audio. Among them, for the focus audio, the corresponding virtual space position can be fixed, that is, no matter which audio data is used as the focus audio, it corresponds to the same position, such as the preset center position; and for the non-focus audio, the corresponding virtual space position is adaptively set based on different audio data, that is, different audio data may have different corresponding positions when used as non-focus audio.

[0125] It can be understood that, in the embodiments of the present application, the virtual space position can be understood as the sound image position in the virtual sound field space.

[0126] That is to say, in an embodiment of the present application, after determining the focus audio and the non-focus audio, the virtual space position corresponding to the audio data as the focus audio can be determined, and the virtual space position corresponding to the audio data as the non-focus audio can also be determined.

[0127] It should be noted that in the embodiments of the present application, when the spatial audio rendering algorithm renders multi-channel audio data, it is often assumed that multiple virtual speakers are arranged in the virtual listening space, and the data of each channel is fed to each virtual speaker. After being processed by the rendering algorithm, the sound is like it is emitted from the position of the virtual speaker. Among them, the basic sound unit processed by the spatial audio rendering algorithm generally includes audio data and sound position information, and the sound position information can be the virtual space position corresponding to the audio data.

[0128] It can be understood that in the embodiments of the present application, the preset center position can be the spatial position corresponding to the focus audio, wherein the preset center position can be fixed or adaptively changed, and the present application does not make specific limitations.

[0129] It is understandable that in the embodiments of the present application, the preset center position can be determined based on the playback configuration and playback parameters of the multi-audio playback device or equipment. For example, for a dual-channel playback device, the corresponding preset center position can be a spatial position concentrated at one point, or can include two symmetrical spatial positions; for a quad-channel playback device, the corresponding preset center position can include four mutually symmetrical spatial positions, which is not specifically limited in the present application.

[0130] Exemplarily, in some embodiments, taking dual channels as an example, assuming that the preset center position is fixed, it can be two symmetrical spatial positions, that is, for any audio data as the focus audio, the corresponding virtual spatial position is the preset center position.

[0131] It should be noted that, in the embodiment of the present application, the first preset animation effect and the second preset animation effect may be different animation rendering effects.

[0132] It should be noted that, in an embodiment of the present application, the first preset animation effect can be used to highlight the playback status of the first focus audio.

[0133] For example, in some embodiments, the first preset animation effect may be a flashing animation effect, a water ripple animation effect, or a shaking animation effect, which is not specifically limited in the present application.

[0134] That is to say, in an embodiment of the present application, when displaying visual identification corresponding to at least two first audio data, different animation effects, such as a first preset animation effect and a second preset animation effect, can be used in different areas, such as a focus area and a non-focus area, to display the first focus audio and the first non-focus audio, respectively.

[0135] Furthermore, in an embodiment of the present application, a visual identification of the first focus audio is displayed in the focus area according to a first preset animation effect; in a first target area in the non-focus area corresponding to the first non-focus audio, the visual identification of the first non-focus audio is displayed according to a second preset animation effect; and in a second target area in the non-focus area corresponding to the first focus audio, the visual identification of the first focus audio can also be displayed in a third preset animation effect.

[0136] It can be understood that, in the embodiment of the present application, the second target area is the area where the visual identification is displayed corresponding to the first focus audio and is determined based on the correspondence between the scene and the non-focus position.

[0137] It should be noted that, in the embodiment of the present application, the first preset animation effect, the second preset animation effect and the third preset animation effect can be different animation rendering effects. Among them, the third preset animation effect can be used to highlight the home position corresponding to the first focus audio.

[0138] Exemplarily, in some embodiments, the third preset animation effect may be a dotted line animation effect.

[0139] It can be understood that in the embodiments of the present application, the visual identification of the first focus audio and the first non-focus audio is displayed based on the first preset animation and the second preset animation effect respectively, so as to achieve the distinctive display of the first focus audio and the first non-focus audio.

[0140] It can be understood that in an embodiment of the present application, based on the first preset animation and the third preset animation effects, the visual identification of the first focus audio is displayed in the focus area and the non-focus area respectively, so as to realize the display of the gradual entry process of the first focus audio from the home position to the center position.

[0141] Exemplarily, in some embodiments, Figure 7 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 1 ,like Figure 7As shown, the position change process of the current audio playback is displayed in real time on the holographic audio playback interface through animation, for example, the position change of the first focus audio from the home position to the center position. Among them, the home position of each audio data can be displayed on the holographic audio playback interface. If there is currently playing audio, such as an Internet call, the center position will show that the audio is playing (indicated by the animation effect of water ripples), and its corresponding home position is displayed with a dotted line, indicating that it has moved from the home position to the center position.

[0142] It should be noted that, in the embodiments of the present application, for the first focus audio, the first focus audio can be played directly in the focus area, and can also be played from the non-focus area to the focus area in a gradual-in manner.

[0143] That is to say, in the embodiments of the present application, for the focus audio, the playback mode adopted can be a gradual-in playback mode or a direct playback mode, and the present application does not make specific limitations.

[0144] Exemplarily, in some embodiments, for the focus audio among the multiple audio data to be played, you can choose to use a gradual-in method to play the focus audio; for the non-focus audio among the multiple audio data to be played, you can choose to directly play the non-focus audio.

[0145] Step 102: In response to a second playback operation corresponding to the holographic audio playback interface, a display process corresponding to the second playback operation is performed in the holographic audio playback interface.

[0146] In an embodiment of the present application, in response to a first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and visual identifiers corresponding to at least two first audio data are displayed in the focus area and non-focus area of ​​the holographic audio playback interface. If a second playback operation is obtained in the holographic audio playback interface, the display processing corresponding to the second playback operation can be performed in the holographic audio playback interface in response to the second playback operation corresponding to the holographic audio playback interface.

[0147] Further, in an embodiment of the present application, the second play operation may include any type of operation implemented based on the holographic audio function. The second play operation and the first play operation may be of the same type or different type, and the present application does not specifically limit this.

[0148] Exemplarily, in some embodiments, if the second playback operation is the first selection operation corresponding to the focus area, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, the first display interface can be called out in the holographic audio playback interface; and the identification information of the first focus audio is displayed in the first display interface.

[0149] Exemplarily, in some embodiments, if the second playback operation is the second selection operation corresponding to the non-focus area, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, the first display interface can be called out in the holographic audio playback interface; and the identification information of the first non-focus audio is displayed in the first display interface.

[0150] It is understandable that, in the embodiment of the present application, the first display interface called out can be used to display the identification information corresponding to the audio data, wherein the identification information of the audio data may include the source, type, characteristics and other information corresponding to the audio data.

[0151] Exemplarily, in some embodiments, the identification information may be the type corresponding to the audio data, such as music, ringtone, etc.; or the source corresponding to the audio data, such as a creation application, a creation system, etc.

[0152] It should be noted that in an embodiment of the present application, after displaying at least two visual identifiers corresponding to the first audio data in the holographic audio playback interface, for any one of the visual identifiers, if the first selection operation or the second selection operation corresponding to the visual identifier is obtained in the holographic audio playback interface, the identification information of the corresponding audio data can be displayed in the called out first display interface.

[0153] Exemplarily, in some embodiments, in response to a first selection operation received in a focus area in a holographic audio playback interface, identification information corresponding to the first focus audio may be displayed in an outgoing first display interface; in response to a second selection operation received in a non-focus area in the holographic audio playback interface, identification information corresponding to the first non-focus audio may be displayed in an outgoing first display interface.

[0154] Exemplarily, in some embodiments, Figure 8 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 2 ,like Figure 8 As shown, the first selection operation is the selection of the center position, and the app application from which the focus audio being played comes can be displayed below to enable the user to understand the source of the focus audio.

[0155] Exemplarily, in some embodiments, Fig. 9 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 3 ,like Fig. 9 As shown, the second selection operation is the selection of the home position, and the app application from which the non-focus audio being played comes can be displayed below, so that the user can understand the source of the non-focus audio.

[0156] Further, in an embodiment of the present application, if the second playback operation is a new operation corresponding to the second audio data, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, when the priority of the second audio data is higher than or equal to the first focus audio, the visual identification of the second audio data is displayed in the focus area according to the first preset animation effect; in the second target area in the non-focus area corresponding to the first focus audio, the visual identification of the first focus audio is displayed according to the second preset animation effect.

[0157] It should be noted that, in the embodiment of the present application, the second audio data may be one or more newly added audio data that are different from the first audio data.

[0158] It can be understood that in an embodiment of the present application, when displaying in response to a second playback operation of adding second audio data, if the priority of the newly added audio data is higher than that of the audio data already being played, that is, the priority of the second audio data is higher than or equal to the first audio data, then it can be selected to display the visual identification of the newly added second audio data in the focus area according to the first preset animation effect, and at the same time, in the second target area in the non-focus area, display the visual identification of the first focus audio according to the second preset animation effect.

[0159] Further, in an embodiment of the present application, if the second playback operation is a new operation corresponding to the second audio data, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, if the priority of the second audio data is higher than or equal to the first audio data, in the third target area corresponding to the second audio data in the non-focus area, the visual identification of the second audio data is displayed according to the third preset animation effect.

[0160] It can be understood that, in the embodiment of the present application, the third target area is the area where the visual identification is displayed corresponding to the second audio data and is determined based on the correspondence between the scene and the non-focus position.

[0161] It can be understood that in an embodiment of the present application, the visual identification of the second audio data is displayed in the focus area and the non-focus area based on the first preset animation and the third preset animation effects respectively, so as to realize the display of the gradual entry process of the second audio data from the home position to the center position.

[0162] Exemplarily, in some embodiments, Fig.10 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 4 ,like Fig.10 As shown, the position change process of the current audio playback is displayed in real time on the holographic audio playback interface through animation. For example, the home position of each audio data can be displayed on the holographic audio playback interface. If the newly added second audio data (such as a game) occupies the center position of the first focus audio, then the first focus audio (such as an Internet call) changes from the center position to the home position, and at the same time, the second audio data can change from the home position to the center position. Among them, for the second audio data, the center position will show that the audio is playing (indicated by the animation effect of water ripples), and its corresponding home position is displayed with a dotted line, indicating that it has entered the center position from the home position.

[0163] Further, in an embodiment of the present application, if the second playback operation is a new operation corresponding to the second audio data, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, when the priority of the second audio data is lower than that of the first focus audio, in the third target area in the non-focus area corresponding to the second audio data, the visual identification of the second audio data is displayed according to the second preset animation effect.

[0164] It can be understood that in an embodiment of the present application, when displaying in response to a second playback operation of adding second audio data, if the priority of the newly added audio data is lower than that of the audio data already being played, that is, the priority of the second audio data is lower than that of the first audio data, then the visual identification of the second audio data can be selected to be displayed in a third target area in a non-focus area according to a second preset animation effect.

[0165] Further, in an embodiment of the present application, if the second playback operation is a stop operation corresponding to the first focus audio, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, the visual identification of the first focus audio can be stopped from being displayed.

[0166] Further, in an embodiment of the present application, if the second playback operation is a stop operation corresponding to the first focus audio, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, the visual identification of the second focus audio can be displayed in the focus area according to the first preset animation effect; wherein the second focus audio is the audio data with the highest priority in the first non-focus audio; and in the fourth target area in the non-focus area corresponding to the second focus audio, the visual identification of the second focus audio is displayed according to the third preset animation effect.

[0167] It should be noted that, in an embodiment of the present application, after stopping the playback of the first focus audio, a new focus audio with the highest priority, namely, the second focus audio, can be re-determined in the first non-focus audio, and then played in the center position.

[0168] It can be understood that, in the embodiment of the present application, the fourth target area is the area where the visual identification is displayed corresponding to the second focus audio and is determined based on the correspondence between the scene and the non-focus position.

[0169] It can be understood that in an embodiment of the present application, when displaying in response to stopping the second playback operation of the first focus audio, on the one hand, the visual identification of the first focus audio can be stopped from being displayed in the focus area, and on the other hand, the visual identification of the new focus audio, that is, the visual identification of the second focus audio can be displayed in the focus area according to the first preset animation effect; at the same time, the visual identification of the second focus audio can be displayed in the fourth target area corresponding to the second focus audio in the non-focus area according to the third preset animation effect.

[0170] Exemplarily, in some embodiments, Fig.11 Schematic diagram of the display of the holographic audio playback interface proposed in the embodiment of the present application Figure 5 ,like Fig.11 As shown, the position change process of the current audio playback is displayed in real time on the holographic audio playback interface through animation. For example, the home position of each audio data can be displayed on the holographic audio playback interface. If the first focus audio (such as an Internet call) played at the center position is stopped, a new focus audio, that is, the second focus audio, can be determined from the first non-focus audio played at the home position. Then, the second focus audio can change from the home position to the center position. Among them, for the second focus audio (such as music), the center position will show that the audio is playing (indicated by the animation effect of water ripples), and its corresponding home position is displayed with a dotted line, indicating that it has entered the center position from the home position.

[0171] Further, in an embodiment of the present application, if the second playback operation is a stop operation corresponding to the first non-focus audio, then in response to the second playback operation corresponding to the holographic audio playback interface, when the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, the visual identification of the first non-focus audio can be stopped.

[0172] Further, in an embodiment of the present application, in response to a first setting instruction of the holographic audio function, a holographic audio setting interface can be called out; then, in response to a first setting operation obtained by the holographic audio setting interface, a setting process corresponding to the first setting operation is executed in the holographic audio setting interface.

[0173] It should be noted that, in an embodiment of the present application, the holographic audio setting interface may include a first area and a second area; wherein the first area displays identification information of the added audio scene; and the second area displays identification information of the unadded audio scene.

[0174] For example, in the embodiments of the present application, Fig.12 Schematic diagram of the holographic audio setting interface proposed in the embodiment of the present application Figure 1 ,like Fig.12 As shown, the called-out holographic audio setting interface can be divided into two different areas, namely a first area and a second area, wherein the first area can be used to display the identification information of the added audio scene, and the second area can be used to display the identification information of the unadded audio scene.

[0175] It can be understood that, in the embodiments of the present application, the added audio scene is the set audio scene that needs to take effect of the holographic audio function; the unadded audio scene is the set audio scene that does not need to take effect of the holographic audio function.

[0176] For example, in the embodiments of the present application, Fig.13 Schematic diagram of the holographic audio setting interface proposed in the embodiment of the present application Figure 2 ,like Fig.13 As shown, in the called-out holographic audio setting interface, the first area displays identification information of the added audio scenes, such as navigation, alarm clock, and music, and the second area displays identification information of the unadded audio scenes, such as video, game, and incoming call.

[0177] Further, in an embodiment of the present application, if the first setting operation is a deletion operation corresponding to the first audio scene displayed in the first area, then in response to the first setting operation obtained by the holographic audio setting interface, when the setting processing corresponding to the first setting operation is performed in the holographic audio setting interface, the identification information of the first audio scene is stopped from being displayed in the first area; and at the same time, the identification information of the first audio scene is displayed in the second area.

[0178] It can be understood that in an embodiment of the present application, if the first setting operation is a deletion operation obtained for the first audio scene displayed in the first area, then in response to the first setting operation, the identification information of the first audio scene may no longer be displayed in the first area, and at the same time, the identification information of the first audio scene may be displayed in the second area, that is, the first audio scene is changed from an added audio scene to an unadded audio scene.

[0179] Exemplarily, in some embodiments, Fig.14 Schematic diagram of the implementation of the first setting operation proposed in the embodiment of the present application Figure 1 ,like Fig.14 As shown, assuming that the first setting operation is a deletion operation corresponding to music, the display processing of "music" can be switched from the first area to the second area.

[0180] Further, in an embodiment of the present application, if the first setting operation is an adding operation corresponding to the second audio scene displayed in the second area, then in response to the first setting operation obtained by the holographic audio setting interface, when the setting processing corresponding to the first setting operation is executed in the holographic audio setting interface, the identification information of the second audio scene is stopped from being displayed in the second area; and at the same time, the identification information of the second audio scene is displayed in the first area.

[0181] It can be understood that in an embodiment of the present application, if the first setting operation is an add operation obtained for the second audio scene displayed in the second area, then in response to the first setting operation, the identification information of the second audio scene may no longer be displayed in the second area. At the same time, the identification information of the second audio scene may be displayed in the first area, that is, the second audio scene is changed from an audio scene that has never been added to an audio scene that has been added.

[0182] Exemplarily, in some embodiments, Fig.15 Schematic diagram of the implementation of the first setting operation proposed in the embodiment of the present application Figure 2 ,like Fig.15 As shown, assuming that the first setting operation is an adding operation corresponding to the game, the display processing of "game" can be switched from the second area to the first area.

[0183] It should be noted that in the embodiment of the present application, for adding scenes, the user can also be guided to perform the adding process by real-time detection of the audio type being played. For example, if a new game audio is currently incoming to the user, and this game audio is not in the current adding list, a dotted game audio icon can be displayed on the UI to inform the user whether the audio of the current incoming game audio needs to be added to the list, so that the user can quickly add it.

[0184] Further, in an embodiment of the present application, if the first setting operation is a moving operation corresponding to the first audio scene displayed in the first area, then in response to the first setting operation obtained by the holographic audio setting interface, when the setting processing corresponding to the first setting operation is performed in the holographic audio setting interface, the identification information corresponding to the first audio scene can be moved from the initial position in the first area to the target position indicated by the moving operation to adjust the priority sorting of the first audio scene.

[0185] It can be understood that in an embodiment of the present application, if the first setting operation is a move operation obtained for the first audio scene displayed in the first area, then in response to the first setting operation, the corresponding target position indicated by the move operation can be determined, and then the identification information corresponding to the first audio scene can be moved from the initial position to the target position, thereby completing the adjustment of the priority ranking of the first audio scene.

[0186] That is, in an embodiment of the present application, the display order of the added audio scenes displayed in the first area can be determined based on the corresponding priorities. For example, the multiple audio scenes in the first area can be displayed in order from high to low priority, from top to bottom.

[0187] Exemplarily, in some embodiments, Fig.16 Schematic diagram of the implementation of the first setting operation proposed in the embodiment of the present application Figure 3 ,like Fig.16 As shown, assuming that the first setting operation is a moving operation corresponding to the game, "game" can be moved from after "music" to before "music". Before responding to the moving operation, the priority of the game is lower than that of music, and after responding to the moving operation, the priority of the game is higher than that of music.

[0188] Furthermore, in an embodiment of the present application, the multi-audio playback device can also respond to the second setting instruction of the holographic audio function to call out the area setting interface; in response to the second setting operation obtained by the area setting interface, in the area setting interface, based on the correspondence between the scene and the non-focus position, different non-focus areas corresponding to the added audio scene are set.

[0189] It should be noted that, in the embodiment of the present application, for the added audio scene, the corresponding non-focus area can be set in the area setting interface according to the correspondence between the scene and the non-focus position.

[0190] It can be seen that the multi-audio playback method proposed in the above steps 101 and 102 can more flexibly set the required audio to take effect of the holographic function; at the same time, the UI animation display can be used to enable the user to understand the implementation logic of the holographic function; and the audio playback source can be displayed more intuitively.

[0191] The embodiment of the present application provides a multi-audio playback method. When the holographic audio function is turned on, in response to the first playback operation corresponding to at least two first audio data, the holographic audio playback interface is called out, and the visual identification corresponding to at least two first audio data is displayed in the focus area and non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface. It can be seen that in the embodiment of the present application, in the process of multi-audio parallel playback, the visual identification corresponding to different audio data can be displayed in the focus area and non-focus area of ​​the holographic audio playback interface, so that different audio data can be played in different virtual space positions respectively, and the virtual space positions corresponding to different audio data can be displayed through the holographic audio playback interface. In other words, the multi-audio playback method proposed in the embodiment of the present application can not only play each audio data completely, but also assign virtual space positions that do not interfere with each other to different audio data for rendering and playback, so as to take into account the clarity and integrity of the audio content and effectively improve the playback effect of multi-audio.

[0192] Based on the above embodiments, another embodiment of the present application proposes a multi-audio playback method based on a holographic audio function, which involves a display interface for multi-audio playback.

[0193] It should be noted that, in the embodiments of the present application, the method for implementing the display of the interface mainly involves the interaction between the interface layer (referred to as the "UI layer") and the holographic audio service layer (referred to as the "service layer"). Fig.17 FIG. 1 is a schematic diagram of another implementation flow of an interface display method in an embodiment of the present application. Fig.17 As shown, the specific process is as follows:

[0194] S1. UI layer binds holographic audio service;

[0195] S2. The UI layer reads information from the service layer, including function switches (controlling whether the holographic audio function is effective), mode selection (smart mode and custom mode), scene position (spatial position of each audio source), playback status (whether each audio source is playing), etc.

[0196] S3, the UI layer displays the read information, and passes the scene position and playback status to the graphics engine for rendering and display;

[0197] S4. The user adjusts the setting items of each audio source and transmits the user input to the service layer to make the user input effective.

[0198] It should be noted that in the embodiments of the present application, holographic audio is an audio technology that can present music or sound through holographic imaging technology. This sound can come from different directions, distances and heights, giving the audience an immersive experience. When implementing the holographic audio function, the embodiments of the present application set a corresponding virtual space position for the original audio data of each sound source, and then process the position information and the original audio data through a spatial audio rendering algorithm, so that each sound source is like being emitted from different positions, so that the sounds of multiple sound sources can be separated, solving the problem of interference between multiple audios played simultaneously.

[0199] It should be noted that, in the embodiments of the present application, Fig.18 A graphical display of the spatial position relationship of audio data in an embodiment of the present application Figure 2 ,like Fig.18 As shown, the holographic audio playback interface displays the three-dimensional spatial position relationship of multiple audio data, and the three-dimensional space takes a hemispherical three-dimensional space as an example. According to the three-dimensional coordinates of each audio data, the visual identification of each sound source is displayed in the hemispherical three-dimensional space, the user identification is displayed at the center of the hemispherical space, and the visual identification of each sound source is distributed around the center, and the visual identification of different sound sources is different. Fig.18 The visual recognition and spatial location of sound sources such as incoming ringtones, alarms, game voices, videos, audio books, music, notifications and navigation are given as examples.

[0200] Exemplarily, when the audio data is in a playing state, the visual identifier of the audio data is superimposed with the identifier representing the playing state, otherwise the identifier representing the playing state is removed. The identifier representing the playing state may be a dynamic identifier or a static identifier.

[0201] In some embodiments, the playing state includes a circular sound wave dynamic mark or a fan-shaped sound wave dynamic mark.

[0202] Fig.19 A graphical display of the audio source playback status in the embodiment of the present application Figure 1 ,like Fig.19 As shown, when the music and navigation enter the playing state, a circular sound wave dynamic logo is superimposed on the music symbol and the navigation symbol.

[0203] Exemplarily, in response to the operation of playing audio data, the visual identification of the audio data is displayed at the first position of the holographic audio playback interface; in response to the operation of stopping the playback of the audio data, the visual identification of the first sound source is deleted in the holographic audio playback interface. In other words, the visual identification of the sound source will be displayed at the default position of the holographic audio playback interface only when the sound source enters the playback state, otherwise it will not be displayed.

[0204] Fig. 20A graphical display of the audio source playback status in the embodiment of the present application Figure 2 ,like Fig. 20 As shown in the figure, when music, navigation, alarm and notification enter the playing state, the music symbol, navigation symbol, alarm symbol and notification symbol will be displayed in the holographic audio playback interface, and other audio sources that have not entered the playing state will not be displayed. For scenes with many audio sources, the display effect of the spatial position relationship of the audio sources can be guaranteed.

[0205] Different output modes correspond to different multi-source playback control methods. In an embodiment of the present application, the multi-source target output mode can be one of the following: intelligent mode and custom mode. In the intelligent mode, the sound source position can be changed based on a preset position transformation strategy, and the audio data can be rendered using the transformed sound source position information. In the custom mode, audio data is rendered according to the user-defined sound source position information. In actual applications, at least one intelligent mode may be included, and different intelligent modes change the sound source position based on different position transformation strategies.

[0206] By adopting the above technical solution, different sound sources are allocated to different virtual space positions using a multi-source output mode, so that the multi-source data streams do not interfere with each other and are independently controllable, thereby achieving the playback effect of separated auditory senses of the sound sources. For different output modes, the complex spatial position relationship of the sound sources is intuitively displayed through a visual holographic audio playback interface, which is conducive to the application and promotion of holographic audio technology.

[0207] Fig.21 Schematic diagram of the spatial position relationship of the sound source in the intelligent mode in the embodiment of the present application. Fig.21 As shown, the holographic audio playback interface displays the three-dimensional spatial position relationship of multiple sound sources (audio data), and the three-dimensional space takes a hemispherical three-dimensional space as an example. According to the three-dimensional coordinates of each sound source, the visual identification of each sound source is distributed around the center position of the hemisphere and displayed at different positions in the hemispherical three-dimensional space. The position of each sound source can be called the home position, and the visual identification of different sound sources is different. In the smart mode, multiple sound sources take ringtones, music, alarm clocks, navigation and notifications as examples.

[0208] In smart mode, multiple audio sources include focus audio sources and non-focus audio sources. The position information of each audio source can be arranged in different combinations of audio source positions to perform an auditory test of the audio, thereby determining the position with the best audio effect. When using smart mode for multi-source output, each audio is not fixed at the default position, but changes accordingly following the position change strategy.

[0209] The focus sound source position can also be called (center position). The focus sound source position can be a position with a certain distance and azimuth relative to the center position. For example, the focus sound source position can be at a certain distance from the center position along the Y-axis direction. The focus sound source position can also be the center position, that is, the focus sound source position can coincide with the center position. The sound source with the focus sound source position is called the focus sound source. When multiple sound sources play sounds at the same time, there is only one focus sound source. In actual applications, if the audio output device is a multi-channel output, the focus sound source position can also include multiple focus sound sources corresponding to different channels at different positions.

[0210] In some embodiments, the sound source type includes a transient sound source and a non-transient sound source, and the priority of the non-transient sound source is higher than the priority of the transient sound source.

[0211] Among them, transient sound sources can be understood as sound sources that are triggered to play in a short period of time, and the playing time of such sound sources is relatively short. Exemplarily, transient sound sources include at least one of the following: notification, navigation, voice assistant, voice message. The same priority can be set for transient sound sources.

[0212] Non-transient sound sources can be understood as sound sources that are continuously played under certain conditions, and such sound sources have a longer playing time. Exemplarily, non-transient sound sources include at least one of the following: calls, incoming call ringtones, alarm clocks, games, voice calls, videos, audiobooks, and music.

[0213] For non-transient audio sources, different non-transient audio sources may be prioritized. For example, the priority order of non-transient audio is: call > incoming call ringtone > alarm > game > voice call > video > audiobook > music.

[0214] It should be noted that different priorities may be set for transient sound sources, and the same priority may be set for non-transient sound sources.

[0215] For example, the priorities of the five sound sources are as follows: incoming ringtone > alarm > music > notification and navigation. Notification and navigation are transient sound sources, and their priorities are the same and lower than non-transient sound sources. Figure 22 to Figure 24 Schematic diagram of the graphical display of the position change strategy in the embodiment of the present application, taking the focus sound source position as the center position as an example for illustration, such as Fig. 22 As shown in the figure, when the music is currently playing, the focus source position is called the center position. When the center position is empty, the music takes the center position. At this time, a call ringtone comes in. Because the call ringtone has a higher priority than the music, the music returns to its home position and the call ringtone enters the center position. Fig.23Then the alarm rings and the incoming call ring ends. The alarm takes the center position, the incoming call ring returns to its home position, and the playing animation of the incoming call ring disappears. Fig.24 shown.

[0216] When the first sound source (first sound source) occupies the focus sound source position, and the priority of the second sound source (second sound source) is equal to the priority of the first sound source, the second sound source occupies the focus sound source position, and the first sound source returns to its default position. If the priority of the second sound source (second sound source) is lower than the priority of the first sound source, the second sound source is in its default position. Among them, the sound sources with the same priority can be the sound sources of the same sound source type.

[0217] Figure 25 to Figure 26 Schematic diagram of the graphical display of the position change strategy in the embodiment of the present application, such as Fig.25 As shown in FIG. 1 , the first music source is played first, and the first music source is in the center position. Fig.26 As shown, the second music source is played next. Because both music scenes have the same priority, the second music source that is played later enters the center position, and the first music source that is played earlier returns to its home position.

[0218] The position adjustment operation may be a continuous operation, thereby displaying the position change process of the visual identifier of the first sound source on the holographic audio playback interface. In some embodiments, the position adjustment operation may include a sliding operation on the visual identifier of the first sound source on the holographic audio playback interface. Fig. 27 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 1 ,like Fig. 27 As shown, the display area includes a mode selection interface and a holographic audio playback interface. The mode selection interface includes the selection of smart mode and custom mode. The holographic audio playback interface includes a hemispherical three-dimensional space, which includes visual logos of multiple sound sources and a central visual logo. The user clicks on the visual logo of a sound source to select it, and slides the visual logo to adjust the sound source position information. The holographic audio playback interface also includes a "start audition" button, which allows the user to control the output effect of multiple sound sources under the current spatial position relationship.

[0219] Fig.28 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 2 ,like Fig.28As shown, the display area includes a mode selection interface, a holographic audio playback interface, and a parameter adjustment interface. The mode selection interface includes the selection of smart mode and custom mode. The holographic audio playback interface includes a hemispherical three-dimensional space, which includes visual identifiers of multiple sound sources and a central visual identifier. The user clicks on the visual identifier of a sound source to select it, and adjusts the sound source position information by sliding the visual identifier. The holographic audio playback interface also includes a "start audition" button, which the user can operate to control the multi-source output effect under the current spatial position relationship. The parameter adjustment interface includes a sound source selection item and three coordinate sliding bars. The user clicks on a sound source selection item to call up a list of selection items and selects an audio from it. At this time, adjusting the three position coordinates in the position information is to adjust the position of the selected audio.

[0220] Further, in an embodiment of the present application, in response to a first setting instruction of the holographic audio function, a holographic audio setting interface is called out; then in response to a first setting operation obtained by the holographic audio setting interface, a setting process corresponding to the first setting operation is executed in the holographic audio setting interface.

[0221] It should be noted that, in an embodiment of the present application, the holographic audio setting interface includes a first area and a second area; wherein the first area displays identification information of the added audio scene; and the second area displays identification information of the unadded audio scene.

[0222] It should be noted that, in an embodiment of the present application, if the first setting operation is a deletion operation corresponding to the first audio scene displayed in the first area, in response to the first setting operation obtained by the holographic audio setting interface, a setting process corresponding to the first setting operation is performed in the holographic audio setting interface, including: stopping displaying the identification information of the first audio scene in the first area; and displaying the identification information of the first audio scene in the second area.

[0223] It should be noted that, in an embodiment of the present application, if the first setting operation is an adding operation corresponding to the second audio scene displayed in the second area, in response to the first setting operation obtained by the holographic audio setting interface, the setting processing corresponding to the first setting operation is executed in the holographic audio setting interface, including: stopping displaying the identification information of the second audio scene in the second area; displaying the identification information of the second audio scene in the first area.

[0224] It should be noted that, in an embodiment of the present application, if the first setting operation is a moving operation corresponding to the first audio scene displayed in the first area, in response to the first setting operation obtained by the holographic audio setting interface, the setting processing corresponding to the first setting operation is performed in the holographic audio setting interface, including: moving the identification information corresponding to the first audio scene from the initial position in the first area to the target position indicated by the moving operation to adjust the priority sorting of the first audio scene.

[0225] It is understandable that in the embodiments of the present application, many audio sources are supported, but the user may not need certain audio, such as not having the habit of listening to books and not needing the holographic function of the audio of listening to books, so a more flexible setting scheme is provided to delete or add audio.

[0226] The specific operations are as follows:

[0227] 1. Click Audio Edit to enter the editing interface, which displays the added audio list and the supported unadded audio list.

[0228] 2. Click the "-" on the right side of the list to delete the audio from the added audio list. After deletion, it will be displayed in the unadded list below. Click the "+" on the right side of the unadded list to add the audio to the added list above.

[0229] 3. After long pressing the added list, you can swipe up to adjust the order to set the audio priority. This can be used to grab the center position of the audio in smart mode.

[0230] Furthermore, in the example of the present application, when the holographic audio function is turned on, in response to a first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and visual identifiers corresponding to at least two first audio data are displayed in the focus area and non-focus area of ​​the holographic audio playback interface; in response to a second playback operation corresponding to the holographic audio playback interface, display processing corresponding to the second playback operation is performed in the holographic audio playback interface.

[0231] It should be noted that, in an embodiment of the present application, at least two first audio data include a first focus audio and a first non-focus audio, and visual identifiers corresponding to at least two first audio data are displayed in the focus area and non-focus area of ​​the holographic audio playback interface, including: displaying the visual identifier of the first focus audio in the focus area according to a first preset animation effect; and displaying the visual identifier of the first non-focus audio in the first target area in the non-focus area corresponding to the first non-focus audio according to a second preset animation effect.

[0232] It should be noted that in an embodiment of the present application, at least two visual identifiers corresponding to the first audio data are displayed in the focus area and non-focus area of ​​the holographic audio playback interface, including: in a second target area in the non-focus area corresponding to the first focus audio, the visual identifier of the first focus audio is displayed according to a third preset animation effect.

[0233] It should be noted that, in an embodiment of the present application, the holographic audio playback interface includes at least one focus area and multiple non-focus areas; wherein different non-focus areas display different visual identifications of non-focus audio based on the correspondence between the scene and the non-focus position.

[0234] It should be noted that, in an embodiment of the present application, if the second playback operation is the first selection operation corresponding to the focus area, in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: calling out the first display interface in the holographic audio playback interface; and displaying the identification information of the first focus audio in the first display interface.

[0235] It should be noted that, in an embodiment of the present application, if the second playback operation is the second selection operation corresponding to the non-focus area, in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: calling out the first display interface in the holographic audio playback interface; and displaying the identification information of the first non-focus audio in the first display interface.

[0236] It should be noted that, in an embodiment of the present application, if the second playback operation is a new operation corresponding to the second audio data, in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: when the priority of the second audio data is higher than or equal to the first focus audio, the visual identification of the second audio data is displayed in the focus area according to the first preset animation effect; in the second target area in the non-focus area corresponding to the first focus audio, the visual identification of the first focus audio is displayed according to the second preset animation effect.

[0237] It should be noted that, in the embodiment of the present application, in the third target area in the non-focus area corresponding to the second audio data, the visual identification of the second audio data is displayed according to the third preset animation effect.

[0238] It should be noted that, in an embodiment of the present application, in response to a second playback operation corresponding to the holographic audio playback interface, display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: when the priority of the second audio data is lower than that of the first focus audio, in a third target area in a non-focus area corresponding to the second audio data, a visual identifier of the second audio data is displayed according to a second preset animation effect.

[0239] It should be noted that, in an embodiment of the present application, if the second playback operation is a stop operation corresponding to the first focus audio, in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: stopping the display of the visual mark of the first focus audio.

[0240] It should be noted that, in an embodiment of the present application, in response to the second playback operation corresponding to the holographic audio playback interface, display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: displaying a visual identification of the second focus audio in the focus area according to a first preset animation effect; wherein the second focus audio is the audio data with the highest priority in the first non-focus audio; and displaying a visual identification of the second focus audio in a fourth target area in the non-focus area corresponding to the second focus audio according to a third preset animation effect.

[0241] It should be noted that, in an embodiment of the present application, if the second playback operation is a stop operation corresponding to the first non-focus audio, in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface, including: stopping the display of the visual mark of the first non-focus audio.

[0242] It can be understood that in the embodiments of the present application, in order to deepen the implementation logic of the position changes of the home position and the center position of the smart mode, the position change process of the current audio playback can be displayed in real time on the interface through animation.

[0243] Exemplarily, in some embodiments, the home position of each audio can be displayed. If there is an audio currently being played, the center position will display that the audio is being played (indicated by a water ripple animation effect, i.e., according to the first preset animation effect), and its corresponding home position is displayed with a dotted line, indicating that it has moved from the home position to the center position.

[0244] For example, in some embodiments, when the center position is selected, the app application from which the audio being played comes can be displayed below to let the user know the source of the sound, as shown in the following figure:

[0245] For example, in some embodiments, when a new audio is detected in the background and its priority is higher than the current center position, it needs to occupy the center position, and then the interface will display an animation of the current center position returning to its home position and the new video entering the center position. When music is playing in the center position, a video is played. Since the video has a higher priority than the music, it needs to occupy the center position, and then the music returns to its home position to play, and the video enters the center position to play, and the home position of the video becomes a dotted line.

[0246] For example, in some embodiments, no matter it is the center position or the home position, as long as it is playing, after selecting the audio, the app name corresponding to the audio will be displayed below, which is convenient for knowing the source of the audio playback.

[0247] Exemplarily, in some embodiments, Fig.29 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 1 ,like Fig.29 As shown, during the parallel playback of multiple audios, for the input audio data played in parallel, the focus audio FocusTrack in the current state can be obtained according to the priority and creation time of each Track (audio data) (step 201), and then the motion state of each Track itself is updated according to the current FocusTrack and the spatial position and motion state of each Track itself (step 202), and after the Track updates its own motion state, it updates its own spatial position (step 203), and then the position coordinates of each Track are set in the sound renderer (step 204), and finally the data of the Track is given to the sound renderer for sound rendering, and the dual-channel data is output (step 205). The dual-channel data output by the final sound renderer includes the position effect of each Track in the virtual space.

[0248] That is to say, in the embodiment of the present application, after rendering, what is finally played is the two-channel data after 3D mixing.

[0249] Exemplarily, in some embodiments, Fig.30 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 2 ,like Fig.31As shown, when new audio data is added during the process of playing multiple audios, the update of the focus audio can be completed first. Among them, the priority of the newly added audio data and the priority of the original focus audio can be compared first (step 301). If the priority of the newly added audio data is higher than the priority of the original focus audio, then the newly added audio data can be updated to the new focus audio (step 302); if the priority of the newly added audio data is lower than the priority of the original focus audio, then the original focus audio can be maintained, and the newly added audio data can be used as non-focus audio (step 303); if the priority of the newly added audio data is equal to the priority of the original focus audio, then the creation time of the newly added audio data and the creation time of the original focus audio can be further compared (step 304), and when the creation time of the newly added audio data is greater than or equal to the creation time of the original focus audio, the newly added audio data is updated to the new focus audio (step 302), otherwise the original focus audio is maintained (step 303).

[0250] Furthermore, in the embodiments of the present application, Fig.31 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 3 ,like Fig.31 As shown, taking the multi-audio data including the first audio data and the second audio data as an example, after obtaining the multi-audio parallel playback instruction of the first audio data and the second audio data, the scene category corresponding to the first audio data and the second audio data can be determined first, that is, the first scene category and the second scene category (step 401); then, the priority corresponding to the first audio data and the second audio data is further determined based on the correspondence between the preset scene and the priority, that is, the first priority and the second priority (step 402); then, according to the priority (and creation time) of the first audio data and the second audio data, the focus audio FocusTrack and the non-focus audio in the current state, that is, the first focus audio and the first non-focus audio (step 403); then, according to the spatial position and motion state of the first focus audio and the first non-focus audio, the state and the corresponding virtual space position of the first audio data and the second audio data can be updated, thereby obtaining the first virtual space position corresponding to the first audio data and the second virtual space position corresponding to the second audio data (step 404). Finally, the position coordinates of each Track can be set in the sound renderer, and finally the data of the Track is given to the sound renderer for sound rendering, and the dual-channel data is output (step 405).

[0251] Furthermore, in the embodiments of the present application, Fig.32 Schematic diagram of the implementation of multi-audio playback proposed in the embodiment of the present application Figure 4 ,like Fig.32As shown, taking the third audio data as the newly added audio data as an example, in the process of playing the first audio data and the second audio data in parallel, after obtaining the playback instruction of the third audio data, the third scene category corresponding to the third audio data can be determined first (step 501); then, based on the correspondence between the preset scene and the priority, the third priority corresponding to the third audio data can be further determined (step 502); then, according to the priority update of the first audio data, the second audio data and the third audio data, the focus audio FocusTrack and non-focus audio in the current state, that is, the second focus audio and the second non-focus audio, are obtained (step 503).

[0252] The embodiment of the present application provides a multi-audio playback method. When the holographic audio function is turned on, in response to the first playback operation corresponding to at least two first audio data, the holographic audio playback interface is called out, and the visual identifiers corresponding to at least two first audio data are displayed in the focus area and non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface. It can be seen that in the embodiment of the present application, in the process of multi-audio parallel playback, the visual identifiers corresponding to different audio data can be displayed in the focus area and non-focus area of ​​the holographic audio playback interface, so that different audio data can be played in different virtual space positions respectively, and the virtual space positions corresponding to different audio data can be displayed through the holographic audio playback interface. In other words, the multi-audio playback method proposed in the embodiment of the present application can not only play each audio data completely, but also assign virtual space positions that do not interfere with each other to different audio data for rendering and playback, so as to take into account the clarity and integrity of the audio content and effectively improve the playback effect of multiple audios.

[0253] Based on the above embodiment, in another embodiment of the present application, Fig.33 This is a schematic diagram of the structure of the multi-audio playback device proposed in the embodiment of the present application, such as Fig.33 As shown, the multi-audio playback device 10 proposed in the embodiment of the present application may include a calling unit 11, a display unit 12,

[0254] The calling unit 11 is used to call out the holographic audio playing interface in response to the first playing operation corresponding to at least two first audio data when the holographic audio function is turned on;

[0255] The display unit 12 is used to display the visual identifiers corresponding to the at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, perform display processing corresponding to the second playback operation in the holographic audio playback interface.

[0256] In the embodiments of the present application, further, Fig.34 This is a schematic diagram of the structure of the electronic device proposed in the embodiment of the present application, such as Fig.34 As shown, the electronic device 20 proposed in the embodiment of the present application may also include a processor 21 and a memory 22 storing executable instructions of the processor 21. Furthermore, the multi-audio playback device 10 may also include a communication interface 23 and a bus 24 for connecting the processor 21, the memory 22 and the communication interface 23.

[0257] In the embodiment of the present application, the processor 21 can be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor. It can be understood that for different devices, the electronic device used to implement the function of the processor can also be other, and the embodiment of the present application is not specifically limited. The multi-audio playback device 10 can also include a memory 22, which can be connected to the processor 21, wherein the memory 22 is used to store executable program code, the program code includes computer operation instructions, and the memory 22 may include a high-speed RAM memory, and may also include a non-volatile memory, for example, at least two disk memories.

[0258] In the embodiment of the present application, the bus 24 is used to connect the communication interface 23, the processor 21 and the memory 22, and the mutual communication between these devices.

[0259] In the embodiment of the present application, the memory 22 is used to store instructions and data.

[0260] Furthermore, in an embodiment of the present application, the processor 21 is used to, when the holographic audio function is turned on, call out a holographic audio playback interface in response to a first playback operation corresponding to at least two first audio data, and display visual identifiers corresponding to the at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface; and in response to a second playback operation corresponding to the holographic audio playback interface, perform display processing corresponding to the second playback operation in the holographic audio playback interface.

[0261] In practical applications, the memory 22 may be a volatile memory, such as a random access memory (RAM); or a non-volatile memory, such as a read-only memory (ROM), a flash memory, a hard disk (HDD) or a solid-state drive (SSD); or a combination of the above types of memory, and provide instructions and data to the processor 21.

[0262] In addition, each functional module in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software functional modules.

[0263] If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk, etc., which can store program code.

[0264] The embodiment of the present application provides a multi-audio playback device and an electronic device. When the holographic audio function is turned on, the multi-audio playback device and the electronic device call out the holographic audio playback interface in response to the first playback operation corresponding to at least two first audio data, and display the visual identification corresponding to at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, the display processing corresponding to the second playback operation is performed in the holographic audio playback interface. It can be seen that in the embodiment of the present application, in the process of multi-audio parallel playback, the visual identification corresponding to different audio data can be displayed in the focus area and the non-focus area of ​​the holographic audio playback interface, so that different audio data can be played in different virtual space positions respectively, and the virtual space positions corresponding to different audio data can be displayed through the holographic audio playback interface. That is to say, the multi-audio playback method proposed in the embodiment of the present application can not only play each audio data completely, but also assign virtual space positions that do not interfere with each other to different audio data for rendering and playback, so as to take into account the clarity and integrity of the audio content and effectively improve the playback effect of multi-audio.

[0265] An embodiment of the present application provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the multi-audio playback method as described above is implemented.

[0266] Specifically, the program instructions corresponding to the multi-audio playback method in this embodiment can be stored in a storage medium such as a CD, a hard disk, a USB flash drive, etc. When the program instructions corresponding to the multi-audio playback method in the storage medium are read or executed by an electronic device, the following steps are included:

[0267] When the holographic audio function is turned on, in response to a first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and visual identifiers corresponding to the at least two first audio data are displayed in a focus area and a non-focus area of ​​the holographic audio playback interface;

[0268] In response to a second playback operation corresponding to the holographic audio playback interface, display processing corresponding to the second playback operation is performed in the holographic audio playback interface.

[0269] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0270] The present application is described with reference to implementation flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the process in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0271] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which is implemented in the implementation flow diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0272] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing the steps in the flowchart. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0273] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. A multi-audio playback method, characterized in that: The method comprises: When the holographic audio function is turned on, in response to a first playback operation corresponding to at least two first audio data, a holographic audio playback interface is called out, and visual identifiers corresponding to the at least two first audio data are displayed in a focus area and a non-focus area of ​​the holographic audio playback interface; In response to a second playback operation corresponding to the holographic audio playback interface, display processing corresponding to the second playback operation is performed in the holographic audio playback interface.

2. The method according to claim 1, characterized in that The at least two first audio data include a first focus audio and a first non-focus audio, and the displaying of visual identifiers corresponding to the at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface includes: Displaying a visual identification of the first focus audio in the focus area according to a first preset animation effect; In a first target area in the non-focus area corresponding to the first non-focus audio, a visual identifier of the first non-focus audio is displayed according to a second preset animation effect.

3. The method according to claim 2, characterized in that The displaying of the visual identifiers corresponding to the at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface includes: In a second target area in the non-focus area corresponding to the first focus audio, a visual identifier of the first focus audio is displayed according to a third preset animation effect.

4. The method according to any one of claims 1 to 3, characterized in that: The holographic audio playback interface includes at least one focus area and multiple non-focus areas; wherein different non-focus areas display different visual identifiers of non-focus audio based on the correspondence between scenes and non-focus positions.

5. The method according to claim 4, characterized in that If the second playback operation is the first selection operation corresponding to the focus area, the step of responding to the second playback operation corresponding to the holographic audio playback interface and performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: Calling out the first display interface in the holographic audio playback interface; The identification information of the first focus audio is displayed in the first display interface.

6. The method according to claim 4, characterized in that If the second playback operation is a second selection operation corresponding to the non-focus area, the step of responding to the second playback operation corresponding to the holographic audio playback interface and performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: Calling out the first display interface in the holographic audio playback interface; The identification information of the first non-focus audio is displayed in the first display interface.

7. The method according to claim 3, characterized in that If the second playback operation is a new operation corresponding to the second audio data, the step of responding to the second playback operation corresponding to the holographic audio playback interface and performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: When the priority of the second audio data is higher than or equal to the first focus audio data, displaying a visual identifier of the second audio data in the focus area according to the first preset animation effect; In the second target area in the non-focus area corresponding to the first focus audio, a visual identifier of the first focus audio is displayed according to the second preset animation effect.

8. The method according to claim 6, characterized in that The method further comprises: In a third target area in the non-focus area corresponding to the second audio data, a visual identifier of the second audio data is displayed according to the third preset animation effect.

9. The method according to claim 6, characterized in that In response to the second playback operation corresponding to the holographic audio playback interface, performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: When the priority of the second audio data is lower than that of the first focus audio data, a visual identifier of the second audio data is displayed in a third target area corresponding to the second audio data in the non-focus area according to the second preset animation effect.

10. The method according to claim 3, characterized in that: If the second playback operation is a stop operation corresponding to the first focus audio, the step of responding to the second playback operation corresponding to the holographic audio playback interface and performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: The visual indicator of the first focus audio is stopped from being displayed.

11. The method according to claim 10, characterized in that In response to the second playback operation corresponding to the holographic audio playback interface, performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: Displaying a visual identification of a second focus audio in the focus area according to the first preset animation effect; wherein the second focus audio is the audio data with the highest priority in the first non-focus audio; In a fourth target area in the non-focus area corresponding to the second focus audio, a visual identifier of the second focus audio is displayed according to the third preset animation effect.

12. The method according to claim 3, characterized in that If the second playback operation is a stop operation corresponding to the first non-focus audio, the step of responding to the second playback operation corresponding to the holographic audio playback interface and performing display processing corresponding to the second playback operation in the holographic audio playback interface includes: The visual indicator of the first non-focus audio is stopped from being displayed.

13. The method according to claim 4, characterized in that The method further comprises: In response to the first setting instruction of the holographic audio function, calling out a holographic audio setting interface; In response to the first setting operation acquired by the holographic audio setting interface, a setting process corresponding to the first setting operation is performed in the holographic audio setting interface.

14. The method according to claim 13, characterized in that The holographic audio setting interface includes a first area and a second area; wherein the first area displays identification information of added audio scenes; and the second area displays identification information of unadded audio scenes.

15. The method according to claim 14, characterized in that If the first setting operation is a deletion operation corresponding to the first audio scene displayed in the first area, in response to the first setting operation acquired by the holographic audio setting interface, performing setting processing corresponding to the first setting operation in the holographic audio setting interface includes: Stop displaying the identification information of the first audio scene in the first area; The identification information of the first audio scene is displayed in the second area.

16. The method according to claim 14, characterized in that If the first setting operation is an adding operation corresponding to the second audio scene displayed in the second area, in response to the first setting operation acquired by the holographic audio setting interface, performing setting processing corresponding to the first setting operation in the holographic audio setting interface includes: Stop displaying the identification information of the second audio scene in the second area; The identification information of the second audio scene is displayed in the first area.

17. The method according to claim 14, characterized in that If the first setting operation is a moving operation corresponding to the first audio scene displayed in the first area, in response to the first setting operation acquired by the holographic audio setting interface, performing setting processing corresponding to the first setting operation in the holographic audio setting interface includes: In the first area, identification information corresponding to the first audio scene is moved from an initial position to a target position indicated by the moving operation, so as to adjust the priority order of the first audio scene.

18. The method according to claim 15 or 16, characterized in that The method further comprises: In response to the second setting instruction of the holographic audio function, calling out a region setting interface; In response to the second setting operation acquired by the area setting interface, in the area setting interface, different non-focus areas corresponding to the added audio scene are set based on the correspondence between the scene and the non-focus position.

19. The method according to claim 1, characterized in that The focus area and the non-focus area are distributed around the center position of the holographic audio playback interface; wherein a first distance between the focus area and the center position is smaller than a second distance between the non-focus area and the center position.

20. The method according to claim 19, characterized in that The holographic audio playback interface is a hemispherical three-dimensional space, and the center position is the center position of the hemispherical three-dimensional space.

21. A multi-audio playback device, characterized in that: The multi-audio playback device comprises: a calling unit, a display unit, The calling unit is used to call out the holographic audio playing interface in response to the first playing operation corresponding to at least two first audio data when the holographic audio function is turned on; The display unit is used to display the visual identifiers corresponding to the at least two first audio data in the focus area and the non-focus area of ​​the holographic audio playback interface; in response to the second playback operation corresponding to the holographic audio playback interface, perform display processing corresponding to the second playback operation in the holographic audio playback interface.

22. An electronic device, characterized in that: The electronic device comprises a processor and a memory storing instructions executable by the processor, and when the instructions are executed by the processor, the method according to any one of claims 1 to 20 is implemented.

23. A computer-readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 20 is implemented.

Images