Multi-sound-source output control method and device, equipment and storage medium

Abstract

The invention discloses a multi-sound-source output control method and device, equipment and a storage medium, and the method comprises the steps: obtaining the position information of a plurality of sound sources in a target scene in response to a scene selection operation for the target scene of a multi-sound-source target output mode; and according to the position information of the plurality of sound sources, displaying visual identifiers of the plurality of sound sources at different spatial positions of a graphic display interface. Therefore, according to actual requirements, the multi-sound-source output mode is divided into different use scenes, virtual space positions of a plurality of sound sources are configured for each scene, multi-sound-source data streams are not interfered with each other and are independently controllable, and multi-sound-source playing effects corresponding to requirements are provided for different scenes. The complex spatial position relation is visually displayed through the visual graphic display interface, a user is helped to rapidly know the spatial position relation of multiple sound sources in different scenes, and application and popularization of the holographic audio technology are facilitated.

Description

Technical Field

[0001] The present application relates to holographic audio technology, and in particular to a multi-sound source output control method, device, equipment and storage medium. Background Art

[0002] In various smart devices currently, when the system plays multiple sound sources at the same time, some systems directly linearly superimpose the data of different sound sources and then play them, while some systems adjust the volume of each sound source to reduce the volume of some sound sources and highlight the volume of other sound sources. However, in these processing methods, each sound source is in the same position and has no difference in spatial dimension, so there is still interference problem between multiple sound sources. Summary of the invention

[0003] The embodiments of the present application are intended to provide a method, apparatus, device and storage medium for controlling multi-sound source output.

[0004] The technical solution of this application is implemented as follows:

[0005] In a first aspect, a multi-source output control method is provided, comprising:

[0006] In response to a scene selection operation for a target scene of a multi-source target output mode, obtaining position information of multiple sound sources in the target scene;

[0007] Visual identifiers of the multiple sound sources are displayed at different spatial positions of a graphic display interface according to the position information of the multiple sound sources.

[0008] In a second aspect, a multi-source output control device is provided, comprising:

[0009] An acquisition unit, configured to acquire position information of multiple sound sources in the target scene in response to a scene selection operation for a target scene in a multi-sound source target output mode;

[0010] The graphic display unit is used to display the visual identifications of the multiple sound sources at different spatial positions of the graphic display interface according to the position information of the multiple sound sources.

[0011] In a third aspect, a multi-source output control device is provided, comprising: a processor and a memory configured to store a computer program that can be run on the processor,

[0012] Wherein, the processor is configured to execute the steps of the aforementioned method when running the computer program.

[0013] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, wherein the computer program implements the steps of the aforementioned method when executed by a processor.

[0014] The present application provides a multi-source output control method, device, equipment and storage medium, the method comprising: in response to a scene selection operation for a target scene of a multi-source target output mode, obtaining the position information of multiple sound sources in the target scene; displaying the visual identification of the multiple sound sources at different spatial positions of a graphic display interface according to the position information of the multiple sound sources. In this way, according to actual needs, the multi-source output mode is divided into different usage scenarios, and the virtual spatial positions of multiple sound sources are configured for each scene, so that the multi-source data streams do not interfere with each other and are independently controllable, and provide multi-source playback effects corresponding to the needs for different scenes. The complex spatial position relationship is intuitively displayed through a visual graphic display interface, which helps users quickly understand the spatial position relationship of multiple sound sources in different scenarios, which is conducive to the application and promotion of holographic audio technology.

[0015] Furthermore, the graphical display interface is conducive to quickly and accurately adjusting the configuration information of the sound source in different scenarios (such as location and priority, etc.), thereby achieving personalized customization for multi-source output. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 This is a schematic diagram of the first process of the multi-source output control method in an embodiment of the present application;

[0017] Figure 2 The interface display diagram of the scene selection in the embodiment of the present application is shown as follows Figure 1 ;

[0018] Figure 3 The interface display diagram of the scene selection in the embodiment of the present application is shown as follows Figure 2 ;

[0019] Figure 4 A schematic diagram showing a graphical display of the spatial position relationship of multiple sound sources in an embodiment of the present application;

[0020] Figure 5 A graphical display of the audio source playback status in the embodiment of the present application Figure 1 ;

[0021] Figure 6 A graphical display of the audio source playback status in the embodiment of the present application Figure 2 ;

[0022] Figure 7 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 1 ;

[0023] Figure 8 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 2 ;

[0024] Fig. 9This is a graphical display diagram of a sound source selected in the embodiment of the present application. Figure 1 ;

[0025] Fig.10 This is a graphical display diagram of a sound source selected in the embodiment of the present application. Figure 2 ;

[0026] Fig.11 Schematic diagram of visual identification of each sound source in different display states in the embodiment of the present application;

[0027] Fig.12 This is a second flow chart of the multi-sound source output control method in an embodiment of the present application;

[0028] Fig.13 The interface display diagram of the style selection in the embodiment of the present application is shown as follows Figure 1 ;

[0029] Fig.14 The interface display diagram of the style selection in the embodiment of the present application is shown as follows Figure 2 ;

[0030] Fig.15 This is a third flow chart of the multi-sound source output control method in an embodiment of the present application;

[0031] Fig.16 This is a schematic diagram of adjusting the sound source position in the intelligent mode in an embodiment of the present application;

[0032] Fig.17 A graphical display of the position change strategy in the embodiment of the present application Figure 1 ;

[0033] Fig.18 A graphical display of the position change strategy in the embodiment of the present application Figure 2 ;

[0034] Fig.19 A graphical display of the position change strategy in the embodiment of the present application Figure 3 ;

[0035] Fig. 20 This is a fourth flow chart of the multi-sound source output control method in an embodiment of the present application;

[0036] Fig.21 A schematic diagram of the spatial position relationship of the sound source in the third scene in the custom mode in an embodiment of the present application;

[0037] Fig. 22 Schematic diagram of the spatial position relationship of the sound source in the fourth scene in the custom mode in the embodiment of the present application

[0038] FIG. 23A to FIG. 23EThis is a schematic diagram of the operation flow of multi-source output control in an embodiment of the present application;

[0039] Fig.24 This is a schematic diagram of the implementation process of an interface display method in an embodiment of the present application;

[0040] Fig.25 This is a schematic diagram of the composition structure of the multi-sound source output control device in an embodiment of the present application;

[0041] Fig.26 This is a schematic diagram of the composition structure of a multi-source output control device in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present application.

[0043] Figure 1 FIG. 1 is a schematic diagram of a first flow chart of a multi-source output control method in an embodiment of the present application. Figure 1 As shown, the method may specifically include:

[0044] Step 101: In response to a scene selection operation for a target scene in a multi-source target output mode, obtaining position information of multiple sound sources in the target scene;

[0045] In the embodiment of the present application, the multi-source target output mode can be any output mode that realizes the holographic audio function. Holographic audio is an audio technology that can present music or sound through holographic imaging technology. This sound can come from different directions, distances and heights, giving the audience an immersive experience. When realizing the holographic audio function, the embodiment of the present application sets a corresponding virtual space position for the original audio data of each sound source, and then processes the position information and the original audio data through a spatial audio rendering algorithm, so that each sound source seems to be emitted from different positions, so that the sounds of multiple sound sources can be separated, solving the problem of interference between multiple audios playing simultaneously.

[0046] In the embodiment of the present application, the sound source may specifically include: incoming call ringtones, alarm clocks, game voice, video, audiobooks, music, notifications, and navigation. The graphic display interface may display the spatial position relationship of all predefined sound sources. When one or more sound sources enter the play state, the graphic display interface may also display the spatial position relationship of the visual identification of one or more sound sources entering the play state on the graphic display interface, and delete the visual identification of the sound source when exiting the play state.

[0047] In the embodiments of the present application, the multi-source target output mode can realize the simultaneous playback of multiple audio sources in at least one of the following typical scenarios: Game scenario, when playing games, the game background sound, microphone voice and music sound are played simultaneously. In the car scenario, the navigation sound and music sound are played simultaneously. In the music / audiobook scenario, when playing music or using audiobook software to play audio, it is played simultaneously with the message notification sound. In the split-screen / small window scenario, when using the split-screen mode, long videos and short videos will be played at the same time, or video playback and calls will be played at the same time. For these typical scenarios, when multiple audio sources are played simultaneously on the same device, turning on the holographic audio function can adjust the spatial position of each audio source so that each audio source can be distributed in different spatial orientations when it appears at the same time, avoiding the problem of all audio sources playing at the same position at the same time, thereby enhancing the user's audio immersive experience.

[0048] In some embodiments, before responding to a scene selection operation for a target scene of a multi-source target output mode, the method may further include: in response to a mode selection operation for the target output mode, calling up a scene selection interface for the target output mode; and receiving a scene selection operation for the target scene in the scene selection interface.

[0049] It should be noted that the mode selection operation is used to select the target output mode and obtain the position information of multiple sound sources when using the target output mode. The user interface is rendered according to the position information of each sound source to obtain a graphical display interface. The visual identification of multiple sound sources is displayed at different spatial positions of the graphical display interface, and the visual identification of different sound sources is different.

[0050] In some embodiments, the position information of the multiple sound sources may be the default position information of each sound source in the target scene.

[0051] In other embodiments, the position information of the multiple sound sources may be the historical position information of each sound source that was last set in the target scene.

[0052] Different output modes correspond to different multi-source playback control methods. In an embodiment of the present application, the multi-source target output mode can be one of the following: intelligent mode and custom mode. In the intelligent mode, the sound source position can be changed based on a preset position transformation strategy, and the audio data can be rendered using the transformed sound source position information. In the custom mode, audio data is rendered according to the user-defined sound source position information. In actual applications, at least one intelligent mode may be included, and different intelligent modes change the sound source position based on different position transformation strategies.

[0053] In some embodiments, before responding to a scene selection operation for a target scene of a multi-source target output mode, the method may further include: in response to a mode selection operation for the target output mode, obtaining location information of multiple sound sources in a preset scene; in response to a scene selection start operation for the target output mode, calling up a scene selection interface for the target output mode; and receiving a scene selection operation for the target scene in the scene selection interface. In other words, in response to the mode selection operation, the spatial position relationship of each sound source of the preset scene is first displayed on the graphic display interface, and then the scene selection interface is called up through the scene selection start operation, and the user selects the target scene from the multiple scenes displayed on the scene selection interface. Among them, the preset scene can be the scene last selected for the target output mode, or it can be a default scene.

[0054] In some embodiments, before responding to a mode selection operation for a target output mode, the method may further include: in response to a start-up operation for a holographic audio function, calling up a mode selection interface; and receiving a mode selection operation for a target output mode in the mode selection interface. Exemplarily, the mode selection interface may select the smart mode by default.

[0055] In some embodiments, each mode corresponds to one or more scenes, and different scenes correspond to different preference settings in actual use. For example, if a user wants to watch a movie, then the "video" audio source may need to occupy a better position. If a user wants to listen to music or play games, there may be similar requirements. After selecting a scene mode, the spatial position relationship and other configuration information of multiple audio sources in the target scene of the target output mode can be set with one click.

[0056] In some embodiments, the scene of the target output mode includes at least one of the following: a default scene and a first scene. The default scene can be understood as a reasonable spatial position relationship designed for the overall multi-sound source, and the first scene can be understood as a spatial position relationship that prefers the first sound source.

[0057] Figure 2 The interface display diagram of the scene selection in the embodiment of the present application is shown as follows Figure 1 ,like Figure 2 As shown, when the user turns on the holographic audio function, the smart mode is entered by default, and the scene selection items and the graphic display interface are displayed at the same time. The spatial position relationship of multiple sound sources for the first scene of the smart mode can be displayed on the graphic display interface.

[0058] Figure 3 The interface display diagram of the scene selection in the embodiment of the present application is shown as follows Figure 2 ,like Figure 3 As shown, the user clicks Figure 2The scene selection item in the scene selection menu starts the scene selection of the smart mode, and calls up the scene selection interface. The scene selection interface displays multiple scenes that can be selected in the smart mode, for example, default scenes, music scenes, game scenes, cinema scenes, and custom scenes, etc. The custom scene is a scene created by the user. The user implements the scene selection operation by clicking on a scene.

[0059] In actual applications, the scene selection interface can also be displayed directly after the mode is selected. Figure 2 The interface shown directly displays multiple scenes that can be selected in the smart mode. The graphic display interface can also be displayed after the scene is selected.

[0060] In some embodiments, the method further includes: acquiring a scene selection operation collected by a user input unit, or generating a scene selection operation according to a preset scene selection strategy. That is, the scene selection operation can be manually selected by the user or automatically generated according to the scene selection strategy.

[0061] Exemplarily, the scene selection strategy includes: when the timer of the first scene is reached, a scene selection operation of the second scene is generated, and the target output mode is switched from the first scene to the second scene. The default scene generally used by users is to select the theater scene when they need to watch a movie, and then add a 2-hour timer setting, and automatically switch back to the default scene after 2 hours, so that users do not need to manually switch scenes frequently, thereby improving user experience.

[0062] Step 102: Displaying visual identifiers of multiple sound sources at different spatial positions of a graphic display interface according to the position information of the multiple sound sources.

[0063] Exemplarily, the multiple sound sources include at least a first sound source and a second sound source, and the graphical display interface includes a visual identifier of the first sound source displayed at a first position, and a visual identifier of the second sound source displayed at a second position, and the first position and the second position are different. The visual identifiers of the various sound sources in the graphical display interface are distributed around the center position of the sound source space. The sound source space can be the geometric center of the three-dimensional space. In practical applications, the center position can be the user position in the space.

[0064] In some embodiments, the sound source space may be a spherical three-dimensional space, a hemispherical three-dimensional space, a cubic three-dimensional space, etc., and the graphical display interface displays the three-dimensional spatial position relationship of multiple sound sources, and the position information of the corresponding sound sources may include three-dimensional coordinates. In other embodiments, the sound source space may be a two-dimensional space, and the graphical display interface displays the two-dimensional spatial position relationship of multiple sound sources, and the corresponding position information may include two-dimensional coordinates.

[0065] In some embodiments, the multiple sound sources include a focal sound source and a non-focal sound source. The visual identifiers of the non-focal sound sources are distributed around the center position of the sound source space. The focal sound source position may be a position with a certain distance and azimuth relative to the center position. For example, the focal sound source position may be at a certain distance from the center position along the Y-axis direction. The focal sound source position may also be the center position, that is, the focal sound source position may coincide with the center position. The sound source with the focal sound source position is called the focal sound source. When multiple sound sources play sounds at the same time, there is only one focal sound source.

[0066] In some embodiments, a central visual identifier is displayed at the center of the graphical display interface, and the central visual identifier has directionality. Exemplarily, the central visual identifier may be an arrow, and the arrow points to the direction of the user's head. The central visual identifier may also be a user identifier. The central visual identifier with directionality enables the user to quickly and accurately perceive the position of each sound source relative to the user.

[0067] In some embodiments, the method may further include: determining the distance and / or azimuth of the sound source relative to the center position based on the audio characteristics of the sound source; and determining the position information of each sound source based on the distance and / or azimuth of each sound source relative to the center position.

[0068] The smaller the distance between each sound source and the center position, the louder and clearer the sound will be. Conversely, the smaller the sound volume, the blurrier it will be. When the distance from the center position is the same, the playback effect of the sound source at different azimuths will also be different. In other words, the playback effect of each sound source is affected not only by the distance, but also by the azimuth. By adjusting the distance and azimuth of each sound source relative to the center position, the playback effect of each sound source can be changed.

[0069] In some embodiments, when the sound source space is a three-dimensional space, the sound source with a first audio characteristic is located in the first direction or the second direction of the center position, and the sound source with a second audio characteristic is located at a position having a certain angle relative to the first direction or the second direction of the center position.

[0070] In some embodiments, when the sound source space is a three-dimensional space, the sound source with a first audio characteristic is located in the first direction, the second direction or the third direction of the center position, and the sound source with a second audio characteristic is located at a position having a certain angle relative to the first direction, the second direction or the third direction of the center position.

[0071] Exemplarily, the first direction, the second direction and the third direction correspond to the horizontal direction, the vertical direction and the depth direction respectively, and the first audio feature can be a rich and diverse audio feature. Such one or more sound sources are set in the horizontal direction, the vertical direction and the depth direction of the focus sound source, which has a better sound effect. The second audio feature can be a single audio feature. Such one or more sound sources are set at a position with a certain angle relative to a specific direction of the focus sound source, which can reduce interference with other sound sources on the basis of ensuring its sound effect, so that the sound source distribution in the multi-sound source space is balanced.

[0072] Figure 4 FIG. 1 is a schematic diagram showing a graphical display of the spatial position relationship of multiple sound sources in an embodiment of the present application. Figure 4 As shown, the graphical display interface displays the three-dimensional spatial position relationship of multiple sound sources, and the three-dimensional space takes a hemispherical three-dimensional space as an example. According to the three-dimensional coordinates of each sound source, the visual identification of each sound source is displayed in the hemispherical three-dimensional space, and the user identification is displayed at the center of the hemispherical space. The visual identification of each sound source is distributed around the center, and the visual identification of different sound sources is different. Figure 4 The visual recognition and spatial location of sound sources such as incoming ringtones, alarms, game voices, videos, audio books, music, notifications and navigation are given as examples.

[0073] In some embodiments, the method further includes: in response to a play operation on the first sound source, displaying a visual identifier of the first sound source in a play state at a first position of the graphical display interface.

[0074] Exemplarily, in response to a play operation on the first sound source, the visual identifier of the first sound source is adjusted from the unplayed state to the played state in the graphic display interface; in response to a stop play operation on the first sound source, the visual identifier of the first sound source is adjusted from the played state to the unplayed state in the graphic display interface. That is, when the sound source is in the unplayed state, the visual identifier of the unplayed state is displayed at the default position of the graphic display interface, and when the sound source is in the playing state, the visual identifier of the playing state is displayed at the default position of the graphic display interface, and the visual identifier of the unplayed state is different from the visual identifier of the playing state.

[0075] Exemplarily, when the first sound source is in a playing state, the visual identifier of the first sound source is superimposed with an identifier representing the playing state, otherwise the identifier representing the playing state is removed. The identifier representing the playing state may be a dynamic identifier or a static identifier.

[0076] In some embodiments, the playing state includes a circular sound wave dynamic mark or a fan-shaped sound wave dynamic mark.

[0077] Figure 5 A graphical display of the audio source playback status in the embodiment of the present application Figure 1 .like Figure 5 As shown, when the music and navigation enter the playing state, a circular sound wave dynamic logo is superimposed on the music symbol and the navigation symbol.

[0078] Exemplarily, in response to a play operation on a first sound source, a visual identifier of the first sound source is displayed at a first position on the graphical display interface; in response to a stop play operation on the first sound source, the visual identifier of the first sound source is deleted on the graphical display interface. In other words, the visual identifier of the sound source is displayed at a default position on the graphical display interface only when the sound source enters the play state, otherwise it is not displayed.

[0079] Figure 6 A graphical display of the audio source playback status in the embodiment of the present application Figure 2 .like Figure 6 As shown in the figure, when music, navigation, alarm and notification enter the playing state, the music symbol, navigation symbol, alarm symbol and notification symbol will be displayed in the graphic display interface, and other sound sources that have not entered the playing state will not be displayed. For scenes with many sound sources, the display effect of the spatial position relationship of the sound sources can be guaranteed.

[0080] In some embodiments, the method further includes: in response to a position adjustment operation for the visual identifier of the first sound source, adjusting the visual identifier of the first sound source from a first position to a second position on the graphic display interface; wherein the second position is different from the first position.

[0081] It should be noted that the position adjustment operation is used to adjust the position information of the first sound source. The first sound source is any sound source displayed on the graphic display interface, and the position adjustment method for the first sound source can be understood as the position adjustment method for each sound source.

[0082] The first position can be understood as being determined based on the position information of the first sound source before adjustment, and the second position can be understood as being determined based on the position information of the first sound source after adjustment. The second position can be any position other than the first position in the multi-sound source space displayed in the graphical interface. The second position can include the center position, and can also include the position of other sound sources, that is, swapping the positions of the first sound source and the other sound sources.

[0083] The position adjustment operation may be a continuous operation, so that the position change process of the visual identifier of the first sound source is displayed on the graphic display interface. In some embodiments, the position adjustment operation may include a sliding operation on the visual identifier of the first sound source on the graphic display interface. Figure 7 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 1 ,like Figure 7As shown, the display area includes a mode selection interface and a graphic display interface. The mode selection interface includes the selection of smart mode and custom mode. The graphic display interface includes a hemispherical three-dimensional space, which includes visual identifiers of multiple sound sources and a central visual identifier. The user clicks on the visual identifier of a sound source to select it, and adjusts the sound source position information by sliding the visual identifier. The graphic display interface also includes a "start audition" button, and the user can control the output effect of multiple sound sources under the current spatial position relationship by operating this button.

[0084] In some embodiments, the method further includes: displaying a coordinate adjustment item of the first sound source on a parameter adjustment interface; in response to a coordinate adjustment operation on the coordinate adjustment item of the first sound source, the visual identifier of the first sound source is adjusted from a first position to a second position on a graphic display interface; wherein the second position is different from the first position.

[0085] In some embodiments, the parameter adjustment interface and the graphic display interface are different display areas. That is, the display area is divided into the graphic display interface and the parameter adjustment interface, and the position adjustment operation can be one of the following: a sliding operation on a visual identifier in the graphic display interface, a coordinate adjustment on the position information of the parameter adjustment interface, or a sliding operation on a visual identifier in the graphic display interface and a coordinate adjustment item of the parameter adjustment interface.

[0086] Exemplarily, the coordinate adjustment item of the parameter adjustment interface includes three slide bars for adjusting the coordinates in three directions, and the coordinate adjustment operation includes the dragging operation of any slide bar. The three slide bars are arranged in sequence in the horizontal or vertical direction on the parameter adjustment interface, and the slide bar may also include a slider, and the coordinate adjustment can be achieved by dragging the slider. Exemplarily, the coordinate adjustment item may also include an input box for the coordinates in three directions, and the coordinates in the output box may be modified to achieve position adjustment.

[0087] Figure 8 The interface display diagram of the custom mode in the embodiment of the present application is shown as follows Figure 2 ,like Figure 8As shown, the display area includes a mode selection interface, a graphic display interface and a parameter adjustment interface. The mode selection interface includes the selection of smart mode and custom mode. The graphic display interface includes a hemispherical three-dimensional space, which includes visual identifiers of multiple sound sources and a central visual identifier. The user clicks on the visual identifier of a sound source to select it, and adjusts the sound source position information by sliding the visual identifier. The graphic display interface also includes a "start audition" button, and the user can control the output effect of multiple sound sources under the current spatial position relationship by operating this button. The parameter adjustment interface includes a sound source selection item and three coordinate sliding bars. The user clicks on a sound source selection item to call up a list of selection items and selects an audio from it. At this time, adjusting the three position coordinates in the position information is to adjust the position of the selected audio.

[0088] In some embodiments, the parameter adjustment interface is displayed in a floating window on the graphic display interface. That is, the parameter adjustment interface can be displayed in a floating window on the graphic display interface without affecting the graphic display interface.

[0089] In some embodiments, the method further includes: in response to a selection operation for the visual identifier of the first sound source, calling up a parameter adjustment interface. In response to a mode selection operation for a multi-source target output mode, only the graphic display interface may be displayed in the entire display area first, and when position adjustment or coordinate adjustment is required, the parameter adjustment interface is called up. The parameter adjustment interface and the graphic display interface are in different display areas; or, the parameter adjustment interface is displayed in a floating window on the graphic display interface.

[0090] like Figure 7 As shown, the entire display area only displays the graphic display interface. After performing the selection operation on the music symbol, the parameter adjustment interface is called up and the display result can be as follows Figure 8 As shown, the parameter adjustment interface and the graphic display interface are different display areas. The display results can also be Fig. 9 As shown, the parameter adjustment interface is displayed as a floating window on the graphic display interface. After the adjustment is completed, close the parameter adjustment interface and restore to Figure 7 .

[0091] In some embodiments, displaying the coordinate adjustment item of the first sound source in the parameter adjustment interface includes: in response to a selection operation on the visual identifier of the first sound source, the coordinate adjustment item of the preset sound source in the parameter adjustment interface is adjusted to the coordinate adjustment item of the first sound source.

[0092] In some embodiments, the parameter adjustment interface also includes a sound source selection item, and a coordinate adjustment item of the first sound source is displayed on the parameter adjustment interface, including: in response to a selection operation on the first sound source in the sound source selection item, the coordinate adjustment item of the preset sound source in the parameter adjustment interface is adjusted to the coordinate adjustment item of the first sound source.

[0093] In some embodiments, the parameter adjustment interface further includes at least one of the following: a volume adjustment item. The adjustment item may include any one or more parameter adjustment methods such as a slider, an input box, and a selection item. Only the volume adjustment item of the selected sound source may be displayed, or the volume adjustment items of multiple sound sources may be displayed.

[0094] In some embodiments, before responding to the position adjustment operation for the visual identifier of the first sound source, the method further includes: responding to the selection operation for the visual identifier of the first sound source, or responding to the selection operation for the first sound source in the sound source selection item, the visual identifier of the first sound source is adjusted from the first display state to the second display state on the graphic display interface; wherein the visual identifiers of the first display state and the second display state are different. Exemplarily, the selection operation can be a click operation on the visual identifier of the first sound source on the graphic display interface.

[0095] That is to say, depending on whether the user manually selects the sound source, the sound source is divided into a selected state (corresponding to the first display state of the visual identification) and an unselected state (corresponding to the second display state of the visual identification). Different display states are used to distinguish whether the sound source is selected for position adjustment, thereby realizing a visual display of the selected sound source. Fig.10 Schematic diagram of a graphical display when a sound source is selected in an embodiment of the present application, such as Fig.10 As shown in the figure, the music symbol is selected, and only the surface texture of the music symbol changes, while the texture of other sound source symbols remains the same as when they were not selected. Figures 7 to 10 The interface display method for position adjustment in the custom mode is shown, and the same or similar interface display method can also be used for the smart mode.

[0096] Fig.11 Schematic diagram of visual identification of each sound source in different display states in the embodiment of the present application, such as Fig.11 As shown in the figure, it is divided into selected state and unselected state according to whether the user manually selects the audio; it is divided into playing state and unplayed state according to whether the current audio is playing. The playing state is a graphic superimposed with the playing sound wave effect logo, and both the selected and unselected states will be superimposed with the playing sound wave effect logo.

[0097] By adopting the above technical solution, the multi-source output mode is divided into different usage scenarios according to actual needs, and the virtual spatial positions of multiple sound sources are configured for each scenario, so that the multi-source data streams do not interfere with each other and are independently controllable, and provide multi-source playback effects corresponding to the needs for different scenarios. The complex spatial position relationship is intuitively displayed through a visual graphic display interface, which helps users quickly understand the spatial position relationship of multiple sound sources in different scenarios, which is conducive to the application and promotion of holographic audio technology. Furthermore, the graphical display interface is conducive to the rapid and accurate adjustment of the configuration information of the sound source in different scenarios (such as position and priority, etc.), so as to achieve personalized customization for the output of multiple sound sources.

[0098] In order to better reflect the purpose of this application, based on the above embodiments of this application, Fig.12 As shown, the method specifically includes:

[0099] Step 201: In response to a scene selection operation for a target scene in a multi-sound source target output mode, position information of multiple sound sources in the target scene is obtained.

[0100] Step 202: Displaying visual identifiers of multiple sound sources at different spatial positions of a graphic display interface according to the position information of the multiple sound sources.

[0101] Step 203: In response to a first style selection operation for a target style of a target scene, obtaining rendering information of the target style; wherein the rendering information includes rendering information of a target graphic style.

[0102] The first style selection operation is used to select a target style from multiple styles for a target scene, the target style including a target graphic style, and the visual identification of the sound source of the graphic display interface is adjusted according to rendering information of the target graphic style.

[0103] In some embodiments, before responding to a first style selection operation for a target style of a target scene, the method further includes: in response to a style selection start operation for the target scene, calling out a style selection interface, and displaying visual identifiers of multiple styles on the style selection interface.

[0104] In some embodiments, the rendering information further includes rendering information of a target sound effect style, and the method further includes: according to the rendering information of the target sound effect style, the current sound effect of at least one sound source in the target scene is adjusted to the target sound effect style. The target style includes the target sound effect style, and according to the rendering information of the target sound effect style, the sound effect style of the sound source is adjusted.

[0105] Step 204: According to the rendering information of the target graphic style, the visual identification of at least one sound source in the target scene is adjusted from the current graphic style to the target graphic style on the graphic display interface.

[0106] In some embodiments, when the target style is a preset style, obtaining rendering information of the target style includes: obtaining rendering information of all sound sources in the preset style. According to the rendering information of the target graphic style, the visual identification of all sound sources in the target scene is adjusted from the current graphic style to the target graphic style in the graphic display interface. That is, the graphic style of all sound sources in the graphic display interface can be adjusted through the first style selection operation, and the sound effect style of all sound sources can be adjusted.

[0107] In some embodiments, when the target style is a custom style, obtaining rendering information of the target style includes: in response to a second style selection operation for the first sound source, obtaining rendering information of the first sound source in the custom style. According to the rendering information of the first sound source in the custom style, the visual identification of the first sound source in the target scene is adjusted from the current graphic style to the target graphic style in the graphic display interface. That is, when the custom style is selected through the first style selection operation, further, the style adjustment is performed separately for the selected first sound source according to the second style selection operation. Among them, the sound effect rendering can be implemented by accessing a third-party sound effect algorithm.

[0108] Fig.13 The interface display diagram of the style selection in the embodiment of the present application is shown as follows Figure 1 ,like Fig.13 As shown, when the user turns on the holographic audio function, the smart mode is entered by default, and scene selection items, style selection items and a graphic display interface are displayed at the same time. The graphic display interface can display the spatial position relationship of multiple sound sources for the first scene of the smart mode.

[0109] Fig.14 The interface display diagram of the style selection in the embodiment of the present application is shown as follows Figure 2 ,like Fig.14 As shown, the user clicks Fig.13 The style selection item in the style selection starts the style selection of the smart mode and calls up the style selection interface. The style selection interface displays a variety of styles that can be selected in the smart mode, for example, default, realistic, flat, other and custom styles, etc. Custom style is a scene created by the user for part or all of the audio. The user clicks on a certain style to select the style. For example, if the realistic style is selected, all visual icons in the graphical display interface will switch to the corresponding style. The user can also choose to add a custom style of their own preference and customize the style of each audio source, such as setting music and games to the default style, setting calls to realistic, and setting alarms to flat styles. The style selection can be set for any one of them separately, or it can be effective for all modes.

[0110] The above technical solution can intuitively display complex spatial position relationships through a visual graphic display interface, helping users quickly understand the spatial position relationship of multiple sound sources in different scenes, which is conducive to the application and promotion of holographic audio technology. Users can freely choose the style of each scene to provide a graphic display interface that meets the user's aesthetic preferences, as well as sound source playback effects that meet their auditory preferences, and achieve personalized customization for multiple sound source output.

[0111] In order to better reflect the purpose of the present application, based on the above embodiments of the present application, the target output mode is further illustrated by taking the intelligent mode of changing the sound source position based on the preset position change strategy as an example, such as Fig.15 As shown, the method specifically includes:

[0112] Step 301: In response to a scene selection operation for a target scene in the smart mode, location information of multiple sound sources in the target scene is obtained.

[0113] Step 302: Displaying visual identifiers of multiple sound sources at different spatial positions of a graphic display interface according to the position information of the multiple sound sources.

[0114] In some embodiments, the method further includes: in response to a position adjustment operation for the visual identifier of the first sound source, adjusting the visual identifier of the first sound source from a first position to a second position on the graphic display interface; wherein the second position is different from the first position.

[0115] In some embodiments, the method further includes: displaying a coordinate adjustment item of the first sound source on a parameter adjustment interface; in response to a coordinate adjustment operation on the coordinate adjustment item of the first sound source, the visual identifier of the first sound source is adjusted from a first position to a second position on a graphic display interface; wherein the second position is different from the first position.

[0116] In some embodiments, when the target output mode is an intelligent mode for changing the position of the sound source based on a preset position change strategy, the second position is the position of the visual identifier of the second sound source in the graphical display interface. Fig.16 Schematic diagram of the sound source position adjustment in the intelligent mode in the embodiment of the present application. Fig.16 As shown, the first sound source is music, the second sound source is an alarm clock, and the default positions of the music and the alarm clock are swapped.

[0117] In smart mode, multiple audio sources include focus audio sources and non-focus audio sources. The position information of each audio source can be arranged in different combinations of audio source positions to perform an auditory test of the audio, thereby determining the position with the best audio effect. When using smart mode for multi-source output, each audio is not fixed at the default position, but changes accordingly following the position change strategy.

[0118] The focus sound source position can also be called (Center position). The focus sound source position can be a position with a certain distance and azimuth relative to the center position. For example, the focus sound source position can be at a certain distance from the center position along the Y-axis direction. The focus sound source position can also be the center position, that is, the focus sound source position can coincide with the center position. The sound source with the focus sound source position is called the focus sound source. When multiple sound sources play sounds at the same time, there is only one focus sound source. In actual applications, if the audio output device is a multi-channel output, the focus sound source position can also include multiple focus sound sources corresponding to different channels at different positions.

[0119] In some embodiments, in response to a first style selection operation of a target style for a target scene, rendering information of the target style is obtained; wherein the rendering information includes rendering information of a target graphic style; based on the rendering information of the target graphic style, a visual identifier of at least one sound source in the target scene is adjusted from a current graphic style to a target graphic style in a graphic display interface.

[0120] In some embodiments, before responding to a first style selection operation for a target style of a target scene, the method further includes: in response to a style selection start operation for the target scene, calling out a style selection interface, and displaying visual identifiers of multiple styles on the style selection interface.

[0121] In some embodiments, the rendering information further includes rendering information of a target sound effect style, and the method further includes: according to the rendering information of the target sound effect style, the current sound effect of at least one sound source in the target scene is adjusted to the target sound effect style.

[0122] In some embodiments, when the target style is a preset style, obtaining rendering information of the target style includes: obtaining rendering information of all sound sources in the preset style. According to the rendering information of the target graphic style, the visual identification of all sound sources in the target scene is adjusted from the current graphic style to the target graphic style in the graphic display interface.

[0123] In some embodiments, when the target style is a custom style, obtaining rendering information of the target style includes: in response to a second style selection operation for the first sound source, obtaining rendering information of the first sound source in the custom style.

[0124] Step 303: In response to the play operation on the first sound source, a target priority ranking list of multiple sound sources in the target scene is obtained.

[0125] Different scenes of the smart mode correspond to different priority ranking lists. In some embodiments, the scenes of the smart mode include at least one of the following: a default scene and a first scene; wherein the priority of the first sound source in the first scene is higher than the priority of the first sound source in the default scene.

[0126] In some embodiments, the scene of the smart mode also includes: a custom scene, and the method may also include: in response to the priority configuration operation under the custom scene, obtaining the priority sorting sequence of multiple sound sources under the custom scene; wherein the priority of the second sound source in the custom scene is higher than the priority of the second sound source in the default scene.

[0127] That is to say, the priority of multiple audio sources in a custom scene is configured by the user. In actual application, the user can make adjustments based on the priority sorting list of the default scene, or completely customize it.

[0128] For example, the priority ranking list of each scene in smart mode is as follows:

[0129] Default scenario: Priority is set to call > ringtone > alarm > game > voice call > video > audiobook > music

[0130] Music scene: Increase the priority of music and home rendering, and set the priority to call > incoming ringtone > music > alarm > game > voice call > video > audiobook

[0131] Game scenario: Increase the priority of games and home rendering, and set the priority to call > game > incoming ringtone > alarm > voice call > video > audiobook > music

[0132] Cinema scene: Increase the priority of video and home rendering, and set the priority to call > ringtone > video > alarm > game > voice call > audiobook > music

[0133] Custom scenes: Users can create their own scenes and set the home position and priority of each audio source.

[0134] It should be noted that after the user selects a scene in a certain scene, the user can also re-edit the settings, and the edited mode or the scene in this mode can also be reset to the initial setting state.

[0135] Step 304: According to the priority and position change strategy of the first sound source in the target priority sorting list, the target position information of the first sound source is determined from the position information of the first sound source and the position information of the preset focus sound source.

[0136] In some embodiments, the position change strategy may include: when there is no focus sound source at the focus sound source position, or when there is a focus sound source at the focus sound source position and the priority of the first sound source is higher than the priority of the focus sound source, determining the target position information of the first sound source as the position information of the focus sound source; when there is a focus sound source at the focus sound source position and the priority of the first sound source is lower than the priority of the focus sound source, determining the target position information of the first sound source as the position information of the first sound source; when there is a focus sound source at the focus sound source position and the priority of the first sound source is equal to the priority of the focus sound source, if the creation time of the first sound source is later than the creation time of the focus sound source, determining the target position information of the first sound source as the position information of the focus sound source.

[0137] That is to say, by judging whether the priority of the sound source entering the playback state is the highest priority, it is determined whether the current sound source should occupy the focus sound source. If the focus sound source position is empty, that is, there is no focus sound source, the current sound source directly occupies the focus sound source. If the focus sound source position is not empty, that is, there is a focus sound source, then when the current sound source has a higher priority than the focus sound source, the focus sound source is first restored from the focus sound source position to the default position, and then the current sound source enters the focus sound source position.

[0138] The playback operation can be to click the "Start Audition" button on the graphical display interface to audition the playback effects of some or all of the sound sources under the current spatial position relationship. The playback operation can also be implemented based on preset playback instructions when using the smart mode. In some embodiments, the sound source type includes transient sound sources and non-transient sound sources, and the priority of non-transient sound sources is higher than that of transient sound sources.

[0139] Among them, transient sound sources can be understood as sound sources that are triggered to play in a short period of time, and the playing time of such sound sources is relatively short. Exemplarily, transient sound sources include at least one of the following: notification, navigation, voice assistant, voice message. The same priority can be set for transient sound sources.

[0140] Non-transient sound sources can be understood as sound sources that are continuously played under certain conditions, and such sound sources have a longer playing time. Exemplarily, non-transient sound sources include at least one of the following: calls, incoming call ringtones, alarm clocks, games, voice calls, videos, audiobooks, and music.

[0141] For non-transient audio sources, different non-transient audio sources may also be prioritized. For example, in a default scenario, the priority order of non-transient audio is: call > incoming ringtone > alarm > game > voice call > video > audiobook > music.

[0142] It should be noted that different priorities may be set for transient sound sources, and the same priority may be set for non-transient sound sources.

[0143] For example, the priorities of the five sound sources are as follows: incoming ringtone > alarm > music > notification and navigation. Notification and navigation are transient sound sources, and their priorities are the same and lower than non-transient sound sources. Figures 17 to 19 FIG. 1 is a graphical display diagram of the position change strategy in the embodiment of the present application, and takes the focus sound source position as the center position as an example for illustration. Fig.17 As shown in the figure, when music is currently playing, the focus source position is called the Center position. When the Center position is empty, the music takes over the Center position. At this time, a call ringtone comes in. Because the call ringtone has a higher priority than the music, the music returns to its Home position and the call ringtone enters the Center position. Fig.18 Then the alarm rings and the incoming call ring ends. The alarm takes the center position, the incoming call ring returns to its home position, and the playing animation of the incoming call ring disappears. Fig.19 shown.

[0144] When the first sound source (first sound source) occupies the focus sound source position, and the priority of the second sound source (second sound source) is equal to the priority of the first sound source, the second sound source occupies the focus sound source position, and the first sound source returns to its default position. If the priority of the second sound source (second sound source) is lower than the priority of the first sound source, the second sound source is in its default position. Among them, the sound sources with the same priority can be the sound sources of the same sound source type.

[0145] Step 305: Displaying a visual identifier of the first sound source on a graphic display interface according to the target position information of the first sound source.

[0146] In some embodiments, the method may further include: when the target position information of the first sound source is the position information of the focus sound source, rendering the first sound source and the audio data according to the position information of the focus sound source to obtain rendering data; or, when the target position information of the first sound source is the position information of the first sound source, rendering the first sound source and the audio data according to the position information of the first sound source to obtain rendering data; and outputting the rendering data using an audio output device.

[0147] Exemplarily, the target position information and audio data of the first sound source are rendered based on the spatial audio rendering algorithm. Exemplarily, the core of the spatial audio rendering algorithm may be a head-related transfer function (HRTF), which is used to represent the effect of audio at different positions on the human ear, and the HRTF function parameters are determined according to the position information of each sound source, so that the audio data output at a specific position can be obtained with the help of the HRTF function.

[0148] In some embodiments, the method further includes: in response to the priority adjustment operation for the first sound source, the first sound source is adjusted from the first priority to the second priority in the target priority sorting list. That is, in the smart mode, the priority of different scenes is also adjusted by the user, so that the playback effect of each scene is in accordance with the user's preference.

[0149] In some embodiments, before responding to a priority adjustment operation for the first sound source, the method further includes: in response to a priority adjustment start operation for the first sound source, calling up a priority adjustment interface, and displaying a priority sort list of multiple sound sources in the target scene on the priority adjustment interface.

[0150] In some embodiments, the priority adjustment interface and the graphic display interface are different display areas; or, the priority adjustment interface is displayed as a floating window on the graphic display interface; or, the priority adjustment interface and the graphic display interface are two interfaces of the display area.

[0151] With the above technical solution, in smart mode, the best position is intelligently matched according to the priority and position change strategy of each sound source, and the playback effect of priority audio is improved on the basis of achieving the playback effect of sound source separation. The default position and priority of sound sources in different scenes can also be adjusted, and personalized customization can also be achieved for smart mode.

[0152] In order to better reflect the purpose of the present application, based on the above embodiments of the present application, the target output mode is further illustrated by taking the custom mode as an example. Fig. 20 As shown, the method specifically includes:

[0153] Step 401: In response to a scene selection operation for a target scene in a custom mode, position information of multiple sound sources in the target scene is obtained.

[0154] It should be noted that when the target output mode is the sound source position customization mode, the position of the visual identifier of at least one sound source is different in different scenes of the customization mode.

[0155] In some embodiments, the scenes of the custom mode include at least one of the following: a third scene and a fourth scene; wherein in the third scene, a visual identifier of a third sound source is displayed at a preset position of the graphic display interface; and in the fourth scene, a visual identifier of a fourth sound source is displayed at a preset position of the graphic display interface. The preset position may be any position in the sound source space, and exemplarily, the preset position is a focus sound source position or a center position.

[0156] In actual applications, the third scene can be an output scene for the third sound source, giving priority to ensuring the playback effect of the third sound source and its related sound sources, and the fourth scene can be an output scene for the fourth sound source, giving priority to ensuring the playback effect of the fourth sound source and its related sound sources.

[0157] like Fig.21 As shown, the preset position may be a position a certain distance in front of the user, and the game voice occupies this position in the third scenario. Fig. 22 , the sound source occupies this position in the fourth scene.

[0158] Step 402: Displaying visual identifiers of multiple sound sources at different spatial positions of a graphic display interface according to the position information of the multiple sound sources.

[0159] In some embodiments, the method further includes: in response to a position adjustment operation for the visual identifier of the first sound source, adjusting the visual identifier of the first sound source from a first position to a second position on the graphic display interface; wherein the second position is different from the first position.

[0160] In some embodiments, the method further includes: displaying a coordinate adjustment item of the first sound source on a parameter adjustment interface; in response to a coordinate adjustment operation on the coordinate adjustment item of the first sound source, the visual identifier of the first sound source is adjusted from a first position to a second position on a graphic display interface; wherein the second position is different from the first position.

[0161] Step 403: In response to a play operation on a first sound source, obtaining position information of the first sound source;

[0162] Step 404: Rendering the audio data of the first sound source according to the position information of the first sound source to obtain rendering data;

[0163] Step 405: Output the rendering data using an audio output device.

[0164] FIG. 23A to FIG. 23E FIG. 1 is a schematic diagram of the operation flow of multi-source output control in an embodiment of the present application. Fig.23A As shown in the figure, the user turns on the holographic audio function and enters the graphic display interface of the smart mode by default. In the graphic display interface of the smart mode, the position change strategy of the smart mode can be graphically displayed, and the Home position and / or priority of each sound source can be adjusted. After the adjustment is completed, exit the current interface, the smart mode takes effect, and multi-audio playback is performed according to the preset position change strategy to realize the holographic audio function.

[0165] like Fig. 23BAs shown, the user selects the custom mode and switches to the graphic display interface of the custom mode. In the custom mode, the graphic display interface and the parameter adjustment interface are displayed. The incoming call ringtone is selected by default. The user can adjust the position by sliding the incoming call ringtone in the graphic display, or adjust the position coordinates in the left, right, front, back, and up and down directions in the parameter adjustment interface by dragging the slide bar. The distance between each audio and the Center position affects the sound volume, which is louder when closer and smaller when farther away.

[0166] like Fig.23C As shown, the switching can be achieved by clicking on the music symbol, or by selecting items in the parameter adjustment interface.

[0167] like Fig.23D As shown, after the music enters the selected state, the user can adjust the position by sliding the music in the displayed graphic, or adjust the position coordinates in the left and right, front and back, and up and down directions in the parameter adjustment interface by dragging the slide bar.

[0168] like Fig.23E As shown, after the adjustment is completed, exit the current interface, the custom mode takes effect, and multiple audios are played according to the user-defined position information to realize the holographic audio function.

[0169] When the visual graphic display interface intuitively displays the complex spatial position relationship, the graphics engine will render different display effects according to different user input operations after loading each sound source model. For example, the sound source model rendering can use the traditional physically based rendering (Physically Base Rendering, PBR) algorithm to present the authenticity of the model color, and different display effects can be achieved through customized materials.

[0170] In some embodiments, rendering may be performed only when the user input changes, the interface may be redrawn and the interface cache may be updated. Otherwise, the interface cache does not need to be updated and the last rendering result may be used directly for presentation. For example, the interface cache may be updated when any of the position, selection and playback changes, and the interface cache may not be updated when none of them changes.

[0171] It should be noted that FIG. 23A to FIG. 23E It can also include scene selection items and style selection items. The scene selection items are used to select scenes for the smart mode and the custom mode, and the style selection items are used to select styles for the smart mode and the custom mode.

[0172] The interface display implementation method of the embodiment of the present application mainly involves the interaction between the interface layer (referred to as "UI layer") and the holographic audio service layer (referred to as "service layer"). Fig.24Schematic diagram of the implementation process of an interface display method in an embodiment of the present application, such as Fig.24 As shown, the specific process is as follows:

[0173] S1: UI layer binds holographic audio service;

[0174] S2: The UI layer reads information from the service layer, including scene selection and style selection, obtains the location information and priority of each audio source in each scene, as well as the currently selected target scene and style, and displays the icon of each audio source on the graphic display interface according to the location and graphic style of each audio source.

[0175] The read information may also include function switch (controls whether the holographic audio function is effective), mode selection (smart mode and custom mode), scene position (spatial position of each sound source), playback status (whether each audio source is playing), etc.

[0176] S3: The user selects the scene and style, etc., and the user selection is input to the service layer to make the user input effective.

[0177] The beneficial effects of the technical solution provided by the embodiments of the present application specifically include:

[0178] 1. Use holographic audio technology for multi-source output. When multiple sound sources are played simultaneously, they appear in different spatial orientations, creating an immersive three-dimensional auditory experience and avoiding the mutual interference problem that occurs when multiple sound sources are played simultaneously.

[0179] 2. For different output modes, multiple audio combination settings are provided to facilitate users to switch between different scenes with one click. Users can also set custom scenes and styles, which can also be switched with one click;

[0180] 3. Provide audio settings in various styles to meet users' diverse visual and auditory experiences.

[0181] To implement the method of the embodiment of the present application, based on the same inventive concept, the embodiment of the present application also provides a multi-source output control device, such as Fig.25 As shown, the multi-source output control device 250 includes:

[0182] An acquisition unit 2501 is used to acquire position information of multiple sound sources in a target scene in response to a scene selection operation for a target scene in a multi-sound source target output mode;

[0183] The graphic display unit 2502 is used to display the visual identifications of the multiple sound sources at different spatial positions of the graphic display interface according to the position information of the multiple sound sources.

[0184] In some embodiments, the graphic display unit 2502 is further used to respond to a position adjustment operation of the visual identifier of the first sound source, and the visual identifier of the first sound source is adjusted from a first position to a second position in the graphic display interface; wherein the second position is different from the first position.

[0185] In some embodiments, the graphic display unit 2502 is also used to display the coordinate adjustment item of the first sound source in the parameter adjustment interface; in response to the coordinate adjustment operation of the coordinate adjustment item of the first sound source, the visual identification of the first sound source is adjusted from the first position to the second position in the graphic display interface; wherein the second position is different from the first position.

[0186] In some embodiments, the parameter adjustment interface and the graphic display interface are different display areas; or, the parameter adjustment interface is displayed in a floating window on the graphic display interface.

[0187] In some embodiments, when the target output mode is an intelligent mode for changing the position of the sound source based on a preset position change strategy, the second position is the position of the visual identifier of the second sound source in the graphical display interface.

[0188] In some embodiments, the acquisition unit 2501 is also used to obtain rendering information of the target style in response to a first style selection operation for the target style of the target scene; wherein the rendering information includes rendering information of the target graphic style; the graphic display unit 2502 is also used to adjust the visual identification of at least one sound source in the target scene from the current graphic style to the target graphic style in the graphic display interface according to the rendering information of the target graphic style.

[0189] In some embodiments, the rendering information also includes rendering information of a target sound effect style, and the multi-sound source output control device 250 also includes an audio processing unit for adjusting the current sound effect of at least one sound source in a target scene to the target sound effect style according to the rendering information of the target sound effect style.

[0190] In some embodiments, when the target style is a preset style, the acquisition unit 2501 is used to acquire rendering information of all sound sources in the preset style.

[0191] In some embodiments, when the target style is a custom style, the acquisition unit 2501 is used to obtain rendering information of the first sound source in the custom style in response to a second style selection operation for the first sound source.

[0192] In some embodiments, before responding to a first style selection operation for a target style for a target scene, the graphic display unit 2502 is further used to respond to a style selection start operation for the target scene, call out a style selection interface, and display visual identifiers of multiple styles on the style selection interface.

[0193] In some embodiments, when the target output mode is an intelligent mode that changes the position of the sound source based on a preset position transformation strategy, the graphic display unit 2502 is also used to obtain a target priority sorting list of multiple sound sources in the target scene in response to a playback operation on the first sound source; wherein different scenes of the intelligent mode correspond to different priority sorting lists; according to the priority and position transformation strategy of the first sound source in the target priority sorting list, the target position information of the first sound source is determined from the position information of the first sound source and the position information of the preset focus sound source; according to the target position information of the first sound source, the visual identification of the first sound source is displayed on the graphic display interface.

[0194] In some embodiments, the graphic display unit 2502 is further configured to respond to a priority adjustment operation on the first audio source, whereby the first audio source is adjusted from a first priority to a second priority in the target priority sorting list.

[0195] In some embodiments, before responding to a priority adjustment operation for a first sound source, the graphic display unit 2502 is also used to respond to a priority adjustment start operation for the first sound source, call out a priority adjustment interface, and display a priority sort list of multiple sound sources in a target scene on the priority adjustment interface.

[0196] In some embodiments, the priority adjustment interface and the graphic display interface are different display areas; or, the priority adjustment interface is displayed as a floating window on the graphic display interface; or, the priority adjustment interface and the graphic display interface are two interfaces of the display area.

[0197] In some embodiments, the scenes of the smart mode include at least one of the following: a default scene and a first scene; wherein the priority of the first sound source in the first scene is higher than the priority of the first sound source in the default scene.

[0198] In some embodiments, the scene of the smart mode also includes: a custom scene, and the method also includes: in response to the priority configuration operation under the custom scene, obtaining the priority sorting sequence of multiple sound sources under the custom scene; wherein, the priority of the second sound source in the custom scene is higher than the priority of the second sound source in the default scene.

[0199] In some embodiments, the position change strategy includes: when there is no focus sound source at the focus sound source position, or when there is a focus sound source at the focus sound source position and the priority of the first sound source is higher than the priority of the focus sound source, determining the target position information of the first sound source as the position information of the focus sound source; when there is a focus sound source at the focus sound source position and the priority of the first sound source is lower than the priority of the focus sound source, determining the target position information of the first sound source as the position information of the first sound source; when there is a focus sound source at the focus sound source position and the priority of the first sound source is equal to the priority of the focus sound source, if the creation time of the first sound source is later than the creation time of the focus sound source, determining the target position information of the first sound source as the position information of the focus sound source.

[0200] In some embodiments, the audio processing unit is used to render the first sound source and the audio data according to the position information of the focus sound source to obtain rendering data when the target position information of the first sound source is the position information of the focus sound source; or to render the first sound source and the audio data according to the position information of the first sound source to obtain rendering data when the target position information of the first sound source is the position information of the first sound source; and output the rendering data using an audio output device.

[0201] In some embodiments, when the target output mode is a sound source position customization mode, the position of the visual identifier of at least one sound source is different in different scenes of the customization mode.

[0202] In some embodiments, the scenes of the custom mode include at least one of the following: a third scene and a fourth scene; wherein, in the third scene, a visual identifier of a third sound source is displayed at a preset position of the graphical display interface; and in the fourth scene, a visual identifier of a fourth sound source is displayed at a preset position of the graphical display interface.

[0203] In some embodiments, before responding to a scene selection operation for a target scene of a multi-source target output mode, the graphic display unit 2502 is also used to respond to a mode selection operation for the target output mode, bring up a scene selection interface for the target output mode; and receive a scene selection operation for the target scene in the scene selection interface.

[0204] In some embodiments, before responding to a mode selection operation for a target output mode, the graphic display unit 2502 is also used to respond to a start operation for a holographic audio function, bring up a mode selection interface; and receive a mode selection operation for the target output mode in the mode selection interface.

[0205] In practical applications, the above-mentioned device can be any electronic device that realizes the holographic audio function, or it can be a chip applied to an electronic device. In the present application, the device can realize the functions of multiple units through software, hardware, or a combination of software and hardware, so that the device can execute the multi-source output control method provided in any of the above embodiments. And the technical effects of each technical scheme of the device can refer to the technical effects of the corresponding technical scheme in the multi-source output control method, and this application will not go into details one by one.

[0206] The electronic devices implementing the holographic audio function described in this application may include mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), vehicle-mounted devices, wearable devices, etc.

[0207] Based on the hardware implementation of each unit in the above-mentioned multi-source output control device, the embodiment of the present application also provides a multi-source output control device, such as Fig.26 As shown, the multi-source output control device 260 includes: a processor 2601 and a memory 2602 configured to store a computer program that can be run on the processor;

[0208] The processor 2601 is configured to execute the method steps in the aforementioned embodiment when running a computer program.

[0209] Of course, in practical applications, Fig.26 As shown, each component in the multi-source output control device 260 is coupled together through a bus system 2603. It can be understood that the bus system 2603 is used to realize the connection communication between these components. In addition to the data bus, the bus system 2603 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, various buses are marked as bus system 2603 in the figure.

[0210] In practical applications, the processor may be at least one of an application-specific integrated circuit (ASIC), a digital signal processing device (DSPD), a programmable logic device (PLD), a field-programmable gate array (FPGA), a controller, a microcontroller, and a microprocessor. It is understandable that for different devices, the electronic device used to implement the functions of the processor may also be other, and the embodiments of the present application do not specifically limit this.

[0211] The above-mentioned memory can be a volatile memory (volatile memory), such as a random access memory (RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (ROM), a flash memory, a hard disk (HDD) or a solid-state drive (SSD); or a combination of the above-mentioned types of memory, and provide instructions and data to the processor.

[0212] Optionally, the multi-source output control device may be a chip, and the chip may further include an input interface, wherein the processor may control the input interface to communicate with other devices or chips, and specifically, may obtain information or data sent by other devices or chips.

[0213] Optionally, the chip may further include an output interface, wherein the processor may control the output interface to communicate with other devices or chips, and specifically, may output information or data to other devices or chips.

[0214] Optionally, the chip can be applied to the electronic device in the embodiments of the present application, and can implement the corresponding processes of the various methods in the embodiments of the present application. For the sake of brevity, they will not be described here.

[0215] In an exemplary embodiment, the embodiment of the present application further provides a computer-readable storage medium, such as a memory including a computer program, and the computer program can be executed by a processor of a multi-source output control device to complete the steps of the aforementioned method.

[0216] An embodiment of the present application also provides a computer program product, including computer program instructions.

[0217] Optionally, the computer program product can be applied to the multi-sound source output control device in the embodiments of the present application, and the computer program instructions enable the computer to execute the corresponding processes implemented by the multi-sound source output control device in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0218] The embodiment of the present application also provides a computer program.

[0219] Optionally, the computer program can be applied to the multi-sound source output control device in the embodiments of the present application. When the computer program is run on a computer, the computer executes the corresponding processes implemented by the multi-sound source output control device in the various methods of the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0220] It should be understood that in the embodiments of the present application, related data such as user information is involved. When the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0221] It should be understood that the terms used in the present application are only for the purpose of describing specific embodiments, but are not intended to limit the present application. The singular forms of "a", "said" and "the" used in the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in this article refers to and includes any or all possible combinations of one or more associated listed items. The expressions "having", "may have", "include" and "include", or "may include" and "may include" in this application can be used to indicate the presence of corresponding features (e.g., elements such as numerical values, functions, operations or components), but the presence of additional features is not excluded.

[0222] It should be understood that although the terms first, second, third, etc. may be used in this application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other and are not necessarily used to describe a specific order or sequence. For example, without departing from the scope of the present invention, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information.

[0223] The technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0224] In the several embodiments provided in the present application, it should be understood that the disclosed methods, devices and equipment can be implemented in other ways. The embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0225] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0226] In addition, all functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may be a separate unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0227] The above description is only a specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application.

Claims

1. A multi-source output control method, characterized in that: The method comprises: In response to a scene selection operation for a target scene of a multi-source target output mode, obtaining position information of multiple sound sources in the target scene; Visual identifiers of the multiple sound sources are displayed at different spatial positions of a graphic display interface according to the position information of the multiple sound sources.

2. The method according to claim 1, characterized in that The method further comprises: In response to a position adjustment operation for the visual identifier of the first sound source, the visual identifier of the first sound source is adjusted from the first position to the second position on the graphic display interface; wherein the second position is different from the first position.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: Display the coordinate adjustment items of the first sound source on the parameter adjustment interface; In response to a coordinate adjustment operation on the coordinate adjustment item of the first sound source, the visual identifier of the first sound source is adjusted from the first position to the second position on the graphic display interface; wherein the second position is different from the first position.

4. The method according to claim 3, characterized in that The parameter adjustment interface and the graphic display interface are in different display areas; or, the parameter adjustment interface is displayed in a floating window on the graphic display interface.

5. The method according to claim 3, characterized in that: When the target output mode is an intelligent mode for changing the position of the sound source based on a preset position change strategy, the second position is the position of the visual identifier of the second sound source in the graphical display interface.

6. The method according to claim 1, characterized in that The method further comprises: In response to a first style selection operation for a target style of the target scene, acquiring rendering information of the target style; wherein the rendering information includes rendering information of a target graphics style; According to the rendering information of the target graphic style, a visual identifier of at least one sound source in the target scene is adjusted from a current graphic style to the target graphic style on the graphic display interface.

7. The method according to claim 6, characterized in that The rendering information also includes rendering information of a target sound effect style, and the method further includes: According to the rendering information of the target sound effect style, the current sound effect of the at least one sound source in the target scene is adjusted to the target sound effect style.

8. The method according to claim 6 or 7, characterized in that: When the target style is a preset style, obtaining rendering information of the target style includes: Get the rendering information of all audio sources in the preset style.

9. The method according to claim 6 or 7, characterized in that: When the target style is a custom style, obtaining rendering information of the target style includes: In response to a second style selection operation for a first sound source, rendering information of the first sound source in the custom style is obtained.

10. The method according to claim 6, characterized in that Before the first style selection operation in response to the target style of the target scene, the method further includes: In response to a style selection start operation for the target scene, a style selection interface is called up, and visual identifiers of multiple styles are displayed on the style selection interface.

11. The method according to claim 1, characterized in that: When the target output mode is an intelligent mode for changing the sound source position based on a preset position change strategy, the method further includes: In response to a play operation on a first sound source, a target priority ranking list of the plurality of sound sources in the target scene is obtained; wherein different scenes of the smart mode correspond to different priority ranking lists; Determining target position information of the first sound source from position information of the first sound source and position information of a preset focus sound source according to the priority of the first sound source in the target priority sorting list and the position change strategy; A visual identifier of the first sound source is displayed on the graphic display interface according to the target position information of the first sound source.

12. The method according to claim 11, characterized in that The method further comprises: In response to a priority adjustment operation for the first audio source, the first audio source is adjusted from a first priority to a second priority in the target priority sorting list.

13. The method according to claim 12, characterized in that Before responding to the priority adjustment operation for the first audio source, the method further includes: In response to a priority adjustment start operation for the first sound source, a priority adjustment interface is called up, and a priority ranking list of the multiple sound sources in the target scene is displayed on the priority adjustment interface.

14. The method according to claim 13, characterized in that The priority adjustment interface and the graphic display interface are different display areas; or, the priority adjustment interface is displayed in a floating window above the graphic display interface; or, the priority adjustment interface and the graphic display interface are two interfaces of the display area.

15. The method according to claim 11, characterized in that The scenes of the smart mode include at least one of the following: a default scene and a first scene; Among them, the priority of the first sound source in the first scene is higher than the priority of the first sound source in the default scene.

16. The method according to claim 15, characterized in that The scenarios of the smart mode also include: custom scenarios, and the method also includes: In response to the priority configuration operation in the custom scene, obtaining a priority sorting sequence of the plurality of audio sources in the custom scene; Among them, the priority of the second sound source in the custom scene is higher than the priority of the second sound source in the default scene.

17. The method according to claim 11, characterized in that The position change strategy includes: In a case where there is no focus sound source at the focus sound source position, or in a case where there is a focus sound source at the focus sound source position and the priority of the first sound source is higher than the priority of the focus sound source, determining the target position information of the first sound source as the position information of the focus sound source; When there is a focus sound source at the focus sound source position and the priority of the first sound source is lower than the priority of the focus sound source, determining the target position information of the first sound source to be the position information of the first sound source; When there is a focus sound source at the focus sound source position and the priority of the first sound source is equal to the priority of the focus sound source, if the creation time of the first sound source is later than the creation time of the focus sound source, the target position information of the first sound source is determined to be the position information of the focus sound source.

18. The method according to claim 11, characterized in that The method further comprises: When the target position information of the first sound source is the position information of the focus sound source, rendering the first sound source and the audio data according to the position information of the focus sound source to obtain rendering data; Alternatively, when the target position information of the first sound source is the position information of the first sound source, the first sound source and the audio data are rendered according to the position information of the first sound source to obtain rendering data; The rendered data is outputted using an audio output device.

19. The method according to claim 1, characterized in that When the target output mode is a sound source position customization mode, the position of the visual identifier of at least one sound source is different in different scenes of the customization mode.

20. The method according to claim 19, characterized in that The scenes of the custom mode include at least one of the following: the third scene and the fourth scene; Wherein, in the third scenario, a visual identification of the third sound source is displayed at a preset position of the graphic display interface; In the fourth scenario, a visual identifier of the fourth sound source is displayed at the preset position of the graphic display interface.

21. The method according to claim 1, characterized in that Before the scene selection operation in response to the target scene of the multi-source target output mode, the method further includes: In response to a mode selection operation for the target output mode, calling out a scene selection interface for the target output mode; A scene selection operation for a target scene in the scene selection interface is received.

22. The method according to claim 21, characterized in that Before responding to the mode selection operation for the target output mode, the method further includes: In response to a start-up operation for the holographic audio function, calling out a mode selection interface; A mode selection operation for the target output mode in the mode selection interface is received.

23. A multi-source output control device, characterized in that: The device comprises: An acquisition unit, configured to acquire position information of multiple sound sources in the target scene in response to a scene selection operation for a target scene in a multi-sound source target output mode; The graphic display unit is used to display the visual identifications of the multiple sound sources at different spatial positions of the graphic display interface according to the position information of the multiple sound sources.

24. A multi-source output control device, characterized in that: The device comprises: a processor and a memory configured to store a computer program capable of being executed on the processor, Wherein, the processor is configured to execute the steps of the method described in any one of claims 1 to 22 when running the computer program.

25. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 22 are implemented.

Images