Audio media material arrangement method, arrangement device, electronic device and storage medium
By correlating the audio media material with the target audio output mapping relationship during the audio media material arrangement process, the problem of low audio material arrangement efficiency in the prior art is solved, and efficient audio media material arrangement is achieved.
Patent Information
- Application Number
- CN202211032358.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-26
- Publication Date
- 2025-08-05
- Estimated Expiration
- 2042-08-26
AI Technical Summary
During the audio material arrangement process, the existing technology needs to update the bound audio material and the changed physical sound card one by one, resulting in inefficient orchestration.
By configuring the audio media material in the media material area to the program editing area in the operation interface of the terminal device, and binding the target audio output mapping relationship in the attribute setting area, the association between the audio media material and the target audio output mapping relationship is realized. Only the target physical sound card information in the target audio output mapping relationship needs to be replaced.
The audio media material choreography process is simplified, the orchestration efficiency is improved, and the tedious operation of updating the binding one by one is avoided.
Smart Images

Figure CN115394312B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of audio playback technology, and in particular relates to an audio media material arrangement method, an arrangement device, an electronic device, and a storage medium. Background Art
[0002] In a performance scene, a program often includes multiple audio materials (eg, audio, video, etc.), and the multiple audio materials included in the same program usually include audio data.
[0003] Currently, when arranging audio materials, it is necessary to bind the multiple audio materials contained in the program to the physical sound card of the playback environment. However, if the physical sound card of the playback environment changes, the multiple audio materials need to be updated and bound to the changed physical sound card one by one. This operation is relatively cumbersome and leads to low arrangement efficiency during the audio media material arrangement process. Summary of the Invention
[0004] In view of the above problems, embodiments of the present application provide an audio media material playback method, an arrangement device, an electronic device, and a storage medium to overcome or at least partially solve the above problems of the prior art.
[0005] In the first aspect, an embodiment of the present application provides an audio media material arrangement method, which is applied to a terminal device. The operation interface of the terminal device includes a media material area, a program editing area, and a property setting area. The media material area is used to add and / or display added media materials, the program editing area is used to configure media materials for the program, and the property setting area is used to set properties for the program and / or media materials. The audio media material arrangement method includes: configuring the media material in the media material area to the target program in the program editing area, where the media material is an audio media material; in response to a user binding operation instruction, binding a target audio output mapping relationship for the audio media material of the target program in the property setting area, and playing the audio media material according to the target audio output mapping relationship.
[0006] In the second aspect, an embodiment of the present application provides an audio media material arrangement device, which is applied to a terminal device. The operation interface of the terminal device includes a media material area, a program editing area, and an attribute setting area. The media material area is used to add and / or display the added media material, the program editing area is used to configure the media material for the program, and the attribute setting area is used to set the attributes of the program and / or media material. The audio media material arrangement device includes: a configuration module and a binding module. The configuration module is used to configure the media material in the media material area to the target program in the program editing area, and the media material is an audio media material; the binding module is used to respond to the user's binding operation instruction, bind the target audio output mapping relationship for the audio media material of the target program in the attribute setting area, and the audio media material is played according to the target audio output mapping relationship.
[0007] In a third aspect, an embodiment of the present application provides an electronic device comprising a memory; one or more processors coupled to the memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the audio media material arrangement method provided in the first aspect above.
[0008] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which program code is stored. The program code can be called by a processor to execute the audio media material arrangement method provided in the first aspect above.
[0009] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the audio media material arrangement method provided in the first aspect above.
[0010] The solution provided by the present application configures the media material in the media material area to the target program in the program editing area, the media material is an audio media material, and in response to the user binding operation instruction, binds the target audio output mapping relationship to the audio media material of the target program in the property setting area, and plays the audio media material according to the target audio output mapping relationship. This realizes that in the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one. This simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0012] Figure 1 A schematic diagram of a scenario of an audio media material playback system provided in an embodiment of the present application is shown.
[0013] Figure 2 A schematic diagram of a flow chart of the audio media material arrangement method provided in an embodiment of the present application is shown.
[0014] Figure 3 A schematic diagram shows a scenario in which a mapping relationship between audio media materials and target audio output is bound in the audio media material arrangement method provided in an embodiment of the present application.
[0015] Figure 4 Another flowchart of the audio media material arrangement method provided in an embodiment of the present application is shown.
[0016] Figure 5 A schematic diagram of a scenario showing the channel layout of audio media materials in the audio media material arrangement method provided in an embodiment of the present application is shown.
[0017] Figure 6 A structural block diagram of the audio media material arrangement device provided in an embodiment of the present application is shown.
[0018] Figure 7 A functional block diagram of an electronic device provided in an embodiment of the present application is shown.
[0019] Figure 8 A computer-readable storage medium provided in an embodiment of the present application is shown for storing or carrying program code for implementing the audio playback method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0020] In order to make the purpose, features, and advantages of the invention of this application more obvious and easy to understand, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the embodiments described below are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0021] It will be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.
[0022] It should also be understood that the terms used in this specification are for the purpose of describing specific embodiments only and are not intended to limit the present application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms unless the context clearly indicates otherwise.
[0023] It should be further understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
[0024] In addition, in the description of the present application, the terms "first", "second", "third", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.
[0025] See also Figure 1 , which shows a schematic diagram of an application scenario of the audio media material playback system provided in an embodiment of the present application, which may include a terminal device 100 and an audio playback device 200. The terminal device 100 can be communicatively connected to the audio playback device 200 and interact with data with the audio playback device 200.
[0026] The terminal device 100 can be connected to the audio playback device 200 via a network and exchange data with the audio playback device 200 via the network. The terminal device 100 can be any one of a mobile phone, a personal digital assistant (PDA), a tablet personal computer (Tablet PC), a laptop computer, a smart watch, or a smart bracelet, etc., and is not limited here.
[0027] The network can be a ZigBee network, a Bluetooth (BT) network, a Wireless Fidelity (Wi-Fi) network, a Thread network, a Long Range Radio (LoRa) network, a Low-Power Wide-Area Network (LPWAN), an infrared network, a Narrow Band Internet of Things (NB-IoT), a Controller Area Network (CAN), a Digital Living Network Alliance (DLNA) network, a Wide Area Network (WAN), a Local Area Network (LAN), a Metropolitan Area Network (MAN), or a Wireless Personal Area Network (WPAN), etc.
[0028] The audio playback device 200 may include a physical sound card 210 and a speaker 220 . The physical sound card 210 is communicatively connected to the speaker 220 and is connected to the terminal device 100 via a network.
[0029] When a user needs to play audio media material, the user can send the audio media material to the physical sound card 210 through the terminal device 100. The physical sound card 210 receives and responds to the audio media material, plays the audio media material, and sends the sound information of the audio media material to the speaker 220. The speaker 220 receives and responds to the sound information sent by the physical sound card, and outputs the sound information, thereby realizing the playback control of the audio media material.
[0030] See also Figure 2 , which shows a flow chart of an audio media material arrangement method provided by an embodiment of the present application. In a specific embodiment, the audio media material arrangement method can be applied to Figure 1 The terminal device 100 in the audio media material playing system shown in FIG. 1 is taken as an example below. Figure 2 The process shown in FIG. 1 is described in detail. The audio media material arrangement method may include the following steps S110 to S120.
[0031] Step S110: Allocate the media materials in the media material area to the target program in the program editing area.
[0032] In the embodiment of the present application, the operation interface of the terminal device may include a media material area, a program editing area, and an attribute setting area. The media material area can be used to add and / or display added media materials, the program editing area can be used to configure media materials for a program, and the attribute setting area can be used to set attributes for the program and / or media materials.
[0033] The media material may be an audio media material, and the audio media material may be at least any one of an audio file, a video file, or a media file with audio. For example, the audio media material may be at least any one of a waveform audio (WAV) file, a Windows Media Audio (WMA) file, an Advanced Audio Coding (AAC) file, a Free Lossless Audio Codec (FLAC) file, a Moving Picture Experts Group Audio Layer III (MP3) file, a Moving Picture Experts Group 4 (MP4) file, or an Audio Video Interleaved (AVI) file.
[0034] When the user needs to arrange audio media materials, he can send a configuration instruction to the terminal device. The terminal device receives and responds to the configuration instruction and arranges the media materials in the media material area to the target program in the program editing area.
[0035] In some embodiments, the terminal device can detect user operations. When it is determined based on the detected user operations that the user has input an instruction to configure the audio media material, the configuration instruction is detected. For example, when the user needs to configure the audio media material, they can perform a touch operation on the operation panel of the terminal device. The terminal device responds to the user's touch operation, generates a corresponding touch signal, analyzes the touch signal, and determines that the configuration instruction has been detected when the touch signal is determined to be a preset control signal.
[0036] In some embodiments, the terminal device may collect voice information input by the user, perform voice recognition on the voice information, and determine, based on the recognition result of the voice recognition, that the recognition result contains a keyword indicating configuration of the audio media material, such as "audio media material configuration", or "audio media material" and "configuration", and then determine that a configuration instruction has been detected. For example, if the voice information input by the user is: configuration of audio media material, and the recognition result of the voice recognition contains the keyword "audio media material" and the keyword "configuration", then it is determined that a configuration instruction has been detected.
[0037] Step S120: In response to the user's binding operation instruction, a target audio output mapping relationship is bound to the audio media material of the target program in the property setting area.
[0038] In an embodiment of the present application, the terminal device can detect the user's operation. When it is determined that the user has entered a user binding operation instruction for setting the attributes of the audio media material of the target program based on the detected user operation, the terminal device responds to the user binding operation instruction and binds the target audio output mapping relationship for the audio media material of the target program in the attribute setting area. The audio media material is played according to the target audio output mapping relationship, so that in the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one. This simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process.
[0039] In some embodiments, when a user needs to set the properties of the audio media material of the target program, the user can touch the property setting area, and the terminal device detects the user's touch operation in the property setting area, determines that the user has entered a user binding operation instruction for setting the properties of the audio media material of the target program, and the terminal device responds to the user binding operation instruction and binds the audio media material of the target program to the target audio output mapping relationship in the property setting area. Figure 3 As shown, it shows a scenario schematic diagram of binding audio media materials and target audio output mapping relationships.
[0040] In some embodiments, when a user needs to set properties for the audio media material of a target program, the user can touch the properties of the audio media material of the target program in the program editing area, for example, right-click on the properties of the audio media material. The terminal device detects that there is a user property setting operation in the target program editing area, and determines that the user has entered a user binding operation instruction for setting properties for the audio media material of the target program. The terminal device responds to the user binding operation instruction and binds the audio media material of the target program to the target audio output mapping relationship in the property setting area.
[0041] In some embodiments, after or before configuring the media materials in the media material area to the target program in the program editing area, the terminal device responds to the user's establishment operation instruction when detecting the user's user establishment operation instruction, establishes at least one audio output mapping relationship, and responds to the user's binding operation instruction when detecting the user's user binding operation instruction, binds the target audio output mapping relationship for the audio media materials of the target program in the property setting area. It should be noted that establishing the audio output mapping relationship and configuring the media materials in the media material area to the target program in the program editing area and binding the target audio output mapping relationship for the audio media materials of the target program in the property setting area do not limit the order of operations.
[0042] The audio output mapping relationship can be used to represent the relationship between identification information and audio output information, and the target audio output mapping relationship is one of the audio output mapping relationships. The identification information can be any of a pointer, a placeholder, or an identifier. The identification information can be displayed on the operation interface of the terminal device. For example, the identification information can be a sequence number or label displayed on the operation interface of the terminal device. The identification information can also be not displayed on the operation interface of the terminal device, which is not limited here.
[0043] In some embodiments, the target audio output mapping relationship may include target identification information. When the terminal device determines, based on the detected user operation, that the user has entered a user binding operation instruction for setting attributes of the audio media material of the target program, the terminal device responds to the user binding operation instruction and binds the target identification information to the audio media material of the target program in the attribute setting area.
[0044] In one application scenario, target programs may include Program A, Program B, and Program C, and media materials may include Material A, Material B, and Material C. The terminal device may configure Material A to Program A, Material B to Program B, and Material C to Program C. Furthermore, Material A, Material B, and Material C are all bound to a target audio output mapping relationship X, and the target audio output mapping relationship X is associated with the physical sound card 1 of the playback environment. When the physical sound card 1 of the playback environment is changed to the physical sound card 2, there is no need to associate Material A, Material B, and Material C with the physical sound card 2 one by one. Instead, the physical sound card in the target audio output mapping relationship X can be changed from physical sound card 1 to physical sound card 2, thereby completing the physical sound card change for Material A, Material B, and Material C bound to the target audio output mapping relationship X at once.
[0045] The solution provided in this embodiment configures the media material in the media material area to the target program in the program editing area, the media material is an audio media material, and in response to the user binding operation instruction, the target audio output mapping relationship is bound to the audio media material of the target program in the property setting area. The audio media material is played according to the target audio output mapping relationship, thereby realizing that in the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one. This simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process.
[0046] See also Figure 4 , which shows a flow chart of an audio media material arrangement method provided by another embodiment of the present application. In a specific embodiment, the audio media material arrangement method can be applied to Figure 1 The terminal device 100 in the audio media material playing system shown in FIG. 1 is taken as an example below. Figure 4 The process shown in FIG. 1 is described in detail. The audio media material arrangement method may include the following steps S210 to S250.
[0047] Step S210: Allocate the media materials in the media material area to the target program in the program editing area.
[0048] Step S220: In response to the user's binding operation instruction, a target audio output mapping relationship is bound to the audio media material of the target program in the property setting area.
[0049] In this embodiment, step S210 and step S220 may refer to the contents of the corresponding steps in the aforementioned embodiment, and will not be repeated here.
[0050] The target audio output mapping relationship may include target identification information and target audio output information, and the target audio output information may include target physical sound card information. The target physical sound card information may be valid sound card information, which may be used to indicate sound card information that can output sound, for example, valid sound card information may be local / speaker. The target physical sound card information may also be invalid sound card information, etc., which may be used to indicate sound card information that cannot output sound, for example, invalid sound card information may be NA.
[0051] Specifically, for example, in a pre-edited scenario, the target audio output mapping relationship can be bound to the audio media material in advance. The target sound card information in the audio output mapping relationship can be valid sound card information or invalid sound card information. When the sound card information is valid, the user can preview the playback of the audio media material in the pre-edited environment in advance to simulate the real playback scene. Alternatively, only the target audio output mapping relationship can be bound. There is no need to preview the playback effect of the audio media material in the pre-edited environment, that is, the above-mentioned invalid sound card information is bound. During actual playback, the invalid sound card information is directly changed to the physical sound card information on site.
[0052] Step S230: Receive a play instruction for the target program.
[0053] In this embodiment, when the user needs to play a target program, the user can send a play instruction of the target program to the terminal device, and the terminal device receives the play instruction of the target program sent by the user.
[0054] In some embodiments, the terminal device may be provided with an input panel. When a user needs to play a target program, the user may touch-input the play instruction of the target program on the input panel of the terminal device, for example, by pressing a button to input the play instruction of the target program, or by handwriting to input the play instruction of the target program. The terminal device receives the play instruction input by the user through touch.
[0055] In some embodiments, the terminal device may be provided with a voice module, which may be used to collect ambient voice information of the environment in which the terminal device is located and perform voice recognition on the collected ambient voice information. When a user needs to play a target program, the user may issue a control voice message within the collection range of the voice module. The voice module collects the control voice message issued by the user and performs voice recognition on the control voice message. The terminal device may determine, based on the recognition result of the voice recognition, whether the recognition result contains a keyword for indicating that the terminal device has received a play instruction for the target program. For example, the keyword may be "play target program" or "play" and "target program". When the terminal device determines, based on the recognition result of the voice recognition, that the recognition result contains a keyword for indicating that the terminal device has received a play instruction for the target program, it determines that the play instruction issued by the user's voice has been received.
[0056] In some embodiments, the audio media material playback system may further include a user client, which may be connected to a terminal device via a network and exchange data with the terminal device via the network. When a user wishes to play a target program, the user may send a playback instruction for the target program to the terminal device via the user client, and the terminal device receives the playback instruction sent by the user client.
[0057] Step S240: Determine the corresponding target physical sound card information according to the target identification information.
[0058] In this embodiment, after receiving the play instruction of the target program, the terminal device can search in the audio output mapping relationship according to the target identification information to obtain the target physical sound card information corresponding to the target identification information.
[0059] For example, the identification information may include mapping 01, mapping 02, and mapping 03, and the physical sound card information may include local / speaker and NA. The correspondence between the identification information and the physical sound card may be as shown in Table 1, i.e., the audio output mapping relationship. Based on this correspondence, the target physical sound card information corresponding to the target identification information may be obtained.
[0060] Table 1
[0061] Identification information Physical sound card information Map 01 This unit / speaker Map 02 NA Map 03 NA
[0062] It should be noted that the identification information and the type of the physical sound card, as well as the correspondence between the identification information and the physical sound card information are not limited to those shown in Table 1, and can be specifically set according to actual needs.
[0063] In some implementations, there may be multiple audio media materials, and the multiple audio media materials may correspond to multiple target identification information. After receiving the play instruction of the target program, the terminal device may determine the corresponding target physical sound card information according to each target identification information.
[0064] As an implementation method, multiple audio media materials can be bound to the same audio output mapping relationship. After receiving the playback instruction of the target program, the terminal device can search for the audio output mapping relationship according to the target identification information of each audio media material, and obtain the target physical sound card information corresponding to the target identification information of each audio media material.
[0065] As another embodiment, multiple audio media materials can be bound to different audio output mapping relationships. After receiving a play instruction for a target program, the terminal device can search for the audio output mapping relationships corresponding to the multiple audio media materials based on the target identification information of the multiple audio media materials, and obtain the target physical sound card information corresponding to the target identification information of the multiple audio media materials.
[0066] Step S250: sending the audio media material to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material.
[0067] In this embodiment, after the terminal device determines the corresponding target physical sound card information based on the target identification information, it can send the audio media material to the target physical sound card associated with the target physical sound card information. The target physical sound card receives and responds to the audio media material and plays the audio media material, thereby realizing that in the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one, which simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process.
[0068] Specifically, after the terminal device determines the corresponding target physical sound card information based on the target identification information, it can send the audio media material to the target physical sound card associated with the target physical sound card information via a preset communication method. The target physical sound card receives and responds to the audio media material and plays the audio media material. The preset communication method can be any one of named pipes, sockets, or shared memory.
[0069] In some embodiments, the preset communication method is a named pipe. After the terminal device determines the corresponding target physical sound card information based on the target identification information, it can send the audio media material to the target physical sound card associated with the target physical sound card information through the named pipe. The target physical sound card receives and responds to the audio media material and plays the audio media material.
[0070] In some embodiments, the preset communication method is Socket. After the terminal device determines the corresponding target physical sound card information based on the target identification information, it can send the audio media material to the target physical sound card associated with the target physical sound card information through Socket. The target physical sound card receives and responds to the audio media material and plays the audio media material.
[0071] In some embodiments, the preset communication mode is shared memory. After the terminal device determines the corresponding target physical sound card information based on the target identification information, it can send the audio media material to the target physical sound card associated with the target physical sound card information through the shared memory. The target physical sound card receives and responds to the audio media material and plays the audio media material.
[0072] In some embodiments, the target audio output information may include target channel information, which may include a target number of channels. After determining the corresponding target physical sound card information based on the target identification information, the terminal device may process the audio media material to obtain processed audio media material corresponding to the target number of channels, and transmit the processed audio media material to the target physical sound card associated with the target physical sound card information. The target physical sound card receives and responds to the processed audio media material and plays the processed audio media material. The target number of channels, when set by the user, is the expected number of output channels of the audio media material after processing, and the audio media material is processed according to the target number of channels. For example, if the audio and video media material initially has two channels and the processed output channels have six channels, that is, when a live playback device is connected to a six-channel device, each playback device may have audio output without processing. However, when the live playback device is connected to the six-channel device, since the audio and video media material initially has only two channels, only two channels of the six-channel device will have audio output.
[0073] Specifically, after the terminal device determines the corresponding target physical sound card information based on the target identification information, it can resample the audio media material to obtain the corresponding resampled audio media material, and determine the resampled audio media material as the processed audio media material corresponding to the target number of channels.
[0074] For example, if the target number of channels is 6, the terminal device may resample the audio media material to obtain processed audio media material corresponding to the target number of 6 channels.
[0075] In some embodiments, after determining the corresponding target physical sound card information based on the target identification information, the terminal device can process the audio media material to obtain processed audio media material corresponding to the target number of channels, and when detecting the user's user setting operation, respond to the user setting operation, set the channel layout of the processed audio media material, and send the processed audio media material to the target physical sound card associated with the target physical sound card information. The target physical sound card receives and responds to the processed audio media material, and plays the processed audio media material according to the channel layout of the processed audio media material.
[0076] The channel layout is the channel identification selected for output under the target channel number according to the set target channel number. The channel identification can be used to identify the specific transmission channel of the audio media material. The channel identification can be an order, a special mark, etc., such as Figure 5 As shown, a schematic diagram of a scenario of channel layout of audio media material is shown. For example, if the target number of channels for the audio media material is 6, and the on-site playback device only has 4 channels, in response to the user setting instruction, specific 4 channels are selected as the live output, such as 1 channel, 2 channels, 3 channels, and 4 channels, or 2 channels, 3 channels, 4 channels, and 5 channels. In another case, when the on-site playback device has 6 channels, all channels can be selected for output.
[0077] In some embodiments, there may be multiple audio media materials, each corresponding to multiple target identification information. After the terminal device determines a corresponding target physical sound card information based on each target identification information, the terminal device may send the multiple audio media materials to the target physical sound card associated with the corresponding target physical sound card information. The target physical sound card receives and responds to the multiple audio media materials and plays the multiple audio media materials.
[0078] The solution provided in this embodiment configures the media materials in the media material area to the target program in the program editing area, responds to the user's binding operation instructions, binds the target audio output mapping relationship for the audio media materials of the target program in the property setting area, receives the playback instruction of the target program, and determines the corresponding target physical sound card information based on the target identification information, and sends the audio media materials to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media materials. In the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one. This simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process.
[0079] See also Figure 6 , which shows an audio media material arrangement device 300 provided by an embodiment of the present application. The audio media material arrangement device 300 can be applied to Figure 1 The terminal device 100 in the illustrated audio media material playback system has an operation interface that includes a media material area, a program editing area, and an attribute setting area. The media material area can be used to add and / or display added media materials, the program editing area can be used to configure media materials for a program, and the attribute setting area can be used to set attributes for the program and / or media materials.
[0080] The following will take the terminal device 100 as an example. Figure 6 The audio media material arrangement device 300 shown in FIG. 3 is described in detail. The audio media material arrangement device 300 may include a configuration module 310 and a binding module 320 .
[0081] The configuration module 310 can be used to configure the media material in the media material area to the target program in the program editing area, where the media material is an audio media material; the binding module 320 can be used to respond to the user's binding operation instructions, bind the target audio output mapping relationship for the audio media material of the target program in the property setting area, and play the audio media material according to the target audio output mapping relationship.
[0082] In some implementations, the audio media material arrangement apparatus 300 may further include a creation module.
[0083] The establishment module can be used for the binding module 320 to respond to the user's binding operation instructions. Before binding the target audio output mapping relationship for the audio media material of the target program in the property setting area, it responds to the user's establishment operation instruction and establishes at least one audio output mapping relationship. The audio output mapping relationship is used to characterize the relationship between the identification information and the audio output information. The target audio output mapping relationship belongs to one of the audio output mapping relationships.
[0084] In some implementations, the target audio output mapping relationship may include target identification information, and the binding module 320 may include a binding unit.
[0085] The binding unit can be used to respond to a user binding operation instruction and bind target identification information to the audio media material of the target program in the attribute setting area.
[0086] In some implementations, the target audio output mapping relationship may include target identification information and target audio output information, the target audio output information may include target physical sound card information, and the audio media material arrangement apparatus 300 may further include a receiving module, a determining module, and a sending module.
[0087] The receiving module can be used to receive the playback instruction of the target program; the determining module can be used to determine the corresponding target physical sound card information based on the target identification information; the sending module can be used to send the audio media material to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material.
[0088] In some implementations, the target audio output information may include target channel information, which may include the target number of channels. The audio media material arrangement apparatus 300 may further include a processing module.
[0089] The processing module can be used to process the audio media material before the sending module sends the audio media material to the target physical sound card associated with the target physical sound card information, so as to obtain processed audio media material corresponding to the target number of channels.
[0090] In some embodiments, the sending module may include a first sending unit.
[0091] The first sending unit may be configured to send the processed audio media material to a target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the processed audio media material.
[0092] In some implementations, the audio media material arrangement apparatus 300 may further include a setting module.
[0093] The setting module can be used for the sending unit to send the processed audio media material to the target physical sound card associated with the target physical sound card information, so that before the target physical sound card plays the processed audio media material, it responds to the user setting operation and performs channel layout settings for the processed audio media material.
[0094] In some embodiments, the first sending unit may include a sending subunit.
[0095] The sending subunit may be configured to send the processed audio media material to a target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material according to the channel layout.
[0096] In some implementations, the determination module may include a search unit.
[0097] The search unit may be configured to search in the audio output mapping relationship according to the target identification information to determine the corresponding target physical sound card information.
[0098] In some implementations, there are multiple audio media materials, and the multiple audio media materials correspond to multiple target identification information. The determination module may further include a determination unit
[0099] The determining unit may be configured to determine corresponding target physical sound card information according to each target identification information.
[0100] In some embodiments, the sending module may further include a second sending unit.
[0101] The second sending unit may be configured to send the plurality of audio media materials to a target physical sound card associated with the corresponding target physical sound card information, so that the target physical sound card plays the plurality of audio media materials.
[0102] The solution provided in this embodiment configures the media material in the media material area to the target program in the program editing area, the media material is an audio media material, and in response to the user binding operation instruction, the target audio output mapping relationship is bound to the audio media material of the target program in the property setting area. The audio media material is played according to the target audio output mapping relationship, thereby realizing that in the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one. This simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process.
[0103] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to in detail. For the device embodiments, since they are basically similar to the method embodiments, the description is relatively simple. For the relevant parts, refer to the partial description of the method embodiments. Any processing method described in the method embodiment can be implemented by the corresponding processing module in the device embodiment, and will not be repeated in detail in the device embodiment.
[0104] In addition, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module. The above-mentioned integrated modules may be implemented in the form of hardware or software functional modules.
[0105] See also Figure 7 , which shows a functional block diagram of an electronic device 500 provided in another embodiment of the present application. The electronic device 500 may include one or more of the following components: a memory 510, a processor 520, and one or more applications, wherein the one or more applications may be stored in the memory 510 and configured to be executed by the one or more processors 520, and the one or more applications are configured to execute the method described in the aforementioned method embodiment.
[0106] The memory 510 may include a random access memory (RAM) or a read-only memory (ROM). The memory 510 may be used for storing instructions, programs, codes, code sets, or instruction sets. The memory 510 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as adding media material, displaying media material, configuring media material, setting properties, responding to user binding operation instructions, binding target audio output mapping relationships, responding to user establishment operation instructions, establishing audio output mapping relationships, binding target identification information, receiving play instructions, determining target physical sound card information, sending audio media material, playing audio media material, processing audio media material, obtaining processed audio media material, sending processed audio media material, playing processed audio media material, responding to user setting operations, channel layout settings, and searching for audio output mapping relationships, etc.), instructions for implementing the following various method embodiments, etc. The storage data area can also store data created by the electronic device 500 during use (such as terminal equipment, operation interface, media material area, program editing area, property setting area, media material, properties, target program, audio media material, user binding operation instructions, target audio output mapping relationship, user establishment operation instructions, at least one audio output mapping relationship, the relationship between identification information and audio output information, target identification information, target audio output information, target physical sound card information, play instructions, target physical sound card information, target physical sound card, target channel information, target number of channels, processed audio media material, user setting operation, channel layout, multiple audio media materials and multiple target identification information), etc.
[0107] The processor 520 may include one or more processing cores. The processor 520 utilizes various interfaces and circuits to connect various components within the electronic device 500. It executes instructions, programs, code sets, or instruction sets stored in the memory 510, and accesses data stored in the memory 510 to perform various functions and process data within the electronic device 500. Optionally, the processor 520 may be implemented using at least one of the following hardware forms: a digital signal processing (DSP), a field-programmable gate array (FPGA), or a programmable logic array (PLA). The processor 520 may integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem handles wireless communications. It is understood that the modem may not be integrated into the processor 520 and may be implemented separately via a communication chip.
[0108] Please refer to Figure 8 , which shows a block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable storage medium 600 stores program code 610, which can be called by a processor to execute the method described in the above method embodiment.
[0109] The computer-readable storage medium 600 can be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read-Only Memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 600 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 600 has storage space for program code 610 for executing any of the method steps described above. These program codes can be read from or written to one or more computer program products. The program code 610 can be compressed, for example, in a suitable form.
[0110] The solution provided by this embodiment configures the media material in the media material area to the target program in the program editing area, the media material is an audio media material, and in response to the user binding operation instruction, binds the target audio output mapping relationship to the audio media material of the target program in the property setting area. The audio media material is played according to the target audio output mapping relationship, thereby realizing that in the arrangement process of multiple audio media materials, multiple audio media materials are associated with a target audio output mapping relationship. When the physical sound card of the playback environment changes, it is only necessary to replace the target physical sound card information in the target audio output mapping relationship, and there is no need to update and bind multiple audio media materials to the changed physical sound card one by one. This simplifies the operation process of audio media material arrangement and improves the arrangement efficiency of the audio media material arrangement process.
[0111] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for arranging audio media materials, characterized in that: Applied to a terminal device, the operating interface of the terminal device includes a media material area, a program editing area, and an attribute setting area. The media material area is used to add and / or display added media materials, the program editing area is used to configure the media materials for the program, and the attribute setting area is used to set attributes of the program and / or the media materials. The audio media material arrangement method includes: Allocating the media material in the media material area to a target program in the program editing area, wherein the media material is an audio media material; In response to a user binding operation instruction, binding a target audio output mapping relationship for the audio media material of the target program in the property setting area, and playing the audio media material according to the target audio output mapping relationship, wherein the target audio output mapping relationship includes target identification information and target audio output information, and the target audio output information includes target physical sound card information; receiving a play instruction for the target program; Determining the corresponding target physical sound card information according to the target identification information; The audio media material is sent to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material.
2. The method according to claim 1, characterized in that The step of responding to the user's binding operation instruction, before binding the target audio output mapping relationship for the audio media material of the target program in the attribute setting area, further includes: In response to a user establishment operation instruction, at least one audio output mapping relationship is established, where the audio output mapping relationship is used to characterize the relationship between identification information and audio output information, and the target audio output mapping relationship belongs to one of the audio output mapping relationships.
3. The method according to claim 1, characterized in that The target audio output mapping relationship includes target identification information, and the response to the user binding operation instruction, binding the target audio output mapping relationship for the audio media material of the target program in the attribute setting area, includes: In response to a user binding operation instruction, the target identification information is bound to the audio media material of the target program in the attribute setting area.
4. The method according to claim 1, wherein The target audio output information includes target channel information, and the target channel information includes the target channel quantity. Before sending the audio media material to the target physical sound card associated with the target physical sound card information, the method further includes: Processing the audio media material to obtain processed audio media material corresponding to the target number of channels; The sending the audio media material to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material, includes: The processed audio media material is sent to a target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the processed audio media material.
5. The method according to claim 4, characterized in that Before sending the processed audio media material to the target physical sound card associated with the target physical sound card information so that the target physical sound card plays the processed audio media material, the method further includes: In response to a user setting operation, performing channel layout setting on the processed audio media material; The sending the processed audio media material to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the processed audio media material, includes: The processed audio media material is sent to a target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material according to the channel layout.
6. The method according to claim 1, wherein The determining, according to the target identification information, corresponding target physical sound card information includes: According to the target identification information, the corresponding target physical sound card information is searched in the audio output mapping relationship.
7. The method according to any one of claims 1 to 6, characterized in that There are multiple audio media materials, and the multiple audio media materials correspond to multiple target identification information; and determining the corresponding target physical sound card information according to the target identification information includes: According to each target identification information, determine the corresponding target physical sound card information; The sending of the audio media material to the target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material, includes: The multiple audio media materials are sent to a target physical sound card associated with the corresponding target physical sound card information, so that the target physical sound card plays the multiple audio media materials.
8. An audio media material arrangement device, characterized in that: Applied to a terminal device, the operating interface of the terminal device includes a media material area, a program editing area, and an attribute setting area. The media material area is used to add and / or display added media materials, the program editing area is used to configure the media materials for the program, and the attribute setting area is used to set attributes of the program and / or the media materials. The audio media material arrangement device includes: a configuration module, configured to configure the media material in the media material area to a target program in the program editing area, wherein the media material is an audio media material; a binding module, configured to respond to a user binding operation instruction and bind a target audio output mapping relationship to the audio media material of the target program in the property setting area, so that the audio media material is played according to the target audio output mapping relationship, wherein the target audio output mapping relationship includes target identification information and target audio output information, and the target audio output information includes target physical sound card information; A receiving module, configured to receive a play instruction for the target program; A determination module, configured to determine the corresponding target physical sound card information according to the target identification information; The sending module is configured to send the audio media material to a target physical sound card associated with the target physical sound card information, so that the target physical sound card plays the audio media material.
9. An electronic device, characterized in that: include: Memory; one or more processors coupled to the memory; One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by one or more processors, and the one or more application programs are configured to execute the audio media material arrangement method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, which can be called by a processor to execute the audio media material arrangement method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Display device and multi-Bluetooth audio output method
CN114339383A