Data processing method, apparatus, medium, and computing device
By clustering and constructing second audio information for audio groups, the problem of incomplete audio information is solved, enabling fast and automatic information completion and improving the efficiency of audio information completion.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HANGZHOU NETEASE CLOUD MUSIC TECH CO LTD
- Filing Date
- 2023-10-08
- Publication Date
- 2026-06-09
AI Technical Summary
Due to the different recording times of the audio, some audio information is incomplete, which prevents users from obtaining complete information during playback, affecting user efficiency. Existing methods for manually supplementing information are time-consuming, resulting in low information completion efficiency.
By acquiring the audio features of each audio, audio groups are formed by clustering, and second audio information is constructed as the union of each first audio information. The information of each audio in the audio group is updated, and the information completion process is optimized by using indicators such as the popularity value and similarity of the audio group.
It eliminates the need for manual searching for missing information, quickly completing audio information and improving audio information completion efficiency.
Smart Images

Figure CN117150072B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of this disclosure relate to the audio field, and more specifically, embodiments of this disclosure relate to data processing methods, apparatus, media, and computing devices. Background Technology
[0002] This section is intended to provide background or context for embodiments of this disclosure. The description herein is not intended to imply that it is prior art simply because it is included in this section.
[0003] With the increasing ease of audio production, the amount of audio produced is growing, and the amount of audio stored in databases is also increasing.
[0004] Because the audio was recorded at different times, some audio information is incomplete. If users cannot obtain complete information about the audio when playing such audio, it will affect the user experience and reduce playback efficiency.
[0005] In the exemplary technology, information is supplemented to the audio manually to make the audio information complete. However, when supplementing the audio information, it is necessary to find the missing information in the audio. The search for missing information is time-consuming, resulting in low efficiency in audio information completion. Summary of the Invention
[0006] This disclosure provides a data processing method, apparatus, medium, and computing device to solve the problem of low efficiency in audio information completion.
[0007] In a first aspect of this disclosure, a data processing method is provided, comprising: acquiring audio features of each first audio audio, and determining an audio group based on each audio feature, wherein the multiple first audio audios included in the audio group are identical audio, and the similarity of the audio features of any two first audio audios within the audio group is greater than a first preset threshold; constructing second audio information based on first audio information of each first audio audio in the audio group, the second audio information being used to indicate the union of each first audio information; and updating the first audio information of each first audio audio in the audio group to the second audio information.
[0008] In one embodiment of this disclosure, constructing second audio information based on the first audio information of each first audio in the audio group includes: obtaining a first popularity value for each first audio in the audio group, wherein the first popularity value is used to indicate the number of plays and / or search volume of the first audio; and determining the audio text of the first audio corresponding to the first popularity value that is greater than a first preset popularity value as the audio text in the second audio information.
[0009] In another embodiment of this disclosure, after updating the first audio information of each first audio in the audio group to the second audio information, the method further includes: adding the second audio to the audio group in response to the similarity between the audio features of the newly added second audio and the audio features of any first audio in the audio group being greater than a second preset threshold; and updating the third audio information of the second audio to the second audio information.
[0010] In another embodiment of this disclosure, updating the third audio information of the second audio to the second audio information includes: comparing the third audio information with the second audio information; and updating the third audio information of the second audio to the second audio information in response to the second audio information including the third audio information.
[0011] In another embodiment of this disclosure, after comparing the third audio information with the second audio information, the method further includes: in response to the second audio information not including target information, constructing fourth audio information based on the target information and the second audio information, wherein the target information is part or all of the third audio information, and the fourth audio information is used to indicate the union of the target information and the second audio information; and updating the audio information of each audio in the audio group to the fourth audio information.
[0012] In another embodiment of this disclosure, the method further includes: constructing an index of the audio group based on the audio features of any of the first audios in the audio group; obtaining a newly added second audio, and determining the similarity between the audio features of the second audio and the audio features of any of the first audios in the audio group based on the audio features of the second audio and the index of the audio group; and determining that the second audio and any of the first audios in the audio group are the same audio if the similarity between the audio features of the second audio and the audio features of any of the first audios in the audio group is greater than a second preset threshold.
[0013] In another embodiment of this disclosure, the method further includes: obtaining a first popularity value for each of the first audios in the audio group, wherein the first popularity value is used to indicate the number of plays and / or search volume of the first audio; transcoding the target audio to obtain multiple third audios, wherein the target audio is the first audio corresponding to the first popularity value which is greater than a second preset popularity value, and the audio quality of each of the third audios is different; and associating and storing each of the third audios with the audio group.
[0014] In another embodiment of this disclosure, after associating and storing each of the third audios with the audio group, the method further includes: in response to the similarity between the audio features of the newly added second audio and the audio features of any of the first audios in the audio group being greater than a third preset threshold, obtaining a second popularity value of the second audio; in response to the second popularity value being greater than a first popularity value of the target audio, transcoding the second audio to obtain multiple fourth audios, each of which has a different audio quality; and associating and storing each of the fourth audios with the audio group.
[0015] In another embodiment of this disclosure, the method further includes: determining a plurality of fifth audios based on the copyright information of each of the first audios in the audio group, wherein each of the fifth audios is a first audio with different copyright information, and the first audio information includes the copyright information; and outputting prompt information based on each of the fifth audios, wherein the prompt information is used to instruct the copyright of each of the fifth audios to be confirmed.
[0016] In another embodiment of this disclosure, determining an audio group based on each of the audio features includes: determining a feature vector corresponding to the audio feature; determining the similarity between the audio features based on the feature vector; and determining the first audio with a similarity greater than a first preset threshold as audio in the same audio group.
[0017] In another embodiment of this disclosure, the first audio information includes at least one of audio tags, audio text, creator information, language information, copyright information, and version information.
[0018] In a second aspect of this disclosure, a data processing apparatus is provided, comprising: a first acquisition module, configured to acquire audio features of each first audio audio and determine an audio group based on each audio feature, wherein the multiple first audio audios included in the audio group are identical audio audios, and the similarity of audio features between any two first audio audios within the audio group is greater than a first preset threshold; a first construction module, configured to construct second audio information based on first audio information of each first audio audio in the audio group, the second audio information being used to indicate the union of each first audio information; and a first update module, configured to update the first audio information of each first audio audio in the audio group to the second audio information.
[0019] In one embodiment of this disclosure, the first construction module includes: an acquisition unit, configured to acquire a first popularity value for each of the first audios in the audio group, wherein the first popularity value is used to indicate the number of plays and / or search volume of the first audio; and a first determination unit, configured to determine the audio text of the first audio corresponding to the first popularity value that is greater than a first preset popularity value as the audio text in the second audio information.
[0020] In another embodiment of this disclosure, the data processing apparatus further includes: an adding module, configured to add the second audio to the audio group in response to a similarity between the audio features of the newly added second audio and the audio features of any of the first audios in the audio group being greater than a second preset threshold; and a second updating module, configured to update the third audio information of the second audio to the second audio information.
[0021] In another embodiment of this disclosure, the second update module includes: a comparison unit for comparing the third audio information with the second audio information; and a first update unit for updating the third audio information of the second audio to the second audio information in response to the second audio information including the third audio information.
[0022] In another embodiment of this disclosure, the second update module further includes: a construction unit, configured to construct fourth audio information based on the target information and the second audio information in response to the second audio information not including target information, wherein the target information is part or all of the third audio information, and the fourth audio information is used to indicate the union of the target information and the second audio information; and a second update unit, configured to update the audio information of each audio in the audio group to the fourth audio information.
[0023] In another embodiment of this disclosure, the data processing apparatus further includes: a second construction module, configured to construct an index of the audio group based on the audio features of any one of the first audios in the audio group; a second acquisition module, configured to acquire a newly added second audio, and determine the similarity between the audio features of the second audio and the audio features of any one of the first audios in the audio group based on the audio features of the second audio and the index of the audio group; and a first determination module, configured to determine that the second audio and any one of the first audios in the audio group are the same audio in response to the similarity between the audio features of the second audio and the audio features of any one of the first audios in the audio group being greater than a second preset threshold.
[0024] In another embodiment of this disclosure, the data processing device further includes: a third acquisition module, configured to acquire a first popularity value for each of the first audios in the audio group, the first popularity value being used to indicate the number of plays and / or search volume of the first audio; a first transcoding module, configured to transcode the target audio to obtain multiple third audios, the target audios being the first audios corresponding to the first popularity values that are greater than a second preset popularity value, and the audio quality of each of the third audios being different; and a first storage module, configured to associate and store each of the third audios with the audio group.
[0025] In another embodiment of this disclosure, the data processing device further includes: a fourth acquisition module, configured to acquire a second popularity value of the second audio in response to a similarity between the audio features of the newly added second audio and the audio features of any first audio in the audio group being greater than a third preset threshold; a second transcoding module, configured to transcode the second audio in response to a second popularity value being greater than a first popularity value of the target audio to obtain multiple fourth audios, each of the fourth audios having a different audio quality; and a second storage module, configured to associate and store each of the fourth audios with the audio group.
[0026] In another embodiment of this disclosure, the data processing device further includes: a second determining module, configured to determine a plurality of fifth audios based on the copyright information of each of the first audios in the audio group, wherein each of the fifth audios is a first audio with different copyright information, and the first audio information includes the copyright information; and an output module, configured to output prompt information based on each of the fifth audios, wherein the prompt information is used to instruct the copyright of each of the fifth audios to be confirmed.
[0027] In another embodiment of this disclosure, the first acquisition module includes: a second determining unit, configured to determine a feature vector corresponding to the audio feature; a third determining unit, configured to determine the similarity between the audio features based on the feature vector; and a fourth determining unit, configured to determine the first audio corresponding to the similarity greater than a first preset threshold as audio from the same audio group.
[0028] In another embodiment of this disclosure, the first audio information includes at least one of audio tags, audio text, creator information, language information, copyright information, and version information.
[0029] In a third aspect of this disclosure, a medium is provided, comprising: computer execution instructions, which, when executed by a processor, are used to implement the method described above.
[0030] In a fourth aspect of this disclosure, a computing device is provided, comprising:
[0031] Memory and processor;
[0032] The memory stores computer-executed instructions;
[0033] The processor executes computer execution instructions stored in the memory, causing the processor to perform the method described above.
[0034] In this embodiment of the disclosure, second audio information representing the union of each first audio information is obtained through the first audio information of the same audio, and then the first audio information of each audio with the same audio is updated to the second audio information. That is, the audio information to which the same audio belongs is used to complete the information of each audio. There is no need to manually search for the missing audio information, which improves the efficiency of completing the missing audio information. Attached Figure Description
[0035] The above and other objects, features, and advantages of this disclosure will become readily apparent from the following detailed description of exemplary embodiments, taken in conjunction with the accompanying drawings. Several embodiments of this disclosure are illustrated in the drawings by way of example and not limitation, in which:
[0036] Figure 1 A schematic diagram of a scenario according to an embodiment of the present disclosure is shown;
[0037] Figure 2 A schematic flowchart according to an embodiment of the present disclosure is shown;
[0038] Figure 3 A schematic flowchart according to another embodiment of the present disclosure is shown;
[0039] Figure 4 A schematic flowchart according to yet another embodiment of the present disclosure is shown;
[0040] Figure 5 A schematic flowchart according to another embodiment of the present disclosure is shown;
[0041] Figure 6 A schematic flowchart according to another embodiment of the present disclosure is shown;
[0042] Figure 7 A schematic diagram of a program product provided according to an embodiment of the present disclosure is shown.
[0043] Figure 8 A schematic diagram of the structure of a data processing apparatus provided according to an embodiment of the present disclosure is shown.
[0044] Figure 9 A schematic diagram of the structure of a computing device provided according to an embodiment of the present disclosure is shown.
[0045] In the accompanying drawings, the same or corresponding reference numerals indicate the same or corresponding parts. Detailed Implementation
[0046] The principles and spirit of this disclosure will now be described with reference to several exemplary embodiments. It should be understood that these embodiments are given merely to enable those skilled in the art to better understand and implement this disclosure, and are not intended to limit the scope of this disclosure in any way. Rather, these embodiments are provided to make this disclosure more thorough and complete, and to fully convey the scope of this disclosure to those skilled in the art.
[0047] Those skilled in the art will recognize that embodiments of this disclosure can be implemented as a system, apparatus, device, method, or computer program product. Therefore, this disclosure can be specifically implemented in the following forms: entirely hardware, entirely software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.
[0048] According to embodiments of this disclosure, a data processing method, apparatus, medium, and computing device are proposed.
[0049] Furthermore, the number of any elements in the accompanying drawings is for illustrative purposes only and not for limitation, and any naming is for distinction only and has no limiting meaning.
[0050] In addition, the data involved in this disclosure may be data authorized by the user or fully authorized by all parties. The collection, dissemination and use of the data shall comply with the requirements of relevant national laws and regulations. The implementation methods / executives of this disclosure may be combined with each other.
[0051] The principles and spirit of this disclosure will be explained in detail below with reference to several representative embodiments. Invention Overview
[0053] With the increasing ease of audio production, the amount of audio produced is growing, and the amount of audio stored in databases is also increasing.
[0054] Because the audio was recorded at different times, some audio information is incomplete. If users cannot obtain complete information about the audio when playing such audio, it will affect the user experience and reduce playback efficiency.
[0055] The inventors of this disclosure have discovered that if audio information is supplemented manually to obtain complete audio information, the missing information in the audio needs to be found during the supplementation process. However, finding the missing information is time-consuming, resulting in low efficiency in audio information supplementation.
[0056] The inventors of this disclosure therefore conceived of obtaining second audio information representing the union of various first audio information through first audio information of the same audio, and then updating the first audio information of each of the same audio to the second audio information, that is, to complete the information of each audio by using the audio information to which the same audio belongs, without the need for manual searching of missing audio information, thus improving the efficiency of completing missing audio information.
[0057] Application Scenarios Overview
[0058] First refer to Figure 1 , Figure 1 This is a schematic diagram illustrating an application scenario of the data processing method according to an embodiment of the present disclosure. Database 100 stores multiple audio files, along with their corresponding first audio information and audio features. Data processing device 200 retrieves the audio features of each audio file from database 100 and clusters them based on these features to obtain multiple audio groups. The similarity of the audio features between any two audio files in each audio group is greater than a preset threshold, and the audio files in each audio group are identical. Data processing device 200 constructs second audio information based on the first audio information corresponding to each audio file in the audio group. The second audio information is the union of all the first audio information. The data processing device then updates the first audio information of each audio file in the audio group with the second audio information and synchronizes the second audio information to database 100, ensuring that the first audio information of each audio file in the audio group in the database is updated with the second audio information.
[0059] Exemplary methods
[0060] The following is combined Figure 1 Application scenarios, refer to Figures 2-6 This document describes a data processing method according to exemplary embodiments of the present disclosure. It should be noted that the above application scenarios are shown only to facilitate understanding of the spirit and principles of the present disclosure, and the embodiments of the present disclosure are not limited in any way. Rather, the embodiments of the present disclosure can be applied to any applicable scenario.
[0061] Reference Figure 2 , Figure 2 An exemplary flowchart of an embodiment of a data processing method provided according to this disclosure is shown. The data processing method includes:
[0062] Step S201: Obtain the audio features of each first audio and determine an audio group based on each audio feature. The audio group includes multiple first audios that are the same audio, and the similarity of the audio features of any two first audios in the audio group is greater than a first preset threshold.
[0063] In this embodiment, the executing entity is a data processing device, which can be any terminal device, cloud server, database, or distributed processing system with data processing capabilities. For ease of description, the term "device" will be used to refer to the data processing device below.
[0064] The device retrieves audio features from a database, defining each audio as a first audio. The device then clusters these audio features to form audio groups. In one example, the device calculates the similarity between any two audio features. If the similarity is greater than a first preset threshold, the two audio features belong to the same category. The first audios corresponding to the audio features of each category constitute an audio group, and the similarity between the audio features of any two first audios within the audio group is greater than the first preset threshold. In another example, similarity can be calculated using the distance between audio features. That is, audio features can be represented by feature vectors. The device determines the feature vectors corresponding to the audio features and, based on these feature vectors, determines the similarity between the audio features. First audios with similarities greater than the first preset threshold are identified as first audios in the same audio group. In other words, the device calculates the distance between the feature vectors corresponding to two audio features, converts the distance into similarity, and the smaller the distance, the greater the similarity.
[0065] Step S202: Based on the first audio information of each first audio in the audio group, construct second audio information. The second audio information is used to indicate the union of each first audio information.
[0066] The device retrieves audio information for each first audio track in the audio group from the database. This audio information is defined as first audio information. First audio information includes at least one of the following: audio tag, audio text, creator information, language information, copyright information, and version information. Audio tags may include, for example, the musical style, emotional tone, or genre of the first audio track; audio text may include the background of the audio track's creation, lyrics, or alternative titles; creator information includes the arranger, lyricist, singer, and corresponding biographical information; language information includes the language in which the first audio track is sung, such as a dialect, Mandarin, or another language; and version information includes the release version and copyright ownership information of the first audio track.
[0067] The first audio files of each audio group may be different. For example, the audio information of audio A includes genre tags and audio text; the audio information of audio B includes emotion tags, release version, language, etc.; and the audio information of audio C includes creator information, aliases, etc. However, the first audio files within the same audio group are the same audio files. Therefore, the information of the first audio file can be completed based on the first audio information of each first audio file in the audio group.
[0068] To address this, the device constructs second audio information based on the first audio information of each first audio in the audio group. The second audio information is the union of all the first audio information. For example, the audio information of audio A includes a genre tag and audio text; the audio information of audio B includes an emotion tag, release version, language, etc.; the audio information of audio C includes creator information, aliases of audio C, etc.; if audio A, audio B, and audio C all belong to the same audio group, then the second audio information includes a genre tag, audio text, emotion tag, release version, language, creator information, and aliases of the audio.
[0069] Step S203: Update the first audio information of each first audio in the audio group to the second audio information.
[0070] After obtaining the second audio information, the device updates the first audio information of each first audio in the audio group with the second audio information, that is, it completes the audio information of the first audio in the audio group to complete the information of the first audio. For example, the device can send the identifier of the first audio to which the audio group belongs and the second audio information to the database, and the database will then update the first audio information of the first audio corresponding to the identifier with the received second audio information.
[0071] In this embodiment, second audio information representing the union of each first audio information is obtained through the first audio information of the same audio. Then, the first audio information of each audio that is the same is updated with the second audio information. In other words, the audio information to which the same audio belongs is used to complete the information of each audio. There is no need to manually search for the missing audio information, which improves the efficiency of completing the missing audio information.
[0072] Reference Figure 3 , Figure 3 An exemplary flowchart of another embodiment of the data processing method provided according to embodiments of this disclosure is shown, based on... Figure 2 In the embodiment shown, step S202 includes:
[0073] Step S301: Obtain the first popularity value of each first audio in the audio group. The first popularity value is used to indicate the number of plays and / or searches of the first audio.
[0074] In this embodiment, some of the first audio in the audio group may have audio text, while other parts of the first audio may not have audio text. The first audio with audio text may have inaccurate or incomplete lyrics. Therefore, it is necessary to select complete audio text as the audio text in the second audio information.
[0075] To this end, the device acquires the popularity value of each first audio in the audio group. This popularity value is defined as a first popularity value, which is determined based on the number of plays and / or searches of the first audio. The higher the number of plays and searches, the higher the first popularity value. The device can obtain the play count and search count of the first audio from the first audio information to calculate the first popularity value. Alternatively, the first audio information may contain the first popularity value of the first audio, and the device can directly acquire the first popularity value from the first audio information.
[0076] Step S302: The audio text of the first audio corresponding to the first heat value that is greater than the first preset heat value is determined as the audio text in the second audio information.
[0077] After determining the first heat value of each first audio in the audio group, the device determines a first heat value that is greater than the first preset heat value. The audio text of the first audio corresponding to this first heat value is determined as the audio text in the first audio information. That is, the audio text of the first audio with high heat in the audio group is selected as the audio text in the second audio information.
[0078] In this embodiment, the popularity value can reflect the degree of recognition of each user for the audio with the popularity value. The higher the popularity value, the higher the degree of recognition of the audio. By selecting the audio text corresponding to the audio with high popularity in the audio group as the audio text in the second audio information, the audio text of other first audio in the audio group is covered, and the audio text of the same audio is completed.
[0079] Reference Figure 4 , Figure 4 An exemplary flowchart of yet another embodiment of the data processing method provided according to embodiments of the present disclosure is shown, based on... Figure 2 or Figure 3 In one embodiment shown, step S203 includes:
[0080] Step S401: In response to the similarity between the audio features of the newly added second audio and the audio features of any first audio in the audio group being greater than a second preset threshold, the second audio is added to the audio group.
[0081] In this embodiment, when a new audio file is added to the library, if the audio file already belongs to an audio group, the audio information corresponding to the new audio file is directly updated to the second audio information of the audio group. The new audio file is defined as the second audio file. The device determines the similarity between the audio features of any first audio file in the audio group and the audio features of the second audio file. If the similarity is greater than a second preset threshold, the second audio file is considered to be the same as each of the first audio files in the audio group, and the device adds the second audio file to the audio group as the same audio file.
[0082] Step S402: Update the third audio information of the second audio to the second audio information.
[0083] In one example, after the device adds a second audio to the audio group, the device updates the third audio information of the second audio to the second audio information.
[0084] In another example, the device needs to compare the third audio information of the second audio with the second audio information. If the second audio information includes the third audio information, and no new information is added to the second audio information in the third audio information, then the third audio information of the second audio is updated to the third audio information. If the second audio information does not include the target information, and the target information is part or all of the third audio information, that is, the target information is information not contained in the second audio information, then the device constructs a fourth audio information based on the target information and the second audio information. The fourth audio information is the union of the target information and the second audio information, and it is also the union of the third audio information and the second audio information. The device then updates the audio information of each audio in the audio group to the fourth audio information.
[0085] Furthermore, after obtaining an audio group, the device constructs an index for the audio group based on the audio features of any first audio file within the group. This index can be used for grouping new audio files. Upon acquiring a newly added second audio file, the device determines the similarity between the audio features of the second audio file and the audio features of any first audio file within the audio group, based on the audio features of the second audio file and the index of the audio group. That is, the similarity between the audio features of the second audio file and the index can be used to characterize the similarity between the audio features of the second audio file and the audio features of any first audio file within the audio group. When the similarity between the audio features of the second audio file and the audio features of any first audio file within the audio group is greater than a second preset threshold, it can be determined that the second audio file and any first audio file within the audio group are the same audio file. In this embodiment, by constructing an index for the audio group, the device quickly identifies the audio group to which the newly added audio file belongs, thereby quickly completing the audio information corresponding to the newly added audio file.
[0086] In this embodiment, when a new audio is added, the audio group to which the new audio belongs is determined by the audio features corresponding to the new audio, thereby quickly completing the audio information corresponding to the new audio.
[0087] Reference Figure 5 , Figure 5 An exemplary flowchart of another embodiment of the data processing method provided according to embodiments of the present disclosure is shown, based on... Figures 2 to 4 In any of the embodiments shown, after step S201, the method further includes:
[0088] Step S501: Obtain the first popularity value of each first audio in the audio group. The first popularity value is used to indicate the number of plays and / or searches of the first audio.
[0089] In this embodiment, the device acquires a first popularity value for each first audio in the audio group. The first popularity value is used to indicate the number of plays and / or searches for the first audio. That is, the first popularity value is determined based on at least one of the number of plays and searches for the first audio. The method of acquiring the first popularity value is specifically described above.
[0090] Step S502: Transcode the target audio to obtain multiple third audios. The target audio is the first audio corresponding to the first heat value which is greater than the second preset heat value. The audio quality of each third audio is different.
[0091] The device determines the target audio based on the first heat value of each first audio in each audio group. The first heat value of the target audio is greater than a second preset heat value; that is, the target audio is the first audio corresponding to a first heat value greater than the second preset heat value. After determining the target audio, the device transcodes the target audio to obtain multiple third audios with different audio qualities, i.e., converting the target audio into multiple third audios with different audio qualities. These audio qualities may include lossless audio quality, high-quality audio, standard audio quality, and smooth audio quality.
[0092] Step S503: Associate and store each third audio file with an audio group.
[0093] After obtaining each third audio, the device associates each third audio with an audio group. If it is necessary to play the audio of the audio group later, the third audio with the audio quality selected by the user will be played from the third audio associated with the audio group.
[0094] When a new second audio track is added, the device determines the audio group to which the second audio track belongs. That is, if the similarity between the audio features of the second audio track and the audio features of any first audio track in the audio group is greater than a third preset threshold, then the second audio track is considered to be the same as the audio track in the audio group. The device then obtains the second heat value of the second audio track. The method for obtaining the second heat value is the same as that for obtaining the first heat value, and will not be described again here. The device determines whether the second heat value is greater than the first heat value of the target audio track. If the second heat value is greater than the first heat value of the target audio track, the second audio track is transcoded to obtain multiple fourth audio tracks with different audio qualities. The device then replaces each third audio track with a fourth audio track and associates each fourth audio track with the audio group for storage. If the second heat value is less than or equal to the first heat value of the target audio track, no further transcoding is required.
[0095] In this embodiment, the device selects audio with high popularity from the audio group for transcoding, avoiding transcoding the same audio in the audio group and saving the device's transcoding resources.
[0096] Reference Figure 6 , Figure 6 An exemplary flowchart of another embodiment of the data processing method provided according to embodiments of this disclosure is shown, based on... Figures 2 to 5 In any of the embodiments shown, after step S201, the method further includes:
[0097] Step S601: Based on the copyright information of each first audio in the audio group, determine multiple fifth audios, each of which is a first audio with different copyright information. The first audio information includes copyright information.
[0098] Step S602: Output prompt information based on each fifth audio file. The prompt information is used to indicate the copyright of each fifth audio file.
[0099] In this embodiment, the device obtains the copyright information of each first audio in the audio group. The copyright information can be obtained from the first audio information, which refers to the copyright owner of the first audio.
[0100] The device identifies multiple fifth audio tracks based on the copyright information of each first audio track. Each fifth audio track is a first audio track with different copyright information, meaning that the same audio track with different copyright holders appears in the audio group.
[0101] In response, the device needs to output prompts based on each fifth audio, which are used to instruct users to verify the copyright of each fifth audio.
[0102] In this embodiment, based on the copyright information of each first audio file in the audio group, audio files with different copyrights can be quickly identified, thereby outputting a prompt message to remind relevant personnel to confirm the final ownership of the audio copyright. Furthermore, the determination of the audio group is triggered when audio files are added to the audio course, thus allowing sufficient time for relevant personnel to confirm the final copyright of the audio files.
[0103] Exemplary media
[0104] After introducing the methods of exemplary embodiments of this disclosure, the following references are made. Figure 7 The storage medium of the exemplary embodiments of this disclosure will be described.
[0105] refer to Figure 7As shown, the storage medium 70 stores a program product for implementing the above-described method according to an embodiment of the present disclosure. This program product may be a portable compact disc read-only memory (CD-ROM) and includes computer-executable instructions for causing a computing device to execute the data processing method provided in this disclosure. However, the program product of this disclosure is not limited thereto.
[0106] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0107] A readable signal medium may include data signals propagated in baseband or as part of a carrier wave, carrying computer-executed instructions. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium.
[0108] Computer-executable instructions for performing the operations disclosed herein can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as C or similar languages. The computer-executable instructions can be executed entirely on the user's computing device, partially on the user's computing device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing devices can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN).
[0109] Exemplary device
[0110] Having introduced the medium of exemplary embodiments of this disclosure, the following references are made to... Figure 8 The terminal device described is provided as an example of an exemplary implementation. The terminal device is used to implement the method in any of the above data processing method embodiments, and its implementation principle and technical effect are similar.
[0111] refer to Figure 8 , Figure 8A schematic diagram of the structure of a data processing apparatus provided according to an embodiment of the present disclosure is shown.
[0112] like Figure 8 As shown, the data processing device includes: a first acquisition module 810, used to acquire the audio features of each first audio and determine an audio group based on the audio features, wherein the multiple first audios included in the audio group are the same audio, and the similarity of the audio features between any two first audios in the audio group is greater than a first preset threshold; a first construction module 820, used to construct second audio information based on the first audio information of each first audio in the audio group, the second audio information being used to indicate the union of the first audio information; and a first update module 830, used to update the first audio information of each first audio in the audio group to the second audio information.
[0113] In one embodiment, the first construction module 820 includes: an acquisition unit, configured to acquire a first popularity value for each first audio in the audio group, the first popularity value being used to indicate the number of plays and / or search volume of the first audio; and a first determination unit, configured to determine the audio text of the first audio corresponding to a first popularity value greater than a first preset popularity value as the audio text in the second audio information.
[0114] In one embodiment, the data processing apparatus further includes: an adding module, configured to add the second audio to the audio group in response to a similarity between the audio features of the newly added second audio and the audio features of any first audio in the audio group being greater than a second preset threshold; and a second updating module, configured to update the third audio information of the second audio to the second audio information.
[0115] In one embodiment, the second update module includes: a comparison unit for comparing third audio information with second audio information; and a first update unit for updating the third audio information of the second audio to the second audio information in response to the second audio information including the third audio information.
[0116] In one embodiment, the second update module further includes: a construction unit, configured to construct fourth audio information based on the target information and the second audio information in response to the second audio information not including target information, wherein the target information is part or all of the third audio information, and the fourth audio information is used to indicate the union of the target information and the second audio information; and a second update unit, configured to update the audio information of each audio in the audio group to the fourth audio information.
[0117] In one embodiment, the data processing apparatus further includes: a second construction module, configured to construct an index of the audio group based on the audio features of any first audio in the audio group; a second acquisition module, configured to acquire a newly added second audio and determine the similarity between the audio features of the second audio and the audio features of any first audio in the audio group based on the audio features of the second audio and the index of the audio group; and a first determination module, configured to determine that the second audio and any first audio in the audio group are the same audio in response to the similarity between the audio features of the second audio and the audio features of any first audio in the audio group being greater than a second preset threshold.
[0118] In one embodiment, the data processing device further includes: a third acquisition module, configured to acquire a first popularity value for each first audio in the audio group, the first popularity value being used to indicate the number of plays and / or search volume of the first audio; a first transcoding module, configured to transcode the target audio to obtain multiple third audios, the target audio being the first audio corresponding to a first popularity value greater than a second preset popularity value, and the audio quality of each third audio being different; and a first storage module, configured to associate and store each third audio with the audio group.
[0119] In one embodiment, the data processing apparatus further includes: a fourth acquisition module, configured to acquire a second popularity value of the second audio in response to a third preset threshold being met with an audio feature of the newly added second audio being similar to an audio feature of any first audio in the audio group; a second transcoding module, configured to transcode the second audio in response to a second popularity value being greater than a first popularity value of the target audio to obtain multiple fourth audios, each of which has a different audio quality; and a second storage module, configured to associate and store each fourth audio with the audio group.
[0120] In one embodiment, the data processing apparatus further includes: a second determining module, configured to determine a plurality of fifth audios based on the copyright information of each first audio in the audio group, wherein each fifth audio is a first audio with different copyright information, and the first audio information includes copyright information; and an output module, configured to output prompt information based on each fifth audio, wherein the prompt information is used to instruct the copyright of each fifth audio to be confirmed.
[0121] In one embodiment, the first acquisition module 810 includes: a second determining unit, configured to determine the feature vector corresponding to the audio feature; a third determining unit, configured to determine the similarity between audio features based on the feature vector; and a fourth determining unit, configured to determine the first audio corresponding to a similarity greater than a first preset threshold as audio from the same audio group.
[0122] In one embodiment, the first audio information includes at least one of audio tags, audio text, creator information, language information, copyright information, and version information.
[0123] Exemplary computing device
[0124] Having described the methods, media, and apparatus of exemplary embodiments of this disclosure, the following references... Figure 9 A computing device according to an exemplary embodiment of the present disclosure will be described.
[0125] Figure 9 The computing device 90 shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein. Figure 9 As shown, the computing device 90 is presented in the form of a general-purpose computing device. The components of the computing device 90 may include, but are not limited to: at least one processing unit 901, at least one storage unit 902, and a bus 903 connecting different system components (including the processing unit 901 and the storage unit 902). The at least one storage unit 902 stores computer-executable instructions; the at least one processing unit 901 includes a processor that executes the computer-executable instructions to implement the methods described above.
[0126] The 903 bus includes a data bus, a control bus, and an address bus.
[0127] Storage unit 902 may include readable media in the form of volatile memory, such as random access memory (RAM) 9021 and / or cache memory 9022, and may further include readable media in the form of non-volatile memory, such as read-only memory (ROM) 9023.
[0128] Storage unit 902 may also include a program / utility 9025 having a set (at least one) of program modules 9024, such program modules 9024 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.
[0129] The computing device 90 can also communicate with one or more external devices 904 (e.g., keyboard, pointing device, etc.). This communication can be performed via input / output (I / O) interface 905. Furthermore, the computing device 90 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 906. Figure 9 As shown, network adapter 906 communicates with other modules of computing device 90 via bus 903. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with computing device 90, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0130] It should be noted that although several units / modules or sub-units / modules of the terminal device / server are mentioned in the detailed description above, this division is merely exemplary and not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided and embodied by multiple units / modules.
[0131] Furthermore, although the operations of the methods disclosed herein are described in a specific order in the accompanying drawings, this does not require or imply that these operations must be performed in that specific order, or that all of the operations shown must be performed to achieve the desired result. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one step, and / or one step may be broken down into multiple steps.
[0132] While the spirit and principles of this disclosure have been described with reference to several specific embodiments, it should be understood that this disclosure is not limited to the disclosed specific embodiments, and the division of aspects does not imply that features in these aspects cannot be combined for benefit; such division is merely for convenience of expression. This disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.
Claims
1. A data processing method, characterized in that, include: The audio features of each first audio are obtained, and an audio group is determined based on each audio feature. The audio group includes multiple first audios that are the same audio, and the similarity of the audio features of any two first audios in the audio group is greater than a first preset threshold. Based on the first audio information of each of the first audios in the audio group, second audio information is constructed, and the second audio information is used to indicate the union of each of the first audio information; Update the first audio information of each of the first audios in the audio group to the second audio information; In response to the similarity between the audio features of the newly added second audio and the audio features of any of the first audios in the audio group being greater than a second preset threshold, the second audio is added to the audio group; Compare the third audio information of the second audio with the second audio information; In response to the second audio information including the third audio information, the third audio information of the second audio is updated to the second audio information; In response to the fact that the second audio information does not include target information, a fourth audio information is constructed based on the target information and the second audio information, wherein the target information is part or all of the third audio information, and the fourth audio information is used to indicate the union of the target information and the second audio information; The audio information of each audio in the audio group is updated to the fourth audio information.
2. The data processing method according to claim 1, characterized in that, The step of constructing second audio information based on the first audio information of each of the first audios in the audio group includes: Obtain a first popularity value for each of the first audio files in the audio group, wherein the first popularity value is used to indicate the number of plays and / or searches for the first audio file; The audio text of the first audio corresponding to the first popularity value that is greater than the first preset popularity value is determined as the audio text in the second audio information.
3. The data processing method according to claim 1, characterized in that, Also includes: Based on the audio features of any one of the first audio elements in the audio group, construct an index for the audio group; Obtain the newly added second audio, and determine the similarity between the audio features of the second audio and the audio features of any first audio in the audio group based on the audio features of the second audio and the index of the audio group; In response to the similarity between the audio features of the second audio and the audio features of any of the first audios in the audio group being greater than a second preset threshold, it is determined that the second audio and any of the first audios in the audio group are the same audio.
4. The data processing method according to claim 1, characterized in that, Also includes: Obtain a first popularity value for each of the first audio files in the audio group, wherein the first popularity value is used to indicate the number of plays and / or searches for the first audio file; The target audio is transcoded to obtain multiple third audios. The target audio is the first audio corresponding to the first popularity value which is greater than the second preset popularity value. The audio quality of each third audio is different. Each of the third audio files is associated with and stored in the audio group.
5. The data processing method according to claim 4, characterized in that, After associating and storing each of the third audio files with the audio group, the method further includes: In response to the fact that the similarity between the audio features of the newly added second audio and the audio features of any of the first audios in the audio group is greater than a third preset threshold, the second popularity value of the second audio is obtained. In response to the second heat value being greater than the first heat value of the target audio, the second audio is transcoded to obtain multiple fourth audios, each of which has a different audio quality; Each of the fourth audio files is associated with and stored in the audio group.
6. The data processing method according to claim 1, characterized in that, Also includes: Based on the copyright information of each first audio in the audio group, multiple fifth audios are determined, each of the fifth audios being a first audio with different copyright information, and the first audio information includes the copyright information; Based on each of the fifth audio recordings, a prompt message is output, which is used to instruct the copyright holder to confirm the copyright of each of the fifth audio recordings.
7. The data processing method according to claim 1, characterized in that, The step of determining the audio group based on each of the audio features includes: Determine the feature vector corresponding to the audio feature; The similarity between the audio features is determined based on the feature vector; The first audio corresponding to the similarity greater than the first preset threshold is determined as audio from the same audio group.
8. The data processing method according to any one of claims 1-7, characterized in that, The first audio information includes at least one of the following: audio tag, audio text, creator information, language information, copyright information, and version information.
9. A data processing apparatus, characterized in that, include: The first acquisition module is used to acquire the audio features of each first audio and determine an audio group based on each audio feature, wherein the multiple first audios included in the audio group are the same audio, and the similarity of the audio features between any two first audios in the audio group is greater than a first preset threshold. A first construction module is configured to construct second audio information based on the first audio information of each first audio in the audio group, wherein the second audio information is used to indicate the union of each first audio information; The first update module is used to update the first audio information of each of the first audios in the audio group to the second audio information; An add module is configured to add the second audio to the audio group in response to a second audio being added whose audio features are more similar to the audio features of any first audio in the audio group than a second preset threshold. The second update module is used to update the third audio information of the second audio to the second audio information; The second update module includes: The comparison unit is used to compare the third audio information with the second audio information; The first updating unit is configured to update the third audio information of the second audio to the second audio information in response to the second audio information including the third audio information; A construction unit is configured to, in response to the second audio information not including target information, construct fourth audio information based on the target information and the second audio information, wherein the target information is part or all of the third audio information, and the fourth audio information is used to indicate the union of the target information and the second audio information; The second update unit is used to update the audio information of each audio in the audio group to the fourth audio information.
10. The data processing apparatus according to claim 9, characterized in that, The first building module includes: The acquisition unit is used to acquire a first popularity value for each of the first audios in the audio group, wherein the first popularity value is used to indicate the number of plays and / or searches of the first audio. The first determining unit is used to determine the audio text of the first audio corresponding to the first heat value which is greater than the first preset heat value as the audio text in the second audio information.
11. The data processing apparatus according to claim 9, characterized in that, The data processing device further includes: The second construction module is used to construct an index of the audio group based on the audio features of any one of the first audios in the audio group; The second acquisition module is used to acquire the newly added second audio, and determine the similarity between the audio features of the second audio and the audio features of any first audio in the audio group based on the audio features of the second audio and the index of the audio group. A first determining module is configured to determine that the second audio and any of the first audios in the audio group are the same audio in response to the similarity between the audio features of the second audio and the audio features of any of the first audios in the audio group being greater than a second preset threshold.
12. The data processing apparatus according to claim 9, characterized in that, The data processing device further includes: The third acquisition module is used to acquire the first popularity value of each of the first audios in the audio group, and the first popularity value is used to indicate the number of plays and / or searches of the first audio. The first transcoding module is used to transcode the target audio to obtain multiple third audios. The target audio is the first audio corresponding to the first popularity value which is greater than the second preset popularity value. The audio quality of each of the third audios is different. The first storage module is used to associate and store each of the third audio files with the audio group.
13. The data processing apparatus according to claim 12, characterized in that, The data processing device further includes: The fourth acquisition module is used to acquire the second popularity value of the second audio in response to the similarity between the audio features of the newly added second audio and the audio features of any of the first audios in the audio group being greater than a third preset threshold. The second transcoding module is used to transcode the second audio in response to the second popularity value being greater than the first popularity value of the target audio, to obtain multiple fourth audios, each of which has a different audio quality. The second storage module is used to associate and store each of the fourth audio files with the audio group.
14. The data processing apparatus according to claim 9, characterized in that, The data processing device further includes: The second determining module is used to determine multiple fifth audios based on the copyright information of each first audio in the audio group, wherein each fifth audio is a first audio with different copyright information, and the first audio information includes the copyright information; The output module is used to output prompt information based on each of the fifth audio files, the prompt information being used to indicate copyright confirmation for each of the fifth audio files.
15. The data processing apparatus according to claim 9, characterized in that, The first acquisition module includes: The second determining unit is used to determine the feature vector corresponding to the audio feature; The third determining unit is used to determine the similarity between the audio features based on the feature vector; The fourth determining unit is used to determine the first audio corresponding to the similarity greater than the first preset threshold as audio from the same audio group.
16. The data processing apparatus according to any one of claims 9-15, characterized in that, The first audio information includes at least one of the following: audio tag, audio text, creator information, language information, copyright information, and version information.
17. A medium, characterized in that, include: Computer execution instructions, when executed by a processor, are used to implement the method as described in any one of claims 1 to 8.
18. A computing device, characterized in that, include: Memory and processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the method as described in any one of claims 1 to 8.