501results about "Metadata audio data retrieval" patented technology

The invention provides a multi-modal-based data retrieval enhancement method, which solves the problems of semantic gaps and outdated information among different modal data through cross-modal semantic alignment and real-time data source integration. And secondly, by constructing a multi-modal feature space and introducing a dynamic retrieval layer, the retrieval speed and accuracy are improved. In addition, by combining sparse retrieval and dense retrieval methods, the accuracy and the recall rate are balanced, and the retrieval result is optimized. And finally, through the steps of post-processing and result optimization, the correlation of the retrieval result and the user experience are further improved. The method is not only suitable for data retrieval of common modes such as texts, images and videos, but also can be expanded to any multi-mode scene, and provides powerful technical support for cross-mode retrieval.

A scoring system and method identifies personal attacks in a piece of audio content and generates a civility score for the piece of audio content that can differentiate between personal attacks and vernacular / casual banter. The piece of audio content may be a podcast.

The invention provides an acoustic data storage and retrieval method combined with computer cloud computing, which comprises the following steps of: performing time sequence division processing on original acoustic data to generate an audio frame sequence with a timestamp mark; based on a context window of the audio frame sequence, acoustic features are extracted, and a context-aware acoustic feature vector is constructed; constructing a time sequence sensing distributed index structure according to the acoustic feature vector, and dynamically storing the streaming acoustic data to obtain the time sequence sensing distributed index structure; and executing cross-modal similarity retrieval on the query audio and the distributed index structure to obtain a target fragment sequence in space-time association with the query audio. By adopting the method, the retrieval precision and efficiency of the acoustic data in a complex time sequence association scene can be improved through a time sequence perception storage architecture and a cross-modal retrieval mechanism.

A method, a device and / or a system of a generative AI computing platform implemented using a processor communicatively coupled to a memory is disclosed. In accordance therewith, context relevant to an interaction of a user with the generative AI computing platform is determined from an input thereto indicative of the interaction of the user. In addition to the context, a current location of the user is determined from the input, data associated with the input and / or metadata of the user outside the input and the data associated with the input. Also, one or more operation(s) contextually relevant to and reflective of the determined context and the determined current location of the user is automatically executed as associated with a response to the interaction of the user.

The invention relates to the technical field of multimedia, and provides a song recommendation method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring song-based real-time user interaction data and historical user use data; a target model is created based on the real-time user interaction data and the historical user usage data, and the target model is a model representing user preferences; a target music feature and a candidate song set similar to the currently played song are obtained, and the target music feature is a feature obtained after multi-modal music features are fused; and creating a dynamic queue of the candidate song set based on the target model and the target music features to obtain a to-be-played song set. According to the method, diversification of data analysis factors of song recommendation is enhanced, intelligent dynamic adjustment of the music playing queue is realized, highly personalized and dynamically responsive music playing experience is provided for the user, the accuracy of the played songs is improved, and thus the personalized song listening experience of the user is improved.

An electronic device associated with a media-providing service stores, in a vector space, a plurality of respective vector representations for respective media content items. The electronic device receives a user input, including a text string. The electronic device generates, using a neural network, a structured query based on the text string. The electronic device determines, based on the structured query, whether to generate a vector representation of a portion of the text string. When the electronic device determines to generate the vector representation of the portion of the text string, it generates the vector representation of the portion of the text string, wherein the vector representation is embedded in the vector space, and identifies a set of media items using the vector representation of the portion of the text string. And the electronic device provides one or more select media items from the set of media items to a user.

The invention relates to a voice interaction method based on a dynamic tag library and terminal equipment. The method comprises the following steps: receiving voice interaction information sent by a user; performing intention recognition on the voice interaction information based on a preset dynamic tag library, and determining an intention recognition result matched with the voice interaction information; wherein the preset dynamic label library comprises a user behavior label library and a dynamic content label library; the user behavior tag library comprises behavior tags related to user preferences and behavior habits; the dynamic content label library comprises dynamic content labels related to user preferences; based on the intention recognition result, executing an action sequence corresponding to the intention recognition result; the interaction intention of the user can be more comprehensively and accurately understood, so that accurate interaction is realized, and the individuation degree and accuracy of voice interaction are improved.

The invention discloses an information retrieval method, a related device, equipment and a storage medium, and is applied to the field of artificial intelligence. The method comprises the steps of obtaining to-be-queried information and target instruction information; based on the to-be-queried information and the target instruction information, obtaining a first token sequence through a feature extraction layer included in an information retrieval model; performing bidirectional attention coding on the first token sequence through a backbone network included in the information retrieval model to obtain a second token sequence; pooling the second token sequence to obtain a target embedded vector; and according to the target embedding vector, obtaining a preset number of candidate information with the highest similarity as a retrieval result. According to the method, the complexity and the calculation cost of model deployment are reduced, and the target embedding vector generated by the model is more discriminative, so that the accuracy of a retrieval result is improved.

The invention relates to the technical field of music score matching, in particular to an audio and music score matching method and system, and the method comprises the steps: providing a reference database of a music score, which comprises multiple segments of expected playing characteristics of a plurality of music units; acquiring first note data generated by playing of the user at first time; judging whether second note data generated at adjacent second time before the first time is successfully matched with the first target music unit or not; if yes, determining a first dynamic prediction sequence at the first time according to the first target music unit; judging whether the corresponding music unit obtained in the first dynamic prediction sequence is a second target music unit of the first note data or not; and if yes, marking the second target music unit as the current playing node. According to the music score matching technology, the matching time axis can be dynamically adjusted in combination with the playing state, and then positioning matching of the audio and the music score can be rapidly achieved through the limited matching calculation amount.

The invention relates to an interactive music intelligent generation method and system adaptive to a scene space, and the method comprises the steps: building a conditional diffusion model frame through sensing the behavior, emotional state and space environment change of a user, generating music matched with a current scene in real time, achieving the deep fusion of the music and user experience, and improving the user experience. And the generated music is dynamically adjusted to ensure that the generated music not only can flexibly cope with scene changes, but also can meet personalized requirements of the user, so that the interaction experience of the user with the music generation system in the scene is improved, and the diversity and intelligence of scene scheme generation are improved.

The system receives a voice query at an audio interface and converts the voice query to text. The system can determine pronunciation information during conversion and generate metadata that indicates a pronunciation of one or more words of the query, include phonetic information in the text query, or both. A query includes one or more entities that may be more accurately identified based on pronunciation. The system searches for information, content, or both among one or more databases based on the generated text query, pronunciation information, user profile information, search histories or trends, and optionally other information. The system identifies one or more entities or content items that match the text query, and retrieves the identified information to provide to the user.

The invention discloses a song teaching template generation method and system, equipment and a program product. The method comprises the following steps: acquiring song audio information of a target song audio; wherein the song audio information comprises lyrics, lyric timestamps, time points corresponding to paragraphs and audio representation information; performing various intra-sentence teaching feature analysis on the lyric timestamps and the audio representation information of the target song audio, and marking various analyzed intra-sentence teaching features on lyrics; wherein the in-sentence teaching features comprise at least one of accent, treble, long tone, tremolo, gliding and breathing points; the singing difficulty feature comprises at least one of high pitch and long pitch; the skill features comprise at least one of tremolo and glide; on the basis of the time point corresponding to each paragraph and the audio representation information, performing in-segment teaching feature marking on the loudness gradient part of each paragraph in the lyrics of the target song audio; and generating a song teaching template based on the marked lyrics of the target song audio and outputting the song teaching template.

The invention provides a maintenance guidance method and device for a household electrical appliance. The method comprises the following steps: constructing a unified vector database in advance based on text data, image data and audio data related to a household electrical appliance fault; acquiring field condition information of the household electrical appliance, wherein the field condition information comprises video information, audio information and / or text information; respectively carrying out image matching, audio matching and / or text matching on the field condition information based on the unified vector database, and outputting knowledge fragments as retrieval results; and inputting a retrieval result into the large language model, and outputting a maintenance guidance scheme of the household electrical appliance. According to the method, a retrieval and reasoning framework based on multi-modal feature direct fusion can be constructed, information dimension reduction loss is avoided by directly analyzing image, audio and text features of faults, and the comprehensive accuracy of fault diagnosis is improved to 95% or above; and through a dynamic knowledge retrieval and enhanced generation technology, the risk of'knowledge illusion 'possibly occurring in the professional field of the general large language model is effectively reduced.

The invention discloses a music education practice system and a method thereof, and relates to the technical field of education. The system comprises a music score library, a teacher unit, a student unit and a display unit. Wherein the music score library is used for storing online open source music scores; the teacher unit is used for carrying out music score analysis on the music score and splitting the music score into corresponding signal components according to a singing mode and a playing mode to form an original audio; the student unit is used for practicing target music through peripheral equipment and recording by taking the length of each piece of music as a cycle to obtain a practicing audio; and the display unit is used for dynamically displaying the original audio and the practice audio in the form of visual notes, and deducting scores when the original audio and the practice audio have signal inconformity to obtain a final practice scoring result. According to the invention, the user can be assisted to improve the convenience of music practice.

The invention discloses a music generation method based on multi-modal cross attention and dynamic feature fusion, which is characterized by comprising the following steps of: extracting semantic features of a text by using a pre-training language model, and extracting image region features through a pre-training visual model; a multi-head cross attention module is used, text features are used as Query, image features are used as Key and Value, and a guide module pays attention to features, strongly related to texts, in pictures; constructing a small neural network prediction modal weight, and dynamically weighting and fusing text features and picture features; and extracting emotion information in the text and the picture by using a long-short-term memory network and a convolutional neural network, and guiding a diffusion model to generate symbol music according to the fusion features. Compared with the prior art, the method has the advantages of efficiently capturing potential information of texts and pictures, being high in cross-modal information fusion capability, enhancing the consistency of potential emotions of music and input information and the like, can improve the matching degree of music and input to a certain extent, and has a good application prospect.

The present disclosure relates to a system and method for selecting and generating audio using a large language model. The method includes receiving from a user a text-based prompt for a desired song, generating a song specification from a prompt that includes the text-based prompt and instructions on how to create a suitable instruction file format for representing the requested song, for each of the list of tracks in the song specification, generating a ranked list of potential sound loops matching the song specification for a selected track, selecting a sound loop from the ranked list of potential sound loops for each of the list of tracks, and generating a track specification file including the sound loop selected for each of the list of tracks.

A system and method for media content management include creating, via a digital vault, a container file comprising media content submitted by a first user and content metadata; verifying, via the digital vault, a completeness of the content metadata associated with the media content in the container file; classifying, via the digital vault, the container file based on the completeness of the media content; capturing, via the digital vault, event metadata when a second user gains access to the container file, the event metadata comprising at least one of identification of the second user, an activation timestamp, a duration of access, portions of the container file accessed, and changes to the container file; and enabling a private communication channel between parties affiliated with the media content to permit messaging among the parties affiliated with the media content via the private communication channel.

The invention relates to the technical field of Internet information processing, in particular to a sound effect recommendation method, system and device based on user preference and scene awareness, and the method comprises the steps: carrying out the deep analysis of collected user preference data, and constructing a user preference model; when an audio recommendation request of a user side is received, scene perception information matched with a current vehicle position is obtained, and a current scene is determined; matching the current scene with the user preference model to obtain a candidate sound effect set matched with the current scene and the user preference; checking each candidate sound effect data in the candidate sound effect set, screening the candidate sound effect data according to the sound effect data, and generating a recommendation result; and feeding back the recommended sound effect contained in the sound effect recommendation result. According to the scheme, the personalized requirements of the user can be fully considered, and the preferable sound effect recommendation information is provided for the user, so that the satisfaction degree of the user on sound effect recommendation is improved.

The invention relates to the technical field of audio playing, and discloses an audio playing method and device capable of keeping contexts continuous, equipment and a storage medium. Matching an audio context model conforming to a preset rule from a playing record database; analyzing the audio context model, and extracting audio playing state information and sound effect configuration information recorded in the audio context model; and adjusting the sound effect of the target playing device, and controlling audio playing according to the audio playing state information. Through the playing control mode, switching playing of multiple sound sources can be achieved, continuous playing after switching can also be achieved, and the problems that audio playing repetition is high after traditional switching, and the user experience feeling is reduced are solved.

The invention relates to the technical field of data processing, and discloses a recommended song menu customization method, device and equipment, a storage medium and a computer program product, and the method comprises the steps: obtaining user identity information of a current user, obtaining a music playing record and a user portrait of the current user based on the user identity information, and obtaining a recommended song menu based on the music playing record; and obtaining a user preference song list of the current user, and screening songs in the user preference song list according to the user portrait to obtain a recommended song list. Therefore, the music playing record and the user portrait of the corresponding current user can be obtained according to the obtained user identity information, the user preference song list of the current user is obtained based on the music playing record of the user, and the songs in the user preference song list are screened according to the user portrait. Due to the fact that the music playing record of the current user and the user portrait are combined, the effect of more accurately matching the song listening requirement of the user is achieved.

The present application discloses a method, device and storage medium for processing meeting minutes, relates to the field of voice conference technology, and discloses a method for processing meeting minutes, including: sending a meeting request to a server to create a meeting, collecting audio frames through a conference recording component and sending them to the server; receiving meeting minutes information obtained by the server based on the audio frames, ASR technology and a pre-trained large language model; obtaining a user's meeting query request; displaying matching content of the meeting minutes information according to the meeting query request; realizing real-time display of meeting content, being able to summarize the meeting content from a semantic level, and timely pushing meeting completion information, so as to facilitate users to understand the meeting content in real time and efficiently.

Techniques for accessing shared content based on a recipient's subscriptions are described. A recipient user may receive a notification that a sender user shared content. The recipient user may request to output the shared content. The system may determine which content providers the recipient user is subscribed to, and may perform entity resolution processing to identify potential content, from the subscribed content providers, corresponding to the shared content. The system may output the identified potential content in response to the request to output the shared content.

A system includes a computing platform having processing hardware, and a memory storing software code and a machine learning (ML) model-based feature classifier. When executed, the software code receives media content including a first media component corresponding to a first media mode and a second media component corresponding to a second media mode, encodes the first media component using a first encoder to generate multiple first embedding vectors, and encodes the second media component using a second encoder to generate multiple second embedding vectors. The software code further combines the first embedding vectors and the second embedding vectors to provide an input data structure for a neural network mixer, process, using the neural network mixer, the input data structure to provide feature data corresponding to a feature of the media content, and predict, using the ML model-based feature classifier and the feature data, a classification of the feature.

A media identification system is provided. The system comprises an audio input configured to receive an audio signal, and an audio clip extraction module configured to extract an audio clip from the audio signal. The system further comprises an audio clip processing module configured to generate metadata based upon the audio clip, and a first communication interface configured to transmit media identification data corresponding to the audio clip to a media identification server when the metadata based upon the audio clip meets a predetermined requirement, wherein the predetermined requirement comprises the metadata indicating that the audio clip comprises music.

The invention provides a display device and a sound synthesis method, and the method comprises the steps: receiving sound data collected by a sound collector in response to an access instruction of the sound collector, and storing the sound data and corresponding collection time at a preset position; according to an input playing instruction, accompaniment audio data and original sound audio data of a target song are decoded, a start time identifier contained in the accompaniment audio data is detected, and after the start time identifier is detected, sound data are periodically read according to time corresponding to the start time identifier and collection time; when the sound data is read, generating target audio data according to the accompaniment audio data and the read sound data; and when the sound data is not read, generating target audio data according to the accompaniment audio data and the replacement audio data. According to the method, the missing sound data of the user can be filled in a mode of replacing the audio data, the integrity of the target audio is ensured, and the problem that the audio is incomplete in the audio recording process is solved.

The present invention provides an information processing system for performing processing related to music using AI technology.　An information processing system according to the present invention includes an acquisition unit that acquires a trained music foundation model, and a generating unit that generates a trained model adapted to a downstream task on the basis of a training dataset related to the music foundation model and the downstream task. The model generating unit generates a plurality of trained models for each downstream task, on the basis of common intermediate features with the music foundation model, and a plurality of training datasets respectively corresponding to the plurality of the downstream tasks.

A computing device receives a user query regarding a dataset that includes variability. The computer device obtains the dataset that includes one or more data fields and data corresponding to the one or more data fields and determines data uncertainty corresponding to the data. The device generates a multi-modal data representation of the data and the data uncertainty, including rendering a data visualization that represents the data and the data uncertainty; generating, according to statistics of the dataset, text content describing the data and the data uncertainty; translating the text content into a speech synthesis markup language to generate an audio narrative of the text content; and synchronizing the data visualization, the text content, and the audio narrative according to a timestamp of the audio narrative. The computing device causes the multi-modal data representation to be presented at a user interface of an electronic device.

Provided are a method and apparatus for determining multimedia content, an electronic device, and a storage medium. The method comprises: acquiring a target material and text information (S110); determining a material feature, a text feature, and an intent type on the basis of the target material and the text information by means of a preset model (S120); and according to the intent type, determining corresponding target multimedia content for the target material on the basis of at least one target object in a target object set (S130), wherein the target object set comprises keywords in the text feature, a text vector corresponding to the text feature, and a material vector corresponding to the material feature.

A system for platform-independent visualization of audio content, in particular audio tracks utilizing a central computer system in communication with user devices via a computer network. The central system utilizes various algorithms to identify spoken content from audio tracks and identifies “great moments” and / or selects visual assets associated with the identified content. Audio tracks, for example Podcasts, may be segmented into topical audio segments based upon themes or topics, with segments from disparate podcasts combined into a single listening experience, based upon certain criteria, e.g., topics, themes, keywords, and the like.

The invention provides an interrogation record and audio and video recording linkage method and system, and belongs to the technical field of information processing, and the method comprises the steps: obtaining interrogation record text data and segmented video recording data, and respectively labeling category labels; performing semantic extraction on the record text data to obtain semantic feature information, and converting the feature information into text semantic feature vectors; frame extraction is carried out on the video data, image features of each frame of the video data are extracted, similarity screening is carried out, and the image features are converted into key frame semantic feature vectors; constructing a cross-modal embedding space model, respectively encoding the text semantic feature vector and the key frame semantic feature vector of the category label through two encoders, then splicing and fusing to obtain a fused feature vector, converting and mapping the fused feature vector into a sharing layer, completing feature association of the record text data and the segmented video recording data, and obtaining the segmented video recording data. And subsequently, cross-modal search is carried out. According to the method, cross-modal information association is realized through association of the semantic feature vectors of the record and video recording information, and a basis is provided for subsequent rapid calling, research and judgment.