307 results about "Lyrics" patented technology

The invention discloses a VEM-Token vocal music emotion multi-mode token song sound and accompaniment deep learning method, which is different from an existing method that information is segmented into textual token lexical elements by artificial intelligence and then recognition is carried out on the textual token lexical elements. The method comprises the following steps: performing frequency spectrum processing on a vocal music file, detecting rhythm, segmenting the vocal music file subjected to frequency spectrum processing into a VEM-Token sequence according to the vocal music rhythm, establishing a VEM coordinate system, a VEM function and a VEM library according to multiple modes such as lyrics, singing sound, accompaniment, singer emotion, accompaniment emotion, video and image, performing VEM-Token identification, separating a singing sound stream and an accompaniment stream, and determining the vocal music according to a vocal music expert. And performing multi-modal emotion scoring on the vocal music sample, obtaining a VEM parameter by adopting supervised learning and deep learning algorithms, and learning to obtain the multi-modal emotion of the vocal music sample. For other vocal music works, vocal music multi-mode emotions can be recognized, and a lyric score, a VEM-Token song sound score, a VEM-Token accompaniment score and a VEM-Token music score are output. AI systems including a common large model and the like are accessed, and a vocal music agent Agent capable of listening to the singing and identifying the music score is developed.

The invention discloses a video generation method and device based on AIGC and a storage medium, and the method comprises the steps: extracting information expressed in lyrics of a song, generating a story summary according to the information expressed by the lyrics, and generating a corresponding story plot according to each lyric segment; inputting the lyric segments and the corresponding story lines into the artificial intelligence model, generating sub-shots corresponding to the lyric segments, and generating corresponding images / videos according to the sub-shots; and sorting and processing the images / videos corresponding to the sub-shots according to a time sequence to obtain song videos corresponding to the songs. According to the method, the video conforming to the artistic conception of the song can be efficiently generated, and the song video production efficiency and quality are improved.

The invention provides a song generation method, and relates to the technical field of artificial intelligence, in particular to the fields of natural language processing, content generation, deep learning and large models. The method comprises the following steps: selecting a target template from at least two candidate templates according to song theme description; the candidate template is used for describing a corresponding relation between a candidate lyric text and a candidate song melody in the song material; performing imitation writing on the target lyric text in the target template based on the lyric demand description through a lyric imitation writing model, and outputting imitation writing lyrics; the imitated lyrics are consistent with the target lyrics in text line number and word number in each line; the lyric imitation writing model is obtained by adopting a lyric corpus to supervise and finely adjust a pre-trained large language model; and synthesizing the imitated lyrics and the melody of the target song in the target template based on the corresponding relationship between the text of the target lyrics in the target template and the melody of the target song to generate a new song. The song generation quality can be ensured, and the song generation cost can be reduced.

The construction method of the VEM-Token vocal emotion multi-modal magic modification model is different from the natural language processing model NLP-Token which interprets music through text. Instead, the VEM-Token sound-to-text innovation model comes with vocal emotion multi-modal information. The model captures and aligns the music tempo of sample songs and user learning songs, identifies various modalities of vocal emotion, divides the file into word units based on tempo, obtains VEM parameters through supervised learning and reinforcement learning, and decomposes songs into vocals, accompaniment, and emotion. The magic modification model provides a multi-modal magic modification method for imitating sample songs, including vocals, accompaniment, emotion overtones, emotion fluctuations, learning to sing, voice cloning, lyrics, pitch calibration, ornaments, tempo length, rhythm speed, tempo strength, freedom, and multiple sample magic modification. It also provides member management, mobile and PC application systems, dedicated support hardware, and communication protocols including MIDI, making it easy to access popular AI large models, reducing model hallucinations, and forming AI vocal agents and AI karaoke.

The invention discloses an intelligent music playing method based on three-dimensional scene interaction, and relates to the technical field of three-dimensional interaction, and the method comprises the steps: extracting a music feature vector of an input audio, inputting a lightweight neural network to output a music genre label, loading a three-dimensional scene in a three-dimensional scene template library based on the music genre label, and generating an initial three-dimensional music space; materializing a control component in the three-dimensional scene into a three-dimensional interactive object, and detecting the position and posture of the hand of the user in the initial three-dimensional music space to perform music playing control; and driving a dynamic element in the three-dimensional scene based on the music feature vector to control the amplitude of a top light beam, the ripple radius and the particle spacing of the central region, and mapping to the initial three-dimensional music space. According to the method, playing, volume and lyric functions are materialized into interactive objects, gesture recognition is introduced, and natural, visual and low-delay three-dimensional interactive experience is achieved; and an intelligent music playing effect with high immersion, high degree of freedom and high consistency is achieved.

The invention relates to the technical field of vehicles, in particular to a lyric display method and device for a vehicle cabin, a vehicle and a storage medium, and the method comprises the steps: obtaining current audio data and current lyric data of target music; analyzing the current audio data, determining a current rhythm, a current melody and a current music label of the target music, and determining a target lyric style and a target dynamic background of the current lyric data from a preset lyric style library and a preset dynamic background library according to the current music label; and using a Unity 3D engine to render the current lyric data and the target dynamic background according to the target lyric style based on the current rhythm and the current melody, playing the current audio data, and displaying the rendered current lyric data and the rendered target dynamic background. Therefore, the rhythm and melody of the music are analyzed in real time, the lyric style and the background image are dynamically matched and rendered, the defects of a music system in the aspects of visual interactivity and immersion are overcome, and immersive personalized music experience is provided.

The invention relates to the technical field of audio processing, and discloses an intelligent guitar with a karaoke singing function. Comprising the following steps: detecting singing sound of a user in real time, synchronously regulating and controlling audio signal path parameters between a built-in microphone and a loudspeaker, and eliminating delay and synchronization errors caused by transmission; the refresh rate of the display screen is automatically adjusted according to the working frequency of the lyric display module, so that the lyric display time is strictly synchronized with the rolling of the music progress bar to eliminate the display delay; performing multi-stage filtering processing on the acquired audio data sung by the user, and comparing the audio data with a preset standard intonation model to provide high-precision sound acquisition and accurate intonation judgment; and the optimal sound proportion and reverberation effect are ensured to be achieved under various playing conditions. According to the intelligent guitar with the karaoke singing function, real-time and accurate audio playing can be realized, the audio-visual experience of a user in scenes of listening to music, watching videos and the like is improved, and discomfort caused by asynchronism of sound and pictures is avoided.

Implementations relate to utilizing generative model(s) (GM(s)) to generate musical content that includes at least lyrical content and music composition content. Processor(s) of a system can: receive user input associated with a client device of a user that includes a request for the musical content, generate the musical content, and cause the musical content to be audibly rendered at the client device. In some implementations, the processor(s) can cause a single GM to process GM input (including at least the user input) to generate GM output and can determine the lyrical content and the music composition content based on the GM output. In other implementations, the processor(s) can cause multiple GMs to process respective GM inputs (each including at least the user input) to generate respective GM outputs and can determine the lyrical content and the music composition content based on the respective GM outputs.

This information processing system includes: an information generation unit that generates instruction information containing a first character string in which lyrics of a musical piece, sound of content, or text of a comic book is expressed in a first language and a constraint condition related to the length of a character string; and an information acquisition unit that acquires a second character string which is generated as a result of the processing of the instruction information by a trained generation model, the second character string resulting from conversion of the first character string into a second language different from the first language, under the constraint condition.

A variety of exemplary embodiments for editing music and user interface thereof are disclosed. In an exemplary embodiment, a method includes displaying a GUI that allows a user to edit music; wherein the GUI includes a melody region and a lyrics region, the melody region displays a melody portion of the music along the time axis and pitch axis, the lyrics region displays a lyrics portion corresponding to at least a part of the displayed melody portion, at least one pitch of the displayed melody portion and at least one character of the displayed lyrics portion corresponding to the at least one pitch are displayed, and substantially aligned along time axis, receiving a user input for modifying the displayed lyrics portion; and in response to the user input for modifying the lyrics portion, displaying a modified version of the lyrics portion on the lyrics region.

1. The name of the design product: Bluetooth speaker (with lyrics aurora projection). 2. The use of the design product: a speaker for playing music, decoration and as a display, while having the functions of displaying lyrics, lighting and projection. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: design 1 perspective view. 5. Design 1 is designated as the basic design.

A music generation method and apparatus, a device, and a storage medium. The method comprises: presenting an editing interface, the editing interface comprising a lyric editing control (310); in response to a selection of first lyric content in the lyric editing control, presenting a set of candidate lyric content, the set of candidate lyric content being generated on the basis of context information associated with the lyric editing control (320); determining target lyric on the basis of a selection of second lyric content in the set of candidate lyric content (330); and in response to receiving a music generation request, providing music content generated on the basis of the target lyric (340). The method can improve the lyric editing efficiency in a music generation process, thereby improving the music generation efficiency.

This invention provides a method, apparatus, storage medium, and electronic device for drawing lyrics in a vehicle cockpit. The method includes: responding to a lyrics loading request from a media source on a media display screen in the vehicle cockpit and acquiring the original lyrics data of the media source; constructing a lyrics data model of the original lyrics data using characters as units; initializing and configuring a set of control components for lyrics on a lyrics canvas of the media display screen; controlling the activation state of the control component set according to the lyrics loading state; calling a content drawing component in the control component set to configure a lyrics pen, and drawing lyrics on the lyrics canvas using the lyrics pen and the lyrics data model. This embodiment solves the technical problem of low efficiency in drawing lyrics in vehicle cockpits in the prior art, improving the smoothness of lyrics display, the responsiveness of interaction, and the user-friendliness of the user experience.

The present invention proposes an information processing device, an information processing method, and an information processing program that promote the improvement of the range of application and diversity of generation in singing voice synthesis technology. An information processing device according to the present disclosure comprises: a first estimation unit that estimates a first feature amount from lyrics; a second estimation unit that estimates a second feature amount from performance data obtained by converting musical performance information into data and the first feature amount; and a generation unit that generates a singing voice on the basis of the first feature amount and the second feature amount.

This invention relates to the fields of audio signal processing and artificial intelligence, specifically to a lyrics alignment method and electronic device based on automatic speech recognition. The lyrics alignment method based on automatic speech recognition in this application uses a pre-trained automatic speech recognition model to recognize audio samples and generate recognized text. The edit distance sequence between the recognized text and the lyrics text is calculated, and spoken segments are determined by analyzing the distance change pattern through a sliding window. These spoken segments are then replaced with silent segments, effectively eliminating spoken segments and avoiding interference from non-lyric content in the alignment process, thus laying the foundation for subsequent alignment.

The disclosure relates to generating audio-based and / or audiovisual-based music content using a generative model. Implementations relate to generating music content comprising at least lyric content and music authoring content using a generative model (GM). A processor of a system may: receive user input associated with a client device of a user, the user input including a request for music content; generating music content; and causing the music content to be audibly rendered at the client device. In some implementations, a processor may cause a single GM to process a GM input, including at least a user input, to generate a GM output, and may determine lyric content and music authoring content based on the GM output. In other implementations, a processor may cause a plurality of GMs to process respective GM inputs (each GM input including at least a user input) to generate respective GM outputs, and may determine lyric content and music authoring content based on the respective GM outputs.

1. Name of the product in this design: Graphical User Interface for Music Playback on an Electronic Device. 2. Intended use of this design: for use in an electronic device. 3. The key design features of this product are its graphical user interface content. 4. The image or photograph that best illustrates the design's key features: the front view. 5. Purpose of the graphical user interface: The graphical user interface of this design is used for playing music. The main view is the music playback display page, which shows information such as the name of the music being played, lyrics, album art, and time progress. Users can click the button at the bottom of the screen to adjust playback settings. 6. Other situations requiring explanation: Other explanation: "××" in the interface represents variable text, and a single gray block represents the content screen.

In some embodiments, an electronic device displays time-synced lyrics of content items playing on an electronic device. In some embodiments, an electronic device displays representations of content items in a playback sequence on an electronic device. In some embodiments, an electronic device shares an item of content with another user account of another electronic device.

The invention discloses a dialect song generation method and device and a dialect song display method and device, and relates to the technical field of computers. The method comprises the steps of obtaining a first Chinese song and Chinese lyrics of the first Chinese song; dialect lyrics of the first Chinese song are generated through a language model according to the Chinese lyrics of the first Chinese song, and the dialect lyrics of the first Chinese song are used for describing semantics of the Chinese lyrics of the first Chinese song in a dialect language expression mode; a first dialect song corresponding to the first Chinese song is generated according to the first Chinese song, the dialect lyrics of the first Chinese song and the dialect pronunciation mapping relation through a song generation model, and the first dialect song is used for singing the first Chinese song through dialects. The dialect pronunciation mapping relation is established by adopting a pronunciation mode of at least one language to mark dialect pronunciation of the Chinese vocabulary. According to the method, a more accurate dialect pronunciation mapping relation is constructed, and the accuracy of dialect pronunciation in the first dialect song is improved.

1. The name of this design product: Bluetooth Speaker (Lyrics). 2. Purpose of this design product: This design product is used as a device for audio and lyrics output. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

The application discloses a song lyric display speed adjustment method, device, equipment, medium and product, and belongs to the technical field of audio processing. The method comprises the following steps: acquiring identification information corresponding to a second device associated with a first device, the first listener account is logged in on the first device, the second device is used for playing a song in the first device, and the identification information is used for distinguishing different second devices; displaying an adjustment entrance of a song lyric display speed for the second device based on the identification information; in response to a trigger operation on the adjustment entrance, displaying an adjustment result corresponding to the second device, the adjustment result comprising a song lyric display speed parameter obtained by adjusting the second device as a granularity; wherein the first device and the second device are connected through a wireless transmission connection mode. This mode allows users to adjust the corresponding song lyric display speed according to the characteristics of the second device to coordinate the corresponding relationship between different second devices and the song lyric display speed.

The embodiment of the invention provides a text recognition method and device, electronic equipment and a storage medium, and the method comprises the steps: recognizing a starting time point and an ending time point of a song for any song in a to-be-detected video, and enabling the to-be-detected video to comprise a textbox obtained through the recognition of a text line; extracting a plurality of video frames within a first preset duration range after the starting time point; respectively identifying the positions of the textboxes in the plurality of video frames, and overlapping the textboxes of the plurality of video frames according to the positions of the textboxes respectively corresponding to the video frames to obtain a lyric display area of the song; carrying out intersection and comparison calculation on the lyric display area and a textbox in a video frame between the starting time point and the ending time point of the song to obtain a lyric textbox containing lyrics; and obtaining lyrics of the song from the lyric textbox. According to the embodiment of the invention, the lyric recognition accuracy is improved.

1. Name of the product in this design: Lyrics translation module for word translation display and interactive graphical user interface on player page of electronic device. 2. Purpose of this design: An electronic device. 3. The key design features of this product are: the parts in the graphical user interface, and the parts not marked with dotted lines are the parts for which protection is required. 4. The picture or photo that best illustrates the key design points: Design 1 front view. 5. Design 1 is designated as the basic design. 6. Purpose of the graphical user interface: The overall appearance design of the interface is used to display the song playback page, display lyrics, control song playback, and display word translations based on the dictionary (words marked in Chinese lyrics will be switched to English words with Chinese translations, while words marked in foreign language lyrics will directly display the Chinese translations); the partial appearance design of the interface is used to display lyrics, control song playback, and display word translations based on the dictionary (words marked in Chinese lyrics will be switched to English words with Chinese translations, while words marked in foreign language lyrics will directly display the Chinese translations). 7. Human-computer interaction method of graphical user interface: In the main view of Design 1, the foreign language lyrics are displayed in the middle of the interface. The corresponding Chinese translation is displayed below the words marked by the dictionary in the lyrics. Users can click on the lyrics area to bring up the word list module. Design 2 uses the same human-computer interaction method as Design 1. In the main view of Design 3, the Chinese lyrics are displayed in the center of the interface. The words marked in the lyrics are switched to English words with Chinese translations. Users can click on the lyrics area to bring up the word list module. Design 4's main view is a landscape playback page, with foreign language lyrics displayed in the center of the interface. The corresponding Chinese translations are displayed below the words marked in the lyrics according to the dictionary. Users can click on the lyrics area to bring up the word list module. In the main view of Design 5, when the user clicks on the blank area in the middle of the interface, the lyrics are displayed in an immersive state, showing the interface changes from the main view of Design 5 to the interface change diagram of Design 5.

A text-to-speech engine creates audio output that includes synthesized speech and one or more media content item snippets. The input text is obtained and partitioned into text sets. A track having lyrics that match a part of one of the text sets is identified. The location of the track's audio that contains the lyric is extracted based on forced alignment data. The extracted audio is combined with synthesized speech corresponding to the remainder of the input text to form audio output.

The invention provides a lyric generation method, computer equipment and a storage medium, and belongs to the technical field of artificial intelligence. The method for generating the lyrics comprises the following steps: acquiring word indication information and reference lyrics, extracting word style characteristics of the reference lyrics, the word style characteristics comprising a first text for describing word styles, and generating target lyrics based on the word indication information and the word style characteristics. According to the method and the device, reference information of lyric creation of the large language model can be enriched by extracting the word-making style characteristics of the reference lyrics specified by the user, so that the efficiency of lyric auxiliary creation of the large language model can be improved.

The system according to the embodiment is intended for a singer to complete a piece of music alone.SOLUTION: A system according to an embodiment includes an information acquisition unit, a lyrics unit, a composition unit, and a singing unit. The information acquisition unit acquires information such as a conversation, a diary, and SNS. The lyrics unit generates lyrics based on the information acquired by the information acquisition unit. The composition unit composes a melody based on the lyrics generated by the lyric unit. The singing unit allows the user to sing into the melody composed by the composition unit.SELECTED DRAWING: Figure 1

The present invention discloses a method, system, device and storage medium for generating multilingual rhyming lyrics. A speech generation model is used to capture the pronunciation of words, and then rhyming word pairs are generated, greatly improving the rhyming quality of the generated words. At the same time, an autoencoder model with the rhyme as the starting input is adopted during the generation process, which can generate lyrics with more coherent semantics. Moreover, it supports the generation of multilingual lyrics, making the generated rhyming words more diverse.

The embodiment of the application discloses a training method of a rhyming lyrics model, a generation method and device of rhyming lyrics, and is used in the technical field of lyrics processing. The method comprises the following steps: determining an initial phoneme mapping relationship between a first pronunciation dictionary and a second pronunciation dictionary corresponding to a song sample based on a first phoneme sequence and a second phoneme sequence; checking the initial phoneme mapping relationships corresponding to a plurality of song samples with each other to obtain a target phoneme mapping relationship, and taking the target phoneme mapping relationship as a rhyming lyrics model. By determining the phoneme mapping relationship between the pronunciation dictionaries and taking the phoneme mapping relationship between the pronunciation dictionaries as the rhyming lyrics model, the rhyming lyrics model can be used to convert the song lyrics corresponding to the first pronunciation dictionary into the rhyming lyrics corresponding to the second pronunciation dictionary, so that the song lyrics corresponding to the first pronunciation dictionary can be more comprehensively converted into the rhyming lyrics corresponding to the second pronunciation dictionary.

The invention relates to a song recall method, computer equipment, a readable storage medium and a program product. The method comprises the steps of obtaining songs to be subjected to same song group recall from a plurality of different song data sources, and obtaining multi-modal feature representation of the songs according to song audio features, lyric semantic features and song name text features of the songs; according to the multi-modal feature representation of any two songs, determining the similarity between the first song and a plurality of second songs in the plurality of song data sources; the first song is any one song in a plurality of song data sources; the second song is a song except the first song in the plurality of song data sources; and according to similarity matching conditions corresponding to different recall scenes, screening similarities between the first song and the second songs to obtain a same song group recall result of the first song. By adopting the method, the effect of recalling the same song group can be effectively improved.

The invention relates to the field of intelligent cabin entertainment systems, in particular to a song processing method and device, a vehicle, a readable medium and a program product. The method comprises the following steps: acquiring lyric configuration information, wherein the lyric configuration information is used for indicating lyrics of songs to be sung displayed on each display interface; according to the lyric configuration information, lyrics in the to-be-sung song are controlled to be displayed on corresponding display interfaces, and lyrics sung by different users are displayed on different display interfaces. Thus, the different lyrics are controlled to be displayed on the different display interfaces, the lyrics sung by different users are displayed on the different display interfaces, then the user can clearly know the lyric part sung by himself, the defect that the user sinks by mistake due to the fact that the lyrics are displayed in a confused mode is effectively avoided, and the karaoke experience of the user is improved.