380 results about "Lyrics" patented technology

The invention discloses a VEM-Token vocal music emotion multi-mode token song sound and accompaniment deep learning method, which is different from an existing method that information is segmented into textual token lexical elements by artificial intelligence and then recognition is carried out on the textual token lexical elements. The method comprises the following steps: performing frequency spectrum processing on a vocal music file, detecting rhythm, segmenting the vocal music file subjected to frequency spectrum processing into a VEM-Token sequence according to the vocal music rhythm, establishing a VEM coordinate system, a VEM function and a VEM library according to multiple modes such as lyrics, singing sound, accompaniment, singer emotion, accompaniment emotion, video and image, performing VEM-Token identification, separating a singing sound stream and an accompaniment stream, and determining the vocal music according to a vocal music expert. And performing multi-modal emotion scoring on the vocal music sample, obtaining a VEM parameter by adopting supervised learning and deep learning algorithms, and learning to obtain the multi-modal emotion of the vocal music sample. For other vocal music works, vocal music multi-mode emotions can be recognized, and a lyric score, a VEM-Token song sound score, a VEM-Token accompaniment score and a VEM-Token music score are output. AI systems including a common large model and the like are accessed, and a vocal music agent Agent capable of listening to the singing and identifying the music score is developed.

The invention discloses a music generation method and device. The method comprises the steps of obtaining tone information in first audio data in response to triggering of a music generation event, and generating at least one tone coding vector based on the tone information; obtaining rhythm information in the second audio data, and generating at least one rhythm coding vector based on the rhythm information; obtaining target lyrics, performing word segmentation processing on the target lyrics, and converting each word segmentation unit in the target lyrics into a corresponding word segmentation unit vector; and inputting the at least one timbre coding vector, the at least one rhythm coding vector and the word segmentation unit vector into a pre-constructed music generation large model, and generating target music according to an output result of the music generation large model. According to the scheme, the decoupling of the timbre and the rhythm can be realized, so that the timbre duplicating of any timbre on any rhythm is realized, and the free generation of music by using the duplicated timbre and any rhythm can be realized.

The invention discloses a video generation method and device based on AIGC and a storage medium, and the method comprises the steps: extracting information expressed in lyrics of a song, generating a story summary according to the information expressed by the lyrics, and generating a corresponding story plot according to each lyric segment; inputting the lyric segments and the corresponding story lines into the artificial intelligence model, generating sub-shots corresponding to the lyric segments, and generating corresponding images / videos according to the sub-shots; and sorting and processing the images / videos corresponding to the sub-shots according to a time sequence to obtain song videos corresponding to the songs. According to the method, the video conforming to the artistic conception of the song can be efficiently generated, and the song video production efficiency and quality are improved.

The invention provides a song generation method, and relates to the technical field of artificial intelligence, in particular to the fields of natural language processing, content generation, deep learning and large models. The method comprises the following steps: selecting a target template from at least two candidate templates according to song theme description; the candidate template is used for describing a corresponding relation between a candidate lyric text and a candidate song melody in the song material; performing imitation writing on the target lyric text in the target template based on the lyric demand description through a lyric imitation writing model, and outputting imitation writing lyrics; the imitated lyrics are consistent with the target lyrics in text line number and word number in each line; the lyric imitation writing model is obtained by adopting a lyric corpus to supervise and finely adjust a pre-trained large language model; and synthesizing the imitated lyrics and the melody of the target song in the target template based on the corresponding relationship between the text of the target lyrics in the target template and the melody of the target song to generate a new song. The song generation quality can be ensured, and the song generation cost can be reduced.

The construction method of the VEM-Token vocal emotion multi-modal magic modification model is different from the natural language processing model NLP-Token which interprets music through text. Instead, the VEM-Token sound-to-text innovation model comes with vocal emotion multi-modal information. The model captures and aligns the music tempo of sample songs and user learning songs, identifies various modalities of vocal emotion, divides the file into word units based on tempo, obtains VEM parameters through supervised learning and reinforcement learning, and decomposes songs into vocals, accompaniment, and emotion. The magic modification model provides a multi-modal magic modification method for imitating sample songs, including vocals, accompaniment, emotion overtones, emotion fluctuations, learning to sing, voice cloning, lyrics, pitch calibration, ornaments, tempo length, rhythm speed, tempo strength, freedom, and multiple sample magic modification. It also provides member management, mobile and PC application systems, dedicated support hardware, and communication protocols including MIDI, making it easy to access popular AI large models, reducing model hallucinations, and forming AI vocal agents and AI karaoke.

The invention discloses an intelligent music playing method based on three-dimensional scene interaction, and relates to the technical field of three-dimensional interaction, and the method comprises the steps: extracting a music feature vector of an input audio, inputting a lightweight neural network to output a music genre label, loading a three-dimensional scene in a three-dimensional scene template library based on the music genre label, and generating an initial three-dimensional music space; materializing a control component in the three-dimensional scene into a three-dimensional interactive object, and detecting the position and posture of the hand of the user in the initial three-dimensional music space to perform music playing control; and driving a dynamic element in the three-dimensional scene based on the music feature vector to control the amplitude of a top light beam, the ripple radius and the particle spacing of the central region, and mapping to the initial three-dimensional music space. According to the method, playing, volume and lyric functions are materialized into interactive objects, gesture recognition is introduced, and natural, visual and low-delay three-dimensional interactive experience is achieved; and an intelligent music playing effect with high immersion, high degree of freedom and high consistency is achieved.

The invention discloses a song teaching template generation method and system, equipment and a program product. The method comprises the following steps: acquiring song audio information of a target song audio; wherein the song audio information comprises lyrics, lyric timestamps, time points corresponding to paragraphs and audio representation information; performing various intra-sentence teaching feature analysis on the lyric timestamps and the audio representation information of the target song audio, and marking various analyzed intra-sentence teaching features on lyrics; wherein the in-sentence teaching features comprise at least one of accent, treble, long tone, tremolo, gliding and breathing points; the singing difficulty feature comprises at least one of high pitch and long pitch; the skill features comprise at least one of tremolo and glide; on the basis of the time point corresponding to each paragraph and the audio representation information, performing in-segment teaching feature marking on the loudness gradient part of each paragraph in the lyrics of the target song audio; and generating a song teaching template based on the marked lyrics of the target song audio and outputting the song teaching template.

The utility model discloses lyric subtitle sound equipment, relates to the technical field of sound equipment, and aims to solve the problem that most of existing sound equipment in the market cannot synchronously display lyric subtitles when playing music, and adopts the following scheme that the lyric subtitle sound equipment comprises a box body, one end in the box body is connected with a main control board, and the other end in the box body is connected with a loudspeaker; the lower end of one side of the box body is connected with a loudspeaking assembly, the loudspeaking assembly is used for receiving, processing and amplifying audio signals, one end, close to the loudspeaking assembly, in the box body is connected with a display screen, the main control board is used for controlling the display content and the display mode of the display screen, and the lower end, away from the loudspeaking assembly, of the box body is connected with a transmission part. According to the lyric and music synchronous display device, the structure is novel, the display content and the display mode of the display screen are controlled through the main control board, synchronous display of lyrics and music is achieved, and richer and more vivid audio-visual experience is provided for users.

The invention relates to the technical field of vehicles, in particular to a lyric display method and device for a vehicle cabin, a vehicle and a storage medium, and the method comprises the steps: obtaining current audio data and current lyric data of target music; analyzing the current audio data, determining a current rhythm, a current melody and a current music label of the target music, and determining a target lyric style and a target dynamic background of the current lyric data from a preset lyric style library and a preset dynamic background library according to the current music label; and using a Unity 3D engine to render the current lyric data and the target dynamic background according to the target lyric style based on the current rhythm and the current melody, playing the current audio data, and displaying the rendered current lyric data and the rendered target dynamic background. Therefore, the rhythm and melody of the music are analyzed in real time, the lyric style and the background image are dynamically matched and rendered, the defects of a music system in the aspects of visual interactivity and immersion are overcome, and immersive personalized music experience is provided.

The invention discloses a Song poem music restoration model construction method and device. The construction method comprises the following steps: constructing a Song poem music data set; the Song poem music restoration model comprises a lyric-to-melody generation module which is used for generating melody according to input Song poems; the melody-to-aclasas generation module is used for generating an aclasas according to the melody; the melody-to-accompaniment generation module is used for generating an accompaniment according to the melody; the merging and restoring module is used for merging the melody, the unsold singing and the accompaniment to generate a complete music work; and training the constructed Song poem music restoration model by using the Song poem music data set to obtain a trained Song poem music restoration model. Compared with the prior art, high-quality restoration of the Song poem music is realized.

The invention relates to the technical field of information processing, in particular to a lyric generation method and device, an intelligent terminal and a storage medium. The method comprises the steps of obtaining a target demand and original lyrics of a target song, wherein the target demand comprises a target theme and a target style; extracting target lyric features of the original lyrics, wherein the target lyric features comprise structure information and rhythm information of the original lyrics; generating prompt words according to the target theme, the target style and the target lyric features; and inputting the prompt word into a target lyric generation model, and guiding the target lyric generation model to generate a new lyric meeting the target demand by reasoning according to the target theme, the target style and the target lyric feature. By adopting the method, the high-quality lyrics meeting the requirements can be generated, the labor and time cost of lyric creation is reduced, the efficiency of lyric creation is improved, and diversified inspiration sources are provided for creators.

The invention relates to the technical field of audio processing, and discloses an intelligent guitar with a karaoke singing function. Comprising the following steps: detecting singing sound of a user in real time, synchronously regulating and controlling audio signal path parameters between a built-in microphone and a loudspeaker, and eliminating delay and synchronization errors caused by transmission; the refresh rate of the display screen is automatically adjusted according to the working frequency of the lyric display module, so that the lyric display time is strictly synchronized with the rolling of the music progress bar to eliminate the display delay; performing multi-stage filtering processing on the acquired audio data sung by the user, and comparing the audio data with a preset standard intonation model to provide high-precision sound acquisition and accurate intonation judgment; and the optimal sound proportion and reverberation effect are ensured to be achieved under various playing conditions. According to the intelligent guitar with the karaoke singing function, real-time and accurate audio playing can be realized, the audio-visual experience of a user in scenes of listening to music, watching videos and the like is improved, and discomfort caused by asynchronism of sound and pictures is avoided.

Implementations relate to utilizing generative model(s) (GM(s)) to generate musical content that includes at least lyrical content and music composition content. Processor(s) of a system can: receive user input associated with a client device of a user that includes a request for the musical content, generate the musical content, and cause the musical content to be audibly rendered at the client device. In some implementations, the processor(s) can cause a single GM to process GM input (including at least the user input) to generate GM output and can determine the lyrical content and the music composition content based on the GM output. In other implementations, the processor(s) can cause multiple GMs to process respective GM inputs (each including at least the user input) to generate respective GM outputs and can determine the lyrical content and the music composition content based on the respective GM outputs.

1. The name of the product of this design: the main body of a graphical user interface for listening to music and chatting on electronic devices. 2. Purpose of the product of this design: an electronic device. 3. The key design features of this design product lie in the solid-line content of the graphical user interface; the dotted-line content does not constitute part of the design for which protection is sought. 4. The picture or photo that best illustrates the key points of the design: Main view of Design 1. 5. Designate Design 1 as the base design. 6. Purpose of the graphical user interface: The partial appearance design for which protection is requested is used for chatting and interacting in a music room, etc. 7. Human-computer interaction method of the graphical user interface: In the main view of Design 1, the user can click the arrow below the lyrics to close the chat area; can click the arrow to the right of "Listening Together" to view the user information of the person listening together; can also click the input bar at the bottom of the interface to chat and interact. The human-computer interaction method of Design 2 is the same as that of Design 1. 8. The overall interface design of this appearance product is used to display the information of the songs being played and the chat interaction content, so that users can listen to songs and chat together in the listening room.

This information processing system includes: an information generation unit that generates instruction information containing a first character string in which lyrics of a musical piece, sound of content, or text of a comic book is expressed in a first language and a constraint condition related to the length of a character string; and an information acquisition unit that acquires a second character string which is generated as a result of the processing of the instruction information by a trained generation model, the second character string resulting from conversion of the first character string into a second language different from the first language, under the constraint condition.

The embodiment of the invention provides an AI song editing method and device, electronic equipment and a storage medium, after a first song and a corresponding first lyric are generated, the first lyric of the first song is displayed, and the first song is audio data generated based on an artificial intelligence technology; in response to a modification instruction for a first character in the first lyrics, generating a second lyrics, the second lyrics including a second character corresponding to the playing timestamp of the first character; in response to generation of the second lyrics, a second song is generated based on the second characters, the second song comprises a target song segment and a non-target song segment, the target song segment is a song segment corresponding to the second characters, and the melody of the non-target song segment is the same as the melody of the corresponding song segment in the first song. The melody of the song is not changed while the lyrics are accurately modified, and the lyric modification flexibility and accuracy of the AI song are improved.

The invention discloses a somatosensory dance game method and device for a user-defined dance video and a computer readable storage medium. The method comprises the steps that keywords input by a user and used for the user-defined dance video are obtained; determining the dance level of the user; generating an accompaniment demand according to the keyword and the dance level; according to the accompaniment demand, generating an accompaniment meeting the accompaniment demand through a preset music model; according to the dance level, screening an adaptive initial dance action from a preset dance action library; according to the accompaniment and the initial dance movement, generating a dance movement sequence matched with the accompaniment; generating a lyric demand according to the accompaniment and the keyword; according to the lyric demand, generating lyrics meeting the lyric demand through a preset natural language model; and combining the accompaniment, the dance action sequence and the lyrics to generate a self-defined dance video. The method has the advantages of being capable of meeting personalized requirements of users and improving game experience of the users.

A variety of exemplary embodiments for editing music and user interface thereof are disclosed. In an exemplary embodiment, a method includes displaying a GUI that allows a user to edit music; wherein the GUI includes a melody region and a lyrics region, the melody region displays a melody portion of the music along the time axis and pitch axis, the lyrics region displays a lyrics portion corresponding to at least a part of the displayed melody portion, at least one pitch of the displayed melody portion and at least one character of the displayed lyrics portion corresponding to the at least one pitch are displayed, and substantially aligned along time axis, receiving a user input for modifying the displayed lyrics portion; and in response to the user input for modifying the lyrics portion, displaying a modified version of the lyrics portion on the lyrics region.

The embodiment of the present application discloses a method, device and computer-readable storage medium for generating music reviews, wherein the method comprises: obtaining a fusion feature vector of a target music, the fusion feature vector being composed of a concatenation of a lyrics feature vector of the target music and an audio feature vector of the target music; obtaining a preset vocabulary, the preset vocabulary including a plurality of preset vocabulary characters; determining the probability of each vocabulary character in the preset vocabulary generating each comment character in the comment text of the target music according to the fusion feature vector of the target music; obtaining the comment text of the target music based on the probability of each vocabulary character generating each comment character in the comment text. The present application can improve the quality of generating music reviews.

1. The name of the design product: Bluetooth speaker (with lyrics aurora projection). 2. The use of the design product: a speaker for playing music, decoration and as a display, while having the functions of displaying lyrics, lighting and projection. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: design 1 perspective view. 5. Design 1 is designated as the basic design.

A music generation method and apparatus, a device, and a storage medium. The method comprises: presenting an editing interface, the editing interface comprising a lyric editing control (310); in response to a selection of first lyric content in the lyric editing control, presenting a set of candidate lyric content, the set of candidate lyric content being generated on the basis of context information associated with the lyric editing control (320); determining target lyric on the basis of a selection of second lyric content in the set of candidate lyric content (330); and in response to receiving a music generation request, providing music content generated on the basis of the target lyric (340). The method can improve the lyric editing efficiency in a music generation process, thereby improving the music generation efficiency.

This invention provides a method, apparatus, storage medium, and electronic device for drawing lyrics in a vehicle cockpit. The method includes: responding to a lyrics loading request from a media source on a media display screen in the vehicle cockpit and acquiring the original lyrics data of the media source; constructing a lyrics data model of the original lyrics data using characters as units; initializing and configuring a set of control components for lyrics on a lyrics canvas of the media display screen; controlling the activation state of the control component set according to the lyrics loading state; calling a content drawing component in the control component set to configure a lyrics pen, and drawing lyrics on the lyrics canvas using the lyrics pen and the lyrics data model. This embodiment solves the technical problem of low efficiency in drawing lyrics in vehicle cockpits in the prior art, improving the smoothness of lyrics display, the responsiveness of interaction, and the user-friendliness of the user experience.

The present invention proposes an information processing device, an information processing method, and an information processing program that promote the improvement of the range of application and diversity of generation in singing voice synthesis technology. An information processing device according to the present disclosure comprises: a first estimation unit that estimates a first feature amount from lyrics; a second estimation unit that estimates a second feature amount from performance data obtained by converting musical performance information into data and the first feature amount; and a generation unit that generates a singing voice on the basis of the first feature amount and the second feature amount.

This invention relates to the fields of audio signal processing and artificial intelligence, specifically to a lyrics alignment method and electronic device based on automatic speech recognition. The lyrics alignment method based on automatic speech recognition in this application uses a pre-trained automatic speech recognition model to recognize audio samples and generate recognized text. The edit distance sequence between the recognized text and the lyrics text is calculated, and spoken segments are determined by analyzing the distance change pattern through a sliding window. These spoken segments are then replaced with silent segments, effectively eliminating spoken segments and avoiding interference from non-lyric content in the alignment process, thus laying the foundation for subsequent alignment.

The disclosure relates to generating audio-based and / or audiovisual-based music content using a generative model. Implementations relate to generating music content comprising at least lyric content and music authoring content using a generative model (GM). A processor of a system may: receive user input associated with a client device of a user, the user input including a request for music content; generating music content; and causing the music content to be audibly rendered at the client device. In some implementations, a processor may cause a single GM to process a GM input, including at least a user input, to generate a GM output, and may determine lyric content and music authoring content based on the GM output. In other implementations, a processor may cause a plurality of GMs to process respective GM inputs (each GM input including at least a user input) to generate respective GM outputs, and may determine lyric content and music authoring content based on the respective GM outputs.

1. Name of the product in this design: Graphical User Interface for Music Playback on an Electronic Device. 2. Intended use of this design: for use in an electronic device. 3. The key design features of this product are its graphical user interface content. 4. The image or photograph that best illustrates the design's key features: the front view. 5. Purpose of the graphical user interface: The graphical user interface of this design is used for playing music. The main view is the music playback display page, which shows information such as the name of the music being played, lyrics, album art, and time progress. Users can click the button at the bottom of the screen to adjust playback settings. 6. Other situations requiring explanation: Other explanation: "××" in the interface represents variable text, and a single gray block represents the content screen.

In some embodiments, an electronic device displays time-synced lyrics of content items playing on an electronic device. In some embodiments, an electronic device displays representations of content items in a playback sequence on an electronic device. In some embodiments, an electronic device shares an item of content with another user account of another electronic device.

The invention discloses a dialect song generation method and device and a dialect song display method and device, and relates to the technical field of computers. The method comprises the steps of obtaining a first Chinese song and Chinese lyrics of the first Chinese song; dialect lyrics of the first Chinese song are generated through a language model according to the Chinese lyrics of the first Chinese song, and the dialect lyrics of the first Chinese song are used for describing semantics of the Chinese lyrics of the first Chinese song in a dialect language expression mode; a first dialect song corresponding to the first Chinese song is generated according to the first Chinese song, the dialect lyrics of the first Chinese song and the dialect pronunciation mapping relation through a song generation model, and the first dialect song is used for singing the first Chinese song through dialects. The dialect pronunciation mapping relation is established by adopting a pronunciation mode of at least one language to mark dialect pronunciation of the Chinese vocabulary. According to the method, a more accurate dialect pronunciation mapping relation is constructed, and the accuracy of dialect pronunciation in the first dialect song is improved.

1. The name of this design product: Bluetooth Speaker (Lyrics). 2. Purpose of this design product: This design product is used as a device for audio and lyrics output. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

The application discloses a song lyric display speed adjustment method, device, equipment, medium and product, and belongs to the technical field of audio processing. The method comprises the following steps: acquiring identification information corresponding to a second device associated with a first device, the first listener account is logged in on the first device, the second device is used for playing a song in the first device, and the identification information is used for distinguishing different second devices; displaying an adjustment entrance of a song lyric display speed for the second device based on the identification information; in response to a trigger operation on the adjustment entrance, displaying an adjustment result corresponding to the second device, the adjustment result comprising a song lyric display speed parameter obtained by adjusting the second device as a granularity; wherein the first device and the second device are connected through a wireless transmission connection mode. This mode allows users to adjust the corresponding song lyric display speed according to the characteristics of the second device to coordinate the corresponding relationship between different second devices and the song lyric display speed.