24 results about "Music visualization" patented technology

In one aspect, a music visualization method for light show is provided. According to the method, artificial intelligence neural network machine learning is adopted, and judgment standards of multiple music modes are defined through training, so that any song can be identified to be composed of one or multiple music modes through the music mode detection neural network. In another aspect, a music visualization device for light show is provided. According to the device, different light show styles can be selected according to different music modes by using a real-time artificial intelligence music mode detection / beat detection result, and then a cool acousto-optic effect is realized through combination of light elements arranged on the device and intelligent processing. The music visualization device can generate a light show effect matched with music intensity, intensity, emotion style and the like, and creates an audio-visual effect with immersive artistic appeal.

A method and system for visualizing music using a perceptually conformal mapping system are provided. A music source file is input into a processor configured to carry out a series of steps on audio cues identified within the music and ultimately generate a simultaneous visual representation on a display device. The series of steps include application of one or more perceptually conformal mapping systems that essentially induce a synesthetic experience in which a person can experience music both acoustically and visually at the same time. The device extracts cues from the music that are designed to specifically capture fundamentals of human appreciation, maps them into visual cues, then presents those visual cues synchronized with the source music.

The invention provides a multi-mode visual touch music sensing garment. The multi-mode visual touch music sensing garment comprises a garment body, and a sound sensor, an audio analysis module, a main processor, a plurality of lamp strips and at least one vibration motor which are arranged on the garment body, the sound sensor is used for collecting analog audio signals; the audio analysis module is used for performing spectral analysis on the analog audio signal, dividing the analog audio signal into a plurality of frequency bands and transmitting the frequency bands to the main processor; the main processor is used for selecting frequency values of different frequency bands and respectively mapping the frequency values to different lamp strips, and controlling the corresponding lamp strips to flicker along with rhythm; the vibration frequency is output according to the received audio signals of the multiple frequency bands, the corresponding vibration motor is controlled to vibrate according to the vibration frequency and the vibration intensity, and the vibration intensity changes along with the change of the amplitude of the audio signals. According to the music perception garment provided by the invention, music visualization and vibration touch are realized, multi-mode design and garment design are fused, and hearing-impaired people are helped to feel rhythm and wonderness of music in an immersive manner.

The invention provides a music visualization method and a music visualization device. The music visualization method comprises the following steps: acquiring a current frame signal of a target audio signal, and determining current frame parameter information based on the current frame signal; determining a target representation mode of the current frame signal based on the current frame parameter information; a visual representation of the current frame signal is generated based on the target representation pattern.

An electronic device and a method for controlling the electronic device, the method including receiving an input of a command to reproduce music contents, determining audio characteristics information on the music contents and situation information on an environment where the music contents are being reproduced; and displaying a visualization effect of visualizing the music contents using the audio characteristics information and the situation information, and reproducing the music contents.

Systems and methods for visualizations of music may include one or more processors which receive an audio input, and compute a simulation of a human auditory periphery using the audio input. The processor(s) may generate one or more visual patterns on a visual display, according to the simulation, the one or visual patterns synchronized to the audio input.

1. The name of the product of this design: Display screen panel with music visualization graphical user interface. 2. Purpose of this design product: It is used to display various driving information of the car. Without interfering with the driver's normal observation of the road environment, more information can be displayed in front of the field of vision through the display device. 3. The design highlights of this appearance design product lie in the assisted driving prompt information interface on the product screen. 4. The picture or photo that best illustrates the key points of the design: main view. 5. No design points, other views are omitted. 6. The purpose of the graphical user interface: to play music in the parking state, display the music visualization animation and the song name of the relevant singer, and the music animation will make a waveform animation according to the music frequency; there will be a settlement prompt after the trip, showing the time taken, total distance, maximum speed, average speed and trip route of this trip. Including music player, music visualization wave animation, as well as end-of-trip settlement reminders, gear position, weather, etc. 7. Other situations that need to be explained Other explanations: The final products of this design product include: mobile phones, car computers, speakers with screens, smart TVs, tablets, portable computers, desktop computers, navigation systems, car smart rearview mirrors, driving recorders, smart watches, and head-up displays.

The application discloses a music visualization method and device, a computer readable storage medium and a vehicle, wherein the method comprises: acquiring at least one frequency corresponding to an audio signal within a preset time before a current time; determining a frequency interval in which each frequency is located, and determining an amplitude corresponding to the frequency interval to obtain an amplitude corresponding to each frequency; wherein the frequency interval comprises a plurality of frequency intervals, each frequency interval has a corresponding amplitude; and controlling an atmosphere lamp according to each frequency and the amplitude corresponding to each frequency. Thus, the linkage between the atmosphere lamp and music can be realized, and different frequency characteristics of the vehicle-mounted music can be exhibited by controlling the atmosphere lamp, so that the visual presentation effect of the vehicle-mounted music is better, a more cool music atmosphere is created, and the user experience is improved.

The invention relates to the technical field of artistic artificial intelligence, in particular to a music-driven image generation method and system based on cross-modal alignment and a computer device, and the method comprises the steps: S1, obtaining a music audio clip and a text title and sentiment classification corresponding to the music audio clip; s2, performing feature extraction and normalization processing on the music audio clips to obtain audio embedding features; s3, the audio embedding features are mapped to a pseudo text embedding space, and audio pseudo text emotion features are obtained through a cross-modal alignment network; s4, fusing the audio pseudo-text emotion features with the text title features to obtain joint condition features; and S5, inputting the joint condition features into a diffusion model, and generating an image consistent with the music theme and the emotion features in the music audio clip. According to the method, the modal difference between the music and the image is effectively reduced, the semantic consistency and emotion expression of the generated result are improved, and the method is suitable for scenes such as music visualization and intelligent creation.

This invention discloses a music-assisted image generation method based on music theory element extraction. The method specifically includes: extracting six-dimensional fine-grained structured music theory semantics from audio using a multimodal large language model and performing cross-modal consistency verification; constructing a neutral scene description based on the NSA (Neutral, Concise, White Space) principle to provide a semantic whiteboard; intelligently translating music theory elements into visual modification instructions using the large language model, adaptively rewriting the neutral scene to generate fusion prompts; and using the FastVAR model for efficient image generation. Compared with existing technologies, this invention effectively solves the problems of black-box feature extraction and semantic alignment ambiguity in audio-driven generation, eliminates logical conflicts caused by cross-modal splicing, and achieves high-quality generation while ensuring high-fidelity image texture details and semantic consistency. The method is intelligent and efficient, and has good application prospects in the fields of intelligent art creation and music visualization.

The disclosure provides a system for music visualization and a loudspeaker system including the system for music visualization. The system may comprises: a passive radiator configured to be movable in a direction of excursion while music is being played; a plurality of lenses operably attached to the passive radiator and configured to move together with the passive radiator; and a plurality of light sources disposed relative to the plurality of lenses so that the light emitted from the plurality of light sources passes through the plurality of lenses and is projected on an environment surface to form at least one projected area.

The invention belongs to the technical field of music propagation and art algorithms, and particularly discloses a music and light visualization method based on acousto-optic mapping, which comprises the following steps: acquiring and pre-analyzing and extracting an audio signal through a real-time microphone acquisition or preset audio input mode; noise in the audio signals is filtered out through an adaptive filtering algorithm, a normalization algorithm and a dynamic compression method, the uniformity and stability of the audio signals are improved, audio details are amplified, and the preprocessed audio signals are obtained; constructing a multi-layer convolutional neural network model, inputting the preprocessed audio signal into the multi-layer convolutional neural network model, and extracting music features based on Mel frequency scale; establishing a multi-dimensional acousto-optic parameter mapping relation based on the music characteristics and the light characteristic parameters; and generating and outputting a light signal according to the mapping relation, thereby realizing music and light visualization. According to the method, the problems of singleness, insufficient stability, high delay and limited application in the traditional music visualization technology are solved.

The disclosure provides a system for music visualization and a loudspeaker system including the system for music visualization. The system may comprises: a passive radiator configured to be movable in a direction of excursion while music is being played; a plurality of lenses operably attached to the passive radiator and configured to move together with the passive radiator; and a plurality of light sources disposed relative to the plurality of lenses so that the light emitted from the plurality of light sources passes through the plurality of lenses and is projected on an environment surface to form at least one projected area.

An electronic device and a method for controlling the electronic device, the method including receiving an input of a command to reproduce music contents, determining audio characteristics information on the music contents and situation information on an environment where the music contents are being reproduced; and displaying a visualization effect of visualizing the music contents using the audio characteristics information and the situation information, and reproducing the music contents.

The invention discloses a music driving fluid generation method and system based on multi-dimensional semantic mapping, and belongs to the technical field of computer graphics and audio signal processing. The method comprises the following steps that music input by a user is received, characteristics such as rhythm, frequency spectrum and energy are obtained through audio analysis, and emotion vectors and color information changing along with time are obtained through a music emotion recognition and color palette generation module; in a unified parameter space, the audio, emotion and color semantics are mapped into fluid colors, fluid simulation parameters and camera and environment control parameters, and fluid models such as shallow water waves or height fields are driven to generate multi-style fluid scenes changing along with music. Compared with an existing music visualization mode which only depends on frequency band energy to drive simple and special effects, the method can achieve consistent expression of music emotion, rhythm, fluid form and audio-visual atmosphere in multiple scenes, and can be applied to scenes such as music visualization, immersive interactive art display and emotion relaxation assistance.

The application belongs to the technical field of music propagation and artistic algorithm, and specifically discloses a music and light visualization method based on sound-light mapping, which comprises the following steps: collecting and pre-analyzing and extracting audio signals through real-time microphone collection or a preset audio input mode; filtering out noise in the audio signals, improving the uniformity and stability of the audio signals, and amplifying audio details through an adaptive filtering algorithm, a normalization algorithm and a dynamic compression method, so that preprocessed audio signals are obtained; a multi-layer convolutional neural network model is constructed, the preprocessed audio signals are input into the multi-layer convolutional neural network model, and music features are extracted based on a mel-frequency scale; a multi-dimensional sound-light parameter mapping relationship is established based on the music features and light feature parameters; and light signals are generated and output according to the mapping relationship, so that music and light visualization is realized. The application solves the problems of single nature, insufficient stability, high delay and application limitations in traditional music visualization technology.

On the one hand, a music visualization method for light shows is provided. The method uses artificial intelligence neural network machine learning, which defines the judgment standards for multiple music modes by training. Therefore, any song can be identified as consisting of one or more music modes through a music mode detection neural network. On the other hand, a music visualization apparatus for light shows is provided. The apparatus can select different light show patterns according to different music modes by means of real-time artificial intelligence music mode detection / beat detection results, and light components arranged on the apparatus are combined with intelligent processing to achieve cool and dazzling sound and light effects. The music visualization apparatus can generate light show effects that match the intensity, severity, emotional style, etc. of the music to create an immersive and artistically appealing audio-visual effect.

A method and system for visualizing music using a perceptually conformal translation system are provided. A music source file is input into a processor configured to carry out a series of steps on music perception audio cues identified within the music, to translate those cues into visual cues, with rules for spatial arrangement, to ultimately generate a visual representation of the music on a display device, time synchronized with the audio music. The translation system produces an enhanced experience of music perception for the user listening to the music while viewing the display. The rules for spatial arrangement may allocate visual cues translated from music source components and music representation components to different parts of the display. The effect of that is to use spatial information to enhance music perception. The display may be enhanced by including video of the music performance or a music video associated with that performance.

The invention discloses a multi-ecology compatible acousto-optic interaction intelligent ceiling lamp system and a control method thereof, and belongs to the technical field of intelligent home and illumination, and the system comprises an intelligent sound box which comprises a main control module, a multi-mode communication and protocol compatible module, an illumination execution module, an entertainment illumination unit, a laser module and an audio collection module. Through ecological seamless integration, the pain point that a user is bound by a brand is solved, and the product universality and the user experience are greatly improved; through high function fusion, three illumination technologies with different purposes are physically integrated, logic unification is achieved through an intelligent algorithm, and the full-scene requirement from practicability to entertainment is met; through an advanced acoustic feature extraction and multi-parameter mapping algorithm, a professional music visualization effect far better than that of an existing product is provided.

The application provides a music teaching man-machine interaction implementation system and method based on a cloud database, and belongs to the technical field of man-machine interaction and artificial intelligence. The system comprises a sound sensor, an image sensor, a cloud matching unit and a visual interaction terminal. The sound sensor comprises a music collection unit and a music playing unit. The music playing unit first plays first target teaching music. Then, the music collection unit collects real-time music rhythm sequences generated by a target person at present. The image sensor synchronously captures a body action sequence and an expression change sequence of the target person. The cloud matching unit matches at least one target matching music in the cloud database based on the real-time music rhythm sequences of the target person, the body action sequence or the expression change sequence. The visual interaction terminal compares the first target teaching music with the target matching music, and adjusts the first target teaching music. The technical scheme of the application can realize personalized music teaching based on artificial intelligence assistance.

A method of producing a graphical representation of a musical composition, the method including: (a) receiving music data indicative of at least the harmony and rhythm of the musical composition; (b) processing the music data to provide a set of harmonic data including a time series with one or more common harmonic features of the musical composition; (c) processing the music data to provide a set of rhythmic data including a time series with one or more common rhythmic features of the musical composition; and (d) forming a graphical representation of the musical composition including a grid with a first shaded region of the grid having a shading intensity based at least in part on the harmonic data and a second shaded region of the grid having a shading intensity based at least in part on the rhythmic data. The first and second shaded regions of the grid may overlap.

The invention relates to the technical field of intelligent control, in particular to a cloud-based starry sky top atmosphere lamp management system, which comprises an audio feature separation module, a music style sensing module, a lamp effect strategy matching module and a layered instruction synthesis module. According to the invention, the audio stream is deconstructed into the harmonic component and the non-harmonic component in real time, and the harmonic component and the non-harmonic component are respectively mapped to the slow gradual change of the background atmosphere lamp and the instantaneous flicker of starry sky lighting, thereby achieving the clear layering and harmonious coexistence of melody and rhythm in visual performance, avoiding the unclear mixing of the lamp effect, and achieving the intelligent recognition of the music style. The system can automatically match the macroscopic light effect template adapted to the current music genre, realizes high unification of the light effect and the music artistic style from the dimensions of color, dynamic range and the like, improves music visualization from physical response to emotional resonance level, and creates deep immersive audio-visual experience for users.

Systems and methods for visualizations of music may include one or more processors which receive an audio input, and compute a simulation of a human auditory periphery using the audio input. The processor(s) may generate one or more visual patterns on a visual display, according to the simulation, the one or visual patterns synchronized to the audio input.

The application belongs to the field of computer information technology, and particularly relates to a meditation music visual interaction and emotional healing method based on real-time driving of physiological signals. The method first acquires preferences through an interaction interface and establishes an individual emotional baseline using a collection device; in the healing process, heart rate, heart rate variability and skin electrical signals are collected in real time and multi-dimensional feature vectors are extracted; the feature vectors are input into an emotional state analysis model based on a regression algorithm, the real-time coordinates and offset vectors are calculated in a continuous emotional space composed of valence and arousal; a decision module calculates the acoustic regulation parameters and picture geometry regulation parameters of the meditation music according to the offset vector combined with the parameterized control logic; and the audiovisual picture is output in real time through a graphics rendering engine and closed-loop feedback adjustment is performed, guiding the user's emotion to smoothly migrate to the low-arousal high-positive-valence quadrant. The application constructs a dynamic mapping closed loop from physiological signals to audiovisual parameters, significantly improving the immediacy, accuracy and immersion of emotional intervention.