133 results about "MIDI" patented technology

The construction method of the VEM-Token vocal emotion multi-modal magic modification model is different from the natural language processing model NLP-Token which interprets music through text. Instead, the VEM-Token sound-to-text innovation model comes with vocal emotion multi-modal information. The model captures and aligns the music tempo of sample songs and user learning songs, identifies various modalities of vocal emotion, divides the file into word units based on tempo, obtains VEM parameters through supervised learning and reinforcement learning, and decomposes songs into vocals, accompaniment, and emotion. The magic modification model provides a multi-modal magic modification method for imitating sample songs, including vocals, accompaniment, emotion overtones, emotion fluctuations, learning to sing, voice cloning, lyrics, pitch calibration, ornaments, tempo length, rhythm speed, tempo strength, freedom, and multiple sample magic modification. It also provides member management, mobile and PC application systems, dedicated support hardware, and communication protocols including MIDI, making it easy to access popular AI large models, reducing model hallucinations, and forming AI vocal agents and AI karaoke.

The invention relates to an MIDI cloud music system with intelligent analysis and teaching functions and a teaching method, and relates to the technical field of musical instruments. The system comprises a user terminal module which obtains playing data and uploads the playing data to a cloud end; the cloud server module is used for analyzing the MIDI data and generating feedback information and accompaniment data; the intelligent analysis and feedback module performs analysis according to the playing pitch, rhythm and strength, and generates error correction prompts, playing suggestions and visual comparison data; the automatic arrangement and accompaniment module generates an accompaniment track and an arrangement structure according to the selected music style, rhythm and playing characteristics, and sends the track and the structure to the user terminal module for playing; the personalized teaching management module is used for dynamically adjusting teaching contents and difficulty levels and pushing teaching resources according to the learning progress and the playing level; and the database module is used for storing playing records, intelligent analysis results, automatic arrangement information and personalized teaching resources. The application has the effect of improving the application value of the cloud music system and the user experience.

The application provides a note-level automatic singing transcription method based on target detection and language characteristics, comprising the following steps: step 1: converting a one-dimensional audio sequence into two-dimensional mel spectrum slice and phoneme posterior slice with similar width-height ratio through a preprocessing method of mel transformation, phoneme classification, linear intensity mapping and slicing; step 2: performing target detection on the mel spectrum slice and phoneme posterior slice, post-processing and time adjustment on the left and right boundaries of the boundary box obtained by target detection, and then obtaining the final start time and end time through decision screening; step 3: taking the lower boundary of the target detection boundary box as the fundamental frequency, obtaining the final fundamental frequency through peak value search, and then converting the final fundamental frequency to obtain the MIDI pitch value. The method can effectively improve the phoneme feature extraction effect, improve the phoneme posterior slice quality and improve the feature extraction and analysis effect, thereby improving the transcription accuracy.

The invention provides an AI multi-mode music long board capable of generating MIDI signals through dynamic motion, the AI multi-mode music long board comprises a long board body, the upper surface of the long board body is provided with a pressure sensor assembly, the front part and the rear part of the lower surface of the long board body are rotatably provided with wheels through wheel shafts, the wheels are provided with speed sensors, and the speed sensors are connected with the pressure sensor assembly. A microcontroller and an accelerometer are arranged at the bottom of the long plate body, the pressure sensor assembly, the speed sensor and the accelerometer are all electrically connected with the microcontroller, and the microcontroller is wirelessly connected with intelligent terminal equipment; music is generated through dynamic movement, a multi-sensory expression mode is provided for hand slippery of long-board dance, the method can be used for real-time music creation in hand slippery dance, a music producer can be attracted to explore a new art form, a bridge is constructed between vision and hearing, and a user is helped to freely express himself / herself.

An electronic device receives a source audio file from a user of a digital audio workstation and a target MIDI file, the target MIDI file comprising digital representations for a series of notes. The electronic device generates a series of sounds from the target MIDI file, each respective sound in the series of sounds corresponding to a respective note in the series of notes. The electronic device divides the source audio file into a plurality of segments. For each sound in the series of sounds, the electronic device matches a segment from the plurality of segments to the sound based on a weighted combination of features identified for the corresponding sound. The electronic device generates an audio file in which the series of sounds from the target MIDI file are replaced with the matched segment corresponding to each sound.

The invention relates to the technical field of artificial intelligence and music information processing, in particular to a multi-modal signal fusion music playing accuracy evaluation system. The system comprises a multi-modal signal synchronous acquisition module, a signal preprocessing and feature extraction module, a time domain alignment and event association engine, a hierarchical collaborative evaluation module and a comprehensive evaluation report generation module. Through high-precision synchronous acquisition of an MIDI instruction, an acoustic signal and a structural vibration signal, a nonlinear time domain alignment mechanism taking dynamic time warping as a core is constructed, accurate matching of a symbol event and a physical response is realized, and an alignment multi-modal event frame is formed; and collaborative quantitative evaluation of basic accuracy, technical skill and music expressive force is carried out through the hierarchical model. By adopting the technical scheme, full-link high-fidelity analysis from playing intention to physical presentation can be realized, and the accuracy, robustness and interpretability of evaluation are remarkably improved.

The invention discloses a musical instrument playing audio and video beautifying method and system based on artificial intelligence and a readable storage medium, and aims to solve the problems that in the prior art, wrong playing tones cannot be automatically repaired, the rhythm cannot be optimized, and audio and video synchronization cannot be ensured. The method comprises the following steps: after transcribing a playing audio into MIDI data, carrying out wrong tone repair (correcting wrong notes, supplementing leaked tones and deleting redundant tones) and rhythm beautification (adjusting a note time sequence) through music score alignment or a generative large model; for video beautification, after audio is extracted from the video and beautified, audio and picture synchronization is ensured by dynamically controlling the replacement amplitude. The method can significantly improve the accuracy, fluency and hearing quality of playing audios and videos, and is suitable for the fields of music education, performance later stage, intelligent musical instruments and the like.

A singing detection method and a singing detection system using the same are provided in the embodiments of the present invention. The singing detection method includes the following steps: performing packet trigger judgment to activate the detection function; conducting rhythm detection on the sound signal; performing pitch detection on the sound signal; quantizing the pitch detection data; converting the quantized data and rhythm detection data into MIDI note data; using the MIDI note data to judge rhythm and pitch changes; assigning weighted scores and comparing with a threshold score. Finally, it determines whether the sound signal is singing based on the total score. This method combines multiple musical feature analyses to identify singing voices through comprehensive scoring.

The present invention discloses a method, system, device and storage medium for automatic composition of guzheng music. The method includes: obtaining the numbered musical notation data of the guzheng, converting the numbered musical notation data of the guzheng into staff notation data, obtaining MIDI format data according to the staff notation data, and constructing a guzheng music dataset; obtaining the chorus part of each song in the guzheng music dataset, and using the chorus part and the full song as a training set; training a GRU network with the training set to obtain preliminary melody data after training; performing reinforcement learning training on the preliminary melody data to obtain music data with guzheng performance techniques; performing timbre conversion on the music data with guzheng performance techniques to generate music data with guzheng timbre. The present invention uses the gated recurrent unit GRU algorithm to generate the melody of guzheng string music, and then uses reinforcement learning to train in terms of folk guzheng techniques, making the generated music closer to real guzheng folk music, and can be widely applied to the field of automatic composition technology.

The invention describes an advanced musical control system based on the identification and tracking of physical objects on an infrared touch surface. Traditional musical controllers offer limited control possibilities. Existing controllers based on object tracking systems, on the other hand, are often bulky (when based on visual detection) or restricted to the use of conductive materials (in the case of capacitive controllers). In the proposed solution, object tracking is achieved by identifying groups of points (protrusions on the objects themselves) through an infrared detection system. The geometric configurations of these points uniquely identify and localize the objects, making it possible to detect data that, once processed through suitable protocols such as MIDI, TUIO, or equivalents, allow the user to control up to three sound parameters with each hand. The invention is intended for interactive musical performance and enables intuitive and compact control of sound parameters through physical objects.

The utility model discloses a hitting pad with a pickup atmosphere lamp, which comprises a hitting pad shell, the hitting pad shell comprises a lower shell and an upper shell, the pickup atmosphere lamp is arranged on the side of the hitting pad shell, the pickup atmosphere lamp comprises a circuit board provided with an LED lamp, the circuit board is provided with a light shield located above the LED lamp, and the light shield is provided with a light guide plate located above the LED lamp. A light shield is arranged on the upper shell, a light uniformizing film and a lampshade are arranged above the light shield, the light uniformizing film is located between the light shield and the lampshade, a lamplight display window is arranged on the upper shell, the lampshade is fixed on the lamplight display window, and the circuit board is fixed on the lower shell. The pickup atmosphere lamp is in a long strip shape and is arranged on the end side of the hitting pad, so that the hitting pad and the pickup atmosphere lamp are integrated, and the integrated function requirement of the MIDI hitting pad and the pickup atmosphere lamp is perfectly met on the basis of portability; the novel requirements of digital musical instrument fashionable people on correct music arrangement guidance and sound quality improvement of the pickup atmosphere lamp are met.

The invention relates to a method for converting an image into a music score, which comprises the following steps of: performing note identification on a note image to obtain an MIDI (musical instrument digital interface) file, and performing music score conversion on the MIDI file to obtain music score data. According to the method for converting the image into the music score, the recognized note data can be directly converted into the music score data in a standardized data format used by a music teaching system, the structural consistency of a score recognition result and an original music score is effectively improved, and the generated music score is closer to a manual input standard in visual and logic aspects; and the obtained music score data can also be used for conventional functions of a music teaching system.

The disclosure provides a wireless communication device, an electronic device, and a wireless communication method. A wireless communication device is connected to an electronic musical instrument and transmits and receives MIDI data input to and output from the electronic musical instrument to and from other wireless communication devices paired through wireless communication at a predetermined communication interval, the pair is formed with each of a plurality of the other wireless communication devices. The wireless communication device includes a communication interval setting part configured to set a communication interval of each pair to a different time interval; and a communication interval transmission part configured to transmit the communication intervals set by the communication interval setting part to the corresponding other wireless communication devices.

This application discloses a Vlog generation method and related apparatus. The method includes: acquiring video footage, the duration of the target Vlog, reference transition points, video emotional information, and a reference audio signal; determining the edited video footage, the transition points of the target Vlog, and reference background music information based on the acquired information; performing track splitting and transcription processing on the reference audio signal to obtain the MIDI score and phrase / section segmentation points of the reference audio signal; processing the reference audio signal according to the transition points of the target Vlog, the reference background music information, the MIDI score of the reference audio signal, and the phrase / section segmentation points of the reference audio signal to obtain the background music of the target Vlog; and obtaining the target Vlog based on the edited video footage and the background music of the target Vlog. Using the method of this application, Vlogs that meet the personalized needs of users can be obtained.

The present invention provides an intelligent interpretation system for entertainment venues and commercial space performances, including: a PC, an operating software is provided inside the PC, one side of the operating software is respectively provided with grandMA2 on PC software, beyond laser system, DJ system and LED system, one side of the grandMA2 on PC software is provided with stage lights and other related equipment, one side of the beyond laser system is provided with laser lights, one side of the DJ system is provided with speakers, one side of the LED system is provided with a screen, and the MIDI output and input are provided on one side of the operating software. The present invention provides an intelligent interpretation system for entertainment venues and commercial space performances. Since the intelligent interpretation system integrates various systems, it has a high degree of integration, greatly shortens the project engineering time, saves the labor cost of the entertainment venues in the later stage, has better system stability and artistic expression, increases the adaptability of the system, and facilitates the addition of various other systems.

The invention belongs to the technical field of multi-modal generation and audio and video synthesis, and relates to a piano playing audio and video joint generation model based on multi-modal MIDI guidance, and the overall structure of the piano playing audio and video joint generation model comprises three core modules: an MIDI to gesture (MIDI-to-Pose) module; a gesture-to-video (Pose-to-Video) generation module is used for generating a gesture (Pose-to-Video); the invention relates to a symbol-to-audio (Symbolic-to-Audio) generation module. The model provided by the invention can be applied to music education, virtual playing, music generation explaining, performance analysis and other scenes. According to the invention, the generated hand action, key knocking and piano sound are strictly aligned in time and semantics, and the real, synchronous and physically consistent piano playing video generation is realized.

The invention discloses a harmonic texture and sequence reasoning fused audio-to-MIDI method and system, and relates to the technical field of audio processing. Aiming at the problem of insufficient transcription accuracy of the existing polyphonic music, the method comprises the following steps: carrying out time-frequency transformation on the polyphonic music to generate a spectrogram; constructing a time-frequency target detection network, detecting notes based on harmonic comb texture features, and outputting a time-frequency bounding box; constructing a sequence inference network to extract time sequence context features; carrying out local alignment and weighted fusion on the time sequence context features by using a time-frequency bounding box by adopting an ROI-guided gating fusion mechanism; and inputting the fusion features into a decoder to generate an MIDI sequence, and correcting the note time value by using a time-frequency bounding box. According to the method, the visual texture features and the music sequence logic are effectively fused, and the time precision and robustness of polyphonic music transcription are remarkably improved.

The utility model discloses an MIDI and DMX interconversion device, which comprises an MCU module, a control panel and a plurality of interface modules, wherein the control panel and the interface modules are connected with the MCU module; the interface module is provided with at least one DMX interface used for DMX information communication and at least one MIDI interface used for MIDI information communication, and the MCU module can edit the conversion relation between DMX information and MIDI information through the control panel; when the MCU module receives any one of the DMX information or the MIDI information, the DMX information or the MIDI information can be converted into the corresponding MIDI information or the DMX information according to a preset conversion relation. Compared with the prior art, the interconversion of MIDI and DMX can be realized, so that a music player can quickly operate stage equipment such as lighting equipment, and a stage lamp player can quickly play MIDI musical instruments.

1. The name of the product of this design: MIDI keyboard (SMK‑37Pro). 2. Purpose of the product of this design: electronic keyboard used for music production, synthesis and playing. 3. The design key point of this appearance design product lies in the overall shape of the product. 4. The picture or photo that best illustrates the key points of the design: main view.

There are provided a method and a system for extracting singing voice phoneme duration. A singing voice phoneme duration extraction system using a MIDI according to an embodiment may receive phonemes converted from a text as input, and may output a prior probability distribution, may receive acoustic features as input and may output a posterior probability distribution, may convert the probability distribution, may perform monotonic alignment search by using information on MIDI duration, and may output a waveform which is a voice digital signal, based on input reflecting a result of extracting the phoneme duration.

An enhanced earplug device for noise suppression and entertainment lighting comprises a tubular housing with a removable tip portion for ear canal insertion and a visible light element. The device incorporates a quartz acoustic filter for high-fidelity sound preservation while reducing volume, and a vibration sensor detecting musical beats in the 20-250 Hz range for music-reactive lighting patterns. Bluetooth connectivity enables inter-device synchronization and mobile app control. A tap sensor integrated into the housing exterior provides intuitive gesture-based mode switching between static color, music-reactive, and synchronized operational modes. The system includes RF capabilities for professional venue integration via centralized controllers with DMX / MIDI connectivity, enabling coordinated lighting displays across multiple users in entertainment environments.

A novel interface is provided which supports simultaneous transmission of an audio signal and a MIDI signal. A signal continuous in predetermined units is transmitted to a receiving side via a prescribed transmission path. The signal continuous in predetermined units includes a signal of a first predetermined unit including an audio signal and a signal of a second predetermined unit including a MIDI signal. The audio signal is, for example, a linear PCM signal which constitutes a stereo 2-channel audio signal. The MIDI signal includes, for example, packet data having a prescribed length which is divided into a plurality of units, included in a plurality of signals in the second predetermined unit, and transmitted.

The invention provides a singing detection method and a singing detection system using the same. The singing detection method comprises the following steps: performing packet triggering judgment to start a detection function; performing rhythm detection on the sound signal; carrying out fundamental tone detection on the sound signal; carrying out quantization operation on the fundamental tone detection data; converting the quantized data and the rhythm detection data into MIDI note data; performing rhythm and pitch change judgment by using MIDI note data; weight scores are given and compared with threshold scores. And finally, judging whether the sound signal is singing according to the total score. According to the method, analysis of multiple music features is combined, singing sounds are recognized through comprehensive scores, singing sounds and non-singing sounds can be effectively distinguished without a high-performance processor or a large number of memories, and the application range of the singing detection technology in low-power-consumption and small-size equipment is greatly expanded.

The utility model provides an electronic musical instrument keyboard, including the face shell and bottom shell who butt joint into the casing, still include gyro wheel support structure, be located in the bottom shell inside, functional potentiometer, rotatable installation in gyro wheel support structure, cross section is semicircular functional gyro wheel, functional gyro wheel bottom direct surface sinks in the bottom shell inside, functional gyro wheel top stretches out the face shell upwards, functional gyro wheel center installation in functional potentiometer, gyro wheel reset spare, connect in gyro wheel support structure and functional gyro wheel between, reset buffer spare, be located in gyro wheel reset spare and gyro wheel support structure junction. The utility model provides electronic musical instrument keyboard under the diameter and rotation angle stroke limit optimization functional gyro wheel layout, realize MIDI keyboard thinning and portable, eliminate the larger rebound noise of shorter elastic arm in the limited space, satisfy individualized color selection while reducing the cost, realize assembly tolerance control, avoid partial deformation, warping in the assembly process, realize circuit board device integration module stacking and guarantee the plug assembly in place.

A method of generating an audio output file via a computer system includes receiving one or more audio files including musical tracks; separating each audio file into at least one selectable audio block; selecting an audio block and analysing the harmonic chord structure of the musical track; determining a new harmonic chord structure; and adapting the musical track to the new harmonic chord structure. The system for outputting an audio file includes a unique identifier module; a chord progression constructor; an instrument role allocator; a melodic DNA transposer; a musical elements analyst; an element selector module; an integration & adaptation module; a genre application module; an integration & adaptation module; and a genre application module. The system includes an interactive user editing control panel, aimed at offering extensive control over various musical aspects within an AI generated music track. The output file can be an audio file or MIDI file.

The invention discloses a method for generating symbol music with emotional conditions, and the method comprises the steps: S1, preparing a dataset which comprises a midi dataset and a piano roll dataset, the piano roll dataset is obtained through the preprocessing of the midi dataset, and the midi dataset and the piano roll dataset both comprise symbol music data containing classical music and popular music; s2, training a VAE network which is used for encoding the piano roll data into a hidden space; s3, pre-training a diffusion model; the diffusion model adopts a DiT architecture, and the diffusion model is trained on the piano roll data with the time sequence length of 10.24 s after segmentation; s4, using random control guidance SCG to carry out forward evaluation on an undifferentiated rule function, and working together with the diffusion model in a plug-and-play mode to realize undifferentiated rule guidance on the diffusion model; s5, setting a music emotion evaluation index MAV; and S6, setting a non-differentiatable rule function with an emotion condition to guide the diffusion model to generate a music clip meeting the emotion condition in a back diffusion process.

The utility model discloses a multifunctional time code synchronizer, which comprises an MCU (Microprogrammed Control Unit) module, a control panel connected with the MCU module, a power supply module connected with the MCU module, a plurality of interface modules and an interface circuit connected between the interface modules and the MCU module, the interface module at least comprises an MIDI IN interface and an MIDI OUT interface which can be used for transmitting an MIDI time code, an LTC IN interface and an LTC OUT interface which can be used for transmitting an SMPTE LTC time code, and an Ethernet port which can be used for transmitting an RTP MIDI time code and an ArtTimecode time code, and the MCU module can transmit and synchronize corresponding time code information through an interface circuit connected with the MIDI IN interface, the MIDI OUT interface, the LTC IN interface, the LTC OUT interface and the Ethernet port. Compared with the prior art, the device has the synchronization of the MIDI time code and the SMPTE LTC time code, and also has the network time codes of the ArtTimecode and the RTP-MIDI, so that the LTC time code can be transmitted more flexibly.

The invention provides a unified assistive technology system, the ADA Empathy Wearable Bundle, enhancing perception, communication, and self-expression for individuals with visual, auditory, or speech impairments.It integrates Empathy Glasses, Empathy Headphones, Word Articulation Guidance (WAGS), Word Articulation Response Monitoring (W.A.R.M.), and Conversational MIDI (C-MIDI), using AI-driven narrative interpretation, augmented reality, and blockchain-based security.The system delivers vivid narrative audio for blind users, multimodal AR overlays for hearing-impaired users, and real-time visual and auditory articulation guidance for speech-impaired or non-verbal users. A tone-based trust protocol ensures operational integrity, while blockchain storage preserves privacy and consent.Grounded in ethical AI, empathy, and human dignity, the system enables users to perceive, understand, and engage with the world fully, offering a holistic, compassionate, and transformative solution in assistive technology.

The invention discloses a symbol music generation method based on texture perception and adaptive representation alignment. The method is characterized by comprising the steps of conditional decoupling and extraction of multi-scale music element features, conditional coding, texture perception FLUX music model construction, adaptive representation alignment, MIDI file generation and the like. Compared with the prior art, the method has the advantages that the structural advantage and multi-scale information of the symbol music are fully utilized, the texture consistency, chord accuracy and style controllability of the generated music are remarkably improved, the training and reasoning cost is reduced, and the generalization ability and practicability of the model are further improved. Through the three-in-one design of'conditional decoupling, texture perception diffusion and self-adaptive expression alignment ', the problems of semantic loss, inconsistent texture, uncontrollable chord and the like caused by neglecting of internal association of music in a traditional method are effectively solved, and the method is efficient, reliable and easy to implement and has good application prospects in the fields of automatic composition, interactive music creation and the like.

Security clip locks for MIDI Heki