Ai multi modal MIDI signal generation by dynamic motion

Abstract

The invention provides an AI multi-mode music long board capable of generating MIDI signals through dynamic motion, the AI multi-mode music long board comprises a long board body, the upper surface of the long board body is provided with a pressure sensor assembly, the front part and the rear part of the lower surface of the long board body are rotatably provided with wheels through wheel shafts, the wheels are provided with speed sensors, and the speed sensors are connected with the pressure sensor assembly. A microcontroller and an accelerometer are arranged at the bottom of the long plate body, the pressure sensor assembly, the speed sensor and the accelerometer are all electrically connected with the microcontroller, and the microcontroller is wirelessly connected with intelligent terminal equipment; music is generated through dynamic movement, a multi-sensory expression mode is provided for hand slippery of long-board dance, the method can be used for real-time music creation in hand slippery dance, a music producer can be attracted to explore a new art form, a bridge is constructed between vision and hearing, and a user is helped to freely express himself / herself.

Description

Technical Field

[0001] The present invention relates to the fields of intelligent hardware, music production and sports entertainment technology, and in particular to an AI multimodal music longboard that generates MIDI signals through dynamic motion. Background Art

[0002] A longboard is similar to a surfboard or snowboard with wheels. Compared with an ordinary skateboard, it has a longer and wider board, larger, softer and wider wheels, longer battery life, better road adaptability, quicker learning time and better handling feel.

[0003] Modern longboard dance focuses on rhythm and self-expression, but existing longboards and music equipment fail to fully support skaters to seamlessly combine music and dance, resulting in a disconnect between dance and music expression. Therefore, instead of following the existing beat, it is better to let skaters create music in real time through their own movements.

[0004] Existing MIDI controllers and music production tools are usually limited to static environments, lack support for dynamic dance art, and lack multi-sensory interactive interfaces to help users express themselves in visual and auditory forms, making it difficult to capture the randomness and flexibility of movement and music interaction. Therefore, there is an urgent need for an AI multimodal music longboard that generates MIDI signals through dynamic movement, which can convert each dancer's movement into a music signal, thus providing a new way for dynamic art creation. Summary of the invention

[0005] The purpose of the present invention is to provide an AI multimodal music longboard that generates MIDI signals through dynamic movement to solve the problems existing in the above-mentioned prior art.

[0006] To achieve the above object, the present invention provides the following solutions:

[0007] The present invention provides an AI multimodal music longboard that generates MIDI signals through dynamic motion, comprising a longboard body, the upper surface of the longboard body is provided with a pressure sensor assembly, the front and rear parts of the lower surface of the longboard body are rotatably mounted with wheels through axles, the wheels are provided with speed sensors, a microcontroller and an accelerometer are provided at the bottom of the longboard body, the pressure sensor assembly, the speed sensor and the accelerometer are all electrically connected to the microcontroller, and the microcontroller is wirelessly connected to an intelligent terminal device.

[0008] Preferably, the pressure sensor assembly includes seven pressure sensor units, and the seven pressure sensor units are distributed on the board surface of the long board body.

[0009] Preferably, the pressure sensor unit comprises an upper acrylic plate, a silicone mesh sheet, a pressure sensor, a foam tape and a lower acrylic plate which are compounded in sequence from top to bottom.

[0010] Preferably, the pressure sensor is a pressure-sensitive touch sensor.

[0011] Preferably, the speed sensor is a Hall effect sensor.

[0012] Preferably, the accelerometer is a three-axis accelerometer.

[0013] Preferably, the microcontroller adopts an ESP32 type microcontroller.

[0014] Preferably, the microcontroller is wirelessly connected to the intelligent terminal device via Bluetooth.

[0015] Preferably, the smart terminal device is a smart phone or a smart watch.

[0016] Compared with the prior art, the present invention has achieved the following beneficial technical effects:

[0017] The present invention provides an AI multimodal music longboard that generates MIDI signals through dynamic motion, comprising a longboard body, a pressure sensor assembly being provided on the upper surface of the longboard body, wheels being rotatably mounted on the front and rear parts of the lower surface of the longboard body through axles, speed sensors being provided on the wheels, a microcontroller and an accelerometer being provided on the bottom of the longboard body, the pressure sensor assembly, the speed sensor and the accelerometer being electrically connected to the microcontroller, and the microcontroller being wirelessly connected to an intelligent terminal device; music is generated through dynamic motion to provide a multi-sensory expression method for longboard dancers, which can not only be used for real-time music creation in the dancers' dance, but also can attract music producers to explore new art forms, thereby building a bridge between vision and hearing and helping users to express themselves freely. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0019] Figure 1 The schematic diagram of the upper surface of the AI ​​multimodal music longboard for generating MIDI signals through dynamic motion provided by the present invention;

[0020] Figure 2A schematic diagram of the lower surface of an AI multimodal music longboard that generates MIDI signals through dynamic motion provided by the present invention;

[0021] Figure 3 An exploded diagram of a pressure sensor unit in an AI multimodal music longboard that generates MIDI signals through dynamic motion provided by the present invention. DETAILED DESCRIPTION

[0022] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] The purpose of the present invention is to provide an AI multimodal music longboard that generates MIDI signals through dynamic movement to solve the problems existing in the prior art.

[0024] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0025] Embodiment 1:

[0026] This embodiment provides an AI multimodal music longboard that generates MIDI signals through dynamic motion, such as Figure 1-3 As shown, it includes a longboard body 1, a pressure sensor assembly 2 is provided on the upper surface of the longboard body 1, wheels 4 are rotatably mounted on the front and rear parts of the lower surface of the longboard body 1 through axles 3, speed sensors 5 are provided on the wheels 4, a microcontroller 6 and an accelerometer 7 are provided at the bottom of the longboard body 1, the pressure sensor assembly 2, the speed sensor 5 and the accelerometer 7 are all electrically connected to the microcontroller 6, and the microcontroller 6 is wirelessly connected to the smart terminal device.

[0027] As an implementation method, the pressure sensor assembly 2 includes seven pressure sensor units, and the seven pressure sensor units are distributed on the board surface of the longboard body 1; the pressure sensor assembly 2 can capture the rider's footsteps and pedaling intensity in real time, and different sensor areas correspond to preset audio samples (such as drum beats, chords, sound effects, etc.), and specific sound effects can be triggered by pedaling; the pressure sensor assembly 2 generates different MIDI parameter values ​​(Velocity) according to the pedaling force, to achieve dynamic changes in volume, timbre, etc., and enhance the expressiveness of the music.

[0028] As an implementation mode, the pressure sensor unit includes an upper acrylic plate 21 , a silicone mesh sheet 22 , a pressure sensor 23 , a foam tape 24 , and a lower acrylic plate 25 which are compounded in sequence from top to bottom, thereby achieving effective packaging of the pressure sensor 23 .

[0029] As an implementation manner, the pressure sensor 23 is a pressure-sensitive touch sensor.

[0030] As an implementation method, the speed sensor 5 uses a Hall effect sensor, which can capture the sliding speed and map the speed value to the Tempo parameter of MIDI to dynamically adjust the rhythm of the music; when sliding, the user can speed up or slow down the rhythm of the music by changing the speed, so that the sliding action is synchronized with the beat of the music, creating a rhythm experience that is seamlessly integrated with the dance.

[0031] As an implementation method, the accelerometer 7 uses a three-axis accelerometer to detect the tilt angle (Pitch and Roll) of the longboard in real time, and convert the data into a MIDI control signal (CC signal) to adjust the pitch, filter parameters or add special effects (such as distortion, echo, etc.).

[0032] As an implementation method, the microcontroller 6 adopts an ESP32 microcontroller, which can integrate and analyze data from multiple sensors, eliminate noise and redundant signals, and ensure that the generated MIDI signals are accurate and stable.

[0033] As an implementation method, the microcontroller 6 is connected to the intelligent terminal device via Bluetooth wireless connection, and the data is transmitted to the intelligent terminal device in real time via Bluetooth MIDI protocol.

[0034] As an implementation method, the intelligent terminal device adopts a smart phone, which is installed with a dedicated music generation APP, and can also achieve seamless music creation and performance through other music production software (AbletonLive, LogicPro, etc.).

[0035] The present invention provides an AI multimodal music longboard that generates MIDI signals through dynamic movements. It generates music through dynamic movements and provides a multi-sensory expression method for longboard dance skaters. It can not only be used for real-time music creation in skater dance, but also attract music producers to explore new art forms, thereby building a bridge between vision and hearing and helping users to express themselves freely.

[0036] The present invention uses specific examples to illustrate the principles and implementation methods of the present invention. The above examples are only used to help understand the method and core ideas of the present invention. At the same time, for those skilled in the art, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. An AI multimodal music longboard that generates MIDI signals through dynamic motion, including a longboard body, characterized in that: A pressure sensor assembly is provided on the upper surface of the longboard body, wheels are rotatably mounted on the front and rear parts of the lower surface of the longboard body through axles, speed sensors are provided on the wheels, a microcontroller and an accelerometer are provided at the bottom of the longboard body, the pressure sensor assembly, the speed sensor and the accelerometer are electrically connected to the microcontroller, and the microcontroller is wirelessly connected to the smart terminal device.

2. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 1, characterized in that: The pressure sensor assembly includes seven pressure sensor units, and the seven pressure sensor units are distributed on the board surface of the long board body.

3. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 2, characterized in that: The pressure sensor unit comprises an upper acrylic plate, a silicone mesh sheet, a pressure sensor, a foam tape and a lower acrylic plate which are compounded in sequence from top to bottom.

4. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 3, characterized in that: The pressure sensor is a pressure-sensitive touch sensor.

5. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 1, characterized in that: The speed sensor adopts a Hall effect sensor.

6. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 1, characterized in that: The accelerometer is a three-axis accelerometer.

7. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 1, characterized in that: The microcontroller adopts an ESP32 microcontroller.

8. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 1, characterized in that: The microcontroller is wirelessly connected to the intelligent terminal device via Bluetooth.

9. The AI ​​multi-modal music longboard for generating MIDI signals through dynamic motion according to claim 1, characterized in that: The smart terminal device is a smart phone or a smart watch.

Images