45 results about "Piano playing" patented technology

The invention relates to the technical field of intelligent pianos, in particular to a piano automatic playing driving method and system, and the method comprises the steps: obtaining first external data which is used for describing the position change of keys at first playing time; converting the first external data into discrete data, wherein the discrete data is associated with a time sequence label; the discrete data is sent to a main control module, and the main control module forwards the discrete data to a control unit of the exercise device; monitoring second external data of the key at the first moment, and searching a corresponding discrete position through time sequence label association according to the first moment; and calculating a difference value between the second external data and the discrete position, and outputting an adjusting current value through the difference value by adopting a closed-loop control algorithm. The invention provides a lossless built-in driving technology and a driving method, and based on the driving method, a low-cost and miniaturized exerciser can be adopted, so that automatic playing of the piano keys is realized under the condition that the original framework of the piano is not influenced.

The invention relates to the technical field of piano teaching and computers, discloses a multi-dimensional scoring auxiliary system and method in piano teaching, and aims to solve the problems that existing piano teaching is single in evaluation dimension, one-sided in data acquisition and lagged in feedback. According to the method, a five-dimensional scoring model covering rhythm, strength, timbre, posture and fingering is constructed by synchronously collecting a key triggering time sequence, an audio frequency spectrum, limb posture and finger joint tracks, and quantitative scores are output through time alignment, feature extraction and neural network fusion calculation. The system comprises a key sensing module, an audio acquisition module, a posture capture module, a score calculation module and an AR visual feedback module, and supports teaching suggestion generation, historical trend analysis, difficulty self-adaption and multi-person comparison functions. Through multi-modal data closed-loop evaluation and intelligent intervention, the teaching accuracy and individuation level are remarkably improved, and scientific quantification and efficient improvement of the piano playing ability are achieved.

The invention discloses a piano playing posture dynamic correction method and system based on multi-dimensional data, and relates to the technical field of posture correction, and the method comprises the steps: collecting the multi-dimensional data of a player in real time through vision, pressure and electromyographic signal sensors, and generating an original data set; performing cleaning, noise reduction and feature extraction on the original data set, generating a preprocessed data set, and extracting biomechanical feature parameters; based on the extracted biomechanical characteristic parameters, a biomechanical model reflecting the posture state and the potential deviation of the player is constructed, and through multi-dimensional data acquisition and fusion, deep learning model analysis and a closed-loop optimization system, the posture state and the potential deviation of the player can be analyzed. The problems that an existing piano playing posture correction method cannot dynamically monitor in real time, accurately recognize posture deviation, provide personalized correction suggestions and continuously optimize the correction effect are solved.

The invention discloses an AI-based piano practice assisting method, system and equipment and a medium, and the method specifically comprises the steps: carrying out the denoising and segmentation of sound data through employing a signal processing technology, extracting the finger key time sequence characteristics of motion data through employing a motion recognition algorithm, and obtaining a sound feature set and a motion feature set; based on the sound feature set and the action feature set, performing multi-dimensional analysis by adopting a bimodal Transform evaluation network to obtain a first evaluation score; acquiring emotional expression data of the learner during piano playing, and analyzing and processing the emotional expression data according to a preset emotional analysis model to obtain an emotional analysis result; and according to the first sentiment analysis result and the first evaluation score, a deep learning algorithm is adopted to classify playing styles and weak links of the learner, and a personalized improvement direction and a priority sequence are determined. According to the invention, comprehensive playing evaluation and sentiment analysis are provided for learners, and the efficiency and pertinence of piano practice are effectively improved.

The invention discloses a robot piano playing method, device and equipment and a medium. The method comprises the steps that a left-hand main melody music score, a right-hand main melody music score, a left-hand accompaniment music score and a right-hand accompaniment music score are determined according to the motion range of a mechanical arm; selecting at least one first main melody music score from the left-hand main melody music score and the right-hand main melody music score, and generating a first player music score according to the first main melody music scores and the accompaniment music scores by taking playing time as a constraint; generating a second player music score according to the second main melody music score which is not selected; and controlling the left and right hand mechanical arms to perform playing according to the first playing hand music score and the second playing hand music score so as to play the to-be-played track through the robot. The accompaniment music score is combined into the main melody music score to generate the playing music score by taking the playing time as a constraint, the main melody and accompaniment training can be played at the same time under the condition that left and right manipulators do not conflict, the fluency and harmony of playing are ensured, and the playing effect of the to-be-played track is improved.

The invention relates to the technical field of intelligent pianos, in particular to a driving system for automatic playing of a piano and the piano, the driving system adopts a lossless built-in driving module, the piano comprises a sounding module, and the sounding module comprises a linkage device and a hammer connected with the linkage device; ejector rods are arranged at the rear ends of the keys; the driving module comprises a motion device which is arranged at the rear end of the key and is provided with an output end which is arranged opposite to the rear end of the key; the motion device comprises a mover assembly which comprises a permanent magnet, and the first end and the second end of the permanent magnet are provided with a first metal section and a second metal section respectively; and the stator assembly comprises a conduit arranged on the periphery of the permanent magnet, and at least two groups of coils are reversely wound on the conduit. The invention provides a lossless built-in driving technology, that is, the invention provides a low-cost and miniaturized exercise device, and the exercise device can be built below the keys under the condition that the original framework of the piano is not influenced, so that the automatic playing of the keys is realized.

The utility model provides a piano score placing rack, which relates to the technical field of placing racks and comprises a bottom plate. The front end of the bottom plate is hinged to a backup plate capable of turning upwards, a supporting plate is hinged to the front of the backup plate, and the rear of the backup plate is supported on the bottom plate through a supporting plate; a plurality of angle limiting grooves are formed in the bottom plate in an array at equal intervals; the pressing needles are pressed on page corners on the two sides of the music score, and the pressing needles can be rotated to quickly release the limit for page turning when the music score is turned, so that better fluency is provided for playing the piano; under the condition of insufficient light, the lamp switch can be turned on to provide light for the music score through the light supplementing lamp; one end of the pen groove is open, the other end of the pen groove is closed, a notch A is formed in the end, where the pen groove is open, of the backup plate, and the writing pen is placed in the pen groove; according to the structural design, the writing pen is convenient to carry, and the writing pen can record the moments of thinking when playing the piano to help a user capture creation inspiration at each moment; the piano score placing rack solves the problems that a piano score is not easy to read quickly and the function is relatively single in the existing piano score placing rack.

The invention belongs to the technical field of multi-modal generation and audio and video synthesis, and relates to a piano playing audio and video joint generation model based on multi-modal MIDI guidance, and the overall structure of the piano playing audio and video joint generation model comprises three core modules: an MIDI to gesture (MIDI-to-Pose) module; a gesture-to-video (Pose-to-Video) generation module is used for generating a gesture (Pose-to-Video); the invention relates to a symbol-to-audio (Symbolic-to-Audio) generation module. The model provided by the invention can be applied to music education, virtual playing, music generation explaining, performance analysis and other scenes. According to the invention, the generated hand action, key knocking and piano sound are strictly aligned in time and semantics, and the real, synchronous and physically consistent piano playing video generation is realized.

The invention relates to the technical field of piano playing action analysis, and discloses a piano concert practice matching and analysis method, device and equipment and a storage medium. Physical energy input reflected by hammer impact speed is used as a force anchor point without depending on an audio signal; the motion organization reflected by the hand posture is used as a disambiguation basis, rhythm robust re-parameterization is realized by utilizing an accumulated energy progress axis, and matching and alignment models of energy and motion gating, monotonous alignment constraint and physical consistency constraint are introduced in a matched manner, so that the matching and alignment stability of exercise segments under the mute exercise condition is remarkably improved, and the exercise efficiency is improved. And meanwhile, a concert practice analysis result with interpretability on force organization and action organization can be output. Therefore, through scientific quantification of the playing technique, the problems that in a mute practice scene, a traditional method cannot reliably complete matching and alignment of the concerted practice units, and it is difficult to output a force and action concerted technique analysis result are solved.

The utility model discloses a piano playing posture auxiliary correcting device, and belongs to the technical field of posture auxiliary correcting devices.The correcting device comprises a stool body and a soft cushion arranged on the stool body, and a plurality of supporting legs are arranged at the lower end of the stool body at equal intervals; the stool body is provided with an adjusting assembly for adjusting and a correcting mechanism arranged on the adjusting assembly, and the correcting mechanism comprises a mounting block mounted on the adjusting assembly and a main rod oppositely arranged on the mounting block; the mounting block is arranged on the rotating wheel, the sleeve base rotationally connected to the mounting block is matched with the main rod, the fixing sleeve, the auxiliary rod and the chest supporting plate, after the mounting block moves to the position close to the piano, the sleeve base is rotated upwards by 90 degrees, and then the chest supporting plate is rotated to the position horizontal to the chest of a child. Active correction is provided for the chest of the child through the chest supporting plate, and the humpback condition in the exercise process is avoided.

The invention belongs to the technical field of educational appliances, and particularly relates to a piano playing posture auxiliary corrector which specifically comprises a lifting supporting mechanism, a seat plate, a supporting cushion mechanism, a leg supporting mechanism, a side supporting mechanism, a swing mechanism, an elbow supporting mechanism and a sitting posture detection mechanism. The cushion supporting mechanism is fixedly mounted above the seat plate, and an adjusting controller for controlling the lifting supporting mechanism, the cushion supporting mechanism and the leg supporting mechanism is fixedly mounted on the side face of the lifting supporting mechanism. Shoulder movement changes of a learner are monitored through the sitting posture detection mechanism, torque rotating shafts on the two sides are pulled when the upper limbs swing in the playing process, the movement state of the upper limbs is detected through the number of rotation turns, the speed and the direction of a rotation angle sensor, and when irregular postures such as unknown stooping and humpback occur, the posture of the learner can be corrected. A player is prompted to correct in time, a correct playing posture is kept, and a correct posture memory is formed.

The present application relates to the technical field of piano playing action analysis, and discloses a piano concerto practice matching and analysis method, device, equipment and storage medium, wherein physical energy input reflected by hammer impact speed is taken as a dynamic anchor point without relying on an audio signal, action organization reflected by a hand posture is taken as a disambiguation basis, rhythm robust reparameterization is realized by using an accumulated energy progress axis, a matching alignment model with energy and action gating, monotonic alignment constraint and physical consistency constraint is introduced, and the matching and alignment stability of practice segments under a mute practice condition is significantly improved, and meanwhile, a concerto practice analysis result with explainability for dynamic organization and action organization can be output. Therefore, the present application solves the problem that a traditional method cannot reliably complete concerto practice unit matching and alignment under a mute practice scene and cannot output dynamic and action collaborative skill analysis results by scientifically quantifying playing skills.

To provide a piano playing support tool that enables anyone to easily play the piano. SOLUTION: A staff for right-hand performance showing note names ("Do," "Re," "Mi," "Fa," "So," "La," "Si") and the right-hand numbers corresponding to those note names is printed on the music sheet 11. Also, a staff for left-hand performance is printed below the staff for right-hand performance on the music sheet 11, showing note names and the left-hand numbers corresponding to those note names.

To provide a simple practice instrument that allows a user to practice the correct fingering and the strength and weakness of hitting a keyboard required for playing the piano, and to easily practice even in places where there is no piano.SOLUTION: A piano training instrument of the present invention has a bottom plate, a plurality of keyboards, a support shaft portion, and an elastic member. The support shaft portion is clamped between a bottom plate end portion of the bottom plate and a keyboard end portion of the keyboards. The support shaft portion supports the keyboards rotatably via hinges provided for the respective keyboards and abuts against the keyboard end portion to regulate its movement. The elastic member is provided between the bottom plate and a predetermined location of the keyboards. The elastic member is a coil spring and is held by a holding plate provided on an upper surface of the bottom plate.SELECTED DRAWING: Figure 1

Provided herein are wearable devices which serve as joint training units, method of using the joint training units, and methods of making joint training units. The present disclosure provides joint training units to assist in training a person to adopt the correct hand or finger positioning during an activity. For example, these wearable training units can be used to encourage proper hand and finger positioning while a person is playing piano. Such training units train a subject to maintain proper hand or finger positioning in a manner which is superior to the existing training methods or devices, which provide reduced flexibility and convenience relative to those of the present disclosure.

1. The name of this design product: Piano Stool. 2. Purpose of this design product: A stool for sitting when playing the piano. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

The present application relates to the field of voice analysis, and particularly relates to a piano playing video generation method and device, computer equipment and storage medium. The method comprises: obtaining audio stream data; inputting the audio stream data into an audio encoder for encoding processing to obtain audio encoding; performing code conversion on the audio encoding through a piano video code conversion model to obtain a piano video code thin sequence; performing decoding processing on the piano video code thin sequence through a piano video code thin decoder to obtain piano video stream data; the piano video stream data refers to a video stream of a hand playing music corresponding to the audio encoding on a piano; and the piano video stream data and the audio stream data are merged to obtain a piano playing video. The present application converts the audio stream data into video stream data with a picture of a hand playing a piano, and finally generates a video containing both audio and a hand playing the audio on a piano, so that the video effect and quality are better, and user experience is improved.

The invention discloses a control method and device of a piano playing robot, the robot and a medium. The method comprises the steps of generating a first player music score and a second player music score according to a main melody music score and an accompaniment music score; determining a first target finger playing sequence and a second target finger playing sequence according to the finger index, the first scaling factor and the second scaling factor which are determined on the basis of the moving cost; and controlling the robot to play the first target finger playing sequence and the second target finger playing sequence. According to the invention, the first player music score and the second player music score are constructed through the main melody music score and the accompaniment music score, and fingers are distributed to the notes based on the moving cost, so that the moving time of the mechanical arm for playing the notes is shortened, and the playing fluency of piano tracks is improved. And meanwhile, the note starting time is adjusted through the scaling factor, so that the time error between the arrival time and the note starting time is reduced, and the playing fluency of the piano track is further improved.

The invention discloses an objective quantitative evaluation method for relieving psychological stress in piano playing, which comprises the following steps of: acquiring pulse wave signals of relaxation and stress states, extracting physiological characteristics, and classifying the two states based on the physiological characteristics; then, recording the playing moment, the playing key number and the playing duration during piano playing, collecting pulse wave signals after piano playing, and extracting physiological features; and finally, calculating rhythm accuracy and note accuracy in piano playing, and quantitatively evaluating the effect of piano playing on mental stress relief in combination with the synchronous change of the playing indexes and the physiological indexes. By quantitatively evaluating the psychological stress relieving effect of piano playing, a personalized music healing strategy can be formulated.

The invention relates to a method for generating professional piano sound, which comprises the following steps of: constructing a data set which comprises professional data of 10-hour piano sound; a training strategy of a multi-stage stream matching framework is adopted for training, and the stages are as follows: the first stage is supervised training: a multi-stream DiT framework is constructed based on stream matching, and video CLIP features and text FLAN-T5 codes are fused; performing cross-modal feature mapping in the Encodec audio potential space; the second stage is CoP guided learning: introducing an MIDI feature control generation module and a playing video to an MIDI feature predictor; the step-by-step generation comprises the following steps of: generating a top view, a multi-view and stylized audio; in the third stage, factorization contrast learning is adopted, audio and video sharing features and independent features are decoupled, and mutual information boundaries are optimized; a direct preference optimization method is adopted, fine tuning is carried out based on piano playing style preference data, and style controllability is improved. According to the invention, the professional piano sound can be generated based on the video-guided sound effect generation model.

The invention relates to the technical field of intelligent education, in particular to an AI auxiliary training system for piano playing skill and style analysis, which comprises a multi-modal data synchronization module, an acoustic feature extraction module, a kinematics feature extraction module, a multi-modal feature alignment module, a style matching and deviation analysis module and a personalized training scheme generation module. Performing space-time registration on the audio data and the image data of the piano user to obtain time sequence data; performing high-resolution sound spectrum representation on the playing audio stream to obtain an acoustic skill feature matrix; performing kinematic dynamics reconstruction on the time series data to obtain a kinematic state tensor; performing cross-modal confrontation alignment on the acoustic skill feature matrix and the kinematic state tensor to obtain a composite playing feature tensor; mapping the composite playing feature tensor into a playing style feature library to obtain skill deviation data; and performing directional optimization on the playing style feature library to obtain a personalized correction training scheme. The piano skill improvement efficiency can be improved.

The invention provides a piano playing robot control method and system in the technical field of piano playing robots. The method comprises the following steps: S1, creating a piano music transcription model and a key positioning model; s2, acquiring a large amount of historical piano music and historical key images, and constructing a music data set and an image data set; s3, training the piano music transcription model through the music data set, and training the key positioning model through the image data set; s4, deploying the trained piano music transcription model and the piano key positioning model to a piano playing robot; and S5, the piano playing robot obtains input real-time piano music, inputs the real-time piano music into the piano music transcription model to obtain a transcription file, inputs the collected real-time piano key image into the piano key positioning model to obtain a piano key physical position, and performs piano playing based on the transcription file and the piano key physical position. The piano playing device has the advantage that the piano playing quality is greatly improved.

The invention relates to the technical field of electronics and computers, in particular to a piano playing system based on gesture recognition and area detection and a construction method thereof, the piano playing system comprises an interactive terminal and a camera module, and a pygame library and a mediappe library are arranged in the interactive terminal; the camera shooting module is in signal connection with the interactive terminal, the interactive terminal generates an interactive window, the camera shooting module is used for displaying a shot hand picture on a screen of the interactive terminal, the pyrame library is used for drawing piano keys in the interactive window, and the media library is matched with the camera shooting module to detect joint points of a hand. The device is ingenious in design, light in weight and convenient to deploy on all platforms, only a single camera module is used for achieving three-dimensional interaction in a space area, the range of the keys can be freely adjusted in a gesture interaction mode, other specific wearable or projection devices are not needed, and the device requirement for playing is simplified.

This application relates to the field of piano teaching technology, and more particularly to a method for detecting the playing of an acoustic piano based on photoelectric information. It includes: installing sensors; sampling a reference playing process using the sensors to obtain a set of photoelectric reference signals; performing intensity and rhythm analysis on each photoelectric reference signal to obtain the photoelectric reference signal analysis results and establishing a playing detection model; sampling the actual playing process using the sensors to obtain a set of actual photoelectric signals; inputting the actual photoelectric signal set into the playing detection model, which uses the photoelectric reference signal set as the detection basis to perform intensity and rhythm detection on each actual photoelectric signal in the actual photoelectric signal set, and outputting the timing-based detection results of the piano keys during the playing process. The playing detection model of this application detects whether the piano keys were pressed accurately, and the intensity and rhythm of the corresponding actual photoelectric signals after the keys were pressed, thereby achieving comprehensive detection.

The embodiment of the invention provides a method and device for obtaining an operation motion path of a robot, and the method comprises the steps: determining the expected sinking amount of an end effector according to the kinematics data of a mechanical arm and the dynamics data of the end effector, and determining the sinking displacement constraint amount applied in the vertical direction according to the expected sinking amount; the vertical direction is perpendicular to the plane of the guitar body. Determining a collision risk area of the robotic arm and a piano body structure of the piano, and determining an obstacle avoidance path according to the collision risk area; and determining an operation motion path of the robot according to the displacement constraint quantity and the obstacle avoidance path. According to the method, the sinkage of the end effector is predicted through the kinematics data of the mechanical arm and the dynamics data of the end effector, when the operation motion path is planned, the obstacle avoidance path determined through the collision risk area of the mechanical arm and the piano body structure is comprehensively considered, the collision interference of the mechanical arm and the piano body can be reduced, and the working efficiency is improved. And the misoperation probability in piano playing is further reduced.

The invention relates to the field of piano music score accessories, in particular to a folding music score fixing device for piano playing, which comprises a piano music score self-page-turning assembly, and a music score fixing assembly is detachably connected to the front end of the piano music score self-page-turning assembly. The reset spring drives the extension plate to be pushed out to complete unfolding, the base is pushed to reset during folding, rapid operation can be achieved, and the folding device is compact and easy to carry after being folded; the automatic page turning needs to be performed after being unfolded to fix the music score without turning, the music score to be turned is fixed on the two L-shaped brackets and is realized by driving the brackets to turn through the driving mechanism, manual page turning is not needed, continuous playing is ensured, magnetic attraction fixation is stable, and the music score is adaptive to multiple pages of tracks; the angle of the adjustable anti-scratching adsorption device is adjusted through the angle adjusting shaft and the bendable component, the rotary knob is rotated to enable the adjustable anti-scratching adsorption device to be tightly adsorbed to the piano after the position of the suction cup is adjusted, multi-angle adjustment can be achieved to meet the requirement, scratching is prevented, and adsorption is stable.

The present application relates to a piano gesture recognition method for complex scenes and electronic equipment, the method comprises the following steps: using a YOLO model to identify the piano and gesture positions in a piano playing image, and generating a piano bounding box and a gesture bounding box respectively; in each bounding box, using a SAM model to extract the edges of the gesture and the piano, and segmenting the gesture area and the piano area, thereby screening effective gestures; using a key point detection algorithm to obtain a key point set on each effective gesture and a feature matrix of the key points, and constructing a graph structure; based on the graph and the gesture area data of the effective gestures respectively, obtaining local features and global features of the gestures; splicing the local features and the global features of the gestures to obtain final gesture features, and classifying the final gesture features to obtain a predicted label. Compared with the prior art, the present application has the advantages of screening effective gestures, improving the accuracy and reliability of gesture recognition, etc.

1. Name of the designed product: piano stool. 2. Use of the designed product: piano stool for playing piano. 3. Design points of the designed product: in shape. 4. Picture or photo showing the design points: perspective view.

1. The name of the designed product: piano stool. 2. The use of the designed product: a seat for a person playing a piano. 3. The design points of the designed product: the combination of shape, pattern and color. 4. The picture or photo that best shows the design points: perspective view. 5. The design contains color.

The utility model relates to the technical field of fixing supports, in particular to a digital piano music stand. The device comprises an adjusting frame and a placing plate, a fixing device is arranged outside the placing plate, the fixing device comprises two U-shaped plates, one sides of the two U-shaped plates are fixedly connected with the placing plate, two T-shaped grooves are formed in the inner sides of the U-shaped plates, T-shaped blocks are connected into the T-shaped grooves in a sliding mode, and the T-shaped blocks are connected with the adjusting frame in a sliding mode. A movable plate is fixedly connected to the sides, close to each other, of the two T-shaped blocks, two telescopic rods are fixedly connected to one side of the movable plate, the output ends of the two telescopic rods are fixedly connected with a pressing plate, the arc faces of the telescopic rods are sleeved with springs, and the two ends of the two springs are fixedly connected with the movable plate and the pressing plate correspondingly. According to the piano music stand, the problem that the music score is easy to fall off from the placement plate when the music score is turned during piano playing due to the fact that no measure for fixing the music score is taken on the traditional piano music stand and the music score placement plate is solved.