Disc eagle kite dynamic driving classical dance partner shadow generation system and method

Abstract

This invention belongs to the field of dance lighting and motion capture technology, and discloses a classical dance lighting generation system driven by a hawk kite. The system includes a collaborative acquisition module, a collaborative processing module, a lighting generation module, and an output control module. The collaborative acquisition module is used to synchronously acquire classical dance movement data, hawk kite dynamic data, and flight tool operation data. Through multi-unit collaborative acquisition and millisecond-level synchronous calibration, it accurately captures synchronous data of classical dance movements, hawk dynamics, and flight tool operations. Standardized preprocessing and collaborative feature fusion effectively eliminate heterogeneous differences in multi-source data, significantly reducing the threshold for cross-subject collaborative driving. Combined with an LSTM model and a multi-style lighting library, it accurately maps hawk acrobatics and classical dance postures into dynamic lighting, significantly improving the artistic fit between lighting and the performance scene. Relying on multi-device, multi-dimensional, low-latency projection, it constructs an immersive performance experience.

Description

Technical Field

[0001] This invention belongs to the field of dance lighting and motion capture technology, specifically a system and method for generating lighting for classical dance accompaniment driven by a kite. Background Technology

[0002] The eagle kite is a soft-winged eagle-shaped sport kite that simulates a real eagle soaring freely at high or low altitudes. Based on the eagle's form, it uses a special structural design to achieve a similar soaring flight posture to a real eagle in the air. It is a perfect combination of traditional Chinese kite art and modern sport kite technology.

[0003] Classical dance lighting systems often rely on single-person motion capture, lacking coordination with external dynamic art carriers, resulting in insufficient artistic fit between lighting effects and performance scenes. The eagle kite, a traditional folk art, possesses high dynamic artistic value with its acrobatic movements such as figure-eight ascents, rapid and slow circling, and diving flips. However, existing eagle motion capture is only used for control optimization and not integrated with dance art. Furthermore, multi-source motion data (human movements, kite motion, and flying tool operations) suffers from heterogeneous sampling frequencies, coordinate system differences, and time asynchrony, making collaborative driving difficult. Therefore, a technical solution capable of achieving cross-subject motion collaborative capture and lighting mapping is urgently needed. Summary of the Invention

[0004] The purpose of this invention is to provide a system and method for generating light and shadow effects for classical dance accompaniment using a dynamic-driven eagle kite, in order to solve the problems mentioned in the background art.

[0005] To achieve the above objectives, the present invention provides the following technical solution: a classical dance accompaniment light and shadow generation system dynamically driven by a kite, comprising a collaborative acquisition module, a collaborative processing module, a light and shadow generation module, and an output control module: the collaborative acquisition module is used to synchronously acquire classical dance movement data, kite dynamic data, and flying tool operation data; the collaborative processing module preprocesses, fuses features, and makes collaborative decisions on multi-source data, and outputs light and shadow control parameters; the light and shadow generation module generates stylized light and shadow driving signals based on the control parameters; and the output control module drives the light and shadow device to achieve synchronous projection.

[0006] Preferably, the collaborative acquisition module includes a classical dance movement acquisition unit, a kite dynamic acquisition unit, a kite launch tool acquisition unit, and a synchronization calibration unit. The classical dance movement acquisition unit consists of multiple inertial measurement units and at least two high-definition cameras. The inertial measurement units are worn on the dancer's key joints to collect joint motion data, and the cameras are used for multi-view shooting and 3D reconstruction of the movements. The kite dynamic acquisition unit deploys miniature inertial measurement units on the kite's head and wingtips, and installs barometric pressure sensors at the wing roots to collect kite attitude angle, acceleration, and flight altitude data. The total weight of the sensors is ≤30g. The kite launch tool acquisition unit installs a rotary encoder and torque sensor on the fork wheel to collect data on line release and take-up speed, line length, and control torque. The synchronization calibration unit uses GPS timing and a wireless synchronization protocol to achieve multi-source data timestamp alignment, with a synchronization error ≤10ms.

[0007] Preferably, the classical dance movement acquisition unit has 8-16 inertial measurement units with a sampling frequency of 80-120Hz, deployed at key joints of the head, shoulder, elbow, hip, knee, and ankle; the eagle dynamic acquisition unit has 2-4 inertial measurement units with a sampling frequency synchronized with the fork wheel acquisition unit.

[0008] Preferably, the collaborative processing module includes a preprocessing unit, a collaborative feature fusion unit, and a collaborative decision-making model. The preprocessing unit uses Kalman filtering for noise reduction, cubic spline interpolation, and standardization to map human body data to a unified skeletal template and convert kite data into a global coordinate system. The collaborative feature fusion unit extracts features such as the rate of change of dance joints, kite posture amplitude, and acceleration features of the fork reel line release and take-up, and uses a dynamic time warping algorithm to achieve time alignment and construct a collaborative feature vector. The collaborative decision-making model is based on an LSTM neural network-trained mapping model, takes the collaborative feature vector as input, and outputs parameters such as brightness, color, trajectory, and diffusion range.

[0009] Preferably, the light and shadow generation module has a built-in library of at least three light and shadow styles, including ink painting style, silhouette style, and flowing light style. Each style corresponds to the following action light and shadow mapping rules: when the eagle's pitch angle is greater than 30°, the light and shadow brightness is increased by 20%-40%; when the total angle of the upper limb joints in classical dance is greater than 180°, the light and shadow diffusion range is expanded to 1.5-2.5m.

[0010] Preferably, the output control module includes 3-6 laser projectors and 6-10 LED arrays, distributed around the performance venue, to achieve multi-dimensional light and shadow projection on the ground, screen and dancers' bodies, with a control delay of ≤50ms.

[0011] The specific steps for generating lighting and shadow effects for classical dance accompaniment using a kite-shaped eagle are as follows:

[0012] Step 1: Equipment calibration, including zero-bias calibration of the inertial measurement unit sensor, camera calibration, and calibration of the rotary encoder using the fork wheel test method. At the same time, the synchronous calibration unit is started to ensure equipment time synchronization.

[0013] Step 2: Collaborative data collection, synchronously acquiring and uploading data on dance movements, eagle dynamics, and fork wheel operation;

[0014] Step 3: Data processing. The raw data is denoised and interpolated, collaborative features are extracted and time-aligned, and then the processed data is input into the LSTM model to output control parameters.

[0015] Step 4: Light and shadow output. Based on the control parameters, a drive signal is generated to drive the light and shadow equipment to project synchronously and adjust dynamically.

[0016] Preferably, the calculation error of the take-up and release length after the fork wheel is calibrated in step one should not exceed 2%, and the fork wheel may be composed of one or more materials selected from wood, bamboo or carbon composite materials.

[0017] Preferably, the driving signal in step four adopts the DM×512 protocol framework with a transmission rate ≥250kbps.

[0018] The beneficial effects of this invention are as follows:

[0019] By leveraging multi-unit collaborative acquisition and millisecond-level synchronous calibration, synchronous data of classical dance movements, eagle dynamics, and flight tool operations are accurately captured. Through standardized preprocessing and collaborative feature fusion, heterogeneous differences in multi-source data are effectively eliminated, significantly reducing the threshold for cross-subject collaborative driving. Combined with an LSTM model and a multi-style lighting library, eagle acrobatics and classical dance postures are accurately mapped into dynamic lighting, significantly improving the artistic fit between lighting and performance scenes. Relying on multi-device, multi-dimensional, low-latency projection, an immersive performance experience is constructed, providing reliable technical support for the cross-border integration of traditional arts. This solves the problems of single-drive classical dance accompaniment lighting systems, unexplored artistic value of eagles, and difficulties in multi-source data collaboration. Attached Figure Description

[0020] Figure 1 This is a flowchart of the present invention. Detailed Implementation

[0021] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0022] like Figure 1 As shown in the figure, this embodiment of the invention provides a classical dance accompaniment lighting and shadow generation system dynamically driven by a hawk kite, including a collaborative acquisition module, a collaborative processing module, a lighting and shadow generation module, and an output control module: the collaborative acquisition module is used to synchronously acquire classical dance movement data, hawk kite dynamic data, and flying tool operation data; the collaborative processing module performs preprocessing, feature fusion, and collaborative decision-making on multi-source data, and outputs lighting and shadow control parameters; the lighting and shadow generation module generates stylized lighting and shadow driving signals based on the control parameters; and the output control module drives the lighting and shadow equipment to achieve synchronous projection.

[0023] The collaborative acquisition module breaks through the limitations of single data acquisition, simultaneously capturing dynamic data from three types of data: human body, eagle, and release tool, laying the foundation for cross-subject collaboration; the collaborative processing module solves the problem of heterogeneous multi-source data, outputting precise control parameters after preprocessing and feature fusion, reducing driving complexity; the light and shadow generation module integrates multiple style libraries, transforming eagle stunts and dance movements into dynamic light and shadow that fits the scene, enhancing artistic fit; the output control module enables low-latency synchronous projection from multiple devices, creating an immersive experience and providing efficient technical support for the cross-border integration of traditional arts.

[0024] The collaborative acquisition module includes a classical dance movement acquisition unit, a kite dynamic acquisition unit, a kite launch tool acquisition unit, and a synchronization calibration unit. The classical dance movement acquisition unit consists of multiple inertial measurement units and at least two high-definition cameras. The inertial measurement units are worn on the dancer's key joints to collect joint motion data, and the cameras are used for multi-view shooting and 3D reconstruction of the movements. The kite dynamic acquisition unit deploys miniature inertial measurement units on the kite's head and wingtips, and installs barometric pressure sensors at the wing roots to collect data on kite attitude angles, acceleration, and flight altitude. The total weight of the sensors is ≤30g. The kite launch tool acquisition unit installs a rotary encoder and torque sensor on the fork wheel to collect data on line release and take-up speed, line length, and control torque. The synchronization calibration unit uses GPS timing and a wireless synchronization protocol to achieve multi-source data timestamp alignment, with a synchronization error of ≤10ms.

[0025] The classical dance motion acquisition unit combines inertial measurement and multi-view shooting to accurately capture joint movements and three-dimensional motion details; the eagle dynamic acquisition uses lightweight miniature sensors to fully explore the dynamic data value of its acrobatic movements without affecting flight; the flight tool acquisition unit captures data on the release and take-off lines and control, supplementing cross-subject data dimensions; the synchronization calibration unit achieves multi-source data alignment within 10ms, completely solving the time asynchrony problem and laying a solid foundation for subsequent data fusion and collaborative driving.

[0026] Among them, the classical dance movement acquisition unit has 8-16 inertial measurement units with a sampling frequency of 80-120Hz, deployed at key joints of the head, shoulder, elbow, hip, knee, and ankle; the eagle motion acquisition unit has 2-4 inertial measurement units with a sampling frequency synchronized with the fork wheel acquisition unit.

[0027] The classical dance motion acquisition unit covers the core joints with 8-16 inertial measurement units, which can capture the delicate movements and joint dynamics of the dance without omission, ensuring the comprehensiveness of the data; the kite dynamic acquisition unit adopts a lightweight configuration of 2-4 inertial measurement units to avoid affecting the flight of the kite. Its sampling frequency synchronized with the fork wheel effectively eliminates the heterogeneous differences in multi-source data sampling and reduces the difficulty of subsequent fusion.

[0028] The collaborative processing module includes a preprocessing unit, a collaborative feature fusion unit, and a collaborative decision-making model. The preprocessing unit uses Kalman filtering for noise reduction, cubic spline interpolation, and standardization to map human body data to a unified skeletal template and convert kite data into a global coordinate system. The collaborative feature fusion unit extracts features such as the rate of change of dance joints, kite posture amplitude, and acceleration features of the fork reel line release and take-up. It achieves time alignment through a dynamic time warping algorithm to construct a collaborative feature vector. The collaborative decision-making model is based on an LSTM neural network-trained mapping model. It takes the collaborative feature vector as input and outputs parameters such as brightness, color, trajectory, and diffusion range.

[0029] The preprocessing unit improves data quality and unifies the coordinate system by using Kalman filtering for noise reduction, cubic spline interpolation, and standardization, eliminating heterogeneous differences. The collaborative feature fusion unit extracts key features and achieves precise time alignment through dynamic time warping to construct a complete collaborative feature vector. The decision model driven by the LSTM neural network accurately maps the feature vector to the lighting parameters, ensuring that the lighting effects are deeply consistent with cross-subject actions, providing high-quality and highly collaborative data support for subsequent lighting generation.

[0030] The light and shadow generation module has at least three light and shadow style libraries, including ink painting style, silhouette style, and flowing light style. Each style corresponds to the following motion light and shadow mapping rules: when the eagle's pitch angle is greater than 30°, the light and shadow brightness is increased by 20%-40%; when the total angle of the upper limb joints in classical dance is greater than 180°, the light and shadow diffusion range is expanded to 1.5-2.5m.

[0031] It has a built-in library of multiple lighting styles that can be adapted to different classical dance performance themes, enriching the artistic presentation. By clarifying the mapping rules between movements and lighting, eagle stunts and classical dance movements can be directly transformed into dynamic lighting changes such as brightness and diffusion range, achieving precise synchronization between cross-subject movements and lighting.

[0032] The output control module includes 3-6 laser projectors and 6-10 LED arrays, distributed around the performance venue, to achieve multi-dimensional light and shadow projection on the ground, screen and dancers' bodies, with a control delay of ≤50ms.

[0033] Three to six laser projectors and multiple LED arrays are distributed throughout the entire area to achieve multi-dimensional light and shadow wrapping of the ground, screen, and dancers' bodies, creating an immersive space without blind spots; the control latency is ≤50ms to ensure that the light and shadow and the eagle stunt and dance movements are linked in real time without lag, avoiding a sense of disconnect; the collaborative projection of multiple devices enriches the layers of light and shadow and the sense of spatial depth, enhances the visual impact, and makes the expression of cross-border art fusion more infectious, while taking into account comprehensive coverage and precise effect, greatly improving the overall quality of the performance.

[0034] The specific steps for generating lighting and shadow effects for classical dance accompaniment using a kite-shaped eagle are as follows:

[0035] Step 1: Equipment calibration, including zero-bias calibration of the inertial measurement unit sensor, camera calibration, and calibration of the rotary encoder using the fork wheel test method. At the same time, the synchronous calibration unit is started to ensure equipment time synchronization.

[0036] Step 2: Collaborative data collection, synchronously acquiring and uploading data on dance movements, eagle dynamics, and fork wheel operation;

[0037] Step 3: Data processing. The raw data is denoised and interpolated, collaborative features are extracted and time-aligned, and then the processed data is input into the LSTM model to output control parameters.

[0038] Step 4: Light and shadow output. Based on the control parameters, a drive signal is generated to drive the light and shadow equipment to project synchronously and adjust dynamically.

[0039] Step one ensures the accuracy and consistency of data collection through precise calibration and time synchronization of multiple devices, laying a solid foundation for collaboration. Step two simultaneously acquires three types of cross-subject data, filling the dimensional gaps of single-source acquisition. Step three, after denoising, feature extraction, and time alignment, combines an LSTM model to accurately output lighting and shadow control parameters, resolving the challenge of heterogeneous multi-source data. Step four achieves dynamic adjustment and synchronous projection of lighting and shadow, ensuring that the lighting and shadow are in real-time harmony with the performance. The entire process balances data quality and execution efficiency, providing a stable and efficient technical path for the cross-border integration of traditional arts.

[0040] In step one, the calculation error of the take-up and release length after the fork wheel is calibrated should not exceed 2%. The fork wheel can be made of one or more materials, such as wood, bamboo or carbon composite material.

[0041] The calculation error limit of ≤2% for the length of the take-up and release line strictly controls the accuracy of the data, providing a high-quality foundation for the collaborative fusion of multi-source data and avoiding deviations in light and shadow mapping due to length errors. The diverse selection of wood, bamboo and carbon composite materials not only preserves the traditional folk texture, but also utilizes the lightweight and high-strength characteristics of composite materials to make the fork wheels light, sturdy and easy to operate, without affecting the performance of the eagle stunt.

[0042] In step four, the driving signal adopts the DM×512 protocol framework with a transmission rate of ≥250kbps.

[0043] High-speed transmission enables millisecond-level command response, meeting the system's low-latency requirements and preventing the disconnect between lighting and performance; at the same time, it is highly resistant to interference and has stable transmission, ensuring accurate and synchronized output of parameters such as brightness and color, thus providing a solid core support for real-time linkage between lighting and cross-subject movements.

[0044] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0045] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A dynamic lighting and shadow generation system for classical dance accompaniment driven by a kite, comprising a collaborative acquisition module, a collaborative processing module, a lighting and shadow generation module, and an output control module, characterized in that: The collaborative acquisition module is used to synchronously acquire classical dance movement data, dynamic data of eagle kites, and operation data of flying tools; the collaborative processing module preprocesses, fuses features, and makes collaborative decisions on multi-source data, and outputs light and shadow control parameters; the light and shadow generation module generates stylized light and shadow driving signals based on the control parameters; and the output control module drives the light and shadow equipment to achieve synchronous projection.

2. The system for generating light and shadow for classical dance accompaniment using a dynamically driven eagle kite as described in claim 1, characterized in that: The collaborative acquisition module includes a classical dance movement acquisition unit, a kite dynamic acquisition unit, a flight tool acquisition unit, and a synchronous calibration unit. The classical dance movement acquisition unit consists of multiple inertial measurement units and at least two high-definition cameras. The inertial measurement units are worn on the dancer's key joints to collect joint motion data, and the cameras are used for multi-view shooting and 3D reconstruction of the movements. The kite dynamic acquisition unit deploys miniature inertial measurement units on the kite's head and wingtips, and installs barometric pressure sensors at the wing roots to collect kite attitude angle, acceleration, and flight altitude data. The total weight of the sensors is ≤30g. The flight tool acquisition unit installs a rotary encoder and torque sensor on the fork wheel to collect data on line release and take-up speed, line length, and control torque. The synchronization calibration unit uses GPS timing and wireless synchronization protocol to achieve multi-source data timestamp alignment with a synchronization error of ≤10ms.

3. The system for generating light and shadow for classical dance accompaniment using a dynamically driven eagle kite as described in claim 2, characterized in that: The classical dance movement acquisition unit has 8-16 inertial measurement units with a sampling frequency of 80-120Hz, deployed at key joints of the head, shoulder, elbow, hip, knee, and ankle; the eagle dynamic acquisition unit has 2-4 inertial measurement units with a sampling frequency synchronized with the fork wheel acquisition unit.

4. The system for generating light and shadow for classical dance accompaniment using a dynamically driven eagle kite as described in claim 1, characterized in that: The collaborative processing module includes a preprocessing unit, a collaborative feature fusion unit, and a collaborative decision-making model. The preprocessing unit uses Kalman filtering for noise reduction, cubic spline interpolation, and standardization to map human body data to a unified skeletal template and convert kite data into a global coordinate system. The collaborative feature fusion unit extracts features such as the rate of change of dance joints, kite posture amplitude, and acceleration features of the fork reel line release and take-up. It achieves time alignment through a dynamic time warping algorithm to construct a collaborative feature vector. The collaborative decision-making model is based on an LSTM neural network-trained mapping model. It takes the collaborative feature vector as input and outputs parameters such as brightness, color, trajectory, and diffusion range.

5. The system for generating light and shadow for classical dance accompaniment using a dynamically driven eagle kite as described in claim 1, characterized in that: The light and shadow generation module has a built-in library of at least three light and shadow styles: ink painting style, silhouette style, and flowing light style. Each style corresponds to the following action light and shadow mapping rules: when the eagle's pitch angle is greater than 30°, the light and shadow brightness is increased by 20%-40%; when the total angle of the upper limb joints in classical dance is greater than 180°, the light and shadow diffusion range is expanded to 1.5-2.5m.

6. The system for generating light and shadow for classical dance accompaniment using a dynamically driven eagle kite as described in claim 1, characterized in that: The output control module includes 3-6 laser projectors and 6-10 LED arrays, distributed around the performance venue, to achieve multi-dimensional light and shadow projection on the ground, screen and dancers' bodies, with a control delay of ≤50ms.

7. The method for generating lighting and shadow effects for classical dance accompaniment using a dynamically driven eagle kite according to claim 1, characterized in that... The specific steps are as follows: Step 1: Equipment calibration, including zero-bias calibration of the inertial measurement unit sensor, camera calibration, and calibration of the rotary encoder using the fork wheel test method. At the same time, the synchronous calibration unit is started to ensure equipment time synchronization. Step 2: Collaborative data collection, synchronously acquiring and uploading data on dance movements, eagle dynamics, and fork wheel operation; Step 3: Data processing. The raw data is denoised and interpolated, collaborative features are extracted and time-aligned, and then the processed data is input into the LSTM model to output control parameters. Step 4: Light and shadow output. Based on the control parameters, a drive signal is generated to drive the light and shadow equipment to project synchronously and adjust dynamically.

8. The method for generating lighting and shadow effects for classical dance accompaniment using a dynamically driven eagle kite according to claim 7, characterized in that: The calculation error of the take-up and release length after the fork wheel calibration in step one should not exceed 2%. The fork wheel can be made of one or more materials selected from wood, bamboo or carbon composite materials.

9. The method for generating lighting and shadow effects for classical dance accompaniment using a dynamically driven eagle kite according to claim 7, characterized in that: The driving signal mentioned in step four adopts the DM×512 protocol framework with a transmission rate of ≥250kbps.

Images