Unmanned aerial vehicle light show method and device, computer equipment and storage medium

Abstract

The invention discloses an unmanned aerial vehicle light show method and device, computer equipment and a storage medium, and the method comprises the steps: loading basic parameters to form a configuration file; loading the three-dimensional scene model according to the configuration file to serve as an unmanned aerial vehicle performance environment; loading an unmanned aerial vehicle dance step file, and analyzing the dance step file to obtain dance step data; simultaneously loading a music file and a special effect file corresponding to the dance step file, and extracting to obtain a music playing time axis and a special effect triggering time point; performing time synchronization on the dance step data, the music playing time axis and the special effect triggering time point to obtain a synchronous data set; and performing driving rendering on the synchronous data set and the unmanned aerial vehicle performance environment to obtain an unmanned aerial vehicle light show effect animation. By implementing the method provided by the invention, the full-process rehearsal of the light show of the unmanned aerial vehicle can be completed in the virtual environment without depending on the field debugging and rehearsal of the entity unmanned aerial vehicle, and the formation change and light switching effect of the unmanned aerial vehicle in the three-dimensional space can be completely restored.

Description

Technical Field

[0001] This invention relates to the field of drone light show rehearsal technology, and more specifically to drone light show rehearsal methods, devices, computer equipment, and storage media. Background Technology

[0002] Drone light shows are an emerging visual art form that uses multiple drones as the core carriers, employing precise formation control technology to enable the drones to move in unison, thereby creating dynamically changing light patterns. With its unique visual impact and flexible and diverse creative presentation methods, it has been widely applied in various scenarios such as large-scale events and celebrations, cultural and tourism attraction displays, festival-themed performances, and commercial brand promotions.

[0003] With the continuous advancement of drone formation control technology, the collaborative control precision and scale of drones have been significantly improved. Large-scale drone light shows have gradually become a highly attractive core performance form in various large-scale events, and market demand and application scenarios are constantly expanding.

[0004] However, the preparation and choreography of existing drone light shows still suffer from many technical challenges: Before the official performance, multiple on-site rehearsals are usually required to ensure the coordination of the formation movements and the synchronization accuracy of the light effects and background music. This not only consumes a lot of manpower and material resources but also has a lengthy preparation period. During the choreography design stage of the light show, creators need to repeatedly verify the matching relationship between the drone dance trajectories, light changes, and music rhythms. However, existing simulation platforms mostly adopt a fixed-view playback mode, which can only present the performance effect in the form of two-dimensional paths or script text. They cannot intuitively and realistically reproduce the movement trajectory and visual presentation of the drone formation in three-dimensional space, making it difficult for creators to accurately judge the choreography effect. In addition, after each adjustment to the light dance steps or music rhythm, on-site rehearsals or the regeneration of complete animation files are required. The adjustment feedback efficiency is low, and multi-angle free observation and real-time interactive control cannot be achieved, which seriously restricts the choreography efficiency and creative implementation speed of drone light shows.

[0005] Therefore, there is an urgent need for a technical solution that can solve the above-mentioned technical problems, improve the efficiency of drone light show choreography, reduce preparation costs, and achieve immersive and interactive previews, so as to meet the market demand for large-scale, high-precision drone light shows. Summary of the Invention

[0006] The purpose of this invention is to overcome the shortcomings of the prior art and provide a method, device, computer equipment and storage medium for drone light show rehearsals.

[0007] To achieve the above objectives, the present invention adopts the following technical solution: Methods for rehearsing drone light shows include: Load basic parameters to form a configuration file; The 3D scene model is loaded according to the configuration file to serve as the drone performance environment; Load the drone dance step file and parse the dance step file to obtain the dance step data; at the same time, load the music file and special effects file corresponding to the dance step file, and extract the music playback timeline and special effects trigger time points; Synchronize the dance steps data, music playback timeline, and special effects trigger times to obtain a synchronized dataset; Driven rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation.

[0008] The present invention also provides a drone light show rehearsal device, comprising: Load forming units, used to load basic parameters to form configuration files; The loading unit is used to load a 3D scene model according to the configuration file to serve as the drone performance environment; The loading and extraction unit is used to load the drone dance step file and parse the dance step file to obtain the dance step data; at the same time, it loads the music file and special effects file corresponding to the dance step file and extracts the music playback timeline and special effects trigger time points; The synchronization unit is used to synchronize dance step data, music playback timeline and special effect trigger time points to obtain a synchronized dataset; The rendering unit is used to drive the rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation.

[0009] The present invention also provides a computer device, the computer device including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the above-described method.

[0010] The present invention also provides a storage medium storing a computer program that, when executed by a processor, implements the above-described method.

[0011] The advantages of this invention compared to existing technologies are as follows: By loading basic parameters to form a configuration file and constructing a 3D scene model, the entire process of a drone light show can be rehearsed in a virtual environment without relying on on-site debugging and rehearsals of physical drones. On the one hand, this avoids the costs associated with on-site rehearsals, such as drone equipment wear and tear, personnel scheduling, and venue rental. On the other hand, creators can verify the effects without waiting for physical rehearsals, significantly shortening the cycle from choreography and design to finalization of the light show, which is particularly suitable for the rapid iterative optimization of large-scale drone light shows. Simultaneously, by loading a 3D scene model to construct a virtual environment consistent with the real performance scene and driving the rendering of drone movement trajectories based on dance step data, the drone's movement in three-dimensional space can be completely reproduced. The intermittent formation changes and lighting effects allow creators to observe the pre-show animation from a perspective closer to actual viewing, accurately judging the coordination of formation movements and the compatibility of lighting with the scene. This avoids choreography errors caused by discrepancies between the 2D preview and the actual effect, improving the accuracy of the light show's creative implementation. In addition, by parsing the dance step files to obtain independent dance step data, and modularizing it with the music playback timeline and special effect trigger times, when it is necessary to adjust the dance step trajectory, music rhythm, or special effect trigger timing, it is only necessary to re-parse the corresponding file and synchronize the time, without having to reconstruct the entire pre-show environment or re-render the complete animation. This significantly reduces the operational complexity and time cost of parameter adjustment, achieving a rapid feedback loop of "adjustment-verification" and improving choreography efficiency.

[0012] The present invention will be further described below with reference to the accompanying drawings and specific embodiments. Attached Figure Description

[0013] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0014] Figure 1 This is a schematic diagram illustrating an application scenario of the drone light show rehearsal method provided in an embodiment of the present invention; Figure 2 A flowchart illustrating the drone light show rehearsal method provided in an embodiment of the present invention; Figure 3 A schematic block diagram of a drone light show rehearsal device provided in an embodiment of the present invention; Figure 4 A schematic block diagram of a computer device provided for an embodiment of the present invention. Detailed Implementation

[0015] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0016] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0017] It should also be further understood that the term "and / or" as used in this specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0018] Please see Figure 1 and Figure 2 , Figure 1 This is a schematic diagram illustrating an application scenario of the drone light show rehearsal method provided in an embodiment of the present invention. Figure 2 This is a schematic flowchart illustrating the drone light show pre-show method provided in this embodiment of the invention. The method is applied to a server that interacts with a terminal, enabling a full-process pre-show of the drone light show in a virtual environment. It eliminates the need for on-site debugging and rehearsals of physical drones and fully recreates the drone formation changes and lighting effects in three-dimensional space. This allows for observation of the pre-show animation from a more realistic perspective, accurately judging the coordination of formation movements and the compatibility of lighting with the scene. It avoids choreography errors caused by discrepancies between two-dimensional previews and actual effects, thus improving the accuracy of realizing the light show concept.

[0019] Figure 2 This is a flowchart illustrating the drone light show rehearsal method provided in an embodiment of the present invention. Figure 2 As shown, the method includes the following steps S110 to S150.

[0020] S110, Load basic parameters to form a configuration file; Specifically, the basic parameters include fundamental information about the drone performance, such as the number of drones, the size of the performance venue, the type of lighting effects, and the music file path. These parameters are typically input by the user based on actual performance needs or selected from preset templates. Furthermore, the collected basic parameters are organized into a configuration file according to a specific format (such as JSON or XML). This configuration file serves as the basis for subsequent loading and rendering, storing the key information required for the entire light show rehearsal.

[0021] In other words, users can easily adjust the basic parameters of the light show through the configuration file without modifying the code, which improves the system's flexibility and scalability, provides a unified input standard for subsequent loading and rendering processes, and ensures that the system can run stably.

[0022] In one embodiment, loading the basic parameters to form the configuration file includes: Read the preset file to obtain basic parameters, which include operating mode, scene name, number of drones, cache size and music path; Specifically, the preset file is typically a structured data file, such as JSON or XML, storing the basic parameters required for the drone light show rehearsal. Upon system startup, the preset file is loaded via a file reading module, and its contents are read using standard file reading APIs. The preset file is then parsed to extract the basic parameters. For JSON files, a JSON parsing library (such as the `json` module in Python) can be used to parse the file content.

[0023] In other words, by reading preset files, the system can automatically obtain basic parameters without requiring manual input from the user, thus improving the system's automation and ease of use. Furthermore, users can easily adjust the basic parameters by modifying the preset files without altering the code, making the system more flexible and scalable. The formatted storage of preset files ensures standardized input of basic parameters, reducing problems caused by manual input errors.

[0024] The basic parameters are integrated to form a configuration file.

[0025] Specifically, the basic parameters read from the preset file are integrated to form a unified configuration file. The configuration file can use the same format as the preset file (such as JSON or XML), or it can be adjusted according to actual needs. Then, the integrated parameters are written to the configuration file, and the file writing API is used to save the configuration file to a specified path, ensuring that the configuration file is in the correct format for easy reading and parsing by subsequent modules.

[0026] In other words, by integrating basic parameters into a configuration file, the system can uniformly manage all parameters required for pre-running, improving the efficiency and accuracy of parameter management. Simultaneously, the configuration file serves as input for each system module, making the system design more modular and facilitating subsequent development and maintenance. Furthermore, the structured storage of the configuration file allows the system to easily expand with new parameters and functions without requiring extensive modifications to existing code.

[0027] S120: Load the 3D scene model according to the configuration file to serve as the drone performance environment; Specifically, based on the site information in the configuration file, corresponding models (such as city squares, parks, etc.) are selected from a pre-set 3D scene library. These models are loaded using 3D modeling software (such as Unreal Engine or Unity) and used as the virtual environment for the drone performance. Simultaneously, LOD (Level of Detail) technology is employed to optimize the scene models. For close-up views (drones < 50 meters from the camera), high-precision mesh rendering is used to showcase complete model details; for distant views (drones ≥ 50 meters from the camera), batch rendering with sprites is used to reduce the rendering load.

[0028] In other words, by loading realistic 3D scene models, an immersive pre-show experience is provided to users, allowing them to intuitively feel the effect of the drone light show in the actual venue. At the same time, the application of LOD technology effectively balances rendering quality and performance, maintaining a high frame rate even in large-scale drone light show pre-shows (e.g., the frame rate is stable at over 60 FPS when there are 5000 drones).

[0029] In one embodiment, loading a 3D scene model according to a configuration file to serve as a drone performance environment includes: Read the scene name and parameters from the configuration file to determine the path and type of the 3D scene model to be loaded; Specifically, after the system starts, it first reads the scene name and related parameters from the configuration file (e.g., in JSON format), and then uses a file reading and parsing tool (e.g., Python's json module) to read and parse the configuration file, extracting the scene name, path, and other relevant parameters. Then, based on the "scene name" and "scene path" in the configuration file, it determines the specific path and file format (e.g., FBX, OBJ, etc.) of the 3D scene model to be loaded. If the scene name matches a preset scene library, the corresponding model is loaded directly; otherwise, a custom model is loaded based on the path.

[0030] In other words, by reading scene information from the configuration file, the system can automatically determine and load the correct 3D scene model, reducing manual intervention and improving the system's automation level. At the same time, users can easily switch between different 3D scene models by modifying the configuration file without changing the code, enhancing the system's flexibility and scalability.

[0031] Load the corresponding 3D scene model according to the path and type of the 3D scene model, and initialize the loaded 3D scene model, including setting the scene's lighting conditions, environmental atmosphere and initial viewpoint position. Specifically, use the API of a 3D engine (such as Unreal Engine or Unity) to load a 3D scene model from a specified path. For example, in Unity, you can use the AssetDatabase.LoadAssetAtPath method to load a model. After the model is loaded, check its integrity and compatibility to avoid loading incorrect or corrupted models.

[0032] The initial setup includes setting the scene's lighting conditions, ambient atmosphere, and initial viewpoint position. Specifically, the scene's lighting is set according to the "Lighting Conditions" parameter in the configuration file. For example, if the lighting condition is "Daylight," a directional light is added to the scene, and its intensity and direction are adjusted. The overall atmosphere of the scene is set according to the "Ambient Atmosphere" parameter. For example, if the ambient atmosphere is "Night," the scene's background color is adjusted to dark blue, and some ambient light is added. The initial position and orientation of the camera are set according to the "Initial Viewpoint Position" parameter in the configuration file. For example, the camera position is set to [0, 50, 100], and the camera's orientation is adjusted so that the user can observe the scene from the optimal perspective.

[0033] In other words, by initializing the settings, the 3D scene model is ensured to match the actual performance scene in terms of lighting, environmental atmosphere, and viewpoint position, thus improving the realism and immersion of the pre-rehearsal. Furthermore, a reasonable initial viewpoint position setting allows users to quickly enter the optimal observation state, enhancing the user experience. The initialization settings also ensure stable operation after scene loading, avoiding problems caused by improper lighting or viewpoint settings.

[0034] The LOD hierarchical rendering algorithm is used to optimize the elements in the 3D scene, and a reference coordinate system for the starting position and flight path of the drone is set in the 3D scene to form the final 3D scene model as the drone performance environment.

[0035] Specifically, multiple LOD levels are defined based on factors such as the importance of elements in the scene and their distance from the camera. For example, elements in the scene are divided into three levels: high precision (LOD0), medium precision (LOD1), and low precision (LOD2). During rendering, the appropriate LOD level is dynamically selected based on the distance between the element and the camera. For near-field elements (e.g., less than 50 meters from the camera), a high-precision model (LOD0) is used; for distant elements (e.g., ≥ 50 meters from the camera), a low-precision model (LOD2) or batch rendering with sprites is used to reduce the rendering load. Through the LOD algorithm, a high frame rate is maintained in large-scale scenes (e.g., a stable frame rate of over 60 FPS when there are 5000 drones).

[0036] The starting position of the drones is determined according to configuration files or preset rules. For example, the starting position of all drones can be set at the center point of the scene or a specific area. A global reference coordinate system is defined in the 3D scene to describe the flight path of the drones. For example, a Cartesian coordinate system can be used to define the starting and ending coordinates of the flight path.

[0037] In other words, the LOD (Level of Detail) rendering algorithm significantly reduces the rendering load and improves system performance, enabling smooth rehearsals for large-scale drone light shows. Simultaneously, by setting a reference coordinate system for the drones' starting positions and flight paths, the algorithm ensures that the drones' flight paths align with the rehearsal requirements, improving the accuracy and reliability of the rehearsal. Furthermore, the defined reference coordinate system allows for flexible adjustment of the drones' flight paths to adapt to different performance scenarios and needs.

[0038] S130: Load the drone dance step file and parse the dance step file to obtain the dance step data; at the same time, load the music file and special effects file corresponding to the dance step file, and extract the music playback timeline and special effects trigger time points; Specifically, the dance step files are stored in JSON format and contain information such as the drone's trajectory point sequence and lighting effect parameters. The system loads the dance step files asynchronously using a multi-threaded approach and parses out the dance step data for each drone, including position, color, and light intensity. Simultaneously, it loads the corresponding music and effects files according to the paths specified in the configuration file. The audio engine parses the music files to extract the music playback timeline; the effects system parses the effects files to extract the effect trigger timestamps.

[0039] In other words, by parsing the dance steps and extracting the timing information of the music and special effects, precise control over each stage of the drone light show was achieved, ensuring the synchronization and smoothness of the performance. Meanwhile, the multi-threaded asynchronous loading mechanism avoided blocking the main thread during I / O operations, improving the system's response speed and processing efficiency.

[0040] In one embodiment, loading the drone dance step file and parsing the dance step file to obtain dance step data; simultaneously loading the music file and special effects file corresponding to the dance step file, and extracting the music playback timeline and special effects trigger time points, includes: The drone dance step file is loaded using a multi-threaded asynchronous method, and the dance step file is parsed to extract the number of drones, dance step duration, trajectory point sequence and light effect parameters, and then integrated to obtain the dance step data; Specifically, a main thread is created for rendering and interactive responses, while multiple parsing threads are created to load and parse the dance step files. These threads are managed using a thread pool (such as `std::thread` in C++) to ensure efficient resource utilization. Simultaneously, the parsing threads load the dance step files (usually in JSON format) from a specified path. The parsing threads then parse the JSON files, extracting the number of drones, dance step duration, trajectory point sequence, and lighting effect parameters, and write the parsing results to a double buffer (BufferA and BufferB). The main thread reads data from the currently available buffers for rendering. Furthermore, a data structure (such as a `struct` in C++ or a `class` in Python) can be designed to store the dance step data, including drone IDs, locations, lighting effects, etc. The parsed trajectory point sequence and lighting effect parameters are then integrated into this data structure to form complete dance step data.

[0041] In other words, the multi-threaded asynchronous loading mechanism avoids blocking the main thread during I / O operations, significantly improving the system's response speed and processing efficiency. Simultaneously, through parsing and integration, the integrity and accuracy of the dance step data are ensured, providing a reliable data foundation for subsequent rendering and synchronization. Furthermore, the double-buffer mechanism ensures the continuity of main thread rendering, avoiding stuttering or delays caused by data reading.

[0042] Load the music file corresponding to the dance step file and extract the music playback timeline, which includes the music's start time, duration, and key beat points; Specifically, the path to the music file is obtained from the configuration file, for example, / music / show-music.mp3. Then, an audio engine (such as FMOD or OpenAL) is used to load the music file. The audio engine provides efficient audio processing capabilities, enabling it to quickly read the music file and extract its timing information. The start time, duration, and key beats of the music are extracted using the audio engine's API. For example, the total duration of the music can be obtained using FMOD's getLength method, and key beats can be extracted by analyzing the audio waveform.

[0043] In other words, extracting the music playback timeline provides a precise time reference for the subsequent dance moves and special effects synchronization, ensuring the synchronization and smoothness of the light show. At the same time, the audio engine's efficient processing capabilities ensure fast loading and parsing of music files, improving the overall system performance.

[0044] Load the special effects file corresponding to the dance step file and extract the special effects trigger time points, including the trigger time and duration of the firework special effects and the cold firework special effects.

[0045] Specifically, the path to the effects file is obtained from the configuration file, such as / effects / fireworks.json. The effects file typically contains the effect type, trigger time, and duration. The effects file is parsed, and the trigger time and duration are extracted and stored in a data structure.

[0046] In other words, by extracting the trigger points of special effects, precise synchronization between the effects and the dance steps and music was achieved, ensuring the overall effect of the light show. At the same time, the structured storage of the special effects files makes the addition and modification of effects more flexible, adapting to different performance needs.

[0047] S140. Synchronize the dance step data, music playback timeline, and special effect trigger time points to obtain a synchronized dataset; Specifically, the system defines a unified time base (such as the global clock T-global) and maintains timestamps (T-uav, T-music, T-fx) for dance step data, music playback timeline, and special effects trigger times. A timestamp alignment algorithm (FrameSync Alignment) ensures that the three are synchronized at the millisecond level (maximum deviation less than 10ms). During each frame update, the synchronization control module reads the global clock T-global and calculates the appropriate time point for each module. If a deviation exceeds a threshold (e.g., 10ms), a compensation mechanism is triggered to adjust the playback position.

[0048] In other words, by using timestamp alignment and synchronization control modules, high-precision synchronization of dance steps, music, and special effects in drone light shows was achieved, avoiding common delay or misalignment issues. Even in complex performance scenarios, stable synchronization was maintained, improving the reliability and usability of rehearsals.

[0049] In one embodiment, the step of synchronizing dance step data, music playback timeline, and special effect trigger times to obtain a synchronized dataset includes: Define a unified time reference, including music playback time, drone animation time, and special effects trigger time; Specifically, a music playback time base (T-music) is defined, with the music's start time as zero, and the time unit being milliseconds. A drone animation time base (T-uav) is defined, with the drone dance animation's start time as zero, and the time unit being milliseconds. An effect trigger time base (T-fx) is defined, with the effect's start time as zero, and the time unit being milliseconds.

[0050] Unify the three time bases mentioned above into a single global time base (T-global) to ensure that all time bases are on the same time axis.

[0051] In other words, by defining a unified time base, the music, drone animation, and special effects were ensured to be synchronized on the same timeline, avoiding the chaos caused by inconsistent time bases. At the same time, the unified time base provided a precise time reference for subsequent time synchronization, improving synchronization accuracy.

[0052] Initialize the global clock and align it with a unified time base; Specifically, when the system starts, a global clock (T-global) is initialized, typically using a high-precision timer (such as std::chrono in C++ or time.perf-counter in Python), setting the start time of the global clock to zero and ensuring that it is aligned with a uniform time base.

[0053] In other words, the initialization of the global clock ensures the stability of time synchronization and avoids synchronization problems caused by time base drift. At the same time, the use of a high-precision timer ensures the real-time performance of the global clock, providing a foundation for accurate time synchronization.

[0054] For each frame of data, the music playback position, drone animation frame, and special effects triggering status corresponding to the current moment are calculated based on the global clock. Specifically, during each frame rendering, the current time of the global clock (T-global) is read. Then, based on the global clock time, the corresponding music playback position, drone animation frame, and effect triggering status are calculated. That is, the current music playback time, the current drone animation frame, and whether the effect needs to be triggered are calculated using T-global.

[0055] In other words, by updating every frame, the real-time nature of music playback position, drone animation frames, and special effects triggering status is ensured, improving the smoothness of the rehearsal. At the same time, calculations based on a global clock ensure the accuracy of time synchronization, avoiding synchronization problems caused by time calculation errors.

[0056] The system detects time deviations in the current music playback position, drone animation frames, and special effects triggering status. If the deviation between the music playback position, drone animation frames, or special effects triggering status and the global clock exceeds a preset threshold, a compensation mechanism is triggered to adjust the playback position or triggering time to obtain the adjusted dance step data, music playback timeline, and special effects triggering time points. Specifically, during each frame update, the deviation between the music playback position, the drone's animation frame, and the effect triggering state and the global clock is detected. If the deviation exceeds a preset threshold (e.g., 10 milliseconds), a compensation mechanism is triggered. Music playback position adjustment refers to adjusting the music playback position via the audio engine's API; drone animation frame adjustment refers to adjusting the drone's animation frame via the rendering engine's API; and effect triggering time adjustment refers to adjusting the effect triggering time via the effects system's API.

[0057] In other words, the timing deviation detection and compensation mechanism ensures the synchronization stability of music, drone animation, and special effects, avoiding misalignment issues caused by timing deviations. Simultaneously, the triggering of the compensation mechanism ensures the accuracy of timing synchronization, maintaining high-precision synchronization even in complex scenarios.

[0058] The adjusted dance steps data, music playback timeline, and special effects trigger times are integrated into a synchronized dataset.

[0059] Specifically, after each frame update, the adjusted dance steps, music playback timeline, and effect trigger times are integrated into a synchronized dataset. This synchronized dataset can be a data structure (such as a struct in C++ or a class in Python) containing the music playback position, drone animation frames, and effect trigger states. Simultaneously, the synchronized dataset is stored in memory for use by subsequent rendering and interaction modules, ensuring its real-time updates so that the latest synchronization information is available for each frame rendering.

[0060] In other words, by integrating the synchronized dataset, consistency in the rendering of music, drone animation, and special effects across each frame was ensured, improving the overall effect of the preview. Simultaneously, the real-time updates of the synchronized dataset ensured the reliability of the preview, avoiding problems caused by data inconsistencies.

[0061] S150: Drive the rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation.

[0062] Specifically, the parsed dance data directly drives the GPU shader for rendering. The CPU only maintains the posture matrix queue and light intensity queue, reducing the computational burden; the GPU calculates the interpolation position based on the timestamp and buffer data, achieving smooth dynamic updates. Special effects (such as fireworks and cold fireworks) are triggered through a particle system, bound to the drone's position and timestamp, enabling dynamic effect rendering. In the VR environment, the drone model is rendered in real time using GPU instancing technology, supporting real-time rendering of 5000 drones.

[0063] In other words, the application of data-driven rendering mechanism and GPU Instancing technology enables the system to support high frame rate rendering of large-scale drone light shows (such as a frame rate of stable above 60 FPS when there are 5,000 drones), providing users with a smooth visual experience.

[0064] In one embodiment, the step of driving rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation includes: Initialize the rendering engine and configure rendering parameters, including rendering resolution, frame rate, and anti-aliasing. Specifically, choose a suitable rendering engine, such as Unreal Engine or Unity, which offer powerful graphics rendering capabilities and optimization mechanisms. Simultaneously, initialize the rendering engine, load necessary resources and modules, and ensure the rendering engine is ready to run.

[0065] Configuring rendering parameters includes rendering resolution, frame rate, and anti-aliasing. Rendering resolution refers to setting the resolution of the rendered output, such as 1920x1080 or higher, to meet the needs of different display devices; frame rate refers to configuring the target frame rate of the rendering engine, such as 60 FPS or higher, to ensure smooth animation; anti-aliasing refers to enabling anti-aliasing features (such as MSAA or FXAA) to reduce jagged edges in the rendered image and improve image quality.

[0066] In other words, by configuring high resolution and anti-aliasing, the rendered animation images are ensured to be of high quality, enhancing the visual effect. At the same time, setting a high frame rate ensures smooth animation, avoiding stuttering or flickering, and improving the user's viewing experience.

[0067] Based on the time information in the synchronized dataset, the drone position, attitude, and lighting parameters corresponding to the current frame are obtained from the drone performance environment. At the same time, the current music playback progress is obtained from the music playback timeline, and the information of the special effects to be triggered is obtained from the special effect triggering time point. Then, the drone position, attitude, lighting parameters, current music playback progress, and information of the special effects to be triggered are integrated to obtain parameter data. Specifically, during each frame rendering, the current time of the global clock (T-global) is read, and the drone's position, attitude, and lighting parameters corresponding to the current frame are obtained based on the time information in the synchronization dataset. The obtained drone position, attitude, lighting parameters, music playback progress, and special effects information are then integrated into a parameter data structure for subsequent rendering.

[0068] In other words, by synchronizing the time information in the dataset, the accuracy of the parameter data obtained during each frame's rendering is ensured, avoiding rendering errors caused by time asynchrony. Simultaneously, acquiring parameter data in real-time during each frame's rendering ensures the real-time and dynamic nature of the rendering, improving the interactivity of the preview.

[0069] Using GPU Shader technology, the lighting effect parameters of the drones are mapped to each drone model, and the dynamic changes of the lighting effect are adjusted according to the music playback progress. Then, through the GPU Instancing mechanism, the rendering tasks of all drones are processed in batches. At the same time, the fireworks effect and cold firework effect are triggered in real time according to the special effect trigger time point, and finally the special effect data is obtained. Specifically, GPU shader code is written to map the drone's lighting parameters (such as color and intensity) to each drone model. Then, based on the music playback progress (currentMusicTime), the shader code dynamically adjusts these parameters. For example, the drone's lighting intensity or color changes are adjusted according to the music's rhythm. Furthermore, GPU Instancing technology is used to batch process all drone rendering tasks. By storing drone instance data (such as position and color) in the GPU buffer, the number of rendering calls is reduced, improving rendering efficiency. Simultaneously, fireworks and cold firework effects are triggered in real-time based on the effect trigger time (currentEffects). Particle systems are used to generate these effects, and their states are dynamically updated based on their duration, ultimately yielding the effect data.

[0070] In other words, GPU Shader technology and GPU Instancing mechanism significantly improve rendering efficiency, enabling real-time rendering of large-scale drone light shows. Simultaneously, dynamically adjusting lighting parameters based on music playback progress enhances the dynamic effects and visual impact of the light show. Furthermore, real-time triggering of fireworks and cold flame effects makes the light show more realistic and vivid, improving the visual experience.

[0071] The rendering engine combines parameter data and effects data to create a drone light show animation.

[0072] Specifically, during each frame of rendering, the rendering engine composites parameter data (drone position, attitude, and lighting parameters) and special effects data (fireworks effects and cold flame effects). The rendering engine first renders the drone model, applies GPU Shader technology to adjust the lighting parameters, then renders the special effects, uses a particle system to generate fireworks and cold flame effects, and dynamically updates the state of the effects according to their duration. Finally, the composited image is output to the display device to form the final drone light show animation.

[0073] In other words, by synthesizing parameter data and special effects data, the overall effect of the drone light show was ensured, avoiding visual inconsistencies caused by data separation. At the same time, the final rendered image is of high quality and smoothness, meeting the high requirements of the pre-show and enhancing the user experience.

[0074] In one embodiment, after driving the rendering of the synchronized dataset and the drone performance environment to obtain the drone light show effect animation, the method further includes: By using a VR controller to perform six degrees of freedom roaming, the viewpoint, zoom, and playback speed of the drone light show animation can be adjusted and saved to obtain a customized light show animation.

[0075] Specifically, VR device and controller integration involves using VR-enabled devices (such as Oculus Rift, HTC Vive, etc.) and equipping them with corresponding VR controllers. Simultaneously, a VR input module is integrated into the rendering engine to ensure the ability to receive and process input signals from the VR controllers. For example, this can be achieved using Unreal Engine's VR plugin or Unity's XR toolkit.

[0076] More specifically, users can adjust the viewing direction in real time using the joystick or touchpad on the VR controller. For example, users can change the viewing direction by moving the joystick on the controller. Users can adjust the viewing distance (zoom) using the buttons or touchpad on the controller. For example, pressing a button zooms in or out of the view. Users can also adjust the playback speed of animations using the buttons or joystick on the controller. For example, pushing or pulling the joystick forward adjusts the playback speed.

[0077] In other words, the six degrees of freedom (DOF) roaming function of the VR controller allows users to adjust the viewing angle, zoom, and playback speed in an immersive way, enhancing the immersive experience of the preview. Simultaneously, users can adjust the viewing angle and playback speed of the light show effects animation according to their needs and preferences, increasing the flexibility and personalization of the preview. Furthermore, real-time response to controller input ensures immediate feedback to user actions, improving the interactive experience.

[0078] After the user adjusts the viewing angle, zoom, and playback speed, the system saves these settings to a configuration file. The configuration file can be in JSON or XML format and stores the user's custom parameters. Then, a file writing API is used to save the configuration file to a specified path. In subsequent previews, the system reads the configuration file and loads the user-saved settings. In addition, users can customize the viewing path, speed, angle, and lighting parameters, and the system automatically saves these custom parameters as a .config file for reuse.

[0079] In other words, by storing users' custom settings, the system can provide a personalized preview experience for each user, meeting the needs of different users. At the same time, users do not need to repeatedly adjust settings, as the system can automatically load the saved configuration, improving the convenience and efficiency of previews. Furthermore, the saved configuration files can be used for subsequent previews or demonstrations, ensuring the reusability of preview settings.

[0080] The aforementioned method for rehearsing drone light shows, by loading basic parameters to form a configuration file and constructing a 3D scene model, allows for the entire process of rehearsing a drone light show in a virtual environment, eliminating the need for on-site debugging and rehearsals with physical drones. This avoids the costs associated with on-site rehearsals, such as drone equipment wear and tear, personnel scheduling, and venue rental. Furthermore, creators can verify the effects without waiting for physical rehearsals, significantly shortening the cycle from choreography and design to finalization, making it particularly suitable for rapid iterative optimization of large-scale drone light shows. Simultaneously, by loading a 3D scene model to construct a virtual environment consistent with the real performance scene and using dance data to drive the rendering of drone movement trajectories, the drones' movements in 3D space can be completely recreated. With its choreography changes and lighting effects, the system allows creators to observe the pre-show animation from a more realistic perspective, accurately judging the coordination of choreography movements and the compatibility of lighting with the scene. This avoids choreography errors caused by discrepancies between the 2D preview and the actual effect, improving the accuracy of the light show's creative implementation. Furthermore, by parsing the dance step files to obtain independent dance step data, and modularizing it with the music playback timeline and special effect trigger times, adjustments to dance step trajectories, music rhythms, or special effect trigger timings can be made simply by re-parsing the corresponding files and synchronizing the time. This eliminates the need to reconstruct the entire pre-show environment or re-render the complete animation, significantly reducing the complexity and time cost of parameter adjustments. It achieves a rapid feedback loop of "adjustment-verification," improving choreography efficiency.

[0081] Figure 3 This is a schematic block diagram of a drone light show rehearsal device 300 provided in an embodiment of the present invention. Figure 3 As shown, corresponding to the above-described drone light show rehearsal method, the present invention also provides a drone light show rehearsal device 300. This drone light show rehearsal device 300 includes a unit for executing the above-described drone light show rehearsal method, and the device can be configured in a server. Specifically, please refer to... Figure 3 The drone light show preview device 300 includes: Loading unit 301 is used to load basic parameters to form a configuration file; Loading unit 302 is used to load a 3D scene model according to the configuration file to serve as a drone performance environment; The loading and extraction unit 303 is used to load the drone dance step file and parse the dance step file to obtain the dance step data; at the same time, it loads the music file and special effects file corresponding to the dance step file and extracts the music playback timeline and special effects trigger time points. Synchronization unit 304 is used to synchronize dance step data, music playback timeline and special effect trigger time points to obtain a synchronized dataset; Rendering unit 305 is used to drive the rendering of the synchronous dataset and the drone performance environment to obtain drone light show effect animation.

[0082] In one embodiment, the loading forming unit 301 includes: The reading module is used to read a preset file to obtain basic parameters, including the operating mode, scene name, number of drones, cache size, and music path. The first integration module is used to integrate basic parameters to form a configuration file.

[0083] In one embodiment, the loading unit 302 includes: The read determination module is used to read the scene name and parameters from the configuration file to determine the path and type of the 3D scene model to be loaded; The loading initialization module is used to load the corresponding 3D scene model according to the path and type of the 3D scene model, and to initialize the loaded 3D scene model, including setting the scene's lighting conditions, environmental atmosphere and initial viewpoint position. The optimization settings module is used to optimize elements in the 3D scene using the LOD hierarchical rendering algorithm, and to set the reference coordinate system for the drone's starting position and flight path in the 3D scene, forming the final 3D scene model as the drone performance environment.

[0084] In one embodiment, the loading and extraction unit 303 includes: The loading, parsing, extraction, and integration module is used to load drone dance step files in a multi-threaded asynchronous manner, parse the dance step files to extract the number of drones, dance step duration, trajectory point sequence, and light effect parameters, and then integrate them to obtain dance step data. The first loading and extraction module is used to load the music file corresponding to the dance step file and extract the music playback timeline, which includes the music's start time, duration, and key beat points. The second loading and extraction module is used to load the special effects file corresponding to the dance step file and extract the special effects trigger time points, including the trigger time and duration of the firework special effects and the cold firework special effects.

[0085] In one embodiment, the synchronization unit 304 includes: The definition module is used to define a unified time reference, including music playback time, drone animation time, and special effects trigger time; The initialization alignment module is used to initialize the global clock and align it with a unified time base; The calculation module is used to calculate the music playback position, drone animation frame, and special effects triggering status corresponding to the current moment for each frame of data, based on the global clock. The detection module is used to detect the time deviation of the current music playback position, the drone's animation frame, and the special effect triggering state. If the deviation of the music playback position, the drone's animation frame, or the special effect triggering state from the global clock exceeds a preset threshold, a compensation mechanism is triggered to adjust the playback position or triggering time to obtain the adjusted dance step data, music playback timeline, and special effect triggering time point. The second integration module is used to integrate the adjusted dance step data, music playback timeline, and special effect trigger time points into a synchronized dataset.

[0086] In one embodiment, the rendering unit 305 includes: The initialization configuration module is used to initialize the rendering engine and configure rendering parameters, including rendering resolution, frame rate, and anti-aliasing. The acquisition and integration module is used to obtain the drone position, attitude, and lighting parameters corresponding to the current frame from the drone performance environment based on the time information in the synchronous dataset. At the same time, it obtains the current music playback progress from the music playback timeline and the information of the special effects to be triggered from the special effect trigger time point. Then, it integrates the drone position, attitude, lighting parameters, current music playback progress, and information of the special effects to be triggered to obtain parameter data. The mapping adjustment processing trigger module is used to use GPU Shader technology to map the drone's light effect parameters to each drone model, and adjust the dynamic changes of the light effect according to the music playback progress. Then, through the GPU Instancing mechanism, the rendering tasks of all drones are processed in batches. At the same time, based on the special effect trigger time point, the fireworks effect and cold firework effect are triggered in real time to finally obtain the special effect data. The compositing module is used by the rendering engine to composite parameter data and special effects data to obtain drone light show effect animation.

[0087] In one embodiment, the device further includes: Adjust the storage unit to adjust the perspective, zoom, and playback speed of the drone light show effect animation through six degrees of freedom roaming using a VR controller and store it to obtain a customized light show effect animation.

[0088] It should be noted that those skilled in the art can clearly understand that the specific implementation process of the above-mentioned drone light show rehearsal device 300 and each unit can be referred to the corresponding description in the foregoing method embodiments. For the sake of convenience and brevity, it will not be repeated here.

[0089] The aforementioned drone light show rehearsal device 300 can be implemented as a computer program, which can, for example... Figure 4 It runs on the computer device shown.

[0090] Please see Figure 4 , Figure 4 This is a schematic block diagram of a computer device provided in an embodiment of this application. The computer device 500 can be a server, wherein the server can be a standalone server or a server cluster composed of multiple servers.

[0091] See Figure 4 The computer device 500 includes a processor 502, a memory, and a network interface 505 connected via a system bus 501. The memory may include a non-volatile storage medium 503 and internal memory 504.

[0092] The non-volatile storage medium 503 may store an operating system 5031 and a computer program 5032. The computer program 5032 includes program instructions that, when executed, cause the processor 502 to perform a method for rehearsing a drone light show.

[0093] The processor 502 provides computing and control capabilities to support the operation of the entire computer device 500.

[0094] The internal memory 504 provides an environment for the operation of the computer program 5032 in the non-volatile storage medium 503. When the computer program 5032 is executed by the processor 502, the processor 502 can execute a drone light show rehearsal method.

[0095] This network interface 505 is used for network communication with other devices. Those skilled in the art will understand that... Figure 4 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device 500 to which the present application is applied. The specific computer device 500 may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0096] The processor 502 is used to run a computer program 5032 stored in the memory to perform the following steps: Load basic parameters to form a configuration file; load a 3D scene model based on the configuration file to serve as the drone performance environment; load and parse the drone dance step file to obtain dance step data; simultaneously load the music file and special effects file corresponding to the dance step file, and extract the music playback timeline and special effects trigger time points; synchronize the dance step data, music playback timeline, and special effects trigger time points to obtain a synchronization dataset; drive the rendering of the synchronization dataset and the drone performance environment to obtain the drone light show effect animation.

[0097] It should be understood that in the embodiments of this application, the processor 502 may be a central processing unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0098] It will be understood by those skilled in the art that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program includes program instructions and can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiments of the above methods.

[0099] Therefore, the present invention also provides a storage medium. This storage medium can be a computer-readable storage medium. The storage medium stores a computer program, wherein when executed by a processor, the computer program causes the processor to perform the following steps: Load basic parameters to form a configuration file; load a 3D scene model based on the configuration file to serve as the drone performance environment; load and parse the drone dance step file to obtain dance step data; simultaneously load the music file and special effects file corresponding to the dance step file, and extract the music playback timeline and special effects trigger time points; synchronize the dance step data, music playback timeline, and special effects trigger time points to obtain a synchronization dataset; drive the rendering of the synchronization dataset and the drone performance environment to obtain the drone light show effect animation.

[0100] The storage medium can be any computer-readable storage medium capable of storing program code, such as a USB flash drive, portable hard drive, read-only memory (ROM), magnetic disk, or optical disk.

[0101] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0102] In the several embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For example, the division of each unit is merely a logical functional division, and there may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0103] The steps in the method of this invention can be adjusted, merged, or reduced in order according to actual needs. The units in the device of this invention can be merged, divided, or reduced according to actual needs. Furthermore, the functional units in the various embodiments of this invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0104] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, a terminal, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.

[0105] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for rehearsing drone light shows, characterized in that, include: Load basic parameters to form a configuration file; The 3D scene model is loaded according to the configuration file to serve as the drone performance environment; Load the drone dance step file and parse the dance step file to obtain the dance step data; at the same time, load the music file and special effects file corresponding to the dance step file, and extract the music playback timeline and special effects trigger time points; Synchronize the dance steps data, music playback timeline, and special effects trigger times to obtain a synchronized dataset; Driven rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation.

2. The drone light show rehearsal method according to claim 1, characterized in that, The loading of basic parameters to form a configuration file includes: Read the preset file to obtain basic parameters, which include operating mode, scene name, number of drones, cache size and music path; The basic parameters are integrated to form a configuration file.

3. The drone light show rehearsal method according to claim 1, characterized in that, The process of loading a 3D scene model according to a configuration file to serve as the drone performance environment includes: Read the scene name and parameters from the configuration file to determine the path and type of the 3D scene model to be loaded; Load the corresponding 3D scene model according to the path and type of the 3D scene model, and initialize the loaded 3D scene model, including setting the scene's lighting conditions, environmental atmosphere and initial viewpoint position. The LOD hierarchical rendering algorithm is used to optimize the elements in the 3D scene, and a reference coordinate system for the starting position and flight path of the drone is set in the 3D scene to form the final 3D scene model as the drone performance environment.

4. The drone light show rehearsal method according to claim 1, characterized in that, The process involves loading and parsing the drone dance step file to obtain dance step data; simultaneously, loading the corresponding music and effects files, and extracting the music playback timeline and effects trigger timestamps, including: The drone dance step file is loaded using a multi-threaded asynchronous method, and the dance step file is parsed to extract the number of drones, dance step duration, trajectory point sequence and light effect parameters, and then integrated to obtain the dance step data; Load the music file corresponding to the dance step file and extract the music playback timeline, which includes the music's start time, duration, and key beat points; Load the special effects file corresponding to the dance step file and extract the special effects trigger time points, including the trigger time and duration of the firework special effects and the cold firework special effects.

5. The drone light show rehearsal method according to claim 1, characterized in that, The process of synchronizing dance step data, music playback timeline, and special effect trigger times to obtain a synchronized dataset includes: Define a unified time reference, including music playback time, drone animation time, and special effects trigger time; Initialize the global clock and align it with a unified time base; For each frame of data, the music playback position, drone animation frame, and special effects triggering status corresponding to the current moment are calculated based on the global clock. The system detects time deviations in the current music playback position, drone animation frames, and special effects triggering status. If the deviation between the music playback position, drone animation frames, or special effects triggering status and the global clock exceeds a preset threshold, a compensation mechanism is triggered to adjust the playback position or triggering time to obtain the adjusted dance step data, music playback timeline, and special effects triggering time points. The adjusted dance steps data, music playback timeline, and special effects trigger times are integrated into a synchronized dataset.

6. The drone light show rehearsal method according to claim 1, characterized in that, The process of driving rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation includes: Initialize the rendering engine and configure rendering parameters, including rendering resolution, frame rate, and anti-aliasing. Based on the time information in the synchronized dataset, the drone position, attitude, and lighting parameters corresponding to the current frame are obtained from the drone performance environment. At the same time, the current music playback progress is obtained from the music playback timeline, and the information of the special effects to be triggered is obtained from the special effect triggering time point. Then, the drone position, attitude, lighting parameters, current music playback progress, and information of the special effects to be triggered are integrated to obtain parameter data. Using GPU Shader technology, the lighting effect parameters of the drones are mapped to each drone model, and the dynamic changes of the lighting effect are adjusted according to the music playback progress. Then, through the GPU Instancing mechanism, the rendering tasks of all drones are processed in batches. At the same time, the fireworks effect and cold firework effect are triggered in real time according to the special effect trigger time point, and finally the special effect data is obtained. The rendering engine combines parameter data and effects data to create a drone light show animation.

7. The drone light show rehearsal method according to claim 1, characterized in that, After driving the rendering of the synchronized dataset and the drone performance environment to obtain the drone light show effect animation, the process also includes: By using a VR controller to perform six degrees of freedom roaming, the viewpoint, zoom, and playback speed of the drone light show animation can be adjusted and saved to obtain a customized light show animation.

8. A drone light show rehearsal device, characterized in that, include: Load forming units, used to load basic parameters to form configuration files; The loading unit is used to load a 3D scene model according to the configuration file to serve as the drone performance environment; The loading and extraction unit is used to load the drone dance step file and parse the dance step file to obtain the dance step data; at the same time, it loads the music file and special effects file corresponding to the dance step file and extracts the music playback timeline and special effects trigger time points; The synchronization unit is used to synchronize dance step data, music playback timeline and special effect trigger time points to obtain a synchronized dataset; The rendering unit is used to drive the rendering of the synchronized dataset and the drone performance environment to obtain drone light show effect animation.

9. A computer device, characterized in that, The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the method as described in any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1 to 7.

Images