Method and system for performing forced clock synchronization with background music video in flight performance process of fleet
By analyzing the audio time codes and calculating the take-off time of the drone, the problem of difficulty in synchronizing music and flight images in formation flight performances is solved, and accurate audio and video synchronization is achieved, improving the on-site experience and simplicity of operation.
Patent Information
- Application Number
- CN202410969850.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-29
AI Technical Summary
In formation flight performances, it is difficult to accurately synchronize the music and the drone flight images, resulting in poor live audio and visual experience and increasing operational difficulty.
The audio time code of background music is analyzed by the ground station, and the drone formation screen is calculated to ensure that the takeoff time is synchronized with the music. The user interface interaction module, audio and video synchronization calculation module and navigation calculation and control module are used to realize the sound. Video synchronization.
The background music and the drone performance screen clock are synchronized and consistent in the formation performance, reducing the operation complexity and time alignment difficulty of the operation site, and improving the on-site audit and visual experience.
Smart Images

Figure CN119052544A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of unmanned aerial vehicles, and in particular relates to a method and a system for forcibly performing clock synchronization with a background music video during a formation flight performance. Background Art
[0002] At present, during formation flight performances, because the formation flight needs to coordinate with the current environment for the flight performance, the music is inconsistent with the drone flight picture, and it is impossible to accurately play it to the frame and point, and to the millisecond level. This seriously affects the actual audio-visual experience of the operation site, and also greatly increases the operating difficulty of the on-site operators.
[0003] Therefore, providing a method that can obtain information through background music, automatically control formation flying, and perform at a fixed time and location has become a technical problem that needs to be solved at present.
[0004] Through the above analysis, the problems and defects of the prior art are as follows:
[0005] At present, in some performance sites, such as large amusement parks and opening ceremonies of large companies, it is necessary to force the audio and visual to be consistent. However, because ground operators need to manually control the fleet to take off using a ground station, it is difficult for the aircraft to take off in line with the background music that has started or has been going on for a while, the host's speech, etc., which makes it difficult for the on-site formation flight to force the clock to be synchronized with other equipment, greatly reducing the on-site audio and visual effects. Summary of the invention
[0006] In order to overcome the problems existing in the related art, the disclosed embodiments of the present invention provide a method and system for forcibly synchronizing the clock with the background music video during a formation flight performance.
[0007] The technical solution is as follows:
[0008] A method for forcibly synchronizing a clock with a background music video during a formation flight performance, the method comprising:
[0009] S1: The formation aircraft are placed on site, open the ground station, select the background music to be played, enter the specified audio time code, select the formation flight screen style, and enter the start UTC time of the music playback;
[0010] S2: The ground station calculates the start UTC time of the background music and adds the relative time of the audio to the specified frame to obtain the expected synchronization time of the actual picture playback and the audio;
[0011] S3: Use the expected synchronization time obtained in step S2 to reversely calculate the take-off UTC time of the formation group to obtain the time required for the dance flight waypoint;
[0012] Play the waypoints at the set frequency, and calculate the time required from the takeoff waypoint to the expected screen through the cumulative number of screen points, that is, the relative time. Subtract the relative time from the total time to get the expected takeoff time of the aircraft;
[0013] S4: The take-off UTC time obtained in step S3 is sent to the individual aircraft in the fleet. After receiving the take-off instruction, the aircraft flies to the set take-off time, and the background audio is played at the set time;
[0014] S5: It is expected that the picture will achieve audio and video synchronization.
[0015] Furthermore, in step S1, the audio time code is specified to specify the time of the climax of the music according to the needs of the performance.
[0016] Further, in step S3, the waypoints are played at a set frequency of 25 Hz.
[0017] Further, in step S3, the cumulative number of picture points refers to the waypoint playback points, starting from 1 and ending at the last point, where the point count is the cumulative number.
[0018] Another object of the present invention is to provide a drone with a method for forcibly performing clock synchronization with a background music video during a formation flight performance.
[0019] Another object of the present invention is to provide a system for forcibly synchronizing a clock with a background music video during a formation flight performance, and a method for implementing the forcible clock synchronization with a background music video during a formation flight performance, the system comprising:
[0020] The user interface interaction module is used for user input and interaction, including selecting background music, inputting a specified audio time code, selecting a formation flight screen style, and inputting the start UTC time of music playback;
[0021] The audio and video synchronization calculation module is used to calculate the synchronization time of audio and video playback to ensure the synchronous playback of background music and formation flight images;
[0022] The navigation calculation and control module is used to calculate the time required from the take-off waypoint to the desired screen and the expected take-off time of the aircraft, as well as to execute take-off instructions and navigation control.
[0023] Furthermore, the system for forcibly synchronizing the clock with the background music video during the formation flight performance is installed on a group of drones and applied in the flight performance.
[0024] Furthermore, a system for forced clock synchronization with a background music video during a formation flight performance is installed on a computer device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, and the processor implements the functions of the above-mentioned method when executing the computer program.
[0025] Furthermore, the system for forced clock synchronization with the background music video during the formation flight performance is installed on a computer-readable storage medium, and the computer-readable storage medium stores a computer program. When the computer program is executed by the processor, the functions of the above-mentioned method can be realized.
[0026] Furthermore, a system for forced clock synchronization with background music video during formation flight performances is installed on a server, and the server is used to provide a user input interface to implement the functions of the synchronization system as described above when executed on an electronic device.
[0027] In combination with all the above technical solutions, the beneficial effects of the present invention are as follows:
[0028] A method for forced clock synchronization with background music video during a formation flight performance, which uses a ground station to parse the background music audio time code in advance and calculate the playback time of the corresponding frame waypoints of the UAV formation screen, achieves the functional effect of consistent clock synchronization between the background music and the UAV performance screen during the formation performance, and solves the problem of audio-visual misalignment caused by overly complicated operations and difficult time alignment at the operation site. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The accompanying drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the principles of the present disclosure;
[0030] Figure 1 is a flow chart of a method provided by an embodiment of the present invention;
[0031] Figure 2 is a schematic diagram of a method provided by an embodiment of the present invention;
[0032] Figure 3 is a schematic diagram of a system provided by an embodiment of the present invention;
[0033] Figure 4 It is a schematic diagram of part of the program segment of the take-off time calculated by the ground station;
[0034] Figure 5 It is a schematic diagram of part of the program segment for returning the aircraft status during the flight process.
[0035] In the figure:
[0036] 1-User interface interaction module; 2-Audio and video synchronization calculation module; 3-Navigation calculation and control module. DETAILED DESCRIPTION
[0037] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the specific embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present invention, so the present invention is not limited by the specific implementation disclosed below.
[0038] Embodiment 1:
[0039] like Figure 1 As shown, a method for forcibly synchronizing a clock with a background music video during a formation flight performance, the method comprising:
[0040] S1: The formation aircraft are placed on site, open the ground station, select the background music to be played, enter the specified audio time code, select the formation flight screen style, and enter the start UTC time of the music playback;
[0041] S2: The ground station calculates the start UTC time of the background music and adds the relative time of the audio to the specified frame to obtain the expected synchronization time of the actual picture playback and the audio;
[0042] S3: Use the expected synchronization time obtained in step S2 to reversely calculate the take-off UTC time of the formation group to obtain the time required for the dance flight waypoint;
[0043] Play the waypoints at the set frequency, and calculate the time required from the takeoff waypoint to the expected screen through the cumulative number of screen points, that is, the relative time. Subtract the relative time from the total time to get the expected takeoff time of the aircraft;
[0044] S4: The take-off UTC time obtained in step S3 is sent to the individual aircraft in the fleet. After receiving the take-off instruction, the aircraft flies to the set take-off time, and the background audio is played at the set time;
[0045] S5: It is expected that the picture will achieve audio and video synchronization.
[0046] Furthermore, in step S1, the audio time code is specified to specify the time of the climax of the music according to the needs of the performance.
[0047] Further, in step S3, the waypoints are played at a set frequency of 25 Hz.
[0048] Further, in step S3, the cumulative number of picture points refers to the waypoint playback points, starting from 1 and ending at the last point, where the point count is the cumulative number.
[0049] Working principle:
[0050] The principle of realizing time synchronization in the present invention is realized through the formula of "music playing start time + time required to play to climax = take-off time + time required to play to the desired picture waypoint", wherein: "music playing start time is the start UTC time", "time required to play to climax" is the set specified audio time code, the period from the take-off waypoint to the desired picture is the "relative time", and the actual time of the desired picture broadcast is the "total time", and the actual take-off time can be obtained by subtracting the relative time (required time) from the total time (actual time).
[0051] The start UTC time and take-off UTC time of the present invention can ensure that the system time is synchronized with the real world, so that the take-off of individual aircraft in the fleet is kept accurately synchronized.
[0052] Figure 2 Shown is a schematic diagram of a method for forcibly synchronizing a clock with a background music video during a formation flight performance provided by an embodiment of the present invention.
[0053] Embodiment 2:
[0054] like Figure 3 As shown, the system for forcibly synchronizing the clock with the background music video during the formation flight performance provided by the embodiment of the present invention includes:
[0055] User interface interaction module 1, used for user input and interaction, including selecting background music, inputting specified audio time code, selecting formation flight picture style, and inputting the start UTC time of music playback;
[0056] The audio and video synchronization calculation module 2 is used to calculate the synchronization time of audio and video playback to ensure the synchronous playback of background music and formation flight images;
[0057] The navigation calculation and control module 3 is used to calculate the time required from the take-off waypoint to the desired picture and the expected take-off time of the aircraft, as well as to execute take-off instructions and navigation control.
[0058] Working principle:
[0059] The user interface interaction module 1 inputs relevant information, including selecting background music, inputting a specified audio time code, selecting a formation flight picture style, and inputting the start UTC time of music playback. The audio and video synchronization calculation module 2 calculates the actual picture playback and the expected audio synchronization time through this information. Then the navigation calculation and control module 3 reversely calculates the take-off UTC time of the formation aircraft group based on the expected synchronization time, and calculates the time required from the take-off waypoint to the expected picture based on the set frequency and the cumulative number of picture points, and further obtains the expected take-off time of the aircraft. Then the navigation calculation and control module 3 sends a take-off instruction, combines the information of the user interface interaction module 1, and flies according to the set take-off time. At the same time, the background audio is played at the set time.
[0060] To further illustrate the effects of the embodiments of the present invention, the present invention provides some program segments to illustrate the present invention, wherein Figure 4 It is a part of the program segment of the take-off time calculated by the ground station. Figure 5 It is a part of the program segment that returns the aircraft status during the flight process.
[0061] Since the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present invention, their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.
[0062] Those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated in one processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment.
[0063] An embodiment of the present invention further provides a computer device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, wherein the processor implements the steps in any of the above-mentioned method embodiments when executing the computer program.
[0064] An embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.
[0065] An embodiment of the present invention further provides an information data processing terminal, which, when executed on an electronic device, provides a user input interface to implement the steps in the above method embodiments. The information data processing terminal is not limited to mobile phones, computers, and switches.
[0066] An embodiment of the present invention further provides a server, which is used to provide a user input interface to implement the steps in the above method embodiments when executed on an electronic device.
[0067] An embodiment of the present invention provides a computer program product. When the computer program product runs on an electronic device, the electronic device can implement the steps in the above-mentioned method embodiments when executing the computer program product.
[0068] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the camera / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk.
[0069] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any modifications, equivalent substitutions and improvements made by any technician familiar with the technical field within the technical scope disclosed by the present invention and within the spirit and principles of the present invention should be covered within the protection scope of the present invention.
Claims
1. A method for forcibly synchronizing a clock with a background music video during a formation flight performance, characterized in that: The method includes: S1: The formation aircraft are placed on site, open the ground station, select the background music to be played, enter the specified audio time code, select the formation flight screen style, and enter the start UTC time of the music playback; S2: The ground station calculates the start UTC time of the background music and adds the relative time of the audio to the specified frame to obtain the expected synchronization time of the actual picture playback and the audio; S3: Use the expected synchronization time obtained in step S2 to reversely calculate the take-off UTC time of the formation group to obtain the time required for the dance flight waypoint; Play the waypoints at the set frequency, and calculate the time required from the takeoff waypoint to the expected screen through the cumulative number of screen points, that is, the relative time. Subtract the relative time from the total time to get the expected takeoff time of the aircraft; S4: The take-off UTC time obtained in step S3 is sent to the individual aircraft in the fleet. After receiving the take-off instruction, the aircraft flies to the set take-off time, and the background audio is played at the set time; S5: It is expected that the picture will achieve audio and video synchronization.
2. The method for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 1, characterized in that: In step S1, the audio time code is specified to specify the time of the climax of the music according to the needs of the performance.
3. The method for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 1, characterized in that: In step S3, the waypoints are played at a set frequency of 25 Hz.
4. The method for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 1, characterized in that: In step S3, the cumulative number of picture points refers to the waypoint playback points, starting from 1 and ending at the last point, where the point count is the cumulative number.
5. An unmanned aerial vehicle using the method for forcibly synchronizing the clock with a background music video during a formation flight performance as described in any one of claims 1 to 4.
6. A system for forcibly synchronizing the clock with background music video during a formation flight performance, characterized in that: A method for implementing forced clock synchronization with a background music video during a formation flight performance as described in any one of claims 1 to 4, the system comprising: A user interface interaction module (1) is used for user input and interaction, including selecting background music, inputting a specified audio time code, selecting a formation flight picture style, and inputting a UTC time for starting music playback; An audio and video synchronization calculation module (2) is used to calculate the synchronization time of audio and video playback to ensure the synchronization of background music and formation flight images; The navigation calculation and control module (3) is used to calculate the time required from the take-off waypoint to the expected picture and the expected take-off time of the aircraft, and to execute take-off instructions and navigation control.
7. The system for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 6, characterized in that: The system for forcibly synchronizing the clock with the background music video during the formation flight performance is carried by a group of drones and is used in flight performances.
8. The system for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 6, characterized in that: The system is mounted on a computer device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, and the processor implements the functions of the above-mentioned method when executing the computer program.
9. The system for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 6, characterized in that: The system is mounted on a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the functions of the method described above can be realized.
10. The system for forcibly synchronizing the clock with the background music video during the formation flight performance according to claim 6, characterized in that: The system for forced clock synchronization with the background music video during the formation flight performance is installed on the server. The server is used to provide a user input interface to implement the functions of the synchronization system as described above when executed on an electronic device.
