Method and apparatus for processing time code data and real-time visual packaging system

Abstract

The present invention discloses a method and apparatus for processing time code data and a real-time visual packaging system. Among them, the method includes: receiving time code data from a time code sending end; performing a decoding operation on the time code data to generate a plurality of time code information in a predetermined format; respectively matching the plurality of time code information with a plurality of preset trigger time codes, and the plurality of trigger time codes respectively correspond to different control commands; in response to successful matching, sending the control command corresponding to the successfully matched trigger time code to the corresponding control port to execute an operation corresponding to the control command. Through the present invention, it can be realized that virtual reality systems and online graphic systems can be triggered by time codes to execute complex animation playback.

Description

Technical Field

[0001] The present invention relates to the field of video systems, and particularly to a method and apparatus for processing time code data and a real-time visual packaging system. Background Art

[0002] In the field of radio and television media, when a camera records an image signal, a unique time code (abbreviated as time code or time stamp) is recorded for each image. Its main function was originally for post-production work, to accurately locate video clips and audio clips according to the time code, efficiently synchronize video and audio files, and make the output video after editing and processing achieve lip-sync.

[0003] With the development and diversification of the media industry, time code has evolved from being used in post-production to live galas. By using time code, various technologies can be synchronized in real time to achieve synchronous triggering and execution of technical interfaces such as video, audio, and lighting, presenting the most perfect performance. As an extension of live broadcast technology, in addition to basic video, audio, and lighting, other technical interfaces - large screens, power devices, virtual reality, online graphic packaging, etc. - have all put forward requirements for precise synchronous triggering. Through a time code receiving device, time code synchronization is performed with other technical interfaces to ensure that each link can be controlled and synchronized by machine time, avoiding the problem of incomplete synchronization caused by real-time human operation errors, and ensuring that the program effects can be accurately triggered for all technical effects down to each frame.

[0004] Currently, there is no precedent for time code synchronization in virtual reality systems and online graphic systems (also known as online packaging). Real-time broadcasting relies on manual timing operations, which have relatively large uncertainties and broadcast risks. Even the most experienced broadcast control personnel cannot guarantee completely precise synchronization with the video and audio time triggers.

[0005] The time code systems commonly used in existing live broadcast systems are not fully compatible with virtual reality systems and online graphic systems. It is necessary to use a third-party (foreign fee-based) software to read the time code information. However, due to system incompatibility (online graphic systems and virtual reality systems are Windows systems, while the current time code receiving devices are developed based on the IOS system), the time code information needs to be specifically converted before it can be received by virtual reality systems and online graphic systems.

[0006] In addition, the sending and receiving of time code synchronization is only the first step, and its most important function is to trigger the operation and playback of the software of this system according to the received time code information. In the prior art, for video devices, simply synchronizing the start trigger can meet the broadcast requirements. However, for virtual reality systems and online graphic systems, simply triggering with an initial value cannot complete a task. During the execution process, it is necessary to synchronize the operation of each key frame of the animation in real time according to the passage of time, and the commands involved in the execution are relatively complex. Therefore, after simply receiving the start of time code synchronization, it is also necessary to control the more complex animation broadcast, which the current device is unable to execute. Summary of the Invention

[0007] In view of this, the present invention provides a method for processing time code data, an apparatus, and a real-time visual packaging system to solve at least one of the above-mentioned problems.

[0008] According to a first aspect of the present invention, there is provided a method for processing time code data, the method comprising: receiving time code data from a time code sending end; performing a decoding operation on the time code data to generate a plurality of time code information in a predetermined format; respectively matching the plurality of time code information with a plurality of preset trigger time codes, the plurality of trigger time codes corresponding to different control commands respectively; in response to a successful match, sending the control command corresponding to the successfully matched trigger time code to the corresponding control port to perform an operation corresponding to the control command.

[0009] Specifically, performing a decoding operation on the time code data includes: performing a format conversion operation on the time code data to generate the plurality of time code information in the predetermined format, the time code information including: machine time information, and a playback frame position corresponding to the machine time information.

[0010] Receiving time code data from a time code sending end includes: receiving a plurality of time code data in different formats from the time code sending end through a XLR audio cable.

[0011] Preferably, the above method further includes: presetting an association relationship between the trigger time code, the control command, and the control port, the control command being used to control an animation scene based on an online graphic system and / or a virtual reality system.

[0012] According to a second aspect of the present invention, there is provided a processing device for time code data, the device comprising: a time code data receiving unit for receiving time code data from a time code sending end; a decoding unit for performing a decoding operation on the time code data to generate a plurality of time code information in a predetermined format; a matching unit for respectively matching the plurality of time code information with a plurality of preset trigger time codes, the plurality of trigger time codes corresponding to different control commands respectively; and a command sending unit for, in response to a successful match, sending the control command corresponding to the successfully matched trigger time code to a corresponding control port to perform an operation corresponding to the control command.

[0013] Specifically, the above decoding unit is configured to: perform a format conversion operation on the time code data to generate the plurality of time code information in the predetermined format, the time code information including: machine time information and a playback frame position corresponding to the machine time information.

[0014] Specifically, the above time code data receiving unit is configured to: receive a plurality of time code data in different formats from the time code sending end through an XLR audio cable.

[0015] Preferably, the above device further comprises: an association relationship setting unit for presetting the association relationship among the trigger time code, the control command, and the control port, the control command being used to control an animation scene based on an online graphic system and / or a virtual reality system.

[0016] According to a third aspect of the present invention, there is provided a real-time visual packaging system, the system comprising: an online graphic system, a virtual reality system, a time code sending end, a video system, and the above processing device for time code data, wherein the processing device for time code data sends the control command to the online graphic system and / or the virtual reality system to enable a predetermined animation scene in the online graphic system and / or the virtual reality system to be loaded to a predetermined playback frame position in the video system.

[0017] According to a fourth aspect of the present invention, there is provided an electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, the steps of the above method are implemented.

[0018] According to a fifth aspect of the present invention, there is provided a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0019] As can be seen from the above technical solution, by decoding the time code data received from the time code sending end, multiple time code information in a predetermined format is generated, and the generated time code information is matched with the preset trigger time code. When the matching is successful, the control command corresponding to the successfully matched trigger time code is sent to the control port of the online graphic system or the virtual reality system to execute the operation corresponding to the control command, so that the virtual reality system and the online graphic system devices can be triggered by the time code to execute complex animation playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0021] Figure 1 is a flowchart of the method for processing time code data according to an embodiment of the present invention;

[0022] Figure 2 is a structural block diagram of a real-time visual packaging system according to an embodiment of the present invention;

[0023] Figure 3 is a structural block diagram of the time code data processing device 1 according to an embodiment of the present invention;

[0024] Figure 4 is a detailed structural block diagram of the time code data processing device 1 according to an embodiment of the present invention;

[0025] Figure 5 is a hardware example structural diagram of the time code data processing device 1 according to an embodiment of the present invention;

[0026] Figure 6 is a software implementation example structural diagram of the time code data processing device 1 according to an embodiment of the present invention;

[0027] Figure 7 is a specific execution flow schematic diagram of the time code data processing device 1 according to an embodiment of the present invention;

[0028] Figure 8 is a screenshot of the setting interface of the trigger time code and the control command according to an embodiment of the present invention;

[0029] Figure 9 is a schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0031] In the process of implementing the present invention, the applicant has discovered the following related technologies:

[0032] By referring to the time code synchronization board card devices of lights or switchers, an internationally standardized format and general-purpose time code transceiver device can be used to read time code information. How the time code functions for different devices after being received depends on the software compatibility. In the related technologies, different time code receiving devices cannot be directly transferred to other devices. The time code receiving device of lights cannot be used for video, and the time code receiving device of audio cannot be used for lights. Even the time code synchronization device of a video switcher cannot be compatible between different brands of switcher products. Therefore, different devices require dedicated time code receiving devices for themselves.

[0033] The time code systems commonly used in existing live broadcast systems are not fully compatible with virtual reality systems and online graphic systems. Third-party software is required to read the time code information. Moreover, due to system incompatibility (the online graphic system and the virtual reality system are Windows systems, while the time code receiving device is developed based on the IOS system), the time code information needs to be specifically converted before it can be received by the virtual reality system and the online graphic system.

[0034] In addition, time code synchronization sending and receiving is only the first step, and its most important function is to trigger the operation and playback of the software of this system according to the received time code information. For example, for video devices, just synchronously starting the trigger can meet the broadcast requirements. However, for virtual reality systems and online graphic systems, just an initial value trigger cannot complete a task. During the execution process, it is necessary to synchronize the operation of each key frame of the animation in real time according to the passage of time, and the commands involved in the execution are relatively complex. Therefore, after simply receiving the time code synchronization start, more complex animation broadcasts still need to be manually controlled.

[0035] That is to say, currently, for the time code receiving devices of virtual reality systems and online graphic systems, the following problems exist: (1) Due to system incompatibility, the time code information received by the time code receiving device needs to be converted before it can be received by the virtual reality system and the online graphic system; (2) After receiving the time code synchronization start, more complex animation broadcasts still need to be manually controlled.

[0036] Based on this, on the basis of realizing time code synchronization in other technical trades (such as lighting, audio and video, etc.), the embodiments of the present invention provide a time code synchronization scheme for virtual reality systems and online graphic packaging systems, so as to receive time codes in a unified format on virtual reality system and online graphic system devices, convert them into commands recognizable by software, and moreover, complex animations that can be triggered by time codes on virtual reality system and online graphic system devices can be loaded into the live video for playback. The embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0037] Figure 1 is a flowchart of a method for processing time code data according to an embodiment of the present invention, as Figure 1 shown, the method includes:

[0038] Step 101, receiving time code data from a time code sending end.

[0039] In actual operation, multiple time code data from a time code sending end can be received through a cannon audio cable, or a twisted pair cable, or a MIDI (Musical Instrument Digital Interface) cable. Here, the formats of the time code data can be different. For example, it can be an LTC Smpte (a kind of time code) time code or an MTC (MIDI Time Code) time code.

[0040] Step 102, performing a decoding operation on the time code data to generate multiple time code information in a predetermined format.

[0041] Specifically, a format conversion operation can be performed on the time code data to generate multiple time code information in a predetermined format. The time code information includes: machine time information, and a playback frame position corresponding to the machine time information. For example, the time code information can be in a format such as "hour:minute:second:frame...".

[0042] In this way, by converting the time code information into a predetermined format, it is convenient for subsequent matching and recognition operations of the time code information.

[0043] Step 103, respectively matching the multiple time code information with multiple preset trigger time codes, and the multiple trigger time codes respectively correspond to different control commands.

[0044] In actual operation, an association relationship between the trigger time code, the control command, and the control port can be preset. The control command is used to control the animation scene based on the online graphic system and / or the virtual reality system.

[0045] Step 104, in response to successful matching, send the control command corresponding to the trigger time code of the successful matching to the corresponding control port to perform an operation corresponding to the control command.

[0046] By performing a decoding operation on the received time code data from the time code sender, generate multiple time code information in a predetermined format, and perform a matching operation between the generated time code information and the pre-set trigger time code. When the matching is successful, send the control command corresponding to the trigger time code of the successful matching to the control port of the online graphic system or the virtual reality system to perform an operation corresponding to the control command, so that the virtual reality system and the online graphic system devices can be triggered by the time code to play complex animations.

[0047] Based on a similar inventive concept, an embodiment of the present invention further provides a real-time visual packaging system, as Figure 2 shown. The system includes: a time code data processing device 1, an online graphic system 2, a virtual reality system 3, a time code sender 4, and a video system 5. Among them, the time code data processing device 1 receives the time code data sent by the time code sender 4, decodes the time code data to generate time code information in a predetermined format, and when the time code information successfully matches the pre-set trigger time code, sends the control command corresponding to the trigger time code of the successful matching to the online graphic system and / or the virtual reality system. The control command is used to control the playback of the animation scene of the online graphic system and / or the virtual reality system, so that a predetermined animation scene in the online graphic system and / or the virtual reality system can be loaded to a predetermined playback frame position in the video system 5.

[0048] Preferably, the above time code data processing device 1 can implement the process in the above method embodiment. Figure 3 is a structural block diagram of the time code data processing device 1, as Figure 3 shown. The time code data processing device 1 includes: a time code data receiving unit 11, a decoding unit 12, a matching unit 13, and a command sending unit 14, where:

[0049] The time code data receiving unit 11 is used to receive the time code data from the time code sender.

[0050] In actual operation, the time code data receiving unit 11 can receive multiple time code data in different formats (for example, LTC Smpte time code or MTC time code) from the time code sender through a cannon head audio cable, or a twisted pair cable, or a MIDI cable.

[0051] The decoding unit 12 is used to perform a decoding operation on the time code data to generate multiple time code information in a predetermined format.

[0052] Specifically, the decoding unit 12 performs a format conversion operation on the time code data to generate a plurality of time code information in the predetermined format. The time code information includes: machine time information and a playback frame position corresponding to the machine time information.

[0053] In this way, by converting the time code information into a predetermined format, it is convenient for subsequent matching and recognition operations of the time code information.

[0054] The matching unit 13 is configured to perform a matching operation on the plurality of time code information respectively with a plurality of preset trigger time codes, and the plurality of trigger time codes respectively correspond to different control commands.

[0055] The command sending unit 14 is configured to, in response to a successful match, send the control command corresponding to the successfully matched trigger time code to the corresponding control port to execute an operation corresponding to the control command.

[0056] Through the decoding unit 12 performing a decoding operation on the time code data received by the time code data receiving unit 11 from the time code sending end to generate a plurality of time code information in a predetermined format, the matching unit 13 performs a matching operation on the generated time code information with the preset trigger time codes. When the match is successful, the command sending unit 14 sends the control command corresponding to the successfully matched trigger time code to the control port of the online graphic system or the virtual reality system to execute an operation corresponding to the control command, so that it can be realized that the virtual reality system and the online graphic system devices can be triggered by the time code to execute complex animation playback.

[0057] In the specific implementation process, as Figure 4 shown, the time code data processing device 1 further includes: an association relationship setting unit 15, configured to preset the association relationship between the trigger time code, the control command, and the control port.

[0058] For the specific execution processes of the above units, reference can be made to the descriptions in the above method embodiments, which will not be elaborated here.

[0059] In actual operation, the above units can be combinedly set or can be set individually, and the present invention is not limited thereto.

[0060] To further understand the embodiments of the present invention, the following combines Figure 5 the shown hardware structure, and Figure 6 the shown software implementation example to describe in detail the working principle of the time code data processing device 1 in the live broadcast.

[0061] As Figure 5For the hardware structure shown, the time code is sent through the time code sending port. The time code is received using an XLR audio cable, and the received time code is transmitted to the decoding and playlist control terminal through a computer USB (Universal Serial Bus) port or UDP (User Datagram Protocol) via a third-party hardware (e.g., KissBox series), converted into a time code in a predetermined format, and distributed to the control terminals of the virtual reality system or the online graphic system through program instructions to drive different systems to execute different instructions. For computers with different operating systems, the configuration standards are different. Although connected through an IP network, it can be regarded as a local MIDI interface on both PCs and MACs to match the corresponding MIDI reception.

[0062] As Figure 6 shown, on the virtual reality system or the online graphic system, the time code receiving hardware receives the time code sent by the time code generator through an XLR audio cable or the like, and transmits it to the time code receiving module through a network port UDP (or a computer USB port). The time code receiving module parses the received time code and performs time code playlist operations to match control commands that can be triggered to trigger the rendering engine animation.

[0063] In actual operation, by writing a program, the received time code can be identified and processed in the form of UDP data packets. The information conveyed by the time code is corresponding to the animation parameters made on the engine. A control panel is made in C#, and control animation commands are written in vb (a programming language) and the engine custom language. In addition to completing the basic trigger animation, more complex commands for customizing the control of the engine animation can also be defined, such as script trigger, parameter passing, picture replacement, text update, animation loop, frame replacement, time speed change, etc.; at the same time, the number of engines can also be defined to achieve multi-engine and multi-process commands controlled by one time code, and more complex effect synchronization can be accurately completed.

[0064] Figure 7 is a schematic diagram of the specific execution process of the time code data processing device 1 according to an embodiment of the present invention. As Figure 7 shown, this process mainly includes:

[0065] Step 1, data parsing: Parse the Sampte LTC time code or MTC Midi time code transmitted by the third-party time code receiving hardware through the USB port or UDP protocol.

[0066] Step 2, intercept the time code segment of the data: Intercept the required time code part of the parsed data for storage and display.

[0067] Step 3, set multiple engine IP (Internet Protocol) addresses and port numbers: The user sets all the engine IP addresses and port numbers to be controlled to implement the control of multiple engines and multiple processes with a single time code.

[0068] Step 4, set the trigger time code: Set a fixed time code (i.e., the above-mentioned trigger time code). When the received time code is the same as this time code, a series of actions in Steps 5 and 6 are triggered.

[0069] Step 5, set the engine commands: Set the engine interface commands integrated in the software, or manually write commands in the software engine interface command editing area. Refer to Figure 8 the screenshot of the setting interface for the trigger time code and control commands shown, so that more complex commands for customizing the control of the engine animation can be implemented.

[0070] In actual operation, Steps 3 - 5 can be set in advance, and Step 4 for setting the trigger time code and Step 5 for setting the engine commands need to be set correspondingly.

[0071] Step 6, send the engine commands corresponding to the matched time code: When the trigger time code set in Step 4 is the same as the received time code, the corresponding engine commands in Step 5 are sent to the engine set in Step 3 via the UDP protocol.

[0072] In one instance, the engine commands can be as follows:

[0073] 1. REND*STAGE*DIRECTOR*A1 START;

[0074] Explanation: Locate the animation named A1 in the "STAGE" menu in the engine and play it.

[0075] 2. REND*STAGE*DIRECTOR*A1 SHOW 0.21;

[0076] Explanation: Locate the animation named A1 in the "STAGE" menu in the engine and move the play frame to 0.21 seconds.

[0077] 3. REND*STAGE*DIRECTOR*A1 CONTINUE REVERSE;

[0078] Explanation: Locate the animation named A1 in the "STAGE" menu in the engine and play it in reverse.

[0079] 4. REND*FRONT_LAYER*STAGE*DIRECTOR*A1 START;

[0080] Explanation: Locate the animation named A1 in the "STAGE" menu of the foreground layer in the engine and play it.

[0081] 5, REND*BACK_LAYER*STAGE*DIRECTOR*A1 START;

[0082] Explanation: Locate the animation named A1 in the "STAGE" menu of the background layer in the engine and play it.

[0083] 6, REND SET_OBJECT c / scene1;

[0084] Explanation: Load the scene with the path "c / scene1" in the engine.

[0085] 7, REND*TREE GET;

[0086] Explanation: Obtain the scene tree in the engine.

[0087] 8, REND*SCRIPT INVOKE script1;

[0088] Explanation: Execute the script method named "script1" in the engine.

[0089] 9, CLOCK 0*TIME SET 200;

[0090] Explanation: Set the time of the clock numbered "0" to "200" seconds.

[0091] 10, CLOCK 0CONT;

[0092] Explanation: Continue playing the animation of the clock numbered "0".

[0093] In actual operation, special commands can also be set to meet special functional requirements.

[0094] The following gives an example.

[0095] In a large-scale evening party, the time code can be uniformly issued by the audio system. The video system (including the time code monitoring of the switcher and cameras), the lighting system, the large screen system, and the online packaging system receive the same time code. At the start of each song, all technical parts are simultaneously and uniformly triggered to implement the preset effects. Among them, the online packaging system is built in a dual-engine and primary / backup dual-backup system, and accesses 8-channel camera signals. It pre-produces packaging special effects and animations. The time code data processing device of the embodiment of the present invention is connected to the video relay system. The received time code is uniformly converted into a time code in a predetermined format through the time code data processing device, and the time code is matched with the trigger time code. When the matching is successful, the control command corresponding to the matched trigger time code is accurately incorporated into the packaging effects for different camera positions. In the same song, 4 groups of animation effects can be controlled through the time code, avoiding the mistakes of real-time manual operations and presenting a perfect broadcast effect.

[0096] Figure 9 It is a schematic diagram of an electronic device according to an embodiment of the present invention. Figure 9 The shown electronic device is a general data processing device, which includes a general computer hardware structure, and at least includes a processor 901 and a memory 902. The processor 901 and the memory 902 are connected through a bus 903. The memory 902 is suitable for storing one or more instructions or programs executable by the processor 901. The one or more instructions or programs are executed by the processor 901 to implement the steps in the above-mentioned time code data processing method.

[0097] The above-mentioned processor 901 can be an independent microprocessor or a set of one or more microprocessors. Thus, the processor 901 executes the commands stored in the memory 902, thereby executing the method flow of the embodiment of the present invention as described above to implement the processing of data and the control of other devices. The bus 903 connects the above-mentioned multiple components together, and at the same time connects the above-mentioned components to a display controller 904, a display device, and an input / output (I / O) device 905. The input / output (I / O) device 905 can be a mouse, a keyboard, a modem, a network interface, a touch input device, a somatosensory input device, a printer, and other devices well known in the art. Typically, the input / output (I / O) device 905 is connected to the system through an input / output (I / O) controller 906.

[0098] Among them, the memory 902 can store software components, such as an operating system, a communication module, an interaction module, and application programs. Each of the above-mentioned modules and application programs corresponds to a set of executable program instructions for completing one or more functions and the methods described in the embodiments of the invention.

[0099] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method for processing time code data are implemented.

[0100] In summary, the time code data processing solution provided by the embodiment of the present invention realizes the time code synchronization function of the virtual reality system and the online packaging system in the live broadcast technology link. Moreover, through the time code control of the virtual reality system and the online graphic system, the effect of touching complex animations through time codes can be achieved; through the embodiment of the present invention, another technical synchronization implementation is added to the live broadcast synchronization process link, achieving a more accurate broadcast effect and reducing the risk of real-time manual operation in the live broadcast.

[0101] The preferred embodiments of the present invention have been described above with reference to the accompanying drawings. Many features and advantages of these embodiments are clear from this detailed description. Therefore, the claims are intended to cover all these features and advantages that fall within the true spirit and scope of these embodiments. In addition, since many modifications and changes are easily conceivable by those skilled in the art, the embodiments of the present invention are not limited to the exact structures and operations illustrated and described, but may cover all suitable modifications and equivalents that fall within their scope.

[0102] Those skilled in the art should understand that the embodiments of the present invention may be provided as a method, a system, or a computer program product. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0103] The present invention is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one or more of the flows or multiple flows and / or blocks Figure 1 one or more of the blocks or multiple blocks.

[0104] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means embodying the functionality specified in one or more of the flow Figure 1 acts or a plurality of acts and / or boxes Figure 1 specified in one or more of the boxes or a plurality of boxes.

[0105] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable apparatus provide steps for implementing the functionality specified in one or more of the flow Figure 1 acts or a plurality of acts and / or boxes Figure 1 specified in one or more of the boxes or a plurality of boxes.

[0106] Specific embodiments are used in the present invention to illustrate the principles and implementation manners of the present invention. The description of the above embodiments is only used to help understand the method and its core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation on the present invention.

Claims

1. A method for processing time code data, characterized in that, the method includes: receiving time code data from a time code sending end; performing a decoding operation on the time code data to generate a plurality of time code information in a predetermined format; respectively matching the plurality of time code information with a plurality of preset trigger time codes, where the plurality of trigger time codes respectively correspond to different control commands; in response to a successful match, sending the control command corresponding to the successfully matched trigger time code to the corresponding control port to perform an operation corresponding to the control command; The performing a decoding operation on the time code data includes: performing a format conversion operation on the time code data to generate the plurality of time code information in the predetermined format, where the time code information includes: machine time information and a playback frame position corresponding to the machine time information; The control command is used to load a predetermined animation scene in an online graphic system and / or a virtual reality system to a predetermined playback frame position in a video system; the control command includes: finding the animation named A1 in the "STAGE" menu in the engine and moving the playback frame to 0.21 seconds, finding and playing the animation named A1 in the "STAGE" menu of the foreground layer in the engine, finding and playing the animation named A1 in the "STAGE" menu of the background layer in the engine, obtaining the scene tree in the engine, executing the script method named "script1" in the engine, finding and playing the animation named A1 in the "STAGE" menu in the engine, finding and playing the animation named A1 in the "STAGE" menu in the engine in reverse, loading the scene at the path in the engine, setting the clock time numbered "0" to "200" seconds and continuing to play the animation with clock number "0"; The method for processing the time code data further includes: presetting the association relationship between the trigger time code, the control command, and the control port, where the control command is used to control the animation scene based on the online graphic system and / or the virtual reality system; The presetting the association relationship between the trigger time code, the control command, and the control port includes: setting a plurality of engine IP addresses and port numbers so that a time code data controls multi-engine multi-process commands; setting a fixed trigger time code, and setting the engine interface command integrated in the software, or manually writing the command in the software engine interface command editing area; the trigger time code and the engine interface command are correspondingly set, and when the received time code is consistent with the trigger time code, the corresponding engine interface command is sent to the corresponding engine through the UDP protocol; The method for processing the time code data further includes: by writing a program, identifying and processing the received time code data in the form of a UDP data packet, corresponding the information conveyed by the time code data to the animation parameters made on the engine, making a control panel by C#, and writing control animation commands in vb and the engine custom language; the control animation commands include commands for controlling script triggering, parameter passing, picture replacement, text update, animation loop, frame replacement, and time speed change.

2. The method according to claim 1, characterized in that, Receiving time code data from a time code sender includes: Receiving multiple time code data in different formats from the time code sender through a XLR audio cable.

3. A processing device for time code data, characterized in that, the device includes: a time code data receiving unit for receiving time code data from a time code sender; a decoding unit for performing a decoding operation on the time code data to generate multiple time code information in a predetermined format; a matching unit for respectively matching the multiple time code information with multiple preset trigger time codes, and the multiple trigger time codes respectively correspond to different control commands; a command sending unit for, in response to a successful match, sending the control command corresponding to the successfully matched trigger time code to a corresponding control port to execute an operation corresponding to the control command; the decoding unit is specifically used for: performing a format conversion operation on the time code data to generate multiple time code information in the predetermined format, and the time code information includes: machine time information and a playback frame position corresponding to the machine time information; the control command is used to load a predetermined animation scene in an online graphic system and / or a virtual reality system to a predetermined playback frame position in a video system; the control command includes: finding the animation named A1 in the "STAGE" menu in the engine and moving the playback frame to 0.21 seconds, finding and playing the animation named A1 in the "STAGE" menu in the foreground layer of the engine, finding and playing the animation named A1 in the "STAGE" menu in the background layer of the engine, obtaining the scene tree in the engine, executing the script method named "script1" in the engine, finding and playing the animation named A1 in the "STAGE" menu in the engine, finding and playing the animation named A1 in the "STAGE" menu in the engine in reverse, loading the scene at the path in the engine, setting the clock time numbered "0" to "200" seconds and continuing to play the animation with clock number "0"; the processing device for time code data further includes: an association relationship setting unit for presetting the association relationship between the trigger time code, the control command, and the control port, and the control command is used to control the animation scene based on the online graphic system and / or the virtual reality system; the association relationship setting unit is specifically used for: setting multiple engine IP addresses and port numbers so that a time code data controls multiple engine multi-process commands; setting a fixed trigger time code, and setting an engine interface command integrated in the software, or manually writing a command in the software engine interface command editing area; the trigger time code and the engine interface command are correspondingly set, and when the received time code is consistent with the trigger time code, the corresponding engine interface command is sent to the corresponding engine through the UDP protocol; the processing device for time code data is further specifically used for: By writing a program, the received time code data is recognized and processed in the form of UDP data packets. The information conveyed by the time code data is corresponding to the animation parameters made on the engine. A control panel is made in C#, and control animation commands are written in vb and the custom language of the engine; the control animation commands include commands for controlling script triggering, parameter passing, picture replacement, text update, animation loop, fixed frame replacement, and time speed change.

4. A real-time visual packaging system, characterized in that the system includes: an online graphic system, a virtual reality system, a time code sender, a video system, and a processing device for time code data as described in claim 3. Among them, the processing device for time code data sends the control commands to the online graphic system and / or the virtual reality system, so that a predetermined animation scene in the online graphic system and / or the virtual reality system is loaded to a predetermined playback frame position in the video system.

5. An electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that when the processor executes the program, the steps of the method described in any one of claims 1 to 2 are implemented.

6. A computer-readable storage medium, on which a computer program is stored, characterized in that when the computer program is executed by the processor, the steps of the method described in any one of claims 1 to 2 are implemented.

Images