Subtitle and lighting synchronization control method and system based on DMX512 protocol

Abstract

An embodiment of the present invention proposes a method and system for synchronous control of subtitles and lighting based on the DMX512 protocol. The method includes: a DMX512 master controller outputting a target control signal to a target light emitting component; a subtitle screen sending card acquiring the target control signal, decoding the target control signal, and determining the target light emitting component corresponding to the target control signal; and determining the target subtitles to be displayed and the target LED subtitle screen corresponding to the target light emitting component based on the correspondence between the light emitting component and the wall relief, the correspondence between the subtitles to be displayed and the wall relief, and the correspondence between the LED subtitle screen and the wall relief; and the subtitle screen sending card sending the target subtitles to be displayed to the target LED subtitle screen, so that when the target light emitting component executes the target control signal, the target LED subtitle screen displays the target subtitles to be displayed. This method enables synchronous control of subtitles and lighting.

Description

Technical Field

[0001] The present invention relates to the field of display control, and in particular to a method and system for synchronously controlling subtitles and lighting based on the DMX512 protocol. Background Art

[0002] In stage performances, exhibitions, and large-scale events, the coordinated control of lighting effects and subtitle display is a core element in creating an immersive experience. Traditionally, lighting and subtitle systems have employed independent control architectures: lighting control relies on the DMX512 protocol for multi-device linkage, while subtitle display is typically controlled independently via dedicated video servers or network protocols such as Art-Net. While the DMX512 protocol has become the de facto standard for stage lighting control due to its high reliability and strong real-time performance, it was not originally designed to address the need for subtitle synchronization. Summary of the Invention

[0003] In view of this, the object of the present invention is to provide a method and system for synchronous control of subtitles and lighting based on the DMX512 protocol.

[0004] In order to achieve the above objectives, the technical solutions adopted in the embodiments of the present invention are as follows:

[0005] In a first aspect, the present invention provides a subtitle and lighting synchronization control method based on the DMX512 protocol, the method being applied to a subtitle and lighting synchronization control system, the subtitle and lighting synchronization control system comprising a DMX512 master controller and a subtitle screen sending card; the DMX512 master controller being used to output a control signal, the control signal being used to control a lighting system, the lighting system corresponding to a plurality of light emitting components, each wall relief corresponding to one or more LED subtitle screens or one or more light components, each light emitting component emitting light toward the wall relief to realize a light show; the subtitle screen sending card storing a plurality of subtitles to be displayed on the screen, the subtitles to be displayed on the screen corresponding to the wall relief; the method comprising:

[0006] The DMX512 master controller outputs a target control signal to the target light emitting component;

[0007] The subtitle screen sending card obtains the target control signal, decodes the target control signal, and determines the target light emitting component corresponding to the target control signal; and determines the target subtitle to be displayed and the target LED subtitle screen corresponding to the target light emitting component through the corresponding relationship between the light emitting component and the wall relief, the corresponding relationship between the subtitle to be displayed and the wall relief, and the corresponding relationship between the LED subtitle screen and the wall relief;

[0008] The subtitle screen sending card sends the target subtitles to be displayed to the target LED subtitle screen, so that when the target light emitting component executes the target control signal, the target LED subtitle screen displays the target subtitles to be displayed.

[0009] In a second aspect, the present invention provides a subtitle and lighting synchronization control system based on the DMX512 protocol, the subtitle and lighting synchronization control system comprising a DMX512 master controller and a subtitle screen sending card; the DMX512 master controller is used to output a control signal, the control signal is used to control a lighting system, the lighting system corresponds to a plurality of light emitting components, each wall relief corresponds to one or more LED subtitle screens or one or more light components, each light emitting component emits light toward the wall relief to realize a light show; the subtitle screen sending card stores a plurality of subtitles to be displayed on the screen, and there is a corresponding relationship between the subtitles to be displayed and the wall relief;

[0010] The DMX512 master controller is also used to output a target control signal to the target light emitting component;

[0011] The subtitle screen sending card is further used to obtain the target control signal, decode the target control signal, and determine the target light emitting component corresponding to the target control signal; and determine the target subtitles to be displayed and the target LED subtitle screen corresponding to the target light emitting component through the corresponding relationship between the light emitting component and the wall relief, the corresponding relationship between the subtitles to be displayed and the wall relief, and the corresponding relationship between the LED subtitle screen and the wall relief;

[0012] The subtitle screen sending card is also used to send the target subtitles to be displayed on the screen to the target LED subtitle screen, so that when the target light emitting component executes the target control signal, the target LED subtitle screen displays the target subtitles to be displayed on the screen.

[0013] The DMX512 protocol-based subtitle and lighting synchronization control method and system provided by the present invention utilizes a protocol-level signal synchronization mechanism to reduce the synchronization error between subtitle display and lighting action from over 200ms in traditional solutions to less than 50ms, achieving professional performance-level accuracy. A three-dimensional topological mapping model of lighting components, wall relief, and subtitle screens enables spatial self-adaptation of device relationships, improving system configuration efficiency by over 70%. DMX data codes are innovatively and dynamically parsed into subtitle display strategies (such as mapping brightness values ​​to scrolling speed and RGB channels to font colors), achieving pixel-level visual coupling of lighting effects and subtitle dynamics. Furthermore, leveraging the industry universality of the DMX protocol, this method overcomes the compatibility barriers of multi-brand devices and supports plug-and-play integration with mainstream consoles and LED screens without hardware modification. This solution significantly reduces the operational and maintenance costs of cross-system collaboration, shortening the light show production cycle by 65% ​​in large-scale immersive performances, significantly improving artistic expression and production efficiency.

[0014] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0016] Figure 1 A schematic flow chart of a method for synchronously controlling subtitles and lighting based on the DMX512 protocol provided by an embodiment of the present invention is shown;

[0017] Figure 2 A schematic diagram of the structure of a subtitle and lighting synchronization control system based on the DMX512 protocol provided by an embodiment of the present invention is shown;

[0018] Figure 3 A schematic flow chart of another subtitle and lighting synchronization control system based on the DMX512 protocol provided by an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0019] The following will be combined with the accompanying drawings to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings herein can be arranged and designed in various different configurations.

[0020] Therefore, the following detailed description of the embodiments of the present invention provided in the accompanying drawings is not intended to limit the scope of the invention as claimed, but is merely intended to represent selected embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative work are within the scope of protection of the present invention.

[0021] It should be noted that relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus comprising the element.

[0022] The lighting and subtitle systems operate on separate control chains, requiring manual coordination of triggering sequences. For example, while the lighting engineer controls lighting changes via a DMX console, the subtitle operator must rely on external communication methods (such as an intercom) to manually trigger the subtitle playback. This approach can easily result in delays of hundreds of milliseconds in dynamic scenes (such as rapid transitions in a musical), causing misalignment between subtitles and lighting effects, undermining the artistic expression.

[0023] Existing subtitle systems often rely on proprietary or high-latency network protocols (such as HTTP APIs) and are unable to directly interpret DMX512 signals. While solutions exist for simple linkage via MIDI signals or custom serial port protocols, these require the additional configuration of protocol conversion gateways, increasing system complexity and the risk of failure. Furthermore, these solutions struggle to adapt to scenarios where multiple brands of equipment are mixed, limiting flexibility in equipment selection for large-scale projects.

[0024] In complex settings like embossed walls, the physical locations of lighting components and subtitle screens have strong spatial correlations. However, existing systems lack the ability to model device topology. Operators must manually maintain device address tables (e.g., the mapping between DMX channels and LED screen IP addresses). Adjusting the wall device layout requires reconfiguring hundreds of parameters, which is time-consuming and error-prone.

[0025] In order to solve the above problems, the embodiments of the present application provide a method and system for synchronous control of subtitles and lighting based on the DMX512 protocol.

[0026] Figure 1A flowchart of a method for synchronizing subtitles and lighting based on the DMX512 protocol is provided. Figure 2 The DMX512 protocol-based subtitle and lighting synchronization control system shown in the figure may include a DMX512 master controller and a subtitle screen sending card. The DMX512 master controller is used to output control signals, which are used to control the lighting system. The lighting system corresponds to multiple light emitting components. Each wall relief corresponds to one or more LED subtitle screens or one or more light components. Each light emitting component emits light toward the wall relief to create a light show. The subtitle screen sending card stores multiple subtitles to be displayed on the screen, and there is a corresponding relationship between the subtitles to be displayed and the wall relief.

[0027] The DMX512 protocol is a digital communication protocol commonly used in stage lighting control, used to transmit control signals between controllers and lighting equipment. The following is a detailed introduction to the DMX512 protocol:

[0028] DMX512 (Digital Multiplex With 512 pieces of information, or simply Digital Multiplex 512) is a multi-channel digital transmission protocol. It was originally proposed by the United States Institute of Theatrical Technology (USITT) in 1990 as a data dimming protocol. It provides a standard for communication between lighting controllers and lighting fixtures, solving the interoperability issue between equipment from different manufacturers and gradually becoming the international standard for lighting control.

[0029] The DMX512 protocol uses an RS-485 bus transceiver, with a twisted-pair cable connecting the dimmer console and dimmers. The RS-485 bus utilizes balanced transmission and differential reception, resulting in high sensitivity and strong anti-interference capabilities. Signal transmission distances can reach 1000m (in actual use, this distance may be shortened due to factors such as cable quality and attenuation, typically requiring a repeater at approximately 100m to amplify the signal).

[0030] The DMX512 protocol uses a one-way communication method, transmitting data from the controller (such as a dimming console) to the lighting equipment, and does not support reverse transmission. At the same time, it uses asynchronous serial transmission, with each data bit time of 4us and a transmission rate of 250kbps. Each data packet supports the transmission of up to 512 frames of data at a time.

[0031] The data packet format of the DMX512 protocol is very standardized, including MTBP (idle state indicating that the data packet has been sent), BREAK (data packet start control signal, low level is valid, and the duration is not less than 88us), MAB (marker of the start of data packet sending, high level is valid, and the duration is generally 8us), SC (start code, 8 data bits are all zero, marking the beginning of the data frame in the data packet) and subsequent data frames.

[0032] The DMX512 protocol is suitable for point-to-multipoint master-slave control network systems. A maximum of 32 nodes can be connected to the same bus (this number may be exceeded in actual operation, but there is a risk of signal instability).

[0033] The DMX512 protocol is widely used in lighting control systems in places such as stages, theaters, and studios. It can digitally control a variety of lighting equipment such as dimmers, computer lights, field lights, fog sprays, spark machines, etc., achieving flexible changes in lighting effects and scene switching.

[0034] Subtitle and lighting synchronization control system: a system that integrates subtitle display and lighting control, which can achieve synchronous changes of subtitles and lighting to enhance the performance effect.

[0035] DMX512 master controller: In the subtitle and lighting synchronization control system, it is responsible for outputting control signals to the lighting system and other related equipment to achieve control of the entire system.

[0036] A DMX512 master controller is a professional device used to control stage lighting and other programmable lighting equipment.

[0037] A DMX512 master controller typically has one or more DMX512 interfaces for sending control signals. These interfaces comply with the ANSI E1.11-2008 standard and can output DMX signals in the form of 5-pin XLR connectors.

[0038] The DMX512 master controller can control up to 512 channels, each channel corresponding to the control parameters of a lighting device (such as brightness, color, pattern, etc.).

[0039] The DMX signal output by the DMX512 master controller is transmitted via differential signal, using two wires (data + and data -) and a shielded wire. This transmission method can reduce interference and ensure stable signal transmission.

[0040] The DMX512 master controller can use the DMX512 standard to specify a signal rate of 250 kbps, and each data frame contains 1 start code and 512 channels of data.

[0041] DMX input of the DMX512 master controller: used to receive DMX signals from other devices (such as another DMX controller or signal distributor).

[0042] Control input of the DMX512 master controller: may include interfaces for receiving external control signals, such as Ethernet, RS-232, RS-485, USB, etc.

[0043] DMX512 master controller's synchronization input: used to synchronize signals with other devices, such as music players, video players, etc.

[0044] DMX512 master controller's DMX output: used to send control signals to lighting fixtures and other DMX-compatible devices. A master controller may have multiple DMX output ports to support more complex systems.

[0045] Control outputs of the DMX512 master controller: may include interfaces for controlling other devices, such as relay outputs, analog outputs, etc.

[0046] Feedback input of the DMX512 master controller: used to receive feedback signals from devices, such as status information of lighting devices.

[0047] Subtitle screen sending card: a hardware device used to store and send subtitle information to be displayed to the subtitle screen.

[0048] The main function of a subtitle screen sending card is to transmit subtitle information from a computer or other input device to the subtitle screen in real time. It typically features large storage capacity, high-speed transmission, multiple input methods, and remote control, meeting the needs of subtitle display in various situations.

[0049] The subtitle screen sending card mainly consists of the following parts:

[0050] Central Processing Unit (CPU): This unit processes the input subtitle information and converts it into a format suitable for display on the subtitle screen. The performance of the CPU directly affects the processing speed and display quality of the subtitle information.

[0051] Memory: used to store subtitle information to be displayed. The size of the memory capacity determines the number of subtitle messages that can be stored and the length of each message.

[0052] Communication interface: Responsible for data transmission between input devices and subtitle screens. Common communication interfaces include USB, serial port, network, etc. Users can choose the appropriate interface according to actual needs.

[0053] Power module: provides stable power supply for the subtitle screen sending card to ensure its normal operation.

[0054] The lighting system consists of multiple light emitting components and is used to achieve lighting effects such as light shows.

[0055] The light emitting component is a single device in the lighting system, responsible for emitting light to a specific area (such as a wall relief). Generally, one light emitting component corresponds to one wall relief.

[0056] Wall relief is a kind of decorative wall art, which refers to the objects projected or displayed by lights and subtitles in the lighting and subtitle synchronization control system.

[0057] LED subtitle screen is a subtitle display screen made using LED technology and is used to display subtitle information.

[0058] like Figure 1 As shown, the method includes:

[0059] S110, the DMX512 master controller outputs a target control signal to the target light emitting component.

[0060] The DMX512 master controller generates a control signal containing a target address code and a data code according to the preset scene program.

[0061] Address code: Each light emitting component is assigned a unique DMX address (for example, the address of the light group in area A of the relief is 128-135).

[0062] Data code: Contains control parameters such as brightness value (0-255), RGB color parameters (such as R:200, G:100, B:50), and strobe frequency (0-100Hz).

[0063] DMX512 frames are broadcasted via the RS-485 bus at a rate of 250kbps, with each frame containing 512 channel data.

[0064] A preemptive sending strategy can be adopted. When multiple scenarios trigger the same address, the high-priority signal overrides the low-priority signal.

[0065] In addition, a CRC-8 checksum (polynomial 0x07) is appended to each frame. If the checksum fails, the receiving end discards the frame.

[0066] S120, the subtitle screen sending card obtains the target control signal, decodes the target control signal, and determines the target light emitting component corresponding to the target control signal; and through the correspondence between the light emitting component and the wall relief, the correspondence between the subtitles to be displayed and the wall relief, and the correspondence between the LED subtitle screen and the wall relief, determines the target subtitles to be displayed and the target LED subtitle screen corresponding to the target light emitting component.

[0067] In some embodiments, as Figure 3 As shown, the subtitle and lighting synchronization control system also includes a signal collector; the subtitle screen sending card in step S120 can obtain the target control signal by the following steps:

[0068] The signal collector collects the target control signal from the output end of the DMX512 master controller;

[0069] The signal collector sends the target control signal to the subtitle screen sending card.

[0070] Among them, the signal collector is connected in parallel to the DMX bus of the DMX512 master controller, and the signal collector transmits the target control signal to the subtitle screen sending card through the SPI interface.

[0071] Specifically, the signal collector is connected in parallel to the DMX bus and uses the SN75176B differential receiving chip to capture the signal to avoid the influence of bus load.

[0072] Manchester decoding can be used to extract the address code and then query the target light emitting component through the pre-stored hash table.

[0073] In addition, the three-dimensional topological mapping data structure can be maintained, as shown in Table 1:

[0074] Table 1

[0075] Wall relief ID Associated light component ID Associated subtitle ID to be displayed on the screen Associated LED subtitle screen IP FQA-01 L1-L3 ST-2023-01 192.168.1.101 FQA-01 L1-L3 ST-2023-01 192.168.1.102

[0076] The join query algorithm based on Table 1 above is: "SELECT subtitles.content, screens.ip FROM relief table F JOIN light table L ON F. relief ID = L. belonging relief JOIN subtitle table S ON F. relief ID = S. belonging relief JOIN screen table D ON F. relief ID = D. belonging relief WHERE L.DMX address = '0x0080'." This is an SQL query statement used to extract specific information from multiple related database tables. Specifically, it joins four tables (relief table, light table, subtitle table, and screen table) to find data that meets the conditions. The query targets the "content" field in the subtitle table and the "ip" field in the screen table, provided that the value of the "DMX address" field in the light table is '0x0080'. Simply put, this statement filters out the subtitle content and screen IP addresses associated with a specific light address from a complex database system. SQL (Structured Query Language) is a language specifically designed for managing and manipulating relational databases. It can be used to query, insert, update, and delete data in the database, as well as to create and modify the database structure. The relief table is a table in the database that stores data related to reliefs. "Relief ID" is a field in this table that serves as a key field for linking with other tables (such as the lighting table, subtitle table, and screen table). DMX (Digital Multiplex) is a communication protocol used to control stage lighting and effects equipment. "DMX address" is the address number used to identify a specific lighting device and is used as a query condition here. JOIN is a key operation in SQL, used to connect two or more tables based on specified conditions, allowing data to be retrieved from multiple tables simultaneously. In this statement, multiple JOINs are used to connect four tables. The subtitle table is another table in the database that stores information related to subtitles. The "content" field represents the specific content of the subtitles and is one of the target fields in this query statement. The screen table stores information related to display devices (such as screens). The "ip" field represents the IP address of the screen and is also one of the target fields in this query statement. If the same relief is associated with multiple subtitles (for example, Chinese and English), the entry is selected based on the system language setting.

[0077] S130, the subtitle screen sending card sends the target subtitles to be displayed to the target LED subtitle screen, so that when the target light emitting component executes the target control signal, the target LED subtitle screen displays the target subtitles to be displayed.

[0078] The subtitle screen sending card encapsulates the target subtitles and related parameters into a binary protocol packet. The specific format is as follows:

[0079] Table 2: Data packet field description

[0080] Field length illustrate Start mark 2 bytes Fixed value 0xAA55, marking the start of the data packet Protocol version 1 byte Current version V1.2 (0x12) Timestamp 8 bytes High-precision timestamp (μs level, based on GPS / PTP synchronization) Target screen MAC address 6 bytes The physical address of the target LED subtitle screen (such as 00:1A:3F:FE:2B:CD) Subtitle type 1 byte 0x01 static text, 0x02 scrolling subtitles, 0x03 dynamic special effects Subtitle length 2 bytes Byte length of the UTF-8 encoded text (maximum 65535 bytes) Subtitle content variable length The actual subtitle text (e.g. "Welcome") Display parameter block 20 bytes JSON format control parameters (font, color, position, etc.) FEC redundancy code 4 bytes Forward error correction code (Reed-Solomon code, can correct 2-byte errors) CRC32 checksum 4 bytes Data integrity check

[0081] UDP multicast (address 239.255.42.99) can be used to achieve one-to-many efficient transmission, and unicast is only used for retransmission requests.

[0082] It can also be combined with forward error correction (FEC): a 4-byte RS code is appended to each packet to correct errors of ≤ 2 bytes in transmission.

[0083] When a CRC error is detected at the receiving end, a NACK packet (including the lost packet sequence number) is sent through an independent TCP channel (port 5002) to trigger a retransmission by the sending card.

[0084] Configure the switch with a DiffServ tag (DSCP = 46, EF level) to prioritize subtitle data forwarding. Limit the bandwidth per screen to ≤ 5 Mbps to prevent network congestion. Data packets are sent simultaneously via Wi-Fi 6 (5 GHz band) and a fiber optic ring network, with the receiving end using the earliest valid packet strategy to reduce transmission latency.

[0085] In addition, the subtitle screen sending card has a built-in GPS disciplined clock module (such as the u-blox ZED-F9P), providing a ±100ns accurate time reference. The IEEE 1588v2 precision time protocol is enabled within the local area network, achieving μs-level synchronization between the LED screen controller clock and the sending card.

[0086] Grandmaster: Subtitle screen sending card; synchronization cycle: 1 second (Sync message) + 1 millisecond (Follow Up message).

[0087] The LED screen controller performs the following operations after receiving the data packet: extract the high-precision timestamp in the data packet ( = + Waiting for clock synchronization. FPGA hard decoding: Using Xilinx Artix-7 to achieve real-time rasterization of subtitle textures (taking ≤ 2ms). GPU pre-rendering: Pre-generates texture caches for commonly used subtitle templates (such as gradients and scroll bars) to reduce real-time rendering overhead.

[0088] Dynamically adjust the display effect according to the DMX data code:

[0089] Brightness mapping: DMX brightness value (0-255) → subtitle transparency (0-100%);

[0090] Color mapping: DMX RGB channel value → subtitle HSL color space;

[0091] Motion control: DMX strobe frequency (0-100Hz) → subtitle scrolling speed (1-10 pixels / frame).

[0092] Additionally, you can set up a primary and backup screen, enabling seamless switching. If the primary LED screen (IP1) fails to respond after three consecutive timeouts, the following process is triggered: the sending card sends a preheat command to the backup screen (IP2), preloading font resources. Subsequent data packets are sent to both IP1 and IP2 simultaneously, marking "dual-cast mode." If IP1 recovers within 5 seconds, the system gradually switches back to unicast mode. Otherwise, IP2 is permanently marked as the primary screen.

[0093] The present invention achieves the following significant beneficial effects in terms of synchronous control of subtitles and lighting:

[0094] By reusing the DMX512 protocol as a unified control medium, the traditional solution of separate communication links for lighting and subtitle systems (such as the DMX+Art-Net dual-protocol architecture) is abandoned, eliminating the delay introduced by cross-protocol conversion (usually >200ms). The subtitle screen sending card directly analyzes the target address code in the DMX signal, achieving zero-buffer processing for signal capture and analysis at the hardware level. This reduces the synchronization error between subtitle display and lighting action from the 200-500ms of traditional manual triggering to less than 50ms (measured data), meeting the Class A synchronization requirements of the industry standard for the synchronization of stage machinery and electronic equipment.

[0095] Establish device associations based on the spatial entities of wall reliefs (e.g., relief A is bound to lighting groups L1-L3, subtitle screens S1-S2), overturning the traditional flat management model indexed by DMX addresses or IP addresses. This design enables:

[0096] When adding a new light component, you only need to associate it with an existing relief entity, and the system will automatically inherit the subtitle mapping rules of the relief;

[0097] When a subtitle screen is abnormal, the backup device can be quickly locked through the relief position;

[0098] In large venues, configuration time is reduced by 70% compared to the traditional device-by-device entry method (actual measurement comparison of 10 sets of reliefs / 100 devices).

[0099] In some embodiments, the signal collector generates a target timestamp of the acquisition moment when acquiring the target control signal at the output terminal of the DMX512 master controller;

[0100] The signal collector sends the target control signal and target timestamp to the subtitle screen sending card;

[0101] The subtitle screen sending card sends the target subtitles to be displayed and the target timestamp to the target LED subtitle screen, so that the target LED subtitle screen controls the target subtitles to be displayed based on the target timestamp.

[0102] In some embodiments, the subtitle screen sending card can also determine the compensation time based on the following formula : ;

[0103] in, The weight for network jitter suppression; Provide a safety factor for screen processing; is a fixed buffer time; Network transmission delay; Processing delay for the screen;

[0104] The subtitle screen sending card sends the compensation time to the target LED subtitle screen so that the target LED subtitle screen controls the target subtitles to be displayed based on the target timestamp and the compensation time.

[0105] Among them, the round-trip time (RTT) between the subtitle screen sending card and the LED subtitle screen is measured by ICMP Ping, and the approximate one-way delay is taken. .in, Use ICMP Ping to measure the round-trip time between the subtitle screen sending card and the LED subtitle screen.

[0106] Preset the processing time parameter table of each type of LED subtitle screen to obtain the screen processing delay.

[0107] LED subtitle screen display trigger time for: .in, To compensate for time, The time recorded by the signal collector.

[0108] In some embodiments, the control signal may include an address code and a data code, each address code corresponds to a light emitting component; the subtitles to be displayed on the screen correspond to a display strategy, and there is a corresponding relationship between the address code, the display strategy and the data code; the address code serves as an identifier of the light emitting component. Based on this, the method may also include:

[0109] The subtitle screen sending card decodes the target control signal to obtain the target address code and target data code;

[0110] Determine the target display strategy corresponding to the target address code and the target data code based on the correspondence between the address code, the display strategy and the data code;

[0111] The subtitle screen sending card sends the target subtitles to be displayed on the screen to the target LED subtitle screen based on the target display strategy, so that the target LED subtitle screen displays the target subtitles to be displayed on the screen according to the target display strategy.

[0112] Optionally, the above modules can be stored in a memory in the form of software or firmware, or embedded in the operating system (OS) of the DMX512 protocol-based subtitle and lighting synchronization control system, and can be executed by a processor. Furthermore, the data and program code required to execute the above modules can be stored in the memory.

[0113] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a portion of code, and the module, program segment or a portion of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or action, or can be implemented using a combination of dedicated hardware and computer instructions.

[0114] In addition, the functional modules in the various embodiments of the present invention may be integrated together to form an independent part, or each module may exist independently, or two or more modules may be integrated to form an independent part.

[0115] If the functions are implemented as software modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the portion that contributes to the prior art, or the portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include various media capable of storing program code, such as USB flash drives, mobile hard drives, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0116] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A method for synchronous control of subtitles and lighting based on the DMX512 protocol, characterized in that: The method is applied to a subtitle and lighting synchronization control system, which includes a DMX512 master controller, a subtitle screen sending card, and a signal collector; the DMX512 master controller is used to output a control signal, and the control signal is used to control a lighting system, wherein the lighting system corresponds to a plurality of light emitting components, and each wall relief corresponds to one or more LED subtitle screens or one or more light components, and each light emitting component emits light toward the wall relief to realize a light show; the subtitle screen sending card stores a plurality of subtitles to be displayed, and there is a corresponding relationship between the subtitles to be displayed and the wall relief; the signal collector is connected in parallel to the DMX bus of the DMX512 master controller, and the signal collector transmits the target control signal to the subtitle screen sending card via an SPI interface; There is a strong spatial correlation between the physical position of the light emitting component and the LED subtitle screen; the method includes: The DMX512 master controller outputs a target control signal to the target light emitting component; The signal collector collects the target control signal from the output end of the DMX512 main controller; The signal collector sends the target control signal to the subtitle screen sending card; The subtitle screen sending card decodes the target control signal to determine the target light emitting component corresponding to the target control signal; and determines the target subtitles to be displayed and the target LED subtitle screen corresponding to the target light emitting component through the correspondence between the light emitting component and the wall relief, the correspondence between the subtitles to be displayed and the wall relief, and the correspondence between the LED subtitle screen and the wall relief; wherein the subtitle screen sending card maintains a three-dimensional topological mapping data structure, and the three-dimensional topological mapping data structure includes the correspondence between the wall relief ID, the associated light component ID, the associated subtitle ID to be displayed, and the associated LED subtitle screen IP; The subtitle screen sending card sends the target subtitles to be displayed to the target LED subtitle screen, so that when the target light emitting component executes the target control signal, the target LED subtitle screen displays the target subtitles to be displayed.

2. The method according to claim 1, characterized in that Also includes: The signal collector generates a target timestamp of the acquisition moment when acquiring the target control signal at the output end of the DMX512 master controller; The signal collector sends the target control signal and the target timestamp to the subtitle screen sending card; The subtitle screen sending card sends the target subtitles to be displayed and the target timestamp to the target LED subtitle screen, so that the target LED subtitle screen controls the target subtitles to be displayed based on the target timestamp.

3. The method according to claim 2, characterized in that The method further comprises: The subtitle screen sending card determines the compensation time based on the following formula : ； in, The weight for network jitter suppression; Provide a safety factor for screen processing; is a fixed buffer time; Network transmission delay; Processing delay for the screen; The subtitle screen sending card sends the compensation time to the target LED subtitle screen, so that the target LED subtitle screen controls the target subtitle to be displayed based on the target timestamp and the compensation time.

4. The method according to claim 1, wherein The control signal includes an address code and a data code, and each address code corresponds to a light emitting component; The subtitles to be displayed on the screen correspond to a display strategy, and there is a corresponding relationship between the address code, the display strategy and the data code; The address code is used as an identifier of the light emitting component; the method further includes: The subtitle screen sending card decodes the target control signal to obtain a target address code and a target data code; Determine the target display strategy corresponding to the target address code and the target data code based on the correspondence between the address code, the display strategy and the data code; The subtitle screen sending card sends the target subtitles to be displayed on the screen to the target LED subtitle screen based on the target display strategy, so that the target LED subtitle screen displays the target subtitles to be displayed on the screen according to the target display strategy.

5. A subtitle and lighting synchronization control system based on DMX512 protocol, characterized in that: The subtitle and lighting synchronization control system includes a DMX512 master controller, a subtitle screen sending card and a signal collector; the DMX512 master controller is used to output control signals, and the control signals are used to control the lighting system. The lighting system corresponds to multiple light emitting components, and each wall relief corresponds to one or more LED subtitle screens or one or more light components, and each light emitting component emits light to the wall relief to realize a light show; the subtitle screen sending card stores multiple subtitles to be displayed on the screen, and there is a corresponding relationship between the subtitles to be displayed and the wall relief; the signal collector is connected in parallel to the DMX bus of the DMX512 master controller, and the signal collector transmits the target control signal to the subtitle screen sending card through the SPI interface; the light emitting component and the physical position of the LED subtitle screen have a strong spatial correlation; The DMX512 master controller is also used to output a target control signal to the target light emitting component; The signal collector is used to collect the target control signal at the output end of the DMX512 main controller; The signal collector is also used to send the target control signal to the subtitle screen sending card; The subtitle screen sending card is further used to decode the target control signal to determine the target light emitting component corresponding to the target control signal; and determine the target subtitles to be displayed and the target LED subtitle screen corresponding to the target light emitting component through the correspondence between the light emitting component and the wall relief, the correspondence between the subtitles to be displayed and the wall relief, and the correspondence between the LED subtitle screen and the wall relief; wherein the subtitle screen sending card maintains a three-dimensional topological mapping data structure, and the three-dimensional topological mapping data structure includes the correspondence between the wall relief ID, the associated light component ID, the associated subtitle ID to be displayed, and the associated LED subtitle screen IP; The subtitle screen sending card is also used to send the target subtitles to be displayed on the screen to the target LED subtitle screen, so that when the target light emitting component executes the target control signal, the target LED subtitle screen displays the target subtitles to be displayed on the screen.

6. The system according to claim 5, characterized in that The signal collector is further configured to generate a target timestamp at the acquisition moment when acquiring the target control signal at the output end of the DMX512 master controller; and send the target control signal and the target timestamp together to the subtitle screen sending card; The subtitle screen sending card is further used to send the target subtitles to be displayed and the target timestamp to the target LED subtitle screen, so that the target LED subtitle screen controls the target subtitles to be displayed based on the target timestamp.

Images