Multi-screen collaborative immersive interactive cinema image synchronization method and system

Abstract

The invention relates to the technical field of image synchronization, in particular to a multi-screen collaborative immersive interactive cinema image synchronization method and system.The method comprises the steps that when the system is initialized, a multi-screen projection module completes image splicing and sends real-time splicing parameters to a coordinate mapping calibration module; the coordinate mapping calibration module establishes a basic mapping relation between physical coordinates and virtual coordinates based on the real-time splicing parameters, and the environment sensing module collects environment parameters and transmits the environment parameters to the cooperative control unit. According to the invention, a dynamic mapping algorithm model is constructed, real-time splicing parameters of the multi-screen projection module and light and temperature data collected by the environment sensing module are integrated, and a mapping relation between physical coordinates and virtual coordinates is corrected in real time; the problems of aiming deviation and special effect dislocation caused by the fact that coordinate mapping lacks dynamic adaptation and cannot be adjusted along with changes of splicing parameters in the prior art are effectively solved.

Description

Technical Field

[0001] This invention relates to the field of image synchronization technology, specifically to a multi-screen collaborative immersive interactive cinema image synchronization method and system. Background Technology

[0002] Immersive interactive cinemas construct a surround visual space through multi-screen splicing projection, combined with interactive operation devices and scene special effects devices, allowing viewers to participate in interaction while watching images. The core lies in the deep integration of visual presentation, interactive operation, and scene special effects. Among them, the splicing accuracy of multi-screen images and the spatial positioning accuracy of interactive operation directly determine the realism of the immersive experience, and the coordinated adaptation of the two is a key aspect of technological realization.

[0003] The currently disclosed patent CN111294628B describes a multi-channel immersive audio-visual control system. This system employs a cloud platform-based multi-channel immersive projection device and a stereo sound system, enabling multiple projection components to simultaneously output ultra-high-definition images and construct a multi-faceted surround audio-visual space. Through distributed decoding and synchronous control technology, this system solves the synchronization problem of multi-channel video output, providing fundamental support for an immersive experience.

[0004] However, the aforementioned technologies and existing similar solutions suffer from a specific technical problem: during multi-screen image synchronization, there is a lack of a dynamic adaptation mapping calibration mechanism between the physical spatial coordinates of the interactive device and the virtual coordinates of the multi-screen spliced ​​image, and this mapping relationship cannot be corrected in real time with minor adjustments to the multi-screen splicing parameters. A multi-screen spliced ​​image is composed of multiple independent projection areas, each with a fixed mapping relationship between its physical position and the virtual image coordinates. The interactive device captures the physical spatial position of the viewer's operation, which needs to be converted to virtual image coordinates to trigger the corresponding feedback. In existing technologies, this coordinate conversion is mostly based on fixed preset parameters. When the physical position of the multi-screen splicing changes slightly due to equipment debugging, site adjustments, etc., the preset coordinate mapping relationship immediately becomes invalid, causing a deviation between the physical spatial position actually aimed at by the viewer and the virtual hit position displayed in the multi-screen image. Simultaneously, the trigger area of ​​the special effects device will also be spatially misaligned with the image feedback position. This misalignment is not a simple time delay or synchronization error, but rather an accuracy problem caused by insufficient dynamic adaptation of the coordinate system. Conventional synchronization control methods cannot solve this, severely damaging the realism and immersive experience of the interactive operation. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention provides a method and system for immersive interactive cinema image synchronization with multi-screen collaboration, which solves the problems of aiming deviation and special effects misalignment caused by the lack of dynamic adaptation of coordinate mapping and the inability to correct for changes in splicing parameters and environment in existing technologies.

[0006] To achieve the above objectives, the present invention provides the following technical solution: a multi-screen collaborative immersive interactive cinema image synchronization method, comprising the following steps: S1: During system initialization, the multi-screen projection module completes the image splicing and sends real-time splicing parameters to the coordinate mapping calibration module. The coordinate mapping calibration module establishes a basic mapping relationship between physical coordinates and virtual coordinates based on the real-time splicing parameters. The environmental perception module collects environmental parameters and transmits them to the collaborative control unit. S2: The collaborative control unit synchronizes the working clocks of each module through the synchronization reference module, starts the playback of image content, and controls the multi-screen projection module to play the surround image synchronously. S3: The audience operates through the interactive operation module. The interactive operation module captures the physical space coordinates of the operation, and after signal preprocessing, transmits the physical coordinate signal to the coordinate mapping calibration module. S4: The coordinate mapping calibration module performs coordinate conversion on the physical coordinate signal according to the recognition range defined by the calibration frame. At the same time, it receives the splicing parameters fed back by the multi-screen projection module and the real-time environmental data transmitted by the environmental perception module in real time. It corrects the basic mapping relationship through the dynamic mapping algorithm, converts the physical coordinates into the corresponding virtual coordinates, and transmits the virtual coordinates to the collaborative control unit. S5: The collaborative control unit sends a screen feedback command to the multi-screen projection module based on the virtual coordinates, and sends a trigger command to the special effects execution module, so that the screen feedback and special effects actions are executed synchronously in spatial position and time sequence.

[0007] Furthermore, the implementation of S1 includes the following specific steps: S11: Powers all devices through the power control module. The one-button power on / off system sends protocol signals to start the server and projector devices according to the device startup priority. S12: The collaborative control unit triggers the initialization process, the multi-screen projection module performs the image splicing operation, and sends the real-time splicing parameters, including the physical location information of each projection area, to the coordinate mapping calibration module. S13: The coordinate mapping calibration module receives the real-time splicing parameters and establishes a basic mapping relationship between points in physical space and corresponding pixels in the multi-screen splicing image; S14: The environmental perception module is activated, collecting light intensity and temperature parameters in the cinema, and transmitting the environmental parameters to the collaborative control unit for subsequent initial calibration.

[0008] Furthermore, the implementation of S2 includes the following specific steps: S21: The collaborative control unit receives the unified time reference signal provided by the synchronization reference module and synchronizes the time reference to the multi-screen projection module, interactive operation module, special effects execution module, coordinate mapping calibration module and dynamic compensation module. S22: The collaborative control unit combines the initial environmental parameters collected by the environmental perception module to perform initial calibration on the brightness and contrast parameters of the multi-screen projection module and the trigger sensitivity parameters of the special effects execution module. S23: The collaborative control unit starts the image content and sends the video signal to the multi-screen projection module through the HDMI fiber optic transmission link, controlling the multi-screen projection module to achieve synchronous playback of the surround image; S24: The collaborative control unit sends control signals to the interactive seat through the control motherboard, so that the interactive seat performs corresponding actions synchronously with the camera movement trajectory on the screen.

[0009] Furthermore, the implementation of S3 includes the following specific steps: S31: Audience members use infrared laser shooting pistols to aim, and the laser beam emitted by the infrared laser shooting pistols illuminates the multi-screen projection screen to form a light spot; S32: The AI ​​algorithm camera in the interactive operation module captures the position of the light spot in physical space and generates the original physical coordinate signal; S33: The IO control board performs noise reduction and filtering on the original physical coordinate signal to obtain the processed physical coordinate signal; S34: If multiple viewers operate simultaneously, the interactive operation module prioritizes the physical coordinate signals from different infrared laser shooting pistols according to their reception time sequence and transmits them sequentially to the coordinate mapping calibration module.

[0010] Furthermore, the implementation of S4 includes the following specific steps: S41: The coordinate mapping calibration module limits the physical coordinate range of the effective interactive area based on the calibration frame set according to the physical space size of the cinema; S42: The coordinate mapping calibration module receives the current splicing parameters periodically fed back by the multi-screen projection module. The splicing parameters include the offset, rotation angle and scaling ratio of each projector. S43: The coordinate mapping calibration module receives real-time environmental data transmitted by the environmental perception module, the real-time environmental data including the current light intensity and temperature value; S44: The coordinate mapping calibration module inputs the processed physical coordinate signal, the current splicing parameters and the real-time environmental data into the preset dynamic mapping algorithm model to calculate the corrected mapping matrix; S45: The coordinate mapping calibration module uses the corrected mapping matrix to convert the physical coordinate signal into virtual coordinates in the multi-screen splicing image; S46: The coordinate mapping calibration module stores the correction parameters obtained from each calculation into the mapping relationship optimization database for subsequent iterative optimization of the mapping algorithm.

[0011] Furthermore, the construction process of the dynamic mapping algorithm model includes the following steps: S441: Establish the initial affine transformation model between the physical coordinate system and the virtual coordinate system; S442: Use the splicing parameters of the multi-screen projection module as the first type of correction factor to adjust the translation, rotation and scaling components in the affine transformation model; S443: Use the environmental data from the environmental sensing module as a second type of correction factor to compensate for coordinate recognition deviations caused by changes in ambient light and equipment deformation caused by temperature changes. S444: By weighted fusion of the first and second type of correction factors, the initial affine transformation model is updated in real time to generate a dynamic mapping algorithm model.

[0012] Furthermore, the implementation of S5 includes the following specific steps: S51: The collaborative control unit receives the virtual coordinates transmitted by the coordinate mapping calibration module and parses the projection area and specific pixel position to which the virtual coordinates belong. S52: The collaborative control unit sends a screen feedback instruction to the corresponding projector in the multi-screen projection module. The instruction includes rendering an impact effect or performing a scene switch at the specific pixel location. S53: The collaborative control unit sends a trigger command to the corresponding device in the special effects execution module through EV1527 encoded communication signals according to the special effects type associated with the virtual coordinates; S54: The triggering command includes the identifier of the special effects device, the trigger intensity value and the duration parameter. The special effects execution module performs actions such as blowing wind, spraying water, falling snow or generating bubbles at a specified physical space location according to the parameters.

[0013] Furthermore, during synchronized video playback and interaction, dynamic compensation S6 is also included: S61: The dynamic compensation module monitors the edge splicing accuracy of the multi-screen projection module, the position synchronization error of the interactive seat, and the action response delay of the special effects execution module in real time. S62: The dynamic compensation module combines the real-time environmental data from the environmental perception module and the mapping relationship correction records from the coordinate mapping calibration module to perform quantitative analysis on the monitored deviation data based on the preset deviation analysis model. S63: When any deviation data exceeds the preset threshold, the dynamic compensation module sends a compensation request signal to the collaborative control unit; S64: The collaborative control unit generates a compensation instruction that matches the type and degree of deviation based on the deviation type and degree information in the compensation request signal; S65: The collaborative control unit sends image geometry correction parameters to the multi-screen projection module or drive current adjustment parameters to the special effects execution module through the ESP8266 control board to compensate for deviations.

[0014] Furthermore, before and after the experience begins, it also includes entry management and system shutdown S7: S71: Before the audience enters, the collaborative control unit sends an opening command to the entry management module, and the sliding rail door opening and closing control module executes the opening action; S72: After the audience enters and takes their seats, the audience recognition system uses an AI algorithm camera to perform facial recognition, counts and records the actual number of people entering, and transmits the data to the collaborative control unit. S73: Before the end of the experience, the entry number recognition system will recalculate the number of people and compare the final number with the initial recorded number; S74: After the experience is over, the collaborative control unit sends an opening command to the sliding rail door opening and closing control module and a shutdown protocol signal to the one-button power on / off system; S75: The one-button power on / off system sends power off commands to the server and projector in a preset sequence. After all devices are turned off, the main power supply is cut off via the electrical box knife switch.

[0015] This invention also provides a multi-screen collaborative immersive interactive cinema image synchronization system, comprising: The collaborative control unit is used to coordinate and schedule the entire process of image playback, interactive response, special effects triggering and environmental adaptation, and to receive feedback signals from each module. The multi-screen projection module is used to receive synchronization commands from the collaborative control unit to complete the splicing, synchronized playback, and dynamic parameter adjustment of multi-screen images; The interactive operation module is used to capture the physical space coordinates of the audience's operations and output the physical coordinate signals after signal preprocessing. The special effects execution module is used to receive trigger commands and execute special effects actions at a specified physical location; The synchronization reference module is used to provide a unified time reference signal for all modules; The coordinate mapping calibration module is used to establish and dynamically correct the mapping relationship between physical coordinates and virtual coordinates, integrate multi-screen splicing parameters and environmental perception data, and convert physical coordinate signals into virtual coordinates. The environmental sensing module is used to collect environmental parameters in the cinema in real time and transmit them to the collaborative control unit; The dynamic compensation module is used to monitor system operation deviations and request parameter compensation from the collaborative control unit when the deviation exceeds the limit. The entry management module is used to control the opening and closing of the cinema doors and to identify and record the number of audience members entering the cinema. The power supply control module is used to control the power supply and power cut-off of all devices and to enable the orderly switching on and off of the devices.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: This invention constructs a dynamic mapping algorithm model, integrating real-time splicing parameters of the multi-screen projection module with light and temperature data collected by the environmental perception module. It corrects the mapping relationship between physical and virtual coordinates in real time, effectively solving the problems of aiming deviation and special effects misalignment caused by the lack of dynamic adaptation in coordinate mapping and the inability to adjust with changes in splicing parameters in existing technologies. Simultaneously, the dynamic compensation module monitors the splicing accuracy, seat synchronization error, and special effects response delay in real time. Through the collaborative control unit, it issues compensation commands to offset deviations, ensuring the synchronization of multi-screen surround playback and the spatial positioning accuracy of interactive operations. Combined with a unified time reference signal and an orderly device start / stop and entry management mechanism, it achieves full-process temporal and spatial synchronization of image playback, interactive response, special effects triggering, and seat movements. This effectively enhances the audience's immersive experience, strengthens the system's stability and practicality, and meets the technical requirements of immersive interactive cinemas. Attached Figure Description

[0017] Figure 1 This is a flowchart of the method of the present invention; Figure 2 This is a schematic diagram of the overall system connection of the present invention; Figure 3 This is a schematic diagram of the multi-screen projection and power-on / off control connection of the present invention; Figure 4 This is a schematic diagram of the entry management control process of the present invention; Figure 5 This is a schematic diagram of the operation of the entrance number recognition system of the present invention; Figure 6 This is a schematic diagram of the start-up and safety barrier control of the broadcast control system of the present invention; Figure 7 This is a schematic diagram showing the connection of the image playback and interactive effects device of the present invention; Figure 8 This is a schematic diagram of the interactive shooting operation and coordinate signal transmission of the present invention. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0019] Example 1 Please see Figure 1-8 This invention provides a method and system for immersive interactive cinema image synchronization with multi-screen collaboration, specifically including the following steps: First, the system initializes. The multi-screen projection module stitches the images and sends real-time stitching parameters to the coordinate mapping calibration module. The coordinate mapping calibration module establishes a basic mapping relationship between physical and virtual coordinates based on these parameters. The environmental perception module collects environmental parameters and transmits them to the collaborative control unit. Specifically, the power supply control module first supplies power to all devices. This module includes a switch and a voltage adapter. The switch controls the main power supply, while the voltage adapter adapts to the voltage requirements of different devices; for example, the projector server is compatible with 220V, while LED strips and lamps are compatible with 12V. Then, the one-button power-on / off system sends a protocol signal to start the server and projector devices according to their startup priority. This priority is set based on the logical dependencies of the devices, with the server, as the core control device, starting first. The projector devices start after the server has finished booting, ensuring smooth signal transmission and command execution.

[0020] After the collaborative control unit triggers the initialization process, the multi-screen projection module performs image splicing. The multi-screen projection module can use a 4K projector or a combination of two 8K projectors, achieving high-speed video signal transmission via HDMI 4K fiber optic cable. Edge blending technology is employed during splicing to ensure a natural transition between adjacent projection areas, with no obvious splicing artifacts. Real-time splicing parameters, including the physical location information of each projection area, are sent to the coordinate mapping calibration module. Upon receiving the real-time splicing parameters, the coordinate mapping calibration module establishes a basic mapping relationship between points in physical space and corresponding pixels in the multi-screen spliced ​​image. Assuming the coordinates of a point in physical space are... The coordinates of the corresponding pixel in the multi-screen splicing image are The fundamental mapping relationship is established through the following linear transformation formula: , in, The basic mapping coefficients are obtained by calibrating the physical size and pixel resolution of the multi-screen projection area. For example, after knowing the coordinates of multiple feature points and their corresponding pixels in the physical space, these coefficients are obtained by using the least squares method.

[0021] After the environmental perception module is activated, it collects light intensity and temperature parameters within the cinema using light and temperature sensors located at different positions. These environmental parameters are then transmitted to the collaborative control unit for subsequent initial calibration. The light intensity parameter is collected within a range of 0-1000 lux, and the temperature parameter within a range of 10-40℃, at a frequency of 10Hz, ensuring real-time reflection of the cinema's environmental conditions.

[0022] After initialization, the collaborative control unit synchronizes the working clocks of each module through the synchronization reference module, starts the playback of image content, and controls the multi-screen projection module to perform surround-style synchronized playback. The collaborative control unit receives a unified time reference signal provided by the synchronization reference module. The synchronization reference module uses the PTP (Precision Time Protocol) to provide a time reference signal with microsecond-level accuracy, and synchronizes this time reference to the multi-screen projection module, interactive operation module, special effects execution module, coordinate mapping calibration module, and dynamic compensation module to ensure that the working timing of each module is consistent.

[0023] The collaborative control unit, in conjunction with the initial environmental parameters collected by the environmental perception module, performs initial calibration on the brightness and contrast parameters of the multi-screen projection module and the trigger sensitivity parameters of the special effects execution module. For example, when the initial light intensity is high, the brightness parameter of the multi-screen projection module is appropriately increased, with a brightness adjustment range of 500-1500 cd / m² and a contrast adjustment range of 1000:1-5000:1. The trigger sensitivity of the special effects execution module is adjusted according to the temperature parameter; when the temperature rises, the trigger sensitivity is appropriately increased to offset the impact of temperature changes on the device's response speed.

[0024] The collaborative control unit initiates the video content, stored in the UE game package on the server, and sends video signals to the multi-screen projection module via an HDMI fiber optic transmission link. The HDMI fiber optic transmission link has a transmission rate of no less than 18Gbps, ensuring latency-free transmission of 4K or 8K ultra-high-definition video signals, and controls the multi-screen projection module to achieve synchronized playback of the surround-view image. Simultaneously, the collaborative control unit sends control signals to the interactive seat via a control motherboard. The control motherboard uses an ESP8266 control board, supporting wireless signal transmission. The interactive seat has built-in drive motors and position sensors, enabling it to synchronously perform up, down, left, and right movements according to the camera's movement trajectory based on the control signals, simulating an immersive experience following the camera's perspective.

[0025] During the playback, viewers operate the interactive module, which captures the physical coordinates of the actions. After signal preprocessing, the physical coordinate signals are transmitted to the coordinate mapping and calibration module. Viewers use an infrared laser shooting pistol for aiming. The pistol emits a 650nm wavelength laser beam, which illuminates the multi-screen projection, forming a light spot with a diameter of 2-5mm. The AI ​​algorithm camera in the interactive module captures the position of the light spot in physical space. This high-definition camera operates at 30fps with a pixel resolution of 1920×1080. An image recognition algorithm extracts the center coordinates of the light spot, generating the original physical coordinate signal. .

[0026] The IO control board performs noise reduction and filtering on the original physical coordinate signal. A median filter algorithm is used to remove random noise from the signal, with the median filter window size set to 3×3. The filtered physical coordinate signal... satisfy: , , , in, This represents the pixel position of the original physical coordinate signal in the image.

[0027] If multiple viewers operate simultaneously, the interactive operation module prioritizes the physical coordinate signals from different infrared laser shooting pistols according to their reception sequence. The priority rule is that the signal received earlier has higher priority than the signal received later. The priority value ranges from 1 to N (where N is the number of viewers operating simultaneously). The signals are then transmitted sequentially to the coordinate mapping calibration module to avoid processing delays caused by signal transmission conflicts.

[0028] After receiving the physical coordinate signal, the coordinate mapping calibration module performs coordinate conversion on the physical coordinate signal according to the recognition range defined by the calibration frame. Simultaneously, it receives splicing parameters from the multi-screen projection module and real-time environmental data transmitted by the environmental perception module. Through a dynamic mapping algorithm, it corrects the basic mapping relationship, converting the physical coordinates into corresponding virtual coordinates, and then transmits the virtual coordinates to the collaborative control unit. The coordinate mapping calibration module first defines the physical coordinate range of the effective interactive area based on the calibration frame set according to the physical space dimensions of the cinema. Assuming the length of the cinema's physical space is L, the width is W, and the height is H, the physical coordinate range of the effective interactive area is... , , Physical coordinate signals outside this range will be considered invalid and will not be processed.

[0029] The coordinate mapping calibration module receives the current stitching parameters periodically fed back by the multi-screen projection module. These stitching parameters include the offset of each projector. Rotation angle and scaling ratio (k is the projector number), with a feedback period of 50ms to ensure timely acquisition of changes in splicing parameters. Simultaneously, it receives real-time environmental data from the environmental sensing module, including current light intensity I and temperature T. The acquisition frequency is consistent with the environmental sensing module's acquisition frequency of 10Hz.

[0030] The coordinate mapping calibration module inputs the processed physical coordinate signal, current stitching parameters, and real-time environmental data into the preset dynamic mapping algorithm model to calculate the corrected mapping matrix. The construction process of the dynamic mapping algorithm model is as follows: First, an initial affine transformation model between the physical coordinate system and the virtual coordinate system is established. The expression for the initial affine transformation model is: , in, Let be the initial affine transformation matrix. , The initial affine transformation coefficients are obtained by calibrating the feature points within the calibration box.

[0031] The splicing parameters of the multi-screen projection module are used as the first type of correction factor. Used to adjust the translation, rotation, and scaling components in an affine transformation model; first-type correction factor. The expression is: , in, The weight coefficients of the first type of correction factor range from 0.3 to 0.7 and are obtained by gradient descent. The optimization objective is to minimize the mapping error between physical coordinates and virtual coordinates. The transformation matrix correction amount corresponding to the splicing parameters is calculated based on the offset, rotation angle, and scaling ratio: , Environmental data from the environmental perception module is used as the second type of correction factor. This is used to compensate for coordinate recognition deviations caused by changes in ambient light and equipment deformation caused by temperature changes; it is a second-type correction factor. The expression is: , in, The weighting coefficients for the second type of correction factor range from 0.3 to 0.7 and satisfy the following conditions: ; The correction factor for the affine transformation coefficients corresponding to the environmental data is calculated based on the changes in light intensity and temperature. , in, , ; The correction coefficient was obtained through experimental calibration. The initial light intensity, This is the initial temperature value.

[0032] By weighted fusion of the first and second type correction factors, the initial affine transformation model is updated in real time to generate a dynamic mapping algorithm model. The expression of the dynamic mapping algorithm model is as follows: , The coordinate mapping calibration module uses the corrected mapping matrix to convert physical coordinate signals into virtual coordinates in the multi-screen splicing image. The corrected parameters obtained from each calculation are stored in the mapping relationship optimization database, which uses an SQLite database. The storage frequency is consistent with the feedback period of the concatenated parameters, which is 50ms. This database is used for iterative optimization of the subsequent mapping algorithm. By continuously accumulating corrected data, the accuracy and stability of the mapping relationship are improved.

[0033] After receiving the virtual coordinates, the collaborative control unit sends a screen feedback command to the multi-screen projection module and a trigger command to the special effects execution module, so that the screen feedback and special effects actions are executed synchronously in spatial position and timing. The collaborative control unit first parses the projection area and specific pixel position to which the virtual coordinates belong, and determines the projector number and pixel coordinates corresponding to the virtual coordinates based on the splicing parameters of the multi-screen projection module. , where u is the horizontal coordinate of the pixel and v is the vertical coordinate of the pixel.

[0034] The collaborative control unit sends image feedback instructions to the corresponding projectors in the multi-screen projection module. The instructions include rendering an impact effect at a specific pixel location or performing a scene switch. The impact effect can take the form of a bright flash or an explosion animation, with a rendering time of 0.5-1s. When switching scenes, a fade-in and fade-out transition effect is used, with a transition time of 1-2s, to ensure smooth and natural image feedback.

[0035] Simultaneously, the collaborative control unit sends trigger commands to the corresponding devices in the special effects execution module via EV1527 encoded communication signals, based on the special effects type associated with the virtual coordinates. The EV1527 encoded communication signal uses a 24-bit data format, including an 8-bit address code and a 16-bit data code, ensuring the uniqueness and accuracy of the command transmission. The trigger command includes the identifier of the special effects device, the trigger intensity value, and the duration parameter. The special effects execution module then executes actions such as blowing wind, spraying water, snowfall, or generating bubbles at the specified physical location based on these parameters. For example, when the scene corresponding to the virtual coordinates is a forest storm, an interactive hair dryer is triggered with a trigger intensity value of 0.6-0.8 (the value is set according to the storm intensity of the scene) and a duration parameter of 3-5 seconds; when the scene is rainy, an interactive water sprayer is triggered with a trigger intensity value of 0.3-0.5 and a duration parameter of 2-4 seconds, ensuring that the special effects actions are highly consistent with the scene and enhancing the viewer's immersion.

[0036] During synchronized video playback and interaction, dynamic compensation is also required. The dynamic compensation module monitors in real time the edge stitching accuracy of the multi-screen projection module, the position synchronization error of the interactive seat, and the action response delay of the special effects execution module. The dynamic compensation module uses an image acquisition device and sensors to monitor the edge stitching accuracy. The image acquisition device captures the edge area of ​​the multi-screen spliced ​​image and calculates the overlap and misalignment of adjacent projection areas through image comparison algorithms. The monitoring accuracy of overlap is 1 pixel, and the monitoring accuracy of misalignment is 0.5 pixels. The position sensor built into the interactive seat monitors the deviation between the actual position and the preset position of the interactive seat. The monitoring accuracy of position synchronization error is 0.1 mm. A timer records the time interval from when the special effects execution module receives the trigger command to when it completes the action. The monitoring accuracy of action response delay is 1 ms, and the monitoring frequency is 20 Hz.

[0037] The dynamic compensation module combines real-time environmental data from the environmental perception module and mapping relationship correction records from the coordinate mapping calibration module to quantitatively analyze the monitored deviation data based on a preset deviation analysis model. The expression for the deviation analysis model is: , Where E is the overall deviation value; , , These are weighting coefficients for image edge stitching accuracy deviation, interactive seat position synchronization error, and special effects execution module action response delay, respectively. The values ​​range from 0.2 to 0.4, and all satisfy the following conditions: This was determined using the analytic hierarchy process (AHP). The image edge splicing accuracy deviation is represented by a weighted sum of overlap deviation and misalignment: , For overlap deviation, It is a misalignment quantity; The position synchronization error of the interactive seat is the distance between the actual position and the preset position. This is the difference between the action response delay of the special effects execution module and the preset response delay.

[0038] When any deviation data exceeds a preset threshold, the dynamic compensation module sends a compensation request signal to the collaborative control unit. The preset threshold is set as follows: based on a large amount of experimental data, the normal fluctuation range of each deviation data is statistically analyzed, and the maximum value of the normal fluctuation range is set as the preset threshold. For example, the preset threshold for the edge stitching accuracy deviation is 2 pixels, the preset threshold for the interactive seat position synchronization error is 0.5mm, the preset threshold for the action response delay of the special effects execution module is 50ms, and the preset threshold for the overall deviation value is 0.3.

[0039] The collaborative control unit generates a compensation instruction that matches the type and degree of deviation based on the deviation type and degree information in the compensation request signal. If the edge stitching accuracy deviation exceeds a threshold, the compensation instruction includes image geometric correction parameters, such as offset adjustment value, rotation angle adjustment value, and scaling ratio adjustment value; if the interactive seat position synchronization error exceeds a threshold, the compensation instruction includes drive motor speed adjustment value; if the special effects execution module action response delay exceeds a threshold, the compensation instruction includes drive current adjustment parameters.

[0040] The collaborative control unit sends image geometric correction parameters to the multi-screen projection module or drive current adjustment parameters to the special effects execution module via the ESP8266 control board to compensate for deviations. For example, when misalignment occurs at the edges of the image, an offset adjustment value is sent to the corresponding projector to adjust its physical position and align the images in adjacent projection areas; when the synchronization error of the interactive seat is large, the speed of the drive motor is adjusted to allow the interactive seat to quickly return to its preset position; when the action response delay of the special effects execution module is too long, the drive current is increased to speed up the action response of the special effects device, ensuring that the system's performance indicators are always kept within a reasonable range and improving the stability of synchronized image playback and interaction.

[0041] Before and after the experience, entry management and system shutdown operations are required. Before the audience enters, the collaborative control unit sends an opening command to the entry management module, and the sliding rail door opening and closing control module executes the opening action. The sliding rail door opening and closing control module adopts a motor-driven sliding rail structure. The motor has a rated power of 500W and a rated speed of 1500rpm. The door opening action takes 3-5 seconds. During the opening process, an infrared sensor detects whether there is an obstacle. If an obstacle is detected, the door opening action is immediately stopped and the door is closed in the reverse direction to ensure the safety of the audience.

[0042] After the audience enters and takes their seats, the attendance recognition system uses an AI algorithm camera to perform facial recognition, count and record the actual number of attendees, and transmit the data to the collaborative control unit. The AI ​​algorithm camera captures facial images of the audience members, extracts facial feature points using a facial recognition algorithm (128 feature points are used), and identifies the audience members by matching these feature points, avoiding duplicate counting. The error in the actual number of attendees counted does not exceed one person.

[0043] Before the experience ends, the attendance recognition system recalculates the number of attendees and compares the final number with the initial recorded number. If the two counts match, the recorded data is retained; if they do not match, the recorded data, along with relevant photos and videos, are retained and sent to the administrator for verification. This allows the administrator to understand the actual audience viewing situation and conduct operational management.

[0044] After the experience, the collaborative control unit sends an opening command to the sliding rail door control module and a shutdown protocol signal to the one-button power-on / off system. The sliding rail door control module executes the door opening action, allowing the audience to leave in an orderly manner; the one-button power-on / off system sends shutdown commands to the server and projector equipment in a preset order. The shutdown order is the reverse of the power-on order, first shutting down the projector equipment, and then shutting down the server after the projector equipment has cooled down to avoid damage to the equipment due to sudden shutdown.

[0045] After all equipment is turned off, the main power supply is cut off through the electrical box knife switch to ensure electrical safety when the equipment is not in operation, while reducing energy consumption.

[0046] By implementing the above process, the lack of a dynamic adaptation mapping calibration mechanism between the physical spatial coordinates of interactive devices and the virtual coordinates of the multi-screen spliced ​​image during multi-screen image synchronization in existing technologies is effectively solved, and the mapping relationship cannot be corrected in real time with minor adjustments to the multi-screen splicing parameters. The dynamic mapping algorithm model can correct the mapping relationship in real time according to changes in multi-screen splicing parameters and environmental data, and the dynamic compensation module can promptly eliminate various deviations, ensuring that the image feedback and special effects actions are highly synchronized in spatial position and temporal sequence. This effectively improves the splicing accuracy of multi-screen images and the spatial positioning accuracy of interactive operations, enhancing the audience's immersive experience.

[0047] Example 2

[0048] Please see Figure 2 The present invention also provides a multi-screen collaborative immersive interactive cinema image synchronization system, used to implement the multi-screen collaborative immersive interactive cinema image synchronization method in Embodiment 1. The system includes: a collaborative control unit, a multi-screen projection module, an interactive operation module, a special effects execution module, a synchronization reference module, a coordinate mapping calibration module, an environmental perception module, a dynamic compensation module, an entry management module, and a power supply control module.

[0049] The collaborative control unit uses an industrial-grade processor, model Intel Core i7-12700H, with a main frequency of 2.7GHz and a cache of 24MB. It has powerful data processing and multi-tasking capabilities, and is used to coordinate and schedule the entire process of image playback, interactive response, special effects triggering and environmental adaptation. It also receives feedback signals from each module to ensure the orderly operation of each part of the system.

[0050] The multi-screen projection module consists of a 4K projector or dual 8K projectors. The projectors have a brightness of 5000 lumens, a contrast ratio of 4000:1, and a resolution of 3840×2160. They support an HDMI 2.1 interface to receive synchronization commands from the collaborative control unit, complete the splicing of multi-screen images, synchronized playback, and dynamic parameter adjustment, and achieve seamless image splicing through edge blending technology.

[0051] The interactive operation module includes an AI algorithm camera, an IO control board, and an infrared laser shooting pistol. The AI ​​algorithm camera has a pixel resolution of 1920×1080 and a shooting frame rate of 30fps. The IO control board uses an STM32F103 microcontroller as the core controller. The infrared laser shooting pistol has a laser wavelength of 650nm and is used to capture the physical space coordinates of the audience's operation. After signal preprocessing, the physical coordinate signal is output.

[0052] The special effects execution module includes interactive hair dryers, interactive water sprayers, interactive snow machines, interactive bubble machines, and other equipment. The wind speed of the interactive hair dryer can be adjusted from 0 to 10 m / s, and the water spray volume of the interactive water sprayer can be adjusted from 0 to 5 L / min. These devices are used to receive trigger commands and execute special effects actions at specified physical locations.

[0053] The synchronization reference module uses a PTP clock synchronization module with a clock accuracy of ±1μs to provide a unified time reference signal for all modules, ensuring that the working timing of each module is consistent.

[0054] The coordinate mapping calibration module uses an FPGA chip, model Xilinx XC7K325T, which has high-speed parallel processing capabilities. It is used to establish and dynamically correct the mapping relationship between physical coordinates and virtual coordinates, integrate multi-screen splicing parameters and environmental perception data, and convert physical coordinate signals into virtual coordinates.

[0055] The environmental sensing module consists of a light sensor and a temperature sensor. The light sensor has a measurement range of 0-1000 lux and a measurement accuracy of ±1 lux, while the temperature sensor has a measurement range of 10-40℃ and a measurement accuracy of ±0.5℃. It is used to collect environmental parameters in the cinema in real time and transmit them to the collaborative control unit.

[0056] The dynamic compensation module uses a microcontroller, specifically an Arduino Uno R3, combined with an image acquisition device and sensors, to monitor system operational deviations and request parameter compensation from the co-control unit when the deviation exceeds the limit.

[0057] The entry management module includes a sliding rail door opening and closing control module and an entry number recognition system. The sliding rail door opening and closing control module consists of a motor, a sliding rail, and an infrared sensor. The entry number recognition system shares an AI algorithm camera with the interactive operation module to control the opening and closing of the cinema doors and to identify and record the number of audience members entering the cinema.

[0058] The power supply control module includes an electrical box knife switch and a voltage adapter. The rated current of the electrical box knife switch is 32A, and the voltage adapter supports multiple output voltages such as 220V to 12V and 24V. It is used to control the power supply and power-off of all equipment and realize the orderly switching on and off of the equipment.

[0059] During system operation, the power supply control module first powers all devices. The one-button power-on system prioritizes and starts the server and projector devices. The collaborative control unit triggers the initialization process. The multi-screen projection module completes image stitching and sends real-time stitching parameters. The coordinate mapping calibration module establishes basic mapping relationships, and the environmental perception module collects initial environmental parameters. Subsequently, the synchronization reference module provides a unified time reference. The collaborative control unit starts video playback, controls the multi-screen projection module to perform surround-style synchronized video playback, and simultaneously controls the interactive seats to move synchronously. Viewers interact by shooting a pistol with an infrared laser. The interaction module captures and preprocesses physical coordinate signals before transmitting them to the coordinate mapping calibration module. The coordinate mapping calibration module corrects the mapping relationship using a dynamic mapping algorithm, converting physical coordinates into virtual coordinates and transmitting them to the collaborative control unit. The collaborative control unit sends image feedback commands and special effects trigger commands based on the virtual coordinates. The dynamic compensation module monitors deviations in real time and compensates for them. The entry management module manages viewer entry and exit. After the experience, the devices are shut down sequentially, and the main power is cut off, completing the entire image synchronization and interactive process.

[0060] Example 3

[0061] To enable those skilled in the art to fully understand and implement this invention, the specific implementation principle of this invention is further explained below in conjunction with a specific application scenario.

[0062] This embodiment selects a small-to-medium-sized immersive interactive cinema as the application scenario for practical application verification. The physical space dimensions of the cinema are 12m in length, 8m in width, and 5m in height. It adopts a single-screen splicing projection layout and is equipped with two 4K projectors. The images are spliced ​​together using edge blending technology to form a complete picture. The total resolution of the projected image is 7680×2160. It is equipped with one row of 15 interactive seats (meeting the actual needs of 10-20 people). Each seat is equipped with an infrared laser shooting pistol and a corresponding interactive operation button. The special effects execution module includes 5 interactive hair dryers, 3 interactive water sprayers, 2 interactive snow machines, and 2 interactive bubble machines, which are evenly distributed in front of and on both sides of the seats.

[0063] During application verification, the system was first initialized and configured, with the device startup priority set as server > projector > special effects execution module > interactive seating > entry management module. The effective interactive area physical coordinate range of the calibration frame was [missing information]. , , (Adapting to the interaction range of one row of seats), the initial affine transformation coefficients of the dynamic mapping algorithm model are obtained by calibrating 100 feature points within the calibration box, and the weight coefficients of the first type of correction factor. The weighting coefficient of the second type of correction factor is set to 0.5. The weighting coefficient of the deviation analysis model is set to 0.5. , , The preset thresholds for various deviations are set as follows: 2 pixels for edge stitching accuracy deviation, 0.5mm for interactive seat position synchronization error, and 50ms for action response delay of special effects execution module.

[0064] The specific types, configuration quantities, and key parameters of each device are shown in Table 1: Table 1

[0065] The specific application verification process is as follows: First, power is supplied to all devices via the electrical box switch. The one-button power-on system starts the server and projector devices according to preset priorities. After the server starts, it loads the image content from the UE game package. After the projector devices start, they perform image stitching. Edge blending technology is used to make the images from the two projectors form a complete stitched image. During the stitching process, the multi-screen projection module sends real-time stitching parameters to the coordinate mapping calibration module. The coordinate mapping calibration module establishes the basic mapping relationship between physical coordinates and virtual coordinates. After the environmental perception module starts, three light sensors and three temperature sensors collect light intensity and temperature parameters at different locations in the cinema and transmit them to the collaborative control unit. The collaborative control unit combines the initial environmental parameters to perform initial calibration of the projector's brightness, contrast, and the trigger sensitivity of the special effects execution module. For example, when the initial light intensity is 300 lux and the temperature is 25℃, the projector's brightness is adjusted to 800 cd / m², the contrast ratio is adjusted to 3000:1, and the trigger sensitivity of the special effects execution module is adjusted to a medium level.

[0066] The synchronization reference module sends a PTP precise time reference signal to all modules to ensure synchronized operation. The collaborative control unit sends video signals to the multi-screen projection module via an HDMI fiber optic transmission link to initiate video content playback. Simultaneously, it sends control signals to the interactive seats via the control motherboard. The interactive seats then move up, down, left, and right in sync with the camera's movement, simulating an immersive experience of following the camera. After the audience enters, the seating experience's attendance recognition system uses an AI algorithm camera to identify and record the number of attendees. A total of 15 audience members were identified, consistent with the number entered into the integrated broadcast control system, and the data was retained.

[0067] During the viewing experience, when the scene transitions to an interactive shooting game, viewers use an infrared laser gun to aim at and shoot at the monsters on screen. The AI ​​algorithm camera captures the physical spatial coordinates of the laser beam, generating raw physical coordinate signals. The IO control board performs median filtering and noise reduction on these signals before transmitting them to the coordinate mapping calibration module. Since multiple viewers may operate the system simultaneously, the interactive operation module prioritizes the physical coordinate signals according to their reception sequence and transmits them accordingly.

[0068] After receiving the physical coordinate signals, the coordinate mapping calibration module filters them according to the valid interactive area defined by the calibration frame, deeming signals outside the range invalid. Simultaneously, it receives periodic feedback of current splicing parameters from the multi-screen projection module, including the offset, rotation angle, and scaling ratio of each projector, as well as real-time environmental data transmitted by the environmental perception module. This data is input into the dynamic mapping algorithm model, which corrects the basic mapping relationship by weighted fusion of the first and second type of correction factors, converting the physical coordinates into virtual coordinates and transmitting them to the collaborative control unit.

[0069] The collaborative control unit analyzes the projection area and pixel position of the virtual coordinates, sends image feedback instructions to the corresponding projector, and renders the impact effect at the pixel position, such as a monster flashing and exploding when it is hit. At the same time, according to the special effect type associated with the virtual coordinates, it sends trigger instructions to the corresponding special effect execution module through EV1527 encoded communication signals. For example, when the audience shoots at the waterfall scene in the picture, the interactive water jet in the corresponding area is triggered to perform a water spraying action with a trigger intensity of 0.4 and a duration of 3 seconds, so that the audience can feel an immersive interactive experience.

[0070] During image playback and interaction, the dynamic compensation module monitors in real time the edge stitching accuracy of the multi-screen projection module, the position synchronization error of the interactive seats, and the action response delay of the special effects execution module. Combined with real-time environmental data from the environmental perception module and mapping relationship correction records from the coordinate mapping calibration module, the module quantifies and analyzes various deviation data using a deviation analysis model. During verification, a screen edge stitching accuracy deviation of 2.5 pixels occurred, exceeding the preset threshold. The dynamic compensation module immediately sent a compensation request signal to the collaborative control unit. Based on the type and degree of deviation, the collaborative control unit issued image geometric correction parameters to the corresponding projector, adjusting the projector's offset and rotation angle to reduce the screen edge stitching accuracy deviation to within 1 pixel, ensuring the integrity and consistency of the image stitching.

[0071] Thirty seconds before the end of the experience, the attendance recognition system recalculated the number of attendees, which remained at 15, consistent with the initial count. After the experience concluded, the collaborative control unit sent an opening command to the sliding door control module, causing the sliding door to open automatically and allowing the attendees to leave in an orderly manner. Subsequently, the collaborative control unit sent a shutdown protocol signal to the one-button power-on / off system, which then sent shutdown commands in the order of server and projector. Once all devices were powered off, the main power supply was cut off via the electrical control panel's knife switch, completing the entire experience.

[0072] Through application verification in this small-to-medium-sized immersive interactive cinema, the multi-screen collaborative immersive interactive cinema image synchronization method and system of the present invention can operate stably. The splicing accuracy of multi-screen images and the spatial positioning accuracy of interactive operations are effectively improved. The screen feedback and special effects actions maintain a high degree of synchronization in spatial position and timing. It effectively solves the problem of insufficient dynamic adaptation of coordinate mapping in the prior art, enhances the audience's immersion and interactive experience, fully demonstrates the practicality and advancement of the present invention, and can meet the application needs of immersive interactive cinemas of different sizes.

[0073] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.

[0074] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A method for synchronizing multi-screen cooperative immersive interactive theater images, characterized in that, Comprise the following steps: S1: at system initialization, the multi-screen projection module completes picture splicing and sends real-time splicing parameters to the coordinate mapping calibration module, the coordinate mapping calibration module establishes the basic mapping relationship between the physical coordinates and the virtual coordinates based on the real-time splicing parameters, and the environment perception module collects environment parameters and transmits to the collaborative control unit; S2: the collaborative control unit synchronizes the working clock of each module through the synchronization reference module, starts the image content playing, controls the multi-screen projection module to play the surround picture synchronously; S3: the audience operates through the interactive operation module, the interactive operation module captures the physical space coordinates of the operation, and transmits the physical coordinate signal to the coordinate mapping calibration module after signal preprocessing; S4: the coordinate mapping calibration module converts the physical coordinate signal according to the recognition range of the calibration frame, simultaneously receives the splicing parameters fed back by the multi-screen projection module and the real-time environment data transmitted by the environment perception module, corrects the basic mapping relationship through dynamic mapping algorithm, converts the physical coordinates into corresponding virtual coordinates, and transmits the virtual coordinates to the collaborative control unit; S5: the collaborative control unit sends picture feedback instructions to the multi-screen projection module according to the virtual coordinates, and sends trigger instructions to the special effect execution module, so that the picture feedback and special effect action are executed synchronously in space position and time sequence. 2.The method of claim 1, wherein, The implementation of S1 comprises the following specific steps: S11: power supply control module supplies power to all devices, one-key on-off system sends protocol signal, and server and projector devices are started in the order of device starting priority; S12: the collaborative control unit triggers the initialization process, the multi-screen projection module performs picture splicing operation, and sends real-time splicing parameters including physical position information of each projection area to the coordinate mapping calibration module; S13: the coordinate mapping calibration module receives the real-time splicing parameters, and establishes the basic mapping relationship between the points in the physical space and the corresponding pixel points in the multi-screen splicing picture; S14: the environment perception module starts, collects the light intensity and temperature parameters in the cinema, and transmits the environment parameters to the collaborative control unit for subsequent initial calibration.

3. The multi-screen cooperative immersive interactive cinema image synchronization method of claim 1, wherein, The implementation of S2 comprises the following specific steps: S21: the collaborative control unit receives the unified time reference signal provided by the synchronization reference module, and synchronizes the time reference to the multi-screen projection module, the interactive operation module, the special effect execution module, the coordinate mapping calibration module and the dynamic compensation module; S22: the collaborative control unit combines the initial environment parameters collected by the environment perception module to perform initial calibration on the brightness, contrast parameters of the multi-screen projection module and the trigger sensitivity parameters of the special effect execution module; S23: the collaborative control unit starts the image content, sends the video signal to the multi-screen projection module through the HDMI optical fiber transmission link, and controls the multi-screen projection module to realize the synchronous playing of the surround picture; S24: the collaborative control unit sends control signal to the interactive seat through the control mainboard, so that the action of the interactive seat is executed synchronously according to the corresponding action according to the picture lens moving track.

4. The multi-screen cooperative immersive interactive theater image synchronization method of claim 1, wherein, The implementation of S3 comprises the following specific steps: S31: the audience uses the infrared laser shooting pistol to perform aiming operation, and a laser beam emitted by the infrared laser shooting pistol forms a light spot on the multi-screen projection picture; S32: an AI algorithm camera in the interactive operation module captures a position of the light spot in the physical space to generate an original physical coordinate signal; S33: an IO control board performs noise reduction and filtering processing on the original physical coordinate signal to obtain a processed physical coordinate signal; S34: if there are multiple audiences operating simultaneously, the interactive operation module performs priority sorting on the physical coordinate signals from different infrared laser shooting pistols according to receiving time sequences, and sequentially transmits the physical coordinate signals to the coordinate mapping calibration module.

5. The multi-screen cooperative immersive interactive theater image synchronization method according to claim 1, characterized in that, The implementation of S4 includes the following specific steps: S41: the coordinate mapping calibration module limits a physical coordinate range of an effective interactive area according to a calibration frame set based on a size of a cinema physical space; S42: the coordinate mapping calibration module receives current splicing parameters periodically fed back by the multi-screen projection module, and the splicing parameters include offset amounts, rotation angles, and scaling ratios of the projectors; S43: the coordinate mapping calibration module receives real-time environment data transmitted by the environment perception module, and the real-time environment data includes current light intensity and temperature values; S44: the coordinate mapping calibration module inputs the processed physical coordinate signal, the current splicing parameters, and the real-time environment data into a preset dynamic mapping algorithm model to calculate a corrected mapping matrix; S45: the coordinate mapping calibration module converts the physical coordinate signal into a virtual coordinate in the multi-screen spliced picture by using the corrected mapping matrix; S46: the coordinate mapping calibration module stores the corrected parameters calculated each time into a mapping relationship optimization database for iterative optimization of a subsequent mapping algorithm.

6. The multi-screen cooperative immersive interactive cinema image synchronization method of claim 5, wherein, The construction process of the dynamic mapping algorithm model includes the following steps: S441: an initial affine transformation model between a physical coordinate system and a virtual coordinate system is established; S442: the splicing parameters of the multi-screen projection module are used as first-type correction factors to adjust translation, rotation, and scaling components in the affine transformation model; S443: the environment data of the environment perception module are used as second-type correction factors to compensate for coordinate recognition deviation caused by changes in ambient light and equipment deformation caused by temperature changes; S444: the first-type correction factors and the second-type correction factors are fused by weighting to update the initial affine transformation model in real time to generate the dynamic mapping algorithm model.

7. The multi-screen cooperative immersive interactive theater image synchronization method of claim 1, wherein, The implementation of S5 includes the following specific steps: S51: the cooperative control unit receives the virtual coordinate transmitted by the coordinate mapping calibration module, and analyzes a projection area and a specific pixel position to which the virtual coordinate belongs; S52: the cooperative control unit sends a picture feedback instruction to a corresponding projector in the multi-screen projection module, and the instruction content includes rendering a hit effect or performing scene switching at the specific pixel position; S53: the cooperative control unit sends a trigger instruction to a corresponding device in the special effect execution module by EV1527 encoding communication signals according to a special effect type associated with the virtual coordinate. S54: The trigger instruction contains the identifier of the special effect device, the trigger strength value and the duration parameter, and the special effect execution module executes the blowing, water spraying, snow falling or bubble generating action at the specified physical space position according to the parameters.

8. The multi-screen cooperative immersive interactive theater image synchronization method of claim 1, wherein, In the process of image synchronous playing and interaction, dynamic compensation S6 is also included: S61: The dynamic compensation module monitors the picture edge splicing accuracy of the multi-screen projection module, the position synchronization error of the interactive seat and the action response delay of the special effect execution module in real time; S62: The dynamic compensation module combines the real-time environmental data of the environmental perception module and the mapping relationship correction record of the coordinate mapping calibration module, and quantitatively analyzes the monitored deviation data based on a preset deviation analysis model; S63: When any item of deviation data exceeds a preset threshold, the dynamic compensation module sends a compensation request signal to the cooperative control unit; S64: The cooperative control unit generates a compensation instruction matched with the type and degree of deviation according to the type and degree information of the deviation in the compensation request signal; S65: The cooperative control unit sends picture geometry correction parameters to the multi-screen projection module or driving current adjustment parameters to the special effect execution module through the ESP8266 control board to offset the deviation.

9. The multi-screen cooperative immersive interactive theater image synchronization method of claim 1, wherein, Before and after the experience begins, entrance management and system shutdown S7 is also included: S71: Before the audience enters, the cooperative control unit sends an opening instruction to the entrance management module, and the sliding rail door control module executes the opening action; S72: After the audience enters and sits down, the entrance number recognition system performs face recognition through AI algorithm camera, counts and records the actual number of people entering, and transmits the data to the cooperative control unit; S73: Before the experience ends, the entrance number recognition system counts the number of people again, and compares the final number with the initial recorded number; S74: After the experience ends, the cooperative control unit sends an opening instruction to the sliding rail door control module, and sends a shutdown protocol signal to the one-key shutdown system; S75: The one-key shutdown system sends shutdown instructions to the server and projector device in a preset order, and cuts off the total power supply through the electric box knife switch after all devices are turned off.

10. A multi-screen cooperative immersive interactive cinema image synchronization system for implementing the multi-screen cooperative immersive interactive cinema image synchronization method according to any one of claims 1 to 9, characterized in that, It includes: The cooperative control unit is used for overall scheduling of image playing, interactive response, special effect triggering and environment adaptation, and receives feedback signals from each module; The multi-screen projection module is used for receiving synchronization instructions from the cooperative control unit, completing multi-screen picture splicing, synchronous playing and dynamic parameter adjustment; The interactive operation module is used for capturing physical space coordinates of audience operation, and outputting physical coordinate signals after signal preprocessing; The special effect execution module is used for receiving trigger instructions and executing special effect actions at specified physical space positions; The synchronization reference module is used for providing a unified time reference signal for all modules; The coordinate mapping calibration module is used for establishing and dynamically correcting the mapping relationship between physical coordinates and virtual coordinates, integrating multi-screen splicing parameters and environmental perception data, and converting physical coordinate signals into virtual coordinates; The environmental perception module is used for collecting environmental parameters in the theater in real time and transmitting them to the cooperative control unit; A dynamic compensation module is configured to monitor system operation deviation and request the cooperative control unit to perform parameter compensation when the deviation exceeds a limit; An entrance management module is configured to control opening and closing of a theater door and identify and record the number of audience entering the theater; A power supply control module is configured to control power supply and power-off of all devices and realize orderly power-on and power-off of the devices.

Images