A method and system for immersive light and sound adaptive access in complex exhibition scenarios

Abstract

The application discloses a kind of complex exhibition scene immersive lamp sound adaptive access method and system, belong to stage system technical field;A kind of complex exhibition scene immersive lamp sound adaptive access method, according to actual stage area construction includes space dimension, sound and light intensity five-dimensional sound-light twin field and the twin field is updated in real time by calculation;Existing all measurement key points are traversed, and the measurement key of the twin field after change or pre-change is compared one by one;Judge whether the maximum change deviation value exceeds the set acceptable threshold or detect whether there is the effect value of multiple measurement key points is mutated, determine the corresponding access scene type to be executed;In response to device access or disconnection, select the corresponding adaptive access strategy, adjust the device;Drive device to execute the above adaptive access strategy;The adaptability of stage device can be realized, and the influence of device access stage overall atmosphere is reduced.

Description

Technical Field

[0001] This invention belongs to the field of stage system technology, and more specifically, relates to a method and system for immersive adaptive lighting and sound access in complex performance scenarios. Background Technology

[0002] Existing stage systems typically include various types of equipment such as electromechanical equipment, lighting and sound equipment, and communication transmission equipment. However, when different types of equipment are connected to the system, they often encounter common problems such as protocol diversity, compatibility, and high latency requirements. Existing technologies require manual reprogramming or adjustment of the entire timeline and protocol mapping, which cannot automatically and in real time adapt to the dynamically changing stage control environment and resource status. Specifically, this manifests in the following ways: 1. The connection of a single audio or lighting device will have a comprehensive impact on the entire stage performance. For example, replacing a speaker will change the phase interference and standing wave distribution of the entire sound field, and replacing a light fixture will affect the color mixing and light spot overlap in the area; 2. The inability to achieve seamless switching during the connection process will cause the audience to experience perceptible interruptions or jumps, all of which will affect the final stage performance effect. Summary of the Invention

[0003] The technical problem to be solved by this invention is to provide a method and system for immersive adaptive lighting and sound access in complex performance scenarios. This method can enable adaptive access of stage equipment and reduce the impact of equipment access on the overall stage atmosphere.

[0004] The present invention provides a method for immersive adaptive lighting and sound access in complex performance scenarios, comprising steps S1-S4. Step S1: Construct a five-dimensional sound and light twin field containing spatial dimensions, sound, and light intensity based on the actual stage area, and perform real-time calculation and updates on the twin field; Step S2: Traverse all existing measurement key points and compare them one by one with the measurement key points of the changed or pre-changed twin field; determine whether the largest change deviation value exceeds the set acceptable threshold or detect whether the effect values ​​of multiple measurement key points have abruptly changed, and determine the corresponding access scenario type to be executed. Step S3: Based on the corresponding access scenario type, in response to device access or disconnection, select the appropriate adaptive access strategy and adjust the device accordingly; Step S4: The driver device executes the above adaptive access strategy, and after execution, continues to update the twin field at a fixed period.

[0005] As a further improvement of the present invention, the twin field covers the entire stage area, and any point in the spatial dimension is a measurement point, which includes x-coordinate, y-coordinate and z-coordinate; each sound source is represented as a sound source point in the twin field, and the sound source point information includes the relative positional relationship between the sound source and the measurement point and the sound pressure intensity; each light source is represented as a light source point in the twin field, and the light source point information includes the relative positional relationship between the light source and the measurement point and the illumination intensity.

[0006] As a further improvement of this invention, the main function of the twin field is defined as F(r,t)={L(r,t), E(r,t)}; where r=(x,y,z) are the spatial coordinates of the measurement point, and t is the performance time; L(r,t) is the sound pressure intensity function of the measurement point calculated according to the sound field model, and E(r,t) is the illumination intensity function of the measurement point calculated according to the light field model; the stage includes N speakers, and the total composite sound pressure contributed by the N speakers is L(r,t)=L total (r,t)= The stage has N lights, and the total composite illumination contributed by the N lights is E(r,t) = E total (r,t)= .

[0007] As a further improvement of the present invention, the measurement points are selected as several key measurement points in the entire stage area. These key measurement points are predefined, and the number of key measurement points is K, including r1, r2, r3, ..., r k The key measurement points are located in areas such as the audience area, stage performance area, and special effects area.

[0008] As a further improvement of the present invention, the access scenario type is any one of the following: directly adding or disconnecting the device, using a new device to replace the faulty device, or using an existing device to compensate for and replace the faulty device when there is a lack of spare backup devices.

[0009] As a further improvement of this invention, when the access scenario type is directly adding or disconnecting a device, it is necessary to judge the impact of the device change in order to select an access strategy; calculation and acquisition of the effect value of key observation points: when a new device is connected or a device is disconnected, the effect value change after the connection or disconnection is simulated first. ;in, This is the simulated effect value at the Kth key measurement point after the device is connected or disconnected, calculated using the intensity function. For the existing effect value at the existing Kth measurement key point, To simulate the absolute value of the change in effect value before and after access; take the measurement key point with the largest difference in effect value, record the location of the observation point corresponding to the maximum deviation, and determine whether it exceeds the set acceptable threshold; The coordinates of the corresponding key measurement points are: Preset an acceptable deviation threshold. The threshold The specific values ​​are determined based on the equipment type; comparison and The size, if If the connection or disconnection action will not significantly disturb the performance, proceed directly to step S4 to either fully connect or directly remove the device; if Then proceed to step S3.

[0010] As a further improvement of the present invention, when the access scenario type is to replace the faulty device with a new device, when a sudden change in the effect value of multiple measurement key points is detected, the faulty device is checked one by one, the new device is immediately connected, and step S3 is executed. When the access scenario type is that there is a lack of spare backup equipment, the existing equipment is used to compensate for and replace the faulty equipment; when multiple measurement key points are detected to have sudden changes, check which equipment has failed one by one, call the equipment adjacent to the faulty equipment, and execute step S3.

[0011] As a further improvement of the present invention, when the access scenario type is direct addition or disconnection of a device and the change difference exceeds a threshold; when the maximum deviation exceeds the threshold, the system needs to limit the initial output ratio of the new device. The default operating performance when a new device is connected is At the initial connection or disconnection time, the deviation of the effect change at each observation point should not exceed a threshold; the formula for calculating the initial output ratio is: The corresponding working efficiency when a new device is connected is .

[0012] As a further improvement of the present invention, when the access scenario type is to replace the faulty device with a new device, the working performance parameters of the new device are kept consistent with the working performance parameters of the faulty device. When the access scenario involves replacing a faulty device with an existing one when there is a lack of backup equipment, the faulty device should be identified and the amount of missing effect determined. Calling the device near the faulty device Each piece of equipment, on average, improves the working efficiency of these devices, and maximizes the compensation deviation resulting from this. If it makes If it is always true, then call One device, until it meets the requirements. Established.

[0013] A system for immersive adaptive lighting and sound access in complex performance scenarios, which is used to execute a method for immersive adaptive lighting and sound access in complex performance scenarios; it includes a sensing unit, a processing unit and an execution unit; The sensing unit is used to construct a five-dimensional acoustic-optical twin field containing spatial dimensions, sound, and light intensity based on the actual stage area and to perform real-time calculation and updates on the twin field. The sensing unit includes a spatiotemporal module and an interface module. The spatiotemporal module is used to acquire the stage performance time in real time, acquire real-scene images of the target stage, construct a spatial model of the target stage, and establish a three-dimensional coordinate system on the stage. The interface module is used to identify the protocol type matched by the device and to standardize and convert heterogeneous data. The processing unit is used to traverse all existing measurement key points and compare them one by one with the measurement key points of the changed or pre-changed twin field; determine whether the largest change deviation value exceeds the set acceptable threshold or detect whether there are multiple measurement key points whose effect values ​​have changed abruptly, and determine the corresponding access scenario type to be executed. The execution unit is used to drive the device to execute the above-mentioned adaptive access strategy. After the execution is completed, it continues to update the twin field at a fixed period. The execution unit includes an audio module and a lighting module. The audio module is used to drive the audio to adjust, and the lighting module is used to drive the lighting to adjust.

[0014] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. By constructing a five-dimensional sound and light twin field and updating it in real time, the system can predict the impact of device connection or disconnection on the sound and light effects. When the maximum deviation exceeds the threshold, a gradual connection or disconnection strategy is adopted so that the audience and actors do not perceive the sudden change, ensuring the continuity and immersion of the performance; achieving seamless device connection and disconnection, avoiding the feeling of performance interruption.

[0015] 2. Through multi-scenario adaptive access, each scenario has a corresponding strategy, and the system can automatically identify and execute optimal adjustments, significantly improving the intelligence and fault tolerance of the stage system; through twin field model and deviation threshold judgment, automated decision-making and execution are achieved, reducing reliance on the experience of technical personnel, and making it suitable for large, complex, and dynamically changing stage environments.

[0016] 3. Balancing accuracy and computational efficiency: By selecting key measurement points (such as the audience area, performance area, and special effects area) rather than all points in the space for monitoring, the computational load is effectively controlled while ensuring the accuracy of the sound and light effects, making it suitable for real-time application scenarios. Attached Figure Description

[0017] Figure 1This is a schematic diagram of the method flow of the present invention; Figure 2 This is a schematic diagram of the system structure of the present invention. Detailed Implementation

[0018] Specific Implementation Example 1: Please refer to... Figure 1 A method for immersive light and sound adaptive access in complex performance scenarios, comprising steps S1-S4.

[0019] Step S1: Construct a five-dimensional acoustic-optical twin field containing spatial dimensions, sound, and light intensity based on the actual stage area, and perform real-time calculation and updates on the twin field; the twin field covers the entire stage area, with any point in the spatial dimension serving as a measurement point, including x-coordinate, y-coordinate, and z-coordinate; each speaker is represented as a sound source point in the twin field, and the sound source point information includes the relative positional relationship between the speaker and the measurement point and the sound pressure level; each light is represented as a light source point in the twin field, and the light source point information includes the relative positional relationship between the light and the measurement point and the light intensity.

[0020] The master function of the twin field is defined as F(r,t) = {L(r,t), E(r,t)}; where r = (x,y,z) are the spatial coordinates of the measurement point, and t is the performance time; L(r,t) is the sound pressure intensity function of the measurement point calculated according to the sound field model, and E(r,t) is the illumination intensity function of the measurement point calculated according to the light field model. It should be noted that there are N speakers on the stage, so the total composite sound pressure contributed by the N speakers is L(r,t) = L total (r,t)= The stage has N lights, so the total composite illumination contributed by the N lights is E(r,t) = E total (r,t)= .

[0021] Preferably, the measurement points can be selected from only a number of key measurement points within the entire stage area. These key measurement points are predefined, and the number of key measurement points is K, including r1, r2, r3, ..., r k The key measurement points are located in areas such as the audience area, stage performance area, and special effects area. For example, for a large venue accommodating over 5000 people, the audience area can be divided into 6-8 zones, with 2-3 key measurement points selected in each zone, keeping the total number of observation points below 50. This reduces the computational load while ensuring calculation accuracy.

[0022] Step S2: Traverse all existing measurement key points and compare them one by one with the measurement key points of the changed or pre-changed twin field; determine whether the largest change deviation value exceeds the set acceptable threshold or detect whether there are abrupt changes in the effect values ​​of multiple measurement key points, and determine the corresponding access scenario type to be executed.

[0023] The access scenario types include any one of the following: directly adding or disconnecting a device, using a new device to replace a faulty device, or using an existing device to compensate for and replace a faulty device when there is a lack of spare backup devices.

[0024] When the access scenario involves directly adding or disconnecting a device, it is necessary to assess the impact of the device change in order to select the access strategy. The calculation and acquisition of key observation point effect values: When a new device is connected or a device is disconnected, the effect value change is first simulated under the scenario of "the new device being connected with full output (or the disconnected device being removed)". ;in, This is the simulated effect value at the Kth key measurement point after the device is connected or disconnected, calculated using the intensity function. For the existing effect value at the existing Kth measurement key point, To simulate the absolute value of the change in effect before and after access, reflecting the degree of disturbance caused by the access action.

[0025] Take the measurement key point with the largest difference in effect value, record the location of the observation point corresponding to the maximum deviation, and determine whether it exceeds the set acceptable threshold. The coordinates of the corresponding key measurement points are: Preset an acceptable deviation threshold. The threshold The specific value depends on the type of equipment, for example, for an audio system. =1.5dB; for lighting systems =50 lux.

[0026] Compare and The size, if If the connection (or disconnection) action does not significantly affect the performance, proceed directly to step S4: connect at full power (the new device operates at 100% efficiency) or remove the device directly; if Then proceed to step S3.

[0027] When the access scenario type is to replace the faulty device with a new device, since the faulty device is disconnected suddenly, there will inevitably be changes in the effect values ​​of several key measurement points. When multiple key measurement points are detected to have sudden changes in effect values, check which device is faulty one by one, immediately connect the new device, and execute step S3.

[0028] When the access scenario type is that there is a lack of spare backup equipment, and the existing equipment is used to compensate for and replace the faulty equipment, since the faulty equipment suddenly disconnects, there will inevitably be changes in the effect values ​​of several key measurement points. When multiple key measurement points are detected to have sudden changes, check one by one which equipment has failed, call the adjacent equipment of this faulty equipment, and execute step S3.

[0029] Step S3: Based on the corresponding access scenario type, in response to device access or disconnection, select the appropriate adaptive access strategy and adjust the device accordingly.

[0030] When the access scenario type is directly adding or disconnecting devices and the change difference exceeds the threshold ( When the maximum deviation exceeds a threshold, the system needs to limit the initial output ratio of the new device. ( The default performance when a new device is connected is (Efficiency is 0 when the device is disconnected). At the initial connection or disconnection time, the deviation of the effect change at each observation point should not exceed a threshold. Since the maximum deviation occurs at... Simply ensure that the deviation at that point is reduced below the threshold. The formula for calculating the initial output ratio is: The corresponding working efficiency when a new device is connected is This is the initial safe value. Similarly, when the equipment is disconnected, this is the reverse process, gradually reducing the equipment's operating efficiency to the initial safe value (i.e., from 100% to...). Then disconnect.

[0031] Determine initial safety values Afterwards, the system connects the new device at the initial output ratio to ensure that the maximum deviation at the initial instant does not exceed the threshold; then, a gradual connection process is initiated, gradually increasing the output ratio of the new device from... Increase to 100%. The gradual increase can be linear over time. The process of disconnecting the equipment is similar to the above and will not be repeated here. During the gradual process, because... As the value gradually increases, the deviation at the point of maximum deviation will gradually exceed... This allows for gradual changes, giving the audience and performers time to adapt and reducing discomfort caused by sudden changes; it can achieve the desired effect through connected devices while ensuring that the audience's experience is not interrupted or abrupt.

[0032] When the access scenario type is to replace the faulty device with a new device, the working performance parameters of the new device should be consistent with those of the faulty device.

[0033] When the access scenario involves replacing a faulty device with an existing one when there is a lack of backup equipment, the faulty device should be identified and the amount of missing effect determined. Calling the device near the faulty device Each piece of equipment, on average, improves the working efficiency of these devices, and maximizes the compensation deviation resulting from this. If it makes If it is always true, then call One device, until it meets the requirements. Established.

[0034] It should be noted that the above formulas are all dimensionless calculations. The formulas are derived from software simulations based on a large amount of collected data to obtain the most recent real-world results. The preset parameters and thresholds in the formulas are set by those skilled in the art according to the actual situation.

[0035] Step S4: The driver device executes the above adaptive access strategy, and after execution, continues to update the twin field at a fixed period.

[0036] Specific Implementation Example 2: Please refer to Figure 2 A system for immersive light and sound adaptive access in complex performance scenarios is provided, which is used to execute a method for immersive light and sound adaptive access in complex performance scenarios as described in Specific Embodiment 1; it includes a sensing unit, a processing unit, and an execution unit.

[0037] The sensing unit is used to construct a five-dimensional acoustic-optical twin field containing spatial dimensions, sound, and light intensity based on the actual stage area and to perform real-time calculation and updates on the twin field. The sensing unit includes a spatiotemporal module and an interface module. The spatiotemporal module is used to acquire the stage performance time in real time, acquire real-scene images of the target stage, construct a spatial model of the target stage, and establish a three-dimensional coordinate system on the stage. The interface module is used to identify the protocol type matched by the device and to standardize and convert heterogeneous data.

[0038] The processing unit is used to traverse all existing measurement key points and compare them one by one with the measurement key points of the changed or pre-changed twin field; determine whether the largest change deviation value exceeds the set acceptable threshold or detect whether there are abrupt changes in the effect values ​​of multiple measurement key points, and determine the corresponding access scenario type to be executed.

[0039] The execution unit is used to drive the device to execute the above-mentioned adaptive access strategy. After the execution is completed, it continues to update the twin field at a fixed period. The execution unit includes an audio module and a lighting module. The audio module is used to drive the audio to adjust, and the lighting module is used to drive the lighting to adjust.

Claims

1. A method for immersive, adaptive lighting and sound access in complex performance scenarios, characterized in that: Includes steps S1-S4; Step S1: Construct a five-dimensional sound and light twin field containing spatial dimensions, sound, and light intensity based on the actual stage area, and perform real-time calculation and updates on the twin field; Step S2: Traverse all existing measurement key points and compare them one by one with the measurement key points of the changed or pre-changed twin field; determine whether the largest change deviation value exceeds the set acceptable threshold or detect whether the effect values ​​of multiple measurement key points have abruptly changed, and determine the corresponding access scenario type to be executed. Step S3: Based on the corresponding access scenario type, in response to device access or disconnection, select the appropriate adaptive access strategy and adjust the device accordingly; Step S4: The driver device executes the above adaptive access strategy, and after execution, continues to update the twin field at a fixed period.

2. The method for immersive adaptive lighting and sound access in complex performance scenarios according to claim 1, characterized in that: The twin field covers the entire stage area, with any point in the spatial dimension serving as a measurement point, including x-coordinate, y-coordinate, and z-coordinate. Each speaker is represented as a sound source point in the twin field, and the sound source point information includes the relative positional relationship between the speaker and the measurement point and the sound pressure level. Each light is represented as a light source point in the twin field, and the light source point information includes the relative positional relationship between the light and the measurement point and the light intensity.

3. The method for immersive lighting and sound adaptive access in complex performance scenarios according to claim 2, characterized in that: The master function of the twin field is defined as F(r,t) = {L(r,t), E(r,t)}; where r = (x,y,z) are the spatial coordinates of the measurement point, and t is the performance time; L(r,t) is the sound pressure intensity function of the measurement point calculated according to the sound field model, and E(r,t) is the illumination intensity function of the measurement point calculated according to the light field model; there are N speakers on the stage, and the total composite sound pressure contributed by the N speakers is L(r,t) = L total (r,t)= The stage has N lights, and the total composite illumination contributed by the N lights is E(r,t) = E total (r,t)= .

4. The method for immersive lighting and sound adaptive access in complex performance scenarios according to claim 2, characterized in that: The measurement points are selected from several key measurement points within the entire stage area. These key measurement points are predefined, and there are K key measurement points, including r1, r2, r3, ..., r k The key measurement points are located in areas such as the audience area, stage performance area, and special effects area.

5. The method for immersive lighting and sound adaptive access in complex performance scenarios according to claim 1, characterized in that: The access scenario type is any one of the following: directly adding or disconnecting the device, using a new device to replace the faulty device, or using an existing device to compensate for and replace the faulty device when there is a lack of spare backup devices.

6. The method for immersive lighting and sound adaptive access in a complex performance scene according to claim 5, characterized in that: When the access scenario involves directly adding or disconnecting a device, it is necessary to assess the impact of device changes in order to select the appropriate access strategy. Calculation and acquisition of key observation point effect values: When a new device is accessed or a device is disconnected, the effect value changes after access or disconnection are first simulated. ;in, This is the simulated effect value at the Kth measurement key point after the device is connected or disconnected, calculated using the intensity function. For the existing effect value at the existing Kth measurement key point, To simulate the absolute value of the change in effect value before and after access; take the measurement key point with the largest difference in effect value, record the location of the observation point corresponding to the maximum deviation, and determine whether it exceeds the set acceptable threshold; The coordinates of the corresponding key measurement points are: Preset an acceptable deviation threshold. The threshold The specific values ​​are determined based on the equipment type; comparison and The size, if If the connection or disconnection action will not significantly disturb the performance, proceed directly to step S4 to either fully connect or directly remove the device; if Then proceed to step S3.

7. The method for immersive adaptive lighting and sound access in complex performance scenarios according to claim 5, characterized in that: When the access scenario type is to replace the faulty device with a new device, when a sudden change in the effect value of multiple measurement key points is detected, check which device is faulty one by one, immediately connect the new device, and execute step S3. When the access scenario type is that there is a lack of spare backup equipment, the existing equipment is used to compensate for and replace the faulty equipment; when multiple measurement key points are detected to have sudden changes, check which equipment has failed one by one, call the equipment adjacent to the faulty equipment, and execute step S3.

8. The method for immersive lighting and sound adaptive access in a complex performance scene according to claim 6, characterized in that: When the access scenario involves directly adding or disconnecting a device and the difference in changes exceeds a threshold; when the maximum deviation exceeds a threshold, the system needs to limit the initial output ratio of the new device. The default operating performance when a new device is connected is At the initial connection or disconnection time, the deviation of the effect change at each observation point should not exceed a threshold; the formula for calculating the initial output ratio is: The corresponding working efficiency when a new device is connected is .

9. The method for immersive lighting and sound adaptive access in a complex performance scene according to claim 7, characterized in that: When the access scenario type is to replace the faulty device with a new device, the working performance parameters of the new device should be consistent with those of the faulty device. When the access scenario involves replacing a faulty device with an existing one when there is a lack of backup equipment, the faulty device should be identified and the amount of missing effect determined. Calling the device near the faulty device Each piece of equipment, on average, improves the working efficiency of these devices, and maximizes the compensation deviation resulting from this effect. If it makes If it is always true, then call One device, until it meets the requirements. Established.

10. A system for immersive, adaptive lighting and sound access in complex performance scenarios, characterized in that: A method for implementing immersive light and sound adaptive access in a complex performance scene as described in claim 1; It includes a sensing unit, a processing unit, and an execution unit; The perception unit is used to construct a five-dimensional acoustic-optical twin field containing spatial dimensions, sound, and light intensity based on the actual stage area and to perform real-time calculation and updates on the twin field. The perception unit includes a spatiotemporal module and an interface module. The spatiotemporal module is used to acquire the stage performance time in real time, acquire real-scene images of the target stage, construct a spatial model of the target stage, and establish a three-dimensional coordinate system on the stage. The interface module is used to identify the protocol type matched by the device and to standardize and convert heterogeneous data. The processing unit is used to traverse all existing measurement key points and compare them one by one with the measurement key points of the changed or pre-changed twin field; determine whether the largest change deviation value exceeds the set acceptable threshold or detect whether there are multiple measurement key points whose effect values ​​have changed abruptly, and determine the corresponding access scenario type to be executed. The execution unit is used to drive the device to execute the above-mentioned adaptive access strategy. After the execution is completed, it continues to update the twin field at a fixed period. The execution unit includes an audio module and a lighting module. The audio module is used to drive the audio to adjust, and the lighting module is used to drive the lighting to adjust.

Images