Exhibition hall display method and equipment based on digital multimedia

Abstract

The invention discloses an exhibition hall display method and device based on digital multimedia, relates to the technical field of digital multimedia, and discloses an exhibition hall display method and device based on digital multimedia, which are characterized in that the positions of audiences are acquired in real time, associated device subsets are matched, and cooperative control parameters are generated in combination with environment data and attention data; the multi-device cooperative display strategy is dynamically adjusted, the multimedia cooperative control precision and the display effect are improved, and the exhibition viewing experience of audiences is improved.

Description

Technical Field

[0001] This application relates to the field of digital multimedia technology, and in particular to exhibition hall display methods and equipment based on digital multimedia. Background Technology

[0002] Exhibition halls utilizing digital multimedia technology aim to provide visitors with an immersive experience. However, existing exhibition methods based on digital multimedia technology generally suffer from insufficient precision in media collaborative control. Traditional solutions rely on preset programs or simple sensor-based control of audio-visual equipment, such as triggering fixed audio and video playback via infrared sensing. However, these methods cannot perceive the spatial distribution and behavioral intentions of the audience in real time, resulting in poor media display effects in densely populated areas and inefficient energy consumption in sparsely populated areas. Furthermore, the independent operation of audio and visual equipment often leads to information conflicts, causing a fragmented immersive experience. Specifically, existing technologies have the following shortcomings: First, they lack precise location and dynamic tracking capabilities for the audience, failing to intelligently match relevant display equipment based on the audience's actual location. Second, they fail to effectively collect and analyze audience behavior data and environmental parameters, resulting in a low degree of matching between display content and audience focus. Third, the multi-device collaborative control mechanism is imperfect, lacking dynamic weight allocation strategies for projection and audio equipment based on spatial location and audience behavior. Finally, in multi-audience scenarios, existing systems struggle to achieve group behavior analysis and optimized device collaborative control.

[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The main purpose of this application is to provide a digital multimedia-based exhibition hall display method and equipment, which aims to improve the accuracy of multimedia collaborative control in exhibition halls and the viewing experience of visitors.

[0005] To achieve the above objectives, this application proposes a digital multimedia-based exhibition hall display method, the method comprising: Obtain the current location of the target audience, and based on the target audience's current location, match a subset of related devices in the exhibition hall; Based on the current location of the target audience, trigger environmental sensors deployed in the area where the corresponding exhibit is located to collect environmental data; Acquire the attention behavior of the target audience towards the display elements of the current exhibit in order to generate data on the target audience's attention to the current exhibit; The attention data and the environmental data are fused together to obtain collaborative control parameters. The associated device subset is weighted according to the collaborative control parameters to generate a corresponding set of control instructions, which controls the associated device subset to perform multi-device collaborative display.

[0006] In one embodiment, the step of obtaining the current location of the target audience includes: The pulse signals emitted by the positioning tags worn by the target audience are received by multiple ultra-wideband positioning base stations; The real-time location coordinates of the target audience are determined by calculating the time difference of the arrival of the pulse signal at multiple ultra-wideband signals. The user's motion sensors are used to compensate for the movement trajectory of the real-time location coordinates in order to obtain the current location of the target audience.

[0007] In one embodiment, the associated device subset includes a projection device subset and an audio device subset; the step of matching the associated device subset among the exhibition hall devices based on the current location of the target audience includes: Query the pre-stored exhibition hall equipment space topology database to obtain the projection and audio equipment bound to the current exhibit; Calculate the spatial distances between the target audience's current location and each projection device, as well as between the target audience's current location and each audio device; Projection devices whose spatial distance is less than a preset first distance threshold are selected to form a subset of projection devices, and audio devices whose spatial distance is less than a preset second distance threshold are selected to form a subset of audio devices.

[0008] In one embodiment, the step of acquiring the attention behavior of target viewers towards the display elements of the current exhibit to generate target viewers' attention data for the current exhibit includes: Collect facial image data of the target audience; The facial image data is processed by mapping the gaze point based on the pupil localization algorithm to determine the focal coordinates of the gaze on the display interface. When the focus coordinates fall within the boundary of the display element of the exhibit, its duration is calculated to generate duration data; Output the target audience's attention level to the current exhibit based on the duration data.

[0009] In one embodiment, the environmental data includes light intensity data and background noise data; the step of fusing the attention data with the environmental data to obtain collaborative control parameters includes: When the light intensity data exceeds a preset brightness threshold, projection brightness compensation parameters are generated based on the light intensity data and the preset brightness threshold. When the background noise data exceeds a preset noise intensity, an audio gain compensation parameter is generated based on the background noise data and the preset noise intensity. The projection brightness compensation parameters, audio gain compensation parameters, and attention data are superimposed and calculated to output the collaborative control parameters.

[0010] In one embodiment, the step of weighting the associated device subset using the collaborative control parameters to generate a corresponding control instruction set, and controlling the associated device subset to perform multi-device collaborative display, includes: Obtain the effective radiation radius of each projection device and audio device in the associated device subset; Based on the spatial distance and the effective radiation radius, calculate the distance influence factor for each projection device and audio device; The device weights of each projection device and audio device are calculated using attention data and the distance influence factor. Based on the collaborative control parameters, the device weights of each projection device are adjusted according to a preset first ratio, and the device weights of each audio device are adjusted according to a preset second ratio. The device weights of the adjusted subset of associated devices are normalized to generate a set of control instructions, which then control the subset of associated devices to perform multi-device collaborative display.

[0011] In one embodiment, the method further includes: Obtain the physical location of each audio device in the associated device subset; Calculate the orientation angle of the target audience's position relative to each audio device; The sound wave delay of each audio device is determined based on the azimuth angle and the spatial distance between the audio device and the target audience's current location. The first control instruction set is generated based on the sound wave delay of each audio device; The first control instruction set and the second control instruction set used to control the projection device are time-aligned and merged into a control instruction set, which is then output to the associated device subset to control the associated device subset to perform multi-device collaborative display.

[0012] In one embodiment, the target audience is multiple, and the method further includes: After obtaining the current locations of multiple target audiences, the current locations of the multiple target audiences are divided into regional grids to generate heat distribution data of the exhibition area; When the heat distribution data of the exhibition area shows that multiple visitors are in a clustered state, the associated device subset is matched and the union is calculated based on the current location of each target visitor to obtain the final associated device subset, and the cluster center location is used as the reference point for multi-device collaborative display.

[0013] In one embodiment, the method further includes: when the thermal distribution data of the exhibition area shows that multiple visitors are in a clustered state, before the step of performing data fusion processing on the attention data and the environmental data to obtain collaborative control parameters, the method further includes: Acquire the attention behavior of multiple target audiences towards the same display element of the current exhibit to generate attention data of multiple target audiences towards the current exhibit; The average of the multiple attention data points is calculated and used as the final attention data.

[0014] In addition, to achieve the above objectives, this application also proposes a digital multimedia-based exhibition hall display device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the digital multimedia-based exhibition hall display method.

[0015] This application provides a digital multimedia-based exhibition hall display method and equipment. By acquiring the audience's location in real time and matching it with a subset of associated devices, and combining environmental data and attention data to generate collaborative control parameters, the collaborative display strategy of multiple devices is dynamically adjusted, thereby improving the accuracy of multimedia collaborative control and display effect, and enhancing the audience's exhibition experience. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a flowchart illustrating an embodiment of the exhibition hall display method based on digital multimedia of this application; Figure 2 for Figure 1 A detailed flowchart of step S100 is provided in one embodiment. Figure 3 for Figure 1 A detailed flowchart of another embodiment of step S100 is provided; Figure 4 for Figure 1 A detailed flowchart of step S300 is provided in one embodiment. Figure 5 for Figure 1 A detailed flowchart of step S400 is provided in one embodiment. Figure 6 for Figure 1 A detailed flowchart of step S500 is provided in one embodiment. Figure 7 A flowchart illustrating another embodiment of the exhibition hall display method based on digital multimedia provided in this application; Figure 8 This is a structural schematic diagram of an embodiment of the exhibition hall display equipment based on digital multimedia provided in this application.

[0020] Explanation of icon numbers: 10. Memory; 20. Processor.

[0021] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0023] The technical solutions of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of this application, but merely represents selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application. It should be understood that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this application, the terms "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0024] In existing technologies, digital multimedia exhibition halls typically rely on preset programs or simple sensor-based control devices, such as triggering fixed audio and video playback via infrared sensing. This method cannot perceive the spatial distribution and behavioral intentions of the audience in real time, resulting in poor media display effects in densely populated areas and inefficient energy consumption in sparsely populated areas. Furthermore, the independent operation of audio and visual devices often leads to information conflicts, causing a fragmented immersive experience. For example, in large art exhibitions, when audiences gather in front of a particular exhibit, traditional systems cannot dynamically adjust the collaborative working mode of surrounding devices, resulting in some audience members receiving asynchronous audiovisual information.

[0025] To address the aforementioned issues, a display method is needed that can perceive the audience's position and environmental status in real time and dynamically adjust the collaborative operation of equipment. Traditional solutions trigger equipment using only a single sensor, lacking a multi-dimensional data fusion mechanism. Considering that the distribution of audience attention directly affects the display effect, combining eye-tracking data with environmental perception can establish a more precise equipment control model. Further research revealed that the matching degree between the spatial position of the equipment and the audience's movement trajectory directly affects the sound and light propagation effect, suggesting the need to establish a correlation rule between equipment selection and spatial distance.

[0026] Based on this, the embodiments of this application provide a method for exhibition hall display based on digital multimedia, referring to... Figure 1 The method includes steps S100 to S500, wherein: Step S100: Obtain the current location of the target audience and, based on the current location of the target audience, match a subset of associated devices in the exhibition hall equipment; Step S200: Based on the current location of the target audience, trigger the environmental sensors deployed in the area where the corresponding exhibit is located to collect environmental data; Step S300: Obtain the attention behavior of the target audience towards the display elements of the current exhibit to generate the target audience's attention data towards the current exhibit; Step S400: Perform data fusion processing on the attention data and the environmental data to obtain collaborative control parameters; Step S500: The associated device subset is weighted according to the collaborative control parameters to generate a corresponding set of control instructions, and the associated device subset is controlled to perform multi-device collaborative display.

[0027] In this embodiment, the associated device subset matching refers to filtering devices within the effective range of the audience's location. Coordinates can be obtained using ultra-wideband positioning technology, and spatial distance calculations can be performed by combining this with a database of exhibition hall equipment topology. Environmental data collection is achieved through sensors deployed in the exhibition area; for example, light sensors and decibel meters can acquire brightness and noise data, respectively. Attention data generation is based on visual recognition technology, such as tracking the coordinates of the gaze focus using a pupil positioning algorithm and calculating the duration of lingering at the boundaries of exhibit elements. Data fusion processing employs a multi-source information overlay algorithm, such as weighting brightness compensation parameters and audio gain parameters. Weight allocation is achieved through a distance influence factor calculation model, such as establishing normalization rules based on the spatial relationship between the effective radiation radius of the device and the audience's location.

[0028] In this embodiment, when the audience enters the exhibition area, the system obtains the real-time coordinates through the positioning tag and screens the projections and audio devices within the distance threshold to form an associated subset. The environmental sensor synchronously collects the light intensity and background noise, and the vision system captures the focus of the audience's line of sight and calculates the attention duration. After fusing the environmental data and attention degree, the system automatically generates the projection brightness compensation value and the audio gain value. The influence factor is calculated according to the spatial distance between the device and the audience, and the weight is allocated in combination with the cooperation parameters, and finally the synchronous control instruction is generated to realize the linkage of multiple devices. For example, in a strong light environment, the system preferentially adjusts the brightness weight of the projection device, and at the same time enhances the directional propagation of the audio in the corresponding area according to the position of the focus of the audience's line of sight.

[0029] In this embodiment, by dynamically matching the associated device subset, the problem of device resource waste is solved. By fusing the environmental data and behavior data, the defect of insufficient control accuracy of a single sensor is overcome. Through the weight allocation model, the precise adjustment of the cooperation parameters of multiple devices is realized, and the phenomenon of asynchronous sound and light information is eliminated. Thus, this application effectively improves the cooperation control accuracy of multimedia devices, realizes the optimal allocation of device resources in areas with dense audiences, and avoids ineffective energy consumption. At the same time, by real-time fusing the audience behavior data and environmental state data, it ensures that the audio-visual information is synchronized with the audience's attention, and enhances the display content effect and information transmission efficiency.

[0030] In a feasible implementation manner, referring to Figure 2 , step S100 includes steps S111 to S113, where: Step S111, receiving the pulse signals emitted by the positioning tags worn by the target audience through multiple ultra-wideband positioning base stations; Step S112, performing calculation based on the time difference of arrival of the pulse signals at multiple ultra-widebands to determine the real-time position coordinates of the target audience; Step S113, compensating the moving trajectory of the real-time position coordinates through the motion sensor worn by the user to obtain the current position of the target audience.

[0031] In this embodiment, the ultra-wideband positioning base station refers to a wireless positioning device built based on ultra-wideband technology. Specifically, it can be implemented using a device with nanosecond-level pulse signal transmission capability, used for spatial positioning through high-precision time measurement. The pulse signal refers to an electromagnetic wave signal with an extremely short time width emitted by the positioning tag. Specifically, it can be implemented using a signal with a center frequency in the range of 3.1 GHz to 10.6 GHz, which can maintain anti-interference capability in complex environments. Time difference calculation refers to calculating the time difference between the arrival of the same pulse signal at different base stations. Specifically, it can be implemented using a time difference of arrival positioning algorithm, used to construct a hyperbolic equation system to solve for the target coordinates. Real-time position coordinates refer to a data set containing three-dimensional spatial position data, specifically represented in Cartesian or polar coordinate systems, used to map the physical position of visitors within the exhibition hall. The motion sensor refers to a sensing device used to detect motion state, specifically implemented using a six-axis inertial measurement unit, used to capture the acceleration and angular velocity data of the positioning tag. It is understood that the motion sensor and positioning tag can be integrated into the same portable device, such as a smart bracelet or positioning badge, to achieve synchronous acquisition of position data and motion state. Trajectory compensation refers to the calculation process of dynamically correcting positioning errors. Specifically, it can be achieved by using the Kalman filter algorithm to fuse inertial measurement data and positioning coordinates, in order to eliminate positioning drift caused by multipath effects.

[0032] In this embodiment, when a target visitor enters the exhibition hall, the positioning tag they wear continuously emits ultra-wideband pulse signals, which are received by multiple base stations deployed within the venue. Each base station records the precise timestamp of the pulse arrival. By calculating the time difference between different base stations receiving the same pulse, a position calculation model based on the hyperbolic equation is constructed to obtain preliminary real-time position coordinates. Since the building structure may cause signal reflection or obstruction, acceleration and angular velocity data are collected by motion sensors worn by the visitor. This data, combined with inertial navigation principles, is used to correct the trajectory of the preliminary positioning results. For example, when continuous horizontal acceleration is detected in a visitor, the system compensates for the coordinate offset of the ultra-wideband positioning based on the motion sensor data, ultimately outputting accurate current position information.

[0033] In this embodiment, the fusion of ultra-wideband time-of-flight positioning and inertial sensing data not only adapts to complex electromagnetic environments with metal display cases and glass curtain walls, but also maintains positioning continuity in dynamic scenarios such as audience movement and sudden stops. This effectively improves the accuracy and reliability of audience position detection, providing a data foundation for the precise control of subsequent exhibit equipment. By eliminating positioning errors caused by environmental interference or rapid movement, it avoids projection misalignment or audio delay issues due to position misjudgment, thereby ensuring the spatiotemporal consistency of multi-device collaborative displays.

[0034] In one feasible implementation, refer to Figure 3The associated device subset includes a projection device subset and an audio device subset; step S100 further includes steps S121 to S123, wherein: Step S121: Query the pre-stored exhibition hall equipment space topology database to obtain the projection and audio devices bound to the current exhibit; Step S122: Calculate the spatial distance between the current position of the target audience and each projection device, and between the current position of the target audience and each audio device; Step S123: Select projection devices whose spatial distance is less than a preset first distance threshold to form a projection device subset, and select audio devices whose spatial distance is less than a preset second distance threshold to form an audio device subset.

[0035] In this embodiment, the exhibition hall equipment spatial topology database refers to a structured data set storing the physical locations of various devices within the exhibition hall and the relationships between them. Specifically, it can be implemented using spatial mapping technology based on a three-dimensional coordinate system, used to record the binding relationships between projection equipment, audio equipment, and exhibition areas. Spatial distance refers to the Euclidean distance between the current location of the target audience and the physical location of the equipment. Specifically, it can be calculated using the square root of the sum of squared differences in three-dimensional coordinates, used to quantify the spatial proximity between the audience and the equipment. The preset first distance threshold refers to the boundary distance value of the effective coverage area of ​​the projection equipment, specifically 80% to 90% of the maximum effective radiation radius calculated based on the projection equipment model and projection angle. The preset second distance threshold refers to the critical distance value for the uniform distribution of the sound field of the audio equipment, specifically an effective range where sound wave propagation attenuation does not exceed 3dB, determined based on a sound pressure level attenuation model.

[0036] In this embodiment, when a target visitor enters the exhibition area, the system queries the exhibition hall's equipment spatial topology database to retrieve all projection and audio devices bound to the current exhibition item. Then, based on the target visitor's real-time location coordinates, the spatial distance between the visitor and each projection and audio device is calculated. For example, if the spatial distance to a projection device is less than a preset first distance threshold, that device is included in the projection device subset; if the spatial distance to an audio device is less than a preset second distance threshold, that device is included in the audio device subset. This dynamically selects the set of devices that can effectively cover the visitor's area, avoiding energy waste caused by simultaneously activating all equipment in the hall.

[0037] In this embodiment, by dynamically matching devices based on real-time spatial distance calculations, device response delays during area boundary switching can be eliminated. Simultaneously, the device combination is automatically adjusted based on audience movement trajectories, avoiding redundant operation of ineffective devices. Dynamically filtering effective devices using spatial distance thresholds reduces uneven screen brightness caused by projection devices exceeding their effective coverage area, minimizes reverberation interference caused by overlapping sound fields in audio devices, and reduces the number of unnecessary devices operating through dynamic matching of device subsets, achieving precise control of exhibition hall energy consumption.

[0038] In one feasible implementation, refer to Figure 4 Step S300 includes steps S310 to S340, wherein: Step S310: Collect facial image data of the target audience; Step S320: Based on the pupil localization algorithm, the facial image data is processed to map the gaze point and determine the focal coordinates of the gaze on the display interface. Step S330: When the focus coordinates fall within the boundary of the display element of the exhibit, calculate its duration to generate duration data; Step S340: Output the target audience's attention data for the current exhibit based on the duration data.

[0039] In this embodiment, facial image data refers to image sequences captured by a camera that include the facial features and eye dynamics of the target audience. This can be achieved using a binocular camera or an infrared camera, used to capture facial orientation and eye movement trajectories. The pupil localization algorithm is an algorithm that identifies the center position of the pupil and calculates the direction of the gaze using image processing technology. Specifically, it can be implemented using a circle detection algorithm based on Hough transform or a feature point regression model based on deep learning, used to map the pupil position to the coordinate system of the exhibit interface. Focal coordinates refer to the two-dimensional position coordinates of the gaze projection on the exhibit interface, specifically calculated using a geometric projection model or a calibrated spatial mapping matrix, used to determine whether the audience's gaze falls within the area of ​​a specific display element. Duration data refers to the length of time the focal coordinates continuously remain within the boundary of the display element, specifically achieved through timestamp recording and difference calculation, used to quantify the audience's level of attention to the display element.

[0040] In this embodiment, facial image data of target visitors is collected in real time by cameras deployed in the exhibition area. A pupil localization algorithm is used to detect the pupil position in the image, and combined with pre-calibrated spatial coordinates of the exhibition interface, the pupil position is converted into the focal coordinates of the viewpoint on the exhibition interface. When the focal coordinates fall within the boundary of a certain display element, a timer is triggered to record the dwell time; if the focal point moves out of the boundary, the timer stops. By statistically analyzing the cumulative dwell time within the boundary of the same display element, duration data corresponding to that display element is generated, and thus attention data reflecting the intensity of visitor attention is output.

[0041] In this embodiment, a pupil localization algorithm and focus coordinate mapping are used to directly link the gaze point with the displayed element. Combined with a time dimension, the intensity of attention is quantified, providing more precise input parameters for multi-device collaborative control. Thus, this application can accurately identify the viewer's attention behavior towards specific displayed elements. Through dynamic analysis of the gaze focus position and dwell time, attention data matching the viewer's actual interests is generated, thereby optimizing the collaborative control strategy between projection and audio equipment and solving the problems of low media display effect and fragmented experience caused by inaccurate perception of attention behavior in traditional methods.

[0042] In one feasible implementation, the environmental data includes light intensity data and background noise data; (Refer to...) Figure 5 Step S400 includes steps S410 to S430, wherein: Step S410: When the light intensity data exceeds a preset brightness threshold, generate projection brightness compensation parameters based on the light intensity data and the preset brightness threshold; Step S420: When the background noise data exceeds a preset noise intensity, generate audio gain compensation parameters based on the background noise data and the preset noise intensity; Step S430: The projection brightness compensation parameters, audio gain compensation parameters, and attention data are superimposed and calculated to output the collaborative control parameters.

[0043] In this embodiment, the light intensity data refers to the actual light intensity value of the area where the exhibit is located, collected by environmental sensors. Specifically, a photosensitive sensor array can be used for periodic sampling to determine whether ambient brightness affects the projection device's display effect. The preset brightness threshold is a pre-set critical value for ambient brightness corresponding to the optimal display effect of the projection device, for example, it can be set to 500 lumens. When the measured value exceeds this threshold, a compensation mechanism is triggered. The projection brightness compensation parameter is the output increment of the projection device dynamically calculated based on the difference between the measured value and the threshold. For example, for every 100 lumens increase in the difference, the projection brightness is increased by 10%. Background noise data refers to the ambient sound wave energy value of the exhibition area collected by a sound pressure sensor. Specifically, a decibel meter can be used for spectrum analysis to assess the degree of interference with the audio device's playback effect. The preset noise intensity is the maximum ambient noise threshold for maintaining audio clarity, for example, it can be set to 60 decibels. When this value is exceeded, gain compensation is triggered. The audio gain compensation parameter is an audio output adjustment coefficient generated based on the difference between the noise intensity and the threshold. For example, for every 5 decibels increase in the difference, the speaker power is increased by 8%. Attention data refers to a quantitative indicator of attention generated by analyzing the coordinates of the viewer's gaze focus. Specifically, it can be achieved by using a pupil positioning algorithm and matching the coordinates of interface elements to reflect the viewer's level of interest in the exhibit content.

[0044] In this embodiment, when the ambient light intensity exceeds a preset brightness threshold, for example, when the actual brightness of the exhibition area reaches 700 lumens, the system calculates the difference between the light intensity data and the preset threshold to generate projection brightness compensation parameters to improve the output brightness of the projection device and ensure image visibility. Simultaneously, when the background noise intensity exceeds a preset noise intensity, for example, when the ambient noise reaches 70 decibels, the system analyzes the deviation between the noise data and the threshold to generate audio gain compensation parameters, enhancing the speaker output power to cover environmental interference. Subsequently, the above two compensation parameters are weighted and superimposed with attention data obtained through eye tracking, for example, setting the projection compensation parameter weight to 40%, the audio compensation parameter weight to 35%, and the attention data weight to 25%, ultimately fusing them to generate collaborative control parameters. These parameters synchronously adjust the operating status of the projection device and audio device through a unified command interface, achieving cross-device collaborative response.

[0045] In this embodiment, a compensation mechanism is established by integrating multi-dimensional data. For example, it automatically enhances projection brightness in strong lighting environments and dynamically adjusts audio output in high-noise areas. Simultaneously, it optimizes device weight allocation based on real-time audience attention, resolving information conflicts caused by independent device operation. By dynamically adjusting the output parameters of the projection and audio devices according to ambient light and noise levels, and optimizing the generation logic of control commands based on audience attention data, the accuracy of multi-device collaborative displays is effectively improved. For instance, in densely populated areas, the system enhances the audiovisual output intensity of core exhibits by overlaying high-attention data and noise compensation parameters, while reducing device energy consumption in peripheral areas, thus achieving energy efficiency optimization while ensuring an immersive experience.

[0046] In one feasible implementation, refer to Figure 6 Step S500 includes steps S510 to S550, wherein: Step S510: Obtain the effective radiation radius of each projection device and audio device in the associated device subset; Step S520: Calculate the distance influence factor of each projection device and audio device based on the spatial distance and the effective radiation radius; Step S530: Calculate the device weights of each projection device and audio device using the attention data and the distance influence factor; Step S540: Adjust the device weight of each projection device according to a preset first ratio based on the collaborative control parameters, and adjust the device weight of each audio device according to a preset second ratio based on the collaborative control parameters. Step S550: Normalize the device weights of the adjusted associated device subset, generate a control instruction set, and control the associated device subset to perform multi-device collaborative display.

[0047] In this embodiment, the effective radiation radius refers to the physical range within which the projection or audio equipment can effectively cover the display effect. This can be obtained through equipment parameters or experimental calibration. For example, the effective radiation radius of a projection device can be 5 to 10 meters, and that of an audio device can be 3 to 8 meters. The distance influence factor quantifies the impact of the spatial distance between the device and the target audience on the display effect. Specifically, it can be calculated as an inverse ratio of distance to the effective radiation radius. For example, when the spatial distance is 50% of the effective radiation radius, the distance influence factor is 0.5. The device weight characterizes the control strength of a single device in the collaborative display. Specifically, it can be calculated by multiplying the attention data by the distance influence factor. For example, when the attention data is 0.8 and the distance influence factor is 0.6, the device weight is 0.48. Normalization converts the adjusted device weights into standardized parameters with a sum of 1. Specifically, it can use a linear normalization method, such as dividing each device weight by the sum of its weights.

[0048] In this embodiment, after the target audience enters the exhibition area, the distance influence factor is first calculated based on the spatial distance between their current position and each device, combined with the effective radiation radius of the device. For example, when the distance between the projection device and the audience is 3 meters and the effective radiation radius is 6 meters, the distance influence factor is 0.5. Subsequently, combined with the real-time attention data of the target audience to the exhibition, for example, an attention data of 0.7, the initial device weight of the projection device is calculated to be 0.35. According to the projection brightness compensation parameter in the collaborative control parameters, for example, the preset first ratio is 1.2, the weight of the projection device is adjusted to 0.42. Similarly, the weight of the audio device is adjusted by the preset second ratio. Finally, the adjusted weights are normalized to generate a control instruction set, for example, the weight of the projection device is normalized to 0.6 and the weight of the audio device is normalized to 0.4, thereby controlling the projection device to output higher brightness and the audio device to display with adaptive gain.

[0049] In this embodiment, the weights are dynamically adjusted by fusing distance influence factors, attention data, and collaborative control parameters, and normalization processing is introduced to ensure that the output intensity of multiple devices matches the actual perceptual needs of the audience, avoiding situations where a single device over-responds while other devices contribute insufficiently. This allows the application to dynamically optimize the collaborative control weights of multiple devices based on audience location, attention behavior, and environmental data, ensuring precise matching of projection brightness and audio gain in spatial distribution and intensity. This improves the consistency of the displayed content, reduces waste of equipment resources, and enhances the audience's viewing experience.

[0050] In one feasible implementation, refer to Figure 7 The method further includes steps S551 to S555, wherein: Step S551: Obtain the physical location of each audio device in the associated device subset; Step S552: Calculate the azimuth angle of the target audience's position relative to each audio device; Step S553: ​​Determine the sound wave delay of each audio device based on the azimuth angle and the spatial distance between the audio device and the target audience's current position; Step S554: Generate a first control instruction set based on the sound wave delay of each audio device; Step S555: The first control instruction set and the second control instruction set used to control the projection device are time-aligned and merged into a control instruction set, which is then output to the associated device subset to control the associated device subset to perform multi-device collaborative display.

[0051] In this embodiment, physical location refers to the three-dimensional coordinates of the audio equipment within the exhibition space. Specifically, real-time positioning can be achieved using an ultra-wideband positioning system or a laser rangefinder to establish the spatial relationship between the equipment and the audience. Azimuth angle refers to the angle formed by the lines connecting the audience's location to each audio device. This angle can be calculated using trigonometric functions to determine the azimuth relationship between the device coordinates and the audience coordinates, thus determining the geometric characteristics of the sound wave propagation path. Sound wave delay refers to the time difference required for the audio signal to travel from the device to the audience's location. This delay can be calculated by dividing the spatial distance by the speed of sound propagation, and is used to eliminate phase interference caused by the superposition of sound fields from multiple devices. Time alignment refers to synchronizing the control commands of the audio equipment with those of the projection equipment. This can be achieved through timestamp marking or unified scheduling by a central controller, ensuring the coordination of sound and image synchronization.

[0052] In this embodiment, when a viewer is in the exhibit area, the coordinate data of the surrounding audio devices is first obtained through a positioning system. Then, based on the geometric relationship between the viewer's position and the device coordinates, the sound wave propagation path length and azimuth angle of each device are calculated. The path length is converted into a time delay parameter based on the sound speed parameter, generating delay compensation instructions for each audio device. Simultaneously, the projection device's screen switching instructions are timestamped and aligned with the audio delay compensation instructions under a unified time reference. The final merged instruction set ensures that the sound and visual information received by the viewer remain synchronized in the spatiotemporal dimension.

[0053] Understandably, in traditional solutions, audio and projection devices operate independently, failing to consider the audio-visual asynchrony caused by the difference between the speed of sound and the speed of light. For example, when the audience is far from the audio device, the sound arrives later than the projected image, causing information misalignment. In this embodiment, the solution effectively eliminates timing errors in collaborative control between devices by dynamically calculating the sound wave delay and aligning command timings. Through the above steps, this application solves the problem of information fragmentation caused by audio-visual asynchrony in multi-device collaborative displays, enabling viewers to still enjoy an immersive experience with highly matched audio-visual information in both time and space dimensions while moving, and reducing content conflicts caused by device response delays.

[0054] In one feasible implementation, there are multiple target audiences, and the method further includes: after obtaining the current positions of multiple target audiences, performing regional grid division processing on the current positions of multiple target audiences to generate exhibition area heat distribution data; when the exhibition area heat distribution data shows that multiple audiences are in a clustered state, matching and finding the union of associated device subsets based on the current position of each target audience to obtain the final associated device subset, and using the cluster center position as the reference point for multi-device collaborative display.

[0055] In this embodiment, the area grid division process refers to dividing the exhibition area plane into several grid units of equal or unequal area. Specifically, it can be implemented using rectangular grids or hexagonal honeycomb grid algorithms. By mapping the audience position coordinates to the corresponding grid units, the distribution of the number of audience members within each grid is statistically analyzed. The exhibition area heat map data refers to visualized data reflecting the audience density distribution within the exhibition area. Specifically, it can be generated using color gradients or numerical matrices to quantify the degree of audience gathering in different areas. Aggregation state refers to the phenomenon of multiple audience members forming a high-density distribution within a specific area. This can be determined by setting a threshold for the number of audience members within a grid unit or the rate of change of density gradient between adjacent grids. The union of associated device subsets refers to merging the subsets of projection devices and audio devices matched to multiple target audience members. This can be implemented using hash tables or bitmap data structures to eliminate duplicate devices and cover the device sets in all audience areas. The reference point refers to the spatial reference coordinates when multiple devices are displayed collaboratively. Specifically, it can be determined by calculating the geometric center or weighted center of multiple audience position coordinates, serving as a spatial reference for unifying device control commands.

[0056] In this embodiment, when multiple visitors are detected entering the exhibition area, the exhibition control system divides the exhibition area into rectangular grids with sides of, for example, 0.5 meters. It counts the number of visitors in each grid in real time and generates a heat map of visitor density, using color depth to represent density. When the visitor density in three consecutive grids of a certain area exceeds a preset threshold, the area is determined to be in a clustered state. The system iterates through the location coordinates of each visitor within the area, matching them with projection and audio devices within a preset distance range. All matching results are merged, and duplicate devices are removed to form a set of associated devices covering the entire clustered area. Simultaneously, the system calculates the arithmetic mean of the visitor coordinates in the area, using it as the reference point coordinates for multi-device collaborative control. When multiple visitors simultaneously focus on the same exhibit element, the system collects the gaze focus coordinates and gaze duration data for each visitor, calculating the arithmetic mean of all visitor attention data, which serves as a unified input value for adjusting environmental parameters.

[0057] In this embodiment, by dynamically merging the device set, it is ensured that all audience members within the clustered area are covered by the devices. Simultaneously, device parameters are adjusted based on average attention data to avoid interference from abnormal data from individual audience members. By using unified control commands based on a reference point, the problem of spatial coordination deviation among multiple devices is resolved, ensuring spatial consistency of sound and light effects within the clustered area. This effectively addresses the issue of insufficient device coverage in densely populated areas and avoids fragmented display effects caused by independent device operation. Dynamically merging the device set reduces redundant device startup and lowers system energy consumption. Based on unified reference point control within the audience clustered area, the spatial synchronization accuracy of multi-device collaborative displays is improved, enhancing the immersive viewing experience for group audiences.

[0058] In one feasible implementation, the method further includes: when the thermal distribution data of the exhibition area shows that multiple visitors are in a clustered state, before the step of performing data fusion processing on the attention data and the environmental data to obtain collaborative control parameters, the method further includes: acquiring the attention behavior of multiple target visitors to the same display element of the current exhibit to generate multiple target visitors' attention data to the current exhibit; calculating the average of the acquired multiple attention data and using it as the final attention data.

[0059] In this embodiment, when multiple visitors are detected gathering in the same exhibit area, facial image data of all visitors are simultaneously acquired by image acquisition devices deployed around the exhibit. A pupil localization algorithm is then used to calculate the gaze focus coordinates of each visitor. When the focus coordinates of multiple visitors all fall within the boundary range of the same exhibit element, the focus dwell time of each visitor is recorded, generating corresponding attention data. Subsequently, the attention data of all visitors is input into a calculation unit for arithmetic averaging, and the resulting average is used as the final attention data for that exhibit element. This data is then fused with parameters such as light intensity and background noise collected by environmental sensors to generate collaborative control parameters. These parameters are then used to adjust the ratio of projection brightness compensation to audio gain compensation, ensuring that the collaborative display effect of the associated device subset matches the attention characteristics of the group of visitors.

[0060] In some specific implementations, the image acquisition device can use a binocular camera array to cover the exhibit interface, and the pupil positioning algorithm can achieve focus mapping based on iris contour recognition and three-dimensional spatial coordinate transformation; the average value calculation of attention data can be completed in real time by an embedded processor, for example, by using a sliding window mechanism to dynamically average multiple continuously collected audience data.

[0061] In this embodiment, by collecting data on the attention of multiple people and calculating the average value, the collaborative control parameters can reflect the trend of group attention, avoiding abnormal device response caused by the brief distraction or excessive attention of individual viewers. This solves the problem of insufficient precision in the collaborative control of media devices in multi-person gathering scenarios. By averaging the group attention data, the device response is made closer to the actual needs of most viewers, reducing the fluctuation of display effect caused by individual behavioral differences, and improving the consistency of the collaborative display effect of multimedia devices in dense areas with the immersive experience of the audience.

[0062] In this embodiment, the exhibition hall display method based on digital multimedia obtains the audience's location in real time and matches the associated device subset. It combines environmental data and attention data to generate collaborative control parameters, dynamically adjusts the multi-device collaborative display strategy, improves the accuracy of multimedia collaborative control and display effect, and enhances the audience's viewing experience.

[0063] It should be noted that the above examples are only for understanding this application and do not constitute a limitation on the exhibition hall display method based on digital multimedia of this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0064] This application also provides a digital multimedia-based exhibition hall display device, for reference. Figure 8 The device includes: a memory 10, a processor 20, and a computer program stored on the memory 10 and executable on the processor 20, the computer program being configured to implement the steps of the digital multimedia-based exhibition hall display method.

[0065] The exhibition hall display equipment based on digital multimedia provided in this application, employing the exhibition hall display method based on digital multimedia in the above embodiments, can improve the accuracy of multimedia collaborative control in exhibition halls and the viewing experience of visitors. Compared with the prior art, the beneficial effects of the exhibition hall display equipment based on digital multimedia provided in this application are the same as the beneficial effects of the exhibition hall display method based on digital multimedia provided in the above embodiments, and other technical features in this exhibition hall display equipment are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0066] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A method for exhibition hall display based on digital multimedia, characterized in that, The method includes: Obtain the current location of the target audience, and based on the target audience's current location, match a subset of related devices in the exhibition hall; Based on the current location of the target audience, trigger environmental sensors deployed in the area where the corresponding exhibit is located to collect environmental data; Acquire the attention behavior of the target audience towards the display elements of the current exhibit in order to generate data on the target audience's attention to the current exhibit; The attention data and the environmental data are fused together to obtain collaborative control parameters. The associated device subset is weighted according to the collaborative control parameters to generate a corresponding set of control instructions, which controls the associated device subset to perform multi-device collaborative display.

2. The exhibition hall display method based on digital multimedia as described in claim 1, characterized in that, The step of obtaining the current location of the target audience includes: The pulse signals emitted by the positioning tags worn by the target audience are received by multiple ultra-wideband positioning base stations; The real-time location coordinates of the target audience are determined by calculating the time difference of the arrival of the pulse signal at multiple ultra-wideband signals. The user's motion sensors are used to compensate for the movement trajectory of the real-time location coordinates in order to obtain the current location of the target audience.

3. The exhibition hall display method based on digital multimedia as described in claim 1, characterized in that, The associated device subset includes a projection device subset and an audio device subset; the step of matching the associated device subset in the exhibition hall equipment based on the current location of the target audience includes: Query the pre-stored exhibition hall equipment space topology database to obtain the projection and audio equipment bound to the current exhibit; Calculate the spatial distances between the target audience's current location and each projection device, as well as between the target audience's current location and each audio device; Projection devices whose spatial distance is less than a preset first distance threshold are selected to form a subset of projection devices, and audio devices whose spatial distance is less than a preset second distance threshold are selected to form a subset of audio devices.

4. The exhibition hall display method based on digital multimedia as described in claim 1, characterized in that, The step of acquiring the target audience's attention behavior towards the display elements of the current exhibit to generate target audience attention data for the current exhibit includes: Collect facial image data of the target audience; The facial image data is processed by mapping the gaze point based on the pupil localization algorithm to determine the focal coordinates of the gaze on the display interface. When the focus coordinates fall within the boundary of the display element of the exhibit, its duration is calculated to generate duration data; Output the target audience's attention level to the current exhibit based on the duration data.

5. The exhibition hall display method based on digital multimedia as described in claim 3, characterized in that, The environmental data includes light intensity data and background noise data; The step of fusing the attention data and the environmental data to obtain collaborative control parameters includes: When the light intensity data exceeds a preset brightness threshold, projection brightness compensation parameters are generated based on the light intensity data and the preset brightness threshold. When the background noise data exceeds a preset noise intensity, an audio gain compensation parameter is generated based on the background noise data and the preset noise intensity. The projection brightness compensation parameters, audio gain compensation parameters, and attention data are superimposed and calculated to output the collaborative control parameters.

6. The exhibition hall display method based on digital multimedia as described in claim 5, characterized in that, The step of generating a corresponding set of control instructions by weighting the associated device subset using the collaborative control parameters, and controlling the associated device subset to perform multi-device collaborative display includes: Obtain the effective radiation radius of each projection device and audio device in the associated device subset; Based on the spatial distance and the effective radiation radius, calculate the distance influence factor for each projection device and audio device; The device weights of each projection device and audio device are calculated using attention data and the distance influence factor. Based on the collaborative control parameters, the device weights of each projection device are adjusted according to a preset first ratio, and the device weights of each audio device are adjusted according to a preset second ratio. The device weights of the adjusted subset of associated devices are normalized to generate a set of control instructions, which then control the subset of associated devices to perform multi-device collaborative display.

7. The exhibition hall display method based on digital multimedia as described in claim 6, characterized in that, The method further includes: Obtain the physical location of each audio device in the associated device subset; Calculate the orientation angle of the target audience's position relative to each audio device; The sound wave delay of each audio device is determined based on the azimuth angle and the spatial distance between the audio device and the target audience's current location. The first control instruction set is generated based on the sound wave delay of each audio device; The first control instruction set and the second control instruction set used to control the projection device are time-aligned and merged into a control instruction set, which is then output to the associated device subset to control the associated device subset to perform multi-device collaborative display.

8. The exhibition hall display method based on digital multimedia as described in claim 1, characterized in that, The target audience is multiple, and the method further includes: After obtaining the current locations of multiple target audiences, the current locations of the multiple target audiences are divided into regional grids to generate heat distribution data of the exhibition area; When the heat distribution data of the exhibition area shows that multiple visitors are in a clustered state, the associated device subset is matched and the union is calculated based on the current location of each target visitor to obtain the final associated device subset, and the cluster center location is used as the reference point for multi-device collaborative display.

9. The exhibition hall display method based on digital multimedia as described in claim 8, characterized in that, The method further includes: when the thermal distribution data of the exhibition area shows that multiple visitors are in a clustered state, before the step of performing data fusion processing on the attention data and the environmental data to obtain collaborative control parameters, the method further includes: Acquire the attention behavior of multiple target audiences towards the same display element of the current exhibit to generate attention data of multiple target audiences towards the current exhibit; The average of the multiple attention data points is calculated and used as the final attention data.

10. A digital multimedia-based exhibition hall display device, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the digital multimedia-based exhibition hall display method as described in any one of claims 1 to 9.

Images