Conference environment intelligent sound field control system

Abstract

The application provides a conference environment intelligent sound field control system, which is cooperatively worked by a main sound source module, a plurality of sound field node intensity adjustment modules, a human body recognition positioning module and a processing control module. The main sound source module integrates the functions of main sound emission, direction adjustment, sound source sound collection and direction detection, can automatically track the position of the speaker and adjust the direction of the sound source. The sound field node intensity adjustment module optimizes the sound field effect at each place in the conference space through node sound collection, compensation sound emission, intensity adjustment and node processing. The human body recognition positioning module tracks the positions of the participants in real time and provides the processing control module for intelligent decision-making. The system can automatically adjust the direction and intensity of the sound field according to the distribution of the participants, ensure accurate sound transmission, and reduce environmental noise interference. This intelligent sound field control scheme significantly improves the conference voice clarity and communication efficiency, adapts to the needs of conference scenes of various scales and layouts, and provides an intelligent and efficient acoustic solution for the conference environment.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of sound, in particular to a conference environment intelligent sound field control system. BACKGROUND

[0002] Uniform control of sound field in conference environment is a key challenge in modern conference system design. An ideal conference environment should ensure that all participants can clearly hear the speaker regardless of their location, and the volume distribution is uniform. With the popularity of remote conferencing and hybrid office mode, this demand has become more urgent.

[0003] The most basic method is to use strategically placed traditional loudspeaker systems. By reasonably distributing multiple loudspeakers in the conference room, the sound propagation distance can be reduced, providing more uniform coverage. This method has relatively low implementation cost and mature and reliable technology. However, this method has obvious shortcomings: there will be significant differences in sound at different locations, especially in large or irregular conference spaces; complex audio calibration is required for system debugging by professional personnel; phase interference may occur between multiple loudspeakers, causing sound distortion or echo in some areas; and it is dependent on the building structure, making it difficult to adjust later.

[0004] Directional sound technology uses special loudspeaker arrays to concentrate sound projection on specific areas, reducing sound wave diffusion. This technology can create a relatively quiet listening area in a noisy environment, suitable for zoned conference environments. Its advantage is that it can reduce noise interference and improve speech clarity in specific areas. However, the limitations of directional sound technology are also obvious: the coverage area is limited, making it difficult to meet the needs of large conferences; the cost of equipment is high; the accuracy of sound direction is greatly affected by environmental factors such as temperature and humidity changes; the system is complex, requiring professional skills for debugging and maintenance; and participants will experience significant sound changes when moving, affecting the conference experience. SUMMARY

[0005] The present application provides a conference environment intelligent sound field control system, comprising:

[0006] a main sound source module;

[0007] a plurality of sound field node intensity adjustment modules;

[0008] a human body recognition and positioning module;

[0009] a processing and control module;

[0010] The main sound source module, each sound field node intensity adjustment module, and the human body recognition and positioning module are respectively data connected to the processing and control module.

[0011] The main sound source module includes a main sound emitting module, a direction adjusting module, a sound source sound collecting module and a direction detecting module, the main sound emitting module and the direction detecting module are connected to the direction adjusting module, the sound source sound collecting module is connected to the main sound emitting module, and the direction adjusting module, the sound source sound collecting module and the direction detecting module are data-connected to the processing control module.

[0012] The sound field node intensity adjusting module includes a node sound collecting module, a compensation sound emitting module, a compensation intensity adjusting module and a node processing module, the node sound collecting module, the compensation sound emitting module and the compensation intensity adjusting module are data-connected to the node processing module, and the node processing module is data-connected to the processing control module.

[0013] By adopting the above technical scheme, the conference environment intelligent sound field control system can realize intelligent conference sound field management through the cooperative work of the main sound source module, the multiple sound field node intensity adjusting modules, the human body recognition and positioning module and the processing control module, can automatically recognize and position conference personnel, dynamically adjust the sound field direction and intensity according to the personnel position, ensure effective sound transmission, and can improve the voice clarity and communication efficiency of the conference, reduce environmental noise interference, and adapt to different conference scene requirements.

[0014] Optionally, the conference environment intelligent sound field control system further includes a sound field control strategy, including the following steps:

[0015] A1, obtaining sound source positioning data corresponding to the main sound source module;

[0016] A2, obtaining sound field node positioning data and node sound source distance corresponding to each sound field node intensity adjusting module;

[0017] A3, collecting and playing preset main sound source audio data through the main sound source module, and obtaining corresponding sound source intensity data;

[0018] A4, collecting the main sound source audio data played by the main sound source module to generate node received audio data through each sound field node intensity adjusting module, and obtaining corresponding node sound collecting intensity data;

[0019] A5, calculating corresponding node sound field compensation intensity according to the node sound source distance, the node sound collecting intensity data and the sound source intensity data corresponding to each sound field node intensity adjusting module;

[0020] A6, adjusting the audio intensity compensation by the node intensity adjustment module according to the node sound source distance, the node sound field compensation intensity and the main sound source audio data.

[0021] By adopting the technical scheme, the conference environment intelligent sound field control system can obtain the position data of the main sound source and each sound field node and the relative distance relationship, calculate the sound field compensation intensity required by each node by using the distance relationship between the node and the sound source and the comparison between the sound intensity and the source intensity, and finally realize the audio intensity compensation based on the actual environment parameters, so that the sound uniformity and clarity in the conference environment are improved, the problems of uneven sound transmission and difficult listening at the far end in the traditional conference system are effectively solved, and a more comfortable and efficient sound field environment for information transmission is created for the conference participants.

[0022] Optionally, the sound field control strategy further comprises the following steps:

[0023] A7, obtaining the crowd positioning data corresponding to the human body recognition and positioning module;

[0024] A8, calculating and determining the crowd center positioning data and the crowd area positioning data according to the crowd positioning data;

[0025] A9, obtaining the sound source direction data of the main sound source module;

[0026] A10, adjusting the orientation of the main sound source module according to the sound source direction data and the crowd center positioning data until the ray corresponding to the sound source direction data passes through the point corresponding to the crowd center positioning data;

[0027] A11, determining each sound field node intensity adjustment module in the corresponding area according to the crowd area positioning data and defining as an effective node adjustment module;

[0028] A12, adjusting the audio intensity compensation by each effective node adjustment module.

[0029] By adopting the technical scheme, the conference environment intelligent sound field control system can obtain the position data of the conference crowd by the human body recognition and positioning module, calculate the crowd center point and the overall distribution area, obtain the current direction information of the main sound source and automatically adjust the orientation of the main sound source, ensure that the sound is directly pointed to the crowd center, provide the best sound coverage, the system can automatically identify and activate the effective sound field node adjustment module located in the area according to the crowd distribution area, only in the necessary area, the audio intensity compensation is carried out, the directional transmission efficiency of the conference sound is improved, the energy waste is reduced, and at the same time, no matter how the conference participants move or redistribute, the system can adaptively adjust to maintain the best sound field experience, effectively improve the clarity and comfort of the conference communication.

[0030] Optionally, step A2 comprises the following steps:

[0031] A201, uniformly adjusting the orientation of the main sound source module, playing preset positioning audio data, and determining corresponding sound source orientation data time series data and positioning audio playing time series data;

[0032] A202, collecting positioning audio data by each sound field node intensity adjustment module and determining corresponding positioning audio receiving intensity data and positioning audio receiving time series data;

[0033] A203, determining corresponding receiving time difference according to the positioning audio playing time series data and the positioning audio receiving time series data;

[0034] A204, calculating corresponding node sound source distance by multiplying the receiving time difference of each sound field node intensity adjustment module and the preset sound speed;

[0035] A205, determining the sound source directly opposite moment as the moment corresponding to the maximum value of the positioning audio receiving intensity data;

[0036] A206, determining corresponding node sound source directly opposite orientation data according to the sound source directly opposite moment and the sound source orientation data time series data;

[0037] A207, determining corresponding sound field node positioning data according to the node sound source directly opposite orientation data and the node sound source distance of each sound field node intensity adjustment module.

[0038] By adopting the above technical solution, the conference environment intelligent sound field control system can play positioning audio by uniformly rotating the main sound source, cooperate with time series collection and analysis, and calculate accurate node sound source distance through receiving time difference and sound speed, and determine sound source directly opposite orientation by analyzing sound intensity peak value, so that the spatial position relationship of all sound field nodes in the conference room can be obtained without manual measurement, the efficiency of system deployment and calibration is improved, and higher precision spatial reference data is provided for subsequent sound field compensation.

[0039] Optionally, the sound field control strategy further comprises the following steps:

[0040] B1, correcting each sample collection moment in the node receiving intensity data according to the corresponding receiving time difference of each sound field node intensity adjustment module to generate node receiving intensity time difference correction data;

[0041] B2, calculating corresponding audio intensity attenuation rate according to the node receiving intensity time difference correction data and the sound source intensity data;

[0042] B3, generating corresponding sound field intensity distribution data according to the combination of the audio intensity attenuation rate of each sound field node intensity adjustment module and the sound field node positioning data;

[0043] B4, drawing a corresponding sound field intensity distribution map according to the sound field intensity distribution data and the sound source orientation data and the sound source positioning data of the main sound source module.

[0044] By adopting the above technical solution, the conference environment intelligent sound field control system can correct the time difference of the sound data of each sound field node, eliminate the measurement error caused by the delay of sound wave propagation, then compare the corrected node sound intensity data with the sound source intensity data, calculate the audio intensity attenuation rate of each node, further integrate the attenuation rate and the spatial position data of all nodes, and combine the main sound source position to construct a complete sound field intensity distribution map. The visual distribution map enables the conference staff to intuitively understand the sound propagation characteristics of the entire conference space, and provides a scientific basis for the optimization arrangement of the sound field nodes and the adjustment of the compensation strategy.

[0045] Optionally, step A8 comprises the following steps:

[0046] A801, calculating corresponding crowd center positioning data according to the average of all single positioning data in the crowd positioning data;

[0047] A802, calculating corresponding single influence area data according to each single positioning data and a preset influence radius;

[0048] A803, generating corresponding crowd area positioning data according to the combination of all single influence area data.

[0049] By adopting the above technical solution, the conference environment intelligent sound field control system can determine the crowd center point by calculating the average of the positions of all participants, and provide an accurate target for the direction adjustment of the main sound source. The system also combines the "influence radius" around each participant to construct individual sound field influence areas, and combines these areas to form a complete crowd coverage area, which can accurately identify the actual distribution form and density change of the crowd, and provide accurate spatial reference for the subsequent activation of the sound field nodes and the adjustment of the compensation intensity, which can improve the adaptability and sound field experience quality of the system in various dynamic conference environments.

[0050] Optionally, the sound field control strategy further comprises the following steps:

[0051] C1, assigning a preset node weight value to each sound field node intensity adjustment module;

[0052] C2, adding a preset weight step value to the node weight value of the sound field node intensity adjustment module falling into the area according to each single influence area data;

[0053] C3, generating corresponding node compensation weight distribution data according to the node weight value of each sound field node intensity adjustment module and the sound field node positioning data;

[0054] C4, calculating and determining corresponding volume intensity compensation coefficients according to the audio intensity attenuation rate and the node weight value of each sound field node intensity adjustment module.

[0055] By adopting the above technical solution, the conference environment intelligent sound field control system can allocate a basic weight value to each sound field node, then adjust the node weight of each node according to the influence area of each participant, form an intuitive node compensation weight distribution graph, further combine the actual audio attenuation characteristics and dynamic weight value of each node, and calculate the corresponding volume intensity compensation coefficient, so that the system can ensure the overall sound field balance while providing more accurate sound enhancement to the key area, providing the best listening experience for participants in different positions, and improving the sound transmission efficiency and communication quality in the conference environment.

[0056] Optionally, the sound field control strategy further comprises the following steps:

[0057] D1, sorting each effective node adjustment module from small to large according to the sound receiving time difference to generate an effective node transmission sequence;

[0058] D2, when the main sound source module collects and plays the main sound source audio data, sequentially streaming the main sound source audio data to each effective node adjustment module through the processing control module according to the effective node transmission sequence;

[0059] D3, playing the main sound source audio data through each effective node adjustment module after the sound receiving time difference according to the volume intensity compensation coefficient corresponding to each effective node adjustment module.

[0060] By adopting the above technical solution, the conference environment intelligent sound field control system can sort each node according to the sound receiving time difference (i.e. sound wave propagation delay), construct a reasonable audio transmission sequence, and ensure that the audio data is sent to each node in the optimal order. When the main sound source plays audio, the system streams audio data to each effective node according to the predetermined transmission sequence, avoiding the out-of-sync problem caused by network delay. Each node will play audio data through its own compensation sound module according to the sound receiving time difference, ensuring the superposition of the compensation sound wave and the original sound wave in time and space, and improving the sound receiving effect of the participants.

[0061] In summary, the present application has at least one of the following beneficial technical effects:

[0062] 1. The intelligent conference sound field management can be realized through the cooperative work of the main sound source module, multiple sound field node intensity adjustment modules, human body recognition positioning module and processing control module. The system can automatically recognize and locate conference personnel, dynamically adjust the sound field direction and intensity according to the personnel position, ensure effective sound transmission, the main sound source module is responsible for core sound emission and can adjust the direction, and at the same time has the functions of sound collection and direction detection. The distributed sound field node intensity adjustment module optimizes the overall sound field effect through sound collection, compensation sound emission and intensity adjustment, which can effectively improve the voice clarity and communication efficiency of the conference, reduce environmental noise interference, and adapt to different conference scene requirements.

[0063] 2. The sound field compensation intensity required by each node can be calculated by obtaining the position data of the main sound source and each sound field node and the relative distance relationship, and using the distance relationship between the node and the sound source, the comparison between the sound collection intensity and the source intensity, so as to realize the audio intensity compensation based on the actual environmental parameters, improve the sound uniformity and clarity in the conference environment, and effectively solve the problems of uneven sound transmission, difficulty in listening to the far end and other problems in the traditional conference system, and create a more comfortable and efficient information transmission sound field environment for conference participants.

[0064] 3. The position data of the conference crowd can be obtained by the human body recognition positioning module, the center point and the overall distribution area of the crowd are calculated, the current direction information of the main sound source is obtained and the main sound source is automatically adjusted, the sound is directly pointed to the center of the crowd, the best sound coverage is provided, the system can automatically identify and activate the effective sound field node adjustment module located in the area according to the distribution area of the crowd, only the necessary area is compensated for audio intensity, the directional transmission efficiency of conference sound can be improved, energy waste is reduced, and at the same time, no matter how the conference personnel move or redistribute, the system can adaptively adjust to maintain the best sound field experience, effectively improving the clarity and comfort of conference communication. BRIEF DESCRIPTION OF DRAWINGS

[0065] Figure 1 is a principle schematic diagram of a conference environment intelligent sound field control system of the present application.

[0066] Figure 2 is a process schematic diagram of a sound field control strategy of a conference environment intelligent sound field control system of the present application. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical scheme and advantages of the present application more clear, the present application will be further described in detail below in combination with the drawings and examples. It should be understood that the specific examples described herein are only used to explain the present application and not to limit the present application.

[0068] The embodiments of the present application will be further described in detail below in combination with the drawings of the specification.

[0069] Reference Figure 1 The application provides a conference environment intelligent sound field control system for distributed adjustment of the volume of conference audio in a conference environment to ensure the sound receiving effect of conference participants at different positions in the conference place.

[0070] The conference environment intelligent sound field control system comprises:

[0071] a main sound source module 10;

[0072] a plurality of sound field node intensity adjustment modules 20;

[0073] a human body recognition and positioning module 30;

[0074] a processing control module 40;

[0075] The main sound source module 10, each sound field node intensity adjustment module 20 and the human body recognition and positioning module 30 are respectively data-connected to the processing control module 40.

[0076] The main sound source module 10 comprises a main sound emission module 11, a direction adjustment module 12, a sound source sound receiving module 13 and a direction detection module 14, the main sound emission module 11 and the direction detection module 14 are connected to the direction adjustment module 12, the sound source sound receiving module 13 is connected to the main sound emission module 11, and the direction adjustment module 12, the sound source sound receiving module 13 and the direction detection module 14 are data-connected to the processing control module 40.

[0077] The sound field node intensity adjustment module 20 comprises a node sound receiving module 21, a compensation sound emission module 22, a compensation intensity adjustment module 23 and a node processing module 24, the node sound receiving module 21, the compensation sound emission module 22 and the compensation intensity adjustment module 23 are data-connected to the node processing module 24, and the node processing module 24 is data-connected to the processing control module 40.

[0078] The main sound source module 10 is mainly used for collecting corresponding conference audio and playing the audio to the conference place, so that the conference participants in the conference place can receive the audio content.

[0079] Each sound field node intensity adjustment module 20 is mainly used for distributed detection of the sound receiving effect at each position in the conference place, and auxiliary playing of the conference audio according to the sound receiving effect, so as to ensure the sound receiving effect at each position in the conference place.

[0080] The human body recognition and positioning module 30 is mainly used for human body recognition and positioning of the personnel in the conference place, and selects the corresponding sound field node intensity adjustment module 20 for audio playing compensation according to the positioning information of the personnel.

[0081] The processing control module 40 is mainly used for data processing and controlling other modules.

[0082] The main sound emitting module 11 is mainly used for playing conference audio, which can be collecting the audio of the speech of the conference speaker through the microphone and playing it in real time, or playing the pre-stored audio data.

[0083] The direction adjusting module 12 is mainly used for adjusting the direction of the main sound emitting module 11 so that it can face the crowd as much as possible to improve the playing effect.

[0084] The sound source receiving module 13 is mainly used for collecting the data of the audio emitted by the main sound emitting module 11 for detecting its sound intensity and subsequent data processing.

[0085] The direction detecting module 14 is mainly used for detecting the orientation data of the direction adjusting module 12 and the main sound emitting module 11 for accurate adjustment of the direction.

[0086] The node receiving module 21 is mainly used for collecting the audio emitted by the main sound source module 10 at the position of the sound field node intensity adjusting module 20 in the conference place for data analysis.

[0087] The compensation sound emitting module 22 is mainly used for compensating the sound intensity of the audio emitted by the main sound source module 10, and improving its volume by synchronous sound emission to ensure the sound receiving effect at the position.

[0088] The compensation intensity adjusting module 23 is mainly used for actively or passively adjusting the compensation volume of the compensation sound emitting module 22, which can change the compensation volume of the compensation sound emitting module 22 according to the sound receiving effect, or change the compensation volume manually according to the participants.

[0089] The node processing module 24 is mainly used for processing the data collected by the node sound field intensity adjusting module 20 and controlling each module.

[0090] By the above technical scheme, the conference environment intelligent sound field control system can realize intelligent conference sound field management through the cooperative work of the main sound source module, the multiple sound field node intensity adjustment modules, the human body recognition positioning module and the processing control module. The system can automatically recognize and locate conference personnel, dynamically adjust the sound field direction and intensity according to the personnel position, ensure effective sound transmission, and the main sound source module is responsible for core sound emission and can adjust the direction, and simultaneously has the functions of sound collection and direction detection. The distributed sound field node intensity adjustment modules optimize the overall sound field effect through sound collection, compensation sound emission and intensity adjustment, which can effectively improve the voice clarity and communication efficiency of the conference, reduce environmental noise interference, and adapt to different conference scene requirements.

[0091] Further, with reference to Figure 2 , the conference environment intelligent sound field control system further comprises a sound field control strategy, comprising the following steps:

[0092] A1, obtaining sound source positioning data corresponding to the main sound source module 10;

[0093] The sound source positioning data is the positioning data of the main sound source module 10 in the conference place, which can be determined in advance or directly defined as the origin for subsequent data processing.

[0094] A2, obtaining sound field node positioning data and node sound source distance corresponding to each sound field node intensity adjustment module 20;

[0095] The sound field node positioning data is the positioning data of the sound field node intensity adjustment module 20 in the conference place, which can be determined during installation or determined by subsequent measurement;

[0096] The node sound distance is the distance between the sound field node intensity adjustment module 20 and the main sound source module 10, which can be determined by measurement or calculated according to the sound field node positioning data and the sound source positioning data.

[0097] A3, collecting and playing preset main sound source audio data by the main sound source module 10, and obtaining corresponding sound source intensity data;

[0098] The main sound source audio data is the audio data to be played by the main sound source module 10, which can be generated by real-time collection of the voice of the conference speaker by a microphone or read from pre-stored audio data;

[0099] The sound source intensity data is the audio intensity data when the main sound source module 10 plays the main sound source audio data, which can be generated by the sound source collection module 13 of the main sound source module 10, for example, time-domain-based audio decibel data, that is, the intensity data of the sound played by the main sound emission module 11 of the main sound source module 10.

[0100] A4, the sound field node intensity adjustment module 20 collects the main sound source audio data played by the main sound source module 10 to generate node received audio data, and obtains corresponding node sound receiving intensity data;

[0101] Node received audio data is the audio data generated by the sound field node intensity adjustment module 20 collecting the sound emitted by the main sound source module 10;

[0102] Node sound receiving intensity data is the intensity data of the corresponding audio determined according to the node received audio data, that is, the audio intensity data that the sound field node intensity adjustment module 20 can receive, for example, time-domain-based audio intensity data.

[0103] A5, according to the corresponding node sound source distance, node sound receiving intensity data and sound source intensity data of each sound field node intensity adjustment module 20, the corresponding node sound field compensation intensity is calculated;

[0104] Node sound field compensation intensity is the sound intensity data that needs to be compensated for each sound field node intensity adjustment module 20;

[0105] Because there is a certain distance between the main sound source module 10 and the sound field node intensity adjustment module 20, there is a certain time difference from sound emission to reception, so the corresponding time difference needs to be calculated according to the node sound source distance, and then the sound source intensity data and the node sound receiving intensity data are adjusted and matched according to the time difference, and then the corresponding sound intensity difference value can be calculated and determined, and then the sound intensity value that needs to be compensated for can be determined.

[0106] A6, through the sound field node intensity adjustment module 20, the audio intensity compensation is performed according to the node sound source distance, the node sound field compensation intensity and the main sound source audio data.

[0107] Because the time from the sound emitted by the main sound source module 10 to the sound field node intensity adjustment module 20 is greater than the time from the main sound source module 10 data transmission audio to the sound field node intensity adjustment module 20, the corresponding audio data fragment can be transmitted to the sound field node intensity adjustment module 20 through the processing control module 40 at the same time when the main sound source module 10 emits audio, and after a small delay, when the sound field node intensity adjustment module 20 receives the sound wave of the main sound source audio data, the compensation sound emission module 22 synchronously plays the audio data fragment to realize the compensation of the sound intensity, which can be calculated according to the node sound source distance and the speed of sound.

[0108] Through the above steps, the conference environment intelligent sound field control system can obtain the position data of the main sound source and each sound field node and the relative distance relationship, and calculate the sound field compensation intensity required by each node by using the distance relationship between the node and the sound source, the comparison between the sound intensity and the source intensity, so as to finally realize the audio intensity compensation based on the actual environment parameters, improve the sound uniformity and clarity in the conference environment, and effectively solve the problems of uneven sound transmission and difficult remote listening in the traditional conference system, thereby creating a more comfortable and efficient information transmission sound field environment for conference participants.

[0109] Further, the sound field control strategy further comprises the following steps:

[0110] A7, obtaining corresponding crowd positioning data by the human body recognition positioning module 30;

[0111] The crowd positioning data is a collection of positioning data of conference participants in the conference place;

[0112] The human body recognition positioning module 30 can be a visible light or thermal imaging camera module to acquire images and locate and identify conference participants through the images, or can be a pressure sensor arranged on a conference seat to determine the seat position of a conference participant and indirectly derive corresponding personnel positioning data.

[0113] A8, calculating and determining corresponding crowd center positioning data and crowd area positioning data according to the crowd positioning data;

[0114] The crowd center positioning data is the center position of the conference participants, which can be calculated and determined according to the crowd positioning data;

[0115] The crowd area positioning data is the positioning data of the area covered by the crowd positioning data.

[0116] A9, obtaining the sound source direction data of the main sound source module 10;

[0117] The sound source direction data is the direction data of the main sound emitting module 11 of the main sound source module 10, which can be acquired by the direction detection module 14.

[0118] A10, adjusting the direction of the main sound source module 10 according to the sound source direction data and the crowd center positioning data until the ray corresponding to the sound source direction data passes through the point corresponding to the crowd center positioning data;

[0119] Adjusting the direction of the main sound source module 10 until the ray corresponding to the sound source direction data passes through the point corresponding to the crowd center positioning data, that is, the main sound emitting module 11 of the main sound source module 10 is directly opposite to the crowd center by the direction adjustment module 12, so as to make all conference participants have better sound receiving effect as much as possible.

[0120] A11, determining each sound field node intensity adjustment module 20 in the corresponding area according to the crowd area positioning data and defining as an effective node adjustment module;

[0121] The effective node adjustment module is each sound field node intensity adjustment module 20 in a certain range around which there are participants.

[0122] A12, compensating for audio intensity through each effective node adjustment module;

[0123] Defining each sound field node intensity adjustment module 20 corresponding to the crowd area positioning data as an effective node adjustment module and compensating for audio intensity can avoid compensating for audio intensity of the sound field node intensity adjustment module 20 around which there are no participants, which is invalid or has weak effect.

[0124] Through the above steps, the conference environment intelligent sound field control system can obtain the position data of the conference crowd through the human body recognition positioning module, calculate the crowd center point and overall distribution area, simultaneously obtain the current orientation information of the main sound source and automatically adjust the orientation of the main sound source to ensure that the sound is directly pointed to the crowd center, provide the best sound coverage, the system can automatically identify and activate the effective sound field node adjustment module located in the area according to the crowd distribution area, only in the necessary area, targeted audio intensity compensation can improve the directional transmission efficiency of the conference sound, reduce energy waste, and at the same time ensure that no matter how the conference personnel move or redistribute, the system can adaptively adjust to maintain the best sound field experience, effectively improve the clarity and comfort of the conference communication.

[0125] Further, the step A2 includes the following steps:

[0126] A201, adjusting the orientation of the main sound source module 10 at a constant speed, playing preset positioning audio data, and determining corresponding sound source orientation data time sequence data and positioning audio playing time sequence data;

[0127] The positioning audio data is preset audio data, which can be a specific frequency sound signal emitted every fixed time;

[0128] The sound source orientation data time sequence data is a collection of sound source orientation data based on time;

[0129] The positioning audio playing time sequence data is the playing data of the sound signal in the audio data based on time when the main sound source module 10 plays the positioning audio data, that is, the collection of time data of the playing time of each sound signal.

[0130] A202, collecting positioning audio data by each of the sound field node intensity adjustment module 20 and determining corresponding positioning audio receiving intensity data and positioning audio receiving time sequence data;

[0131] The positioning audio receiving intensity data is intensity data of a sound signal received in the positioning audio data;

[0132] The positioning audio receiving time sequence data is time-based collection data of a sound signal in the positioning audio data collected by the node receiving module 21 of the sound field node intensity adjustment module 20, that is, a collection time data set of collection times of each sound signal.

[0133] A203, determining corresponding receiving time differences according to the positioning audio playing time sequence data and the positioning audio receiving time sequence data;

[0134] The receiving time difference is a time difference from emission to collection of the same sound signal in the positioning audio, which can be determined by comparing the positioning audio playing time sequence data and the positioning audio receiving time sequence data.

[0135] A204, calculating corresponding node sound source distances by multiplying the receiving time difference of each of the sound field node intensity adjustment module 20 and a preset sound speed;

[0136] The sound speed is a preset sound propagation speed, which can be set according to the environmental conditions of the conference place;

[0137] The node sound source distance is an estimated distance from the main sound source module 10 to the sound field node intensity adjustment module 20.

[0138] A205, defining a sound source facing time as a receiving time corresponding to a maximum value of the positioning audio receiving intensity data;

[0139] The sound source facing time is a time corresponding to a maximum volume value in the positioning audio receiving intensity data, indicating that the main sound source module 10 is close to facing the sound field node intensity adjustment module 20 at this time.

[0140] A206, determining corresponding node sound source facing direction data according to the sound source facing time and the sound source direction data time sequence data;

[0141] The node sound source facing direction data is direction data corresponding to the sound source facing time in the sound source direction data time sequence data.

[0142] A207, determining corresponding sound field node positioning data according to the node sound source facing direction data and the node sound source distance of each of the sound field node intensity adjustment module 20;

[0143] The sound field node positioning data is positioning data of the sound field node intensity adjustment module 20 in the conference place.

[0144] The node sound source opposite orientation data can be approximately regarded as the orientation of the sound field node intensity adjustment module 20 relative to the main sound source module 10, and in combination with the node sound source distance between the main sound source module 10 and the sound field node intensity adjustment module 20, the corresponding sound field node positioning data can be calculated.

[0145] Through the above steps, the conference environment intelligent sound field control system can play positioning audio through the uniform rotation of the main sound source, cooperate with time sequence collection and analysis, and calculate the accurate node sound source distance through the sound time difference and the sound speed, and determine the sound source opposite orientation through the analysis of the sound intensity peak, so as to obtain the spatial position relationship of all sound field nodes in the conference room without manual measurement, improve the efficiency of system deployment and calibration, and provide higher-precision spatial reference data for subsequent sound field compensation.

[0146] Further, the sound field control strategy further comprises the following steps:

[0147] B1, correcting each sample collection time in the node sound receiving intensity data according to the corresponding sound time difference of each sound field node intensity adjustment module 20 to generate node sound receiving intensity time difference correction data;

[0148] The node sound receiving intensity time difference correction data is the node sound receiving intensity data corrected by the sound time difference, so that it can be compared with the sound source intensity data. Because there is a time difference due to distance between the audio signal emitted by the main sound source module 10 and the audio signal received by the sound field node intensity adjustment module 20.

[0149] B2, calculating the corresponding audio intensity attenuation rate according to the node sound receiving intensity time difference correction data and the sound source intensity data;

[0150] The audio intensity attenuation rate is the weakening degree value of the node sound receiving intensity time difference correction data compared with the sound source intensity data, which can be determined by comparison calculation.

[0151] B3, combining the corresponding audio intensity attenuation rate and the sound field node positioning data of all the sound field node intensity adjustment modules 20 to generate corresponding sound field intensity distribution data;

[0152] The sound field intensity distribution data is the combination data of the audio intensity attenuation rate and the sound field node positioning data, which is used to reflect the audio attenuation of each sound field node intensity adjustment module 20 based on the positioning data.

[0153] B4, draw a corresponding sound field intensity distribution map according to the sound field intensity distribution data and the sound source orientation data and the sound source positioning data of the main sound source module 10.

[0154] The sound field intensity distribution map is the image sound field intensity distribution data and the sound source orientation data and the sound source positioning data, which can intuitively show the sound collection effect at different positions in the conference place and can be used for subsequent analysis and adjustment by the staff.

[0155] Through the above steps, the conference environment intelligent sound field control system can correct the time difference of the sound collection data of each sound field node, eliminate the measurement error caused by the sound wave propagation delay, then compare the corrected node sound collection intensity data with the sound source intensity data, calculate the audio intensity attenuation rate of each node, further integrate the attenuation rate and the spatial position data of all nodes, and combine the main sound source position to build a complete sound field intensity distribution map. The visual distribution map enables the conference staff to intuitively understand the sound propagation characteristics of the entire conference space, and provides a scientific basis for the optimization arrangement of the sound field nodes and the adjustment of the compensation strategy.

[0156] Further, the step A8 comprises the following steps:

[0157] A801, calculate the corresponding crowd center positioning data according to the mean value of all single positioning data in the crowd positioning data;

[0158] The single positioning data is the positioning data of each participant in the crowd positioning data.

[0159] By calculating the mean value of the single positioning data of all participants to determine the crowd center positioning data, the center of the participant crowd can be better reflected, and the influence of the scattered edge staff on the positioning of the participant crowd is reduced.

[0160] A802, calculate the corresponding single influence area data according to each single positioning data and a preset influence radius;

[0161] The influence radius is a preset value, which is used to determine the surrounding area corresponding to the single positioning data of the participant.

[0162] The single influence area data is the surrounding area of the participant, which is used to determine the range of the area that can be influenced by its sound collection.

[0163] A803, generate corresponding crowd area positioning data by combining all single influence area data;

[0164] The crowd area positioning data is a data collection of the single influence area data.

[0165] Through the above steps, the conference environment intelligent sound field control system can determine the crowd center point by calculating the average value of the positions of all participants, providing an accurate target for the main sound source direction adjustment. The system also combines the "influence radius" around each participant to construct individual sound field influence areas and combine these areas to form a complete crowd coverage area, which can accurately identify the actual distribution form and density changes of the crowd, providing precise spatial reference for subsequent sound field node activation and compensation intensity adjustment, and can improve the adaptability and sound field experience quality of the system in various dynamic conference environments.

[0166] Further, the sound field control strategy further comprises the following steps:

[0167] C1, assigning a preset node weight value to each sound field node intensity adjustment module 20;

[0168] The node weight value is the attribute value corresponding to each sound field node intensity adjustment module 20. In the initialization, a corresponding preset value can be assigned, for example, the node weight value of each sound field node intensity adjustment module 20 is assigned as 0 in the initialization.

[0169] C2, sequentially adding a preset weight step value to the node weight value of the sound field node intensity adjustment module 20 falling within the region according to each single influence area data;

[0170] The weight step value is a preset step value used for cumulative calculation of the node weight value, for example, the weight step value can be set as 1.

[0171] Each single influence area data is sequentially traversed, and the node weight value of each sound field node intensity adjustment module 20 within the range of the single influence area data is added by 1, that is, the final node weight value can reflect how many participants each sound field node intensity adjustment module 20 can affect.

[0172] C3, generating corresponding node compensation weight distribution data according to the node weight value and sound field node positioning data of each sound field node intensity adjustment module 20;

[0173] The node compensation weight distribution data is a data collection of the node weight value and sound field node positioning data of all sound field node intensity adjustment modules 20.

[0174] C4, calculating and determining the corresponding volume intensity compensation coefficient according to the audio intensity attenuation rate and node weight value of each sound field node intensity adjustment module 20.

[0175] The volume intensity compensation coefficient is a numerical value determined according to the audio intensity attenuation rate and the node weight value, and is used to determine the degree of volume compensation of the sound field node intensity adjustment module 20. By setting a suitable algorithm in combination with the node weight value of the sound field node intensity adjustment module 20 and the audio intensity attenuation rate, a reasonable volume intensity compensation coefficient can be calculated.

[0176] Through the above steps, the conference environment intelligent sound field control system can assign a basic weight value to each sound field node, and then adjust the node weight of each node according to the influence area of each participant, to form an intuitive node compensation weight distribution diagram. Further, in combination with the actual audio attenuation characteristics and dynamic weight value of each node, the corresponding volume intensity compensation coefficient is calculated, so that the system can ensure the overall sound field balance while providing more accurate sound enhancement to the key area, and providing the best listening experience for participants at different positions, thereby improving the sound transmission efficiency and communication quality in the conference environment.

[0177] Further, the sound field control strategy further comprises the following steps:

[0178] D1, according to the time difference between the sound collection, the effective node adjustment module is sorted from small to large to generate an effective node transmission sequence;

[0179] The effective node transmission sequence is the sequence of the order of the effective node adjustment module.

[0180] D2, when the main sound source module 10 collects and plays the main sound source audio data, the main sound source audio data is sequentially streamed to each effective node adjustment module through the processing control module 40 according to the effective node transmission sequence;

[0181] Because the sound transmission speed is much greater than the propagation speed of the data path, the corresponding data can be sent to the effective node adjustment module before the audio played by the main sound source module 10 propagates through the air to reach the effective node adjustment module, so that it can play the audio data synchronously when the audio propagates through the air to reach the effective node adjustment module, to realize the compensation of the sound intensity.

[0182] D3, according to the volume intensity compensation coefficient corresponding to each effective node adjustment module, the main sound source audio data is played through each effective node adjustment module after the time difference between the sound collection;

[0183] Referring to the time difference between the sound collection, the effective node adjustment module can determine the arrival time of the audio propagating through the air, to realize the compensation of the sound intensity by playing the audio data synchronously.

[0184] Through the above steps, the conference environment intelligent sound field control system can construct a reasonable audio transmission sequence by sorting the nodes according to the sound arrival time difference (i.e. sound wave propagation delay), and ensure that the audio data is sent to each node in the optimal order. When the main sound source plays audio, the system streams the audio data to each valid node according to the predetermined transmission sequence, avoiding the problem of asynchronization caused by network delay. Each node will play the audio data through its own compensation sound module according to the sound arrival time difference, ensuring the superposition of the compensation sound wave and the original sound wave in time and space, and improving the listening effect of the participants.

[0185] The above are preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any feature disclosed in the specification (including the abstract and drawings) can be replaced by other equivalent or similar features unless specifically stated. That is, each feature is only an example of a series of equivalent or similar features unless specifically stated.

Claims

1. A conference environment intelligent sound field control system, characterized in that, Comprise: A main sound source module; A plurality of sound field node intensity adjustment modules; A human body recognition positioning module; A processing control module; Wherein, the main sound source module, each sound field node intensity adjustment module and the human body recognition positioning module are respectively data connected to the processing control module; Wherein, the main sound source module comprises a main sound emitting module, a direction adjusting module, a sound source sound collecting module and a direction detecting module, the main sound emitting module and the direction detecting module are connected to the direction adjusting module, the sound source sound collecting module is connected to the main sound emitting module, and the direction adjusting module, the sound source sound collecting module and the direction detecting module are data connected to the processing control module; Wherein, the sound field node intensity adjustment module comprises a node sound collecting module, a compensation sound emitting module, a compensation intensity adjusting module and a node processing module, the node sound collecting module, the compensation sound emitting module and the compensation intensity adjusting module are data connected to the node processing module, and the node processing module is data connected to the processing control module; The conference environment intelligent sound field control system further comprises a sound field control strategy, comprising the following steps: A1, obtaining sound source positioning data corresponding to the main sound source module; A2, obtaining sound field node positioning data and node sound source distance corresponding to each sound field node intensity adjustment module; A3, collecting and playing preset main sound source audio data through the main sound source module, and obtaining corresponding sound source intensity data; A4, collecting the main sound source audio data played by the main sound source module at each sound field node intensity adjustment module to generate node received audio data, and obtaining corresponding node sound collecting intensity data; A5, calculating corresponding node sound field compensation intensity according to the node sound source distance, node sound collecting intensity data and sound source intensity data corresponding to each sound field node intensity adjustment module; A6, compensating the audio intensity through the sound field node intensity adjustment module according to the node sound source distance, node sound field compensation intensity and main sound source audio data.

2. The intelligent sound field control system for conference environment of claim 1, wherein, The sound field control strategy further comprises the following steps: A7, obtaining corresponding crowd positioning data through the human body recognition positioning module; A8, calculating and determining corresponding crowd center positioning data and crowd area positioning data according to the crowd positioning data; A9, obtaining sound source direction data of the main sound source module; A10, adjusting the orientation of the main sound source module according to the sound source direction data and the crowd center positioning data until the ray corresponding to the sound source direction data passes through the point corresponding to the crowd center positioning data; A11, determining each sound field node intensity adjustment module in the corresponding area according to the crowd area positioning data and defining as an effective node adjustment module; A12, compensating the audio intensity through each effective node adjustment module.

3. The conference environment intelligent sound field control system according to claim 2, characterized in that, Step A2 comprises the following steps: A201, uniformly adjusting the orientation of the main sound source module and playing preset positioning audio data to determine corresponding sound source direction data time series data and positioning audio playing time series data; A202, collecting positioning audio data through each sound field node intensity adjustment module and determining corresponding positioning audio sound collecting intensity data and positioning audio receiving time series data; A203, determining a corresponding sound receiving time difference according to the positioning audio playing time series data and the positioning audio receiving time series data; A204, calculating a corresponding node sound source distance by multiplying the sound receiving time difference of each sound field node intensity adjustment module and the preset sound velocity; A205, defining a sound source facing time as a sound receiving time corresponding to a maximum value of the sound receiving intensity data; A206, determining corresponding node sound source facing direction data according to the sound source facing time and the sound source direction data time series data; A207, determining corresponding sound field node positioning data according to the node sound source facing direction data and the node sound source distance of each sound field node intensity adjustment module.

4. The conference environment intelligent sound field control system of claim 3, wherein, The sound field control strategy further comprises the following steps: B1, correcting each sample collection time in the node sound receiving intensity data according to the corresponding sound receiving time difference of each sound field node intensity adjustment module to generate node sound receiving intensity time difference correction data; B2, calculating a corresponding audio intensity attenuation rate according to the node sound receiving intensity time difference correction data and the sound source intensity data; B3, combining the corresponding audio intensity attenuation rate and the sound field node positioning data of all the sound field node intensity adjustment modules to generate corresponding sound field intensity distribution data; B4, drawing a corresponding sound field intensity distribution map according to the sound field intensity distribution data and the sound source direction data and the sound source positioning data of the main sound source module.

5. The conference environment intelligent sound field control system according to claim 4, characterized in that, Step A8 comprises the following steps: A801, calculating corresponding crowd center positioning data by averaging all single positioning data in the crowd positioning data; A802, calculating corresponding single influence area data according to each single positioning data and a preset influence radius; A803, combining all single influence area data to generate corresponding crowd area positioning data.

6. The intelligent sound field control system for conference environment of claim 5, wherein, The sound field control strategy further comprises the following steps: C1, assigning a preset node weight value to each sound field node intensity adjustment module; C2, sequentially adding a preset weight step value to the node weight value of the sound field node intensity adjustment module falling into the area according to each single influence area data; C3, combining the node weight value and the sound field node positioning data of each sound field node intensity adjustment module to generate corresponding node compensation weight distribution data; C4, calculating and determining a corresponding volume intensity compensation coefficient according to the audio intensity attenuation rate and the node weight value of each sound field node intensity adjustment module.

7. The intelligent sound field control system for conference environment of claim 6, wherein, The sound field control strategy further comprises the following steps: D1, sorting each effective node adjustment module from small to large according to the sound receiving time difference to generate an effective node transmission sequence; D2, sequentially streaming the main sound source audio data to each effective node adjustment module through the processing control module according to the effective node transmission sequence when the main sound source module collects and plays the main sound source audio data; D3, playing the main sound source audio data through each effective node adjustment module after the time length of the sound receiving time difference according to the corresponding volume intensity compensation coefficient of each effective node adjustment module.

Images