Conference room audio and video light control system

Abstract

The invention relates to the technical field of intelligent control, in particular to a conference room audio and video light control system. Comprising an audio and video acquisition module, an audio control module, a video control module and a light control module, the audio and video acquisition module is used for acquiring audio and video signals and performing primary audio and video processing; the audio control module analyzes each audio signal to obtain a conference audio evaluation value, and automatically adjusts audio setting to adapt to different conference scenes; the video control module comprehensively analyzes the video image to obtain a conference video evaluation value, and optimizes and adjusts the image quality according to the conference video evaluation value; the light control module adjusts the light environment of the conference room according to the light control value; the audio and video lamplight is automatically adjusted, the complexity of manual operation is reduced, the visual experience, comfort and efficiency of a conference are improved, and the participation sense and interactivity of the conference are enhanced.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent control, and particularly to an audio-video and lighting control system for a meeting room. Background Art

[0002] Audio-video and lighting control is a tool to enhance the meeting experience, playing a crucial role in modern enterprises and institutions. It greatly improves the efficiency, comfort, and safety of meetings, while reducing manual intervention through intelligent and automated means and lowering the operation complexity. In addition, good system integration also helps enhance the corporate image, support remote collaboration and cross-regional cooperation, conforming to the trend of modern intelligent office.

[0003] Although the audio-video and lighting control system in the meeting room has played an important role in enhancing the meeting experience, there are still some deficiencies and defects in practical applications. The automatic adjustment of audio, video, and lighting may not fully meet the actual needs of users. For example, automatically increasing the volume or adjusting the lighting may be excessive or insufficient. Especially during the meeting, some participants may feel that the volume is slightly high or the lighting is a bit dazzling, while the system may be difficult to recognize this slight difference. In some meeting systems, there is a certain delay in the adjustment of audio, video, and lighting, resulting in the inability to optimize and adjust the unsatisfactory settings in a timely manner during the meeting. This lag in response not only affects the meeting experience but also may make users feel the operation is not smooth, thus reducing the overall meeting efficiency. Summary of the Invention

[0004] Therefore, the present invention provides an audio-video and lighting control system for a meeting room to overcome the problems mentioned in the above background art.

[0005] To achieve the above object, the present invention provides an audio-video and lighting control system for a meeting room, including: an audio control module, a video control module, and a lighting control module;

[0006] The audio control module analyzes each audio signal to obtain a meeting audio evaluation value and automatically adjusts the audio settings to adapt to different meeting scenarios;

[0007] The video control module comprehensively analyzes the video images to obtain a meeting video evaluation value and optimizes and adjusts the image quality according to the meeting video evaluation value to ensure clear and stable images;

[0008] The lighting control module adjusts the lighting environment of the meeting room according to the lighting control value to enhance the comfort and atmosphere; the specific steps are as follows:

[0009] Obtain the current conference audio evaluation value Yi and the current conference video evaluation value Pi; substitute the values of the current conference audio evaluation value Yi and the current conference video evaluation value Pi into the formula Gi = β1×Yi + β2×Pi to calculate the current lighting control value Gi, where β1 and β2 are the set weight factors respectively;

[0010] Set that there are several lighting interaction scenarios, and each lighting interaction scenario corresponds to a lighting control interval respectively; compare the current lighting control value with the lighting control interval to obtain the current lighting interaction scenario; when the lighting control value is in the higher interval, it means that the conference audio - video quality is good, and a brighter and more prominent lighting mode is selected; when the lighting control value Gi is in the median interval, select a moderate brightness setting to ensure that participants can clearly see each other and it is not too bright or too dark; when the lighting control value is in the low interval, select a soft lighting scenario; when in the conference mode, enhance the overall brightness to ensure that the meeting room is bright and clear, and adjust the lighting angle to ensure that the meeting table and the faces of the participants are illuminated; when in the speech mode, enhance the brightness of the speech area to highlight the position of the speaker, and adjust the lighting color to a clear, bright white or cold tone; when in the break mode, reduce the brightness to a low level to create a quiet and comfortable atmosphere, and adjust the lighting color to a soft and warm tone.

[0011] As a preferred embodiment of the present invention, it further includes an audio - video acquisition module, specifically:

[0012] The audio - video acquisition module is used to collect audio and video signals from various sensors, microphone arrays and camera devices in the meeting room, and perform preliminary audio - video processing; the preliminary audio processing includes noise reduction and echo cancellation; the video signal is optimized by a digital signal processor and the image clarity is enhanced.

[0013] As a preferred embodiment of the present invention, the specific analysis of the conference audio evaluation value is:

[0014] The meeting room is divided into four corners and the center, which are used as measurement points. The background noise intensity is collected at each point, and the current average background noise Bi is obtained by calculating the mean value of the noise intensities at these measurement points, where i = 1, 2, 3... I, I takes positive integer values, I represents the total number of acquisition times, and i represents the serial number of any one acquisition time; The Gaussian Mixture Model (GMM) and spectral entropy threshold method are used to detect the current speech activity level, which is marked as Hi, where HI represents the current speech activity state, with 1 indicating speech activity and 0 indicating no speech activity; The Generalized Cross-Correlation (GCC) peak localization method is used to obtain the azimuth angle of the current sound source by calculating the time difference between microphone arrays, which is marked as Di, where Di represents the azimuth angle of the current sound source relative to the microphone array; The THD+N (Total Harmonic Distortion plus Noise) analysis method is used to calculate the nonlinear distortion degree in the current audio signal, which is marked as Fi, where Fi represents the distortion degree of the current signal;

[0015] Substitute the values of the current speech activity level Hi, sound source azimuth angle Di, nonlinear distortion degree Fi, and current average background noise Bi into the formula Calculate to obtain the meeting audio evaluation value Yi, where e is the natural constant, and α1, α2, α3, and α4 are respectively set weight factors, and send the meeting audio evaluation value to the lighting control module;

[0016] Set several preset scenarios for the meeting room. Use keyword recognition technology to automatically recognize specific voice commands through speech recognition or audio analysis to trigger the corresponding preset scenarios.

[0017] As a preferred implementation manner of the present invention, the specific analysis of the meeting video evaluation value is as follows:

[0018] Calculate the overall brightness of the video image in the meeting room through histogram analysis, which is marked as Li; Substitute the values of the sharpening intensity Qi, backlight brightness Li, and background noise Bi of the video image into the formula Calculate to obtain the meeting video evaluation value Pi, where α7, α8, and α9 are respectively set weight factors, and send the meeting video evaluation value to the lighting control module;

[0019] Set a meeting video evaluation threshold, and compare and analyze the meeting video evaluation value with the set meeting video evaluation threshold; When the meeting video evaluation value is less than the set meeting video evaluation threshold, it indicates that the current video image quality is poor, and automatically enhance the sharpening intensity, optimize the backlight brightness, and reduce noise to improve the image quality; When the meeting video evaluation value is greater than or equal to the set meeting video evaluation threshold, it means that the current image quality is already in the best state, and keep the existing video settings to ensure that the video output quality is in the best state.

[0020] As a preferred embodiment of the present invention, the specific analysis of the video image sharpening intensity is as follows:

[0021] Use a face detection algorithm to detect the face area in the conference room video image, calculate the area ratio of the face area in the image to obtain the occupancy ratio of the face area, and mark the occupancy ratio of the conference room face area as Ri; calculate the motion blur degree of the current frame video image by the inter-frame difference method and mark the motion blur degree as Mi; it should be noted that the motion blur degree reflects the motion effect in the video image and is usually used to detect whether the image is clear, especially the blur degree in a dynamic scene. The specific method is to compare the pixel differences between the current frame and the previous frame. A larger difference indicates a higher motion blur degree of the image, and the unit is pixels / second; substitute the values of the face area occupancy ratio Ri and the motion blur degree Mi into the formula Calculate the sharpening intensity Qi of the video image, where α5 and α6 are respectively set weight factors.

[0022] Advantages of the present invention:

[0023] 1. Through multiple technologies such as audio evaluation, noise suppression, echo cancellation, and keyword recognition to trigger scenarios, it can provide clear and interference-free audio effects, and automatically adjust audio parameters according to the meeting process, which not only improves the audio quality experience of the meeting, but also makes the meeting management more intelligent and automated, greatly enhancing the user experience and meeting efficiency.

[0024] 2. By dynamically adjusting image sharpening, backlight brightness, and noise control, it ensures that the video image is always clear and stable under different environmental conditions; by real-time analyzing parameters such as the occupancy ratio of the face area, motion blur degree, and backlight brightness in the image, it can quickly detect whether the video quality meets the requirements; by automatically adjusting the video quality, it reduces the complexity of manual operations, enabling participants not to worry about image quality issues and allowing them to focus on the meeting content.

[0025] 3. By automatically adjusting the lighting, it ensures that the meeting environment is always in the best state, improving the visual experience, comfort, and efficiency of the meeting; at the same time, the module can intelligently adjust the lighting settings according to the meeting needs, enhancing the interactivity and personalization of the meeting, and greatly improving the intelligent level of the system and the sense of participation in the meeting. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a schematic diagram of the connection of the system modules of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0027] In order to make the objectives and advantages of the present invention more clearly understood, the present invention will be further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only for explaining the present invention and are not used to limit the present invention.

[0028] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention and do not limit the protection scope of the present invention.

[0029] It should be noted that in the description of the present invention, the terms indicating directions or positional relationships such as "upper", "lower", "left", "right", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings. This is only for the convenience of description and does not indicate or imply that the device or component must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention.

[0030] In addition, it should also be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installation", "connection", and "connection" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

[0031] Please refer to Figure 1 As shown, the present invention is a conference room audio-video lighting control system, including: an audio-video acquisition module, an audio control module, a video control module, and a lighting control module;

[0032] The audio-video acquisition module is used to collect audio and video signals from various sensors, microphone arrays, and camera devices in the conference room and perform preliminary audio-video processing; the preliminary audio processing includes noise reduction and echo cancellation; the video signal is optimized by a digital signal processor (DSP) and the image clarity is enhanced;

[0033] The audio control module analyzes each audio signal to obtain a conference audio evaluation value and automatically adjusts the audio settings to adapt to different conference scenarios; the specific steps are as follows:

[0034] Divide the meeting room into four corners and the center and use them as measurement points. Collect the background noise intensity at each point respectively, and calculate the current average background noise Bi by calculating the mean value of the noise intensity at these measurement points, where i = 1, 2, 3... I, I takes positive integer values, I represents the total number of acquisition times, and i represents the serial number of any one acquisition time; Use the Gaussian Mixture Model (GMM) model and the spectral entropy threshold method to detect the current speech activity level and mark it as Hi, where HI represents the current speech activity state, set 1 to represent speech activity, and 0 to represent no speech activity; Use the Generalized Cross-Correlation (GCC) peak localization method to obtain the azimuth angle of the current sound source by calculating the time difference between microphone arrays, and mark it as Di, where Di represents the azimuth angle of the current sound source relative to the microphone array; Use the THD+N (Total Harmonic Distortion plus Noise) analysis method to calculate the nonlinear distortion degree in the current audio signal and mark it as Fi, where Fi represents the distortion degree of the current signal;

[0035] Substitute the values of the current speech activity level Hi, the azimuth angle of the sound source Di, the nonlinear distortion degree Fi, and the current average background noise Bi into the set formula Calculate to obtain the meeting audio evaluation value Yi, where e is the natural constant, and α1, α2, α3, and α4 are the set weight factors respectively; It can be seen from the formula that the larger the value of the speech activity level, the larger the audio evaluation value; When the sound source position is closer to the due front (90 degrees) of the microphone array, the audio evaluation value is larger; When the nonlinear distortion degree is smaller, the audio evaluation value is larger; The smaller the current average background noise, the larger the audio evaluation value; And send the meeting audio evaluation value to the lighting control module;

[0036] Set several preset scenarios for the meeting room. Use keyword recognition technology to automatically recognize specific voice commands through speech recognition or audio analysis and trigger the corresponding preset scenarios; When the microphone detects the voice command "Meeting start", the system will enter the meeting mode and adjust the audio settings to the best meeting state. The specific operations in the meeting mode include: increasing the volume of the microphone input to ensure that the sound covers the entire meeting room. The gain and output volume of the audio input can be adjusted to ensure clear and balanced audio; Automatically adjust the microphone gain to make the speech clearly audible and avoid too low volume or distortion due to distance problems; Enable the noise suppression module to eliminate background noise, especially the noise that may be generated during the meeting (such as air conditioners, fans, etc.); Start the echo cancellation algorithm to ensure that there is no echo or reverberation in the signals input by multiple microphones; Automatically adjust the frequency response and parameter settings of the audio system according to the optimized configuration preset in the meeting mode to ensure the best auditory experience;

[0037] When the microphone detects the "break" command, the system will enter the break mode and automatically adjust the audio settings to mute or low volume to avoid interference during the continuation of the meeting; the specific operations in the break mode include: reducing the volume to a suitable low level or directly muting the audio. At this time, the audio system should minimize the output volume to ensure that participants are not disturbed during the break; according to the meeting requirements, other preset scenarios can also be set, such as the presentation mode: when a command such as "start presentation" is detected, the audio system is automatically set to the optimized presentation mode to enhance the clarity of the speaker's voice and automatically focus on the microphone input of the main speaker.

[0038] Through a number of technologies such as audio evaluation, noise suppression, echo cancellation, and keyword recognition to trigger scenarios, it can provide clear and interference-free audio effects and automatically adjust audio parameters according to the meeting process, which not only improves the audio quality experience of the meeting but also makes the meeting management more intelligent and automated, greatly enhancing the user experience and meeting efficiency.

[0039] The video control module obtains the meeting video evaluation value through comprehensive analysis of the video image and optimizes and adjusts the image quality according to the meeting video evaluation value to ensure that the image is clear and stable; the specific steps are as follows:

[0040] Use the face detection algorithm to detect the face area in the meeting room video image, calculate the area ratio of the face area in the image to obtain the face area ratio, and mark the face area ratio of the meeting room as Ri; calculate the motion blur degree of the current frame video image through the frame difference method and mark the motion blur degree as Mi; it should be noted that the motion blur degree reflects the motion effect in the video image and is usually used to detect whether the image is clear, especially the blur degree in dynamic scenes. The specific method is to compare the pixel differences between the current frame and the previous frame. A larger difference indicates a higher motion blur degree of the image, with the unit of pixel / second; substitute the values of the face area ratio Ri and the motion blur degree Mi into the set formula Calculate the sharpness intensity Qi of the video image, where α5 and α6 are respectively the set weight factors; calculate the overall brightness of the video image in the meeting room through histogram analysis and mark it as Li; substitute the values of the sharpness intensity Qi, backlight brightness Li, and background noise Bi of the video image into the set formula Calculate the meeting video evaluation value Pi, where α7, α8, and α9 are respectively the set weight factors; it can be seen from the formula that the higher the sharpness intensity of the video image, the higher the video evaluation value, indicating better video quality and clearer and more stable images; the higher the backlight brightness of the video image, the higher the video evaluation value, indicating better video quality and better image lighting conditions; the lower the noise, the higher the video evaluation value; and send the meeting video evaluation value to the lighting control module.

[0041] Set a meeting video evaluation threshold, and compare and analyze the meeting video evaluation value with the set meeting video evaluation threshold; when the meeting video evaluation value is less than the set meeting video evaluation threshold, it indicates that the current video image quality is poor, and the sharpness intensity is automatically enhanced, the backlight brightness is optimized, and the noise is reduced to improve the image quality. Taking 3% as one gear, 6% and 9% as the second and third gears, recalculate the meeting video evaluation value after adjusting one gear and compare and analyze it again. If the meeting video evaluation value is still less than the set meeting video evaluation threshold, adjust the amplitude of the third gear to improve the image quality; when the meeting video evaluation value is greater than or equal to the set meeting video evaluation threshold, it means that the current image quality is already in the best state, and the existing video settings are maintained to ensure that the video output quality is in the best state;

[0042] By dynamically adjusting image sharpness, backlight brightness, and noise control, ensure that the video image is always clear and stable under different environmental conditions; by real-time analyzing parameters such as the proportion of the face area, motion blur degree, and backlight brightness in the image, it can quickly detect whether the video quality meets the requirements; by automatically adjusting the video quality, the complexity of manual operation is reduced, enabling participants not to worry about image quality issues and allowing them to focus on the meeting content;

[0043] The lighting control module adjusts the lighting environment of the meeting room according to the lighting control value to improve comfort and atmosphere; the specific steps are as follows:

[0044] Obtain the current meeting audio evaluation value Yi and the current meeting video evaluation value Pi; substitute the values of the current meeting audio evaluation value Yi and the current meeting video evaluation value Pi into the set formula Gi = β1×Yi + β2×Pi to calculate the current lighting control value Gi, where β1 and β2 are the set weight factors respectively; as can be seen from the formula, the larger the meeting audio evaluation value, the better the audio quality in the meeting environment, and the larger the lighting control value; the larger the meeting video evaluation value, the better the video quality in the meeting environment, and the larger the lighting control value;

[0045] It is assumed that there are several lighting interaction scenarios, and each lighting interaction scenario corresponds to a lighting control range; the current lighting control value is compared with the lighting control range to obtain the current lighting interaction scenario; when the lighting control value Gi is in the higher range, it indicates that the conference audio and video quality is good, and a brighter and more prominent lighting mode is selected; when the lighting control value Gi is in the middle range, a moderate brightness setting is selected to ensure that participants can clearly see each other without being too bright or too dark; when the lighting control value Gi is in the lower range, a soft lighting scenario is selected, such as the rest mode; when in the conference mode, the overall brightness is enhanced to ensure that the meeting room is bright and clear, and the lighting angle is adjusted to ensure that the conference table and the faces of the participants are illuminated; when in the presentation mode, the brightness of the presentation area is enhanced to highlight the position of the speaker, and the lighting color is adjusted to a clear, bright white or cold tone; when in the rest mode, the brightness is reduced to a low level to create a quiet and comfortable atmosphere, and the lighting color is adjusted to a soft, warm tone;

[0046] By automatically adjusting the lighting, it is ensured that the conference environment is always in the best state, improving the visual experience, comfort and efficiency of the conference; at the same time, the module can intelligently adjust the lighting settings according to the conference needs, enhancing the interactivity and personalization of the conference, and greatly improving the intelligent level of the system and the sense of participation in the conference;

[0047] So far, the technical solution of the present invention has been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will all fall within the protection scope of the present invention.

[0048] The above are only the preferred embodiments of the present invention and are not used to limit the present invention; for those skilled in the art, the present invention can have various changes and modifications. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A conference room audio-visual lighting control system, comprising an audio control module, a video control module, and a lighting control module; characterized in that, The audio control module analyzes each audio signal to obtain a conference audio evaluation value, and automatically adjusts the audio settings to adapt to different conference scenarios; The video control module comprehensively analyzes the video images to obtain a conference video evaluation value, and optimizes and adjusts the image quality according to the conference video evaluation value; The lighting control module adjusts the lighting environment of the meeting room according to the lighting control value. Specifically: obtain the current conference audio evaluation value and the current conference video evaluation value; normalize the values of the current conference audio evaluation value and the current conference video evaluation value to obtain the current lighting control value; set that there are several lighting interaction scenarios, and each lighting interaction scenario corresponds to a lighting control interval respectively; compare the current lighting control value with the lighting control interval to obtain the current lighting interaction scenario; When the lighting control value is in the higher interval, select a brighter and more prominent lighting mode; when the lighting control value is in the middle interval, select a moderate brightness setting without being too bright or too dark; when the lighting control value is in the lower interval, select a soft lighting scene; when in the conference mode, enhance the overall brightness and adjust the lighting angle; when in the speech mode, enhance the brightness of the speech area, and adjust the lighting color to a clear, bright white or cold color; when in the rest mode, reduce the brightness to a low level, and adjust the lighting color to a soft, warm color.

2. The audio-video lighting control system for a meeting room according to claim 1, characterized in that, It also includes an audio - video acquisition module. The audio - video acquisition module collects audio and video signals from various sensors, microphone arrays and camera devices in the meeting room, and performs preliminary audio - video processing; the preliminary audio processing includes noise reduction and echo cancellation; the video signal is optimized by a digital signal processor and the image clarity is enhanced.

3. The audio-video lighting control system for a meeting room according to claim 1, wherein, The specific analysis process of the conference audio evaluation value is as follows: Divide the meeting room into four corners and the center and use them as measurement points. Collect the background noise intensity at each measurement point respectively, and calculate the mean value through the noise intensity of the measurement points to obtain the current average background noise; Use the Gaussian mixture model and the spectral entropy threshold method to detect the current speech activity; Use the generalized cross - correlation peak localization method to obtain the azimuth angle of the current sound source relative to the microphone array by calculating the time difference between microphone arrays; use the THD+N analysis method to calculate the nonlinear distortion degree in the current audio signal; Process the values of the current speech activity, sound source azimuth angle, nonlinear distortion degree and the current average background noise to obtain the conference audio evaluation value, and send it to the lighting control module; Set that there are several preset scenarios for the meeting room, and use keyword recognition technology to automatically recognize specific voice commands through speech recognition or audio analysis to trigger the corresponding preset scenarios.

4. A conference room audio-visual lighting control system according to claim 1, characterized in that, The specific analysis of the conference video evaluation value is: Calculate the overall brightness of the video image in the meeting room through histogram analysis; process the values of the sharpening intensity, backlight brightness, and background noise of the video image to obtain the meeting video evaluation value and send it to the lighting control module; compare and analyze the meeting video evaluation value with the set meeting video evaluation threshold; when the meeting video evaluation value is less than the set meeting video evaluation threshold, automatically enhance the sharpening intensity, optimize the backlight brightness, and reduce noise; when the meeting video evaluation value is greater than or equal to the set meeting video evaluation threshold, maintain the existing video settings.

5. The audio-video lighting control system for a meeting room according to claim 4, characterized in that The specific analysis of the sharpening intensity of the video image is as follows: Use the face detection algorithm to detect the face area in the meeting room video image, calculate the area ratio of the face area in the image to obtain the proportion of the face area; calculate the motion blur of the current frame video image through the inter-frame difference method and mark the motion blur; normalize the values of the face area proportion and the motion blur to obtain the sharpening intensity of the video image.

Images