Method and system for realizing multimedia conference

Optimizing the multimedia conference system through identity authentication, encryption processing and sentiment analysis, solving the problems of signing, data security and atmosphere, and improving the security, efficiency and user experience of the conference.

CN119094504AInactive Publication Date: 2024-12-06QINGDAO DOUCHUN TECHNOLOGY DEVELOPMENT CO LTD

Patent Information

Application Number
CN202411190353.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-28
Publication Date
2024-12-06
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

There are problems in multimedia conferences such as signing and data transmission security and imperfect conference atmosphere, which affects the authenticity and efficiency of the conference.

Method used

By authenticating the logged-in user and verifying the qualifications of the conference, we ensure that only legal users participate in the conference and encrypt the conference audio and video data stream; at the same time, we use infrared cameras to identify face activity to obtain participant level information for accurate results Control; optimize the conference atmosphere through real-time emotional state analysis and data visualization.

Benefits of technology

It effectively prevents illegal user login and data leakage, ensures the security and proprietaryness of the meeting, improves the organizational efficiency and user experience of the meeting, improves the meeting atmosphere, and improves the sense of participation and satisfaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119094504A_ABST
    Figure CN119094504A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of multimedia conferences, in particular to an implementation method and system based on a multimedia conference. The method comprises the following steps: carrying out identity verification on user login information obtained in a multimedia conference network environment through a preset identity auditing database, carrying out conference participation qualification verification on login users by using an infrared camera, obtaining conference participant grade information and carrying out grade classification on conference participants to obtain conference participant login permissions, and sending the conference participant login permissions to the multimedia conference network environment; entering a corresponding conference operation interface; performing multi-channel transmission on the obtained conference real-time audio and video data stream to obtain a fast transmission data stream; the conference operation interface is intelligently adjusted and optimized based on the fast transmission data; meanwhile, according to the obtained subjective perception signal set of the participants, an emotional fluctuation map is drawn, and an emotional fluctuation map is obtained; and performing atmosphere optimization adjustment on the optimized conference interface based on the emotional fluctuation map to obtain a conference atmosphere optimization effect. According to the invention, the security and participation sense of the conference can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of multimedia conferences, and in particular to an implementation method and system based on multimedia conferences. Background Art

[0002] In an era of increasing digitalization and networking, multimedia conferences have become an important tool for the daily operations of enterprises, education departments, and government departments. However, with widespread application, multimedia conferences also face many challenges, especially in terms of data transmission security and conference atmosphere optimization. Multimedia conferences have the problem of signing in on behalf of participants when they enter the meeting, which affects the authenticity of the meeting. It is particularly important to ensure the safe and complete transmission of data when conducting conference screen presentations and remote conference participation. At the same time, there is often a lack of effective mechanisms to dynamically adjust the atmosphere of the meeting. Therefore, traditional multimedia conferences have problems with signing in on behalf of others, data transmission security, and imperfect conference atmosphere. Summary of the invention

[0003] Based on this, it is necessary for the present invention to provide a method and system for implementing a multimedia conference to solve at least one of the above technical problems.

[0004] To achieve the above object, a method for implementing a multimedia conference includes the following steps:

[0005] Step S1: collecting login information of a login user in a multimedia conference network environment to obtain user login information; authenticating the user login information through a preset identity audit database to obtain an identity authentication result, wherein the identity authentication result includes whether the login user does not exist or whether the login user exists;

[0006] Step S2: When it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the login qualification of the logged-in user is verified by using an infrared camera, and the level information of the participants is obtained to classify the participants, and the login authority of the participants is obtained to enter the corresponding conference operation interface;

[0007] Step S3: obtaining the real-time audio and video data stream of the conference, and encrypting the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; performing exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain an optimized channel; performing multi-channel transmission on the encrypted secure data stream based on the optimized channel to obtain a fast transmission data stream; decrypting the fast transmission data stream to obtain a decrypted secure data stream; intelligently tuning the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface;

[0008] Step S4: Obtain a set of subjective perception signals of the participants, and perform real-time emotional state analysis based on the set of subjective perception signals of the participants to obtain the real-time emotional state of the participants; draw an emotional fluctuation map based on the real-time emotional state of the participants to obtain an emotional fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotional fluctuation map to obtain an optimized conference atmosphere effect.

[0009] The present invention firstly collects login information of the logged-in users in the multimedia conference network environment, and can accurately obtain the identity information of each participant. The key to this step is to use a preset identity audit database to authenticate the user, so as to ensure that only legitimate users can log in. This measure effectively solves the problem of illegal user login, that is, to ensure that only real and registered users can log in, and prevent the abuse of false identities. Secondly, for the case where the identity authentication result is that the logged-in user does not exist, a prompt of "logged-in user does not exist" will be directly displayed, so that unauthorized users can be prevented from trying to log in in time, thereby ensuring the security and effectiveness of the meeting. When the user exists, the login user is further verified by using face active recognition technology to participate in the meeting, effectively ensuring that only real and qualified users can participate in the meeting. The key to this step is that the infrared camera can be used to perform active face recognition on real faces and static resources, which has a significant effect in preventing the problem of proxy signing. At the same time, the level information of the participants is obtained and the level classification is performed, ensuring that the participants enter the corresponding conference operation interface according to their level, thereby realizing accurate control of users with different permissions. This method not only improves the efficiency of conference organization, but also ensures the exclusivity and privacy of conference content. According to the identity level and authority of the participants, the corresponding interface is set, so that users at different levels can access the functions and information of corresponding authority, and optimize the user experience and the flexibility of conference management. This process can also reduce potential security risks in the meeting, such as unauthorized access or information leakage, thereby providing higher protection for the smooth progress of the meeting. Then, obtaining and encrypting the real-time audio and video data stream of the meeting is a basic measure to ensure the security of conference data. Encryption effectively prevents the data from being intercepted or tampered during transmission, ensuring the confidentiality and integrity of the conference content. The exploration domain optimization of the multimedia conference wireless network channel in the conference operation interface can find the best channel in the network, thereby reducing signal interference and improving network transmission efficiency. Multi-channel transmission based on the optimized channel effectively improves the speed and stability of data transmission, so that real-time audio and video data can be smoothly transmitted to the participant end, avoiding conference interruption or jamming caused by data transmission problems. By decrypting the fast-transmitted data, the original data can be restored and intelligently tuned, thereby optimizing the display effect and operation response speed of the conference interface. This series of processing measures effectively solved the security and efficiency issues in the data transmission process and ensured the smoothness and security of the meeting.Finally, obtaining the subjective perception signal set of the participants and conducting real-time emotional state analysis can instantly understand the emotional reactions of the participants. This measure can timely grasp the atmosphere of the meeting and provide data support for further optimization. Drawing an emotional fluctuation map based on the real-time emotional state of the participants is helpful for visual analysis of the emotional change trends of the participants. Drawing this map can help the conference organizer identify the time periods or links with large emotional fluctuations, so as to adjust the meeting process. Based on the emotional fluctuation map, the atmosphere of the optimized conference interface can be optimized and adjusted. The interface content, layout and interaction methods can be adjusted in time according to the emotional state of the participants to enhance the sense of participation and satisfaction of the meeting. This process effectively improves the overall atmosphere of the meeting, making the meeting more in line with the emotional needs and interaction habits of the participants, thereby improving the interactivity and effectiveness of the meeting.

[0010] Preferably, the present invention further provides a multimedia conference system for executing the above-mentioned multimedia conference implementation method, the multimedia conference system comprising:

[0011] User identity authentication module: used to collect login information of logged-in users in the multimedia conference network environment to obtain user login information; authenticate the user login information through a preset identity audit database to obtain an identity authentication result, wherein the identity authentication result includes whether the logged-in user does not exist or whether the logged-in user exists;

[0012] Participant identification and grading module: when the identity authentication result is that the logged-in user does not exist, it will be displayed that the logged-in user does not exist; when the identity authentication result is that the logged-in user exists, the infrared camera will be used to verify the login qualifications of the logged-in user, and the participant level information will be obtained to classify the participants, and the participant login authority will be obtained to enter the corresponding conference operation interface;

[0013] Conference optimization module: used to obtain the real-time audio and video data stream of the conference, and encrypt the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; perform exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain an optimized channel; perform multi-channel transmission of the encrypted secure data stream based on the optimized channel to obtain a fast transmission data stream; perform decryption processing on the fast transmission data stream to obtain a decrypted secure data stream; perform intelligent tuning of the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface;

[0014] Atmosphere optimization module: used to obtain the subjective perception signal set of the participants, and perform real-time emotional state analysis based on the subjective perception signal set of the participants to obtain the real-time emotional state of the participants; draw an emotional fluctuation map based on the real-time emotional state of the participants to obtain an emotional fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotional fluctuation map to obtain the conference atmosphere optimization effect.

[0015] In summary, the present invention provides a multimedia conference system, which consists of a user identity authentication module, a participant identification and classification module, a conference optimization module, and an atmosphere optimization module, which effectively solves the problems of proxy signing, data transmission security, and conference atmosphere optimization in the conference system. By ensuring that only authorized users can participate in the conference, protecting the security of data transmission, and optimizing the conference atmosphere, the security, efficiency, and user experience of the conference are greatly improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments thereof made with reference to the following drawings:

[0017] Figure 1 A schematic diagram of the steps of the method for implementing the multimedia conference of the present invention;

[0018] Figure 2 for Figure 1 Detailed step flow diagram of step S2;

[0019] Figure 3 for Figure 2 Detailed step flow chart of step S21 in FIG. DETAILED DESCRIPTION

[0020] The following is a clear and complete description of the technical method of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by technicians in this field without creative work are within the scope of protection of the present invention.

[0021] In addition, the accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. The functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor methods and / or microcontroller methods.

[0022] It should be understood that, although the terms "first", "second", etc. may be used herein to describe various units, these units should not be limited by these terms. These terms are used only to distinguish one unit from another unit. For example, without departing from the scope of the exemplary embodiments, the first unit may be referred to as the second unit, and similarly the second unit may be referred to as the first unit. The term "and / or" used herein includes any and all combinations of one or more of the listed associated items.

[0023] To achieve this, please refer to Figures 1 to 3 The present invention provides a method for implementing a multimedia conference, the method comprising the following steps:

[0024] Step S1: collecting login information of a login user in a multimedia conference network environment to obtain user login information; authenticating the user login information through a preset identity audit database to obtain an identity authentication result, wherein the identity authentication result includes whether the login user does not exist or whether the login user exists;

[0025] Step S2: When it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the login qualification of the logged-in user is verified by using an infrared camera, and the level information of the participants is obtained to classify the participants, and the login authority of the participants is obtained to enter the corresponding conference operation interface;

[0026] Step S3: obtaining the real-time audio and video data stream of the conference, and encrypting the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; performing exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain an optimized channel; performing multi-channel transmission on the encrypted secure data stream based on the optimized channel to obtain a fast transmission data stream; decrypting the fast transmission data stream to obtain a decrypted secure data stream; intelligently tuning the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface;

[0027] Step S4: Obtain a set of subjective perception signals of the participants, and perform real-time emotional state analysis based on the set of subjective perception signals of the participants to obtain the real-time emotional state of the participants; draw an emotional fluctuation map based on the real-time emotional state of the participants to obtain an emotional fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotional fluctuation map to obtain an optimized conference atmosphere effect.

[0028] In the embodiment of the present invention, please refer to Figure 1 FIG. 1 is a schematic diagram of a step flow chart of a method for implementing a multimedia conference according to the present invention. In this example, the steps of the method for implementing a multimedia conference include:

[0029] Step S1: collecting login information of a login user in a multimedia conference network environment to obtain user login information; authenticating the user login information through a preset identity audit database to obtain an identity authentication result, wherein the identity authentication result includes whether the login user does not exist or whether the login user exists;

[0030] The embodiment of the present invention obtains the user's login information through the user login interface embedded in the meeting. The user enters the user name and password on the login interface, and sends the input data to the background server through an encrypted transmission protocol. The background server is configured to receive and store these data, including the user name, password, IP address, and login time information. All data transmission and storage use the AES-256 encryption algorithm to ensure the security and integrity of the data. After receiving the user login information, the background server extracts the user name and password from the login data. The server performs identity authentication by accessing a preset identity audit database (for example, using a relational database management system such as MySQL and PostgreSQL). The identity audit database contains a user account information table, which records the detailed information of registered users, such as the user name, the encrypted password hash value, and other necessary user attributes. The background server first queries the identity audit database to verify the existence of the user name. If the user name is not found in the database, the authentication result that the login user does not exist will be returned.

[0031] Step S2: When it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the login qualification of the logged-in user is verified by using an infrared camera, and the level information of the participants is obtained to classify the participants, and the login authority of the participants is obtained to enter the corresponding conference operation interface;

[0032] The embodiment of the present invention receives the identity authentication result returned by the server, and ensures that the data in the transmission process is not tampered with through a secure encrypted data transmission protocol, such as TLS (Transport Layer Security). If the verification result shows that the logged-in user does not exist, the system will display a prompt message that the logged-in user does not exist through the Web interface. For users who pass the verification, the system will activate the infrared camera, use the liveness detection technology to perform face activity recognition, use the face detection module assisted by OpenCV and Dlib machine learning libraries, and combine the deep learning framework TensorFlow or PyTorch to perform real-time analysis of user facial features to ensure that the participants are real users and prevent photo or video fraud. After completing the activity detection, query the background database to verify the user's eligibility to attend the meeting. This process uses fast database query technology, such as index search or hash search, to minimize response time. Users are classified according to the level information recorded by the user in the database, such as guests, speakers, and audiences. Each category corresponds to a conference operation interface with different access rights and conference functions.

[0033] Step S3: obtaining the real-time audio and video data stream of the conference, and encrypting the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; performing exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain an optimized channel; performing multi-channel transmission on the encrypted secure data stream based on the optimized channel to obtain a fast transmission data stream; decrypting the fast transmission data stream to obtain a decrypted secure data stream; intelligently tuning the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface;

[0034] The embodiment of the present invention obtains the real-time audio and video data stream of the conference. These data streams can be captured by the camera and microphone modules in the integrated multimedia conference system. The data stream format is H.264 video encoding and AAC audio encoding. The obtained data stream is encrypted by the encryption module, and the data stream is encrypted by AES-256 to ensure the security of the data during transmission. This process involves sending the original data stream to the encryption algorithm for block encryption processing. Each block of data is encrypted by a key to generate an encrypted data stream. Next, the wireless network channel in the conference operation interface is explored and optimized. A spectrum analyzer is used to scan the current wireless network environment to obtain the signal strength and interference of all wireless channels. By analyzing these data, a wireless channel with the least signal interference is selected, and a router and a wireless access point are configured to optimize the coverage and transmission rate of the wireless signal. The optimized wireless channel can provide a stable network environment during data transmission. Based on the optimized channel, the encrypted secure data stream is transmitted using multi-channel transmission technology. The specific operation is to split the encrypted data stream into multiple data packets and transmit them in parallel through different network channels, which can reduce the load of a single channel and increase the data transmission speed. The multiple channels can be different frequency bands or different network interfaces. During the transmission process, each data packet is accompanied by the corresponding channel identifier for reassembly at the receiving end. At the receiving end, the fast-transmitted data stream is decrypted. The decryption module uses the same AES-256 algorithm as encryption to decrypt the data stream with a key to restore the original data content. The decryption process involves decrypting the received encrypted data stream in blocks and restoring it to a readable audio and video data stream block by block. Finally, the conference operation interface is intelligently tuned based on the secure data stream obtained by decryption. The decrypted data is analyzed using an intelligent analysis system to identify and optimize the audio and video synchronization, data stream quality, and user interaction experience on the interface. Interface tuning includes adjusting the video resolution, audio quality settings, and the position of interactive interface elements to ensure that the conference interface can provide the best user experience when processing real-time data.

[0035] Step S4: Obtain a set of subjective perception signals of the participants, and perform real-time emotional state analysis based on the set of subjective perception signals of the participants to obtain the real-time emotional state of the participants; draw an emotional fluctuation map based on the real-time emotional state of the participants to obtain an emotional fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotional fluctuation map to obtain an optimized conference atmosphere effect.

[0036] The embodiment of the present invention captures the facial expressions, body language and voice intonation of the participants in real time by arranging multiple high-precision sensors and cameras in the conference room or using the built-in cameras of the equipment. These sensors and cameras include facial recognition, emotion analysis algorithms and voice emotion recognition technology. The facial recognition system can extract the facial expression data of the participants, the emotion analysis algorithm processes these data to identify the emotional state, and the voice emotion recognition technology analyzes the voice characteristics (such as pitch, volume, and speech speed) of the participants, and finally summarizes all the collected data to form a subjective perception signal set. Secondly, the subjective perception signal set is processed using advanced emotion analysis algorithms to analyze the data including facial expressions, body language and voice characteristics. These algorithms map the data to the emotion state model through the trained emotion classification model to identify the real-time emotional state of the participants. If the facial expression recognition shows a smile and squinting eyes, and a high frequency of positive intonation appears in the voice analysis, the participant's emotion is determined to be agitated. Otherwise, it is depressed. The emotion analysis results will be fed back to the system in real time to provide data support for further processing. Then, based on the real-time emotional state data, a data visualization tool is used to generate an emotional fluctuation map. This map will show the dynamic changes of participants' emotions and present the emotional fluctuations through the timeline. The emotional fluctuation map can intuitively show the ups and downs of participants' emotions during the meeting, providing a basis for the analysis of the meeting atmosphere. Finally, according to the emotional fluctuation map, the meeting interface and atmosphere are adjusted. If the map shows that the participants are in a low mood for a period of time, the light, music and visual display content in the meeting room are automatically adjusted. For example, warm light, soft background music or positive visual materials are added. During the adjustment process, the environmental control system and multimedia display system are used for optimization to improve the meeting atmosphere and enhance the overall experience of the participants. Finally, the improvement effect of the meeting atmosphere is evaluated based on the optimization results.

[0037] The present invention firstly collects login information of the logged-in users in the multimedia conference network environment, and can accurately obtain the identity information of each participant. The key to this step is to use a preset identity audit database to authenticate the user, so as to ensure that only legitimate users can log in. This measure effectively solves the problem of illegal user login, that is, to ensure that only real and registered users can log in, and prevent the abuse of false identities. Secondly, for the case where the identity authentication result is that the logged-in user does not exist, a prompt of "logged-in user does not exist" will be directly displayed, so that unauthorized users can be prevented from trying to log in in time, thereby ensuring the security and effectiveness of the meeting. When the user exists, the login user is further verified by using face active recognition technology to participate in the meeting, effectively ensuring that only real and qualified users can participate in the meeting. The key to this step is that the infrared camera can be used to perform active face recognition on real faces and static resources, which has a significant effect in preventing the problem of proxy signing. At the same time, the level information of the participants is obtained and the level classification is performed, ensuring that the participants enter the corresponding conference operation interface according to their level, thereby realizing accurate control of users with different permissions. This method not only improves the efficiency of conference organization, but also ensures the exclusivity and privacy of conference content. According to the identity level and authority of the participants, the corresponding interface is set, so that users at different levels can access the functions and information of corresponding authority, and optimize the user experience and the flexibility of conference management. This process can also reduce potential security risks in the meeting, such as unauthorized access or information leakage, thus providing higher protection for the smooth progress of the meeting. Then, obtaining and encrypting the real-time audio and video data stream of the meeting is a basic measure to ensure the security of conference data. Encryption effectively prevents the data from being intercepted or tampered during transmission, ensuring the confidentiality and integrity of the conference content. The exploration domain optimization of the multimedia conference wireless network channel in the conference operation interface can find the best channel in the network, thereby reducing signal interference and improving network transmission efficiency. Multi-channel transmission based on the optimized channel effectively improves the speed and stability of data transmission, so that real-time audio and video data can be smoothly transmitted to the participant end, avoiding conference interruption or jamming caused by data transmission problems. By decrypting the fast-transmitted data, the system can restore the original data and perform intelligent tuning, thereby optimizing the display effect and operation response speed of the conference interface. This series of processing measures effectively solved the security and efficiency issues in the data transmission process and ensured the smoothness and security of the meeting.Finally, obtaining the subjective perception signal set of the participants and conducting real-time emotional state analysis can instantly understand the emotional reactions of the participants. This measure can timely grasp the atmosphere of the meeting and provide data support for further optimization. Drawing an emotional fluctuation map based on the real-time emotional state of the participants is helpful for visual analysis of the emotional change trends of the participants. Drawing this map can help the conference organizer identify the time periods or links with large emotional fluctuations, so as to adjust the meeting process. Based on the emotional fluctuation map, the atmosphere of the optimized conference interface can be optimized and adjusted. The interface content, layout and interaction methods can be adjusted in time according to the emotional state of the participants to enhance the sense of participation and satisfaction of the meeting. This process effectively improves the overall atmosphere of the meeting, making the meeting more in line with the emotional needs and interaction habits of the participants, thereby improving the interactivity and effectiveness of the meeting.

[0038] Preferably, step S1 comprises the following steps:

[0039] Step S11: intercepting a request sequence for user login in a multimedia conference network environment to obtain a user request sequence;

[0040] The embodiment of the present invention deploys network monitoring equipment or network traffic analysis tools to capture and record data packets on the network. These tools need to be configured to monitor the target network ports and protocols, usually HTTP, HTTPS and TCP, so as to decode and analyze the data in transmission. Then, set specific filtering rules in the network traffic analysis tool to identify and extract data packets related to user login requests. Specifically, by analyzing the IP address, port number and URL path information of the request in the data packet, filter out the request containing the user login information. Then, extract the core data of the user request, including the request timestamp, request content, user identifier and authentication information, and establish the time series of the user login request by sorting these data. Further, use the log analysis tool or script to structure the extracted data and organize the raw data into a format that is easy to analyze, such as a CSV file or a database table. Finally, store the organized user request sequence in the database for subsequent analysis and query. This process can be completed by an automated script to ensure the integrity and accuracy of the data. Regularly check and update the network traffic analysis rules and tool settings to cope with changes in the network environment and new security challenges.

[0041] Step S12: performing protocol parsing according to the user request sequence to obtain a protocol parsing result;

[0042] The embodiment of the present invention processes the received request sequence by decoding. The decoder tool is used to convert the byte stream transmitted over the network into human-readable text or structured data format. Taking the JSON format as an example, the decoder parses the request sequence into a JSON object, extracts each field and its corresponding value, and each request field includes the request type, user ID, meeting ID, and instruction parameters. The decoded request sequence will be sent to the protocol parser, which is responsible for detailed parsing of the request sequence according to the predetermined protocol specification. The protocol specification defines the format and parameter requirements of various requests. For example, a request to join a meeting needs to include a meeting ID and user identity authentication information.

[0043] Step S13: extracting user login information according to the protocol analysis result to obtain user login information;

[0044] The embodiment of the present invention obtains the results of protocol parsing, which usually include authentication data and session identifiers submitted by users. The protocol parsing results will include fields for user login, such as user name, password, and session token. By calling the parsing module, the user data in the parsing results is extracted according to the preset protocol parsing standard (such as JSON format or XML format). The parsing module will use corresponding parsing tools, such as JSON parser or XML parser, to convert the protocol data into an internal data structure.

[0045] Step S14: Authenticate the user's login information through a preset identity audit database. If the user's login information does not exist in the preset identity audit database, it is verified that the logged-in user does not exist; if the user's login information exists in the preset identity audit database, it is verified that the logged-in user exists.

[0046] The embodiment of the present invention collects the user's login information, usually including the user name and password, in a secure and encrypted web form or a dedicated client. These data are transmitted via the HTTPS protocol to ensure data security during the transmission process. The collected login information is sent to the server, and the authentication service on the server uses the SQL database query language to query the preset identity audit database. The database stores the user names and hashed passwords of all legitimate users. If the database query result does not return any matching user records, the system determines that the logged-in user does not exist. This judgment is based on the direct result of the database query and does not require other additional logic. If the query result finds a match in the database, the system further checks whether the password hash matches. If it matches, it is considered that the verified logged-in user exists; if it does not match, it is considered that the user does not exist or the password is wrong.

[0047] The present invention can firstly monitor and record the details of each login attempt, including time, IP address and request content, by intercepting the user login request sequence, which helps to identify and prevent unauthorized access attempts, thereby improving security. Secondly, the intercepted user request sequence is subjected to protocol parsing, allowing the system to deeply analyze the structure and intention of the request, ensuring that only requests that comply with the specified protocol are accepted, thus avoiding the injection of illegal data or malicious code and enhancing the defense capability of the system. Then, the user login information is extracted from the protocol parsing result to provide the necessary data for subsequent identity authentication. This process is a key step to ensure that only users who enter the correct credentials can enter the system, further ensuring the security and privacy of conference data. Finally, by comparing with the preset identity audit database, the system can effectively verify the identity of the user, prevent login attempts by unauthorized users, ensure that only valid users existing in the database can participate in the meeting, and ensure the security of data transmission and the professional atmosphere of the meeting. In addition, the automation and intelligence of the entire process reduce human errors, improve efficiency and reliability, and create a safe and orderly conference environment. The key to these steps is to ensure the authenticity and reliability of the identity of each login user through multi-layer verification and meticulous data analysis, effectively avoiding the risk of illegal login. At the same time, strict data transmission protocols and encryption measures protect the security of data during transmission and prevent data leakage and tampering. This not only improves the security of the conference system, but also optimizes the atmosphere of the meeting, because participants can be sure that they are communicating and sharing information in a trusted and secure environment. In summary, these steps together build a safe and reliable multimedia conference network environment, providing users with an efficient, secure and professional conference experience.

[0048] Preferably, step S2 comprises the following steps:

[0049] Step S21: when it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the active user face data of the logged-in user is captured by an infrared camera to obtain the active user face image information;

[0050] Step S22: verifying the active user face information with the active user face image information through the preset conference participant face information database to obtain the user face verification result, wherein the user face verification result includes whether the user does not exist in the meeting and whether the user exists in the meeting;

[0051] Step S23: if it is determined that the user face verification result is that the user does not exist in the meeting, then it is displayed that the meeting members do not include the user; if it is determined that the user face verification result is that the user exists in the meeting, then the user level classification in the preset meeting participant face information database is extracted to obtain the participant level information;

[0052] Step S24: Classify the participants according to their level information, and obtain the login authority of the participants to enter the corresponding conference operation interface.

[0053] As an embodiment of the present invention, refer to Figure 2 As shown, Figure 1 Detailed step flow diagram of step S2 in FIG. 1 , in this embodiment, step S2 includes the following steps:

[0054] Step S21: when it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the active user face data of the logged-in user is captured by an infrared camera to obtain the active user face image information;

[0055] After the embodiment of the present invention completes user identity authentication by querying the preset identity audit database, an identity authentication result will be obtained. This result is obtained by comparing the user information in the database with the login information provided by the user. If the identity authentication result shows that the logged-in user does not exist, a prompt message will be generated. The prompt message is displayed to the user through the Web interface, indicating that the logged-in user does not exist. At the same time, no further verification or operation will be performed in this case. For users whose verification results show that the logged-in user exists, the infrared camera is activated for facial scanning. The infrared camera can capture clear facial images under different lighting conditions for face liveness recognition.

[0056] Step S22: verifying the active user face information with the active user face image information through the preset conference participant face information database to obtain the user face verification result, wherein the user face verification result includes whether the user does not exist in the meeting and whether the user exists in the meeting;

[0057] The embodiment of the present invention pre-builds a conference participant face information database, which stores the facial feature data of the current conference participants. These data are usually collected through security measures when the user registers and are encrypted and stored to ensure security. After obtaining the user's active facial image information, the system will use these images to match and verify the data in the conference participant face information database. This process is executed by the server, using facial recognition algorithms such as convolutional neural networks (CNN) in deep learning to quickly compare large amounts of data. If the system finds a record in the database that matches the captured facial image, the verification result is that the user exists in the meeting; if no match is found, the result is that the user does not exist in the meeting. This process ensures that only those who exist in the current conference participant face information database can be recognized by the system and allowed to enter the meeting.

[0058] Step S23: if it is determined that the user face verification result is that the user does not exist in the meeting, then it is displayed that the meeting members do not include the user; if it is determined that the user face verification result is that the user exists in the meeting, then the user level classification in the preset meeting participant face information database is extracted to obtain the participant level information;

[0059] The embodiment of the present invention obtains the user face verification result through the previous active user face image information verification process. This step is a direct result based on the database query output, and no additional judgment logic is required. If the user face verification result is that the user does not exist in the meeting, the system will display a message to the user through the Web interface, indicating that the meeting members do not include the user. This message is clear and ensures that the user understands the verification result. If the verification result is that the user exists in the meeting, the meeting participant face information database is further queried to not only confirm the existence of the user, but also to extract the participant level information associated with the user. This information is stored in the database in a classified form, such as guests, hosts, and audience.

[0060] Step S24: Classify the participants according to their level information, and obtain the login authority of the participants to enter the corresponding conference operation interface.

[0061] The embodiment of the present invention receives the level information of the participants extracted from the face information database of the conference participants. This information defines the role and authority of the user in the conference system, such as guest, host and audience. According to the level information of the participants, the user interface will be dynamically adjusted to display different functional modules and operation options. This process is implemented by a client scripting language such as JavaScript to ensure that the user interface matches the user's authority level.

[0062] The present invention first ensures that only users who have passed identity authentication can attempt to enter the meeting. When the system finds that the logged-in user does not exist, it will inform the user, thereby avoiding unauthorized access. For users who have passed the verification, face liveness recognition technology and infrared cameras are used to further capture face data. This process improves the accuracy of security verification and ensures the security of data transmission, providing an additional layer of protection for the collection of face data. Secondly, user verification is performed by comparing the preset database of face information of conference participants, which not only enhances the security of the verification process, but also ensures that only authorized participants can access the meeting. The accuracy of the verification results is directly related to the security of data transmission and the professional atmosphere of the meeting, because they ensure that only the data of legitimate users is transmitted and processed in the system. Then, if the user face verification result shows that the user does not exist in the meeting, the system will clearly notify the user that he is not included in the meeting members, which effectively prevents any unauthorized access. If the user exists, the user's level information is extracted and the corresponding permissions are assigned to him. This step is the key to achieving a customized meeting experience and maintaining order in the meeting, because it provides appropriate access levels based on the user's identity and role. Finally, users are classified according to their level information and given corresponding login permissions to ensure that users can only access the conference functions they are authorized to. This not only improves the operational efficiency of the meeting, but also optimizes the atmosphere of the meeting, because participants receive customized services and resources based on their roles and needs. This also strengthens the security of data transmission, because users can only access data related to their permissions.

[0063] Preferably, step S21 includes the following steps:

[0064] Step S211: when it is determined that the identity authentication result is that the login user does not exist, it is displayed that the login user does not exist; when it is determined that the identity authentication result is that the login user exists, the face information of the login user is captured by using an infrared camera to obtain original user image data;

[0065] Step S212: performing a deep analysis of the heat distribution characteristics of the face according to the original user image data to obtain a heat distribution characteristic map;

[0066] Step S213: performing a time series dynamic analysis on the heat distribution characteristic graph to obtain a face activity index;

[0067] Step S214: performing multi-dimensional motion analysis and detection according to the face activity index to obtain a facial motion synchronization verification conclusion;

[0068] Step S215: Perform fusion scoring and credibility quantitative analysis on the facial action synchronization verification conclusion to obtain active user face image data.

[0069] As an embodiment of the present invention, refer to Figure 3 As shown, Figure 2 Detailed step flow diagram of step S21 in the embodiment, step S21 includes the following steps:

[0070] Step S211: when it is determined that the identity authentication result is that the login user does not exist, it is displayed that the login user does not exist; when it is determined that the identity authentication result is that the login user exists, the face information of the login user is captured by using an infrared camera to obtain original user image data;

[0071] After the embodiment of the present invention completes user identity authentication by querying the preset identity audit database, an identity authentication result will be obtained. This result is obtained by comparing the user information in the database with the login information provided by the user. If the identity authentication result shows that the logged-in user does not exist, a prompt message will be generated. The prompt message is displayed to the user through the Web interface, indicating that the logged-in user does not exist. At the same time, no further verification or operation will be performed in this case. For users whose verification results show that the logged-in user exists, the infrared camera is activated for facial scanning. The infrared camera can capture clear facial images under different lighting conditions for face liveness recognition.

[0072] Step S212: performing a deep analysis of the heat distribution characteristics of the face according to the original user image data to obtain a heat distribution characteristic map;

[0073] When analyzing the facial thermal distribution features of the original user image data, the embodiment of the present invention first obtains the user's facial image data. These images need to have high resolution and high contrast to capture subtle thermal changes. An infrared thermal imager or a camera with thermal imaging function is used to obtain the image to ensure that the image contains sufficient thermal information and avoid any optical interference. Next, through the image preprocessing step, the image data is grayed to remove background noise and enhance the image contrast. These operations are performed using image processing software such as OpenCV or MATLAB. The preprocessed image is subjected to thermal distribution feature extraction, and a deep learning model such as a convolutional neural network (CNN) is applied to automatically detect and extract the thermal feature map of the facial area. Finally, the extracted thermal feature map is visualized, and a thermal distribution map is generated using an image processing tool, and compared with the user's actual facial data to complete the entire process of deep thermal feature analysis.

[0074] Step S213: performing a time series dynamic analysis on the heat distribution characteristic graph to obtain a face activity index;

[0075] The embodiment of the present invention first records the heat distribution feature map in chronological order to form time series data, performs denoising on each image to ensure the clarity of the image, uses image processing algorithms to normalize the heat image so that the heat data at different time points are comparable, performs feature extraction on each frame of the image, extracts the heat value of each facial region, and generates a feature map in a unified format. Then, the regional heat data in the heat image is used for feature extraction, and the region with significant heat changes is selected as the focus of analysis. The heat mean and standard deviation of each region are calculated by statistical analysis methods to form a heat feature vector, and these feature vectors are organized into time series data in chronological order. Time series modeling techniques, such as the autoregressive moving average (ARMA) model or the long short-term memory network (LSTM), are used to model the time series data to identify the pattern and trend of heat changes. Finally, based on the output of the time series model, the activity index at each time point is calculated. The activity index can be defined by comprehensively evaluating the frequency, amplitude and stability of thermal changes. The activity index is normalized using set thresholds and weights to standardize it into a relative activity indicator. Trend analysis is performed on the calculated activity index to identify the fluctuation pattern of facial activity and generate a report indicating the facial activity at different stages of the meeting.

[0076] Step S214: performing multi-dimensional motion analysis and detection according to the face activity index to obtain a facial motion synchronization verification conclusion;

[0077] The embodiment of the present invention first further performs multi-dimensional motion analysis based on the face activity index. This includes checking the movement of the head, the frequency of eye blinking, and the opening and closing of the mouth, as well as the synchronization of these movements with the standard active face model. Then, the collected motion data is matched with a known active face dynamic database to verify the synchronization of the user's facial movements.

[0078] Step S215: Perform fusion scoring and credibility quantitative analysis on the facial action synchronization verification conclusion to obtain active user face image data.

[0079] The embodiment of the present invention fuses the facial action synchronization verification conclusion with other face liveness detection results (such as blinking and head movement) through a weighted algorithm, in which different detection modules are assigned different weights according to their accuracy and reliability. Then, the fused data is subjected to credibility quantitative analysis, a process involving statistical analysis and machine learning models, such as random forests or support vector machines, to evaluate the confidence level of the overall face liveness detection. Finally, based on the set threshold, the facial image data of the active user is finally judged. If the fusion score and credibility exceed the preset threshold, it is identified as a high-confidence active user; otherwise, it will be marked as low-confidence or failed the liveness verification.

[0080] The present invention first verifies the user's identity to ensure that only legitimate users can log in to the meeting. When the verification result shows that the user does not exist, the user will be clearly informed to prevent illegal access. If the user exists, the infrared camera is used to capture facial information, and static resources are distinguished to prevent the problem of proxy signing. Only through identification can the user enter the meeting. Secondly, the captured original image is subjected to deep thermal feature analysis to generate a thermal distribution feature map for subsequent face activity verification, which increases the cost and difficulty of forgery and further ensures security. Then, the thermal distribution feature map is subjected to time series dynamic analysis to calculate the face activity index to provide data support for verifying whether the user is alive. Finally, multi-dimensional motion analysis is performed based on the face activity index, and the scoring and credibility quantitative analysis are integrated to ensure the accuracy and reliability of the verification activity, effectively prevent deception attacks by non-living objects such as photos or videos, ensure the security of data transmission and ultimately optimize the meeting atmosphere. These steps together build a safe and reliable meeting participation environment.

[0081] Preferably, step S22 includes the following steps:

[0082] Step S221: extracting facial image data from a preset conference participant facial information database, and performing data preprocessing on the facial image data to generate initial facial image data;

[0083] The embodiment of the present invention extracts face image data from a preset database of face information of conference participants. This step involves accessing a database storing face information of participants, which is stored in a structured manner, such as using a relational database management system (RDBMS), such as MySQL or PostgreSQL. During operation, the required face image data of the participants is accurately selected by writing SQL query statements to ensure that the extracted data is the latest and relevant. Next, the extracted initial face image data is preprocessed to improve the accuracy and efficiency of the subsequent face recognition algorithm. The data preprocessing includes multiple links: first, the image is grayed to convert the color image into a gray image to reduce the computational complexity; then histogram equalization is performed to improve the contrast of the image and make the image details clearer; then a Gaussian blur filter is applied to remove image noise and smooth the image; finally, a cropping method is used to separate the face area from the background to ensure the clarity and integrity of the face area. These steps can be implemented in a Python environment using an image processing library such as OpenCV, and the functions and methods provided by it are used for specific operations.

[0084] Step S222: Calculating the facial features angle variation characteristics of each expression on the initial facial image data to generate facial features angle feature data;

[0085] The embodiment of the present invention locates the face area in the image by using face detection technology, which can be achieved by using an existing computer vision library such as OpenCV in conjunction with a face detection algorithm (such as Haar cascades or DNN module). Once the face is located, the facial feature point detection technology, such as the pre-trained model in the Dlib library based on deep learning, is then applied to identify and mark the key feature points of the facial features. Then, the angles between the facial features (eyes, nose, mouth) are calculated based on the marked feature points. This process involves geometric and trigonometric calculations, such as characterizing the relative position and expression changes of the facial features by the distance between two points and the angle formed by three points. Specifically, the angle formed by the eyes and the mouth and the angle from the nose tip to the corner of the mouth can be calculated, and these angles will change significantly under different expressions (such as smiling, angry, and surprised). Finally, the calculated angle data is organized into a facial feature angle feature data set, which will be standardized to ensure the consistency and comparability of the data, and then used to train a machine learning model or perform expression recognition analysis.

[0086] Step S223: calculating and adjusting the facial tilt angle of the initial facial image data to generate adjusted facial perspective image data; dividing the facial features angle feature data into facial features change angle data corresponding to the facial perspective according to the adjusted facial perspective image data to generate facial features angle feature data;

[0087] The embodiment of the present invention calculates the tilt angle of the input face image by detecting specific key points on the face (such as eyes, nose and mouth corners) and applying geometric or perspective transformation methods. The key points are located using the feature point detection algorithm in the opencv library, and then the tilt angle of the face is calculated based on the angle and position relationship between the three points. Once the tilt angle is calculated, the image can be rotated and corrected by applying affine transformation or perspective transformation so that the face faces the front view, thereby generating adjusted facial view image data. Then, based on the adjusted facial view image data, the system recalculates the angle feature data of the facial features. This step requires re-detection and angle measurement of the key points of the facial features on the corrected image. Since the facial view has been adjusted to the front, the facial features angle data calculated at this time will more accurately reflect the current expression state of the subject, reducing the expression recognition error caused by angle deviation. Finally, based on the newly calculated facial features angle feature data, the facial features change angle data corresponding to the facial view can be divided. This step involves classifying and integrating the facial features angle data to form a feature data set that can be used for subsequent analysis and recognition. This data set will be used to train a facial expression recognition model or directly applied to real-time expression recognition.

[0088] Step S224: establishing a facial index topology map framework based on a multimedia network environment; establishing topology map nodes for the facial index topology map framework using the adjusted facial view angle image data, and filling data using the facial features angle feature data to generate a facial index topology map; performing topology map node optimization processing on the facial index topology map to generate an optimized facial index topology map;

[0089] The embodiment of the present invention establishes a facial index topology map architecture based on a multimedia network environment. This architecture needs to be designed as a structure that can effectively organize and retrieve a large amount of facial data. A graph database is usually used to store node and edge information, such as a neo4j graph database. In this architecture, each node represents the facial features of a specific person, and the edge represents the association or similarity between different facial features. Then, the adjusted facial perspective image data is used to establish the topology map nodes of the facial index topology map architecture. This step includes adding each standardized face image and its corresponding facial features angle feature data as a new node to the topology map. The specific operation is to add these data to the graph database according to preset rules by writing an automated script or program. After the node is established, the facial features angle feature data is used to fill the data. This operation involves recording the specific values ​​of the facial features angles in detail for each node. These data will be stored in the graph database as node attributes for subsequent facial recognition and analysis. Finally, the facial index topology map is subjected to topology map node optimization processing. The purpose of this step is to improve the query efficiency and accuracy of the topology map, remove redundant nodes through algorithms such as graph simplification or node clustering methods, and enhance the cohesion of the graph structure. Optimization processing can be achieved through optimization tools provided by the graph database or custom algorithms.

[0090] Step S225: The active user facial image information is transmitted to the optimized facial index topology map for facial information retrieval. When the active user facial image information retrieval fails, the user face retrieval result is that the user does not exist in the meeting; when the active user facial image information retrieval is successful, the user face retrieval result is that the user exists in the meeting.

[0091] In the embodiment of the present invention, the facial image information of the user is transmitted to the server, where the optimized facial index topology map is stored and managed. This step usually involves sending the captured facial image of the user to the server via a secure network protocol (such as https). On the server side, the received image data is loaded and prepared for facial recognition processing. Then, the server matches and retrieves the received facial image with the data in the facial index topology map. This is usually achieved through a facial recognition algorithm, such as feature point matching or a deep learning model. If a node matching the input facial image is found in the topology map, it means that the user exists in the meeting and the retrieval is successful. This process involves complex data processing and pattern recognition technology, which needs to ensure the accuracy of recognition while maintaining efficiency; if no matching node is found in the topology map, it means that the user does not exist in the meeting and the facial image information retrieval fails. In this case, the system will provide feedback to the request source, such as prompting the user to check the meeting participation qualifications. Finally, according to the result of the facial information retrieval, the system will generate a corresponding response. For a successful retrieval, the system confirms that the user exists in the meeting and allows him to enter the meeting or grant relevant permissions. For a failed retrieval, the system will notify the user of the corresponding result, such as the user does not exist in the meeting.

[0092] The present invention first extracts the initial face image data from the preset conference participant face information database and performs data preprocessing on it, which can ensure that the face data entering the system is clean and standardized, and helps to improve the accuracy and efficiency of subsequent steps. This step focuses on solving the problem of proxy signing, because through accurate facial recognition technology, the identity of the participants can be verified to prevent unauthorized users from joining the meeting. The data preprocessing also includes removing background noise and redundant information, which helps to reduce the processing burden of the system and speed up the speed of face detection and recognition. Secondly, the facial angle change characteristics of each expression are calculated for the initial face image data to generate facial angle feature data. The key to this step is that the expression changes of the participants can be understood and analyzed, which is crucial for optimizing the conference atmosphere. By monitoring the facial expressions of the participants, the content and rhythm of the meeting can be adjusted in real time to improve participation and satisfaction. In addition, accurate expression recognition can further enhance the anti-proxy signing mechanism, because the facial expression of an individual is one of the biological characteristics that is difficult to imitate. Then, the facial tilt angle is calculated and adjusted for the initial face data, and the facial angle feature data is divided accordingly according to the adjusted facial perspective image data. These steps ensure that face recognition can be performed accurately regardless of the change in the angle of the participant's face. This not only improves the accuracy of recognition, but also improves the user experience, because the system can work stably at different angles and postures. At the same time, this also helps to optimize the conference atmosphere and ensure that all participants can be effectively recognized and interacted with by the system. Finally, a facial index topology map is established and optimized based on the multimedia network environment, and the user's facial image information is transmitted to the map for retrieval. The key to this step is that it provides a structured solution for the efficient management and retrieval of a large amount of facial data. The optimized facial index topology map not only speeds up the retrieval speed, but also improves the accuracy of recognition, which is particularly important for large-scale conferences. In addition, the facial image information is transmitted through a secure data transmission protocol, which ensures the security of data transmission and prevents data leakage or malicious attacks. This series of operations ultimately ensures the smooth operation of the conference system, effectively solves the problem of proxy signing, and ensures the safety and efficiency of the meeting.

[0093] Preferably, step S3 comprises the following steps:

[0094] Step S31: obtaining the real-time audio and video data stream of the conference, and reorganizing the time domain quantization domain frame structure of the real-time audio and video data stream of the conference to obtain a quantized time domain data set; based on the quantized time domain data set, performing heterogeneous encryption and encapsulation processing on the real-time audio and video data stream of the conference to obtain an encrypted secure data stream;

[0095] The embodiment of the present invention includes extracting real-time audio and video data from the data stream component in the conference system through the process of obtaining the real-time audio and video data stream of the conference. Use efficient data stream acquisition tools, such as multimedia stream acquisition cards, to capture audio and video data in real time. Then, these data are input into the time domain quantization processing module, which uses a quantization algorithm (such as uniform quantization or non-uniform quantization) to segment the data stream and reorganize it into a quantized time domain data set. Next, based on the quantized time domain data set, a heterogeneous encryption algorithm (such as AES and RSA hybrid encryption) is used to encrypt the data stream to ensure the security and privacy of the data. Finally, the output is an encrypted secure data stream.

[0096] Step S32: performing channel strength distribution analysis on the multimedia conference wireless network channels in the conference operation interface to obtain wireless network channel signal strength distribution data;

[0097] The embodiment of the present invention performs channel strength distribution analysis on the multimedia conference wireless network channels in the conference operation interface, monitors the strength of the wireless network signal in real time through a wireless network monitoring instrument (such as a Wi-Fi analyzer), and collects the channel strength data and processes it through dedicated analysis software, which can generate a distribution map of the signal strength. By analyzing these distribution maps, the signal strength of each channel is determined to obtain the wireless network channel signal strength distribution data, which represents the actual signal strength and coverage of different channels.

[0098] Step S33: performing channel allocation exploration domain simulation processing on the multimedia conference wireless network channel based on the wireless network channel signal strength distribution data to obtain the multimedia conference channel allocation exploration domain;

[0099] The embodiment of the present invention obtains the signal strength distribution data of the wireless network channel and uses a channel allocation simulation tool (such as channel allocation optimization software) to simulate the channel allocation exploration domain. The simulation tool can input signal strength data and apply an optimization algorithm (such as a genetic algorithm or a simulated annealing algorithm) to simulate the performance under different channel configurations. The simulation results form a multimedia conference channel allocation exploration domain, which represents the channel performance and interference conditions under different channel allocations.

[0100] Step S34: performing channel access optimization layout for the multimedia conference wireless network channel according to the multimedia conference channel allocation exploration domain to obtain the multimedia conference channel exploration optimization access layout point;

[0101] The embodiment of the present invention uses a channel optimization layout tool (such as wireless network planning software) to optimize the access layout of wireless network channels according to the data of the multimedia conference channel allocation exploration domain. The tool can input the exploration domain data and generate the best channel access point configuration plan through an optimization algorithm (such as linear programming or integer programming). The optimized result determines the optimal layout of the channel access point, thereby obtaining the multimedia conference channel exploration optimization access layout point, ensuring network load balancing and signal coverage optimization.

[0102] Step S35: Performing network performance evaluation on the multimedia conference channel exploration optimization access layout point to obtain the best network performance configuration scheme for the channel access point; performing channel optimization on the multimedia conference wireless network channel according to the best network performance configuration scheme for the channel access point to obtain the optimized channel;

[0103] The embodiment of the present invention evaluates the network performance by exploring and optimizing the access layout points of the multimedia conference channel, and uses network performance test tools (such as bandwidth testers and delay testers) to test these access points, and the test includes measuring the key performance indicators of data transmission rate, delay and packet loss rate. According to the test results, the best network performance configuration scheme of the channel access point is generated, and the scheme indicates the details of the optimized network configuration. According to the configuration scheme, the wireless network channel settings are adjusted to achieve channel optimization, so as to ensure that the wireless network performance reaches the best state.

[0104] Step S36: performing layered channel coding technology and transmission channel configuration on the encrypted security data stream based on the optimized channel to obtain a multi-channel fast data stream;

[0105] The embodiment of the present invention performs preprocessing of the data stream. This step includes formatting and segmenting the original data for subsequent channel coding. For example, the data format is unified using data standardization software to ensure that different types of data (such as audio, video and text) meet the coding requirements. Then, layered channel coding technology is applied. In this step, an efficient coding algorithm (such as LDPC or turbo code) is used to encode the data stream to enhance its error correction capability and security during transmission. For example, professional communication coding software (such as the communication system toolbox in MATLAB) can be used to implement these coding techniques, and the data is divided into multiple levels, each with different protection levels to adapt to different channel conditions. Next, the transmission channel is configured, and the parameters of the transmission channel, such as frequency bandwidth and modulation mode, are adjusted according to the optimized channel allocation scheme. For example, the channel and power of the access point are set through a wireless network management system (such as Cisco Moval or Merakidashboard) to ensure that the data stream is transmitted on the best channel, reduce interference and improve signal quality. Finally, multi-channel fast data transmission is implemented. In this step, data is sent and received simultaneously through multi-channel transmission technology (such as MIMO technology) using optimized channels and layered coded data streams. This can be achieved through hardware and related driver software supported by modern wireless communication devices, such as using wireless network cards and routers that support MIMO, and activating and managing multi-channel transmission through the interfaces and configuration tools they provide.

[0106] Step S37: performing reverse decoding and composite decoding processing according to the multi-channel fast data stream to obtain a decoded secure data stream;

[0107] The embodiment of the present invention performs reverse decoding of the data stream. This step is the inverse operation of the encoding process, which aims to restore the data stream of the layered channel coding to the original format, and uses the decoding algorithm corresponding to the transmitting end (such as LDPC or turbo code decoder) to decode each layer of data one by one through the communication decoding software (such as the corresponding toolbox in MATLAB). In this process, the error detection and correction mechanism will play a role to ensure data integrity and accuracy. Then, a composite decoding process is performed. In this step, the data streams after each layered decoding are recombined into complete information, which involves synchronizing the data of each layer and eliminating any time offset or frequency offset introduced during the transmission process. Dedicated digital signal processing tools (such as GNU Radio or Simulink) can be used to handle these tasks. They provide user-defined modules and interfaces that can accurately adjust and synchronize data streams. Next, security verification is performed. Once the data stream is composited, security verification will be performed to ensure that the data has not been tampered with during transmission. This includes verifying the encrypted signature or using a secure hash algorithm (such as SHA-256) to check the integrity of the data. For example, use terminal security software (such as wireshark or tcpdump) to capture and analyze data packets to ensure that they meet the expected security standards. Finally, the decoded secure data stream is obtained. After processing through the above steps, a high-quality, secure data stream is finally obtained for further use and application. For example, in a conference system, this means sending the decoded audio and video data to the corresponding playback device, or forwarding documents and shared materials to the client of the participants.

[0108] Step S38: Intelligently tune the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface.

[0109] The embodiment of the present invention analyzes the decrypted secure data stream. This step involves a detailed analysis of the content and structure of the data stream to identify various needs and patterns in the meeting. For example, a data analysis tool (such as the pandas library in Python) is used to parse the user interaction information, conference content type, and network performance indicators in the data stream. Then, the interface design is intelligently tuned according to the analysis results, and the layout, color scheme, and interactive elements of the conference interface are adjusted using user interface design software (such as Sketch or Adobe XD) to better meet user needs. For example, if the analysis finds that users frequently need to access specific functions in a meeting, the icons of these functions can be placed in a more prominent position, or quick access buttons can be added. Next, the dynamic adjustment of the interface elements is implemented. Through programming and scripting languages ​​(such as JavaScript and CSS), code is written so that the interface elements can be dynamically adjusted according to real-time data. For example, if the data shows that the network delay has increased, the interface elements can be automatically simplified and the video quality can be reduced to reduce the data transmission requirements. Finally, test and deploy the optimized conference interface. Use automated testing tools (such as selenium or jmeter) in the development environment to stress test and user experience test the new interface to ensure that all functions work properly and user interaction is smooth. Use software deployment tools (such as Jenkins or gitlab ci / cd) to deploy the optimized interface to the conference operation interface.

[0110] The present invention firstly obtains the real-time audio and video data stream of the conference and reorganizes the time domain quantization domain frame structure, which can effectively improve the processing efficiency of the data stream. The generation of the quantized time domain data set optimizes the data during the transmission process, thereby enhancing the compression and transmission performance of the data. By performing heterogeneous encryption and encapsulation processing on the data stream, it can ensure that the data has high security during the transmission process, effectively prevent data leakage and illegal access, and solve the security problem in data transmission. This encryption technology ensures the confidentiality and integrity of the conference content and enhances the protection of data. Secondly, by performing channel strength distribution analysis on the wireless network channel of the multimedia conference, the signal strength of the channel can be understood in detail. This analysis provides the signal strength distribution data of the wireless network channel, which provides a basis for subsequent channel optimization. This step helps to identify areas with weak signals, determine the unevenness of network coverage, and lay a data foundation for channel optimization, thereby improving the overall performance and stability of the network. Then, based on the signal strength distribution data, channel allocation exploration domain simulation processing is performed to explore and optimize the allocation of wireless network channels. This simulation generates a multimedia conference channel allocation exploration domain, which enables different allocation strategies to be tested before actual allocation. This exploration can reveal potential network bottlenecks and load balancing problems, providing strong data support and strategic basis for further channel optimization. Next, the channel access optimization layout is performed according to the multimedia conference channel allocation exploration domain to obtain the optimal channel access layout point. Through this optimized layout, the problem of uneven channel access can be effectively solved, the utilization of network resources can be improved, and each access point can be guaranteed to have the maximum performance. The optimized channel layout point can reduce signal interference and data conflicts, thereby improving the network quality and user experience of the entire conference. Finally, the network performance of the channel access point is evaluated, and the channel is optimized according to the optimal network performance configuration scheme of the channel access point. This evaluation process can help identify and configure the best network performance settings to ensure that the channel performance is optimal. This optimization can further improve the speed and stability of data transmission, solve the delay and interruption problems caused by channel problems during the meeting, and thus improve the smoothness and user satisfaction of the meeting. Through the optimization of the above steps, the overall conference experience has been significantly improved, ensuring efficient and secure data transmission and a good conference atmosphere.

[0111] Preferably, step S4 comprises the following steps:

[0112] Step S41: capturing the participant's facial micro-expressions and sound waveforms in real time to obtain the participant's subjective perception raw data;

[0113] The embodiment of the present invention is provided with a high-precision camera and a sound collection device. This step involves deploying a high-resolution camera and a sensitive sound collection device, such as a micro-microphone array, in the conference room to ensure that the facial expressions and sound waveforms of each participant can be clearly captured. For example, a camera that supports 4k video recording and a microphone with noise suppression function can be used. Next, facial micro-expression capture is performed. By using facial recognition software and micro-expression analysis algorithms (such as opencv library combined with deep learning framework tensorflow or pytorch), the video stream captured by the camera can be analyzed in real time to detect and record the changes in the facial micro-expressions of the participants. These algorithms can identify subtle facial movements, such as the lifting of eyebrows and the blinking frequency of eyes. Then, the sound waveform is captured, and the audio data collected by the sound collection device is analyzed by digital signal processing technology to obtain the characteristics of the sound waveform, and the frequency, amplitude and rhythm of the sound are analyzed using audio processing tools (such as audacity or praat), so as to capture the voice intensity and intonation changes of the participants. Finally, synchronize facial micro-expression and sound waveform data. The captured facial micro-expression data and sound waveform data are synchronized through timestamps to ensure that the two can be aligned in time for subsequent analysis. Use data synchronization tools (such as Apache Kafka) to manage the synchronization of different data streams to ensure the real-time and consistency of the data.

[0114] Step S42: performing facial feature point positioning and voice analysis based on the original data of subjective perception of the participants to obtain a comprehensive subjective perception data set of the participants;

[0115] The embodiment of the present invention implements facial feature point positioning. This step uses facial recognition technology to accurately identify key points of the face in the video, such as eyes, nose and mouth. By applying a computer vision library (such as opencv) combined with a deep learning framework (such as dlib or tensorflow), these feature points can be detected and tracked. For example, a pre-trained deep neural network model can be used, which can process high-definition video streams in real time and output the coordinates of facial feature points in each frame. Next, voice analysis is performed, and the voice data is analyzed by an audio processing tool to extract key features such as pitch, volume and speaking speed. Signal processing algorithms (such as Fourier transform) are used to analyze the frequency characteristics of sound waveforms, and machine learning techniques are used to classify voice emotions. For example, open source voice processing libraries (such as pydub and librosa) can be used to perform these operations, which provide functions for processing and analyzing audio files. Then, integrate the facial feature points and voice analysis results, combine the facial feature point data with the voice analysis results to form a comprehensive data set, which contains the facial expressions and voice characteristics of the participants, and use data fusion technology to ensure that data from different sources can be aligned in time and space, such as using time series analysis tools (such as the TSDL library in the R language) to synchronize data. Finally, generate a comprehensive subjective perception data set. Based on the above analysis, a comprehensive data set containing the changes in facial expressions and voice characteristics of the participants will be generated. This data set provides a basis for subsequent sentiment analysis and behavior prediction. For example, data analysis software (such as Python's pandas library) can be used to organize and store this data so that it can be easily accessed and used by other applications.

[0116] Step S43: extracting subjective perception features from the comprehensive subjective perception data set of participants to obtain a subjective perception feature data set of participants;

[0117] In the subjective perception feature extraction stage, the embodiment of the present invention uses machine learning algorithms, such as principal component analysis (PCA) or convolutional neural network (CNN), to extract key features from the comprehensive subjective perception data set. The facial feature point data will be converted into an emotion representation vector through the feature extraction network, and the sound waveform data will be extracted through time series analysis. Emotion-related features, such as pitch, speech speed, and emotion intensity. These features will be aggregated to form a subjective perception feature data set for further analysis of the emotional state of the participants.

[0118] Step S44: performing real-time emotional state analysis based on the participant's subjective perception feature data set to obtain the participant's real-time emotional state;

[0119] The embodiment of the present invention implements real-time emotional state analysis based on the subjective perception feature data set, and uses an emotion recognition model (such as a long short-term memory network LSTM or a sentiment analysis model BERT) to process the feature data. The emotion recognition model inputs the extracted feature data into the model, and outputs the real-time emotional state of each participant, such as happiness, tension, and confusion, through a trained emotion classifier (for example, a support vector machine SVM or a deep learning classifier).

[0120] Step S45: Draw an emotion fluctuation map according to the real-time emotional state of the participants to obtain the emotion fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotion fluctuation map to obtain the conference atmosphere optimization effect.

[0121] The embodiment of the present invention draws an emotional fluctuation map. This step involves collecting real-time emotional state data and converting it into a visual emotional fluctuation map, using data visualization tools (such as Tableau or D3.js) to create dynamic emotional fluctuation charts, which can show the changing trend of participants' emotions over time. For example, a dashboard can be designed that contains the emotional state curve of each participant and the changing trend of the overall emotion during the meeting. Next, the conference interface is optimized based on the emotional fluctuation map, and according to the analysis results of the emotional fluctuation map, the elements of the conference interface, such as color, layout and display content, are adjusted to improve the atmosphere of the meeting, and the design of the interface elements is adjusted using user interface design tools (such as Sketch or Adobe XD) to ensure that they can respond to the emotional changes of the participants. For example, if it is detected that the overall mood of the participant has dropped, the interface can be automatically adjusted to a more soothing blue tone to help relieve stress. Then, the dynamic adjustment of the conference interface is realized. The conference interface is dynamically changed through programming interfaces (such as JavaScript and CSS). This includes adjusting the color theme, font size, location of interface elements, and conference room equipment to adapt to the emotional fluctuations of the participants. For example, you can use front-end scripts to update the interface style in real time, and dynamically adjust the color and layout of the interface based on the data of the mood fluctuation map. Finally, evaluate the effect of the meeting atmosphere optimization. Evaluate the effect of interface adjustment through user feedback and further sentiment analysis, and use data analysis tools (such as the pandas library in R or Python) to compare the changes in participants' emotions before and after optimization, as well as changes in meeting interaction indicators. For example, you can track the participation and satisfaction of participants to evaluate whether the atmosphere optimization has effectively improved the meeting experience.

[0122] The present invention firstly obtains the original data of subjective perception of the participants by real-time capture of the facial micro-expressions and sound waveforms of the participants. This step provides direct and detailed individual emotional feedback information. Through high-precision facial recognition technology and sound waveform analysis, the emotional response and psychological state of the participants can be accurately captured. The changes in facial micro-expressions and sounds can reflect the participants' immediate reactions to the content of the meeting, providing reliable basic data for subsequent analysis. This real-time capture technology effectively avoids the problem of proxy signing, because the authenticity and immediacy of data collection ensure that the participation status of each participant can be accurately recorded, thereby preventing the occurrence of false participation or proxy signing. At the same time, ensuring the security of data transmission is also key. Through encryption technology and secure data transmission channels, data leakage or tampering during the collection and transmission process is prevented, thereby protecting the privacy and data security of the participants. Secondly, facial feature point positioning and voice analysis are performed based on the original data of the participants' subjective perception to obtain the comprehensive subjective perception data set of the participants. This process accurately locates facial features through algorithms, which can capture subtle emotional changes, while voice analysis provides changes in emotional intensity and tone. This comprehensive analysis helps to deeply understand the emotional fluctuations and perceptual reactions of the participants, laying a solid foundation for the next step of emotional state analysis. In this way, the individual's subjective feelings can be combined with objective data to form a comprehensive emotional data set. This process also strengthens the security of data transmission. All analysis processes are carried out in an encrypted and protected environment to ensure the integrity and confidentiality of the data. Then, the subjective perception feature extraction of the comprehensive subjective perception data set of the participants is performed to obtain the subjective perception feature data set of the participants. This step involves extracting representative emotional features from the comprehensive data set, such as the changing patterns of facial expressions and the emotional components of speech. By extracting features, complex raw data can be simplified into meaningful emotional indicators, making subsequent emotional analysis more efficient and accurate. This feature extraction process not only improves the speed and accuracy of data processing, but also helps analysts better understand the emotional state of the participants. The data still maintains a high degree of security and privacy protection during the processing process, ensuring that the analysis of each feature data is completed while protecting data confidentiality. Next, real-time emotional state analysis is performed based on the subjective perception feature data set of the participants to obtain the real-time emotional state of the participants. This process uses advanced data analysis technology to process and analyze the extracted emotional features in real time, which can instantly reflect the emotional fluctuations of participants. Real-time emotional state analysis not only helps to understand the current emotions of participants, but also can identify emotional trends and patterns. Through this instant feedback mechanism, it is possible to quickly respond to the emotional needs of participants, adjust the content and interaction methods of the meeting in a timely manner, thereby improving the effectiveness and satisfaction of the meeting. In addition, the data is encrypted and access control measures are used to ensure security during the analysis process to prevent the data from being accessed or tampered with by unauthorized personnel.Finally, the mood fluctuation map is drawn according to the real-time emotional state of the participants to obtain the mood fluctuation map. The mood fluctuation map visualizes the real-time emotional state of the participants and shows the changing trends and fluctuations of emotions. This map provides intuitive data support for optimizing the atmosphere of the meeting, allowing the organizers to adjust the rhythm and atmosphere of the meeting according to the changes in emotional fluctuations. This optimization adjustment can include adjusting the content of the meeting, changing the way of interaction, or improving the meeting environment settings, thereby improving the experience of the participants and the overall effect of the meeting. The generation process of the mood fluctuation map also pays attention to data security, ensuring that all emotional data and map information are processed and stored in a secure environment to protect the privacy of the participants and the security of their data.

[0123] Preferably, step S45 includes the following steps:

[0124] Step S451: capturing subtle emotional changes of the real-time emotional state of the participant to obtain subtle emotional dynamic data of the participant;

[0125] The embodiment of the present invention uses high-precision facial expression recognition technology and physiological signal monitoring equipment to capture the emotional state of participants in real time. In the specific implementation process, multiple high-resolution cameras are first arranged in the conference room. These cameras use facial expression analysis algorithms to analyze the changes in the facial expressions of participants in real time. The algorithm can identify subtle emotional changes, such as the amplitude of a smile and the degree of squinting of the eyes. The system can capture the subtle emotional dynamics of participants in real time and transmit the data to the central processing unit for subsequent analysis.

[0126] Step S452: Draw an emotion fluctuation graph according to the subtle emotion dynamic data of the participants to obtain an emotion fluctuation graph;

[0127] The embodiment of the present invention uses the acquired subtle emotional dynamic data to draw an emotional fluctuation map. The specific implementation method includes, first, performing data preprocessing on the collected facial expression data, including noise removal, data smoothing and feature extraction. Then, using data visualization tools, such as Matplotlib or D3.js, the emotional dynamic data is converted into an emotional fluctuation map. During the drawing process, the time axis is set as the X-axis and the emotional intensity is set as the Y-axis. The generated map can display the emotional fluctuations of the participants. The map includes the peaks and troughs of emotional fluctuations, as well as the frequency and amplitude of fluctuations. The emotional fluctuation map can clearly display the emotional fluctuation trend of each participant during the meeting, and provide detailed emotional change information.

[0128] Step S453: performing fluctuation state recognition analysis on the emotion fluctuation graph to obtain the emotion fluctuation state, wherein the emotion fluctuation state includes a gentle emotion fluctuation and a large emotion fluctuation;

[0129] The embodiment of the present invention performs identification and analysis of the state of emotional fluctuations. First, data analysis is performed on the emotional fluctuation spectrum, and statistical analysis methods (such as standard deviation, variance analysis) are applied to calculate the amplitude and frequency of emotional fluctuations. In the specific implementation process, algorithms such as sliding average method and Fourier transform are used to smooth the fluctuation spectrum and extract the main fluctuation mode. Next, according to the set threshold, the emotional fluctuation state is divided into two categories: "gentle" or "large fluctuations". If the amplitude of emotional fluctuations is small and the frequency is low, it is marked as "gentle emotional fluctuations"; if the amplitude of emotional fluctuations is large and the frequency is high, it is marked as "large emotional fluctuations". In this way, the emotional fluctuation state of the participants can be accurately identified, providing a basis for subsequent adjustment measures.

[0130] Step S454: When it is determined that the emotional fluctuation state is gentle, no processing is performed; when it is determined that the emotional fluctuation state is large, the lighting brightness, color temperature, and style and volume of the background music of the multimedia conference are intelligently adjusted based on the emotional fluctuation map to obtain an optimized conference atmosphere.

[0131] The embodiment of the present invention intelligently adjusts the conference environment according to the state of emotional fluctuations. First, if the emotional fluctuation state is identified as "smooth emotional fluctuations", the existing conference environment settings are maintained without adjustment. If it is identified as "large emotional fluctuations", the environment is optimized. Specific operations include adjusting the lighting brightness and color temperature in the conference room, and using the intelligent lighting system to automatically adjust the brightness and color temperature of the lights according to the data of the emotional fluctuation map to create a more comfortable visual environment. In addition, adjust the style and volume of the background music, select the type of music that matches the current emotional fluctuation state (such as calming music or motivating music), and set the appropriate volume to achieve emotional relief or enhancement. Through the above measures, the meeting atmosphere can be effectively optimized and the participation and satisfaction of the participants can be improved.

[0132] The present invention first captures the subtle emotional changes of the real-time emotional state of the participants, which is the key to ensuring the interactive effect of the meeting and the satisfaction of the participants. This process involves accurately monitoring and recording the emotional changes of the participants. Through high-precision emotion recognition technology, it can capture tiny emotional fluctuations. This not only helps to understand the emotional reactions of the participants in a timely manner, but also can intervene quickly when emotional problems occur, thereby avoiding communication barriers caused by emotional instability. In addition, this step also lays the foundation for subsequent data analysis and emotional regulation, ensures the security of emotional data transmission during the meeting, and prevents information leakage and improper use. Secondly, the emotional fluctuation map is drawn according to the subtle emotional dynamic data of the participants, providing a visualization tool to help the conference organizer fully understand the emotional fluctuation situation. The emotional fluctuation map displays the emotional data in a graphical form, so that the trend and pattern of emotional changes are clear at a glance. This map not only helps to identify the emotional fluctuation type of the participants, but also ensures the accuracy and completeness of the information during the data transmission process, avoids data loss and misunderstanding, and through real-time data visualization, the conference organizer can better grasp the atmosphere of the meeting, make timely adjustments, and optimize the meeting effect. Then, the fluctuation state recognition and analysis of the emotion fluctuation map can accurately determine the fluctuation state of the emotion. This analysis step provides data support for the atmosphere adjustment of the meeting. The recognition of the emotion fluctuation state can help the conference organizer better understand the emotional state of the participants and take appropriate measures. If the emotion fluctuation is large, it means that the participant's emotion is unstable, which will affect the effectiveness of the meeting. This step not only improves the understanding of the emotional state, but also ensures the security of the data transmission process and avoids the misreading or tampering of the emotion data. Next, after determining the state of emotion fluctuation, intelligent allocation is carried out according to different emotion fluctuation conditions to optimize the meeting atmosphere. When the emotion fluctuation is gentle, no additional adjustment is required, and the current meeting environment can be maintained; when the emotion fluctuation is large, the meeting atmosphere is improved by adjusting the lighting brightness, color temperature, and the style and volume of the background music. This process can not only effectively alleviate the anxiety and pressure of the participants and improve the overall comfort of the meeting, but also ensure that the atmosphere optimization of the venue can be intelligently adjusted according to actual needs, avoiding the inaccuracy and shortcomings caused by human adjustment. In addition, through intelligent allocation, the problem of poor meeting atmosphere can be effectively solved, and the satisfaction of participants and the meeting effect can be improved.

[0133] Preferably, step S454 includes the following steps:

[0134] Step S4541: when it is determined that the emotional fluctuation state is gentle, no processing is performed; when it is determined that the emotional fluctuation state is large, the emotional fluctuation amplitude is analyzed on the emotional fluctuation spectrum to obtain an emotional fluctuation amplitude index;

[0135] The embodiment of the present invention collects the physiological data and behavioral data of the participants in real time and uses the emotion recognition algorithm to determine the state of emotional fluctuation. First, the facial expression changes are monitored through video analysis technology, and these data are sent to the emotion analysis system. The system processes and analyzes the data based on the preset emotion fluctuation model. If the emotion fluctuation is gentle within the preset range, no further processing is required. If it is detected that the emotion fluctuation amplitude is large, that is, the emotion fluctuation exceeds the range of the gentle state, the system automatically starts the emotion fluctuation amplitude analysis module and calculates the emotion fluctuation amplitude index for further processing and adjustment.

[0136] Step S4542: selecting and adjusting the background music for the multimedia conference based on the emotion fluctuation amplitude index to obtain a background music adjustment plan;

[0137] The embodiment of the present invention uses the obtained emotion fluctuation amplitude index to select and adjust the conference room background music using a multimedia management system. First, a music clip that matches the current emotion fluctuation amplitude is selected from the music library. The music library contains background music of various styles and rhythms. The system selects the corresponding music style and rhythm according to the preset emotion fluctuation amplitude range. Then, the system adjusts the volume and playback frequency of the selected music to match the needs of the meeting atmosphere. These adjustments are implemented through the sound control system to ensure that the background music can effectively adjust the emotional state of the participants, thereby improving the meeting effect.

[0138] Step S4543: performing music rhythm analysis on the background music adjustment scheme to obtain background music rhythm analysis data;

[0139] The embodiment of the invention is performed through a music analysis algorithm. First, the system accesses the real-time background music and extracts the rhythm information of the music through audio signal processing technology, which includes the duration of the notes, the beat frequency and its changing trend. Through the rhythm analysis module, the music rhythm is quantified into data indicators such as beat intensity, frequency change and rhythm stability. These data provide the rhythm analysis data of the background music so that the conference room lighting can be adjusted in the subsequent steps. The music rhythm analysis tool uses the Fourier transform frequency domain analysis method to accurately measure the rhythm characteristics of the music and output a detailed analysis report.

[0140] Step S4544: adjusting the light brightness of the multimedia conference based on the background music rhythm analysis data to obtain a conference room lighting adjustment plan;

[0141] The embodiment of the present invention adjusts the light brightness of the conference room according to the obtained background music rhythm analysis data. First, the background music rhythm analysis data is read by the lighting control system to analyze the frequency and intensity information of the music rhythm. Then, the system converts these data into corresponding lighting brightness and color temperature adjustment parameters. For example, if the music rhythm is fast, the light brightness and color temperature will be increased accordingly to enhance the active atmosphere of the conference room; if the music rhythm is slow, the light brightness and color temperature will be reduced to create a more comfortable environment. Finally, through the adjustment function of the lighting control system, the lighting adjustment plan is implemented, and the changes in the lighting effect are monitored in real time.

[0142] Step S4545: Optimize the conference atmosphere according to the background music adjustment plan and the conference room lighting adjustment plan to obtain a conference atmosphere optimization effect.

[0143] The embodiment of the present invention optimizes the conference atmosphere by integrating the background music adjustment scheme and the conference room lighting adjustment scheme. First, the system integrates the background music adjustment scheme and the conference room lighting adjustment scheme to form a comprehensive optimization scheme. Then, the background music and lighting are synchronously adjusted through the control system to achieve an ideal conference atmosphere. For example, according to the actual situation of the meeting, the system will automatically adjust the background music playback mode and the brightness of the lights to complement each other and enhance the overall atmosphere of the meeting. The optimization effect is evaluated through a real-time monitoring system, including the emotional feedback of the participants and the conference effect indicators, to ensure that the optimization goal of the conference atmosphere is achieved.

[0144] The present invention firstly ensures that the treatment of emotional fluctuations is targeted by judging the state of emotional fluctuations. If the emotional fluctuations are gentle, no treatment is performed, which avoids unnecessary intervention and maintains the natural state. When the emotional fluctuations are large, the amplitude analysis of the emotional fluctuation spectrum is performed, which helps to accurately grasp the intensity of emotional changes and provide a scientific basis for the subsequent background music selection. Secondly, the background music is selected and adjusted using the emotional fluctuation amplitude index, which can not only match the emotional state of the participants, but also relieve the tense atmosphere through the emotional regulation of music and promote the smooth progress of the meeting. Then, the rhythm of the background music is further refined by the analysis of the rhythm of the playing music, so that it is more in line with the rhythm requirements of the meeting and avoids the problem of distraction caused by rhythm mismatch. This process ensures the coordination of the music rhythm and the content of the meeting. Next, the light brightness of the conference room is adjusted according to the background music rhythm analysis data. This adjustment optimizes the visual environment, forms a good match with the background music, and makes the overall atmosphere of the conference room more comfortable and focused. Finally, by integrating the background music adjustment plan and the conference room lighting adjustment plan, a comprehensive conference atmosphere optimization is carried out. This not only improves the comfort and efficiency of the meeting, but also reduces the occurrence of proxy signature management problems through scientific adjustment plans, while ensuring the security and privacy protection of data transmission, thereby achieving the ultimate effect of improving the quality of the meeting and the satisfaction of the participants.

[0145] Preferably, the present invention further provides a multimedia conference system for executing the above-mentioned multimedia conference implementation method, the multimedia conference system comprising:

[0146] User identity authentication module: used to collect login information of logged-in users in the multimedia conference network environment to obtain user login information; authenticate the user login information through a preset identity audit database to obtain an identity authentication result, wherein the identity authentication result includes whether the logged-in user does not exist or whether the logged-in user exists;

[0147] Participant identification and grading module: when the identity authentication result is that the logged-in user does not exist, it will be displayed that the logged-in user does not exist; when the identity authentication result is that the logged-in user exists, the infrared camera will be used to verify the login qualifications of the logged-in user, and the participant level information will be obtained to classify the participants, and the participant login authority will be obtained to enter the corresponding conference operation interface;

[0148] Conference optimization module: used to obtain the real-time audio and video data stream of the conference, and encrypt the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; perform exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain an optimized channel; perform multi-channel transmission of the encrypted secure data stream based on the optimized channel to obtain a fast transmission data stream; perform decryption processing on the fast transmission data stream to obtain a decrypted secure data stream; perform intelligent tuning of the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface;

[0149] Atmosphere optimization module: used to obtain the subjective perception signal set of the participants, and perform real-time emotional state analysis based on the subjective perception signal set of the participants to obtain the real-time emotional state of the participants; draw an emotional fluctuation map based on the real-time emotional state of the participants to obtain an emotional fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotional fluctuation map to obtain the conference atmosphere optimization effect.

[0150] In summary, the present invention provides a multimedia conference system, which consists of a user identity authentication module, a participant identification and classification module, a conference optimization module, and an atmosphere optimization module, which effectively solves the problems of proxy signing, data transmission security, and conference atmosphere optimization in the conference system. By ensuring that only authorized users can participate in the conference, protecting the security of data transmission, and optimizing the conference atmosphere, the security, efficiency, and user experience of the conference are greatly improved.

[0151] Therefore, the embodiments should be regarded as illustrative and non-restrictive from all points, and the scope of the present invention is limited by the appended claims rather than the above description, and it is therefore intended that all changes falling within the meaning and range of equivalent elements of the application documents are included in the present invention.

[0152] The above description is only a specific embodiment of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but should conform to the widest scope consistent with the principles and novel features invented herein.

Claims

1. A method for implementing a multimedia conference, characterized in that: The following steps are involved: Step S1: collecting login information of a logged-in user in a multimedia conference network environment to obtain user login information; Authentication is performed on the user login information through a preset identity audit database to obtain an authentication result, wherein the authentication result includes whether the login user does not exist or whether the login user exists; Step S2: When it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the login qualification of the logged-in user is verified by using an infrared camera, and the level information of the participants is obtained to classify the participants, and the login authority of the participants is obtained to enter the corresponding conference operation interface; Step S3: obtaining the real-time audio and video data stream of the conference, and encrypting the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; Perform exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain the optimized channel; Based on the optimized channel, the encrypted secure data stream is transmitted through multiple channels to obtain a fast transmission data stream; the fast transmission data stream is decrypted to obtain a decrypted secure data stream; Intelligently tune the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface; Step S4: obtaining a set of subjective perception signals of the participants, and performing real-time emotional state analysis based on the set of subjective perception signals of the participants to obtain the real-time emotional state of the participants; An emotion fluctuation map is drawn according to the real-time emotion state of the participants to obtain an emotion fluctuation map; based on the emotion fluctuation map, the atmosphere of the optimized conference interface is optimized to obtain an optimized conference atmosphere effect.

2. The method for implementing a multimedia conference according to claim 1, characterized in that: Step S1 includes the following steps: Step S11: intercepting a request sequence for user login in a multimedia conference network environment to obtain a user request sequence; Step S12: performing protocol parsing according to the user request sequence to obtain a protocol parsing result; Step S13: extracting user login information according to the protocol analysis result to obtain user login information; Step S14: Authenticate the user's login information through a preset identity audit database. If the user's login information does not exist in the preset identity audit database, it is verified that the logged-in user does not exist; if the user's login information exists in the preset identity audit database, it is verified that the logged-in user exists.

3. The method for implementing a multimedia conference according to claim 1, characterized in that: Step S2 includes the following steps: Step S21: when it is determined that the identity authentication result is that the logged-in user does not exist, it is displayed that the logged-in user does not exist; when it is determined that the identity authentication result is that the logged-in user exists, the active user face data of the logged-in user is captured by an infrared camera to obtain the active user face image information; Step S22: verifying the active user face information with the active user face image information through the preset conference participant face information database to obtain the user face verification result, wherein the user face verification result includes whether the user does not exist in the meeting and whether the user exists in the meeting; Step S23: if it is determined that the user face verification result is that the user does not exist in the meeting, then it is displayed that the meeting members do not include the user; if it is determined that the user face verification result is that the user exists in the meeting, then the user level classification in the preset meeting participant face information database is extracted to obtain the participant level information; Step S24: Classify the participants according to their level information, and obtain the login authority of the participants to enter the corresponding conference operation interface.

4. The method for implementing a multimedia conference according to claim 3, characterized in that: Step S21 includes the following steps: Step S211: when it is determined that the identity authentication result is that the login user does not exist, it is displayed that the login user does not exist; when it is determined that the identity authentication result is that the login user exists, the face information of the login user is captured by using an infrared camera to obtain original user image data; Step S212: performing a deep analysis of the heat distribution characteristics of the face according to the original user image data to obtain a heat distribution characteristic map; Step S213: performing a time series dynamic analysis on the heat distribution characteristic graph to obtain a face activity index; Step S214: performing multi-dimensional motion analysis and detection according to the face activity index to obtain a facial motion synchronization verification conclusion; Step S215: Perform fusion scoring and credibility quantitative analysis on the facial action synchronization verification conclusion to obtain active user face image data.

5. The method for implementing a multimedia conference according to claim 3, characterized in that: Step S22 includes the following steps: Step S221: extracting facial image data from a preset conference participant facial information database; performing data preprocessing on the facial image data to generate initial facial image data; Step S222: Calculating the facial features angle variation characteristics of each expression on the initial facial image data to generate facial features angle feature data; Step S223: calculating and adjusting the facial tilt angle of the initial facial image data to generate adjusted facial perspective image data; dividing the facial features angle feature data into facial features change angle data corresponding to the facial perspective according to the adjusted facial perspective image data to generate facial features angle feature data; Step S224: establishing a facial index topology map framework based on a multimedia network environment; establishing topology map nodes for the facial index topology map framework using the adjusted facial view angle image data, and filling data using the facial features angle feature data to generate a facial index topology map; performing topology map node optimization processing on the facial index topology map to generate an optimized facial index topology map; Step S225: The active user facial image information is transmitted to the optimized facial index topology map for facial information retrieval. When the active user facial image information retrieval fails, the user face retrieval result is that the user does not exist in the meeting; when the active user facial image information retrieval is successful, the user face retrieval result is that the user exists in the meeting.

6. The implementation method of multimedia conference according to claim 1, characterized in that: Step S3 includes the following steps: Step S31: obtaining the real-time audio and video data stream of the conference, and reorganizing the time domain quantization domain frame structure of the real-time audio and video data stream of the conference to obtain a quantized time domain data set; based on the quantized time domain data set, performing heterogeneous encryption and encapsulation processing on the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; Step S32: performing channel strength distribution analysis on the multimedia conference wireless network channels in the conference operation interface to obtain wireless network channel signal strength distribution data; Step S33: performing channel allocation exploration domain simulation processing on the multimedia conference wireless network channel based on the wireless network channel signal strength distribution data to obtain the multimedia conference channel allocation exploration domain; Step S34: performing channel access optimization layout for the multimedia conference wireless network channel according to the multimedia conference channel allocation exploration domain to obtain the multimedia conference channel exploration optimization access layout point; Step S35: Performing network performance evaluation on the multimedia conference channel exploration optimization access layout point to obtain the best network performance configuration scheme for the channel access point; performing channel optimization on the multimedia conference wireless network channel according to the best network performance configuration scheme for the channel access point to obtain the optimized channel; Step S36: performing layered channel coding technology and transmission channel configuration on the encrypted security data stream based on the optimized channel to obtain a multi-channel fast data stream; Step S37: performing reverse decoding and composite decoding processing according to the multi-channel fast data stream to obtain a decoded secure data stream; Step S38: Intelligently tune the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface.

7. The method for implementing a multimedia conference according to claim 1, characterized in that: Step S4 includes the following steps: Step S41: capturing the participant's facial micro-expressions and sound waveforms in real time to obtain the participant's subjective perception raw data; Step S42: performing facial feature point positioning and voice analysis based on the original data of subjective perception of the participants to obtain a comprehensive subjective perception data set of the participants; Step S43: extracting subjective perception features from the comprehensive subjective perception data set of participants to obtain a subjective perception feature data set of participants; Step S44: performing real-time emotional state analysis based on the participant's subjective perception feature data set to obtain the participant's real-time emotional state; Step S45: Draw an emotion fluctuation map according to the real-time emotional state of the participants to obtain the emotion fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotion fluctuation map to obtain the conference atmosphere optimization effect.

8. The method for implementing a multimedia conference according to claim 7, characterized in that: Step S45 includes the following steps: Step S451: capturing subtle emotional changes of the real-time emotional state of the participant to obtain subtle emotional dynamic data of the participant; Step S452: Draw an emotion fluctuation graph according to the subtle emotion dynamic data of the participants to obtain an emotion fluctuation graph; Step S453: performing fluctuation state recognition analysis on the emotion fluctuation graph to obtain the emotion fluctuation state, wherein the emotion fluctuation state includes a gentle emotion fluctuation and a large emotion fluctuation; Step S454: When it is determined that the emotional fluctuation state is gentle, no processing is performed; when it is determined that the emotional fluctuation state is large, the lighting brightness, color temperature, and style and volume of the background music of the multimedia conference are intelligently adjusted based on the emotional fluctuation map to obtain an optimized conference atmosphere.

9. The method for implementing a multimedia conference according to claim 8, characterized in that: Step S454 includes the following steps: Step S4541: when it is determined that the emotional fluctuation state is gentle, no processing is performed; when it is determined that the emotional fluctuation state is large, the emotional fluctuation amplitude is analyzed on the emotional fluctuation spectrum to obtain an emotional fluctuation amplitude index; Step S4542: selecting and adjusting the background music for the multimedia conference based on the emotion fluctuation amplitude index to obtain a background music adjustment plan; Step S4543: performing music rhythm analysis on the background music adjustment scheme to obtain background music rhythm analysis data; Step S4544: adjusting the light brightness of the multimedia conference based on the background music rhythm analysis data to obtain a conference room lighting adjustment plan; Step S4545: Optimize the conference atmosphere according to the background music adjustment plan and the conference room lighting adjustment plan to obtain a conference atmosphere optimization effect.

10. A multimedia conference system, characterized in that: The method for implementing a multimedia conference as claimed in claim 1, wherein the multimedia conference system comprises: User identity authentication module: used to collect login information of logged-in users in the multimedia conference network environment to obtain user login information; authenticate the user login information through a preset identity audit database to obtain an identity authentication result, wherein the identity authentication result includes whether the logged-in user does not exist or whether the logged-in user exists; Participant identification and grading module: when the identity authentication result is that the logged-in user does not exist, it will be displayed that the logged-in user does not exist; when the identity authentication result is that the logged-in user exists, the infrared camera will be used to verify the login qualifications of the logged-in user, and the participant level information will be obtained to classify the participants, and the participant login authority will be obtained to enter the corresponding conference operation interface; Conference optimization module: used to obtain the real-time audio and video data stream of the conference, and encrypt the real-time audio and video data stream of the conference to obtain an encrypted secure data stream; perform exploration domain optimization on the multimedia conference wireless network channel in the conference operation interface to obtain an optimized channel; perform multi-channel transmission of the encrypted secure data stream based on the optimized channel to obtain a fast transmission data stream; perform decryption processing on the fast transmission data stream to obtain a decrypted secure data stream; perform intelligent tuning of the conference operation interface based on the decrypted secure data stream to obtain an optimized conference interface; Atmosphere optimization module: used to obtain the subjective perception signal set of the participants, and perform real-time emotional state analysis based on the subjective perception signal set of the participants to obtain the real-time emotional state of the participants; draw an emotional fluctuation map based on the real-time emotional state of the participants to obtain an emotional fluctuation map; optimize the atmosphere of the optimized conference interface based on the emotional fluctuation map to obtain the conference atmosphere optimization effect.

Citation Information

Patent Citations

  • Remote audio and video conference system based on multi-link transmission and processing method

    CN109889767A

  • Information security system and method for video conference based on face recognition

    CN117319596A

  • Conference process optimization method and device, electronic equipment and storage medium

    CN117875904A

Cited By

  • Multi-channel user fusion and target population matching method and product

    CN119740044A