Classroom intelligent terminal integrated with micro host, network access and audio acquisition

Abstract

The invention relates to the technical field of classroom intelligent terminals, in particular to a classroom intelligent terminal integrating a micro host, network access and audio acquisition. According to the technical scheme, the classroom intelligent terminal integrating a micro host, network access and audio acquisition is provided. Comprising a main control unit, an acoustic array device, a network interface device, a deep learning audio processing unit, a multi-mode interaction device, an adaptive network technology component, an edge computing unit, a virtual reality and augmented reality device, a block chain module and a voice synthesis and emotion recognition module. The system provides more advanced, intelligent and interactive rich education experience, is expected to improve the learning effect and teaching efficiency, has potential revolutionary influence in the education field, and provides a more flexible, personalized and efficient learning environment.

Description

Technical Field

[0001] The present invention relates to the technical field of classroom smart terminals, and in particular to a classroom smart terminal integrating a micro host, network access and audio acquisition. Background Art

[0002] With the progress of the times and the development of science and technology, more and more electronic devices are being used in physical classrooms. However, the variety and quantity of electronic devices make it difficult to manage the stability of multimedia hosts and the installation of various software, making the operations required by operation and maintenance personnel very complicated. At present, classrooms are equipped with PC terminals and central control terminals to control the equipment in the classroom, and the central control terminal is only an integrated control of the switch status of external equipment, and the scalability is not strong. It cannot provide a sufficiently immersive learning experience, lacks innovative teaching methods, and is difficult to attract students' interest. It is also relatively limited in terms of interaction methods and cannot provide a diverse user experience, such as being unable to combine multiple interaction methods such as voice, gestures, and eye movements. Therefore, existing technologies are usually limited to specific functions, such as only providing voice recognition, video calls, etc., and lack comprehensive support for multiple functions. Summary of the invention

[0003] The present invention provides a classroom smart terminal integrating a micro host, network access and audio acquisition, which solves the above-mentioned technical problems.

[0004] The solution of the present invention to solve the above technical problems is as follows:

[0005] A classroom smart terminal integrating micro-host, network access and audio acquisition, including a main control unit, an acoustic array device, a network interface device, a deep learning audio processing unit, a multimodal interaction device, an adaptive network technology component, an edge computing unit, a virtual reality and augmented reality device, a blockchain module and a speech synthesis and emotion recognition module;

[0006] Main control unit: includes a microcomputer, processor, memory and storage unit, providing computing and control capabilities for running intelligent learning software, processing voice commands and managing other devices;

[0007] Acoustic array device: an array of multiple highly sensitive microphones for long-distance audio capture and processing. The combination of multiple microphones can locate and extract the sound source so that the system can better identify and filter noise from the classroom environment.

[0008] Network interface device: wired network adapter or wireless network adapter, including Ethernet port and Wi-Fi module;

[0009] Deep Learning Audio Processing Unit: A processor that integrates a deep neural network and corresponding deep learning algorithms;

[0010] Multimodal interaction devices: including voice sensors, cameras, microphones, gesture sensors, and eye trackers;

[0011] Adaptive network technology components: including network monitoring module and bandwidth adjustment module;

[0012] Edge computing unit: including a GPU or a dedicated edge computing chip integrated with an edge computing processor;

[0013] Virtual reality and augmented reality devices: including VR helmets, AR glasses, and sensors;

[0014] Blockchain module: It integrates blockchain protocols and corresponding encryption algorithms to establish secure identity authentication and data transmission mechanisms to ensure the security and non-tamperability of information;

[0015] Speech synthesis and emotion recognition module: Integrates advanced speech synthesis engine and emotion recognition algorithm.

[0016] Based on the above technical solution, the present invention can also be improved as follows.

[0017] Furthermore, the main control unit is the core of the entire system, responsible for managing and coordinating the work of various components.

[0018] The beneficial effects of adopting the above further scheme are:

[0019] Centralized management: As the core of the system, the main control unit centrally manages the operation and collaboration of each component. This helps ensure the consistency and collaborative work of the entire system and improves the overall efficiency of the system.

[0020] Coordinate multimodal interaction: In a multimodal interaction environment, the main control unit is responsible for coordinating multiple input methods such as voice, gesture, eye movement, etc. Such centralized management can ensure synchronization and coordination between different input methods, providing a more consistent and natural user experience.

[0021] Resource allocation and optimization: The main control unit can intelligently allocate system resources to ensure that each component is properly processed and responded to. This resource optimization helps improve system performance, reduce latency, and ensure stable operation of the system in different scenarios.

[0022] Unified user interface: The main control unit is responsible for the management and display of the user interface, allowing users to interact with the system through a unified interface. This simplifies user operations and improves the ease of use of the system.

[0023] Fault diagnosis and processing: The main control unit usually has the ability to diagnose and process faults. It can monitor each component of the system, detect and respond to possible faults in a timely manner, and improve the reliability and stability of the system.

[0024] System scalability: A well-designed system with a main control unit can be expanded and upgraded more easily. By adding new components or updating software, the main control unit can ensure that the system remains scalable and adapts to future changes in technology and requirements.

[0025] Security management: The main control unit is responsible for security management in the entire system. This includes security measures such as user authentication, data encryption, and access control to protect the system from unauthorized access and attacks.

[0026] Furthermore, through the collaborative work of multiple micro-microphones, long-distance audio collection, noise filtering and directional sound capture are achieved, improving the quality of voice recognition and interaction.

[0027] The beneficial effects of adopting the above further scheme are:

[0028] Long-distance audio capture: The collaborative work of multiple micro-microphones can expand the audio capture range, enabling the system to capture clear audio signals in a larger classroom environment. This helps ensure that the voices of students or teachers in the distance can be accurately captured, improving the global coverage of speech recognition.

[0029] Noise filtering: Multiple microphones can work together to capture sounds in the environment to better identify and isolate noise. By working together, the system can use complex algorithms to filter noise, improve the signal-to-noise ratio of voice signals to background noise, and enhance the accuracy of voice recognition.

[0030] Directional sound capture: Multi-microphone arrays can achieve directional capture of sound sources, that is, capture sounds in a specific direction. This is particularly useful in classroom environments, where sounds can be focused on specific areas, such as the location of students or teachers, to improve the pertinence and accuracy of voice recognition and interaction.

[0031] Environmental adaptability: Multi-microphone arrays can adapt to different classroom layouts and environmental conditions. Whether it is a large classroom or a small classroom, the multi-microphone system can adjust its working mode to adapt to the audio capture needs of the specific environment.

[0032] Reduce echo problems: The collaborative work of multiple microphones can also reduce echo problems by precisely controlling the directionality of sound, reducing echoes caused by reflections, and improving the clarity of voice interaction.

[0033] Improve user experience: Through better audio acquisition and noise filtering, users can get a clearer and more natural experience when using voice interaction. This is critical for speech recognition, voice command execution, and other voice interaction applications.

[0034] Furthermore, the network interface device is responsible for enabling the connection between the terminal and the network for remote communication and data transmission, ensuring high-quality network connection.

[0035] The beneficial effects of adopting the above further scheme are:

[0036] Remote communication: Network interface devices enable terminals to communicate with remote servers, cloud services, or other terminals in real time through wired or wireless connections. This is critical for scenarios such as remote education, collaboration, and remote support.

[0037] Data transmission efficiency: Network interface devices are responsible for optimizing the data transmission process, ensuring that data is transmitted from the terminal to the target server or cloud service in an efficient manner. This helps improve the system's response speed, reduce latency, and ensure a smooth user experience.

[0038] High-quality network connection: Through the network interface device, the terminal can establish a high-quality network connection to ensure the stable transmission of audio, video and other data. This is crucial for applications such as real-time voice interaction, video conferencing and distance education.

[0039] Reliability and stability: The design and implementation of network interface devices affect the reliability and stability of the entire system. A stable network connection can avoid unexpected interruptions or data transmission errors and improve system availability.

[0040] Diversified network support: Network interface devices usually support different types of network connections, including wired Ethernet and wireless Wi-Fi, etc. This enables the terminal to connect in different network environments, enhancing the flexibility and adaptability of the system.

[0041] Security: Network interface devices often contain security protocols and encryption mechanisms to ensure the security of data during transmission. This is critical to protecting user privacy and sensitive information, especially in the education field.

[0042] Flexibility: The network interface device should be designed to be flexible and adaptable to different network architectures and protocols. This allows the terminal to be integrated into a variety of network environments, whether it is a school's internal LAN or a remote server of a cloud service provider.

[0043] Furthermore, the deep learning audio processing unit uses deep learning technology, especially deep neural networks, to perform real-time processing of audio signals, improve the accuracy and response speed of speech recognition, and make the system more intelligent.

[0044] The beneficial effects of adopting the above further scheme are:

[0045] Improved accuracy: Deep learning technology, especially deep neural networks, has powerful learning capabilities and can learn complex features of audio signals from a large amount of training data. Therefore, deep learning audio processing units can improve the accuracy of speech recognition and more accurately understand and transcribe user voice commands.

[0046] Strong adaptability: Deep learning models are highly adaptable when processing audio and can adapt to changes in the voice characteristics of different speakers, background noise in different environments, etc. This enables the system to maintain a high level of speech recognition performance in a variety of complex scenarios.

[0047] Real-time processing: The deep learning audio processing unit is designed to process audio signals in real time, allowing the system to respond quickly after the user issues a voice command. This is critical to the real-time nature of voice interaction and user experience.

[0048] Nonlinear feature learning: Deep neural networks have the ability to learn nonlinear features, which is very helpful for capturing the complex time-frequency characteristics of speech signals. By learning these nonlinear features, the system can understand the speech input more comprehensively and improve the robustness of speech recognition.

[0049] Continuous learning capability: Deep learning models usually support continuous learning and can continue to learn new speech patterns and features during runtime. This provides the possibility for continuous optimization and adaptation of the system, allowing the system to continuously improve the speech recognition effect for specific users or scenarios.

[0050] Reduce the error rate: The high adaptability and ability of the deep learning audio processing unit to learn abstract representations help reduce the error rate and improve the robustness of the speech recognition system, enabling the system to perform well in various complex environments in the real world.

[0051] Intelligent system: The audio processing unit integrated with deep learning technology makes the entire system more intelligent. The system can better understand the user's voice input, adapt to the user's voice habits, and provide a more personalized and intelligent interactive experience.

[0052] Furthermore, multimodal interactive devices are used to capture multiple user inputs, providing students with richer operating methods and enhancing the user experience.

[0053] The beneficial effects of adopting the above further scheme are:

[0054] Natural and diverse interactions: Multimodal interactive devices combine multiple input methods such as voice, gestures, and eye movements, allowing users to interact with the system in a more natural and flexible way. This provides more diverse choices, allowing users to choose the interaction method that best suits their personal preferences and needs.

[0055] Personalized experience: Different users may have different interaction preferences. Through multimodal interactive devices, the system can adapt to and respond to the personalized needs of users, provide an operation method that is more in line with user expectations, and enhance the interactive experience between users and the system.

[0056] No physical contact required: Especially in the current environment where hygiene and contactlessness are emphasized, non-contact interaction methods such as gestures and eye movements provide a safer and more hygienic user experience. This is especially beneficial for public places such as classrooms.

[0057] Multi-dimensional input: Multimodal interactive devices can capture multi-dimensional input from users, such as voice and gesture input at the same time. This increases the richness of input information, helps to more fully understand the user's intentions, and improves the accuracy of the system's response to the user.

[0058] Improve interactive participation: Multimodal interactive devices provide students with a more active and interesting way to learn. Through diverse interactions with the system, students are more likely to maintain their attention, which improves learning participation and attractiveness.

[0059] Strong adaptability: Different students may be better at using different interaction methods. The existence of multimodal interaction devices makes the system more adaptable, able to meet the personalized needs of different students, and improves the flexibility of the system.

[0060] Enhance user satisfaction: Providing multiple operation modes and increasing the flexibility of interaction can enhance user satisfaction. Users can more easily find the mode they like and adapt to, and thus be more willing to use the system.

[0061] Promoting barrier-free interaction: Multimodal interactive devices help create a barrier-free learning environment, making it easier for students with special needs to participate in learning activities and improving the inclusiveness of education.

[0062] Furthermore, the adaptive network technology component is responsible for monitoring the current network conditions and dynamically adjusting the bandwidth and connection quality to ensure the stability and quality of audio and video communications.

[0063] The beneficial effects of adopting the above further scheme are:

[0064] Real-time adaptability: Adaptive network technology can monitor network conditions in real time and adjust bandwidth and connection quality based on real-time data. This enables the system to quickly adapt to changes in the network environment and maintain the stability of audio and video communications.

[0065] Improve communication quality: Adaptive network technology helps improve the quality of audio and video communications by dynamically adjusting bandwidth and connection quality. When network conditions are good, higher bandwidth can be provided, and when network conditions are poor, it can be adjusted to adapt to low bandwidth environments, thereby reducing latency and packet loss during data transmission.

[0066] Reduce communication delay: Adaptive network technology can adjust according to the real-time situation of network delay, thereby reducing the delay of audio and video communication. This is especially important for applications with high real-time requirements, such as online education and remote conferencing.

[0067] Improve user experience: By ensuring the stability and quality of communication, adaptive network technology helps improve user experience. Users can communicate more smoothly through audio and video without being disturbed by network fluctuations, thus improving the availability of the entire system and user satisfaction.

[0068] Save network resources: Adaptive network technology can make more efficient use of network resources without sacrificing communication quality. It can avoid excessive bandwidth occupation, ensure sustainable and stable operation of the network, and reduce the risk of network congestion.

[0069] Responding to network changes: The network environment may change at any time, for example, due to an increase in the number of users, network congestion, or signal interference. Adaptive network technology can quickly respond to these changes, maintain the stability of communications, and ensure that the system can provide reliable services in all situations.

[0070] Global adaptability: Globally, network conditions may vary depending on geographical location, network infrastructure, and other factors. Adaptive network technology enables the system to adapt to different regions and network environments, improving the system's global adaptability.

[0071] Furthermore, the edge computing unit is used to perform some computing tasks on the terminal device to reduce the dependence on cloud services, improve the response speed of the system, and enhance data privacy protection.

[0072] The beneficial effects of adopting the above further scheme are:

[0073] Reduced latency: The edge computing unit performs part of the computing tasks on the terminal device, avoiding sending all computing tasks to the remote cloud server for processing. This reduces communication latency and enables the system to respond to user requests more quickly, especially for application scenarios that require real-time feedback.

[0074] Improve system response speed: By offloading computing tasks to terminal devices, the system can process local requests more quickly and reduce dependence on cloud services. This helps improve the response speed of the entire system and improve user experience.

[0075] Saving network bandwidth: Performing some calculations on the terminal can reduce the amount of data that needs to be transmitted to the cloud, thereby alleviating the pressure on network bandwidth. This is crucial for maintaining good system performance under poor network conditions.

[0076] Enhanced data privacy protection: Performing some computing tasks on the terminal device helps protect the privacy of user data. Sensitive data can be processed locally without having to be transmitted to the cloud, reducing the risk of data leakage.

[0077] Improve system reliability: Systems that rely on cloud services may be affected by network failures or unavailability of cloud services. By performing some of the computations on the terminal, the system can operate more independently, improving the reliability and stability of the system.

[0078] Adapt to limited network connection: In some cases, the terminal device may only have access to limited network connection or the network connection may be unstable. Edge computing allows the terminal device to perform calculations locally, reducing the dependence on network connection and improving the adaptability of the system in unstable network environment.

[0079] Reducing the burden on the cloud: Moving some computing tasks to the terminal device shares the burden on the cloud and reduces the load on the cloud server. This helps balance the load of the entire system and improve the availability and performance of cloud services.

[0080] Support for edge devices: Edge computing enables edge devices (such as sensors, cameras, etc.) on terminal devices to process data more autonomously, reducing the need for centralized processing. This is very important for scenarios such as the Internet of Things (IoT).

[0081] Furthermore, virtual reality and augmented reality devices are used to provide immersive learning experiences such as virtual laboratories and virtual face-to-face communication.

[0082] The beneficial effects of adopting the above further scheme are:

[0083] Immersive learning experience: Virtual reality (VR) and augmented reality (AR) technologies can create realistic and immersive learning environments, making students feel as if they are in the actual scene. This immersive experience can increase the attractiveness and depth of learning.

[0084] Hands-on experience: Providing a virtual laboratory environment enables students to conduct hands-on operations, actual observations and experiments without being limited by actual equipment. This is very beneficial for teaching experimental courses, science, technology, engineering and mathematics (STEM) subjects.

[0085] Safety and cost-effectiveness: Virtual laboratories can provide a safe and non-hazardous learning environment, avoiding the dangers that may be caused by some experimental operations. At the same time, it can also reduce the cost of equipment and materials required for actual experiments and improve the cost-effectiveness of education.

[0086] Remote learning support: Virtual reality and augmented reality technologies enable students to participate in virtual labs and learning activities remotely, regardless of their geographic location. This provides more possibilities for distance education and online learning.

[0087] Personalized learning: Virtual reality and augmented reality technologies can provide personalized learning content based on students’ learning styles and progress. Students can customize their learning according to their interests and needs to improve learning outcomes.

[0088] Increase subject appeal: Using virtual reality and augmented reality technologies to create interesting and engaging subject experiences can help stimulate students' interest in the subject and improve their motivation to learn.

[0089] Virtual face-to-face communication: Virtual reality and augmented reality devices enable students to communicate and collaborate face-to-face in a virtual space. This helps to enhance interaction between students and promote teamwork and communication.

[0090] Actual scenario simulation: VR and AR technologies can simulate actual scenarios, allowing students to learn in a virtual environment that simulates actual situations and improve their ability to solve practical problems.

[0091] Improved focus and concentration: Due to their immersive nature, VR and AR technologies help improve students’ focus and concentration, creating a more engaging learning environment.

[0092] Technology Frontier Experience: Using virtual reality and augmented reality devices enables students to experience the latest technological frontiers, providing them with technology experiences that connect with the real world.

[0093] Furthermore, the speech synthesis and emotion recognition modules integrate advanced speech synthesis technology to enable the terminal to interact with users in natural voice, and combine it with emotion recognition to make the system more intelligent and humane.

[0094] The beneficial effects of adopting the above further scheme are:

[0095] Natural interaction experience: Advanced speech synthesis technology enables the system to interact with users in a more natural and fluent voice, just like having a conversation with a real person. This improves the user's interactive experience and makes communication with the system more natural.

[0096] Improve user engagement: Natural speech synthesis and emotion recognition make the system more able to understand and respond to users’ emotional expressions. This can improve user engagement and make users more willing to communicate and interact with the system.

[0097] Humanized interaction: Combined with emotion recognition technology, the system can recognize and understand the user's emotional state, so as to respond to the user's needs more personally. This makes the interaction more humanized and the system can better meet the user's emotions and needs.

[0098] Intelligent voice output: Advanced speech synthesis technology can maintain natural intonation, speech speed and voice quality when outputting voice, making the voice output by the system more intelligent. This is very important for improving the intelligibility and naturalness of voice interaction.

[0099] Increase user-friendliness: Systems with emotion recognition and speech synthesis are more likely to establish emotional connections with users, making them feel that the system is more friendly and easy to communicate with. This helps to increase users’ trust and satisfaction with the system.

[0100] Real-time emotional feedback: Emotion recognition technology enables the system to perceive the user's emotional state in real time and can provide corresponding support, suggestions or feedback based on the user's emotions. This helps to more flexibly meet the needs of users in different emotional states.

[0101] Customized user experience: By combining speech synthesis and emotion recognition, the system can provide personalized voice output and interaction methods based on the user's emotional state and preferences, customizing an experience that is more suitable for the user.

[0102] Improve system intelligence: The combination of emotion recognition and speech synthesis enhances the intelligence of the system, enabling the system to better understand and adapt to users' emotional changes, and provide users with smarter and more personalized services.

[0103] Improved voice interface: Advanced speech synthesis technology can improve the voice interface, making it easier to understand and use. This is very important for applications such as voice assistants and voice navigation.

[0104] Emotional education and therapy: In the field of education and therapy, combining emotion recognition and speech synthesis technology can create a more emotionally intelligent learning and treatment environment, improving teaching effectiveness and treatment results.

[0105] The beneficial effects of the present invention are:

[0106] Comprehensive perception and interaction: The integration of multimodal interactive devices allows users to interact with the system more naturally and flexibly. Multiple input methods such as voice, gesture, and eye movement provide more comprehensive user perception, allowing students to choose the most suitable interaction method according to their personal preferences and needs.

[0107] High-quality audio processing: Using acoustic array devices and deep learning audio processing units, the system can efficiently capture, analyze and process audio signals. This not only improves the accuracy of speech recognition, but also effectively reduces the noise from the classroom environment, providing a basis for a clearer learning experience.

[0108] Adaptive network connection: Adaptive network technology components monitor network conditions and dynamically adjust bandwidth and connection quality to ensure the stability and quality of audio and video communications. This adaptability enables the terminal to provide efficient services in different network environments, whether on campus or in remote learning scenarios.

[0109] Edge computing improves response speed: Edge computing units perform some computing tasks, reducing dependence on cloud services, thereby reducing latency and improving system response speed. Students can get real-time feedback and participate in real-time interactions more quickly, improving learning outcomes.

[0110] Immersive learning experience: Virtual reality and augmented reality devices provide students with an immersive learning experience. Through VR helmets and AR glasses, students can participate in virtual laboratories, interact with virtual objects, or have virtual face-to-face communication with remote educators, which enhances the fun and attractiveness of learning.

[0111] Secure authentication and data transmission: The blockchain module provides a secure authentication and data transmission mechanism to ensure the legitimacy of user identities while protecting the security and integrity of educational data. This is critical for educational institutions and students, especially when it comes to sensitive information such as personal identity and academic performance.

[0112] Intelligent voice interaction and emotion recognition: The speech synthesis and emotion recognition modules enable the system to interact with users in a more intelligent and humane way. By identifying the user's emotional state, the system can adjust the interaction mode and provide more personalized services that are close to the user's emotional needs, increasing the user's trust and comfort in the system.

[0113] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention and implement it according to the contents of the specification, the preferred embodiments of the present invention are described in detail below. The specific implementation of the present invention is given in detail by the following embodiments. DETAILED DESCRIPTION

[0114] The following will be combined with the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0115] The present invention provides a technical solution for a classroom smart terminal integrating a micro host, network access and audio acquisition:

[0116] Embodiment 1

[0117] A classroom smart terminal integrating micro-host, network access and audio acquisition, including a main control unit, an acoustic array device, a network interface device, a deep learning audio processing unit, a multimodal interaction device, an adaptive network technology component, an edge computing unit, a virtual reality and augmented reality device, a blockchain module and a speech synthesis and emotion recognition module;

[0118] Main control unit: includes a microcomputer, processor, memory and storage unit, provides computing and control capabilities, and is used to run intelligent learning software, process voice commands and manage other devices. The main control unit is the core of the entire system and is responsible for managing and coordinating the work of various components;

[0119] Acoustic array device: An array of multiple highly sensitive microphones for long-distance audio capture and processing. The combination of multiple microphones can locate and extract the sound source so that the system can better identify and filter the noise from the classroom environment. Through the collaborative work of multiple miniature microphones, long-distance audio collection, noise filtering and directional sound capture can be achieved, improving the quality of speech recognition and interaction.

[0120] Network interface device: a wired network adapter or a wireless network adapter, including an Ethernet port and a Wi-Fi module. The network interface device is responsible for connecting the terminal to the network for remote communication and data transmission, ensuring high-quality network connection;

[0121] Deep learning audio processing unit: A processor that integrates a deep neural network and a corresponding deep learning algorithm. The deep learning audio processing unit uses deep learning technology, especially deep neural networks, to perform real-time processing of audio signals, improve the accuracy and response speed of speech recognition, and make the system more intelligent.

[0122] Multimodal interactive devices: including voice sensors, cameras, microphones, gesture sensors and eye trackers. Multimodal interactive devices are used to capture multiple user inputs, providing students with richer operation methods and enhancing user experience.

[0123] Adaptive network technology component: including network monitoring module and bandwidth adjustment module. The adaptive network technology component is responsible for monitoring the current network status and dynamically adjusting the bandwidth and connection quality to ensure the stability and quality of audio and video communications;

[0124] Edge computing unit: including GPU or dedicated edge computing chip with integrated edge computing processor. Edge computing unit is used to perform some computing tasks on terminal devices to reduce dependence on cloud services, improve system response speed, and enhance data privacy protection;

[0125] Virtual reality and augmented reality equipment: including VR helmets, AR glasses, sensors, virtual reality and augmented reality equipment are used to provide immersive learning experiences such as virtual laboratories and virtual face-to-face communication;

[0126] Blockchain module: It integrates blockchain protocols and corresponding encryption algorithms to establish secure identity authentication and data transmission mechanisms to ensure the security and non-tamperability of information;

[0127] Speech synthesis and emotion recognition module: Integrating advanced speech synthesis engine and emotion recognition algorithm, the speech synthesis and emotion recognition module integrates advanced speech synthesis technology, enabling the terminal to interact with users in natural voice, and combines emotion recognition to make the system more intelligent and humane.

[0128] When a classroom smart terminal integrating a micro host, network access and audio acquisition based on Example 1 is used:

[0129] Comprehensive perception and interaction: The integration of multimodal interactive devices allows users to interact with the system more naturally and flexibly. Multiple input methods such as voice, gesture, and eye movement provide more comprehensive user perception, allowing students to choose the most suitable interaction method according to their personal preferences and needs.

[0130] High-quality audio processing: Using acoustic array devices and deep learning audio processing units, the system can efficiently capture, analyze and process audio signals. This not only improves the accuracy of speech recognition, but also effectively reduces the noise from the classroom environment, providing a basis for a clearer learning experience.

[0131] Adaptive network connection: Adaptive network technology components monitor network conditions and dynamically adjust bandwidth and connection quality to ensure the stability and quality of audio and video communications. This adaptability enables the terminal to provide efficient services in different network environments, whether on campus or in remote learning scenarios.

[0132] Edge computing improves response speed: Edge computing units perform some computing tasks, reducing dependence on cloud services, thereby reducing latency and improving system response speed. Students can get real-time feedback and participate in real-time interactions more quickly, improving learning outcomes.

[0133] Immersive learning experience: Virtual reality and augmented reality devices provide students with an immersive learning experience. Through VR helmets and AR glasses, students can participate in virtual laboratories, interact with virtual objects, or have virtual face-to-face communication with remote educators, which enhances the fun and attractiveness of learning.

[0134] Secure authentication and data transmission: The blockchain module provides a secure authentication and data transmission mechanism to ensure the legitimacy of user identities while protecting the security and integrity of educational data. This is critical for educational institutions and students, especially when it comes to sensitive information such as personal identity and academic performance.

[0135] Intelligent voice interaction and emotion recognition: The speech synthesis and emotion recognition modules enable the system to interact with users in a more intelligent and humane way. By identifying the user's emotional state, the system can adjust the interaction mode and provide more personalized services that are close to the user's emotional needs, increasing the user's trust and comfort in the system.

[0136] Embodiment 2

[0137] Startup phase: The user starts the terminal, the main control unit performs self-test and system initialization, loads the operating system and starts necessary application programs.

[0138] Network connection: The network interface device establishes a reliable network connection, connects the network interface device to the local area network or the Internet of the educational institution, obtains the IP address and ensures that the network is unobstructed, and ensures that the terminal can communicate remotely and access cloud services

[0139] Acoustic array starts: The audio acquisition device starts capturing the sounds in the classroom, captures the sounds in the classroom, and performs real-time audio processing, transmitting the raw audio signal to the deep learning audio processing unit.

[0140] Deep learning audio processing: The deep learning audio processing unit uses a pre-trained neural network model to process audio in real time to improve the accuracy of speech recognition. This includes speech recognition, noise filtering, sound analysis, etc. to improve the quality of voice interaction.

[0141] Multimodal interaction: Multimodal interactive devices constantly monitor user input and provide users with a variety of interaction methods, such as voice commands, gestures, or eye movements. These inputs are passed to the main control unit to respond to user needs.

[0142] Adaptive Network Technology: The Adaptive Network Technology component monitors network latency, bandwidth, and connection stability. Based on the monitoring results, it dynamically adjusts network settings to ensure smooth audio and video communications.

[0143] Edge computing processing: Some computing tasks are performed on edge computing units to reduce dependence on cloud services and improve the system's response speed, such as real-time audio processing and partial speech recognition, to reduce dependence on cloud services and improve response speed.

[0144] Virtual reality and augmented reality experience: Virtual reality and augmented reality devices provide immersive learning experience. If the user chooses to use virtual or augmented reality functions, the system launches the corresponding devices and applications to provide immersive learning experience, such as virtual laboratories, virtual face-to-face communication, etc.

[0145] Blockchain Authentication: Users authenticate themselves, and the blockchain module ensures that the user’s identity is legitimate and records a secure log of the authentication.

[0146] Speech synthesis and emotion recognition: The speech synthesis and emotion recognition modules synthesize the processed audio in a natural way and analyze the emotional elements in the speech, so that the system can interact with users more intelligently and humanely. The system can adjust the interaction method to better meet the emotional needs of users.

[0147] Real-time feedback and recording: The terminal system provides real-time feedback, such as voice response, screen prompts, etc. At the same time, the system records the user's learning data, including voice interaction history, learning behavior, etc., to support personalized learning and teaching evaluation.

[0148] Shutdown and termination: After the user has finished learning or using the terminal, he can choose to shut down the terminal. The system performs cleanup tasks, saves necessary data, and performs a safe shutdown to protect user privacy.

[0149] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Any ordinary technician in the industry can smoothly implement the present invention as shown in the specification and described above. However, any equivalent changes, modifications and evolutions made by technicians familiar with the profession without departing from the scope of the technical solution of the present invention using the technical content disclosed above are all equivalent embodiments of the present invention. At the same time, any equivalent changes, modifications and evolutions made to the above embodiments based on the essential technology of the present invention are still within the protection scope of the technical solution of the present invention.

Claims

1. A classroom smart terminal that integrates micro-host, network access and audio acquisition. Features: It includes a main control unit, an acoustic array device, a network interface device, a deep learning audio processing unit, a multimodal interaction device, an adaptive network technology component, an edge computing unit, a virtual reality and augmented reality device, a blockchain module, and a speech synthesis and emotion recognition module; Main control unit: includes a microcomputer, processor, memory and storage unit, providing computing and control capabilities for running intelligent learning software, processing voice commands and managing other devices; Acoustic array device: an array of multiple highly sensitive microphones for long-distance audio capture and processing. The combination of multiple microphones can locate and extract the sound source so that the system can better identify and filter noise from the classroom environment. Network interface device: wired network adapter or wireless network adapter, including Ethernet port and Wi-Fi module; Deep Learning Audio Processing Unit: A processor that integrates a deep neural network and corresponding deep learning algorithms; Multimodal interaction devices: including voice sensors, cameras, microphones, gesture sensors, and eye trackers; Adaptive network technology components: including network monitoring module and bandwidth adjustment module; Edge computing unit: including a GPU or a dedicated edge computing chip integrated with an edge computing processor; Virtual reality and augmented reality devices: including VR helmets, AR glasses, and sensors; Blockchain module: It integrates blockchain protocols and corresponding encryption algorithms to establish secure identity authentication and data transmission mechanisms to ensure the security and non-tamperability of information; Speech synthesis and emotion recognition module: Integrates advanced speech synthesis engine and emotion recognition algorithm.

2. According to claim 1, a classroom smart terminal integrating a micro host, network access and audio acquisition, Features: The main control unit is the core of the entire system and is responsible for managing and coordinating the work of each component.

3. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: Through the collaborative work of multiple micro-microphones, long-distance audio collection, noise filtering and directional sound capture are achieved, improving the quality of voice recognition and interaction.

4. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: The network interface device is responsible for connecting the terminal to the network for remote communication and data transmission, ensuring high-quality network connection.

5. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: The deep learning audio processing unit uses deep learning technology, especially deep neural networks, to perform real-time processing of audio signals, improve the accuracy and response speed of speech recognition, and make the system more intelligent.

6. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: Multimodal interactive devices are used to capture multiple user inputs, providing students with richer operating methods and enhancing user experience.

7. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: The adaptive network technology component is responsible for monitoring the current network conditions and dynamically adjusting the bandwidth and connection quality to ensure the stability and quality of audio and video communications.

8. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: Edge computing units are used to perform some computing tasks on terminal devices to reduce dependence on cloud services, improve system response speed, and enhance data privacy protection.

9. According to claim 1, a classroom smart terminal integrating a micro host, network access and audio acquisition, Features: Virtual reality and augmented reality devices are used to provide immersive learning experiences such as virtual laboratories and virtual face-to-face communication.

10. According to claim 1, a classroom smart terminal integrating micro-host, network access and audio collection, Features: The speech synthesis and emotion recognition module integrates advanced speech synthesis technology to enable the terminal to interact with users in natural voice, and combines it with emotion recognition to make the system more intelligent and humane.