An audio and video transmission and intelligent interactive management platform based on the Internet of Things

Abstract

The present invention provides an audio and video transmission and intelligent interaction management platform based on the Internet of Things, including a device access module for connecting audio and video devices to the platform and monitoring the device status through a variety of wireless and wired communication protocols; a data transmission module for utilizing 5G, Wi‑Fi 6, fiber optic communication technology, and edge computing nodes for efficient, low-latency audio and video data transmission; an intelligent interaction module for enhancing the interactive experience of multiple terminal users based on speech recognition, natural language processing, computer vision, and AR / VR technology; a cloud management module for remotely managing the status, resource allocation, and fault detection of audio and video devices, and performing disaster recovery; and a user terminal module for interacting with the platform through an intelligent terminal to achieve audio and video playback, device control, and interaction. The present invention constructs a comprehensive, intelligent, and stable audio and video transmission and interaction management platform by combining a number of advanced technologies such as the Internet of Things, 5G communications, edge computing, and artificial intelligence.

Description

Technical Field

[0001] The present invention relates to the technical field of audio and video signal transmission and management, and in particular to an audio and video transmission and intelligent interaction management platform based on the Internet of Things. Background Art

[0002] With the development of audio and video technology, traditional audio and video transmission and management systems are gradually unable to meet the needs of high-efficiency, high-quality transmission and interaction. The existing technologies mainly have the following deficiencies, including poor real-time performance: traditional audio and video transmission methods are difficult to achieve low latency and high synchronization due to network bandwidth limitations and latency issues. Complex equipment management: large-scale activities involve a variety of audio and video equipment, which makes it difficult to conduct efficient unified management and remote control. Lack of intelligent interaction: existing systems often only support one-way transmission, lack multi-party real-time interaction functions, and have poor user experience. Limited technology upgrades: traditional systems find it difficult to integrate the Internet of Things, cloud computing, and artificial intelligence technologies, which limits overall performance and scalability. Therefore, there is an urgent need for a new audio and video transmission and intelligent interaction management platform based on the Internet of Things to solve the above problems. Summary of the invention

[0003] The purpose of the present invention is to provide an audio and video transmission and intelligent interaction management platform based on the Internet of Things, which realizes efficient audio and video signal transmission, intelligent device management and multi-scenario interactive experience by integrating sensor technology, cloud computing, edge computing and AI technology.

[0004] According to the purpose of the present invention, the present invention provides an audio and video transmission and intelligent interaction management platform based on the Internet of Things, including:

[0005] Device access module, used to connect audio and video devices to the platform through a variety of wireless and wired communication protocols, and monitor device status;

[0006] Data transmission module, used to utilize 5G, Wi-Fi 6, fiber-optic communication technologies, and edge computing nodes for efficient, low-latency audio and video data transmission;

[0007] Intelligent interaction module, used to enhance the interactive experience of multi-terminal users based on speech recognition, natural language processing, computer vision, and AR / VR technology;

[0008] Cloud management module, used to remotely manage the status of audio and video equipment, resource allocation, fault detection, and disaster recovery;

[0009] The user terminal module is used to interact with the platform through a smart terminal to achieve audio and video playback, device control and interaction.

[0010] Furthermore, the device access module is embedded with sensors for real-time monitoring of status parameters of the device, such as power, temperature, and signal strength, and providing feedback and optimization through a cloud management module.

[0011] Furthermore, the data transmission module supports dynamic coding compression technology, adopts AV1 encoding method, and automatically adjusts the compression rate and transmission quality of audio and video data according to network bandwidth and device status.

[0012] Furthermore, the intelligent interaction module uses voice recognition technology to enable users to control audio and video equipment through voice commands to play, pause, and adjust the volume of content; the intelligent interaction module uses natural language processing technology to semantically parse the user's voice commands and perform corresponding operations; the intelligent interaction module includes computer vision technology, which is used to analyze the user's gestures or facial expressions through a camera and respond interactively based on the analysis results; the intelligent interaction module combines AR / VR technology to provide users with an immersive audio and video interactive experience, including real-time interaction in a virtual environment or remote interaction in a video conference.

[0013] Furthermore, the intelligent interaction module analyzes user behavior and recommends personalized audio and video content or interactive activities based on an AI recommendation algorithm.

[0014] Furthermore, the cloud management module includes a multi-device status monitoring function, which obtains the operating data of audio and video devices in real time and performs remote configuration management; the cloud management module optimizes the transmission path and resource usage of audio and video data in a multi-device and multi-user environment through a dynamic load balancing algorithm.

[0015] Furthermore, the cloud management module has fault detection and early warning functions, which can detect equipment failures in time and automatically switch to backup equipment to ensure stable operation of the system; the cloud management module ensures high data availability and supports rapid disaster recovery through distributed storage and multi-node backup technology.

[0016] Furthermore, the user terminal module exchanges real-time video data with the platform through the WebRTC protocol to achieve low-latency, high-quality video playback and interaction; the user terminal module supports high-resolution audio and video playback, and supports AR / VR devices to provide an immersive interactive experience.

[0017] Furthermore, the data transmission module supports automatic selection of the optimal transmission path to cope with bandwidth fluctuations and delay issues in different network environments.

[0018] Furthermore, the intelligent interaction module has a real-time language translation function in video conferencing and supports multi-language speech recognition and translation; the intelligent interaction module can automatically switch and recommend audio and video content according to user behavior and preferences.

[0019] The technical solution of the present invention combines multiple advanced technologies such as the Internet of Things, 5G communications, edge computing, and artificial intelligence to build a comprehensive, intelligent, and stable audio and video transmission and interactive management platform. Whether in terms of device access, data transmission, intelligent interaction, or remote management, the platform can provide efficient, stable, and secure services. This solution can not only meet the needs of various application scenarios such as home entertainment, distance education, and corporate meetings, but also effectively improve user experience, system performance, and resource optimization. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 is a structural block diagram of an embodiment of the present invention; DETAILED DESCRIPTION

[0022] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0024] In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, "multiple" means two or more, unless otherwise clearly and specifically defined. In addition, the terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal connection of two components. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0025] Example 1

[0026] like Figure 1 As shown,

[0027] An audio and video transmission and intelligent interaction management platform based on the Internet of Things, including the following modules:

[0028] The device access module is used to connect audio and video devices to the platform through a variety of wireless and wired communication protocols and monitor the device status. It integrates audio devices (such as microphones and speakers), video devices (such as cameras and displays), and network devices through IoT sensors to ensure unified access at the hardware level and realize real-time status monitoring.

[0029] The device access module is the foundation of the entire system. It intelligently connects various audio and video devices (such as microphones, speakers, cameras, displays, etc.) to the cloud platform and local devices through the Internet of Things (IoT) technology. The module supports multiple wireless protocols (such as Wi-Fi 6, Bluetooth 5.0, Zigbee, NB-IoT, etc.), as well as wired network connections (such as Ethernet, optical fiber).

[0030] The device access module is embedded with sensors to monitor the device's power, temperature, signal strength and other status parameters in real time, and provide feedback and optimization through the cloud management module. Each device is embedded with sensors to monitor the device's working status in real time, including power, working temperature, signal strength, etc., to ensure the system's real-time response and efficient operation of the device.

[0031] The device access module focuses on device compatibility and standardization. In order to ensure that the platform can access various audio and video devices on the market, it should ensure support for device adaptive protocols and intelligent protocol conversion. For example, the compatibility issues between different protocols can be solved by introducing a device gateway. The device gateway can automatically convert data protocols between different devices, allowing the platform to support a wider variety of devices without having to rely on a single communication protocol.

[0032] To further improve the intelligence and operation and maintenance efficiency of the platform, the device access module can add a self-diagnosis function for the access device. This function can monitor the hardware performance of the device (such as temperature, battery power, CPU usage, etc.) in real time, and automatically generate a maintenance report based on the fault code to guide the operation and maintenance personnel to quickly locate and repair the problem.

[0033] The data transmission module uses 5G networks, Wi-Fi 6 technology or optical fiber communication technology to achieve high-speed and low-latency transmission of audio and video data. The data uses dynamic coding compression technology (such as AV1 coding) and edge node optimization strategies to ensure high-quality transmission.

[0034] The data transmission module supports automatic selection of the optimal transmission path to cope with bandwidth fluctuations and delays in different network environments. In order to achieve efficient and low-latency audio and video transmission, the data transmission module of the platform of the present invention adopts the following technologies:

[0035] 5G network: Utilize the ultra-high bandwidth and low latency characteristics of the 5G network to ensure the stability of audio and video signals in high-speed movement and large-scale scenarios.

[0036] Wi-Fi 6: Wi-Fi 6 supports higher data transmission rates and can reduce signal interference and improve network efficiency when multiple devices are connected.

[0037] Edge computing: Using edge computing nodes for local data processing can effectively reduce cloud load, reduce data transmission latency, and improve system response speed.

[0038] Dynamic encoding and compression technology: Automatically adjust the encoding method (such as AV1 encoding) according to network bandwidth, device performance and transmission conditions, and use video adaptive encoding technology to compress the video stream in real time to optimize data transmission efficiency.

[0039] The data transmission module has a bandwidth adaptation and quality assurance mechanism. In order to cope with complex network environments, a dynamic bandwidth adaptation algorithm should be added to the data transmission module to automatically adjust the video quality (such as resolution, frame rate, bit rate, etc.) according to changes in network bandwidth. At the same time, in order to ensure the quality of video and audio, the system can use forward error correction (FEC) technology and automatic video quality adjustment. These technologies can ensure that the system can still guarantee the best audio and video quality even in the case of large network fluctuations.

[0040] The data transmission module has a fault-tolerant mechanism and redundant path design. In order to improve the reliability of the system in extreme situations, redundant data paths and fault-tolerant mechanisms should be designed. For example, during the data transmission process, dual-path or multi-path transmission is adopted. Even if one network fails, other paths can still guarantee the normal transmission of audio and video. In addition, a fault-tolerant mechanism for data encryption transmission can also be designed to ensure that data will not be lost or tampered with when the network jitters.

[0041] The intelligent interaction module is used to enhance the interactive experience of multiple terminal users based on speech recognition, natural language processing (NLP), computer vision, and AR / VR technology. Based on the cloud computing platform, it uses AI algorithms to realize real-time processing of audio and video data and real-time interaction between multiple terminal users, and enhances user experience through speech recognition and AR / VR technology. The intelligent interaction module supports voice command control through natural language processing (NLP), immersive interaction through AR / VR devices, and supports real-time meeting minutes generation through AI algorithms.

[0042] The intelligent interaction module has the function of real-time language translation in video conferences and supports multi-language speech recognition and translation. The intelligent interaction module can automatically switch and recommend audio and video content based on user behavior and preferences.

[0043] The intelligent interaction module combines artificial intelligence technology to enhance the user's interactive experience. It mainly includes:

[0044] Speech recognition and natural language processing (NLP): By integrating speech recognition technology and natural language processing technology, users can use voice commands to control devices within the platform, initiate interactions, or adjust system settings. The intelligent interaction module uses speech recognition technology to enable users to control audio and video devices through voice commands, such as playing content, pausing, and adjusting volume. The intelligent interaction module uses natural language processing (NLP) technology to semantically parse the user's voice commands and perform corresponding operations.

[0045] The intelligent interaction module includes computer vision technology, which is used to analyze the user's gestures or facial expressions through a camera and make interactive responses based on the analysis results.

[0046] The intelligent interaction module combines AR / VR technology to provide users with an immersive audio and video interactive experience, including real-time interaction in a virtual environment or remote interaction in a video conference.

[0047] The intelligent interaction module is based on AI recommendation algorithms to analyze user behavior and recommend personalized audio and video content or interactive activities.

[0048] Computer vision and augmented reality (AR) / virtual reality (VR) technology: Based on computer vision technology, the camera analyzes the user's behavior and gestures in real time. The system analyzes the user's gestures, movements or facial expressions through the camera to achieve contactless interactive control. For example, users can switch audio and video content or adjust the volume with simple gestures.

[0049] With AR (augmented reality) / VR (virtual reality) technology, the system can provide users with an immersive audio and video interactive experience. For example, in a remote meeting, users can participate in the interaction in the virtual space through VR devices and have more intuitive and vivid communication.

[0050] Intelligent content recognition and recommendation: AI algorithms are used to analyze audio and video content in real time, automatically identify and recommend relevant interactive or playback content. Users can not only receive customized content, but also enjoy a personalized interactive experience.

[0051] The intelligent interaction module adopts the extension of multimodal interaction, which can further enhance the multimodal perception ability of the interaction module, enabling it to interact through voice, gesture, facial recognition, eye tracking, brain-computer interface, etc. For example, combined with brainwave control technology, users can control audio and video equipment through thinking, thus achieving a more efficient and accurate interactive experience.

[0052] The intelligent interaction module has real-time translation and subtitle generation functions. In order to enhance the interactive experience of global users, real-time voice translation and subtitle generation functions can be introduced. Using natural language processing and machine learning technology, the system can translate and generate subtitles in real time in a multilingual environment, ensuring that users of different languages ​​can communicate without barriers.

[0053] The intelligent interaction module has emotion recognition and intelligent response. By introducing the emotion analysis algorithm, the platform can identify the user's emotional state (such as happiness, sadness, anger, etc.) and adjust the interaction method according to the user's emotions. For example, when the user appears anxious, the system can automatically lower the brightness of the video or provide more relaxing interactive content.

[0054] The cloud management module is used to remotely manage the status, resource allocation, and fault detection of audio and video equipment, and to perform disaster recovery. With the help of cloud computing technology, it realizes centralized management, remote monitoring, and dynamic scheduling of audio and video equipment, and supports real-time monitoring of equipment status, optimal resource allocation, and abnormal alarms. The cloud management module can dynamically adjust the audio and video transmission strategy according to the equipment status and network conditions, and generate equipment maintenance reports.

[0055] The cloud management module includes multi-device status monitoring functions, real-time acquisition of audio and video equipment operating data, and remote configuration management.

[0056] The cloud management module optimizes the transmission path and resource usage of audio and video data in a multi-device and multi-user environment through a dynamic load balancing algorithm.

[0057] The cloud management module has fault detection and early warning functions, which can detect equipment failures in time and automatically switch to backup equipment to ensure stable operation of the system.

[0058] The cloud management module ensures high data availability and supports rapid disaster recovery through distributed storage and multi-node backup technology.

[0059] The cloud management module provides powerful remote control and management functions for the entire platform. This module supports comprehensive monitoring of equipment, optimal resource scheduling, and rapid recovery from faults. The specific functions are as follows:

[0060] Device status monitoring and remote configuration: Through the cloud management module, the platform can obtain the working status of all connected devices in real time (such as battery power, signal strength, network connection status, etc.), and can perform remote configuration, adjustment or upgrade. Managers can centrally monitor each device through the platform to ensure the efficient operation of the system.

[0061] Dynamic load balancing and resource optimization: Based on real-time data traffic, computing requirements and device status, the cloud management module can intelligently adjust system resources (such as bandwidth allocation, computing resource allocation, etc.) to ensure that the system can run stably and optimize the user experience in a multi-user, high-traffic environment.

[0062] Fault detection and disaster recovery: By real-time monitoring of the operating status of the equipment, the cloud management module can automatically issue an early warning and start the backup mechanism when the equipment fails or is abnormal, ensuring that the faulty equipment can be quickly restored. Through multi-node data backup and distributed storage technology, the system can achieve high availability and perform rapid data recovery when a disaster occurs.

[0063] The cloud management module adopts cross-platform support and integration. In the cloud management module, cross-platform support needs to be added to enable seamless integration with other third-party platforms (such as video conferencing platforms, smart home platforms, content distribution networks CDN, etc.). This allows flexible resource scheduling and data sharing in different scenarios.

[0064] The cloud management module uses AI-assisted fault prediction and maintenance. In order to further improve the speed of fault recovery, an AI-assisted fault prediction system can be introduced. The system can identify potential equipment failures in advance by learning historical fault data, and automatically issue warnings before equipment problems occur, realizing proactive maintenance. This intelligent maintenance can greatly improve the stability of the platform and user experience.

[0065] The cloud management module adopts multi-level security protection and hierarchical authority management. It designs multi-level authority management for different roles of the platform (such as administrators, equipment operators, ordinary users, etc.) to ensure that data access and operation are limited to authorized personnel. In addition, an intrusion detection system (IDS) and a behavior analysis system should be introduced to monitor the abnormal behavior of the system in real time and promptly detect and deal with potential security threats.

[0066] The user terminal module is used to interact with the platform through smart terminals to achieve audio and video playback, device control and interaction; users can access the platform in real time through PCs, mobile devices or other smart terminals, view audio and video transmission status, send instructions or participate in interactions, and achieve real-time data access and control. The terminal supports high-resolution video playback and high-definition sound quality restoration. The user terminal module supports integration with AR / VR devices to provide an immersive interactive experience.

[0067] The user terminal module mainly relies on terminals such as smartphones, tablets, PCs or AR / VR devices to watch and interact with audio and video content through the access platform. The terminal module connects to the cloud platform in real time through efficient protocols (such as WebRTC, HLS, etc.) to ensure smooth playback and interactive experience of audio and video content.

[0068] The user terminal module is a bridge for interaction between the platform and users. Users connect to the platform through smart terminals (such as smartphones, tablets, PCs, AR / VR devices, etc.). The main features of the terminal module include:

[0069] Audio and video playback and interaction: User terminals support high-definition video and high-quality audio playback, and can interact with the platform in real time. Users can control the audio and video playback on the platform through the touch screen, voice input or gesture operation on the terminal.

[0070] WebRTC protocol support: User terminals use the WebRTC protocol to exchange low-latency, high-quality audio and video data with the platform, enabling real-time video calls, remote conferences, and other functions. The WebRTC protocol supports cross-platform use, ensuring seamless connections and smooth interactive experiences between different devices.

[0071] AR / VR support: The terminal module supports AR / VR devices, providing an immersive audio and video interactive experience. For example, users can participate in distance education or virtual meetings through VR helmets for more intuitive interaction and communication.

[0072] The user terminal module device access module supports multiple access methods of at least Wi-Fi 6, Bluetooth 5.0, Zigbee and NB-IoT protocols.

[0073] The user terminal module exchanges real-time video data with the platform through the WebRTC protocol to achieve low-latency, high-quality video playback and interaction.

[0074] The user terminal module supports high-resolution audio and video playback, and supports AR / VR devices, providing an immersive interactive experience.

[0075] The user terminal module adopts hardware adaptability and resource optimization. In view of the hardware differences of different terminal devices (such as low-end mobile phones, high-end PCs, VR headsets, etc.), a hardware resource optimization algorithm should be designed to ensure that the system can run smoothly on various hardware platforms by dynamically adjusting the audio and video quality and computing resource allocation. For example, for devices with poor performance, the video resolution can be reduced to reduce resource usage; while for high-performance devices, higher quality video content can be provided.

[0076] The user terminal module adopts offline mode and edge caching, which can add offline playback mode and edge caching functions to the user terminal. By caching audio and video content on the user terminal or edge device, users can continue to enjoy the viewing experience even during a short network interruption. In addition, the system can automatically synchronize data after the network is restored to ensure the integrity and continuity of the content.

[0077] The present invention integrates advanced Internet of Things, cloud computing and AI technologies and has the following advantages:

[0078] Achieve high-quality, low-latency audio and video transmission and adapt to complex network environments.

[0079] Supports multi-device collaboration to achieve remote monitoring, dynamic adjustment and centralized management of equipment.

[0080] Provides rich interactive functions, including voice control, touch operation and AR / VR immersive experience, to enhance user participation.

[0081] Improve the scalability of the system and be able to flexibly adapt to different scenarios and needs.

[0082] This platform uses a variety of technical means to ensure user data security and privacy protection:

[0083] Data encryption: During all audio and video data transmission processes, high-standard encryption algorithms such as AES are used to ensure the security of data transmission.

[0084] Identity authentication and permission control: The platform supports multiple identity authentication mechanisms, including username and password, fingerprint recognition, facial recognition, etc., to ensure that only authorized users can access specific devices and content.

[0085] Privacy protection: The platform complies with relevant privacy protection laws and regulations to ensure that users' personal information will not be illegally disclosed. Users' audio and video data are only used by the platform and will not be obtained by third parties.

[0086] Security and privacy protection adopts Zero Trust Architecture. It is recommended to introduce Zero Trust Architecture, which means no longer trusting any internal or external devices or users, but evaluating the risk of access requests in real time through strict identity authentication, device verification and behavioral analysis. This can significantly improve the system's defense capabilities against external attacks (such as DDoS attacks, malware, etc.).

[0087] Security and privacy protection adopts data desensitization and anonymization technology. When storing and processing user data, data desensitization and anonymization technology should be introduced to ensure that no sensitive personal information is leaked when analyzing user behavior and preferences. In addition, technologies such as homomorphic encryption can also be used to ensure that data will not be leaked even during cloud computing.

[0088] The present invention can better cope with various challenges in practical applications. The system scalability, device compatibility, data transmission stability, user interaction experience, security and other aspects have been enhanced. In particular, after the optimization of device access, data transmission, intelligent interaction and cloud management, the platform will be able to better provide high-quality, stable and secure services for different types of users, ensuring that the implementation of the technical solution can be completed smoothly and successfully.

[0089] The present invention combines multiple advanced technologies such as the Internet of Things, 5G communications, edge computing, and artificial intelligence to build a comprehensive, intelligent, and stable audio and video transmission and interactive management platform. Whether in terms of device access, data transmission, intelligent interaction, or remote management, the platform can provide efficient, stable, and secure services. This solution can not only meet the needs of various application scenarios such as home entertainment, distance education, and corporate meetings, but also effectively improve user experience, system performance, and resource optimization.

[0090] The invention is based on the audio and video transmission and intelligent interaction management platform of the Internet of Things, aiming to achieve efficient access, intelligent interaction, stable audio and video data transmission and flexible remote device management of audio and video devices. The platform adopts advanced communication technology, artificial intelligence, cloud computing, edge computing and other cutting-edge technologies to provide a seamless audio and video interactive experience, suitable for multi-scenario applications such as home entertainment, distance education, corporate meetings, smart security, etc.

[0091] The present invention can be widely used in various scenarios, such as:

[0092] 1. Application in large-scale activities

[0093] In large-scale concerts or cultural exchange activities, the platform of the present invention realizes intelligent audio and video transmission and management through the following steps:

[0094] Connect audio equipment, cameras, and displays to the platform through IoT sensors to complete device initialization.

[0095] The data transmission module is started, and after the audio and video data are compressed and encoded, they are transmitted to the edge computing node through the 5G network to achieve low-latency synchronization.

[0096] The cloud management module monitors the status of all devices in real time and dynamically adjusts resource allocation to ensure the best performance effect.

[0097] Users access the interactive module through mobile terminals, participate in real-time question-and-answer or voting activities, and enhance their sense of participation in the activities.

[0098] 2. Application in intelligent conference system

[0099] In a remote conference scenario, the platform of the present invention achieves efficient audio and video interaction through the following steps:

[0100] Conference equipment (such as cameras and microphones) access the platform via Wi-Fi 6 and automatically detects the device connection status.

[0101] The data transmission module dynamically adjusts the video resolution and audio quality according to network conditions to ensure a smooth meeting experience.

[0102] The intelligent interaction module transcribes the meeting content in real time based on speech recognition technology and generates meeting minutes through NLP.

[0103] The cloud management module monitors the status of conference equipment, automatically generates resource usage reports and reminds equipment maintenance.

[0104] 3. Application of home entertainment and education

[0105] In the home scenario, the platform of the present invention is used to support smart entertainment and online education:

[0106] Users access the platform through smart TVs or VR headsets and interact with educational or entertainment content in real time.

[0107] The data transmission module transmits high-resolution audio and video signals to the terminal device, and optimizes the picture effect through AI algorithm.

[0108] The intelligent interaction module supports voice control, and users can adjust the playback content or participate in interactive Q&A through voice commands.

[0109] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An audio and video transmission and intelligent interaction management platform based on the Internet of Things, characterized in that: include: Device access module, used to connect audio and video devices to the platform through a variety of wireless and wired communication protocols, and monitor device status; Data transmission module, used to utilize 5G, Wi-Fi 6, fiber-optic communication technologies, and edge computing nodes for efficient, low-latency audio and video data transmission; Intelligent interaction module, used to enhance the interactive experience of multi-terminal users based on speech recognition, natural language processing, computer vision, and AR / VR technology; Cloud management module, used to remotely manage the status of audio and video equipment, resource allocation, fault detection, and disaster recovery; The user terminal module is used to interact with the platform through a smart terminal to achieve audio and video playback, device control and interaction.

2. The platform according to claim 1, characterized in that The device access module is embedded with sensors for real-time monitoring of device status parameters such as power, temperature, signal strength, etc., and provides feedback and optimization through the cloud management module.

3. The platform according to claim 1, characterized in that: The data transmission module supports dynamic coding compression technology, adopts AV1 coding method, and automatically adjusts the compression rate and transmission quality of audio and video data according to network bandwidth and device status.

4. The platform according to claim 1, characterized in that: The intelligent interaction module uses voice recognition technology to enable users to control audio and video equipment through voice commands to play, pause, and adjust the volume of content; the intelligent interaction module uses natural language processing technology to semantically parse the user's voice commands and perform corresponding operations; the intelligent interaction module includes computer vision technology, which is used to analyze the user's gestures or facial expressions through a camera and respond interactively based on the analysis results; the intelligent interaction module combines AR / VR technology to provide users with an immersive audio and video interactive experience, including real-time interaction in a virtual environment or remote interaction in a video conference.

5. The platform according to claim 1, characterized in that: The intelligent interaction module analyzes user behavior and recommends personalized audio and video content or interactive activities based on an AI recommendation algorithm.

6. The platform according to claim 1, characterized in that: The cloud management module includes a multi-device status monitoring function, obtains the operating data of audio and video devices in real time, and performs remote configuration management; the cloud management module optimizes the transmission path and resource usage of audio and video data in a multi-device and multi-user environment through a dynamic load balancing algorithm.

7. The platform according to claim 1, characterized in that The cloud management module has fault detection and early warning functions, which can detect equipment failures in time and automatically switch to backup equipment to ensure stable operation of the system; the cloud management module ensures high data availability and supports rapid disaster recovery through distributed storage and multi-node backup technology.

8. The platform according to claim 1, characterized in that The user terminal module exchanges real-time video data with the platform through the WebRTC protocol to achieve low-latency, high-quality video playback and interaction; the user terminal module supports high-resolution audio and video playback, and supports AR / VR devices to provide an immersive interactive experience.

9. The platform according to claim 1, characterized in that The data transmission module supports automatic selection of the optimal transmission path to cope with bandwidth fluctuations and delay issues in different network environments.

10. The platform according to claim 1, characterized in that The intelligent interaction module has a real-time language translation function in video conferencing and supports multi-language speech recognition and translation; the intelligent interaction module can automatically switch and recommend audio and video content according to user behavior and preferences.

Images