103 results about "WebRTC" patented technology

The invention belongs to the technical field of high-power microwave effect tests in laboratories, and relates to a lossless reinjection data synchronization method and device for a multi-mode test body, and the method comprises the steps: S1, data collection and transmission: collecting electric field data in the multi-mode test body, and transmitting the electric field data out of a shielding cabin of the multi-mode test body; s2, an edge processing step: sending the electric field data transmitted to the outside of the shielding cabin into an edge GPU node, and carrying out voxelization processing and WebGL body rendering; s3, a data synchronization step: synchronizing the three-dimensional rendering data stream to a plurality of user side browsers in real time through WebRTC and HTTPS (Hyper Text Transfer Protocol over Secure Socket) protocols; s4, time synchronization is carried out, a unified high-precision time reference is provided through a Whit-Rabbit clock, and sub-nanosecond alignment of multi-channel data is achieved; and S5, a data storage step: generating a hash abstract for the synchronous data and writing the hash abstract into the block chain. By means of the method, the safety, the real-time performance and the reliability of data transmission can be effectively improved.

The invention discloses a WebRTC voice enhancement system and method based on a multi-modal large model, and belongs to the field of artificial intelligence and real-time communication cross technology, and the system comprises an audio and video collection module which is used for synchronously collecting original voice signals and corresponding video image data of a user side through a WebRTC protocol stack, high-precision alignment is realized through timestamp marking and a cache mechanism; the multi-modal feature extraction module is used for extracting audio features from the voice signals, extracting visual lip movement features from the video images and generating text semantic features through a voice recognition engine; a noise matching and updating module; a multi-modal semantic perception enhancement module; an audio reconstruction module; and a WebRTC integration module. According to the invention, high-precision noise suppression and millisecond-level delay are realized while the voice semantic integrity is guaranteed, and the requirements of industrial inspection, vehicle-mounted communication and other scenes on high fidelity, low delay and strong robustness are met.

The invention provides a low-delay multi-channel video data processing method and system for remote driving, and is applied to the field of data processing. According to the invention, a low-delay multi-channel video data full-process processing system is constructed for remote driving of a target unmanned vehicle. And four types of core data including hardware, video, network and control are obtained. Aiming at multiple cameras, images are screened according to driving scene priorities, full-coverage dead-corner-free, core view-angle-first and vehicle-type adaptation constraints are applied, and preprocessed multiple video streams are generated. Encoding, slicing and decoding the preprocessed video stream to construct a low-delay processing mechanism; a customized WebRTC protocol is adopted, routing is optimized, direct connection between a vehicle end and a cockpit is achieved, meanwhile, the network state is monitored, and transmission stability and safety are guaranteed through multiple constraints when the network state is abnormal. Fusing multiple paths of decoded pictures, arranging and superposing multiple types of key information according to driving habits, and combining constraints to generate an offering cabin display result; and finally, cooperatively processing the control instruction and the video feedback to form an interactive monitoring visual interface.

The invention discloses a safety monitoring system suitable for fireman training, relates to the technical field of fire-fighting training safety, and aims to solve the problems of difficulty in personnel positioning, communication distortion delay, low video monitoring efficiency and untimely safety intervention in existing fire-fighting training. The system comprises a UWB-based personnel positioning subsystem, a WebRTC-based real-time communication subsystem and a training guidance management subsystem. Wherein the UWB personnel positioning subsystem realizes accurate positioning and trajectory tracking of different training spaces, the WebRTC real-time communication subsystem realizes multi-mode real-time voice interaction and voice-text conversion, and the training guidance management subsystem realizes positioning display, communication scheduling, video linkage and alarm control through front and rear end cooperation. According to the system, the safety monitoring precision and the scheduling efficiency in fireman training can be improved, the training process backtracking and resetting are supported, and technical support is provided for the safety guarantee and efficiency improvement of fire training.

The invention discloses a Web honeypot automatic script identification and countering method based on a large language model and related equipment, and the method comprises the steps: obtaining a real IP address of an attack request through a WebRTC protocol; analyzing the attack request through a headless browser and a large language model, judging whether the attack request is an automatic script behavior or not, countering the attack request if the attack request is the automatic script behavior, and guiding the attack request to a honeypot if the attack request is not the automatic script behavior. The method can improve the accuracy of automatic script recognition, improves the honeypot stability, and can be widely applied to the technical field of network security.

The present application belongs to the technical field of remote control of robots, and particularly relates to a 5G cross-domain low-latency remote control system and method for an explosion-proof humanoid robot. The system comprises a master end teleoperation intelligent cockpit and a slave end remote explosion-proof humanoid robot, and the two are connected through a 5G network for information interaction. The system transmits video streams through H.264 encoding and WebRTC protocol, packs sensor data through JSON, and independently processes information for humanoid control and chassis control. The present application can realize accurate remote force feedback and control, with a humanoid control latency within 100 ms and a chassis control latency within 150 ms, effectively solving the stability and latency problems of remote cross-domain control and ensuring the personal safety of operators in dangerous operating environments.

The invention belongs to the technical field of robot remote control, and particularly relates to an anti-explosion humanoid robot 5G cross-domain low-delay remote control system and method. The system comprises a master-end teleoperation intelligent cabin and a slave-end remote anti-explosion humanoid robot which perform information interaction through a 5G network; the system transmits a video stream through H.264 coding and a WebRTC protocol, sensor data are packaged through JSON, and human shape control and chassis control information are independently processed. According to the invention, accurate remote force feedback and control can be realized, the time delay of human shape control is within 100ms, the time delay of chassis control is within 150ms, the problems of stability and time delay of remote cross-domain control are effectively solved, and the personal safety of operators in a dangerous working environment is guaranteed.

Technical field: The invention belongs to the field of online educational platforms and networks, specifically systems and methods for supporting students through online mentoring and tutoring. Abstract: The invention relates to an online mentoring and tutoring network for supporting students in achieving their learning goals. The network integrates experts from various fields who offer individually tailored guidance. A central, cloud-based system connects mentors and students, enabling scalable and secure data processing and storage. An algorithm using machine learning and AI analyzes student and mentor profiles to create optimal pairings. The platform supports real-time interactions through WebRTC technology, enabling video calls, chat, and screen sharing. Mentors create customized learning plans based on data analysis of learning progress and the student's individual needs. The platform utilizes big data and analytics tools to monitor learning progress and generate reports.After each session, students and mentors can provide ratings and feedback to continuously improve the support. Inventive achievement: The invention integrates modern technologies such as cloud computing, machine learning, AI, WebRTC, big data and sentiment analysis to create a personalized, efficient and flexible learning environment, offering a significant technological advancement over existing platforms.

Disclosed in the present application are an on-board interconnection method and apparatus, and an electronic device and a storage medium. The method is applied to a terminal side, and comprises: in response to a first user interconnection operation, establishing a basic interconnection with a head unit side; in response to a screen-mirroring instruction for a target application, determining corresponding interconnection scenario data on the basis of an application interconnection manner, and an application interface of the target application; and on the basis of WebRTC, establishing a real-time transport protocol channel with the head unit side, and sending the interconnection scenario data to the head unit side by means of the real-time transport protocol channel, and displaying the interconnection scenario data. By means of the technical solutions of the embodiments of the present application, a vehicle factory only needs to develop an on-board interconnection scheme to meet market and user requirements, thereby achieving high compatibility; and developers can realize control across all layers from upper-layer application to underlying implementation, such that upon encountering a problem, the solving efficiency is high, and problem localization is clear, thereby reducing the access difficulty of an on-board interconnection scenario and improving the development efficiency.

The application relates to the technical field of data communication, and discloses a device end data transmission method and system based on WebRTC technology, which establishes a communication network through WebRTC and an adaptive network protocol corresponding to the communication network, so that when the current network state is in a congested state, the data transmission rate is determined according to the network bandwidth and the round-trip delay, and when the current network state is in an idle state, the data transmission rate is determined according to the congestion window size and the packet loss rate. The network can accommodate the data amount based on the network bandwidth and the round-trip delay, and the data transmission rate is determined, the network bandwidth is fully utilized, the data preemption capability is improved, the congestion window size and the packet loss rate control the data transmission rate, the data error rate during data transmission is reduced, the reliability of data transmission is improved, the flexibility during WebRTC data transmission is improved from two aspects, and the data transmission effect is greatly improved.

Abstract of the application: The invention relates to a central digital platform in the field of educational technology that links various subject areas and promotes project-based learning approaches. The technical problem is that traditional education systems often teach isolated disciplines, which makes the practical application of knowledge in real-world contexts difficult. The invention's solution comprises a web-based platform that integrates interactive tools such as simulations, virtual laboratories, and data analysis software to enable the practical development of projects. The platform supports student teamwork and collaboration through WebRTC-based communication tools and provides teachers with a dashboard to monitor student progress. The platform enables the creation of interactive presentations and reports and ensures data security through access controls and encryption technologies.The main uses of the invention are in schools and educational institutions to promote interdisciplinary learning and the development of teamwork, critical thinking and creative problem-solving skills.

The application discloses an audio and video online communication system and method based on combination of 5G message and WebRTC, and the audio and video online alarm system comprises a 5G user terminal, an interrogator server, a signaling server, a logic processing server, a media server, a call plan database and a video storage database; the 5G user terminal is connected with the signaling server, the media server and the logic processing server respectively; the interrogator server is connected with the signaling server, the media server and the logic processing server respectively; the signaling server is connected with the logic processing server and the media server respectively; the logic processing server is connected with the call plan database; and the media server is connected with the video database. The application does not need to download and install an application and can communicate through a video.

The application relates to the technical field of Internet of Vehicles, and discloses a car-machine multi-screen cooperative display and interaction method, which comprises the following steps: maintaining a global session and a member view through a centralized session arranger, realizing session access and dynamic member management of multi-screen devices, and determining multi-screen related parameters; constructing a full-order execution rule based on a logical clock, the multi-screen related parameters and an operation identifier, and assigning a global serial number to each multi-screen operation; obtaining a focus of an operation request, and determining feedback parameters through a soft lock and a priority preemption strategy; periodically hashing and checking based on a shadow state and a domain Merkle tree, positioning state differences according to the feedback parameters, and performing incremental repair through an incremental patch; and adopting WebRTC layered coding and a weighted bandwidth allocation strategy, preferentially guaranteeing control signaling and a main driving screen experience, and dynamically adapting in a bandwidth-limited scene. The application can solve the problems of multi-screen interaction inconsistency and insufficient real-time performance, thereby improving the multi-screen cooperative experience in a vehicle.

The present invention relates to a method and a system for remotely controlling a robot by using multiple channels, the system comprising: a robot which captures an image by using a camera, and which transmits image / voice data in real time through a single image / audio channel; a relay server for receiving the image / voice data from the robot through the single image / audio channel, and transmitting the received image / voice data through a plurality of image / audio channels separated from the single image / audio channel; and a plurality of clients matched one-to-one with each of the plurality of image / audio channels so as to receive each piece of the image / audio data through the plurality of image / audio channels, wherein the single image / audio channel and the plurality of image / audio channels use the WebRTC protocol.

The present invention relates to a robot control system based on a microservice architecture and a method thereof. The robot control system and method can operate in a control environment based on a microservice architecture (MSA). The robot control system includes an application programming interface (API) gateway and an administrator terminal, the API gateway connects an authentication server for authenticating a robot, a management server for managing the robot, and an operation server for operating the robot to the robot in a hypertext transfer protocol (HTTP) communication manner, and the administrator terminal communicates with the robot through a web real-time communication (WebRTC).

The application relates to the technical field of the Internet of Things, in particular to a remote control method and device, equipment and a computer storage medium, the method comprises the following steps: acquiring user information; judging whether the user information has control authority; if the user information has control authority, receiving a user instruction; acquiring a target device based on the user instruction and a device list; establishing a WebRTC data channel based on a stun server and the target device; and sending a remote control signal to the target device based on the user instruction and the WebRTC data channel. The application has the effect of reducing data transmission delay.

The invention discloses a front-end-driven multi-channel video stream dynamic filtering and rendering method and system, belongs to the technical field of computer communication, and aims to solve the technical problem of how to solve member state synchronization abnormity and picture residue caused by network fluctuation and detection delay. Comprising the following steps: establishing a persistent bidirectional connection between a client and a converged communication message service background through a WebSocket protocol; many-to-many real-time communication is realized based on a WebRTC and MCU scheme; in combination with a WebSocket automatic reconnection mechanism and a WebRTC packet loss recovery mechanism, the reliability and stability of connection between the client and the converged communication message service background in a high-concurrency environment are enhanced; a Vue.js framework is used for front-end development, and a componentized and responsive user interface is achieved; front-end calculation is carried out, and signaling-service double-track data difference detection is triggered when members change; and the screen fusion service is requested again, and screen fusion video stream rendering is carried out.

The invention discloses an e-commerce platform purchase and sale two-way voice and video interaction method and system. The system comprises a purchaser terminal, a seller terminal and a server, and the server matches a preset audio and video acquisition and processing parameter template corresponding to a commodity category according to a commodity identifier sent by the purchaser terminal and issues the audio and video acquisition and processing parameter template to the seller terminal; the seller terminal configures an acquisition device based on the parameter template to acquire a target commodity, a point-to-point transmission channel is established through a WebRTC protocol to transmit audio and video streams, and the purchaser terminal synchronously plays the audio and video streams and displays associated service information. According to the invention, audio and video transmission optimization for different commodity types is realized through a commodity adaptive parameter template matching mechanism, the technical problems of weak network delay, unstable image quality, poor cross-terminal compatibility and the like in an e-commerce scene are effectively solved, and the definition and interaction experience of remote commodity display are improved.

The application relates to a screen projection method, device, system, computer equipment and storage medium. The method comprises the following steps: a playing end receives a sending end signaling from a sending end; the sending end signaling is a WebRTC signaling transmitted by the sending end through a UPnP protocol; the playing end generates a playing end signaling based on the sending end signaling, and sends the playing end signaling to the sending end through the UPnP protocol, so that the sending end and the playing end establish a WebRTC communication connection; and the playing end receives and displays real-time audio stream or mirror data from the sending end based on the WebRTC communication connection. The method can use the UPnP protocol as a signaling exchange channel of the WebRTC, realizes support and expansion of the WebRTC screen projection on the basis of the current mainstream DLNA screen projection function, does not increase hardware cost, does not reduce the popularity, and realizes mirror screen projection and real-time audio and video stream screen projection functions.

A video forwarding system based on ROS2 and WebRTC comprises a data acquisition and publishing module used for acquiring image data and publishing the image data to a corresponding ROS2 topic; the multi-process streaming pushing module is used for creating an independent streaming pushing sub-process for each path of video stream needing to be forwarded outwards and sending the video stream to the streaming media forwarding module; the streaming media forwarding module is used for receiving the independent video stream from the multi-process streaming pushing module and forwarding the video stream to a user terminal according to a user subscription relationship; the signaling and process management module is used for receiving an external instruction from a user side and dynamically creating or destroying the corresponding streaming pushing sub-process according to the instruction; and the user terminal module is used for sending an instruction to the signaling and process management module and subscribing and receiving the video stream from the streaming media forwarding module through the WebRTC technology. The method has the advantages of extremely low end-to-end delay, extremely low remote equipment resource occupation, strong expandability and flexibility and the like.

The invention provides a jitter buffer management method and device based on WebRTC, and relates to the technical field of WebRTC application, and the method comprises the steps: receiving RTP packets sent by a vehicle end, and recording the arrival time of each RTP packet; key network parameters are calculated according to the arrival time of each RTP packet and the basic parameters; initializing a double-layer buffer area and a buffer area state of the double-layer buffer area based on a buffer configuration parameter set determined by the key network parameters; respectively storing each RTP packet into a basic buffer layer or a burst buffer layer according to the priority label, and adjusting a buffer configuration parameter set and updating the buffer area state of the double-layer buffer area according to the change of the network burst state; and recovering the RTP packets in the packet loss state and storing the RTP packets in the double-layer buffer area according to the priority labels, and controlling each RTP packet currently stored in the double-layer buffer area to be output according to the target playing speed so as to relieve the technical problem that low delay and burst jitter resistance are difficult to coexist.

The invention provides a mobile device remote multi-person sharing method and system, and belongs to the technical field of software testing. The method comprises the following steps: connecting a mobile device, identifying the type of the device and the version of an operating system by a server, and completing authorization verification through two-factor authentication; a WebRTC protocol is adopted to establish a real-time data transmission channel, and a mobile device screen stream is coded and compressed and then transmitted to a control end; a cross-platform remote control interface is provided through a browser or a client, and a touch instruction input by a user is received and sent to a mobile device to be executed; a plurality of control ends access the same mobile device through independent operation authorities, and cooperative operation is achieved. The invention discloses a remote multi-person sharing method for mobile equipment, which can be used for remotely controlling the mobile equipment, realizing low-delay, high-efficiency and safe transmission of data and realizing high-efficiency and safe testing of mobile applications.

The invention relates to the technical field of cloud processing, in particular to a virtual workstation application method based on computing power scheduling, electronic equipment and a storage medium. An application end applies for a virtual workstation through a computing power scheduling platform; the platform dispatches a pre-created workstation; the cloud management platform prepares an application end data disk and a game disk (based on the latest Ceph snapshot); mounting a disk; starting a game server, and pushing a game stream through WebRTC; and closing and destroying the workstation after the application end exits. Compared with a traditional physical server mode, the hardware cost is remarkably reduced, and the method is suitable for old-using scenes; a ceph hierarchical storage framework is adopted, the newest snapshot is updated when the cloud computer game disk is created, it is ensured that the newest cloud game version can be obtained every time an application end applies for, and meanwhile storage space is saved.

The application provides a three-dimensional rendering engine for multi-source design model integration of ocean petroleum engineering, relates to the field of computer graphics and three-dimensional visualization technology, and comprises four layers of technical architecture: a cloud rendering layer realizes high-performance graphics processing based on a Vulkan API; a cloud transmission layer is responsible for pixel stream transmission and instruction interaction; an integrated SDK layer encapsulates common interfaces; and an application docking layer realizes business development. A service-side rendering plus pixel stream pushing technical route is adopted, low-delay video transmission is realized through WebRTC, instruction interaction is realized in combination with an MQTT protocol, rendering calculation is concentrated on the service side, and the client only needs to process video stream decoding. The model browsing frame rate of the application is not lower than 20 frames per second, the first preloading time is less than 1 minute, and the system response time after preloading is less than 3 seconds, so that the smooth display problem of large-scale three-dimensional models on ordinary terminal devices is effectively solved, and high-fidelity three-dimensional visualization support is provided for the whole business process of ocean engineering.

The invention relates to the technical field of audio and video communication transmission, and discloses a rear-end service image quality enhancement method and system for weak network low-delay transmission, and the method comprises the steps: obtaining an original audio and video stream transmitted by a WebRTC protocol through an SFU service, and monitoring a network quality index of a video stream transmission channel in real time, the network quality indexes comprise bandwidth, transmission delay and packet loss rate; performing back-end image quality enhancement processing on the original audio and video stream, wherein the processing comprises super-resolution reconstruction, image detail enhancement and deblurring repair; and forwarding the enhanced video stream to a receiving end by the SFU service, and ensuring end-to-end low-delay transmission by optimizing coding parameters and a transmission path. According to the technical scheme, the video stream is obtained through the SFU service and the image quality is enhanced at the rear end, so that the video quality in the weak network environment is improved, the transmission delay and the video image quality are effectively balanced, and the method is particularly suitable for weak network video stream transmission under the SFU architecture.

A live streaming method lets organizers broadcast real-time online competitions or events over the internet with high-speed streaming and real-time voting, and with layered audio on top of the webRTC channel. It is completely developed on Real-time Communication and considers organizers, hosts, participants, and audience members. An interactive event experience strategically synchronizes multiple live events happening at one or more places. With the app, only the broadcaster / host / organizer would have the authority to start an event and would have all the controls. The host can invite multiple participants to join the live broadcast, and this sets the client role in WebRTC as a participant. In addition, the host can broadcast and record an event or competition which is viewed from multiple angles using multiple mobile devices such as a mobile phone.

An apparatus includes a communication interface and a processor operably coupled to the communication interface. The processor is configured to receive an expected service level agreement (SLA) for a media service from a service provider, where the media service includes a plurality of media flows. The processor is also configured to provision a network slice that includes media functions based on the expected SLA. The processor is further configured to configure the media functions in the network slice with flow prioritization information for each media flow among the plurality of media flows. Additionally, the processor is configured to determine performance of each of the media flows. The processor is also configured to perform adjustment of the service parameters based on the determination that the performance of one or more of the media flows is below the expected SLA.

The invention discloses a video conference shared content authenticity detection method based on an AI large model, and the method comprises the following steps: S1, employing a WebRTC protocol to transmit audio data through audio streams of teaching or training explanation captured by a video conference system in real time; s2, converting the unstructured audio data into a structured text which retains original language features and time sequence information; s3, cleaning the transwritten text to remove metadata, performing intelligent sentence segmentation based on semantics, and unifying a text coding format; s4, guiding an AI large model based on customized special cue words, extracting target text features from multiple dimensions, and carrying out analysis; step S5, adopting a weighted multi-feature fusion model to distribute corresponding weights for feature similarities of all dimensions and calculate a total similarity; and S6, generating a structured report containing the similarity percentage, the judgment basis and the abnormal paragraph, and returning a detection result to the video conference system.

The application relates to the technical field of remote control, in particular to a video assistance and device remote calling method and device based on WebRTC. The method comprises the following steps: establishing a WebRTC connection, a local terminal initiates a device information acquisition request to a remote terminal; after the remote terminal receives the device information acquisition request, the remote terminal collects device information through a hardware peripheral manager and returns the device information to the remote terminal; after the local terminal receives the device information, interface compatibility of hardware peripheral calling interface information contained in the device information is checked, if the interface is incompatible, a user is prompted to perform version matching upgrade, otherwise, the next step is performed; after the local terminal completes the device information checking and verification, whether the corresponding version of the remote hardware peripheral calling plug-in has been installed in the local terminal is checked; the device can support data types output by block devices and stream devices at the same time, and better performance and interactive experience are provided.