1503 results about "Videoconferencing" patented technology

A neural end-to-end system is provided for the face and voice preserving translation of videos. The system is a pipeline of multiple models that produces a video of the original speaker speaking in the target language with modified lip movement to match the target speech, while preserving emphases and prosody of the original speech, and voice characteristics of the original speaker. The pipeline starts with automatic speech recognition including emphasis detection, followed by the translation model. The translated text is then synthesized by a Text-to-Speech model that recreates the original emphases in the target sentence. The resulting synthetic speech is then converted back to the original speakers' voice using a voice conversion model. Finally, to synchronize the lips of the speaker with the translated audio, a generative model generates frames of adapted lip movements which are combined with the audio to produce the final output. The disclosure further describes several use-cases and configurations that apply these techniques to video conferencing, dubbing, low-bandwidth transmission, speech enhancement and assistive technology for the hearing impaired.

The invention provides a multi-language cross-culture communication assisting method and system based on a large model. The method comprises the following steps: receiving a source language audio stream during a call, calling a multi-language sound frequency harmonic modulation feature library to extract fundamental frequency harmonic intensity distribution and tone turning features, and generating a cultural acoustic fingerprint vector; based on the vector, controlling a microphone array phase difference, directionally enhancing a fundamental frequency harmonic component of a speaker and suppressing noise, and outputting a high signal-to-noise ratio spectrogram; analyzing the pronunciation rhythm and tone turning characteristics of the spectrogram, capturing the pitch jump and duration of the syllable boundary, and generating an acoustic culture label; associating the spectrogram with a target semantic library, matching harmonic distribution and a cultural context rule based on a large model, and outputting a cultural interpretation prompt containing an ambiguity resolution suggestion; and generating a calibration result according to the acoustic tag and the semantic prompt, and overlapping the dynamic floating subtitles to the face area of the speaker in the video conference picture. According to the invention, cultural tone ambiguity in multi-language communication is eliminated.

Systems and methods for generating online meeting summaries for videoconferencing are provided. For example, a computing device establishes a video conference for a plurality of participants. While the video conference is in progress, the computing device receives a first portion of a transcript of the video conference and generates a first meeting summary based on the first portion of the transcript. The computing device causes the first meeting summary to be presented in a user interface accessible by a client computing device associated with at least one of the plurality of participants. The computing device receives a second portion of the transcript of the video conference and generates a second meeting summary based on the first portion and the second portion of the transcript. The computing device causes the second meeting summary to be presented in the user interface.

The present disclosure generally relates to embodiments for video communication interface for managing content that is shared during a video communication session.

Systems, methods, and apparatuses are described for enhancing a user experience in event live streaming applications such as video conferencing systems. In an example, first and second virtual meetings are scheduled, each meeting scheduled to include a presentation of the same document. The document is stored in a cloud storage and is associated with both the first meeting and the second meeting. During the first meeting and the second meeting, respective virtual meeting communication data is captured and stored in the cloud storage as metadata associated with the document, and associated with the respective first or second meeting during which it was captured. After the meetings conclude, a user accesses the document and is presented with an option to view the metadata associated with the first or second meeting.

Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

The invention relates to the technical field of network communication and route management, in particular to an intelligent router flow management method for a home scene, which comprises the following steps that: a home router collects network activity data of equipment, including data flow size, connection frequency and equipment type, performs cleaning and formatting processing, and stores the data flow size, the connection frequency and the equipment type; formatted device behavior data is generated. According to the method for analyzing the behavior data of the home network equipment based on the long and short-term memory network, the prediction precision of the periodicity and dependency of user behaviors is improved, and the allocation of bandwidth resources is more prospective and dynamic. Specifically, resources can be automatically adjusted according to predicted data requirements, and particularly in the peak period of requirements, it is ensured that key applications such as video conferences and online education preferentially obtain necessary network resources. According to the flow management technology, the overall operation efficiency of the network is improved by optimizing bandwidth utilization and reducing network congestion.

The invention provides a double-stream video conference privacy tracing method based on a block chain, and the method comprises the steps: building a tracing evidence obtaining model which comprises information uplink and tracing evidence obtaining; the information uploading comprises the following steps: in a video conference process, audio and video data and related conference information are uploaded to an interstellar file system for storage and verification after being subjected to encryption and signature processing through a threshold ring signature mechanism, and key evidence is uploaded to a block chain; the intelligent contract is used for automatically managing data storage; the traceability evidence obtaining comprises the following steps: after leaked picture information is obtained, detecting a traceability identifier in a video or a picture, and comparing the traceability identifier with information stored on a chain; a secret divulging block point is automatically tracked and positioned through an intelligent contract, and the real identity of a secret divulging party is decrypted. According to the method, tampering resistance, transparency, decentration and anonymity of chain information in the traceability evidence obtaining process are achieved, and automatic evidence obtaining and traceability operation is supported.

Systems and methods for expanding chat communication groups based on a chat context are provided. In an example, a chat and video conference provider establishes a first chat communication group for exchanging chat messages between a plurality of client devices and generates a chat summary for a subset of the chat messages within the first chat communication group. The chat and video conference provider determines a relevant user of the first chat communication group based on the chat summary and provides a recommendation for inviting the relevant user a second chat communication group. The chat and video conference provider establishes the second chat communication group and presents the chat summary in the second chat communication group in response to the relevant user joining the second chat communication group.

Systems and methods for generating speaker video and audio in multiple languages for videoconferencing are provided. For example, a computing device can access a speaker speech audio signal that includes a speaker speech in a first language, a video of the speaker and a translated speech audio signal of the speaker speech in a second language. The computing device generates, based on the translated speech audio signal, a converted translated speech audio signal that includes a speech in the second language having voice characteristics in the speaker speech. The computing device further generates a lip-synched speaker video based on the video of the speaker and the converted translated speech audio signal. Lip movements in the lip-synched speaker video correspond to the converted translated speech audio signal. The converted translated speech audio signal and the lip-synched speaker video are transmitted to a video conference provider configured to host the video conference.

A unified virtual background image is generated for multiple participants of a video conference to create an immersive conference experience based on its use within video streams of those multiple participants. Generative artificial intelligence software associated with a conferencing system obtains input associated with a video conference. The generative artificial intelligence software generates a virtual background image based on the input. The virtual background image is then for use within multiple participant video streams during the video conference

An imaging system improves image quality, such as during a videoconference, by adjusting one or more captured images based on a model of a scene, a conference participant's face or a combination thereof. The images are adjusted in response to identification of relatively poor ambient conditions for image capture. The imaging system, such as a videoconference system, is thus able to display relatively high-quality images even in relatively poor conditions for image capture.

A video conferencing method comprising a first and a second video conferencing device. In each video conferencing device, video images of a user are captured, transmitted to the other, remote video conferencing device, and displayed there by a display device. The invention further relates to a video conferencing system comprising a first video conferencing device having a first display device and a first image capture device, and comprising a second video conferencing device having a second display device and a second image capture device.

The invention relates to the technical field of data analysis and processing, in particular to an identity data analysis method based on a spatial frequency sensing fusion network, and the method specifically comprises the following steps: collecting identity data to be detected, and marking real identity information; preprocessing the collected identity data, and dividing the collected identity data into a training set and a test set in proportion; constructing a spatial frequency sensing multi-scale network for real-time deep identity analysis, and training the network; inputting the identity data in the test set into the trained network for forgery detection and prediction, and outputting a probability score that each identity is true or false so as to obtain an identity analysis result. By constructing a lightweight deep neural network structure which combines space and frequency feature perception and has a multi-scale fusion capability, the method can be used for efficiently detecting identity information in actual scenes such as video conferences and social media.

Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

The invention discloses an artificial intelligence automatic response conference assistant, and particularly relates to the technical field of intelligent video conferences. The system comprises a user interface used for displaying conference information, function options and execution results, a large language model used for natural language processing and understanding, and a language recognition module used for converting voice input into characters to achieve real-time conference recording and voice instruction recognition. By means of friendly user interface design, conference information, function options and execution results can be visually displayed, a user can easily operate and master the whole conference process, the voice recognition module adopts a high-quality recording module, voice content in a conference is accurately transferred into characters in real time, and the user experience is improved. The completeness and the accuracy of conference records are ensured, the large language model further performs semantic understanding and processing on the transferred text, intelligent conference abstracts and responses are generated, a user is helped to rapidly obtain key information, and the postprocessing module automatically sends the abstracts to a user mailbox to achieve the purpose of meeting. Or the system is automatically integrated to an online office system of a user, so that a lot of time and energy are saved.

The invention relates to the field of network communication, and particularly discloses a network self-adaptive video conference transmission optimization method and system, and the method comprises the steps: systematically analyzing a historical data sequence of a network state, and extracting a deep trend and mode of a network behavior from the historical data sequence; meanwhile, different requirements of the type of the current conference video frame on transmission parameters (especially code rates) are fully considered, and the key information is fused into a decision-making process. Through a specially designed fusion model, the historical evolution trend of the network state and the specific requirement of the current video content can be intelligently subjected to interactive perception and cooperative processing, so that a video target code rate which can adapt to future network fluctuation and can meet the current picture quality requirement is generated. Based on the dynamically optimized target code rate, the system further determines an appropriate target resolution and an appropriate target frame rate, and the video is coded and transmitted.

The invention relates to the technical field of video conferences, and discloses a real-time document collaborative editing and synchronizing method in a video conference, which is used for solving the problem of insufficient concurrent editing conflict solving mechanism in the traditional method. The method comprises the following steps: firstly, receiving document editing operations submitted by a plurality of participants through a terminal, and establishing an operation sequence; comparing the timestamps with the position information, identifying concurrent operation groups as conflict sets, and arranging the conflict sets according to a time sequence; types and contents are extracted from the conflict set, semantic matching is carried out, matching operation is converted into a compatible sequence, and subsequent position offset is adjusted; distributing the compatible sequence to a synchronous buffer area, updating a server document state, and generating an incremental update package; a packet is pushed to the online terminal, application changes are buffered locally, and sequence playback is provided for a new participant; the monitoring terminal confirms the signal, re-deduces the unconfirmed change, and circularly checks the Hash consistency; according to the method, conflict resolution is optimized through semantic matching and offset adjustment, and efficient synchronization is achieved.

Communications between participants of a video conference are accentuated based on a participant's focus. A first participant of a video conference is determined to be focused on a user interface element associated with a second participant of the video conference. Responsive to the determining that the first participant is focused on the user interface element associated with the second participant, relative audio levels of communications are changed for the second participant such that a first audio level for communications from the first participant to the second participant is higher than a second audio level for other communications received by the second participant.

A video conferencing system for a vehicle includes a display device disposed in a passenger compartment of the vehicle, the display device comprising a screen, a first imager configured to capture a first image data corresponding to a field of view of a passenger compartment of the vehicle, at least one microphone configured to collect audio data from within the passenger compartment, and a controller. The controller is configured detect a display prompt within the image data corresponding to a portion of the image data received from the first imager, detect an audio prompt within a predetermined zone of the passenger compartment of the vehicle, and selectively crop the first image data according to the portion of the image data corresponding with the display prompt in response to determining a correlation between the portion of the image data and the zone of the passenger department associated with the audio prompt.

The invention provides a video conference method, system and device and a storage medium, and relates to the technical field of network communication, the method comprises the following steps: obtaining network performance information, user behavior information, video quality information and retrieval service use information, the retrieval service use information comprising a retrieval service calling state; taking the network performance information, the user behavior information and the video quality information as input, and obtaining a predicted code rate through a pre-constructed first parameter adjustment model; judging whether the retrieval service is called or not according to the calling state of the retrieval service, and if not, adjusting the video parameters according to the predicted code rate; and if yes, obtaining a preset resolution and a preset frame rate, calculating a video code rate to obtain a target code rate, and adjusting the video parameters according to the target code rate. According to the method, the optimal video code rate is predicted in the conference process through the pre-trained first parameter adjustment model, and the video data transmission parameters are adjusted according to the retrieval behavior of the user, so that the information acquisition efficiency of the user is improved.

The invention discloses a video conference multi-modal data alignment method and device based on a causal mask, equipment and a medium, and relates to the technical field of computers, and the method comprises the steps: carrying out the feature extraction and fusion of an original audio, an original video stream and an original document in an online video conference, time sequence division is carried out based on the obtained multi-modal fusion features to obtain a triple time sequence window; determining an initial weight value corresponding to the triple time sequence window, and performing normalization adjustment on the initial weight value by using a preset constraint condition to obtain an adjusted weight; indexing a preset time sequence offset matrix by using a speaking identifier of a speaking party, correcting an original time sequence of the triple time sequence window based on an indexing result, and determining a target attention result corresponding to the triple time sequence window by using a preset causal mask mechanism, and performing multi-level alignment fusion on the multi-modal fusion features based on the target attention result to obtain a multi-modal alignment result. The precision of the multi-mode alignment technology is improved, and future information leakage is avoided.

Implementations are provided for leveraging video conference tools to streamline machine learning model training relating to robot (and non-robot) planning and / or control, and / or for subsequent robot management. In various implementations, video conference client(s) of a video conference session may render output that includes sensor feed(s) capturing an environment in which a robot operates. A robotic planner process may be communicatively coupled to the video conference session. A natural language (NL) request for the robot to perform a high-level task may be received. The robotic planner process may process the NL request using a first machine learning model to generate NL responses, each expressing a mid- level action to be performed by the robot to carry out a respective portion of the high-level task. In some implementations, the NL responses may be processed to generate robot control data that may be used to operate a robot.

The invention provides a positioning system that autonomously and continuously positions interchangeable camera devices on the subject as they move allowing the camera device to leverage its native functionality without modification or connectivity to the MTDS. The embodiments of the MTDS are configured to attach and align varying size of digital cameras, video cameras, mobile devices with a camera, or smart assistants with an embedded camera, action camera, webcam or laptop with embedded camera to the stand. The MTDS tracks the movements of the user during any video conference, photography or videography session. The MTDS includes a sensor, separate from the camera on the camera device, that sends the sensor data stream to a microcontroller in the stand and a machine learning co-processor detects the presence of a person. As the speaker or subject (user) moves, the MTDS tracks their movements and directs motors in the stand to pan or tilt the stand to orient the camera device's camera at the user. Through movement of the stand, the speaker or user stays centered in the camera frame. No data connections or software integrations are required to operate the MTDS.

Systems and methods are provided for optimizing a user interface display in a video conferencing environment. In some embodiments, the systems and methods receive conference feeds for each of a plurality of participants in a video conference. In some embodiments, the systems determine, based on historical interaction data for one or more participants of the plurality of participants, an interaction score for the one or more participants of the plurality of participants. In some embodiments, the systems generate, based on the determined interaction score, a first arrangement of representations of the conference feeds in a user interface. In some embodiments, the systems provide for presentation in the user interface the first arrangement of the conference feeds.

Systems, methods, and apparatuses are described for verifying a user identity in a video conference. A computing device may receive user data and a plurality of security parameters associated with accessing a video conference based on a confidentiality level of the video conference. The computing device may generate a security code that is encoded with user data. The computing device might cause the security code to be displayed on the mobile device for a predetermined time period. The computing device may receive an indication that the first device scanned the security code by using a camera. To verify the identity of a user, the computing device may decode the security code, compare the decoded user data of the decoded security code and expected user data associated with the video conference. The computing device may determine the authenticity of a user video and allow access to the video conference.

Systems and methods are provided herein for only including portions of a user's environment that have been approved by a user in a video conference while excluding portions that have not been approved. This may be accomplished by a device receiving a policy identifying one or more approved objects of a scene of a video stream. The device may then generate a filtered video stream by only including portions of the scene that comprise the one or more objects that were approved by the policy in the filtered video stream. The filtered video stream may be combined with other video streams to generate a video conference that is transmitted and / or stored by one or more devices participating in the video conference.

Systems and methods for performing integrity verification of content in a video conference using lighting adjustment are provided. An example method includes determining that an integrity verification of video content generated by a first client device of a plurality of client devices of a plurality of participants of a video conference is to be performed; causing a modified UI comprising one or more visual items, each corresponding to a video stream, to be presented on the first client device, wherein the UI was modified using a color pattern encoding; receiving, from the first client device, a video stream generated by the first client device subsequent to a presentation of the modified UI on the first client device; and verifying the integrity of the video content generated by the first client device based on the video stream generated by the first client device and the color pattern encoding.

The invention discloses a remote state monitoring system for a portable video conference device, relates to the technical field of equipment monitoring, and solves the problems that the use monitoring data of conference equipment is acquired by using a set frequency in the prior art, and when the set frequency is relatively high, the abnormal condition of the conference equipment cannot be identified in time, so that the use safety of the conference equipment is influenced. And normal proceeding of the conference is influenced. The method comprises the following steps: acquiring real-time data of conference equipment through a data sensor, and preprocessing the real-time data to obtain operation data; analyzing the acquisition frequency of the real-time data according to the operation data; calling operation data in a set time period based on the acquisition frequency, and analyzing the operation state of the conference equipment according to the operation data in the set time period; adjusting parameters of the conference equipment according to the running state; testing the adjusted conference equipment to obtain a test result; the adjustment of the parameters is optimized according to a test result; abnormity of the conference equipment can be found in time, and normal operation of the conference equipment can be ensured.

The invention provides a method and a system for evaluating the health degree of audio and video conference equipment, which comprehensively utilize a QFD thought and AHP and AI methods to construct an equipment fault model and a fault risk transfer model, solve the field problem of fault influence dependency analysis among an equipment principle, a real-time operation state and a historical operation state in equipment fault detection, and improve the reliability of the equipment fault detection. The evaluation method comprises the following steps: scanning a basic state in real time and detecting an environment in real time; verifying the integrity of the signal link; carrying out equipment performance standard test; the influence of the hardware loss on functionality is evaluated; performing actual use state testing, including limiting condition testing and fault injection testing; and performing health degree modeling and grading, and establishing a multi-dimensional comprehensive evaluation model. According to the method, a traditional regular maintenance mode is exceeded through multi-dimensional dynamic modeling and a predictive intervention mechanism, real-time environment sensing and hardware loss modeling are fused, a fault window can be pre-judged, the equipment operation fault rate is reduced, and preventive maintenance is achieved.