2186 results about "Videoconferencing" patented technology

Systems and methods for video summary generation are disclosed. A chat and video conference provider generates a text summary for a meeting video and an audio summary based on the text summary. The chat and video conference provider determines a first set of correspondences between a first set of video portions from the meeting video and portions of the text summary based on a transcript of the meeting video. The chat and video conference provider determines a second set of correspondences between a second set of video portions from the meeting video and the portions of the text summary based on image data of the meeting video. The chat and video conference provider selects a plurality of video frames from the first set of the correspondences and the second set of correspondences to generate a video summary of the meeting video based on the audio summary.

A neural end-to-end system is provided for the face and voice preserving translation of videos. The system is a pipeline of multiple models that produces a video of the original speaker speaking in the target language with modified lip movement to match the target speech, while preserving emphases and prosody of the original speech, and voice characteristics of the original speaker. The pipeline starts with automatic speech recognition including emphasis detection, followed by the translation model. The translated text is then synthesized by a Text-to-Speech model that recreates the original emphases in the target sentence. The resulting synthetic speech is then converted back to the original speakers' voice using a voice conversion model. Finally, to synchronize the lips of the speaker with the translated audio, a generative model generates frames of adapted lip movements which are combined with the audio to produce the final output. The disclosure further describes several use-cases and configurations that apply these techniques to video conferencing, dubbing, low-bandwidth transmission, speech enhancement and assistive technology for the hearing impaired.

Some examples involve an artificial intelligence (AI) system for handling a query about a conversation, such as a conversation between attendees of a videoconferencing meeting. As one example, the system can receive a query from a user about a conversation between attendees of a videoconferencing meeting. The system can determine a relevant portion of the conversation based on the query, determine an intent of the query by providing the query as input to an intent detection model, and select a machine-learning model from among a group of machine-learning models based on the intent of the query. The system can then provide the relevant portion of the conversation as input to the selected machine-learning model. The machine-learning model can generate an output based on the relevant portion of the conversation. The system can transmit the output to the user in a response to the query.

The invention provides a multi-language cross-culture communication assisting method and system based on a large model. The method comprises the following steps: receiving a source language audio stream during a call, calling a multi-language sound frequency harmonic modulation feature library to extract fundamental frequency harmonic intensity distribution and tone turning features, and generating a cultural acoustic fingerprint vector; based on the vector, controlling a microphone array phase difference, directionally enhancing a fundamental frequency harmonic component of a speaker and suppressing noise, and outputting a high signal-to-noise ratio spectrogram; analyzing the pronunciation rhythm and tone turning characteristics of the spectrogram, capturing the pitch jump and duration of the syllable boundary, and generating an acoustic culture label; associating the spectrogram with a target semantic library, matching harmonic distribution and a cultural context rule based on a large model, and outputting a cultural interpretation prompt containing an ambiguity resolution suggestion; and generating a calibration result according to the acoustic tag and the semantic prompt, and overlapping the dynamic floating subtitles to the face area of the speaker in the video conference picture. According to the invention, cultural tone ambiguity in multi-language communication is eliminated.

Methods and systems for real-time video enhancement are provided herein. A current frame of a video stream generated by a client device of a plurality of client devices participating in the video conference is identified during a video conference. An enhanced previous frame corresponding to an enhanced version of a previous frame in the video stream is identified. At least the current frame and the enhanced previous frame are provided as input to a machine-learning model. An output of the machine learning model is obtained. The output of the machine learning model indicates an enhanced current frame corresponding to an enhanced version of the current frame. The current frame is replaced with the enhanced current frame in the video stream.

Systems and methods for generating online meeting summaries for videoconferencing are provided. For example, a computing device establishes a video conference for a plurality of participants. While the video conference is in progress, the computing device receives a first portion of a transcript of the video conference and generates a first meeting summary based on the first portion of the transcript. The computing device causes the first meeting summary to be presented in a user interface accessible by a client computing device associated with at least one of the plurality of participants. The computing device receives a second portion of the transcript of the video conference and generates a second meeting summary based on the first portion and the second portion of the transcript. The computing device causes the second meeting summary to be presented in the user interface.

Techniques for using collaborative conversational artificial intelligence during video conferencing are provided. In an example method, a video conference provider joins first and second client devices to a video conference. The video conference provider receives, from the first client device, a first prompt and relays the first prompt to a conversational AI, which is followed by receipt of a first response. The video conference provider then outputs, to the second client device, a data structure including information about the first prompt and the first response. In some examples, the video conference provider receives, from the second client device, a second prompt and relays the second prompt to the conversational AI, which is followed by receipt of a second response. The video conference provider then outputs, to the first client device, a data structure including information about the second prompt and the second response.

The present disclosure generally relates to embodiments for video communication interface for managing content that is shared during a video communication session.

Systems, methods, and apparatuses are described for enhancing a user experience in event live streaming applications such as video conferencing systems. In an example, first and second virtual meetings are scheduled, each meeting scheduled to include a presentation of the same document. The document is stored in a cloud storage and is associated with both the first meeting and the second meeting. During the first meeting and the second meeting, respective virtual meeting communication data is captured and stored in the cloud storage as metadata associated with the document, and associated with the respective first or second meeting during which it was captured. After the meetings conclude, a user accesses the document and is presented with an option to view the metadata associated with the first or second meeting.

Embodiments herein generally relate to video-conferencing systems, and more particularly a method and system for optimally grouping and auto-cropping a field of view (FOV) of the video-conferencing system based on predefined preferences, such as preferences determined by a user. Generally, embodiments of the disclosure provided herein include a video-conferencing system that is configured to update the presentation of participants within a video conference to regularly determine the optimal presentation of the participants at any given moment in time based on predetermined preferences, while mitigating defects and related unwanted distractions typically generated in the video conference presentation due to the changes provided in the updates. Embodiments of the disclosure allow the predetermined preferences to each be given an importance level rating so as to allow the presentation of the participants to be optimally provided without making unnecessary and / or distracting updates to the video conference presentation, and also help resolve conflicting or competing attributes of related preferences.

Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

Techniques for gaze-based video conference prompts are described that leverage eye-tracking algorithms within a video conference setting to perform a variety of functionality. For instance, a computing device displays a user interface of a video conference session that includes representations of video conference attendees. The computing device receives video content that depicts a user of the computing device and uses eye tracking techniques to determine a gaze location of the user based on the video content. The gaze location corresponds to one of the representations of an attendee. The computing device then communicates a prompt to one or more of the attendees that indicates the gaze location. In another example, the computing device detects a behavior of the user, e.g., a scanning behavior. Responsive to detection of the behavior, the computing device performs an action within the user interface, such as to display a roster view of the attendees.

The invention relates to the technical field of network communication and route management, in particular to an intelligent router flow management method for a home scene, which comprises the following steps that: a home router collects network activity data of equipment, including data flow size, connection frequency and equipment type, performs cleaning and formatting processing, and stores the data flow size, the connection frequency and the equipment type; formatted device behavior data is generated. According to the method for analyzing the behavior data of the home network equipment based on the long and short-term memory network, the prediction precision of the periodicity and dependency of user behaviors is improved, and the allocation of bandwidth resources is more prospective and dynamic. Specifically, resources can be automatically adjusted according to predicted data requirements, and particularly in the peak period of requirements, it is ensured that key applications such as video conferences and online education preferentially obtain necessary network resources. According to the flow management technology, the overall operation efficiency of the network is improved by optimizing bandwidth utilization and reducing network congestion.

The invention provides a double-stream video conference privacy tracing method based on a block chain, and the method comprises the steps: building a tracing evidence obtaining model which comprises information uplink and tracing evidence obtaining; the information uploading comprises the following steps: in a video conference process, audio and video data and related conference information are uploaded to an interstellar file system for storage and verification after being subjected to encryption and signature processing through a threshold ring signature mechanism, and key evidence is uploaded to a block chain; the intelligent contract is used for automatically managing data storage; the traceability evidence obtaining comprises the following steps: after leaked picture information is obtained, detecting a traceability identifier in a video or a picture, and comparing the traceability identifier with information stored on a chain; a secret divulging block point is automatically tracked and positioned through an intelligent contract, and the real identity of a secret divulging party is decrypted. According to the method, tampering resistance, transparency, decentration and anonymity of chain information in the traceability evidence obtaining process are achieved, and automatic evidence obtaining and traceability operation is supported.

Systems and methods for expanding chat communication groups based on a chat context are provided. In an example, a chat and video conference provider establishes a first chat communication group for exchanging chat messages between a plurality of client devices and generates a chat summary for a subset of the chat messages within the first chat communication group. The chat and video conference provider determines a relevant user of the first chat communication group based on the chat summary and provides a recommendation for inviting the relevant user a second chat communication group. The chat and video conference provider establishes the second chat communication group and presents the chat summary in the second chat communication group in response to the relevant user joining the second chat communication group.

Systems and methods for generating speaker video and audio in multiple languages for videoconferencing are provided. For example, a computing device can access a speaker speech audio signal that includes a speaker speech in a first language, a video of the speaker and a translated speech audio signal of the speaker speech in a second language. The computing device generates, based on the translated speech audio signal, a converted translated speech audio signal that includes a speech in the second language having voice characteristics in the speaker speech. The computing device further generates a lip-synched speaker video based on the video of the speaker and the converted translated speech audio signal. Lip movements in the lip-synched speaker video correspond to the converted translated speech audio signal. The converted translated speech audio signal and the lip-synched speaker video are transmitted to a video conference provider configured to host the video conference.

A unified virtual background image is generated for multiple participants of a video conference to create an immersive conference experience based on its use within video streams of those multiple participants. Generative artificial intelligence software associated with a conferencing system obtains input associated with a video conference. The generative artificial intelligence software generates a virtual background image based on the input. The virtual background image is then for use within multiple participant video streams during the video conference

An imaging system improves image quality, such as during a videoconference, by adjusting one or more captured images based on a model of a scene, a conference participant's face or a combination thereof. The images are adjusted in response to identification of relatively poor ambient conditions for image capture. The imaging system, such as a videoconference system, is thus able to display relatively high-quality images even in relatively poor conditions for image capture.

A video conferencing method comprising a first and a second video conferencing device. In each video conferencing device, video images of a user are captured, transmitted to the other, remote video conferencing device, and displayed there by a display device. The invention further relates to a video conferencing system comprising a first video conferencing device having a first display device and a first image capture device, and comprising a second video conferencing device having a second display device and a second image capture device.

The invention relates to the technical field of data analysis and processing, in particular to an identity data analysis method based on a spatial frequency sensing fusion network, and the method specifically comprises the following steps: collecting identity data to be detected, and marking real identity information; preprocessing the collected identity data, and dividing the collected identity data into a training set and a test set in proportion; constructing a spatial frequency sensing multi-scale network for real-time deep identity analysis, and training the network; inputting the identity data in the test set into the trained network for forgery detection and prediction, and outputting a probability score that each identity is true or false so as to obtain an identity analysis result. By constructing a lightweight deep neural network structure which combines space and frequency feature perception and has a multi-scale fusion capability, the method can be used for efficiently detecting identity information in actual scenes such as video conferences and social media.

Some embodiments provide a method for initiating a video conference using a first mobile device. The method presents, during an audio call through a wireless communication network with a second device, a selectable user-interface (UI) item on the first mobile device for switching from the audio call to the video conference. The method receives a selection of the selectable UI item. The method initiates the video conference without terminating the audio call. The method terminates the audio call before allowing the first and second devices to present audio and video data exchanged through the video conference.

Systems and methods for determining video streams for presentation in a user interface (UI) of a video conference are provided. In response to a request of a first user of a video conference platform to participate in video conference, a user priority list associated with the first user is accessed. The user priority list identifies a plurality of users of the video conference platform. Participants of the video conference are identified. The participants include the first user associated with a first client device of client devices of the participants of the video conference. A UI presenting video streams from client devices of at least a subset of the participants is provided for display on the first client device. presentation of each of the video streams in the UI depends on whether a respective participant of the at least the subset of the participants is included in the user priority list.

Methods and systems for mapping video conferencing content to video frames are provided. In an example method, a processing device receives video conference information and a digital video, the digital video including a plurality of frames. The processing device segments the video conference information into one or more video-conference time segments and the digital video into one or more digital-video time segments. The processing device associates each video-conference time segment with a digital-video time segment. The processing device maps first content information of a first video-conference time segment of the one or more video-conference time segments onto a first digital-video time segment associated with the first video-conference time segment based a first identifier of the first content information. The processing device causes the first content information to be displayed during a displaying of the digital video.

The invention discloses an artificial intelligence automatic response conference assistant, and particularly relates to the technical field of intelligent video conferences. The system comprises a user interface used for displaying conference information, function options and execution results, a large language model used for natural language processing and understanding, and a language recognition module used for converting voice input into characters to achieve real-time conference recording and voice instruction recognition. By means of friendly user interface design, conference information, function options and execution results can be visually displayed, a user can easily operate and master the whole conference process, the voice recognition module adopts a high-quality recording module, voice content in a conference is accurately transferred into characters in real time, and the user experience is improved. The completeness and the accuracy of conference records are ensured, the large language model further performs semantic understanding and processing on the transferred text, intelligent conference abstracts and responses are generated, a user is helped to rapidly obtain key information, and the postprocessing module automatically sends the abstracts to a user mailbox to achieve the purpose of meeting. Or the system is automatically integrated to an online office system of a user, so that a lot of time and energy are saved.

The invention relates to the field of network communication, and particularly discloses a network self-adaptive video conference transmission optimization method and system, and the method comprises the steps: systematically analyzing a historical data sequence of a network state, and extracting a deep trend and mode of a network behavior from the historical data sequence; meanwhile, different requirements of the type of the current conference video frame on transmission parameters (especially code rates) are fully considered, and the key information is fused into a decision-making process. Through a specially designed fusion model, the historical evolution trend of the network state and the specific requirement of the current video content can be intelligently subjected to interactive perception and cooperative processing, so that a video target code rate which can adapt to future network fluctuation and can meet the current picture quality requirement is generated. Based on the dynamically optimized target code rate, the system further determines an appropriate target resolution and an appropriate target frame rate, and the video is coded and transmitted.

The invention relates to the technical field of video conferences, and discloses a real-time document collaborative editing and synchronizing method in a video conference, which is used for solving the problem of insufficient concurrent editing conflict solving mechanism in the traditional method. The method comprises the following steps: firstly, receiving document editing operations submitted by a plurality of participants through a terminal, and establishing an operation sequence; comparing the timestamps with the position information, identifying concurrent operation groups as conflict sets, and arranging the conflict sets according to a time sequence; types and contents are extracted from the conflict set, semantic matching is carried out, matching operation is converted into a compatible sequence, and subsequent position offset is adjusted; distributing the compatible sequence to a synchronous buffer area, updating a server document state, and generating an incremental update package; a packet is pushed to the online terminal, application changes are buffered locally, and sequence playback is provided for a new participant; the monitoring terminal confirms the signal, re-deduces the unconfirmed change, and circularly checks the Hash consistency; according to the method, conflict resolution is optimized through semantic matching and offset adjustment, and efficient synchronization is achieved.

Communications between participants of a video conference are accentuated based on a participant's focus. A first participant of a video conference is determined to be focused on a user interface element associated with a second participant of the video conference. Responsive to the determining that the first participant is focused on the user interface element associated with the second participant, relative audio levels of communications are changed for the second participant such that a first audio level for communications from the first participant to the second participant is higher than a second audio level for other communications received by the second participant.

A video conferencing system for a vehicle includes a display device disposed in a passenger compartment of the vehicle, the display device comprising a screen, a first imager configured to capture a first image data corresponding to a field of view of a passenger compartment of the vehicle, at least one microphone configured to collect audio data from within the passenger compartment, and a controller. The controller is configured detect a display prompt within the image data corresponding to a portion of the image data received from the first imager, detect an audio prompt within a predetermined zone of the passenger compartment of the vehicle, and selectively crop the first image data according to the portion of the image data corresponding with the display prompt in response to determining a correlation between the portion of the image data and the zone of the passenger department associated with the audio prompt.

Systems and methods for video conference content auto-retrieval and focus based on learned relevance is provided. A method may include determining collaborative documents each associated with at least one user participating in a video conference, and providing one or more first inputs to a machine learning model, the one or more first inputs identifying the plurality of collaborative documents, and comprising an indication of a request to identify a collaborative document that is most relevant to a first subject discussed during the video conference at a first point in time. The method may further include determining, based on one or more first outputs of the machine learning model, the collaborative document that is the most relevant to the first subject discussed during the video conference at the first point in time, and providing the determined collaborative document for presentation on one or more client devices while the first subject is being discussed during the video conference.

The invention provides a video conference method, system and device and a storage medium, and relates to the technical field of network communication, the method comprises the following steps: obtaining network performance information, user behavior information, video quality information and retrieval service use information, the retrieval service use information comprising a retrieval service calling state; taking the network performance information, the user behavior information and the video quality information as input, and obtaining a predicted code rate through a pre-constructed first parameter adjustment model; judging whether the retrieval service is called or not according to the calling state of the retrieval service, and if not, adjusting the video parameters according to the predicted code rate; and if yes, obtaining a preset resolution and a preset frame rate, calculating a video code rate to obtain a target code rate, and adjusting the video parameters according to the target code rate. According to the method, the optimal video code rate is predicted in the conference process through the pre-trained first parameter adjustment model, and the video data transmission parameters are adjusted according to the retrieval behavior of the user, so that the information acquisition efficiency of the user is improved.