411 results about "Virtual conference" patented technology

A UI is provided for presentation on each client device participating in a virtual meeting. The UI includes visual items each corresponding to one or more participants. One of the visual items includes an avatar representing a virtual assistant that has a role of one of the participants. A communication of a first participant is provided via the UI during the virtual meeting. The communication indicates a request to perform an operation. A response of the virtual assistant to the indicated request is provided via the UI during the virtual meeting. The response of the virtual assistant is at least one of a textual response or an audio response.

Systems and methods for video summary generation are disclosed. A chat and video conference provider generates a text summary for a meeting video and an audio summary based on the text summary. The chat and video conference provider determines a first set of correspondences between a first set of video portions from the meeting video and portions of the text summary based on a transcript of the meeting video. The chat and video conference provider determines a second set of correspondences between a second set of video portions from the meeting video and the portions of the text summary based on image data of the meeting video. The chat and video conference provider selects a plurality of video frames from the first set of the correspondences and the second set of correspondences to generate a video summary of the meeting video based on the audio summary.

One example method includes receiving, during a virtual conference from a client device, a request to generate a real-time summary of the virtual conference, a plurality of client devices participating in the virtual conference and exchanging audio and video streams; receiving, during the virtual conference, a plurality of utterances generated by automatic speech recognition (“ASR”) of the audio streams; generating a group of consecutive utterances from the plurality of utterances; determining a segment based on the group of consecutive utterances; generating, using a large language model (“LLM”), a segment summary based on the segment; and providing the segment summary to the client device.

Methods and systems for artificial intelligence (AI)-based document retrieval during a virtual meeting are provided herein. Discussion data based on multi-media stream(s) provided by client devices of participants of a virtual meeting is obtained. A determination is made of whether the discussion data corresponds to an information access query. In response to a determination that the discussion data corresponds to the information access query, the discussion data is provided as input to an AI model trained to identify one or more electronic documents including content that is relevant to given discussion data. An electronic document associated with at least one of the participants including content that is relevant to the given discussion data is identified based on output(s) of the AI model. At least a portion of the content of the electronic document is provided for presentation via a user interface (UI) at each client device associated with the participants.

Systems and methods for providing multi-meeting modes for virtual meetings are provided. In aspects, a system including a non-transitory computer-readable medium, a communications interface, and a processor is provided. The processor may be configured to execute instructions to establish a first virtual meeting and establish a second virtual meeting. The second virtual meeting may run concurrent with the first virtual meeting. The instructions may further cause the processor to receive, from a first client device, a first request to join the first virtual meeting and a second request to join the second virtual meeting, and transmit to the first client device: a first set of multimedia streams and a second set of multimedia streams. The instructions may further cause the processor to determine a primary virtual meeting and modify one of the first set of multimedia streams or the second set of multimedia streams based on the primary virtual meeting.

A method includes providing, for display on a first client device of a first participant of a plurality of participants of a virtual meeting, a user interface (UI) during the virtual meeting. The UI includes multiple regions each presenting a visual item corresponding to a video stream generated by a client device of a respective participant of the virtual meeting. The method includes detecting engagement of the first participant with a first visual item corresponding to a video stream generated by a second client device of a second participant of the virtual meeting. The method further includes generating one or more information items associated with the second participant. The method further includes causing the one or more information items to be presented within the UI on the first client device of the first participant during the virtual meeting.

Systems and methods for generating a 3D effect for a video stream are provided. A first video stream from a first client device of a first participant of a virtual meeting and a second video stream from a second client device of a second participant of the virtual meeting is identified. A background and a foreground layer of the first video stream is determined. A first and a second eye position of the second participant of the second video stream are determined. A presentation position of the background layer relative to the foreground layer is determined based on movement between the first and the second eye position of the second participant of the second video stream. A UI presenting the first video stream reflecting the determined presentation position of the background layer relative to the foreground layer is provided for display on the second client device.

System and methods of providing automatic recording of a virtual meeting based on user activity is disclosed. The method includes determining if a virtual meeting has begun and if a user is available or attentive based on one or more sensors, including a webcam, a Bluetooth controller, an infrared camera, a proximity detector, and a microphone connected to the user device. When it is determined that the user is insufficiently available or attentive, a recording of the virtual meeting is started. A user attention status may be reassessed periodically, and the recording continues as long as the user remains insufficiently available or attentive. Once the user is determined to be available, the recording is ended.

A digital agent is pre-trained to be a digital proxy for a user. Taking on the persona (e.g., personality, mannerisms, preferences, knowledge, and in some cases, a realistic visual appearance and voice of the human), the digital agent can effectively act on behalf of the human. During a virtual meeting, the pre-trained digital agent can listen to what the team has to say, ask clarifying questions, answer questions on the human's behalf, and raise points the human would want the team to consider. Since the digital agent visually resembles, sounds like, and acts like the human, the digital agent appears much like other remote participants, thereby improving the meeting experience of the other attendees and facilitating meeting productivity in the absence of a human team member.

Systems, methods, and apparatuses are described for enhancing a user experience in event live streaming applications such as video conferencing systems. In an example, first and second virtual meetings are scheduled, each meeting scheduled to include a presentation of the same document. The document is stored in a cloud storage and is associated with both the first meeting and the second meeting. During the first meeting and the second meeting, respective virtual meeting communication data is captured and stored in the cloud storage as metadata associated with the document, and associated with the respective first or second meeting during which it was captured. After the meetings conclude, a user accesses the document and is presented with an option to view the metadata associated with the first or second meeting.

A computer system implements a 3D virtual environment (312) configured to be accessed by a plurality of client devices each having corresponding a user graphical representation (322) within the 3D virtual environment, which includes positions for the user graphical representations (322) arranged in a geometry (330) and a virtual camera (314) positioned within the 3D virtual environment. The virtual camera (314) moves on a predetermined path (332) that maintains a distance between the virtual camera (314) and the positions (322) arranged in the geometry for the user graphical representations. The computer system captures a video stream from the perspective of the virtual camera on the predetermined path. The video stream includes video of the user graphical representations in the positions arranged in the geometry. The predetermined path maintains a constant viewing orientation angle between the virtual camera and the positions arranged in the geometry, which may include predefined seating positions at a virtual conference table.

Aspects of the disclosure are directed to automatic prompt generation based on a meeting discussion. A live transcript of a virtual meeting is obtained while a virtual meeting is being conducted. The live transcript includes current content discussed by participants of the virtual meeting. A determination is made based on the live transcript of whether the current content indicates a request of a participant for an operation to be performed with respect to the virtual meeting. Responsive to a determination that the current content indicates the request of the participant for the operation, one or more of a context or a sentiment associated with the request is identified. A prompt for an artificial intelligence (AI) model is generated based on the request and the one or more of the context or the sentiment. The AI model is trained to perform the operation with respect to the virtual meeting.

The invention discloses a meta universe-based conference interaction method, and relates to the technical field of virtual conferences, and the method comprises the steps: extracting the facial features of participants, comparing the facial features with a pre-established facial feature library, obtaining the unique identity of each participant, and recognizing the identities of the participants; after the identities of the participants are determined, position changes of key body joint points of the participants are detected in real time, and specific actions of the participants are judged by analyzing relative positions and movement tracks between the joint points; the method comprises the following steps: receiving the acoustic characteristics of the participant language, converting the voice signal of the participant into a text, and analyzing the semantics and emotion of the text in combination with natural language processing to obtain the language expression intention of the participant. According to the method and the device, the optimal interaction mode can be dynamically selected from the preset library according to different interaction intentions, and the audio and video parameters and the interface layout are adjusted in real time, so that intelligent interaction in a multi-user scene is realized, the interaction experience of a conference is optimized, and the interaction effect can also be improved.

An example method for AI-assisted notifications of relevant content during a virtual conference includes joining, by a client device, a virtual conference attended by one or more participants using a client application. For example, the client device may receive, a transcript of the virtual conference from a server during the virtual conference and determine if the transcript includes a phrase associated with the participant. In response to determining that the transcript includes the phrase associated with the participant, outputting a notification to the participant on a graphical user interface (GUI) provided by the client application.

The invention relates to the field of video processing, in particular to a video data processing method and device, equipment and a medium. In a background replacement link, based on precise operation of video processing requirements, an adaptive algorithm can be selected according to scene characteristics, and errors are preliminarily reduced. And subsequently, error compensation is carried out on the generated intermediate video data, the error region is corrected in a targeted manner, the edge is filled and optimized by utilizing the edge pixel characteristics of the foreground region, and iteration processing is carried out until the error is lower than a preset value, so that the accuracy of background replacement is greatly improved. And finally, the target video data is injected into the virtual camera of the cloud mobile phone, the method is applied to a mobile terminal scene, the background and the foreground are naturally fused under high-precision scenes such as live broadcast and virtual conferences, the image flaws are remarkably reduced, the strict requirements of a user on the video image quality are met with a high-precision background replacement effect, and the overall user experience is improved.

One example method includes performing sound quality operations. Microphone arrays are used to cancel background noise and to enhance speech. With arrays at each environment of each user participating in a call, a first microphone array can cancel or suppress background noise and a second array can generate enhanced speech for transmission to other users. Thus, for user, the audio signal output by the user's device includes an anti-noise signal to cancel background noise present in the user's environment and enhanced speech from other users.

The invention discloses a remote power supply operation and maintenance virtual conference cooperation method and system and electronic equipment, and particularly relates to the field of power operation and maintenance scheduling, and the method comprises the following steps: I, accessing various data of a power supply network, constructing a three-dimensional topology energy flow diagram in real time, and dynamically generating a security level matrix in combination with real-time equipment working conditions; iI, establishing a temporary operation authority tunnel, starting a virtual conference space, and automatically matching a most suitable interaction mode according to behaviors and intentions of participants; according to the method, the operation compliance and safety can be improved, key leakage and instruction tampering are effectively prevented, the encryption strength of remote operation is enhanced, permission abuse is prevented, the system toughness is improved, and safe closed-loop management from access to execution is realized; the comprehensiveness and timeliness of state monitoring of the power supply network are effectively improved, more accurate abnormal event identification can be realized, the problem positioning efficiency is improved, and a user is ensured to preferentially acquire the most reliable and most representative abnormal propagation chain.

Method, system, device, and non-transitory computer-readable medium for joining a virtual participant in a conversation. In some examples, a computer-implemented method includes: identifying a first conversation scheduled to be participated by a first group of actual participants; joining a first virtual participant into the first conversation; obtaining, via the first virtual participant, a first set of audio data associated with the first conversation while the first conversation occurs; transcribing, via the first virtual participant, the first set of audio data into a first set of text data while the first conversation occurs; and presenting the first set of text data to the first group of actual participants while the first conversation occurs.

One example method includes presenting, by a client device, a view of a virtual conference hosted by a virtual conference provider, the virtual conference including a plurality of participants, the client device associated with a participant of the plurality of participants, the view including a plurality of groupings of participants within a virtual conference area, each grouping associated with a different meeting or sub-meeting of the virtual conference; assign a location within the virtual conference area to the participant; receiving, at the client device from the conference provider, one or more audio streams associated with one or more audio sources within the plurality of groupings, the one or more audio streams provided by one or more remote client devices; determining a first location within the virtual conference area of a first audio source of the one or more audio sources; generating a plurality of spatialized audio streams based on the first location of the first audio source, the location of the indicator, and a first audio stream associated with the first audio source; and outputting the spatialized audio streams.

Provided herein are systems and methods for delta models for providing privatized speech-to-text during virtual meetings. In one embodiment, a system may include a non-transitory computer-readable medium; a communications interface; and a processor. The processor may be configured to execute processor-executable instructions to: join a virtual meeting. Each participant in the virtual meeting may exchange audio streams with other participants in the virtual meeting. The instructions may include receiving, from a video conference provider, a local model for speech recognition. The local model may be a copy of a centralized model. The instructions may include performing speech recognition using the local model on the audio streams. Performing speech recognition may include identifying audio feature data within the one or more audio streams, identifying, based on a vocabulary database, user-specific vocabulary within the audio feature data, and generating, based on the user-specific vocabulary, a private transcription of the audio streams.

In one embodiment, a system receives a set of coaching items including a number of questions each associated with an expected answer; connects to a coaching session including one or more participants and a virtual coaching agent; for each question and for at least a subset of the participants: transmitting the question, by the virtual coaching agent, to the client device used by the participant; receiving an answer to the question by the participant, the answer including media of the participant; receiving text of utterances spoken by the participant during the answer; generating one or more evaluation scores for the answer based on evaluating at least the content of the answer to the question; and transmitting an overall evaluation score for each of the subset of participants based on the generated evaluation scores for that participant.

Systems and methods for selection of client connection type in a virtual meeting based on stored configuration information. In response to a request of a first participant of a virtual meeting platform to join a virtual meeting, a configuration data structure associated with the virtual meeting is accessed. The configuration data structure identifies roles for participants of the virtual meeting. A first role associated with the first participant within the virtual meeting is identified using the configuration data structure. One or more client connection types are assigned to the first participant based on the first role. The first participant is allowed to join the virtual meeting using one of the one or more client connection types.

The technology disclosed herein relates to methods and systems that provide improved computing tools for analyzing legal matter data (e.g., for attorneys during a virtual meeting with a client or potential client). For example, legal matter data can include data corresponding to the client or potential client and another party that is relevant to a legal issue. The improved computing tools can include a legal analyzer (e.g., capable of identifying a legal issue within a particular set of legal matter data and a relevant electronic legal document within a data store that corresponds to the legal issue), a form generator (e.g., capable of identifying one or more legal forms, within a data store, that corresponds to the legal issue and automatically populating the legal form), and a question generator (e.g., capable of generating one or more questions based on the legal issue and a legal document).

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for providing template rooms within a virtual conferencing system. The program and method provide for providing an interface to configure a template room for virtual conferencing; receiving, via the interface, an indication of user input specifying a configuration for the template room; accessing a data file comprising values for generating plural rooms based on the configuration for the template room; and providing, based on the configuration for the template room and on the data file, for virtual conferencing between plural participants across the plural rooms.

An authenticating application may send instructions to a device to generate and emit an ultrasonic signal, the device being associated with a user having access credential to a virtual meeting. The application may receive in real time from the virtual meeting, audio data associated with the access credential. The application may search the audio data for the ultrasonic signal. Responsive to finding the ultrasonic signal in the audio data, the application may categorize the access credential as authentic and allow the access credential into the virtual meeting. Responsive to not finding the ultrasonic signal in the audio data, the application may categorize the access credential as unauthentic and reject the access credential from the virtual meeting.

Example methods and systems are provided for virtual conferencing based on geofences. A virtual conference device hosts an event session for an event at a location. The virtual conference device is installed with a virtual conference application. The virtual conference device joins an event session for an event and accesses geofence data associated with a geofence for an area at the location of the event. The geofence data includes at least one rule associated with the event session within the geofence. The virtual conference device determines that the virtual conference device is within the geofence. The virtual conference device applies the at least one rule in response to determining that the virtual conference device is within the geofence.

A computer-implemented machine learning method for improving speaker separation is provided. The method comprises processing audio data to generate prepared audio data and determining feature data and speaker data from the prepared audio data through a clustering iteration to generate an audio file. The method further comprises re-segmenting the audio file to generate a speaker segment and causing to display the speaker segment through a client device.

One example method includes presenting, by a client device, a view of a virtual conference hosted by a virtual conference provider, the virtual conference including a plurality of participants, the client device associated with a participant of the plurality of participants, the view including a plurality of groupings of participants within a virtual conference area, each grouping associated with a different meeting or sub-meeting of the virtual conference; assign a location within the virtual conference area to the participant; receiving, at the client device from the conference provider, one or more audio streams associated with one or more audio sources within the plurality of groupings, the one or more audio streams provided by one or more remote client devices; determining a first location within the virtual conference area of a first audio source of the one or more audio sources; generating a plurality of spatialized audio streams based on the first location of the first audio source, the location of the indicator, and a first audio stream associated with the first audio source; and outputting the spatialized audio streams.

In one embodiment, a videoconference service determines a selection of a virtual background for a videoconference from a particular participant of a plurality of participants in the videoconference. The videoconference service determines an audio context filter that is associated with a visual context of the virtual background. The videoconference service modifies an audio stream of the videoconference into a modified audio stream according to the audio context filter. The videoconference service presents, to the plurality of participants during the videoconference, the particular participant using the virtual background and the modified audio stream. In an embodiment, the videoconference service ascertains the visual context of the virtual background based on applying a machine learning model to the virtual background.