1152results about "Carrier indicating arrangements" patented technology

In some embodiments, a computer system displays a caption for a media item at different depths depending on the depth of the portion of the media item over which the caption is displayed. In some embodiments, a computer system displays a user interface element that includes information associated with the media item at different locations relative to the media item depending on attention of the user. In some embodiments, a computer system displays a user interface element that includes information associated with the media item with different visual appearances depending on visual characteristics of the portion of the media item over which the user interface element is displayed.

Provided is a video generation model for performing text-to-video (T2V) or other video generation techniques. The proposed model reduces the computational costs associated with video generation. In particular, unlike traditional T2V methods, the disclosed technology can generate the full temporal duration of a video clip at once, bypassing the need for extensive computation. As one example, a machine-learned denoising diffusion model can simultaneously process a plurality of noisy inputs that correspond to various timestamps spanning the temporal dimension of a video to simultaneously generate synthetic frames for the video that match the timestamps.

Systems and methods of compressing video content as encoded data and selectively reconstructing portions of the content are disclosed. The proposed systems provide a computer-implemented process configured to classify a person's behavior(s) during a video and encode the behaviors as a representation of the video. When playback of the video is requested, a video navigation assistant will allow the end-user to select specific segments of the video based on topics discussed in the video and the codes that were generated to represent the video. The user is then able to move through segments of the video in a sequence that aligns with their viewing preferences.

A system, a method and a processor are for AI-powered generation and delivery of video clips. The processor is configured to: load a first video file of a first video content item, the first video file comprising video frames associated with timestamps; load a first subtitle file of the first video content item, the first subtitle file comprising subtitle text associated with the timestamps; execute a natural language processing (NLP) model with the subtitle text as input, the NLP model including language pre-processing steps for classifying words, names or phrases in the subtitle text and associating initial classifiers with the subtitle text, the NLP model including one or more of a recurrent neural network (RNN), a Bidirectional Encoder Representations from Transformers (BERT) model, or a generative pre-trained transformer (GPT) model for a dialogue analysis comprising processing sequences of dialogue in the subtitle text in view of the initial classifiers to associate one or more portions of the dialogue with one or more first classifiers of first narrative elements; execute an image recognition model with at least some of the video frames as input, the image recognition model including a convolutional neural network (CNN) for an object detection analysis and a facial recognition analysis comprising processing video sequences to associate one or more of the video frames with one or more second classifiers of second narrative elements; generate a narrative map of the first video content item by temporally aligning the first narrative elements with the second narrative elements based on the timestamps associated with the video frames and the first subtitle file; and generate a video clip including at least one segment of the first video content item, the at least one segment including selected video frames associated with at least one of the first or second narrative elements identified from the narrative map and selected for inclusion in the video clip.

Methods and systems are disclosed for generating video by applying a template to various content items. The methods and systems select, by an interaction application, a video generation template comprising instructions for combining a set of content items into a video using one or more augmented reality (AR) elements. The methods and systems identify a subset of content items from a plurality of previously captured content items and modify one or more content items of the identified subset of content items based on the AR elements of the video generation template. The methods and systems generate a video comprising a collection of content items including the identified subset of content items and the modified one or more content items based on the instructions of the video generation template.

A video having a wide field of view (e.g., spherical field of view) may be presented within a graphical user interface. The graphical user interface may include multiple punchouts of the wide field of view, with the number of punchouts set based on user interaction with a punchout-number element of the graphical user interface. Individual punchouts may be used as output of a virtual camera to provide views of differential spatial parts of the video. Presentation of different spatial parts of the video within different punchouts may be automatically synchronized based on the different spatial parts originating from a single video.

A user interface change event is detected. An app identifier of an associated third party app is determined. A dynamic rule data structure associated with the app identifier of the associated third party app is determined. A user interface match state specified by the dynamic rule data structure is determined based on absolute screen positioning or relative screen positioning. A current user interface state of the associated third party app is determined by querying an accessibility API. Upon determining that the user interface match state matches the current user interface state, at least one user interface report field specified by the dynamic rule data structure is determined and at least one report field property of the at least one user interface report field is extracted by querying the accessibility API. An active session data structure associated with the dynamic rule data structure is updated to store the extracted property value.

Embodiments of the present invention provide systems, methods, and computer storage media for cutting down a user's larger input video into an edited video comprising the most important video segments and applying corresponding video effects. Some embodiments of the present invention are directed to adding face-aware scale magnification to the trimmed video (e.g., applying scale magnification to simulate a camera zoom effect that hides shot cuts with respect to the subject's face). For example, as the trimmed video transitions from one video segment to the next video segment, a scale magnification may be applied that zooms in on a detected face at a boundary between the video segments to smooth the transition between video segments.

Embodiments of the present invention provide systems, methods, and computer storage media for identifying the relevant segments that effectively summarize the larger input video and / or form a rough cut, and assembling them into one or more smaller trimmed videos. For example, visual scenes and corresponding scene captions are extracted from the input video and associated with an extracted diarized and timestamped transcript to generate an augmented transcript. The augmented transcript is applied to a large language model to extract sentences that characterize a trimmed version of the input video (e.g., a natural language summary, a representation of identified sentences from the transcript). As such, corresponding video segments are identified (e.g., using similarity to match each sentence in a generated summary with a corresponding transcript sentence) and assembled into one or more trimmed videos. In some embodiments, the trimmed video is generated based on a user's query and / or desired length.

Video processing devices, systems and methods are disclosed. A video processing device for processing a source video stream under the control of a video alteration application is provided. A user interface (UI) is presented via which a user specifies a change to be applied to the source video stream. Conditions for the change to be applied to the source video stream are determined. The content of the source video stream is analysed to determine when conditions for the change have been met, and the location within the source video stream to which the change is to be applied. In response, the source video stream is processed to dynamically apply the specified change at the determined location thereby to generate an output video stream.

An audio processing method implemented by an electronic device includes entering a multi-channel video recording mode, detecting a shooting operation of a user, simultaneously recording, after detecting the shooting operation, a first video image and a second video image using a first camera and a second camera, and recording audio of a plurality of sound channels, where the audio includes panoramic audio, first audio corresponding to the first video image, and second audio corresponding to the second video image. The electronic device further records the first audio based on a feature value such as a zoom magnification corresponding to the first display area.

A video editing system leverages a generative artificial intelligence (AI) model to identify songs to overlay on a video. The video editing system extracts a set of key frames from the video and prompts the generative AI model to generate a video narrative for the video. A video narrative is a text description of the plot, theme, feel, or other characteristics of the video. The video editing system uses the video narrative to prompt the generative AI model again to generate a set of descriptor tags for the video based on the video narrative. Descriptor tags are strings that represent themes, features, or characteristics of the song. The video editing system uses an audio tagging system to score a set of songs based on the set of descriptor tags and presents a selected subset of the set of songs based on the scores of the songs.

The invention discloses a video creation method and electronic equipment, and relates to the technical field of terminals. The method comprises the steps that in response to a first image searching request, a first searching result is displayed, and the first searching result comprises first thumbnails of a plurality of first image materials; and in response to the operation of generating the video, displaying a first video, the first video comprising a plurality of first image materials. In response to the second image searching request, a second searching result is displayed, the second searching result comprises options of a plurality of first photo album sets and the first control, the plurality of first photo album sets comprise a second photo album set, and the second photo album set comprises a plurality of second image materials. And in response to the selection operation of the options of the second album and the operation of generating the video, displaying a second video which comprises a plurality of second image materials. Visibly, the electronic equipment can intelligently search the image materials, and the search results are presented in different forms according to different image search requests, so that video creation is facilitated, and the man-machine interaction efficiency is improved.

Provided are a method and an apparatus for generating a video, a device, and a medium. In one method, a first reference image and a second reference image are determined from a plurality of reference images in a reference video. A reference text for describing the reference video is received. A generation model is acquired based on the first reference image, the second reference image and the reference text. The generation model is configured to generate a target video based on a first image, a second image and a text. With example implementations of the present disclosure, the second reference image can serve as guiding data to determine a development direction of a story in the video. In this way, the generation model can clearly grasp changes of various image contents in the video, which is beneficial to generating richer and more realistic videos.

Methods and systems are disclosed herein to address the problems discussed above and in particular to provide coordination for uncoordinated content. Beyond simply archiving and / or organizing available content, the methods and systems generate composite media assets that provide enriched details and supplemental data that extends beyond any given source content. The methods and systems achieve this through a novel data filtration and synchronization process.

A method includes receiving a series of video segments and providing the series of video segments as input to a first machine learning model to produce text data. The text data is provided as input to a second machine learning model to produce categorized text data that includes a classification indication. The classification indication is added to metadata of the video segment, and the categorized text data is provided as input to a third machine learning model to produce a semantic vector. The method also includes causing the video segment and the metadata that includes the classification indication to be stored at a location of a database based on the semantic vector, the database being configured to be searched based on a search query associated with the semantic vector.

The subject technology receives frames of a source media content. The subject technology detects from the frames of the source media content, a first gesture indicating a cut point at a particular frame of the source media content, the cut point associated with a trimming operation to be performed on the source media content. The subject technology selects a starting frame and an ending frame from the frames based at least in part on the cut point at the particular frame. The subject technology performs the trimming operation based on the starting frame and the ending frame. The subject technology generates a second media content using the third set of frames. The subject technology provides for display at least a portion of the third set of frames of the second media content.

A method to highlight video segments in a video stream, where the method includes receiving a video stream from a video source, identifying a highlight segment within the video stream based on a machine learning model, the highlight segment being deemed to be worthy of replay by the machine learning model, and starting and ending frames of the highlight segment being identified by applying the machine learning model to the video stream and corresponding audio data, and providing an availability indication of the highlight segment in the video stream once the starting and ending frames of the highlight segment are identified.

The subject technology receives frames of a source media content. The subject technology detects from the frames of the source media content, a first gesture indicating a cut point at a particular frame of the source media content, the cut point associated with a trimming operation to be performed on the source media content. The subject technology selects a starting frame and an ending frame from the frames based at least in part on the cut point at the particular frame. The subject technology performs the trimming operation based on the starting frame and the ending frame. The subject technology generates a second media content using the third set of frames. The subject technology provides for display at least a portion of the third set of frames of the second media content.

Embodiments of the present invention provide systems, methods, and computer storage media for cutting down a user's larger input video into an edited video comprising the most important video segments and applying corresponding video effects. Some embodiments of the present invention are directed to adding captioning video effects to the trimmed video (e.g., applying face-aware and non-face-aware captioning to emphasize extracted video segment headings, important sentences, quotes, words of interest, extracted lists, etc.). For example, a prompt is provided to a generative language model to identify portions of a transcript (e.g., extracted scene summaries, important sentences, lists of items discussed in the video, etc.) to apply to corresponding video segments as captions depending on the type of caption (e.g., an extracted heading may be captioned at the start of a corresponding video segment, important sentences and / or extracted list items may be captioned when they are spoken).

In an implementation, a software application on a computing device directs the device to extract audio data from a media file comprising the audio data and video data, generate a trim proposal based on analysis of speech in the audio data, and display a visualization of the trim proposal. A user may supply input comprising a selection of at least a portion of the visualization of the trim proposal, in response to which the device trims the media file.

Methods and apparatus are described for evaluating dubbing of media content. Phonemes in dubbed audio are extracted and mapped to visemes. Lip poses in video frames of the media content corresponding to the phonemes of the dubbed audio are compared to the visemes determined from the dubbed audio. A notification may be generated based on the comparison that indicates synchronization of the dubbed audio to lip poses of the video.

Embodiments of this application provide a video processing method and an electronic device. The method includes: The electronic device displays a first interface. In response to a tap operation performed by a user on a first option on the first interface, the electronic device displays a second interface. In response to a first operation performed by the user on a first control on the second interface, the electronic device generates a first finished video. The electronic device displays a third interface. In response to a tap operation performed by the user on the first option on the third interface, the electronic device displays a fourth interface. In response to the first operation performed by the user on the first control on the fourth interface, the electronic device generates a second finished video. The first finished video and the second finished video have different video effects.

The embodiment of the invention provides a video generation method, electronic equipment and a storage medium, which are applied to the technical field of terminals, and the method comprises the following steps: receiving a first operation triggered by a user to generate a target video corresponding to a target theme; in response to the first operation, displaying an interface of a voice assistant comprising at least one candidate object corresponding to the keyword of the target theme; receiving a second operation of the user on a target object in the at least one candidate object; in response to the second operation, a first material corresponding to the target object is displayed in an interface of the voice assistant, and the first material is an image or a video found by the voice assistant from an image library; receiving a third operation triggered by the user to generate the target video; and in response to the third operation, displaying a thumbnail of a target video in an interface of the voice assistant, the target video being generated according to the first material corresponding to the target object. Therefore, the video of the theme expected by the user can be quickly generated, the step of generating the video is simplified, and the user experience is better.