59 results about "Composite video" patented technology

Three dimensional aware video compositing techniques are described. In one or more examples, subject data is produced that defines a subject depicted in frames of a subject video and viewpoint data describing movement of a viewpoint with respect to the frames of the subject video. Three-dimensional data is formed that defines a three-dimensional representation of an environment depicted in frames of an environment video. A composited video is generated by aligning the environment with the movement of the viewpoint of the subject based on the subject data and the three-dimensional data, which is then rendered, e.g., presented for display in a user interface.

This disclosure provides an AI filmmaking workflow including AI-assisted storyboarding, AI animation, and post-production processes for creating films. The workflow provides techniques for reconstructing 3D digital environments and characters, and for virtual camera control. The workflow also provides techniques for capturing 2D live-action performances and extracting visual cues. The AI animation process generates synthetic images and video using prompts that are based on virtual camera control in case of 3D digitization and / or visual cues in case of 2D camera capturing. Further, the workflow provides techniques for compositing with AI assistance, to generate a composited video based on the AI-animated video and inputs resulting from 3D digitization and / or 2D video processing. Advanced post-processing techniques are also provided for generating a complete film based on the composited video. This framework is designed to facilitate creative collaborative networks by using a hybrid digitization approach to enhance consistency, directability, and scalability in AI filmmaking.

The invention belongs to the technical field of education data management, and particularly discloses an intelligent recording and broadcasting management method for education courses, which comprises the following steps of: acquiring multi-modal data in real time through a multi-sensor group, and comprehensively capturing teaching actions of teachers, limb actions of students, speech audios and running states of teaching equipment; further comparing the feature combination with a pre-stored template feature combination to identify different teaching stages; recording modes are automatically switched according to the identified teaching stage, a main and auxiliary picture polling switching rule is established, and videos recorded at different camera positions are integrated into a composite video with synchronous main and auxiliary pictures; key teaching links of teaching videos are automatically identified, index tags are established, the videos are classified and stored in combination with a preset classification rule, and accordingly video contents meeting user requirements are pushed to different users. Structured management and rapid retrieval of recorded and broadcast video content are realized, and personalized service and utilization efficiency of teaching resources are enhanced.

Methods, systems, and apparatus, including computer programs encoded on computer storage media relate to a method for providing multi-point video presentations with live annotations within a communication platform. First, the system receives video feeds depicting imagery of a number of users. The system then determines a boundary about each user in the video feeds, with the boundaries each having an interior portion and an exterior portion. The system provides a media background for the exterior portions, then generates a composite video for each of the feeds. The system then determines that one or more client devices have annotation permissions, and receives one or more annotation inputs corresponding to at least one of the composite videos. Finally, the system updates at least one of the composite videos to additionally depict the annotation inputs within a third layer.

To provide an image processing apparatus configured to generate video data of mobile bodies so that the mobile bodies different in size and location can be easily compared in superimposed video data.SOLUTION: An image processing apparatus for generating synthesized video data showing superimposed different video data includes: a mobile body detection unit which detects a mobile body; a reference value calculation unit which calculates a reference value to be used when superimposing a predetermined mobile body included in one piece of video data, out of pieces of superimposed video data, on another mobile body included in the other piece of video data; a correction value calculation unit which calculates a correction value for correcting at least one piece of video data based on the reference value; and an image processing unit which generates superimposed video data formed by correcting at least one piece of video data based on the calculated correction value and superimposing the predetermined mobile body on the other mobile body.SELECTED DRAWING: Figure 10

Systems and methods for enhancing a composite video sequence created by integrating a real-world object into a synthetic environment. An initial composite video sequence, which may contain visual inconsistencies, is received. Object appearance information, derived from an original source recording of the object, is also received to guide the enhancement process. A generative model processes the initial composite video, conditioned on both the initial composite's content and the object appearance information. This process generates an enhanced video sequence wherein the visual integration of the object into the environment is improved. Enhancements include corrections to lighting, color, contrast, and shadows, as well as generative stabilization of noisy camera motion and correction of viewpoint discrepancies. Critically, the process preserves the identity of the real-world object. A method for training the generative model is provided, utilizing a combined loss function that balances reconstruction accuracy with an identity loss to ensure robust identity preservation.

A method for providing a sign language video, performed by an electronic device, may comprise the operations of: determining analysis information for an original text; determining, on the basis of the analysis information, a first word set for generating a sign language video and a second word set for generating sub-images of the sign language video, from among words included in the original text; generating a sign language video on the basis of one or more words included in the first word set; generating sub-images of the sign language video on the basis of one or more words included in the second word set; generating a composite video including the sign language video and the sub-images; and displaying the composite video via a display of the electronic device.

One example method includes joining, using a computing device, a video conference hosted by a video conference provider, the video conference having a plurality of participants; accessing, by the computing device, presentation content during the video conference, the presentation content comprising one or more content items and one or more video filters, at least one of the one or more video filters corresponding to one of the content items; receiving a selection of a first item of the one or more content items; accessing a first video filter of the one or more video filters, the first video filter corresponding to the content item; receiving a video feed from a video source; generating a composite video feed comprising the first content item and the first video feed, the composite video feed based on the video filter; and providing, via the video conference provider, the composite video feed to one or more video conference participants via the video conference.

This invention provides a video distribution system, a video distribution method, and a video distribution program that can suppress the delay of video displayed on the receiving end. [Solution] A video distribution system comprising multiple mobile devices mounted on a mobile vehicle carrying a crew, a user device used by a user at a location different from the mobile vehicle, and a communication network connecting the multiple mobile devices and the user device in a communicative manner, wherein video is distributed from the multiple mobile devices to the user device, each of the multiple mobile devices distributes multiple videos to the user device via an individual line, and the user device combines the multiple videos distributed from the multiple mobile devices to generate a composite video.

This invention provides a synthetic video management system, method, and program for appropriately managing the synthetic video generated by inserting an avatar and the manner in which information is output to the synthetic video. [Solution] The composite video management system includes: an insertion target video generation unit 3 that generates an insertion target video based on video material input from a video material input unit 1; a person video input unit 4 that inputs a person video that will be the basis of the avatar; an avatar generation unit 5 that generates an avatar from the person video; an avatar insertion unit 7 that inserts the generated avatar into the insertion target video; a video information generation unit 8 that generates composite video information, which is information related to the composite video; a composite video update information generation unit 9 that generates update information for the composite video information; a composite video information acquisition unit 14 that acquires composite video information from a distributed ledger where it is stored; a composite video output unit 15 that outputs a composite video with the composite video information added; an update information acquisition unit 16 that acquires update information from a distributed ledger; and an update information output unit 17 that outputs the acquired update information.

Systems and methods for superimposing the human elements of video generated by computing devices, wherein a first user device implemented as a mixed reality headset and second user device capture and transmit video to a central server which analyzes the video to identify and extract human elements, superimpose these human elements upon one another, adds in at least one augmented reality element, and then transmits the newly created superimposed video back to at least one of the user devices.

An electronic device provides a more realistic composite video feed for a video communication session by triggering a change to a virtual background image (VBI) that is not duplicative of a VBI being used by another participant. A processor of the electronic device receives a video stream from an image capturing device positioned to capture a user of the electronic device during the video communication session. The processor detects a virtual background setting of the VCA for the video communication session selecting a first VBI of a plurality of VBIs in a memory. In response to determining that a second composite video image received, via a communications subsystem, from a second electronic device of one or more second electronic device matches the first VBI, the processor triggers a change from the first VBI to a second VBI that is not being used by any of the second electronic device(s).

Provided are a video processing apparatus that is capable of easily aligning sides near a specified position among the sides of contents arranged in a composite video, a computer-readable recording medium recording a video processing program, and a video processing method. In a video switcher 1, a specified position specified in a composite video Sc by a user H via touch panels 3a and 4a is acquired, and a search range Se is formed based on the specified position. The sides of contents C1 to C3 included in the search range Se are identified as specific sides Ss, and the identified specific sides Ss are aligned. Thus, the user H is allowed to easily align the sides near the specified position, among the sides of the contents C1 to C3 arranged in the composite video Sc, by simply specifying the specified position in the composite video Sc.

A method of streaming and / or recording video from an extended reality headset. The headset renders video in accordance with a first person extended reality experience of a user as usual, but in addition the headset also renders video from the perspective of at least one virtual camera. The video is sent to a remote server, where a composite video is produced which comprises the video from the at least one virtual camera. The composite video is stored and / or streamed from the remote server to one or more viewers. The headset can also capture and send one or more events from within the extended reality experience of the user, and the captured events (or representations of the captured events) can be included in the composite video. Likewise, the headset can render audio from one or more virtual microphones or listeners, also for inclusion in the composite video.

Technical solutions can provide end-to-end data quality checking and control in robotic systems. A processor can receive a first packet of one or more streams at a first time and a second packet of the one or more streams at a second time subsequent to the first time. The processor can identify a first feature in the first packet and a second feature in the second packet and detect, based on the first or second feature, that the first and second packets are out of order. The processor can reorder, responsive to the detection, the first and the second packets and to cause the first packet to be subsequent to the second packet. The processor can determine, using the reordered first and second packets, a metric indicative of performance of the medical session and generate, using the reordered first and second packets, a composite video of the medical session with the metric.

A peripheral video generation device includes: a video input unit that inputs peripheral video data captured by a plurality of cameras; a video composition unit that composites the peripheral video data to generate a composite video as viewed from a predetermined viewpoint; a three-dimensional shape estimation unit that estimates a three-dimensional shape of a peripheral object based on the peripheral video data; a shielded area estimation unit that uses an estimation result of the three-dimensional shape to estimate a shielded area not visible from the predetermined viewpoint in the composite video; an inference unit that infers a video of the shielded area using deep learning; and a video superimposition unit that superimposes the video inferred by the inference unit on the shielded area in the composite video.

A first event associated with a first client device of multiple client devices of participants of a video conference is identified. The first event indicates a request to present content in a user interface (UI) including regions each corresponding to one of multiple video streams from the client devices. A first video layer that includes a reframed visual representation of the first participant is generated from the first video segment of a first video stream from the first client device. A first content layer is generated. The first video layer and the first content layer are composited into the first composite video segment in which the reframed visual representation of the first participant is positioned adjacent to the first part of the content. The first composite video segment is provided to the client devices as a real-time video stream for presentation.

In one implementation of subject-aware background video generation, a processing device generates mask data and foreground feature data from frames of a subject video. The mask data separates a subject depicted in the subject video from an environment therein. The foreground feature data describes the features of the subject. The processing device receives a condition frame that depicts a different environment. A machine-learning model generates a composite video by aligning the subject's movement with the different environment from inputs of the foreground feature data, the mask data, and the condition frame, which conditions the generation of the different environment for the composite video. The processing device then presents the composite video via a user interface.

1. Name of the product in this design: Input and display area of ​​a video generation graphical user interface for an electronic device. 2. Purpose of this design: An electronic device. 3. The key design features of this product are the graphical user interface in the electronic device for which protection is sought. 4. The picture or photo that best illustrates the key design points: Design 1 Change State Diagram 1. 5. Design 1 is designated as the basic design. 6. Purpose of the graphical user interface: The graphical user interface is used for video generation. The graphical user interface requests protection for a portion of the video creation content and displays the video generation process. 7. Human-computer interaction method of graphical user interface: In response to the user entering creative content through the input area of ​​the main view of Design 1 and touching or clicking the "Start Shooting Video Now" button, the graphical user interface changes from the main view of Design 1 to Design 1 Change State Figure 1 to display the script generation result; in response to the user touching or clicking the "Next" button in Design 1 Change State Figure 1, the graphical user interface changes from Design 1 Change State Figure 1 to Design 1 Change State Figure 2 to display the storyboard generation result; in response to the user touching or clicking the "Next" button in Design 1 Change State Figure 2, the graphical user interface changes from Design 1 Change State Figure 2 to Design 1 Change State Figure 3 to display the subtitle generation result; in response to the user touching or clicking the "Next" button in Design 1 Change State Figure 3, the graphical user interface changes from Design 1 Change State Figure 3 to Design 1 Change State Figure 4 to display the music generation result; in response to the user touching or clicking the "Synthesize Video" button in Design 1 Change State Figure 4, the graphical user interface changes from Design 1 Change State Figure 4 to Design 1 Change State Figure 5 to display the video generation result. In response to the user entering creative content through the input area of ​​the main view of Design 2 and touching or clicking the "Start Shooting Video Now" button, the graphical user interface changes from the main view of Design 2 to Design 2 Change State Figure 1 to display the script generation result; in response to the user touching or clicking the "Next" button in Design 2 Change State Figure 1, the graphical user interface changes from Design 2 Change State Figure 1 to Design 2 Change State Figure 2 to display the storyboard generation result; in response to the user touching or clicking the "Next" button in Design 2 Change State Figure 2, the graphical user interface changes from Design 2 Change State Figure 2 to Design 2 Change State Figure 3 to display the subtitle generation result; in response to the user touching or clicking the "Next" button in Design 2 Change State Figure 3, the graphical user interface changes from Design 2 Change State Figure 3 to Design 2 Change State Figure 4 to display the video generation result. In response to the user entering creative content through the input area of ​​the Design 3 main view and touching or clicking the "Start Shooting Video Now" button, the graphical user interface changes from the Design 3 main view to Design 3 Change State Figure 1 to display the script generation result; in response to the user touching or clicking the "Next" button in Design 3 Change State Figure 1, the graphical user interface changes from Design 3 Change State Figure 1 to Design 3 Change State Figure 2 to display the storyboard generation result; in response to the user touching or clicking the "Next" button in Design 3 Change State Figure 2, the graphical user interface changes from Design 3 Change State Figure 2 to Design 3 Change State Figure 3 to display the music generation result; in response to the user touching or clicking the "Composite Video" button in Design 3 Change State Figure 3, the graphical user interface changes from Design 3 Change State Figure 3 to Design 3 Change State Figure 4 to display the video generation result. In response to the user entering creative content through the input area of ​​the main view in Design 4 and touching or clicking the "Start Shooting Video Now" button, the graphical user interface changes from the main view of Design 4 to Design 4 Change State Figure 1 to display the script generation result; in response to the user touching or clicking the "Next" button in Design 4 Change State Figure 1, the graphical user interface changes from Design 4 Change State Figure 1 to Design 4 Change State Figure 2 to display the storyboard generation result; in response to the user touching or clicking the "Next" button in Design 4 Change State Figure 2, the graphical user interface changes from Design 4 Change State Figure 2 to Design 4 Change State Figure 3 to display the subtitle generation result; in response to the user touching or clicking the "Next" button in Design 4 Change State Figure 3, the graphical user interface changes from Design 4 Change State Figure 3 to Design 4 Change State Figure 4 to display the music generation result; in response to the user touching or clicking the "Composite Video" button in Design 4 Change State Figure 4, the graphical user interface changes from Design 4 Change State Figure 4 to Design 4 Change State Figure 5 to display the video generation result. In response to the user entering creative content through the input area of ​​Design 5 main view and touching or clicking the "Start Shooting Video Now" button, the graphical user interface changes from the Design 5 main view to Design 5 Change State Diagram 1 to display the script generation result; in response to the user touching or clicking the "Next" button in Design 5 Change State Diagram 1, the graphical user interface changes from Design 5 Change State Diagram 1 to Design 5 Change State Diagram 2 to display the storyboard generation result; in response to the user touching or clicking the "Next" button in Design 5 Change State Diagram 2, the graphical user interface changes from Design 5 Change State Diagram 2 to Design 5 Change State Diagram 3 to display the subtitle generation result; in response to the user touching or clicking the "Next" button in Design 5 Change State Diagram 3, the graphical user interface changes from Design 5 Change State Diagram 3 to Design 5 Change State Diagram 4 to display the video generation result. In response to the user entering creative content through the input area of ​​the Design 6 main view and touching or clicking the "Start Shooting Video Now" button, the graphical user interface changes from the Design 6 main view to Design 6 Change State Diagram 1 to display the script generation result; in response to the user touching or clicking the "Next" button in Design 6 Change State Diagram 1, the graphical user interface changes from Design 6 Change State Diagram 1 to Design 6 Change State Diagram 2 to display the storyboard generation result; in response to the user touching or clicking the "Next" button in Design 6 Change State Diagram 2, the graphical user interface changes from Design 6 Change State Diagram 2 to Design 6 Change State Diagram 3 to display the music generation result; in response to the user touching or clicking the "Composite Video" button in Design 6 Change State Diagram 3, the graphical user interface changes from Design 6 Change State Diagram 3 to Design 6 Change State Diagram 4 to display the video generation result. 8. Other situations requiring explanation: The portions of the graphical user interface shown by the dashed lines in the views of Designs 1 to 6 do not constitute the parts protected by this design.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for compressed-domain compositing of video streams. A server obtains compressed video streams, each compressed video stream including multiple frames, each frame including a video content region that is a portion of the frame, encoded using a segment identifier for pixels included in the video content region, and encoded using a set of static symbol frequencies. The server receives, from a user device, a request for video stream content, and composites a first and a second compressed video stream to obtain a compressed-domain composite video stream including a first video content region of the first compressed video stream and a second video content region of the second compressed video stream, and provides, to the user device, a packet including a set of frames of the compressed-domain composite video stream decodable by a single decoder.

A system for sport vehicle video includes a sport vehicle; a video of an operator controlling the sport vehicle; a smartphone mounted to the sport vehicle, the smartphone for sensing and displaying performance data to the operator of the sport vehicle; a screen recording of the performance data displayed to the operator on the smartphone; and a composite video of the performance data screen recording overlaid on the sport vehicle video.

1. Name of the product in this design: Video Recording Box. 2. Purpose of this design: It is used to display incoming composite video signals or Svideo video signals and audio signals on its built-in display screen, and to record and save audio and video to an SD card connected to the device; it can also directly play back recorded video files, and is equipped with a battery card slot to support external battery power. 3. The key design features of this product are the design of the battery holder and the overall appearance. 4. The image or photograph that best illustrates the design's key features: the rear view.

Methods, systems, and apparatus, including computer programs encoded on computer storage media related to multi-stream video encoding for screen sharing a communications session. The system may determine an active pixel area and a remaining pixel area of a video region. of a video region. A first video stream of the active pixel area is generated at a first frame rate. A second video stream of the remaining pixel area is generated at second frame rate, where the second frame rate is a frame rate lower than the first frame rate. A client device may transmit the first video stream and the second video stream to a second client device.

A method for high-rate video acquisition comprises providing a video sensor, providing a target area, providing a synchronization reference, capturing a plurality of videos of the target area, wherein each video of the plurality of videos captures a part of the target area, synchronizing the plurality of videos using the synchronization reference, and creating a composite video. Related systems and computer program products are also provided.

An electronic device provides a more realistic composite video feed for a video communication session by triggering a change to a virtual background image that is illuminated from a direction closely aligned with a direction of illumination of a user. A processor is configured to cause the electronic device to detect a virtual background setting, receive a video stream from an image capturing device positioned to capture the user during the video communication session, and determine a beam direction of a lighting source illuminating the user in the video stream. The processor identifies a virtual background image presenting a background illuminated from a direction that closely aligns with the beam direction of the lighting source illuminating the user. The processor causes the electronic device to generate, present, and transmit a composite video feed including a foreground image of the video stream superimposed on the virtual background image with correct lighting.

Systems, methods, and computer-readable media are provided for generating configurable recordings of video live streams. A video live stream may comprise a plurality of participant video streams received from a plurality of video stream participants. Assets, such as graphical overlays, may be added to a video live stream and rendered over the participant video streams. The participant video streams and the assets may be composited to produce a composite video live stream. During the video live stream, events may be detected and logged. The events may be any change during the video live stream. Each video stream participant may generate a local recording of the corresponding participant video stream. A composite video recording may be generated based on the local recordings and the events. The composite video recording may be editable once produced.

The invention discloses a synchronous display method and device of a video conference and a storage medium, relates to the technical field of video conferences, and discloses the synchronous display method of the video conference, comprising the following steps: determining position information of each participant in a panoramic image based on the panoramic image collected by a panoramic lens; determining a close-up shot set in which each participant falls based on the position information and a spatial mapping relationship between the panoramic shot and each close-up shot; determining a target close-up shot from the close-up shot set according to the imaging quality of the participants in the close-up shots for the participants falling into the plurality of close-up shots; and generating a composite video picture containing all the participants based on close-up pictures of the participants output by the target close-up shot. According to the method and the device, the panoramic image is taken as a reference, and spatial mapping and imaging quality optimization are combined, so that repeated display of participants in a multi-lens cross area is avoided, and clear and non-redundant synchronous picture display is realized.

The invention provides a video background replacement method based on a traffic scene, and relates to the technical field of video background replacement, and the method comprises the steps: carrying out the coding of a video frame of an original traffic video through a three-dimensional variational auto-encoder based on a pre-trained video diffusion model, and obtaining a coding background video; removing the video background of the coding background video from Gaussian noise through a denoising diffusion algorithm to generate a clear background video; performing illumination adjustment on the clear background video to obtain an illumination coordinated background video; eliminating inter-frame inconsistency of the illumination coordination background video to obtain a consistency enhanced background video; and synthesizing the foreground video of the original traffic video and the consistency enhanced background video to generate a synthesized video. According to the invention, the problems of poor adaptability and low precision of a traditional background replacement method in a complex traffic scene in the prior art can be solved, the accuracy of traffic video analysis is improved, and the technical effects of peccancy detection and accident analysis are supported.

A video shooting method and electronic device. The method includes: activating a camera function; in response to a first user operation, determining a first recording template, the first recording template including a first example sample, a second example sample, and preset audio, the first example sample corresponding to a first camera movement mode, and the second example sample corresponding to a second camera movement mode; displaying a recording interface including a first camera movement mode identifier and a second camera movement mode identifier; in response to a second user operation, maintaining the electronic device in a fixed position and starting recording; and automatically generating a composite video, the composite video including a first video clip, a second video clip, and preset audio, the first video clip being a video clip generated according to the first camera movement mode, and the second video clip being a video clip generated according to the second camera movement mode. In this manner, multiple video clips obtained through various camera movement modes can be synthesized into a video and configured with audio, thereby obtaining high-quality videos through convenient operations.