65 results about "Compositing" patented technology

Three dimensional aware video compositing techniques are described. In one or more examples, subject data is produced that defines a subject depicted in frames of a subject video and viewpoint data describing movement of a viewpoint with respect to the frames of the subject video. Three-dimensional data is formed that defines a three-dimensional representation of an environment depicted in frames of an environment video. A composited video is generated by aligning the environment with the movement of the viewpoint of the subject based on the subject data and the three-dimensional data, which is then rendered, e.g., presented for display in a user interface.

In some implementations, the techniques described herein relate to a method including: (i) training, by a processor, a machine learning model to create composite images from background scenes and foreground objects, (ii) identifying, by the processor, a digital image file that comprises a background scene and an additional digital image file that comprises a foreground object, (iii) compositing, by the machine learning model executed by the processor, the digital image file that comprises the background scene and the additional digital image file that comprises the foreground object to produce a composite digital image file that comprises the foreground object and the background scene by performing at least one of a channel concatenation step and a reverse diffusion sampling step, and (iv) causing display, by the processor, of the composite image file that comprises the foreground object and the background scene.

In some implementations, the techniques described herein relate to a method including: identifying, by a processor, a digital image file that includes a background scene and an additional digital image file that includes a foreground object; compositing, by a machine learning model executed by the processor, the digital image file and the additional digital image file to produce a composite digital image file that includes the foreground object placed in front of the background scene by: identifying a location within the background scene in the digital image file for placement of the foreground object from the additional digital image file; transforming at least one aspect of the foreground object to harmonize with the background scene; and creating a composite image file that includes the harmonized foreground object in the location within the background scene; causing display, by the processor, of the composite image file.

The invention discloses a multi-channel video composite processing system and a multi-channel video composite processing method for monitoring video acquisition equipment, and relates to the technical field of video image transmission. Multi-channel video images are intelligently received, feature extraction is performed, and the original resolution of each channel of video is respectively obtained; the composite analysis subsystem is used for realizing intelligent compositing of multiple paths of videos according to the association of a preset output resolution YSfb and an original resolution, comprehensively evaluating the adaptability and distortion state of a composited picture by synthesizing an adaptation index HCzs, and improving the comprehensive control on the quality of the whole picture; the evaluation management subsystem sets an adaptation threshold value Q in advance, an adaptation index HCzs is synthesized through comparative analysis, the system can automatically obtain a level management report, and timely monitoring and management of the running state of the system are facilitated; the video processing subsystem adopts a corresponding processing scheme according to the level management report, and the image contrast is improved through an enhancement processing technology; and the video distribution subsystem performs local storage and remote transmission on the processed composite video image.

Embodiments of the present application provide a layer synthesis method and device, electronic equipment and storage medium, the method comprising: obtaining a second layer, a blank layer and a plurality of first layers, the second layer being a layer that has undergone specific processing, the level of the second layer being between the levels of the plurality of first layers, the level of the blank layer being the same as the level of the second layer, and the color value of the pixel points in the blank layer being a preset value; performing synthesis processing on the plurality of first layers and the blank layer to obtain a first synthesis layer; and performing superimposition processing on the first synthesis layer and the second layer to obtain a second synthesis layer. When specific processing is required for an intermediate layer, a plurality of layers can be synthesized.

Disclosed are dynamic system optical-to-optical transfer functions (OOTF), which adapt displayed content to provide a so-called "perceptual reference" effect for the viewer, wherein, as the current viewing conditions depart from a "reference" viewing scenario, the dynamic system OOTF adapts the content and / or display to provide the viewer with as close as possible to the perceptual effect of the "reference" viewing scenario. The dynamic system OOTF may perform one or more of the following adaptation processes: adapting media content from a source color space to a linear XYZ color space; adapting media content from a linear XYZ color space to a display device's color space; automatically adjusting display device brightness, white point, and / or black point; adapting media content from an intended viewing environment to a common compositing space's fixed viewing environment; and / or adapting media content from the common compositing space's fixed viewing environment to that of the viewer's current viewing conditions.

Disclosed are dynamic system optical-to-optical transfer functions (OOTF), which adapt displayed content to provide a so-called "perceptual reference" effect for the viewer, wherein, as the current viewing conditions depart from a "reference" viewing environment, the dynamic system OOTF adapts the content and / or display to provide the viewer with as close as possible to the perceptual effect of the reference viewing environment. The dynamic system OOTF may perform one or more of the following adaptation processes: adapting media content from a source color space to a linear XYZ color space; adapting media content from a linear XYZ color space to a display device's color space; automatically adjusting display device brightness, white point, and / or black point; adapting media content from an intended viewing environment to a common compositing space's fixed viewing environment; and / or adapting media content from the common compositing space's fixed viewing environment to that of the viewer's current viewing environment.

This invention discloses a method for displaying Linux container applications on the HarmonyOS platform based on virtual compositing nodes. Using HarmonyOS as the host and Linux as the container, the host-side Vulkan resource management hub pre-checks GPU characteristics, allocates shared Vulkan resources, creates rendering channels, and initializes global timeline semaphores to build a unified resource pool. After the container starts, it requests resources from the host to import shared video memory objects, and the container compositor registers virtual nodes. During the rendering phase, the application uses shared resources to complete parallel rendering and sends notifications to the container compositor. The container compositor, based on the global display state, uses Vulkan instructions to perform window blending, transformation, and other processing, encapsulates global compositing units, and submits them to the HarmonyOS global compositing scheduler. The scheduler reads the global compositing units and, when the timeline semaphore meets the on-screen conditions, completes the global compositing of the container application window and the host's native window, driving the display service to output the screen.

This application relates to an image display method, apparatus, computer device, chip, and chip module, and pertains to the field of image technology, capable of improving the smoothness and stability of image display. The method includes: obtaining a first target time for the drawing stage based on a first actual time consumption and a first historical time consumption for the application to draw historical image frames; determining a second target time for the compositing and display stage based on a second actual time consumption, a second historical time consumption for the image compositing service to process historical image frames, and a third historical time consumption for the hardware compositor to synthesize and display historical image frames; after the image compositing service submits the compositing and display task corresponding to the current image frame to the asynchronous thread of the hardware compositor, sending the second target time consumption to the hardware compositor and the first target time consumption to the application, to instruct the asynchronous thread of the hardware compositor to asynchronously process the compositing and display task according to the second target time consumption, and instructing the application to process subsequent image frames according to the first target time consumption.

This application provides a display device and a media asset compositing method in some embodiments. The method responds to a user-inputted media asset compositing command by acquiring raw media asset data; performing region extraction on the raw image data in pixels to obtain video frame data; encoding the video frame data according to a preset encoding format to obtain video data; performing format conversion processing on the raw audio data to obtain audio data in a preset encoding format; adding time stamps to the raw text data to obtain subtitle data; and performing encapsulation processing on the video data, audio data, and subtitle data to obtain composite media asset data. This method can acquire various types of raw media asset data, perform corresponding processing on the acquired raw media asset data in real time, and then encapsulate the processed media asset data to obtain composite media asset data, improving the speed and richness of composite media asset data.

A first obtaining unit obtains a plurality of shot images shot at a plurality of shooting positions positioned such that a spacing between adjacent ones, in a first direction or a second direction orthogonal to the first direction, of the shooting positions is a non-integral multiple of a pixel pitch of an image sensor. A generating unit generates a high-resolution image having a resolution higher than a resolution of the plurality of shot images by performing compositing processing on the plurality of shot images. A filter unit applies, to the high-resolution image, a filter that reduces a high-frequency component produced by the compositing processing. A second obtaining unit performs processing for obtaining a difference between the high-resolution image to which the filter has been applied and one shot image among the plurality of shot images.

This application discloses a multi-screen compositing and display method, apparatus, device, and storage medium based on the OpenHarmony system. The method includes: upon receiving a compositing and display task, increasing or decreasing worker threads based on the number of currently connected display nodes to obtain at least one new layer compositing thread, with a quantity greater than one; sending the compositing and display task to the original layer compositing thread or the newly added layer compositing thread for processing to obtain a compositing result; and sending the compositing result to the display node corresponding to the compositing and display task for display. By increasing or decreasing worker threads based on the number of display nodes, the number of display nodes and worker threads are kept consistent, enabling fully parallel processing of the compositing and display task. Furthermore, the number of worker threads can be adjusted adaptively when display nodes are added or removed, ensuring that each display node has a worker thread to handle its compositing and display task, thereby improving the frame rate during multi-screen display and enhancing the user experience.

A light detection device according to an embodiment of the present disclosure comprises: a pixel array which has a plurality of pixels each including a light-receiving element capable of detecting light pulses, in which two or more of the plurality of pixels can be joined together as a light-receiving pixel, and which is capable of generating a detection signal according to light pulse detection timings; a light reception control circuit capable of controlling the operation of the pixel array to switch some of the two or more pixels constituting a light-receiving pixel; and a depth map generation circuit which is capable of generating a first depth map on the basis of a plurality of detection signals generated by a plurality of light-receiving pixels in a case where two or more pixels are first two or more pixels, is capable of generating a second depth map on the basis of a plurality of detection signals in a case where two or more pixels are second two or more pixels, and is capable of generating a composite depth map by performing image compositing processing on the basis of the first depth map and the second depth map.

The invention discloses a multi-person picture synthesis method and device, equipment and a medium. The method comprises the following steps: splicing original images at multiple angles to obtain a panoramic image of a current target area; real-time tracking is carried out according to all face position information in the current frame, sound source information is collected synchronously, and a current spokesman in the target area is determined; and generating a multi-person synthetic picture according to the real-time motion picture of the current spokesman and the real-time motion pictures of other people. Multi-angle images are collected for feature point matching and image splicing, a high-quality panoramic image is generated, wide-area visual angle coverage is achieved, a more detailed image is obtained, all face positions are locked, corresponding sound source information is collected, a current spokesman is recognized, a multi-person synthetic picture which highlights the current spokesman and gives consideration to other people is generated, and the multi-person synthetic picture is obtained. The integrity of the panoramic information is guaranteed, meanwhile, the key content is clearly presented, the problems that the visual angle is limited and information is overloaded are solved, and the communication efficiency and watching experience of a teleconference are improved.

A signal synthesis device includes a waveform synthesis unit that obtains a synthesized waveform of an R wave represented by a function obtained by subtracting, from a function obtained by multiplying a function specified by a parameter value of a parameter specifying a first unimodal distribution by a parameter value of a first weight parameter, a function obtained by multiplying a function specified by a parameter value of a parameter specifying a second unimodal distribution by a parameter value of a second weight parameter, and adding a parameter value of a first level parameter, obtains a synthesized waveform of a T wave obtained by inverting the time axis of a waveform represented by a function obtained by subtracting, from a function obtained by multiplying a function specified by a parameter value of a parameter specifying a third unimodal distribution by a parameter value of a third weight parameter, a function obtained by multiplying a function specified by a parameter value of a parameter specifying a fourth unimodal distribution by a parameter value of a fourth weight parameter, and adding a parameter value of a second level parameter, and connects the synthesized waveform of the R wave and the synthesized waveform of the T wave together.

Various aspects of context aware object interaction prediction and segmentation, including video stream segmentation of a virtual background during a video call, are discussed. An example method of segmentation includes: receiving video data that depicts a human user and an object in a scene; receiving context data from another other data source, which is related to an interaction of the human user with the object; analyzing the context data to determine a shape of the object and a type of the interaction of the human user with the object; and generating a video stream that includes a virtual background overlaid on the video data. The virtual background can be segmented based on at least one outline of the human user, and the virtual background can be further segmented based on the shape of the object and the type of the interaction of the human user with the object.

A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image / video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be a three-dimensional lighting structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately to ensure a uniform light distribution on the subject during the image / video capture. Moreover, a software application on a smart device can act as a system platform that enables for automatic processing of pixel correction in the monochromatic background during the Chroma key process in real-time, and light adjustment of the lighting modules on a portable monochromatic background to correct any light imperfections that impede color neutrality on the background

Disclosed herein a method for agile simulation of a stochastic computing image processing where the input operands are processed with the aid of a correlation-controlled contingency table (CT) construct without using actual stochastic bit-streams. The disclosed method utilizes contingency tables to perform (i) template matching, (ii) image compositing, and (iii) pattern detection. Results show that the proposed approach achieves similar computation accuracy to the traditional stochastic computing simulation while performing runtime- and memory-efficient computations.

The invention provides an information processing apparatus, an information processing system, an information processing method, a recording medium, and a computer program product. An information processing device according to one embodiment of the present disclosure is provided with a first image acquisition unit, an image synthesis unit, a second image acquisition unit, and a detection unit. A first image acquisition unit acquires a first image including a body of a user captured by a first camera, and a second image including a wrist of the user captured by a second camera. The image compositing section generates a third image including the body and the wrist by compositing the first image and the second image. The second image acquisition section determines a plurality of first feature points corresponding to the body from the third image, and acquires a fourth image including the hand of the user based on a plurality of third feature points corresponding to the wrist. The detection unit identifies a plurality of second feature points corresponding to the hand from the fourth image, and detects movement of the hand on the basis of the plurality of second feature points.

The present application discloses a data transmission method and apparatus, a computer device (8), a medium, and a product. The method comprises: (S201) acquiring a display image layer, wherein the display image layer comprises a transparency layer and a color layer; (S202) dividing the transparency layer of the display image layer to obtain a divided transparency layer; (S203) mapping and compositing the divided transparency layer to obtain M first RGB images, wherein M is an integer greater than 1; and (S204) splicing the M first RGB images with a second RGB image constituted by the color layer to obtain a target RGB image, and transmitting the target RGB image. In the present application, during transmission of the display image layer, operations such as dividing, mapping, and compositing are performed on the transparency layer comprised in the display image layer, so as to optimize a transmission mode of transparency layer information, thereby improving the efficiency, stability, and reliability of transparency layer information transmission.

This application is a divisional application of Chinese application 202010876955.9. This application relates to a video compositing method, apparatus, computer device, and storage medium. The method includes: entering a dynamic background material acquisition page; selecting a dynamic background material in response to a background material selection operation triggered on the dynamic background material acquisition page; entering a video compositing preview page; playing the dynamic background material; and displaying a dynamic foreground material in an editing state overlaid on the playing dynamic background material; when a video compositing operation is triggered on the video compositing preview page, compositing the dynamic background material and the dynamic foreground material played on the video compositing preview page into a video. This method can merge at least two materials of different types into a video of interest to the user, thereby increasing viewership.

Disclosed are techniques for generating a photorealistic image by augmenting or compositing at least a portion of a physical structure (e.g., a house) depicted in a two-dimensional (2D) image with synthetic image data. Additionally, disclosed are techniques for augmenting the depicted physical structure and applying a scene effect to the synthetic image data to create a photorealistic effect.

The present disclosure provides a video compositing method, device, electronic device, and computer-readable medium, which relate to the technical field of video processing. The method includes receiving a compositing request input by a user based on a first video, activating a video capture device in response to the compositing request, capturing a second video through the video capture device, and fusing the first video and the second video to obtain a target video. In an embodiment of the present disclosure, the video capture device is activated based on the compositing request input by the user based on the first video, capturing the second video through the video capture device, fusing the first video and the second video to obtain a target video. After the first video and the second video are fused, there is no sense of disconnection between the two videos. When a user shoots videos using the video compositing method according to the embodiment of the present disclosure, the user's interactivity with the videos can be improved, and the user's shooting experience can be enhanced.

An image synthesizing apparatus stores a first stereo image having a first image for the right eye and a first image for the left eye, arranges a three-dimensional object in a three-dimensional virtual space, generates a second stereo image containing a second image for the right eye, which is an image from the point of sight for the right eye in a state in which the first image for the right eye is displayed, and a second image for the left eye, which is an image from the point of sight for the left eye in a state in which the first image for the left eye is displayed, in the three-dimensional virtual space in which the three-dimensional object is arranged, and outputs the second stereo image.

An electronic device and an image processing method thereof are provided. The image processing method includes the following steps: detecting whether a buffer has second image data when performing a first compositing operation of first image data; detecting whether an image capturing operation of third image data is performed; judging a first time point for obtaining the third image data; and comparing a second time point for completing the first compositing operation to the first time point and determining whether to perform a second compositing operation of the second image data first or a third compositing operation of the third image data first.

Systems and methods for image compositing are provided. An aspect of the systems and methods includes obtaining a first image and a second image, wherein the first image includes a target location and the second image includes a target element; encoding the second image using an image encoder to obtain an image embedding; generating a descriptive embedding based on the image embedding using an adapter network; and generating a composite image based on the descriptive embedding and the first image using an image generation model, wherein the composite image depicts the target element from the second image at the target location of the first image.20 24 20 30 33 08 M ay 2 02 4 A B S T R A C T 2 0 2 4 2 0 3 0 3 3 0 8 2 0 2 4 M a y 205205 FIG. 2 Generate a composite image depicting the first image and the element in the target area of the first image Provide the composite image to the user Provide a first image and a second image including an element for compositing into a target area of the first image 200200 215215 210210 2 / 172 / 17 o Provide a first image and a second image including an element for compositing into a target area of the 205 first image Generate a composite 210 image depicting the first image and the element in the target area of the first image Provide the composite image to the user 215 FIG. 2 200 20 24 20 30 33 08 M ay 2 02 4 2 / 1 7 2 0 2 4 2 0 3 0 3 3 0 8 M a y 2 0 2 4 2 1 5 2 0 0

An image capture apparatus obtains image data for a plurality of frames using an image sensor by performing a plurality of shots under an underexposure condition. The image capture apparatus corrects a brightness of the image data for the plurality of frames and generates data of a composite image by compositing the image data for the plurality of frames of which brightness have been corrected.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for compressed-domain compositing of video streams. A server obtains compressed video streams, each compressed video stream including multiple frames, each frame including a video content region that is a portion of the frame, encoded using a segment identifier for pixels included in the video content region, and encoded using a set of static symbol frequencies. The server receives, from a user device, a request for video stream content, and composites a first and a second compressed video stream to obtain a compressed-domain composite video stream including a first video content region of the first compressed video stream and a second video content region of the second compressed video stream, and provides, to the user device, a packet including a set of frames of the compressed-domain composite video stream decodable by a single decoder.

This invention provides a halftone processing method for inkjet printing based on cross-gradient halftone screens, comprising: S1, color space conversion; S2, dot basic unit design; S3, halftone screen generation and filling; S4, error diffusion processing; and S5, image compositing. The advantages of this method in terms of fundamental technology are: accurate color space conversion; stable error diffusion control; and a reliable channel processing mechanism. The advantages of this method in terms of innovation are: cross-line halftone dots provide better directionality; gradient transitions reduce graininess; and overlapping filling ensures smoothness.

The present application relates to the technical field of image processing, and provides an image processing method and a device. The method is applied to a first device. The method comprises: the first device displays a first dynamic image, the first dynamic image comprising a first subject; the first device may acquire, from the first dynamic image, a first subject image corresponding to the first subject; and, in response to an editing operation for the first subject image, the first device may perform compositing on the first subject image and a second dynamic image to display a third dynamic image, the third dynamic image comprising the first subject. In the embodiments of the present application, a subject image corresponding to a subject in one dynamic image and another dynamic image are subjected to compositing, thus generating and displaying a new dynamic image. The present application can support customized editing of dynamic images by users, thereby improving the playability of dynamic images and improving personalized experience for users.