46 results about "Compositing" patented technology

Three dimensional aware video compositing techniques are described. In one or more examples, subject data is produced that defines a subject depicted in frames of a subject video and viewpoint data describing movement of a viewpoint with respect to the frames of the subject video. Three-dimensional data is formed that defines a three-dimensional representation of an environment depicted in frames of an environment video. A composited video is generated by aligning the environment with the movement of the viewpoint of the subject based on the subject data and the three-dimensional data, which is then rendered, e.g., presented for display in a user interface.

In some implementations, the techniques described herein relate to a method including: (i) training, by a processor, a machine learning model to create composite images from background scenes and foreground objects, (ii) identifying, by the processor, a digital image file that comprises a background scene and an additional digital image file that comprises a foreground object, (iii) compositing, by the machine learning model executed by the processor, the digital image file that comprises the background scene and the additional digital image file that comprises the foreground object to produce a composite digital image file that comprises the foreground object and the background scene by performing at least one of a channel concatenation step and a reverse diffusion sampling step, and (iv) causing display, by the processor, of the composite image file that comprises the foreground object and the background scene.

Embodiments of the present application provide a layer synthesis method and device, electronic equipment and storage medium, the method comprising: obtaining a second layer, a blank layer and a plurality of first layers, the second layer being a layer that has undergone specific processing, the level of the second layer being between the levels of the plurality of first layers, the level of the blank layer being the same as the level of the second layer, and the color value of the pixel points in the blank layer being a preset value; performing synthesis processing on the plurality of first layers and the blank layer to obtain a first synthesis layer; and performing superimposition processing on the first synthesis layer and the second layer to obtain a second synthesis layer. When specific processing is required for an intermediate layer, a plurality of layers can be synthesized.

Disclosed are dynamic system optical-to-optical transfer functions (OOTF), which adapt displayed content to provide a so-called "perceptual reference" effect for the viewer, wherein, as the current viewing conditions depart from a "reference" viewing environment, the dynamic system OOTF adapts the content and / or display to provide the viewer with as close as possible to the perceptual effect of the reference viewing environment. The dynamic system OOTF may perform one or more of the following adaptation processes: adapting media content from a source color space to a linear XYZ color space; adapting media content from a linear XYZ color space to a display device's color space; automatically adjusting display device brightness, white point, and / or black point; adapting media content from an intended viewing environment to a common compositing space's fixed viewing environment; and / or adapting media content from the common compositing space's fixed viewing environment to that of the viewer's current viewing environment.

This invention discloses a method for displaying Linux container applications on the HarmonyOS platform based on virtual compositing nodes. Using HarmonyOS as the host and Linux as the container, the host-side Vulkan resource management hub pre-checks GPU characteristics, allocates shared Vulkan resources, creates rendering channels, and initializes global timeline semaphores to build a unified resource pool. After the container starts, it requests resources from the host to import shared video memory objects, and the container compositor registers virtual nodes. During the rendering phase, the application uses shared resources to complete parallel rendering and sends notifications to the container compositor. The container compositor, based on the global display state, uses Vulkan instructions to perform window blending, transformation, and other processing, encapsulates global compositing units, and submits them to the HarmonyOS global compositing scheduler. The scheduler reads the global compositing units and, when the timeline semaphore meets the on-screen conditions, completes the global compositing of the container application window and the host's native window, driving the display service to output the screen.

This application relates to an image display method, apparatus, computer device, chip, and chip module, and pertains to the field of image technology, capable of improving the smoothness and stability of image display. The method includes: obtaining a first target time for the drawing stage based on a first actual time consumption and a first historical time consumption for the application to draw historical image frames; determining a second target time for the compositing and display stage based on a second actual time consumption, a second historical time consumption for the image compositing service to process historical image frames, and a third historical time consumption for the hardware compositor to synthesize and display historical image frames; after the image compositing service submits the compositing and display task corresponding to the current image frame to the asynchronous thread of the hardware compositor, sending the second target time consumption to the hardware compositor and the first target time consumption to the application, to instruct the asynchronous thread of the hardware compositor to asynchronously process the compositing and display task according to the second target time consumption, and instructing the application to process subsequent image frames according to the first target time consumption.

This application provides a display device and a media asset compositing method in some embodiments. The method responds to a user-inputted media asset compositing command by acquiring raw media asset data; performing region extraction on the raw image data in pixels to obtain video frame data; encoding the video frame data according to a preset encoding format to obtain video data; performing format conversion processing on the raw audio data to obtain audio data in a preset encoding format; adding time stamps to the raw text data to obtain subtitle data; and performing encapsulation processing on the video data, audio data, and subtitle data to obtain composite media asset data. This method can acquire various types of raw media asset data, perform corresponding processing on the acquired raw media asset data in real time, and then encapsulate the processed media asset data to obtain composite media asset data, improving the speed and richness of composite media asset data.

This application discloses a multi-screen compositing and display method, apparatus, device, and storage medium based on the OpenHarmony system. The method includes: upon receiving a compositing and display task, increasing or decreasing worker threads based on the number of currently connected display nodes to obtain at least one new layer compositing thread, with a quantity greater than one; sending the compositing and display task to the original layer compositing thread or the newly added layer compositing thread for processing to obtain a compositing result; and sending the compositing result to the display node corresponding to the compositing and display task for display. By increasing or decreasing worker threads based on the number of display nodes, the number of display nodes and worker threads are kept consistent, enabling fully parallel processing of the compositing and display task. Furthermore, the number of worker threads can be adjusted adaptively when display nodes are added or removed, ensuring that each display node has a worker thread to handle its compositing and display task, thereby improving the frame rate during multi-screen display and enhancing the user experience.

A light detection device according to an embodiment of the present disclosure comprises: a pixel array which has a plurality of pixels each including a light-receiving element capable of detecting light pulses, in which two or more of the plurality of pixels can be joined together as a light-receiving pixel, and which is capable of generating a detection signal according to light pulse detection timings; a light reception control circuit capable of controlling the operation of the pixel array to switch some of the two or more pixels constituting a light-receiving pixel; and a depth map generation circuit which is capable of generating a first depth map on the basis of a plurality of detection signals generated by a plurality of light-receiving pixels in a case where two or more pixels are first two or more pixels, is capable of generating a second depth map on the basis of a plurality of detection signals in a case where two or more pixels are second two or more pixels, and is capable of generating a composite depth map by performing image compositing processing on the basis of the first depth map and the second depth map.

The invention discloses a multi-person picture synthesis method and device, equipment and a medium. The method comprises the following steps: splicing original images at multiple angles to obtain a panoramic image of a current target area; real-time tracking is carried out according to all face position information in the current frame, sound source information is collected synchronously, and a current spokesman in the target area is determined; and generating a multi-person synthetic picture according to the real-time motion picture of the current spokesman and the real-time motion pictures of other people. Multi-angle images are collected for feature point matching and image splicing, a high-quality panoramic image is generated, wide-area visual angle coverage is achieved, a more detailed image is obtained, all face positions are locked, corresponding sound source information is collected, a current spokesman is recognized, a multi-person synthetic picture which highlights the current spokesman and gives consideration to other people is generated, and the multi-person synthetic picture is obtained. The integrity of the panoramic information is guaranteed, meanwhile, the key content is clearly presented, the problems that the visual angle is limited and information is overloaded are solved, and the communication efficiency and watching experience of a teleconference are improved.

A signal synthesis device includes a waveform synthesis unit that obtains a synthesized waveform of an R wave represented by a function obtained by subtracting, from a function obtained by multiplying a function specified by a parameter value of a parameter specifying a first unimodal distribution by a parameter value of a first weight parameter, a function obtained by multiplying a function specified by a parameter value of a parameter specifying a second unimodal distribution by a parameter value of a second weight parameter, and adding a parameter value of a first level parameter, obtains a synthesized waveform of a T wave obtained by inverting the time axis of a waveform represented by a function obtained by subtracting, from a function obtained by multiplying a function specified by a parameter value of a parameter specifying a third unimodal distribution by a parameter value of a third weight parameter, a function obtained by multiplying a function specified by a parameter value of a parameter specifying a fourth unimodal distribution by a parameter value of a fourth weight parameter, and adding a parameter value of a second level parameter, and connects the synthesized waveform of the R wave and the synthesized waveform of the T wave together.

A system and, related method, is disclosed for enabling Chroma key compositing using a smart device, wherein an image / video of a subject situated in front of a portable monochromatic background is captured, and simultaneously layered upon a different desired background replacement that will replace only the monochromatic background captured. The portable monochromatic background structure can be a three-dimensional lighting structure affixed with a plurality of lighting modules configured to ensure a uniform light distribution across the monochromatic background and separately to ensure a uniform light distribution on the subject during the image / video capture. Moreover, a software application on a smart device can act as a system platform that enables for automatic processing of pixel correction in the monochromatic background during the Chroma key process in real-time, and light adjustment of the lighting modules on a portable monochromatic background to correct any light imperfections that impede color neutrality on the background

Disclosed herein a method for agile simulation of a stochastic computing image processing where the input operands are processed with the aid of a correlation-controlled contingency table (CT) construct without using actual stochastic bit-streams. The disclosed method utilizes contingency tables to perform (i) template matching, (ii) image compositing, and (iii) pattern detection. Results show that the proposed approach achieves similar computation accuracy to the traditional stochastic computing simulation while performing runtime- and memory-efficient computations.

The invention provides an information processing apparatus, an information processing system, an information processing method, a recording medium, and a computer program product. An information processing device according to one embodiment of the present disclosure is provided with a first image acquisition unit, an image synthesis unit, a second image acquisition unit, and a detection unit. A first image acquisition unit acquires a first image including a body of a user captured by a first camera, and a second image including a wrist of the user captured by a second camera. The image compositing section generates a third image including the body and the wrist by compositing the first image and the second image. The second image acquisition section determines a plurality of first feature points corresponding to the body from the third image, and acquires a fourth image including the hand of the user based on a plurality of third feature points corresponding to the wrist. The detection unit identifies a plurality of second feature points corresponding to the hand from the fourth image, and detects movement of the hand on the basis of the plurality of second feature points.

The present application discloses a data transmission method and apparatus, a computer device (8), a medium, and a product. The method comprises: (S201) acquiring a display image layer, wherein the display image layer comprises a transparency layer and a color layer; (S202) dividing the transparency layer of the display image layer to obtain a divided transparency layer; (S203) mapping and compositing the divided transparency layer to obtain M first RGB images, wherein M is an integer greater than 1; and (S204) splicing the M first RGB images with a second RGB image constituted by the color layer to obtain a target RGB image, and transmitting the target RGB image. In the present application, during transmission of the display image layer, operations such as dividing, mapping, and compositing are performed on the transparency layer comprised in the display image layer, so as to optimize a transmission mode of transparency layer information, thereby improving the efficiency, stability, and reliability of transparency layer information transmission.

This application is a divisional application of Chinese application 202010876955.9. This application relates to a video compositing method, apparatus, computer device, and storage medium. The method includes: entering a dynamic background material acquisition page; selecting a dynamic background material in response to a background material selection operation triggered on the dynamic background material acquisition page; entering a video compositing preview page; playing the dynamic background material; and displaying a dynamic foreground material in an editing state overlaid on the playing dynamic background material; when a video compositing operation is triggered on the video compositing preview page, compositing the dynamic background material and the dynamic foreground material played on the video compositing preview page into a video. This method can merge at least two materials of different types into a video of interest to the user, thereby increasing viewership.

The present disclosure provides a video compositing method, device, electronic device, and computer-readable medium, which relate to the technical field of video processing. The method includes receiving a compositing request input by a user based on a first video, activating a video capture device in response to the compositing request, capturing a second video through the video capture device, and fusing the first video and the second video to obtain a target video. In an embodiment of the present disclosure, the video capture device is activated based on the compositing request input by the user based on the first video, capturing the second video through the video capture device, fusing the first video and the second video to obtain a target video. After the first video and the second video are fused, there is no sense of disconnection between the two videos. When a user shoots videos using the video compositing method according to the embodiment of the present disclosure, the user's interactivity with the videos can be improved, and the user's shooting experience can be enhanced.

An image synthesizing apparatus stores a first stereo image having a first image for the right eye and a first image for the left eye, arranges a three-dimensional object in a three-dimensional virtual space, generates a second stereo image containing a second image for the right eye, which is an image from the point of sight for the right eye in a state in which the first image for the right eye is displayed, and a second image for the left eye, which is an image from the point of sight for the left eye in a state in which the first image for the left eye is displayed, in the three-dimensional virtual space in which the three-dimensional object is arranged, and outputs the second stereo image.

An electronic device and an image processing method thereof are provided. The image processing method includes the following steps: detecting whether a buffer has second image data when performing a first compositing operation of first image data; detecting whether an image capturing operation of third image data is performed; judging a first time point for obtaining the third image data; and comparing a second time point for completing the first compositing operation to the first time point and determining whether to perform a second compositing operation of the second image data first or a third compositing operation of the third image data first.

Systems and methods for image compositing are provided. An aspect of the systems and methods includes obtaining a first image and a second image, wherein the first image includes a target location and the second image includes a target element; encoding the second image using an image encoder to obtain an image embedding; generating a descriptive embedding based on the image embedding using an adapter network; and generating a composite image based on the descriptive embedding and the first image using an image generation model, wherein the composite image depicts the target element from the second image at the target location of the first image.20 24 20 30 33 08 M ay 2 02 4 A B S T R A C T 2 0 2 4 2 0 3 0 3 3 0 8 2 0 2 4 M a y 205205 FIG. 2 Generate a composite image depicting the first image and the element in the target area of the first image Provide the composite image to the user Provide a first image and a second image including an element for compositing into a target area of the first image 200200 215215 210210 2 / 172 / 17 o Provide a first image and a second image including an element for compositing into a target area of the 205 first image Generate a composite 210 image depicting the first image and the element in the target area of the first image Provide the composite image to the user 215 FIG. 2 200 20 24 20 30 33 08 M ay 2 02 4 2 / 1 7 2 0 2 4 2 0 3 0 3 3 0 8 M a y 2 0 2 4 2 1 5 2 0 0

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for compressed-domain compositing of video streams. A server obtains compressed video streams, each compressed video stream including multiple frames, each frame including a video content region that is a portion of the frame, encoded using a segment identifier for pixels included in the video content region, and encoded using a set of static symbol frequencies. The server receives, from a user device, a request for video stream content, and composites a first and a second compressed video stream to obtain a compressed-domain composite video stream including a first video content region of the first compressed video stream and a second video content region of the second compressed video stream, and provides, to the user device, a packet including a set of frames of the compressed-domain composite video stream decodable by a single decoder.

This invention provides a halftone processing method for inkjet printing based on cross-gradient halftone screens, comprising: S1, color space conversion; S2, dot basic unit design; S3, halftone screen generation and filling; S4, error diffusion processing; and S5, image compositing. The advantages of this method in terms of fundamental technology are: accurate color space conversion; stable error diffusion control; and a reliable channel processing mechanism. The advantages of this method in terms of innovation are: cross-line halftone dots provide better directionality; gradient transitions reduce graininess; and overlapping filling ensures smoothness.

The present application relates to the technical field of image processing, and provides an image processing method and a device. The method is applied to a first device. The method comprises: the first device displays a first dynamic image, the first dynamic image comprising a first subject; the first device may acquire, from the first dynamic image, a first subject image corresponding to the first subject; and, in response to an editing operation for the first subject image, the first device may perform compositing on the first subject image and a second dynamic image to display a third dynamic image, the third dynamic image comprising the first subject. In the embodiments of the present application, a subject image corresponding to a subject in one dynamic image and another dynamic image are subjected to compositing, thus generating and displaying a new dynamic image. The present application can support customized editing of dynamic images by users, thereby improving the playability of dynamic images and improving personalized experience for users.

Optimizing combiner workloads in a steady state in a processor device is disclosed herein. In some aspects, a processor device is configured to perform image synthesis by executing a synthesizer pipeline, the synthesizer pipeline comprising a synthesizer, the synthesizer comprising a workload handler; a synthesizer hardware abstraction layer (HAL); a workload regulator communicatively coupled to the synthesizer HAL; and a display driver. The workload regulator detects that the image synthesis has entered a steady state and sends an indication to the workload handler to enter an acceleration mode. Upon receiving the indication, the workload handler places the synthesizer pipeline in an acceleration mode. While in an acceleration mode, the synthesizer bypasses the synthesizer HAL and sends acceleration mode data directly to the display driver.

This application provides a distributed real-time rendering method, system, and apparatus based on edge computing. The method includes: assessing the scene complexity of the task to be rendered and matching it with the preset rendering capabilities of edge nodes; if the rendering capabilities of the edge nodes are insufficient, sending the task to be rendered to the cloud for processing; if the rendering capabilities of the edge nodes are sufficient, splitting the task to be rendered based on the rendering scene category feature data to obtain sub-tasks to be rendered, and allocating them to edge nodes for real-time rendering to obtain the sub-task rendering screen; simultaneously, assessing the rendering consistency of each node, performing compositing processing, obtaining the real-time rendered screen, and transmitting it to the user terminal for display; this application achieves real-time rendering based on edge computing by intelligently matching and verifying the rendering capabilities of edge nodes, splitting and allocating the task to be rendered based on the rendering scene, rendering difficulty, and edge node load status, and performing real-time node rendering consistency assessment.

The invention discloses an image synthesis method and an electronic device, and relates to the field of terminals. And the first application of the electronic equipment sends streaming media data of the interface image of the game application synthesized on the second display instance to the server according to a second frame rate smaller than the first frame rate, and a synthesis sending and displaying unit of the electronic equipment can synthesize a layer of the interface image of the game application on the second display instance according to the second frame rate. And the GPU synthesizes the interface image of the game application on the second display instance according to the second frame rate. The second frame rate is smaller than the first frame rate, so that the frequency of synthesizing the layers of the application interface of the game on the second display instance by the synthesis sending and displaying unit is reduced, the resource overhead is reduced, and the aim of reducing the temperature and the power consumption of the electronic equipment is fulfilled.

Provided in the embodiments of the present application are an interface display method and an electronic device. The electronic device comprises a hardware composer, an image processor and a display screen. The interface display method comprises: before layer drawing and rendering, generating expected layer information; performing pre-validation on the basis of the expected layer information and specification parameters, so as to obtain a pre-validation result; on the basis of the pre-validation result, performing layer drawing and rendering; and performing layer overlay compositing processing, and displaying on the display screen an image obtained after the processing. The embodiments of the present application can reduce the number of additional uses of the image processor, thus improving layer processing efficiency, reducing the processing load of image processors as well as memory and power consumption overheads, and improving performance.

Systems and methods are described herein relating to compositing dynamic content on 3D printed objects. A printing subsystem may transmit printing instructions to a 3D printer that include only a single digital mesh of the object, digital meshes of each discrete element of the dynamic content, and instructions for compositing unique combinations of the discrete elements on each instance of the object or each instance of a set of objects printed by the 3D printer.

The present application relates to the technical field of image processing. Disclosed are an image processing method, a readable storage medium, an electronic device and a program product. In the method, a rendering thread of a first application, which is required to display first image data in a first image frame and currently runs on an electronic device, can send first information to a compositing process, which is used for compositing a display interface, in the electronic device before the rendering of the first image data is completed, for example, before the rendering thread finishes executing an instruction in a "beginDraw" stage. After receiving the first information sent by the first application, and in response to the first information, the compositing process can execute an instruction in a pre-compositing preparation stage, and composite and display the first image frame after the rendering of all the display content corresponding to the first image frame is completed. The compositing process starts to execute the instruction in the pre-compositing preparation stage even before the rendering of the first image data is completed, and therefore the time consumed by the electronic device to draw, render and composite an image frame can be reduced.

Disclosed are dynamic system optical-to-optical transfer functions (OOTF), which adapt displayed content to provide a so-called “perceptual reference” effect for the viewer, wherein, as the current viewing conditions depart from a “reference” viewing scenario, the dynamic system OOTF adapts the content and / or display to provide the viewer with as close as possible to the perceptual effect of the “reference” viewing scenario. The dynamic system OOTF may perform one or more of the following adaptation processes: adapting media content from a source color space to a linear XYZ color space; adapting media content from a linear XYZ color space to a display device's color space; automatically adjusting display device brightness, white point, and / or black point; adapting media content from an intended viewing environment to a common compositing space's fixed viewing environment; and / or adapting media content from the common compositing space's fixed viewing environment to that of the viewer's current viewing conditions.