1270results about "Details involving image processing hardware" patented technology

A method for capturing building information includes capturing dimensions of a 360 degree image at a first location within a room of a building using a mobile device equipped with at least direction sensor and at least one motion sensor. The step of capturing dimensions is repeated within at least one additional room. The mobile device receives user input to connect the rooms to create a floor plan of the building and align the floor plans over each other to create a multi-level building map.

A genus of motion estimation processes is disclosed which is characterized by the following characteristics which all species in the genus will share 1) a process within this genus does not perform the motion estimation separately for each of the partitions and subpartitions defined in the H.264 standard; 2) a process within the genus computes for each motion vector in the search region the partial costs for all macroblock partitions and sub-partitions, compares them to the best partial costs found so far, and for partitions and sub-partitions having lower costs updates the corresponding best partial costs and records the current motion vectors as the one realizing them. 3) a process within the genus after finishing scanning the motion vectors in the search region, computes from the best partial costs the total costs for all possible macroblock partitioning modes and selects the one with the lowest total cost as the best macroblock partitioning mode, with the best motion vectors corresponding to each of the selected macroblock partitions and sub-partitions.

One embodiment of the present invention sets forth a technique for generating a transparency effect for a computing device. The technique includes transmitting, to a camera, a synchronization signal associated with a refresh rate of a display. The technique further includes determining a line of sight of a user relative to the display, acquiring a first image based on the synchronization signal, and processing the first image based on the line of sight of the user to generate a first processed image. Finally, the technique includes compositing first visual information and the first processed image to generate a first composited image, and displaying the first composited image on the display.

Systems and methods in accordance with embodiments of this invention perform depth regularization and semiautomatic interactive matting using images. In an embodiment of the invention, the image processing pipeline application directs a processor to receive (i) an image (ii) an initial depth map corresponding to the depths of pixels within the image, regularize the initial depth map into a dense depth map using depth values of known pixels to compute depth values of unknown pixels, determine an object of interest to be extracted from the image, generate an initial trimap using the dense depth map and the object of interest to be extracted from the image, and apply color image matting to unknown regions of the initial trimap to generate a matte for image matting.

Exemplary systems and methods for performing registration applications are provided. An exemplary system includes a central processing unit (CPU) for transferring a plurality of images to a graphics processing unit (GPU); wherein the GPU performs a registration application on the plurality of images to produce a registration result, and wherein the GPU returns the registration result to the CPU. An exemplary method includes the steps of transferring a plurality of images from a central processing unit (CPU) to a graphics processing unit (GPU); performing a registration application on the plurality of images using the GPU; transferring the result of the step of performing from the GPU to CPU.

A binning architecture that allows opaque and transparent primitives to be segregated automatically into pairs of bins covering the same bin rectangle on the screen. When the frame is complete, the opaque bin will be rendered first and then the transparent bin will be rendered repeatedly using the depth peeling algorithm until all the layers have been resolved. This will happen automatically without requiring the application to isolate and store the transparent primitives until all of the opaque primitives have been rendered or submit the transparent primitives repeated until all of the transparent layers have been resolved.

A method of graphics processing includes determining a non-depth conditional status and an occlusion status of a fragment. Such a method may be used in culling occluded fragments before expending resources such as processing cycles and memory bus usage. In one example, a scratchpad stores depth values of robust fragments and is used for occlusion testing. Graphics architectures, and methods that include use of representative Z values, are also disclosed.

A computer implemented method for fusing images taken by a plurality of cameras is disclosed, comprising the steps of: receiving a plurality of images of the same scene taken by the plurality of cameras; generating Laplacian pyramid images for each source image of the plurality of images; applying contrast normalization to the Laplacian pyramids images; performing pixel-level fusion on the Laplacian pyramid images based on a local salience measure that reduces aliasing artifacts to produce one salience-selected Laplacian pyramid image for each pyramid level; and combining the salience-selected Laplacian pyramid images into a fused image. Applying contrast normalization further comprises, for each Laplacian image at a given level: obtaining an energy image from the Laplacian image; determining a gain factor that is based on at least the energy image and a target contrast; and multiplying the Laplacian image by a gain factor to produce a normalized Laplacian image.

A graphics processor architecture provides for scan conversion and ray tracing approaches to visible surface determination as concurrent and separate processes. Surfaces can be identified for shading by scan conversion and ray tracing. Data produced by each can be normalized, so that instances of shaders, being executed on a unified shading computation resource, can shade surfaces originating from both ray tracing and rasterization. Such resource also may execute geometry shaders. The shaders can emit rays to be tested for intersection by the ray tracing process. Such shaders can complete, without waiting for those emitted rays to complete. Where scan conversion operates on tiles of 2-D screen pixels, the ray tracing can be tile aware, and controlled to prioritize testing of rays based on scan conversion status. Ray population can be controlled by feedback to any of scan conversion, and shading.

Preferred embodiment systems of the invention use a scalable number of cameras that can image a volume of interest from plurality of angles. The volume can be large and illuminated with general non-coherent illumination. Synchronized cameras process data in real time to addresses particle overlap issues while also increasing observable volumes. Systems of the invention also use higher frame rate cameras to increase the amount of particle travel in each frame. Approaches of the invention alleviate the concerns with additional data accumulation by conducting image processing and segmentation at the time of acquisition prior to transfer from a camera to eliminate a data transfer bottleneck between camera and computer and eliminate a data storage problem. A heterogeneous CPU/GPU processor cluster processes data sent from the plurality of programmable, synchronized cameras and conducting multi-camera correspondence, 3D reconstruction, tracking and result visualization in real time by spreading processing over multiple CPUs and GPUs. Systems of the invention be scaled to hundreds of cameras and fully characterize fluid flows extending to room size and larger.

A method and an apparatus that execute a parallel computing program in a programming language for a parallel computing architecture are described. The parallel computing program is stored in memory in a system with parallel processors. The system includes a host processor, a graphics processing unit (GPU) coupled to the host processor and a memory coupled to at least one of the host processor and the GPU. The parallel computing program is stored in the memory to allocate threads between the host processor and the GPU. The programming language includes an API to allow an application to make calls using the API to allocate execution of the threads between the host processor and the GPU. The programming language includes host function data tokens for host functions performed in the host processor and kernel function data tokens for compute kernel functions performed in one or more compute processors, e.g. GPUs or CPUs, separate from the host processor. Standard data tokens in the programming language schedule a plurality of threads for execution on a plurality of processors, such as CPUs or GPUs in parallel. Extended data tokens in the programming language implement executables for the plurality of threads according to the schedules from the standard data tokens.

The present invention relates to a method for registering multi-dimensional image data. First and second multi-dimensional texture datasets are determined in dependence upon received first and second multi-dimensional image datasets, respectively. Initial transform data are then provided. The second multi-dimensional texture dataset is then transformed and interpolated using the transform data. Difference metric data are determined in dependence upon the first multi-dimensional texture dataset and the transformed second multi-dimensional texture dataset. Using an improvement process the transform data are adjusted. The transformation and adjustment of the transform data is iterated until a stopping criterion is satisfied. Use of texture data allows employment of a texture unit of a graphics processor for the transformation, the interpolation and the determination of the difference metric data.

In an exemplary embodiment, a computer-implemented method determines a set of mesh polygons or fragments of the mesh polygons visible from a navigation cell. The method includes determining a composite view frustum containing predetermined view frusta and determining mesh polygons contained in the composite view frustum. The method includes determining at least one supporting polygon between the navigation cell and the contained mesh polygons. The method further includes constructing at least one wedge from the at least one supporting polygon, the at least one wedge extending away from the navigation cell beyond at least the contained mesh polygons. The method includes determining one or more intersections of the at least one wedge with the contained mesh polygons. The method also includes determining the set of the contained mesh polygons or fragments of the contained mesh polygons visible from the navigation cell using the determined one or more intersections.

The present invention relates to a method for processing a video, comprising: a step in which a video central processing unit communicates with a host, receives a bitstream, parses header information, and generates a plurality of tasks for parallel processing; a step in which free scan information is generated by a free scan of a video bitstream inputted from the host according to the control of the video central processing unit; and a step in which a plurality of video processing units process the plurality of tasks on the basis of the free scan information and the parsed header information by receiving the control of the video central processing unit.

The invention discloses a depth calculation processor, a data processing method, and a 3D image device. The depth calculation processor includes at least two input ports for receiving first image data, the first image data including at least a structured light image collected under the projection of structured light; an input switch connected to the input ports and for the passage of all or part of the first image data from the input port; a data processing engine connected to the input switch and for calculation processing of the first image data output by the input switch so as to output second image data which at least comprise a depth map, wherein, the data processing engine at least comprises a depth processing engine for performing depth calculation processing on the structured light image to obtain the depth map; and at least one output port, directly or indirectly connected to the data processing engine, and for outputting the second image data to a host device.

This invention relates to a memory device and the like that are preferably applied to a case where motion vector is detected using a block matching. Pixel data of a first frame (a reference frame) is stored in a unit A of memory cell array portion 20a in straight binary format. Pixel data of a second frame (a search frame) is stored in a unit B of memory cell array portion 20b in two's complement format. The units A and B have a plurality of memory cells, respectively. Word lines WL related to the pixel data of the first and second frames are simultaneously activated so that charges accumulated in capacitors of each of the memory cells can be combined along one bit line BL. A/D converter 53 outputs a digital signal (absolute difference value) having a value that corresponds to a total amount of charges. When reading the pixel data, a subtraction and a conversion into the absolute difference value are simultaneously performed.

An image processing apparatus and an image processing method which can transmit/receive or display a high-dynamic-range image suitably are provided. An image transmission apparatus transfers, as metadata of content, luminance conversion information, which is for conversion of HDR content (for example, with maximum luminance 2000 nit) into SDR content (having, for example, 100 nit), or differential information. Based on the metadata, an image reception apparatus generates luminance conversion information, in which received HDR content is adapted to a capability of a display (for example, with maximum luminance 500 nit or 1000 nit) in an output destination, and realizes display mapping which is not against an intention of a producer.

A method uses a two-dimensional (2D) camera in two different positions to provide first and second 2D images having three common cardinal points. It further uses a three-dimensional (3D) measuring device to measure two 3D coordinates. The first and second 2D images and the two 3D coordinates are combined to obtain a scaled 3D image.

A system and method for dynamically adjusting the pixel sampling rate during primitive shading can improve image quality or increase shading performance. Hybrid antialiasing is performed by selecting a number of shaded samples per pixel fragment. A combination of supersample and multisample antialiasing is used where a cluster of sub-pixel samples (multisamples) is processed for each pass through a fragment shader pipeline. The number of shader passes and multisamples in each cluster can be determined dynamically for each primitive based on rendering state.

The present disclosure includes methods and systems for generating modified digital images utilizing a neural network that includes a rendering layer. In particular, the disclosed systems and methods can train a neural network to decompose an input digital image into intrinsic physical properties (e.g., such as material, illumination, and shape). Moreover, the systems and methods can substitute one of the intrinsic physical properties for a target property (e.g., a modified material, illumination, or shape). The systems and methods can utilize a rendering layer trained to synthesize a digital image to generate a modified digital image based on the target property and the remaining (unsubstituted) intrinsic physical properties. Systems and methods can increase the accuracy of modified digital images by generating modified digital images that realistically reflect a confluence of intrinsic physical properties of an input digital image and target (i.e., modified) properties.