31 results about "Light field rendering" patented technology

Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to light-fields captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.

Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to flats captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.

A catadioptric camera creates images light fields from a 3D scene by creating ray images defined as 2D arrays of ray-structure picture-elements (ray-xels). Each ray-xel capture light intensity, mirror-reflection location, and mirror-incident light ray direction. A 3D image is then rendered from the ray images by combining the corresponding ray-xels.

Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to flats captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.

A rendering method for a plurality of users includes mapping positions of both eyes of a first user and positions of both eyes of a second user to a view area, the view area corresponding to a pixel. The method includes determining a value of the pixel based on the mapped positions of both eyes of the first user and the mapped positions of both eyes of the second user.

A light field image correction method, a computer readable storage medium, and an electronic terminal are provided. The invention projects the three-dimensional scene in the world coordinate system tothe current light field image in the current camera coordinate system and the ideal light field image in the ideal camera coordinate system, takes the current light field image as an input and takesthe ideal light field image as an output, and calculates a transformation matrix corrected from the current light field image to the ideal light field image. The image of each light field in ideal coordinate system has only horizontal parallax, there is only vertical parallax in the same image column, and the baselines between adjacent images are equal, which provides great convenience for pixel matching searching process in computer vision applications such as depth estimation and image matching; rays can be periodically sampled so that multi-camera array images can be efficiently applied torelated light field rendering algorithms.

The invention discloses an unstructured light field rendering method. obtaining a light field sampling image, taking the sampling viewpoint position as the vertex of the basic triangular mesh, the camera parameters of the sampling viewpoint and the geometric model of the to-be-rendered scene, recording the depth value of the scene under each sampling viewpoint, splitting the sampling viewpoint triangular mesh, and generating an independent sub triangular mesh for each vertex; Recording geometric information of the scene under the to-be-rendered viewpoint; And rendering the sampling viewpoint triangular mesh set, reprojecting to the viewpoint by utilizing the geometric information, sampling the light field image, and mixing the sampling results of the viewpoints. According to the method, the influence range and weight of sampling data are determined through the triangular mesh formed by the viewpoint positions when the sampling light field is split, the scene geometric model is re-projected, bilateral filtering is carried out on light field sampling based on the depth, and therefore the scene image under any viewpoint is rendered. Light field sampling data of various sources can befully utilized, and a vivid rendering result can be generated in real time.

A simulator for light field displays. A high-performance simulator that can operate in real-time, allowing for VR-based evaluation of display designs. These capabilities allow for rapid exploration of display parameters (e.g. angular and hogel resolution, field of view, etc.), the visualization of how the angular spread of the rays that can affect quality and the evaluation of artifacts from light field processing. Additionally, the high-throughput nature of the simulation makes it amenable for use in the evaluation of light processing procedures such as those involved in light field rendering and compression contexts. The speed and ease with which one can explore light field display parameters makes this simulator the ideal tool for light field content design and evaluation.

The invention discloses a novel naked-eye three-dimensional light field imaging system comprising a high-speed projector set, a light field scanning screen, a light field scanning screen rotation driving device, a control computer, a light field drawing software system and a system 3D imaging model. The high-speed projector set is composed of three high-speed projectors arranged at different vertical heights and accesses to the control computer through a video parallel interface. The light field scanning screen is driven by the light field scanning screen rotation driving device. The light field scanning screen rotation driving device comprises a servo driving motor and a rotary shaft. The servo driving motor drives a power amplifier board to access to the control computer for control. Thecontrol computer is composed of a PC computer host, a driving interface and a board card. The system 3D imaging model refers to a true naked-eye three-dimensional model, an object and a scene generated by the system. 360-degree omni-directional display of the large-size and high-resolution color dynamic 3d model and scene is realized by utilizing the three-dimensional light field, the projectionimage sequence and the technology of light field shooting and light field rendering and the like.

The invention provides a novel three-dimensional suspension display system and a real-time light field rendering method. Compared with the traditional light field imaging technology, the novel three-dimensional suspension display system and the real-time light field rendering method have the advantages that remote suspension display is achieved, the imaging center of the display system is located outside a whole display, and no barriers exist between an image and an observer; in addition, the light field density of a displayed image is increased through multiple three-dimensional image projection sources, and the corresponding rendering algorithm can achieve real-time rendering.

The invention belongs to the technical field of virtual reality, and discloses an optical field display system and method based on head-mounted VR (Virtual reality) equipment. The optical field display method based on the head-mounted VR equipment comprises the following steps that: according to a current sight point position provided by the VR equipment, rendering the left-eye view and the right-eye view of the current sight point in real time; and sending the left-eye view and the right-eye view, which are rendered by the optical field, of a new sight point into the VR display equipment to be displayed. The optical field display system based on the head-mounted VR equipment comprises an optical field rendering module and a VR display module, wherein the optical field rendering module renders the left-eye view and the right-eye view of the current sight point in real time according to the current sight point position provided by the VR equipment; and the VR display module sends the left-eye view and the right-eye view, which are rendered by the optical field, of the new sight point into the VR display equipment to be displayed. The invention establishes the optical field display system based on the head-mounted VR equipment, an optical field source can be effectively displayed on the head-mounted VR equipment, and the display quality of the head-mounted VR equipment is guaranteed. The system has the characteristics of being low in complexity, wide in applicability and high in practicality.

The invention relates to an all-around spherical light field rendering method which comprises the following steps: a preparation step, namely preparing to input and load related files; pre-computing a latticed depth map of positions of reference cameras which are densely covered with a sphere; moving a rendering camera, enabling the moving range of the rendering camera to be the surface of the sphere, and calculating and identifying the reference cameras surrounding the rendering camera around the rendering camera; performing back projection on pixels of the rendering camera, and performing depth test with the four reference cameras; interpolating the reference cameras passing through the depth test, thereby obtaining the finally rendered pixel value. According to the method disclosed by the invention, the rendering results can be rapidly seen in real time; an object can be observed from any angle on the spherical surface, and a real immersion feeling can be felt.

A method of playing back an image in a display device obtains a stereo image corresponding to both eyes of a user including a left eye and a right eye, obtains positions of the eyes determines warping transform information corresponding to the positions of the eyes based on a database (DB) provided in advance based on a curvature of an display plane of the display device, warps the stereo image by applying the warping transform information to the stereo image, determines pixel values of a display panel included in the display device from the warped stereo image by performing light field rendering based on the positions of the eyes, and reproduces the determined pixel values on the display panel.

The invention discloses a light field rendering artifact removal method. The method comprises the following steps: generating a corresponding parameterized image according to a light field source image and a parameterized grid; marking an artifact area on the parameterized image; obtaining an artifact-free image corresponding to the parameterized image; fusing the parameterized image and the image without artifacts of the parameterized image; and modifying the light field source image based on the fused parameterized image. According to the light field rendering artifact removal method, the light field source image is modified to be matched with the scene geometry accurately, the artifact phenomenon in light field rendering is removed, and a more real rendering result is presented to a user; the processing time is shortened, and the model reasoning overhead during rendering is saved.

The invention discloses a mobile terminal surface light field rendering method based on deep learning. The mobile terminal surface light field rendering method comprises the steps that S1, a camera isused for shooting sampling pictures of a rendered target object at all angles towards the target object; S2, synthesizing a 360-degree environment map of the current environment of the target objectby using the picture; Step S3, aligning the sampled photo to a space coordinate system consistent with the model file of the rendered target object; S4, collecting training data of the deep neural network, and building and training the deep neural network; And S5, rendering the representation of the rendered target object at any viewing angle in real time, and realizing the switching of 360-degreeenvironment maps to obtain the effects of different rendering results. According to the method, an advanced deep learning framework is applied, an integral in a rendering equation is fitted, the calculation amount in the rendering process is reduced, during rendering, environment chartlets can be switched at will, and a relay effect is achieved.

The invention discloses a shielding evaluation method, device, equipment and system based on a mutual view angle, and a medium. The method comprises the following steps: acquiring first imaging dataacquired by at least one top depth camera at a top view angle of a target scene, and acquiring second imaging data acquired by a light field camera array at a main view angle of the target scene; obtaining a three-dimensional coordinate set under a world coordinate system for the head of the person in a plurality of regions in the target scene; modeling each personnel coordinate to a focal plane where the face of the target personnel sits according to the three-dimensional coordinate set to obtain a personnel focal plane coordinate set; and according to at least one color sensor in the light field camera array, evaluating the shielding condition of the target person under the visual angle of any one or more color sensors, and obtaining a shielding degree evaluation set for the target person so as to select an optimal visual angle. According to the invention, the optimal visual angle can be selected to render the light field of the shielded position, and the optimal face information isobtained.

An method of operating a display apparatus is provided. The operating method includes calculating a confidence of a result obtained by performing light field rendering on each of pixels of a display panel based on positions of a left eye and a right eye, determining a weight kernel of a corresponding pixel based on the confidence, and adjusting a brightness of a pixel corresponding to each of the left eye and the right eye based on the weight kernel.

The invention provides a novel three-dimensional suspension display system and a real-time light field rendering method. Compared with the traditional light field imaging technology, the novel three-dimensional suspension display system and the real-time light field rendering method have the advantages that remote suspension display is achieved, the imaging center of the display system is located outside a whole display, and no barriers exist between an image and an observer; in addition, the light field density of a displayed image is increased through multiple three-dimensional image projection sources, and the corresponding rendering algorithm can achieve real-time rendering.

The invention provides a 3D light field rendering method and apparatus. The method comprises the steps of performing spatial transformation on a 3D model to generate a 3D scene; setting a plurality ofcameras on the 3D scene for photographing and collecting to obtain a plurality of 3D scenes taking the cameras as centers; carrying out shearing transformation on the plurality of 3D scenes taking the camera as the center to obtain a plurality of 3D scenes which are sheared at the same time; performing perspective division on Y axes corresponding to the plurality of 3D scenes which are cut at thesame time to obtain a plurality of normalized equipment spaces; performing rasterization processing on the plurality of normalized equipment spaces to obtain a plurality of window spaces; carrying out slice element coloring on the plurality of window spaces to obtain a frame cache object containing multiple pieces of view angle image information; coloring the blank rectangle drawn on the screen by using the frame buffer object to obtain naked eye 3D light field information; and displaying the naked eye 3D light field information on the corresponding nano grating screen. According to the scheme, popularization of a multi-view naked-eye 3D display technology based on the nano grating can be accelerated.

The invention belongs to the technical field of virtual reality, and discloses an optical field display system and method based on head-mounted VR (Virtual reality) equipment. The optical field display method based on the head-mounted VR equipment comprises the following steps that: according to a current sight point position provided by the VR equipment, rendering the left-eye view and the right-eye view of the current sight point in real time; and sending the left-eye view and the right-eye view, which are rendered by the optical field, of a new sight point into the VR display equipment to be displayed. The optical field display system based on the head-mounted VR equipment comprises an optical field rendering module and a VR display module, wherein the optical field rendering module renders the left-eye view and the right-eye view of the current sight point in real time according to the current sight point position provided by the VR equipment; and the VR display module sends the left-eye view and the right-eye view, which are rendered by the optical field, of the new sight point into the VR display equipment to be displayed. The invention establishes the optical field display system based on the head-mounted VR equipment, an optical field source can be effectively displayed on the head-mounted VR equipment, and the display quality of the head-mounted VR equipment is guaranteed. The system has the characteristics of being low in complexity, wide in applicability and high in practicality.

The present invention relates to an all-around spherical light field rendering method, comprising: a preparation step, i.e., preparing to input and load related files; pre-computing a latticed depth map of positions of reference cameras which are densely covered on a sphere; moving a rendering camera, enabling the moving range of the rendering camera to be the surface of the sphere, and calculating and identifying the reference cameras surrounding the rendering camera around the rendering camera; performing back projection on pixels of the rendering camera, and performing depth test with the four reference cameras; and interpolating the reference cameras passing through the depth test, thereby obtaining a finally rendered pixel value. By means of the present invention, the rendering results can be rapidly seen in real time; an object can be observed from any angle on the spherical surface, and a real immersion feeling can be felt.