61 results about "Bokeh" patented technology

An imaging system captures focused imagery from two or more focal planes, yet does so with relatively simple optical elements. Some arrangements involve folded optical paths, to make them more compact in size. Others enable the image sensors to be mounted in coplanar arrangement. Still others involve digital compositing, e.g., to mitigate undesired bokeh effects. A great variety of other features and arrangements are also detailed.

Systems and methods for rendering depth-of-field visual effect on images with high computing efficiency and performance. A diffusion blurring process and a Fast Fourier Transform (FFT)-based convolution are combined to achieve high-fidelity depth-of-field visual effect with Bokeh spots in real-time applications. The brightest regions in the background of an original image are enhanced with Bokeh effect by virtue of FFT convolution with a convolution kernel. A diffusion solver can be used to blur the background of the original image. By blending the Bokeh spots with the image with gradually blurred background, a resultant image can present an enhanced depth-of-field visual effect. The FFT-based convolution can be computed with multi-threaded parallelism.

An apparatus and method for out-focusing photography in a portable terminal is disclosed, including detecting a position of each pixel corresponding to a light area from an original image, generating a blurred image by blurring the original image, mapping a preset texture in correspondence with the detected positions of the pixels in the blurred image, and outputting a result image by mixing the image in which the texture is mapped and the original image, a user can perform out-focusing photography by using a portable terminal having a small lens iris.

Methods and apparatus for providing simultaneous, non-destructive blur patterns in an interactive environment. A blur module may render physically-realistic, spatially-varying blurs in digital images while at the same time giving users the flexibility to produce creative blur effects. The blur module may provide different types of blur patterns, including field blur, iris blur, and tilt-shift blur, all of which are available in a given session. Each different blur pattern can be combined with one or more of the other blur patterns non-destructively. Each blur pattern has a corresponding on-canvas user interface element or elements that can be manipulated for a live preview. A bokeh technique may be provided to create bokeh effects in digital images by simulating bokeh in the resultant blurred image. A selection bleed technique may be provided that allows the user to control bleeding at the edges of selections for any of the blur patterns.

A method for applying a bokeh effect on an image at a user terminal is provided. The method for applying a bokeh effect may include: receiving an image and inputting the received image to an input layer of a first artificial neural network model to generate a depth map indicating depth information of pixels in the image; and applying the bokeh effect on the pixels in the image based on the depth map indicating the depth information of the pixels in the image. The first artificial neural network model may be generated by receiving a plurality of reference images to the input layer and performing machine learning to infer the depth information included in the plurality of reference image.

A “Bokeh-Aji” image is one in which the region of interest is in focus and the background is out of focus. Detection of “Bokeh-Aji” type images and then isolation to the region of interest area in a low complexity way without any human intervention is beneficial. A set of tools for performing this task include SAD and high pass filtering based in-focus / out-of-focus area separation, in-focus / out-of-focus block distribution based “Bokeh-Aji” shot detection and region of interest isolation. By effectively integrating these tools together, the “Bokeh-Aji” images are successfully identified, and the region of interest area is successfully isolated.

The embodiment of the present invention discloses a video recording method and a device. The method comprises a step of obtaining a recorded preview image, and capturing a target object in the preview image, and a step of carrying out bokeh processing on the target object in the recorded preview image, and synthesizing the preview image by using data which is subjected to the bokeh processing and the data which is not subjected to the bokeh processing. By using the method and the device, when a terminal records a video, the target object can be captured in the recorded preview image, the background of the target object is subjected to bokeh processing, the image which is subjected to the bokeh processing is displayed in real time, the problem that a user needs to open a video image through software and manually select a background area to carry out bokeh processing in the prior art is solved, and the effects of improving the bokeh effect and simplifying a user operation are achieved.

Methods and apparatus for creating bokeh effects in digital images. A bokeh technique is described that may provide double threshold image bokeh boosting. The bokeh effect may be controlled by a boost amount, an upper threshold value, and a lower threshold value. Colorfulness may be added to the bokeh effect applied to specular highlights according to a variable colorfulness value. A soft threshold may be implemented that results in most but not all energy of the boosting of the intensity falling between the upper and lower threshold values. The bokeh technique may achieve creative bokeh effects in digital images by simulating bokeh in the resultant blurred image. The bokeh technique may, for example, be used in combination with any of various blur patterns, and also may be used with combinations of two or more blur patterns.

The invention provides a camera photographing method and system of a mobile phone. The camera photographing method comprises the following steps: focusing by use of a focusing module of a camera of the mobile phone to generate a focus value, judging whether a focus is within a bokeh background range according to the focus value, if so, entering a normal photographing mode, if not, opening a bokeh photo synthesis mode to automatically synthesizing a bokeh photo, prompting storage or not, and ending the photography. According to the camera photographing method and system of mobile phone provided by the invention, the photo is directly generated on the basis of an existing bokeh effect, so that better user experience and photographing guide effect can be brought; and meanwhile, the limitation of photographing distances is greatly reduced as well, so that the bokeh effect can be obtained within a further focusing distance range.

Users define the aperture shape and brightness characteristics of a virtual lens system to generate optical system effects in computer graphics images. An image sample point is associated with a aperture point within the aperture. The location of the aperture point may be based on the shape of the aperture. The image sample point value may be scaled based on a brightness value of an associated aperture point. Alternatively, the aperture point location may be based on brightness characteristics of the aperture. An optical system transmission function based on the brightness characteristics of the aperture specifies the density distribution of aperture positions within the aperture. The aperture points locations are distributed according to this optical system transmission function so that the out of focus regions or bokeh of images mimic the shape and brightness characteristics of the aperture. The aperture points, image sample points, and three-dimensional scene data are provided to a renderer to create images including optical system effects.

An image capturing device and a method for generating a bokeh effect are provided. The method includes the following steps. An image including a current input pixel is captured. Next, blurring processes are performed on the image by using a first image blur filter and a second image blur filter so as to generate a plurality of first blur images and second blur images corresponding to different blur levels. A distance between the current input pixel and a focal plane is calculated to obtain a current distance. A first current blur image and a second current blur image are respectively selected from the first blur images and the second blur images according to the current distance. Next, a first current blur pixel of the first current blur image and a second current blur pixel of the second current blur image are combined to generate a current output pixel.

An imaging system captures focused imagery from two or more focal planes, yet does so with relatively simple optical elements. Some arrangements involve folded optical paths, to make them more compact in size. Others enable the image sensors to be mounted in coplanar arrangement. Still others involve digital compositing, e.g., to mitigate undesired bokeh effects. A great variety of other features and arrangements are also detailed.

The invention discloses a bokeh method based on a salient region detection model. The method comprises the following steps: obtaining an original image, constructing a salient region detection model on the basis of a convolutional network to obtain a salient image of the original image, training the obtained salient image in a fully connected conditional random field to obtain an optimized salientimage, performing binaryzation or segmentation processing on the optimized salient image to obtain a 01 matrix, and obtaining a foreground index matrix and a background index matrix; realizing globalblurring of the original image with a distance weighted average algorithm; finally, splicing an original foreground image with the blurred background image to obtain the blurred background image. With adoption of the method, not only can a complete salient region be detected accurately, but also the salient boundary is relatively clear, so that features of the foreground image can be kept duringbokeh, and content of the foreground image is not damaged.

An imaging device, comprising an image sensor that receives subject light and generates image data, and a processor comprising a focus control section, an index generating section, and a control section, wherein the focus control section performs focus detection based on the image data, and controls focus drive based on focus detection results, the index generating section is input with the image data, and generates a first index representing which image of a given plurality of types of image the image data is close to, and a second index representing Bokeh state of an image corresponding to the image data, and the control section changes control of focus drive by the focus control section based on output of the index generating section.

The embodiment of the present invention relates to a processing apparatus, an imaging apparatus, an automatic control system, an imaging system, and a distance information acquisition method. The present invention provides a processing device, an imaging device, an automatic control system, an imaging system, and a distance information acquisition method capable of performing output and control relating to the reliability of a distance to a captured subject obtained from an image. According to an embodiment, a processing device includes an acquisition unit, a distance calculation unit, and a reliability calculation unit. The acquisition unit acquires a first image of the captured subject including the bokeh in a shape indicated by a symmetrical first point spread function and a second image of the captured subject including the bokeh in a shape indicated by the asymmetric second point spread function. The distance calculation unit calculates the distance to the captured subject based on the correlation between the first point spread function and the second point spread function. The reliability calculation unit calculates the reliability of the distance based on the degree of correlation.

The invention discloses a method for producing an image bokeh effect, and belongs to the field of computer graphics. The method of the invention comprises the following steps of: 1) calculating the position and aperture of an emergent pupil by using a ray tracing method according to structural information of an optical element in a camera lens; 2) adding the calculated position and aperture of the emergent pupil into the structural information of the camera lens; 3) sequentially and gradually taking the structural information of the optical element in the camera lens out, and calculating a crossing point of camera ray and the currently taken element and ray direction after the ray passes through the element to obtain emergent ray which can pass through the camera lens; and 4) generating the bokeh effect of an image photographed by the camera by a ray tracing and drawing module by using the emergent ray obtained in the step 3). Compared with the prior art, the method has the advantages that: the drawing result of the invention is more actual and accurate, the efficiency is high, and the influence of any aperture and shape on the bokeh effect can be simulated.

The invention discloses a determination method of image correction, a terminal, and a computer readable storage medium. The determination method of image correction includes the steps: acquiring a binocular image after correction, wherein the binocular image includes a first image shot by a first camera and a second image shot by a second camera; acquiring all the matched key points in the first image and the second image; calculating the average row error of all the matched key points; and according to the calculated average row error of all the matched key points, determining the correctionprecision of the binocular image. The determination method of image correction can determine the correction precision of the binocular image by acquiring all the matched key points in the corrected binocular cameras and according to the average row error of all the matched key points, so as to improve the precision of determination and processing of stereo correction and improve stability and accuracy of bokeh.

The invention provides an image processing method and a mobile terminal. The method comprises the steps of acquiring to-be-processed images shot by two cameras, obtaining depth maps corresponding to the to-be-processed images; performing blurring processing on the background region of the to-be-processed images according to the depth maps to obtain blurring images; combining the blurring images with a brightness images corresponding to the to-be-processed images to obtain output images. According to the method, blurring images corresponding to to-be-processed images are combined with the brightness images corresponding to the to-be-processed images to obtain output images. The brightness of the highlight areas in the image background can be effectively reduced, the scattering effect of a large aperture is simulated, and the image processing effect is improved.

A disclosed image processing apparatus detects a motion vector between a first image and a second image based on the correlation between the first image and the second image. When the degree of reliability of the detected motion vector is determined based on an evaluation value regarding the correlation, a difference in amount of bokeh between the first image and the second image is considered to improve accuracy of the degree of reliability of the motion vector.

The invention discloses a picture photographing device and method, and belongs to the technical field of photographing. The picture photographing device comprises a first picture generation module, a bokeh picture module, a photographing positioning module, a second photographing module and a picture synthesizing module. The first picture generation module is used for photographing a first picture or selecting the fist picture; the bokeh picture module is used for generating the picture background of the first picture into bokeh scenery positioning points; the photographing positioning module is used for positioning the first picture and the framing image when a second picture is framed according to the bokeh scenery positioning points; the second photographing module is used for photographing the second picture; and the picture synthesizing module is used for synthesizing the first picture and the second picture into the same one picture. According to the device and the method, the pictures photographed at two times are automatically synthesized; later operations are unnecessary; and the group photo satisfying the demand of a photographer can be photographed.

An electronic device and method are disclosed. The electronic device includes a memory and processor, which implements the method, including: obtaining image data for an image, set in the image a region of interest and a background region, using depth information, both including one or more sub-regions, determining respective bokeh characteristics for the one or more first sub-regions and the one or more second sub-regions based on a first characteristic criterion and a second characteristic criterion, respectively, and processing the image to apply a bokeh effect to the plurality of pixels based on the respective bokeh characteristics for the one or more first sub-regions and the one or more second sub-regions.

The invention provides an image processing method and an image acquisition device. The method includes: acquiring a first image with first focal distance, and acquiring a second image with a second focal distance; obscuring the first image to generate an obscured image; geometrically correcting the second image to obtain a displacement-corrected image; executing gradient operation on each pixel point of the first image to generate multiple first gradient values, and executing gradient operation on each pixel point of the displacement-corrected image to generate multiple second gradient values; comparing the first gradient values and the corresponding second gradient values, and generating a bokeh map according to the comparison results; mixing the first image and the obscured image according to the bokeh map to generate a background-obscured image.

The distance calculating apparatus detects an object distance to an object based on a first object image signal formed by a luminous flux passing through a first pupil region of an imaging optical system and a second object image signal formed by a luminous flux passing through a second pupil region of the imaging optical system, which are generated by using an imaging device including multiple pixels. The imaging device includes a first and a second photoelectric conversion sections. The first and the second photoelectric conversion sections generate the first and the second object image signals, respectively. The first and the second pupil regions have asymmetric pupil region shapes in an exit pupil of the imaging optical system. An object distance calculation unit detects the object distance by a DFD method based on a difference in bokeh of the first and the second object image signals.

An anamorphic objective lens comprising, along an optical axis and in order from an object space to an image space: at least a negative (−) spherical first lens group; an anamorphic second lens group and a positive (+) spherical third lens group wherein an aperture stop is located before, after or preferably within the spherical third lens group such that the anamorphic objective lens creates a traditional elliptical bokeh of out of focus objects. Both spherical lens groups contain spherical refractive optical surfaces and the anamorphic lens group contains cylindrical and plano optical surfaces with at least one cylindrical surface oriented at substantially 90 degrees about at least one other cylindrical surface. The negative spherical first lens group may provide focusing.

A video system for creating a display in a video conference. The video system includes a web camera to capture an image of a user at a first distance from the web camera and a background that extends away from the camera at a second distance greater than the first distance. The video system also has a distance measuring system to measure the first distance between the user and the web camera. The video system establishes an artificial focal length at least as great as the first distance and less than the second distance to artificially blur the background while maintaining the user in focus. The display thus shows the user in focus and a blurred background. The purposefully-blurred background is known as synthetic bokeh.

A “Bokeh-Aji” image is one in which the region of interest is in focus and the background is out of focus. Detection of “Bokeh-Aji” type images and then isolation to the region of interest area in a low complexity way without any human intervention is beneficial. A set of tools for performing this task include SAD and high pass filtering based in-focus / out-of-focus area separation, in-focus / out-of-focus block distribution based “Bokeh-Aji” shot detection and region of interest isolation. By effectively integrating these tools together, the “Bokeh-Aji” images are successfully identified, and the region of interest area is successfully isolated.

A display control apparatus, in which a user can easily recognize “taste of bokeh” of a captured image before the image is recorded, is disclosed. The display control apparatus controls so as to display, together with a first item that indicates either one of a setting value of an F-number or a T-number, a second item that indicates information that relates to an F-number and an amount of variance of a T-number that correspond to a current setting value.

The embodiment of the invention provides an image processing method and device. On one hand, a photo shooting instruction is received, a motor is used for carrying out focusing shooting to obtain a first picture, and the position information of motor actuation is taken as first position information; according to the first position information, second position information of the motor actuation is determined; when the motor is actuated to the second position information, the focusing shooting is carried out to obtain a second picture; the first picture and the second picture are subjected to overlapping display; and according to a selection instruction, the first picture and the second picture are combined to obtain a third picture. Therefore, according to the technical scheme provided by the embodiment of the invention, a single camera can be used for shooting to obtain a bokeh picture, errors are small, and cost and technical requirements are relatively low. Meanwhile, users can determine the effect of a target object on one's own, and are not only limited to an object in the center of the picture.