91 results about "Binocular disparity" patented technology

A three-dimensional display is provided which can produce a stereoscopic image with a natural stereoscopic depth even on different screen sizes. A stereoscopic video signal generation circuit, which supplies a stereoscopic video signal to the three-dimensional display that forms a stereoscopic image by taking advantage of binocular disparity parallax, comprises: an information retrieving means for retrieving video information on the stereoscopic image and display information on the three-dimensional display; and an offset setting means for offsetting a left-eye image and a right-eye image relative to each other according to the video information and the display information to adjust the stereoscopic depth of the image displayed.

An augmented reality system in which video imagery of a physical environment is combined with video images output by a game engine by the use of a traveling matte which identifies portions of the visible physical environment by techniques such as Computer vision or chroma keying and replaces them with the video images output by the video game engine. The composited imagery of the physical environment and the video game imagery is supplied to a trainee through a headmounted display screen. Additionally, peripheral vision is preserved either by providing complete binocular display to the limits of peripheral vision, or by providing a visual path to the peripheral vision which is matched in luminance to higher resolution augmented reality images provided by the binocular displays. A software / hardware element comprised of a server control station and a controller onboard the trainee performs the modeling, scenario generation, communications, tracking, and metric generation.

In the three-dimensional display, a two-dimensional display section generates a two-dimensional display image based on an image signal, and a lens array converts the wavefront of the display image light from the two-dimensional display section into a wavefront having a curvature which allows the display image light to focus upon a focal point where an optical path length from an observation point to the focal point is equal to an optical path length from the observation point to a virtual object point, so a viewer can obtain information about an appropriate focal length in addition to information about binocular parallax and a convergence angle. Therefore, consistency between the information about binocular parallax and a convergence angle and the information about an appropriate focal length can be ensured, and a desired stereoscopic image can be perceived without physiological discomfort.

A mobile terminal and a method for controlling the operation of the mobile terminal are provided. In the method, a stereoscopic 3D image that utilizes binocular disparity between a left-eye image and a right-eye image is displayed on a display and a stereoscopic 3D pointer is displayed in the stereoscopic 3D image when a user's hand is detected according to analysis of visual data acquired by a camera. The position of the stereoscopic 3D pointer is moved according to movement of the hand when the movement of the hand is detected according to analysis of the visual data. According to this method, the operation of the mobile terminal can be controlled by the user's hand movement or gesture.

The invention discloses a barrier and travelable area detection method based on a vehicle-mounted binocular camera. The barrier and travelable area detection method comprises the following steps of S1, taking an image through a binocular camera; S2, preprocessing the image; S3, calculating the final matching cost of each pixel point in the image; S4, calculating through the final matching cost to obtain a v-disparity map; S5, determining the horizon line and the road scope by means of the v-disparity map; S6, calculating to obtain a barrier-road intersecting line in the road scope; S7, determining the scope of the current lane and the outermost lane; S8, calculating to obtain the height of the barrier on the part above the barrier-road intersecting line; S9, determining the image areas which belong to the same barrier; and S10, outputting the road area information and barrier information. Under the premise that disparity precision is not reduced, unnecessary binocular disparity map calculation is avoided, and therefore the real-time performance of the algorithm is greatly improved, and the barrier and travelable area detection method based on the vehicle-mounted binocular camera is suitable for fields of driving warning, automatic driving and the like.

An image processing apparatus and method may estimate binocular disparity maps of middle views from among a plurality of views through use of images of the plurality of views. The image processing apparatus may detect a moving object from the middle views based on the binocular disparity maps of the frames. Pixels in the middle views may be separated into dynamic pixels and static pixels through detection of the moving object. The image processing apparatus may apply bundle optimization and a local three-dimensional (3D) line model-based temporal optimization to the middle views so as to enhance binocular disparity values of the static pixels and dynamic pixels.

A stereo image display apparatus is disclosed, in which the influence of display area edge portions on the viewing of stereo image is taken into considerations to enable display of stereo images without spoiling the viewer's sense just like the viewer is actually on the site of the image scene. The display of a left eye and a right eye image is controlled to have a binocular parallax substantially fixed in effect. (Specifically, image shifters 32L and 32R shift the left eye and right eye images according to a parallax signal.) Edge portions of a left eye and a right eye image display area are shaded off in effect and made obscure by a left eye and a right eye eyepiece optical system 12L and 12R.

A method for controlling a mobile terminal image includes providing a first image and a second image via a controller on the mobile terminal, the first and second images reflecting a binocular disparity to form a three dimensional image, identifying an editing target from the three dimensional image, editing a first image of the identified editing target, and applying the edited first image and a second image corresponding to the edited first image to the three dimensional image.

A binocular display deals with an optical contrast imbalance problem between display screens manifest over a range of interpupillary distances by orienting contrast asymmetries between the display screens in opposite directions.

A method of controlling a mobile terminal, and which includes receiving a selection signal from an input unit setting a 3D attribute to at least one item among a plurality of items to be displayed on a display of the mobile terminal; and turning on a switching panel unit positioned in front of the display, via a controller controlling the switching panel unit, when the at least one item is displayed on the display of the mobile terminal. Further, the switching panel unit displays left and right eye images of the at least one item such that the at least one item is viewed as a 3D image based on binocular disparity.

A tile-based rendering method and a tile-based rendering apparatus are provided. The tile-based rendering method involves performing tile binning on a first image and a second image having binocular disparity using a plurality of graphic processors based on a draw command, determining a tile of the second image having a highest similarity to a tile of the first image based on a result of the tile binning, determining a tile rendering order for each tile of the first image and the second image, based on a result of the determining of the tile of the second image having a highest similarity to the tile of the first image, and performing tile rendering, according to the determined tile rendering order.

An augmented reality system in which video imagery of a physical environment is combined with video images output by a game engine by the use of a traveling matte which identifies portions of the visible physical environment by techniques such as Computer vision or chroma keying and replaces them with the video images output by the video game engine. The composited imagery of the physical environment and the video game imagery is supplied to a trainee through a headmounted display screen. Additionally, peripheral vision is preserved either by providing complete binocular display to the limits of peripheral vision, or by providing a visual path to the peripheral vision which is matched in luminance to higher resolution augmented reality images provided by the binocular displays. A software / hardware element comprised of a server control station and a controller onboard the trainee performs the modeling, scenario generation, communications, tracking, and metric generation.

The invention belongs to the image processing field and relates to a stereo image quality evaluation method based on GSSIM. The method includes the steps: (1) for left image and right image, gradient structure similarity values are respectively solved, the average of the two values is solved, so as to obtain stereo image quality evaluation value QE; (2) the following method is adopted to carrying out image stereoscopic perception objective evaluation: absolute difference image of the original image and processed image is calculated, Mu1 and Mu2 of the absolute difference image are solved; Sobel operator is used for solving the gradient amplitude image of the absolute difference image; filtering is carried out on the absolute difference image of the original image, and original image binocular parallax distribution situation is calculated; Dl(x, y), Dcg(x, y) and Dsg(x, y) values at binocular parallax position are solved; DSSIM value at the binocular parallax position is calculated; and image gradient structure similarity namely image stereoscopic perception objective evaluation value DE is calculated. The invention can be well applied to stereo image quality evaluation, and correlation of objective evaluation result and subjective evaluation result is strong.

The application provides a generation method, apparatus and terminal of a disparity map, and relates to the technical field of auxiliary driving. The method includes: obtaining a binocular source image acquired by a binocular camera; performing abbreviation processing on the binocular source image to obtain a thumbnail of the binocular source image; performing stereo vision matching on the thumbnail to obtain a thumbnail disparity map; determining a target area corresponding to a physical detection area in the thumbnail disparity map in a real space; mapping the target area to an area in the binocular source image as an obstacle detection area; and performing stereo vision matching on the obstacle detection area in the binocular source image to obtain a binocular disparity map. By adoptingthe method, disparity estimation of pixel points having significance for obstacle detection can be performed in a targeted manner, calculating resources can be effectively utilized, the efficiency ofa stereo matching algorithm is improved, and the efficiency for subsequent obstacle detection based on the disparity map is further improved.

The invention provides a binocular disparity estimation method based on a cascaded geometric context neural network. The invention designs a new cascaded convolution neural network Cascaded GCNet (CGCNet). The network mainly adopts the improved GCNet and combines the 3d convolution and the original 2d convolution operation to obtain a better disparity map characteristic expression, which is beneficial to the subsequent network training. RefineNet is used to optimize the rough parallax map of GCnet network, and the precision of parallax map is improved by iterative refinement. In the process ofRefineNet optimization, difficult mining is used to make the network model focus on learning rare samples, so as to improve the disparity estimation accuracy of the network for image pairs with different complexity.

The invention discloses an unsupervised monocular depth estimation method based on a generative adversarial network, and the method comprises the following steps: 1, obtaining a left and right image pair with strict time synchronization through a binocular camera, building a binocular color image data set, and correcting a binocular color image; 2, establishing an unsupervised generative adversarial network model, inputting the corrected binocular color image into the network, and performing training and iterative regression on the network model; 3, inputting the monocular color image into thetrained network model to generate a disparity map corresponding to the monocular color image; and 4, converting the disparity map into depth information through a binocular disparity depth conversionformula, and synthesizing a depth map. According to the depth estimation method provided by the invention, the monocular color image is converted into the depth map containing the depth information by using the unsupervised network model, and complex real depth data is not needed.

The invention discloses a method and device for detecting a road obstacle. The method comprises: acquiring road images through a binocular device and processing the road images to obtain a disparity map of the road images; carrying out pavement-information-based image segmentation to obtain a binary image with an obstacle region as a foreground and other regions as a background; carrying out morphological operation on the binary image to obtain a to-be-detected region template of a suspected obstacle; carrying out information fusion of the to-be-detected region template and a monocular image being one of the road images to obtain a grayscale image of the to-be-detected region; and inputting the grayscale image into a preset obstacle detection model to carry out obstacle determination on the road images and determining the suspected obstacle based on a determination result. According to the invention, on the basis of fusion of respective advantages of binocular disparity information andmonocular image information, machine-learning-based target recognition and target classification are carried out to obtain a quick and accurate obstacle detection result.

By adding perspective information in addition to binocular parallax, the invention provides a three-dimensional medical imaging apparatus that allows surgery to be performed with a more natural three-dimensional view, similar to that achieved with the naked eye. The three-dimensional medical imaging apparatus includes an image-acquisition optical system and an imaging device for acquiring three-dimensional images of a subject. The image-acquisition optical system includes an objective optical system for forming an image of the subject at an image-forming plane, and an entrance pupil position of the image-acquisition optical system is disposed between the objective optical system and the subject.

The invention relates to a virtual reality police service training device and a virtual reality police service training method. The device comprises head-wearing display equipment, tracing equipment, an operating handle, a communication module and a mainframe, wherein the head-wearing display equipment is used for providing a stereo image having a binocular parallax; the tracing equipment is used for tracing the body posture of a user; the operating handle is used for transmitting position and control signals; the communication module is used for communication between all equipment; and the mainframe is used for receiving information, operation and generating the stereo image. The application method comprises the following steps: the tracing equipment locates the orientation of a user; the user obtains information according to a hint, and uses the operating handle to choose a property to carry out relevant processing; the mainframe judges a processing mode and gives results; and by the mode, using virtual reality to carry out police training is realized. According to the device and the method, abundant tasks and scenes can be conveniently simulated, the police training effect can be improved, and the police training costs can be lowered.

The invention discloses a method and device for converting a two-dimensional image into a three-dimensional image, and a three-dimensional imaging system. The method for converting the two-dimensionalimage into the three-dimensional image comprises the following steps: obtaining a two-dimensional image to be processed; performing perspective transformation on the two-dimensional image to be processed to obtain a left eye image and a right eye image separately; adjusting the distance between the left eye image and the right eye image according to the result of the perspective transformation; and synthesizing the left eye image and the right eye image after distance adjusting. According to the embodiment of the invention, a binocular parallax image is created through performing perspectivetransformation on the two-dimensional image to be processed; and the distance adjusting is performed on the left eye image and the right eye image after perspective transformation to form the binocular parallax and create a convergence angle, so that the image observed by naked eyes lies at different depths and different stereoscopic effects can be seen. The image transformation is performed through the two-dimensional image, which does not relate to the resolution and clarity of the image; therefore, the image quality of the image of 3D imaging is the same as that of the original two-dimensional image, and the effect of 3D imaging is not affected.

Light that is incident through a pair of object lenses of digital binocular glasses is photographed by a pair of image pickup devices to obtain a pair of images (stereoscopic image) generating a difference corresponding to a parallax of both eyes. A geometric difference between image structures corresponding to a parallax of both eyes is recognized in the pair of images subjected to various corrections and stored in memories. Thereafter, a noise reduction process is performed, which reduces a difference (for example, a difference between random noises superposed on the pair of images by the image pickup devices) other than the recognized geometric difference between the image structures. The images subjected to the noise reduction process are displayed on a pair of display devices, and are visually recognized (stereoscopically viewed) by the user through eyepiece lenses.

The invention relates to an optical display, in particular to a binocular NTE display system. The invention discloses a binocular NTE display system which can realize binocular watching by only one microdisplay. The invention adopts the technical proposal that: the binocular NTE display system comprises the microdisplay, an optical splitting system, a left eye ocular system and a right eye ocular system; and the optical splitting system splits the light emitted by the microdisplay into two paths to respectively enter in the left eye ocular system and the right eye ocular system. The binocular NTE display system has a simple structure, reduces the cost, solves the problem that the left eye and the right eye of the binocular NTE display system in the prior art are not easy to align for imaging, and is suitable for various NTE display.

A mobile terminal and a method of controlling the operation of the mobile terminal are provided. The method includes dividing each of first and second images into a plurality of blocks, the first and second images capable of realizing a three-dimensional (3D) image using binocular disparity; searching the first and second images for pairs of matching blocks and calculating depth information of each of the pairs of matching blocks based on a difference in position between each of the pairs of matching blocks; and calculating stereoscopic information of the 3D image based on the depth information of each of the pairs of matching blocks. Therefore, it is possible to effectively provide stereoscopic information of a 3D image for various purposes.

The invention relates to a near-eye binocular display device. The near-eye binocular display device is characterized in that the near-eye binocular display device comprises a micro-display (1), a collimating lens (2), a waveguide (4), an input end holographic grating (3), a left output end holographic grating (5) and an output end holographic grating (6); the micro-display (1) is located below the lower surface of the waveguide (4); the input end holographic grating (3) is located inside or on the surface of the waveguide (4); the left output end holographic grating (5) and the output end holographic grating (6) are located inside or on the surface of the waveguide (4); and the collimating lens (2) is located between the micro-display (1) and the waveguide (4) or on the lower surface of the waveguide (4). The holographic grating-waveguide structure of the near-eye binocular display device can evenly divide an original beam emitted by the micro-display into two beams; and the two beams are diffracted through the two output end holographic gratings respectively so as to enter the left eye and right eye of a user, and therefore, binocular display can be realized.

The invention discloses a binocular display system and an onboard head-up display system. The binocular display system comprises two imaging devices separated by a set distance, a beam splitter and areflector, wherein the two imaging devices are used for displaying a left eye image and a right eye image respectively; the beam splitter is used for receiving the light emitted by the imaging devices, transmitting the light to the reflector, and reflecting the reflected light of the reflector to a set position; the set position and the exit pupil position of the imaging devices are symmetrical about the beam splitting plane of the beam splitter; and the reflector is used for reflecting the incident light back to an original path. By virtue of the beam splitter and the reflector, the system exit pupil distance of the binocular display system is increased. A viewer can view a binocular display image of the imaging devices at a position symmetrical with the exit pupil position of the imaging devices about the beam splitting plane of the beam splitter without the need to get close to the exit pupil position of the imaging devices. Thus, the binocular display system can be applied to a wide application field such as onboard head-up display.

An apparatus and a method for generating Three Dimensional (3D) contents in an electronic device are provided. The method includes extracting data having geometric information, generating two images having binocular disparity using the geometric information of the extracted data, and outputting the generated two images to a display unit. The generating of the two images having the binocular disparity includes rendering a first image using the geometric information of the extracted data, and generating a second image using depth information of an object in the first image.

A depth estimating apparatus operated by at least one processor includes: a database which stores a photographed first color image, a training thermal image geometrically aligned with the first color image, and a second color image simultaneously photographed with the first color image as a training image set; and a training apparatus which trains a neural network in an unsupervised manner to output a chromaticity image and a binocular disparity image from the training thermal image. The training apparatus generates an estimated first color image from the second color image, the chromaticity image, and the binocular disparity image, and trains the neural network to minimize a difference between the estimated first color image and the photographed first color image.

The invention relates to a head-wearing type virtual reality display based on DirectX9. The head-wearing type virtual reality display comprises a display screen and a computer, wherein the display screen displays an image through the computer; the computer is also connected with a motion sensor; the motion sensor sends data of head rotating angle motion to the computer for processing; the computer generates and transmits a picture meeting a binocular parallax standard through DirectX9 texturization, deformation and replay processing to the display screen for displaying. The head-wearing type virtual reality display has a panoramic 3D (three-dimensional) effect and can display pictures in corresponding directions according to rotating angles of the head.

A stereomicroscope includes a microscope main body and a camera for assistant. The microscope main body includes therein an objective optical system, a zoom optical system and an eyepiece optical system. The camera for assistant is detachably mounted to the microscope main body. The microscope main body provides to a main operator a pair of optical images including a certain binocular disparity as viewed from an observation direction of the main operator. The camera for assistant provides to an assistant a pair of electron images including a certain binocular disparity as viewed from an observation direction of the assistant. The observation directions of the main operator and the assistant cross at a certain angle. The camera for assistant outputs the pair of electron images into a stereo viewer which is separated from the microscope main body.