245 results about "Left eye" patented technology

Disclosed in the present invention is a salient contour matching-based method for target measurement in a severe imaging environment. The method specifically comprises: (1) acquiring a binocular image of a target; (2) establishing a global-local joint constraint-based background light estimation model, and removing a scattering effect of a medium in an imaging environment to obtain a restored left eye image and a restored right eye image; (3) learning an original image, and on the basis of a residual between a network reconstructed image and the original image, obtaining target localization prediction maps of the left eye image and the right eye image; and (4) respectively extracting contour lines of the target in the left eye image and the right eye image, constructing feature matching descriptors of contour points, performing stereo matching on the two sets of contour lines by minimizing matching cost, and performing three-dimensional reconstruction on the contour lines in light of calibrated intrinsic and extrinsic parameters to complete the measurement of a key size. According to the present invention, the key sizes of different targets in a severe environment can be accurately measured, thereby providing an effective solution for the problem of measuring the sizes of targets in a severe environment.

This invention belongs to the field of facial expression recognition and provides a micro-expression recognition method based on convolutional neural networks and optical flow features, which is used to improve the adaptability and accuracy of micro-expression recognition. The method first constructs a face detection module to perform face detection on each image frame in a video segment, outputs facial key point information, and extracts facial regions of interest (ROIs) based on the facial key point information: nose, mouth, left eye and eyebrow, right eye and eyebrow. Then, optical flow information and optical strain information are introduced to characterize the spatiotemporal information of facial movement and the intensity information of facial deformation. The optical flow eigenvalue of each image frame is calculated, and a binary search algorithm is used to search for the image frame with the maximum optical flow eigenvalue, which is used as the vertex frame for micro-expression recognition. Finally, a micro-expression recognition model based on a convolutional neural network is constructed, which uses the horizontal and vertical components of the optical flow and optical strain of the vertex frame as input. The micro-expression recognition model outputs a micro-expression category prediction result.

The invention provides a human-computer interaction method based on eye movement tracking, and the method is characterized in that the method comprises the steps: S1, obtaining an original image, and carrying out the preprocessing of the original image; s2, generating a depth information image of the preprocessed original image, and performing facial feature detection and interception on the preprocessed original image to obtain a facial feature image; s3, performing eye feature detection and interception on the facial feature image to respectively obtain a left eye feature image and a right eye feature image, and obtaining user feature information according to the facial feature image; s4, processing the facial feature image, the left eye feature image and the right eye feature image by using a deep learning model, and calculating a fixation point in combination with the depth information image; and S5, outputting user features and gaze information by combining the gaze point and the user feature information, and executing a corresponding program in response to the interactive action. According to the invention, accurate calculation of the depth information of each pixel point in the image is realized, and the depth information graph completely corresponding to the input image is generated.

An eye tracking system can include a first camera configured to capture a first plurality of visual data of a right eye at a first sampling rate. The system can include a second camera configured to capture a second plurality of visual data of a left eye at a second sampling rate. The second plurality of visual data can be captured during different sampling times than the first plurality of visual data. The system can estimate, based on at least some visual data of the first and second plurality of visual data, visual data of at least one of the right or left eye at a sampling time during which visual data of an eye for which the visual data is being estimated are not being captured. Eye movements of the eye based on at least some of the estimated visual data and at least some visual data of the first or second plurality of visual data can be determined.

The invention discloses a mechanical arm vision distance measurement method and a distance measurement system thereof, and relates to the technical field of intelligent vision perception, a camera is installed on a mechanical arm to collect images, and through an optimization matching algorithm, the images shot by the left eye and the right eye are rapidly compared to generate a clear and accurate disparity map; the motion state of the mechanical arm is detected in real time through a vibration compensation mechanism, a shot image is corrected, and it is ensured that the distance measuring process is stable and reliable; and in combination with the corrected disparity map, the accurate distance from the target object to the camera is obtained by utilizing a depth calculation formula, and the result is transmitted to a control system of the mechanical arm. The depth value is fed back to the mechanical arm controller in real time through depth calculation and linkage with a control system, the precision of dynamic path planning and action execution of the mechanical arm is improved, and the mechanical arm shows higher anti-interference capacity in a dynamic vibration environment.

A method of operating an electronic device to mitigate double vision is provided. The method can include using front-facing cameras to acquire passthrough content, using a graphics renderer to generate virtual content, mitigating double vision or improving vergence comfort by modifying at least the passthrough content, merging the passthrough content with the virtual content, and displaying the merged content. The passthrough content can be modified by selectively shifting or transforming left eye passthrough content or right eye passthrough content. The virtual content can be rendered based on a similar type of modification applied to the passthrough content. The virtual content can also be modified by selectively shifting or transforming left eye virtual content or right eye virtual content.

The invention discloses a light-weight heat map stereo matching method and device, which are used for solving the technical problem that the precision of a final parallax result is poor due to the fact that information is easy to lose when a tiny depth difference is captured by the existing light-weight heat map stereo matching method. The method comprises the following steps: acquiring a left eye thermal image and a right eye thermal image, and inputting a preset thermal image stereo matching model (including multi-scale fusion feature extraction, edge feature extraction, an enhanced wavelet attention module, a plurality of cost aggregation residual blocks and a convolution module); a multi-scale module extracts features, generates a left eye and right eye fusion feature map, and constructs an initial cost body; the edge module outputs a left-eye edge probability feature graph, and an intermediate cost body is obtained by combining the initial cost body; the wavelet attention module outputs an attention weight according to the left eye fusion feature map; the cost aggregation residual block is multiplied by the middle cost body according to the weight, and an initial disparity map is generated through disparity regression; and the convolution module combines the left-eye edge probability feature map for refining, and finally generates a target disparity map.

According to an aspect, a system includes a first image source for a left eye and a second image source for a right eye. The system further includes at least one window in a first optical path for the first image source or a second optical path for the second image source, the at least one window configured to align first pixels from the first image source with second pixels from the second image source.

A virtual image display device includes a first display device for a right eye, a second display device for a left eye, a lens barrel or the like serving as an assembly member configured to assemble the first display device and the second display device, and first and second correction units serving as post-assembly adjustment devices configured to adjust a display state of the first display device and the second display device assembled by the assembly member.

A method includes receiving scene image data, comprising left and right images for each eye. Through an eye tracking module, the method includes determining the user's gaze direction or eye vergence. Using this information, the method includes identifying an object in the scene that the user is focusing on, and determining, using a depth estimation module, a left depth from the left eye to the object and a right depth from the right eye to the object. Further, based on the computed left and right depths, the method includes generating, for the left and right eye, constant left and right depth meshes, generating a left and right output images by projecting the left and right images on the corresponding constant left and right depth meshes. Additionally, the method includes displaying the left output image for the left eye and displaying the right output image for the right eye.

A determining device has a processor configured to determine that a driver has dozed off when degree of eye opening of a left eye and degree of eye opening of a right eye of the driver are at or below a reference degree of eye opening and an absolute value of difference between the degree of eye opening of the left eye and the degree of eye opening of the right eye does not exceed a reference difference or determine that the driver has not dozed off when the degree of eye opening of the left eye and the degree of eye opening of the right eye are at or below the reference degree and the absolute value of the difference between the degree of eye opening of the left eye and the degree of eye opening of the right eye exceeds a reference difference during a determining period.

The invention discloses an electronic sighting mark generating device for a synoptophore, relates to the field of optical systems, and is used for solving the problem that the types of sighting marks displayed in a traditional synoptophore are limited and are static. The device comprises a first display module and a second display module, the first display module and the second display module are arranged side by side, the left eye and the right eye of a testee face the first display module and the second display module respectively, the first display module is used for displaying a first test image and enabling light of the first test image to be emitted to the left eye, and the second display module is used for displaying a second test image. The second display module is used for displaying a second test image and enabling light of the second test image to be emitted to the right eye; and the sighting mark generation module is used for processing the image and generating image data, and respectively transmitting the image data to the first display module and the second display module, so that the first display module displays the first test image, and the second display module displays the second test image. Compared with the prior art that images are displayed through slides, more diversified test images can be displayed, and more dynamic test images can be displayed.

The invention relates to the field of image processing, and discloses a fixation point determination method, system and product. The method comprises the following steps: acquiring a first binocular image acquired by an eye camera aiming at the eyes of a user under a visible light condition; predicting a first left eye sight line of the user according to a left eye image in the first binocular image, and predicting a first right eye sight line of the user according to a right eye image in the first binocular image; predicting a first synthetic sight line of the user according to the first binocular image; the first synthetic sight line is a sight line associated with a scene camera; the scene camera is used for collecting a scene in a visual field range of the user; and determining a fixation point of the user based on two of the first left-eye sight line, the first right-eye sight line and the first synthetic sight line. By adopting the method, the near-to-eye tracking precision can be ensured under the visible light condition, and the deployment cost of eye movement tracking equipment can be reduced.

According to an embodiment of the disclosure, a media content rendering method may be provided. The method may include determining a plurality of eye attributes of a user, based on eye position for each of a left eye and a right eye. The method may include identifying eye movement for each of the left eye and right eye, based on the plurality of eye attributes. The method may include determining a constraint for a movement of each of the left eye and right eye, based on the eye movement. The method may include determining a binocular field-of-view (FOV) of the user, based on the constraint for each of the left eye and right eye. The method may include determining transformation values, based on the binocular FOV of the user. The method may include providing a transformed media content based on the transformation values to render the transformed media content.

The application relates to an AR glasses binocular calculation algorithm, which is applied to AR glasses provided with left and right light machines, an eye camera and a master control module, and comprises the following steps: S1, initialization and test image projection, after system initialization and ghost image displacement correction are completed, the left and right light machines respectively project binocular calibration images to the eye camera; S2, center calibration positioning, left and right eye field images are acquired through the eye camera, and left eye center coordinates and right eye center coordinates where the binocular calibration images in the left and right eye field images are respectively extracted through an image recognition algorithm; S3, binocular alignment deviation calculation, the position alignment deviation of the left and right eyes is calculated according to the left eye center coordinates and the right eye center coordinates acquired in step S2; S4, dynamic light machine position adjustment, taking the center coordinates of the eye camera as the reference, the left and right light machines are adjusted in the horizontal direction and the vertical direction; and S5, iterative optimization, steps S2-S4 are repeated until the binocular alignment or the maximum iteration number is reached.

The embodiment of the invention provides a sub-pixel offset optimization parallax calculation method, a sub-pixel offset optimization parallax calculation device and electronic equipment. The sub-pixel offset optimization parallax calculation method comprises the following steps: acquiring a binocular image; labeling a label of a target area of the binocular image based on a preset semantic segmentation network; based on the label, extracting visual features of the target area; establishing a matching relation of the target area according to the visual features; respectively calculating a first sub-pixel offset of a left eye image in the binocular image and a second sub-pixel offset of a right eye image in the binocular image according to the matching relationship of the target areas; and calculating the parallax of the binocular image according to the first sub-pixel offset and the second sub-pixel offset. According to the method, the target area is accurately marked by introducing the semantic segmentation network, and visual feature extraction and sub-pixel offset calculation are combined, so that the precision and robustness of binocular image parallax calculation are remarkably improved.

This article is a cosmetic pack sheet for performing a face cosmetic pack. This article is composed of a water-containing sheet having the shape shown in each figure, and is used in a wet state in which a cosmetic liquid such as lotion, emulsion, or gel is impregnated in this water-containing sheet. For example, this article in a wet state is adhered so as to cover around the eyes of the user (see the reference figure showing an example of the use state). Since this article is composed of a water-containing sheet that is symmetric front and back, by using the adhesion surface of the sheet separately for the front and back, the adhesion location on the face of the user can be either one of the right eye area and the left eye area, or the other.

Arrangement of artificial adaptive intraocular lenses whose operating mode is based on binocular interaction and the accommodation-convergence reflex of the eyes, i. wherein all electrically activated adaptive intraocular lenses (8)(9)(10) comprise activation mechanisms and are operated without interaction between the left and right eye, characterized in that ii. the arrangement of the novel artificial adaptive intraocular lenses, whose operating mode is based on binocular interaction (11.3)(12.3)(5) and the accommodation-convergence reflex of the eyes, is characterized by the inclusion of a microchip, wherein a microchip is used for each intraocular lens of each eye, the microchip containing magnetic nanoparticles with electromagnetic properties and made of biocompatible, non-cytotoxic material (5.1)(3.1)(4.1), wherein a conductor connected to the microchip forms a closed loop (5.2)(3.2)(4.2), and wherein the change in the distance between the microchips of the artificial intraocular lenses of the right and left eye during the convergence movements (5.3)(11.2)(12.2) and divergence movements (5.3)(11.1)(12.1) changes both the strength and the phase of the electromagnetic field (5.4) between the two microchips (5.1)(3.1)(4.1) of the two artificial intraocular lenses, which interact with each other, wherein this change in the strength and phase of the electromagnetic field (5.4) causes the generation of an electric charge or voltage at the ends of the conductor (5.5)(3.3)(4.3), which leads to an electric current flow (5.6)(3.4)(4.4) through the closed loop of the conductor (5.2)(3.2)(4.2) due to the induced voltage and according to the principle of electromagnetic induction.

The invention provides a method for checking light leakage of a sun shield, which is used for effectively adjusting and optimally avoiding the conditions of upper light leakage or left light leakage of the sun shield, the sun shield, a ceiling boundary, an A column boundary and a front windshield black edge in the driving process of a driver and passengers. By taking the left limit point or the upper limit point of the left eye ellipse as a projection center, projecting a point on the sun shield onto the curved surface of the front windshield, projecting a point on the left A column onto the curved surface of the front windshield, and projecting a point on the ceiling onto the curved surface of the front windshield; and then processing the data. According to the method, the optimized result can be quantitatively presented, a model or an organizing person is not needed for review, and high efficiency and low cost are achieved.

A personal eyewear device comprises: a frame for supporting one or more lenses in front of a left eye and a right eye of a wearer when the personal eyewear device is worn by the wearer and an electronics module. The electronics module includes: a processor, a memory, a power source for powering the electronics module, and an eye tracking subsystem, wherein the processor and the memory are communicatively coupled with the eye tracking subsystem and wherein the eye tracking subsystem comprises: a first pair of imaging sensors forming a first stereo imaging sensor configured to capture images of a left eye of the wearer; and a second pair of imaging sensors forming a second stereo imaging sensor configured to capture images of a right eye of the wearer. The device further includes at least one additional sensor subsystem and a scheduling module.

Various implementations disclosed herein include devices, systems, and methods that uses a horizontal shift of left eye and right eye image content to control a stereo effect of the image content. For example, a process may include obtaining image data including images to be presented with a stereo effect at a virtual screen position within a three-dimensional (3D) viewing environment. The process may further obtain depth data corresponding to distances of elements of a scene depicted in the images. The process may further determine a horizontal positioning characteristic for presenting the images at the virtual screen with the stereo effect based on the depth data and a view of the images are presented with the stereo effect based on the horizontal positioning characteristic at the virtual screen within the 3D environment. The images may additionally be presented with a blur, a lighting, a fading, and / or a vignetting effect.

The present invention provides a fatigue driving behavior recognition method for 3D point cloud image data. First, collect 3D point cloud image video frames as the images to be processed; then, use the point-voxel fusion transformation network PVFTN to process the images to be processed to obtain the driver's face region feature image. The point-voxel fusion transformation network PVFTN includes three PVF modules, and the PVF module includes a point-voxel branch and a voxel branch; then use the multi-scale facial key point detector MSFLD to process the face region feature image to obtain the coordinates of 23 key points per frame; then calculate the aspect ratios of the left eye, right eye and mouth, and update the face fatigue parameter matrix; finally, use a method combining a statistical threshold and an adaptive threshold for judgment to obtain the judgment result of the driver's driving state, thereby realizing the judgment of the fatigue driving state of the driver in the motion state.

This application provides a method, apparatus, and device for left and right eye recognition. The method involves emitting a first signal at a first angle and a second signal at a second angle; receiving reflected signals, including a first reflected signal and a second reflected signal, where the first reflected signal is the signal reflected back from the first signal and the second reflected signal is the signal reflected back from the second signal; and determining whether the currently measured eye is the left or right eye based on the first and second reflected signals. Both the first and second signals are optical signals, or both are coded signals, where the coded signal is an optical signal carrying a code. Embodiments of this application can automatically identify the left and right eyes.

The invention discloses an eye movement tracking calibration method and device, which can be applied to the field of human-computer interaction, and comprises the following steps: inputting an eye movement tracking model for processing by fusing various characteristics such as face, left eye and right eye images and geometric position information thereof, obtaining a hidden vector, and mapping the hidden vector to a watching position. And meanwhile, fine tuning data is screened out by using the calibration screening module in combination with the time sequence characteristics of the cursor position and the hidden vector, and dynamic fine tuning is performed on the eye movement tracking module. The multi-feature fusion mode can reflect eye movement information more comprehensively, so that when the positions of the user and the equipment change, high tracking precision can still be kept, and the frequent calibration requirement caused by position change is reduced. And repeated interruption of user interaction is avoided, so that the user experience is remarkably improved.

To provide a wearable terminal device capable of OCT-imaging one of the right eye and the left eye while SLO-imaging the other.SOLUTION: An ophthalmologic apparatus comprises: an ejection part including light sources having at least one of a first light source and a second light source for emitting light for an examination with respect to eyes to be examined so as to eject the light from the light sources; an optical system 507 for guiding the light ejected from the ejection part to a right eye retinal and / or a left eye retinal; and a control part 570 for controlling the ejection part and the optical system so as to irradiate the right eye retinal and / or the left eye retinal with the light.SELECTED DRAWING: Figure 14

The application provides a multi-task driver line-of-sight estimation method and system for assisting safe driving. A plurality of driver images are obtained from a video sequence, face key feature points and a face region image of each driver image are extracted by a Dlib CNN method, eye region cropping and head posture extraction are performed on the face key feature points of each driver image, left eye region images, right eye region images and head postures of each driver image are obtained, a driver line-of-sight estimation network is constructed, the left eye region images, the right eye region images, the face region images and the head postures of each driver image are taken as inputs of the driver line-of-sight estimation network, estimated line-of-sight directions and estimated gaze region types of each driver image are obtained, real-time driver images are obtained and input into the driver line-of-sight estimation network, and estimated line-of-sight directions and estimated gaze region types of the real-time driver are obtained.

The invention relates to the technical field of optics, and discloses a display method, electronic equipment and a medium. In the display method provided by the invention, when the processor determines that the user interpupillary distance information is not in the standard interpupillary distance range, the DDIC is indicated to perform translation processing on the to-be-displayed image, and the corresponding display is controlled to display the corresponding image. For example, when the user interpupillary distance is larger than the standard interpupillary distance range, the DDIC is indicated to translate the to-be-displayed image corresponding to the left eye to the left, the display corresponding to the left eye is controlled to display the translated image corresponding to the left eye, and the to-be-displayed image corresponding to the right eye is translated to the right; and controlling the display corresponding to the right eye to display the translated to-be-displayed image corresponding to the right eye. Therefore, the watching requirements of users with different interpupillary distances can be met, the watching experience of the users is improved, in addition, the occupation of processor resources can be reduced by performing translation and other processing on the to-be-displayed image based on DDIC, and thus the power consumption of the processor is saved.

The application relates to a left eye and right eye tenon-and-mortise complementary dynamic out-of-focus microlens structure lens, which comprises a left eye lens and a right eye lens, the left eye lens and the right eye lens are respectively provided with an out-of-focus ring, and the out-of-focus ring structure distribution on the left eye lens and the out-of-focus ring structure distribution on the right eye lens are in complementary design. The out-of-focus ring comprises a plurality of concentrically arranged single rings, and each single ring comprises out-of-focus arc segments and arc segment gaps which are the same in number. An image seen in an arc gap area is a clear image; the out-of-focus arc section is of a convex lens structure or a concave lens structure and can provide a plurality of different diopters, so that images seen in peripheral areas except the transparent luminosity area become blurred. Dynamic defocusing is achieved through a nasal bitamporal defocusing amount asymmetry and a double-eye defocusing area and transparent area complementation method, and therefore the problem that the myopia control effect is reduced due to long-time wearing is solved.

The invention provides an ophthalmic apparatus which can easily detect eye position deviation when brightness difference of a visual target presented to a left eye and a right eye is enlarged from a double-eye visual state. An ophthalmic apparatus (1) is provided with a visual target presentation means (visual target projection system (44)) for presenting a left-eye visual target (OtL) to a left subject eye (EL) and presenting a right-eye visual target (OtR) to a right subject eye (ER), and the left-eye visual target (OtL) and the right-eye visual target (OtR) are in the same form. A sighting target presentation means (sighting target projection system (44)) presents a left-eye sighting target (OtL) to a left subject eye (EL) and presents a right-eye sighting target (OtR) to a right subject eye (ER), thereby enlarging the brightness difference between a common portion of the left-eye sighting target (OtL) and the right-eye sighting target (OtR) and maintaining the brightness difference between the remaining portions of the left-eye sighting target (OtL) and the right-eye sighting target (OtR).

The present disclosure provides a near-eye display for augmented reality having a polygon-curved optical waveguide holographic coupler and a method of operating the same. In the present disclosure, the near-eye display for augmented reality comprises at least one source and a curved optical waveguide disposed in front of at least one of a user's right eye and left eye, which replicates light from the source by internally reflecting it through at least one of two ends and outputs the replicated light for at least one of the right eye and left eye, and the curved optical waveguide may be a polygon-curved optical waveguide having a plurality of planes disposed at points where the light is totally reflected.