274 results about "Left eye" patented technology

Disclosed in the present invention is a salient contour matching-based method for target measurement in a severe imaging environment. The method specifically comprises: (1) acquiring a binocular image of a target; (2) establishing a global-local joint constraint-based background light estimation model, and removing a scattering effect of a medium in an imaging environment to obtain a restored left eye image and a restored right eye image; (3) learning an original image, and on the basis of a residual between a network reconstructed image and the original image, obtaining target localization prediction maps of the left eye image and the right eye image; and (4) respectively extracting contour lines of the target in the left eye image and the right eye image, constructing feature matching descriptors of contour points, performing stereo matching on the two sets of contour lines by minimizing matching cost, and performing three-dimensional reconstruction on the contour lines in light of calibrated intrinsic and extrinsic parameters to complete the measurement of a key size. According to the present invention, the key sizes of different targets in a severe environment can be accurately measured, thereby providing an effective solution for the problem of measuring the sizes of targets in a severe environment.

Various examples disclosed herein maintain stereo consistency in extended reality (XR) environments when receiving content data with a content frame depicting both a left eye portion of a content item corresponding to a first left eye viewpoint of the content item within the XR environment, and a right eye portion of the content item corresponding to a first right eye viewpoint of the content item within the XR environment. Stereo consistency may be maintained by determining to use an adjusted version of the content frame to provide a view of the content item wherein a left eye view from a second left eye viewpoint is different than the first left eye viewpoint and a right eye view from a second right eye viewpoint is different than the first right eye viewpoint, and presenting the left eye view and the right eye view based on the content frame and the adjustment.

This invention belongs to the field of facial expression recognition and provides a micro-expression recognition method based on convolutional neural networks and optical flow features, which is used to improve the adaptability and accuracy of micro-expression recognition. The method first constructs a face detection module to perform face detection on each image frame in a video segment, outputs facial key point information, and extracts facial regions of interest (ROIs) based on the facial key point information: nose, mouth, left eye and eyebrow, right eye and eyebrow. Then, optical flow information and optical strain information are introduced to characterize the spatiotemporal information of facial movement and the intensity information of facial deformation. The optical flow eigenvalue of each image frame is calculated, and a binary search algorithm is used to search for the image frame with the maximum optical flow eigenvalue, which is used as the vertex frame for micro-expression recognition. Finally, a micro-expression recognition model based on a convolutional neural network is constructed, which uses the horizontal and vertical components of the optical flow and optical strain of the vertex frame as input. The micro-expression recognition model outputs a micro-expression category prediction result.

The invention provides a human-computer interaction method based on eye movement tracking, and the method is characterized in that the method comprises the steps: S1, obtaining an original image, and carrying out the preprocessing of the original image; s2, generating a depth information image of the preprocessed original image, and performing facial feature detection and interception on the preprocessed original image to obtain a facial feature image; s3, performing eye feature detection and interception on the facial feature image to respectively obtain a left eye feature image and a right eye feature image, and obtaining user feature information according to the facial feature image; s4, processing the facial feature image, the left eye feature image and the right eye feature image by using a deep learning model, and calculating a fixation point in combination with the depth information image; and S5, outputting user features and gaze information by combining the gaze point and the user feature information, and executing a corresponding program in response to the interactive action. According to the invention, accurate calculation of the depth information of each pixel point in the image is realized, and the depth information graph completely corresponding to the input image is generated.

An eye tracking system can include a first camera configured to capture a first plurality of visual data of a right eye at a first sampling rate. The system can include a second camera configured to capture a second plurality of visual data of a left eye at a second sampling rate. The second plurality of visual data can be captured during different sampling times than the first plurality of visual data. The system can estimate, based on at least some visual data of the first and second plurality of visual data, visual data of at least one of the right or left eye at a sampling time during which visual data of an eye for which the visual data is being estimated are not being captured. Eye movements of the eye based on at least some of the estimated visual data and at least some visual data of the first or second plurality of visual data can be determined.

To provide a wearable device, a system, and a display method that control the display on the basis of the results of detecting the rotation of the right eye and the rotation of the left eye.SOLUTION: The wearable device is configured to determine whether a user is looking at a first object at a first distance in the real world or looking at a second object at a second distance which is different from the first distance on the basis of the angle of convergence detected by a detector, display a first augmented reality image on a display when the user is determined to be looking at the first object, transmit a request signal to an electronic device when the user is determined to be looking at the second object, and display a second virtual reality image transmitted from the electronic device in response to the request signal on the display.SELECTED DRAWING: Figure 4

The invention discloses a mechanical arm vision distance measurement method and a distance measurement system thereof, and relates to the technical field of intelligent vision perception, a camera is installed on a mechanical arm to collect images, and through an optimization matching algorithm, the images shot by the left eye and the right eye are rapidly compared to generate a clear and accurate disparity map; the motion state of the mechanical arm is detected in real time through a vibration compensation mechanism, a shot image is corrected, and it is ensured that the distance measuring process is stable and reliable; and in combination with the corrected disparity map, the accurate distance from the target object to the camera is obtained by utilizing a depth calculation formula, and the result is transmitted to a control system of the mechanical arm. The depth value is fed back to the mechanical arm controller in real time through depth calculation and linkage with a control system, the precision of dynamic path planning and action execution of the mechanical arm is improved, and the mechanical arm shows higher anti-interference capacity in a dynamic vibration environment.

The integrated VR glasses provided by the invention comprise a glasses frame, the glasses frame comprises a glasses frame and glasses legs, and the glasses legs are rotatably connected to the glasses frame; the display module is embedded in the mirror frame and used for displaying pictures watched by the left eye and the right eye, the display module comprises a first display screen and a second display screen, the first display screen is arranged at the left mirror position of the mirror frame, the second display screen is arranged at the right mirror position of the mirror frame, the first display screen displays the pictures watched by the left eye, and the second display screen displays the pictures watched by the right eye; the nose pad structure is detachably mounted on the glasses frame; the earphones are fixed on the glasses legs, are in communication connection with the display module and are used for outputting audio information; the posture sensing module is arranged on the glasses frame and used for obtaining user action information, converting the action information into control information and sending the control information to the display module. According to the invention, the in-ear earphones are fixed with the glasses legs through the universal arms, and the universal arms can enable the earphones to stay at any position, so that the in-ear earphones can be ensured to adapt to all users.

A method of operating an electronic device to mitigate double vision is provided. The method can include using front-facing cameras to acquire passthrough content, using a graphics renderer to generate virtual content, mitigating double vision or improving vergence comfort by modifying at least the passthrough content, merging the passthrough content with the virtual content, and displaying the merged content. The passthrough content can be modified by selectively shifting or transforming left eye passthrough content or right eye passthrough content. The virtual content can be rendered based on a similar type of modification applied to the passthrough content. The virtual content can also be modified by selectively shifting or transforming left eye virtual content or right eye virtual content.

The invention discloses a light-weight heat map stereo matching method and device, which are used for solving the technical problem that the precision of a final parallax result is poor due to the fact that information is easy to lose when a tiny depth difference is captured by the existing light-weight heat map stereo matching method. The method comprises the following steps: acquiring a left eye thermal image and a right eye thermal image, and inputting a preset thermal image stereo matching model (including multi-scale fusion feature extraction, edge feature extraction, an enhanced wavelet attention module, a plurality of cost aggregation residual blocks and a convolution module); a multi-scale module extracts features, generates a left eye and right eye fusion feature map, and constructs an initial cost body; the edge module outputs a left-eye edge probability feature graph, and an intermediate cost body is obtained by combining the initial cost body; the wavelet attention module outputs an attention weight according to the left eye fusion feature map; the cost aggregation residual block is multiplied by the middle cost body according to the weight, and an initial disparity map is generated through disparity regression; and the convolution module combines the left-eye edge probability feature map for refining, and finally generates a target disparity map.

According to an aspect, a system includes a first image source for a left eye and a second image source for a right eye. The system further includes at least one window in a first optical path for the first image source or a second optical path for the second image source, the at least one window configured to align first pixels from the first image source with second pixels from the second image source.

A virtual image display device includes a first display device for a right eye, a second display device for a left eye, a lens barrel or the like serving as an assembly member configured to assemble the first display device and the second display device, and first and second correction units serving as post-assembly adjustment devices configured to adjust a display state of the first display device and the second display device assembled by the assembly member.

A method includes receiving scene image data, comprising left and right images for each eye. Through an eye tracking module, the method includes determining the user's gaze direction or eye vergence. Using this information, the method includes identifying an object in the scene that the user is focusing on, and determining, using a depth estimation module, a left depth from the left eye to the object and a right depth from the right eye to the object. Further, based on the computed left and right depths, the method includes generating, for the left and right eye, constant left and right depth meshes, generating a left and right output images by projecting the left and right images on the corresponding constant left and right depth meshes. Additionally, the method includes displaying the left output image for the left eye and displaying the right output image for the right eye.

The invention provides a brain surgery image analysis method based on a computer vision technology, and relates to the technical field of computer vision, and the method comprises the steps: collecting a three-dimensional binocular image in a brain surgery; determining visual difference between a left eye and a right eye in the binocular camera, generating a depth map space of a three-dimensional binocular image, and further extracting a visual missing area in the brain surgery; determining an obstacle shielding domain of an obstacle in the binocular camera according to the depth map space, and performing light stripe tracking through the obstacle shielding domain and a relative position between a left eye and a right eye in the binocular camera to obtain light stripe missing information in the brain surgery; and determining a reconstruction missing threshold value of the binocular camera according to the light bar missing information and the visual missing area, performing fusion vacancy filling on the three-dimensional binocular image based on the reconstruction missing threshold value to obtain a three-dimensional fusion image, and taking the three-dimensional fusion image as an analysis image of the brain surgery. And the image integrity of the brain surgery is improved.

A removably attachable phototherapy and vibration system for attachment to and treatment of skin beneath the eyes includes a therapeutic lamp platform for radiant lamps such as LEDs disposed in an assembly, and including a vibrating element, facing towards a patient and a plurality of light apertures substantially aligned with the LEDs for communicating lamp radiation from the lamps to a user. The lamps, vibrating element and associated circuitry are disposed so that the attachable surface is relatively smooth and seamless towards the patient. The system includes two devices one for the right and the other for the left eye of the user. Each device is attachable to beneath each eye with a suitable adhesive such as a reusable silicone strip. The system includes a charging dock for storing and charging the devices.

A determining device has a processor configured to determine that a driver has dozed off when degree of eye opening of a left eye and degree of eye opening of a right eye of the driver are at or below a reference degree of eye opening and an absolute value of difference between the degree of eye opening of the left eye and the degree of eye opening of the right eye does not exceed a reference difference or determine that the driver has not dozed off when the degree of eye opening of the left eye and the degree of eye opening of the right eye are at or below the reference degree and the absolute value of the difference between the degree of eye opening of the left eye and the degree of eye opening of the right eye exceeds a reference difference during a determining period.

The invention discloses an electronic sighting mark generating device for a synoptophore, relates to the field of optical systems, and is used for solving the problem that the types of sighting marks displayed in a traditional synoptophore are limited and are static. The device comprises a first display module and a second display module, the first display module and the second display module are arranged side by side, the left eye and the right eye of a testee face the first display module and the second display module respectively, the first display module is used for displaying a first test image and enabling light of the first test image to be emitted to the left eye, and the second display module is used for displaying a second test image. The second display module is used for displaying a second test image and enabling light of the second test image to be emitted to the right eye; and the sighting mark generation module is used for processing the image and generating image data, and respectively transmitting the image data to the first display module and the second display module, so that the first display module displays the first test image, and the second display module displays the second test image. Compared with the prior art that images are displayed through slides, more diversified test images can be displayed, and more dynamic test images can be displayed.

To provide a technique of displaying an aerial image in a distant view of a large screen.SOLUTION: In an embodiment of the present invention, the position of the point of view of an observer is between an aerial image which is presented by a presentation device for presenting an image and is formed in the air and the presentation device. The display device according to the embodiment of the present invention has a parallax compensation image generation unit for generating a presentation image to present by the presentation device by compensating the parallax of images for the right eye and for the left eye to display, on the basis of the distance from the position of the point of view and the aerial image and the parallax of an observer.SELECTED DRAWING: Figure 2

The invention relates to the field of image processing, and discloses a fixation point determination method, system and product. The method comprises the following steps: acquiring a first binocular image acquired by an eye camera aiming at the eyes of a user under a visible light condition; predicting a first left eye sight line of the user according to a left eye image in the first binocular image, and predicting a first right eye sight line of the user according to a right eye image in the first binocular image; predicting a first synthetic sight line of the user according to the first binocular image; the first synthetic sight line is a sight line associated with a scene camera; the scene camera is used for collecting a scene in a visual field range of the user; and determining a fixation point of the user based on two of the first left-eye sight line, the first right-eye sight line and the first synthetic sight line. By adopting the method, the near-to-eye tracking precision can be ensured under the visible light condition, and the deployment cost of eye movement tracking equipment can be reduced.

According to an embodiment of the disclosure, a media content rendering method may be provided. The method may include determining a plurality of eye attributes of a user, based on eye position for each of a left eye and a right eye. The method may include identifying eye movement for each of the left eye and right eye, based on the plurality of eye attributes. The method may include determining a constraint for a movement of each of the left eye and right eye, based on the eye movement. The method may include determining a binocular field-of-view (FOV) of the user, based on the constraint for each of the left eye and right eye. The method may include determining transformation values, based on the binocular FOV of the user. The method may include providing a transformed media content based on the transformation values to render the transformed media content.

The application relates to an AR glasses binocular calculation algorithm, which is applied to AR glasses provided with left and right light machines, an eye camera and a master control module, and comprises the following steps: S1, initialization and test image projection, after system initialization and ghost image displacement correction are completed, the left and right light machines respectively project binocular calibration images to the eye camera; S2, center calibration positioning, left and right eye field images are acquired through the eye camera, and left eye center coordinates and right eye center coordinates where the binocular calibration images in the left and right eye field images are respectively extracted through an image recognition algorithm; S3, binocular alignment deviation calculation, the position alignment deviation of the left and right eyes is calculated according to the left eye center coordinates and the right eye center coordinates acquired in step S2; S4, dynamic light machine position adjustment, taking the center coordinates of the eye camera as the reference, the left and right light machines are adjusted in the horizontal direction and the vertical direction; and S5, iterative optimization, steps S2-S4 are repeated until the binocular alignment or the maximum iteration number is reached.

The invention provides a strabismus measuring instrument eye shielding intelligent adjusting method. The method comprises the steps that a first face image is acquired, and the first position and size of an eye area are determined; obtaining a size ratio of a preset measurement window to the face image, and controlling the measurement window to form a shielding area according to the size ratio and the first position and size of the eye area; and controlling the occlusion area to perform brightness change according to a preset occlusion strategy. According to the invention, shielding areas with proper sizes can be dynamically formed at the left eye and the right eye, a shielding effect is formed according to a preset shielding strategy, and the movement and the second position state of the shielded eyeballs can be captured through a specific camera; therefore, the strabismus degree of the user is accurately calculated by calculating the relative value of the second position state and the first position state.

The embodiment of the invention provides a sub-pixel offset optimization parallax calculation method, a sub-pixel offset optimization parallax calculation device and electronic equipment. The sub-pixel offset optimization parallax calculation method comprises the following steps: acquiring a binocular image; labeling a label of a target area of the binocular image based on a preset semantic segmentation network; based on the label, extracting visual features of the target area; establishing a matching relation of the target area according to the visual features; respectively calculating a first sub-pixel offset of a left eye image in the binocular image and a second sub-pixel offset of a right eye image in the binocular image according to the matching relationship of the target areas; and calculating the parallax of the binocular image according to the first sub-pixel offset and the second sub-pixel offset. According to the method, the target area is accurately marked by introducing the semantic segmentation network, and visual feature extraction and sub-pixel offset calculation are combined, so that the precision and robustness of binocular image parallax calculation are remarkably improved.

This article is a cosmetic pack sheet for performing a face cosmetic pack. This article is composed of a water-containing sheet having the shape shown in each figure, and is used in a wet state in which a cosmetic liquid such as lotion, emulsion, or gel is impregnated in this water-containing sheet. For example, this article in a wet state is adhered so as to cover around the eyes of the user (see the reference figure showing an example of the use state). Since this article is composed of a water-containing sheet that is symmetric front and back, by using the adhesion surface of the sheet separately for the front and back, the adhesion location on the face of the user can be either one of the right eye area and the left eye area, or the other.

Arrangement of artificial adaptive intraocular lenses whose operating mode is based on binocular interaction and the accommodation-convergence reflex of the eyes, i. wherein all electrically activated adaptive intraocular lenses (8)(9)(10) comprise activation mechanisms and are operated without interaction between the left and right eye, characterized in that ii. the arrangement of the novel artificial adaptive intraocular lenses, whose operating mode is based on binocular interaction (11.3)(12.3)(5) and the accommodation-convergence reflex of the eyes, is characterized by the inclusion of a microchip, wherein a microchip is used for each intraocular lens of each eye, the microchip containing magnetic nanoparticles with electromagnetic properties and made of biocompatible, non-cytotoxic material (5.1)(3.1)(4.1), wherein a conductor connected to the microchip forms a closed loop (5.2)(3.2)(4.2), and wherein the change in the distance between the microchips of the artificial intraocular lenses of the right and left eye during the convergence movements (5.3)(11.2)(12.2) and divergence movements (5.3)(11.1)(12.1) changes both the strength and the phase of the electromagnetic field (5.4) between the two microchips (5.1)(3.1)(4.1) of the two artificial intraocular lenses, which interact with each other, wherein this change in the strength and phase of the electromagnetic field (5.4) causes the generation of an electric charge or voltage at the ends of the conductor (5.5)(3.3)(4.3), which leads to an electric current flow (5.6)(3.4)(4.4) through the closed loop of the conductor (5.2)(3.2)(4.2) due to the induced voltage and according to the principle of electromagnetic induction.

The invention provides a method for checking light leakage of a sun shield, which is used for effectively adjusting and optimally avoiding the conditions of upper light leakage or left light leakage of the sun shield, the sun shield, a ceiling boundary, an A column boundary and a front windshield black edge in the driving process of a driver and passengers. By taking the left limit point or the upper limit point of the left eye ellipse as a projection center, projecting a point on the sun shield onto the curved surface of the front windshield, projecting a point on the left A column onto the curved surface of the front windshield, and projecting a point on the ceiling onto the curved surface of the front windshield; and then processing the data. According to the method, the optimized result can be quantitatively presented, a model or an organizing person is not needed for review, and high efficiency and low cost are achieved.

A personal eyewear device comprises: a frame for supporting one or more lenses in front of a left eye and a right eye of a wearer when the personal eyewear device is worn by the wearer and an electronics module. The electronics module includes: a processor, a memory, a power source for powering the electronics module, and an eye tracking subsystem, wherein the processor and the memory are communicatively coupled with the eye tracking subsystem and wherein the eye tracking subsystem comprises: a first pair of imaging sensors forming a first stereo imaging sensor configured to capture images of a left eye of the wearer; and a second pair of imaging sensors forming a second stereo imaging sensor configured to capture images of a right eye of the wearer. The device further includes at least one additional sensor subsystem and a scheduling module.

Various implementations disclosed herein include devices, systems, and methods that uses a horizontal shift of left eye and right eye image content to control a stereo effect of the image content. For example, a process may include obtaining image data including images to be presented with a stereo effect at a virtual screen position within a three-dimensional (3D) viewing environment. The process may further obtain depth data corresponding to distances of elements of a scene depicted in the images. The process may further determine a horizontal positioning characteristic for presenting the images at the virtual screen with the stereo effect based on the depth data and a view of the images are presented with the stereo effect based on the horizontal positioning characteristic at the virtual screen within the 3D environment. The images may additionally be presented with a blur, a lighting, a fading, and / or a vignetting effect.

The present invention provides a fatigue driving behavior recognition method for 3D point cloud image data. First, collect 3D point cloud image video frames as the images to be processed; then, use the point-voxel fusion transformation network PVFTN to process the images to be processed to obtain the driver's face region feature image. The point-voxel fusion transformation network PVFTN includes three PVF modules, and the PVF module includes a point-voxel branch and a voxel branch; then use the multi-scale facial key point detector MSFLD to process the face region feature image to obtain the coordinates of 23 key points per frame; then calculate the aspect ratios of the left eye, right eye and mouth, and update the face fatigue parameter matrix; finally, use a method combining a statistical threshold and an adaptive threshold for judgment to obtain the judgment result of the driver's driving state, thereby realizing the judgment of the fatigue driving state of the driver in the motion state.

The invention relates to the technical field of head-mounted display equipment, and provides a screen control method and device, equipment and a storage medium, and the method comprises the steps: obtaining a first deviation value of a left eye deviating from a first preset center point, and a second deviation value of a right eye deviating from a second preset center point; according to the comparison result of the first deviation value and the first preset sight line range and the comparison result of the second deviation value and the second preset sight line range, the working mode of the first screen and the working mode of the second screen are adjusted, and the working modes comprise an opening mode and a closing mode. The working modes of the left and right screens of the head-mounted display device are adjusted according to the deviation condition of the left and right eye sight lines of the user, the left and right eyes of the user are prevented from watching the screens for a long time, eyestrain of the user can be relieved, power consumption of the device can be reduced, and user experience is improved. Therefore, the technical problems that the use requirements of users cannot be met and the power consumption of equipment cannot be increased in related technologies are solved.