71 results about "Depth plane" patented technology

Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include monitoring eye orientations of a user of a display system based on detected sensor information. A fixation point is determined based on the eye orientations, the fixation point representing a three-dimensional location with respect to a field of view. Location information of virtual objects to present is obtained, with the location information indicating three-dimensional positions of the virtual objects. Resolutions of at least one virtual object is adjusted based on a proximity of the at least one virtual object to the fixation point. The virtual objects are presented to a user by display system with the at least one virtual object being rendered according to the adjusted resolution.

The invention provides a visual inspection method for precision metal part processing, which comprises the following steps: collecting dynamic light field data of the surface of a metal part through a micro lens array, obtaining an original light field data set containing multi-angle and multi-depth information, and forming a full light field data set; carrying out signal conversion and integration by adopting a high-resolution sensor from the full-light-field data set to generate two-dimensional light-field image data with high spatial resolution, and forming a preliminary light-field image; for the preliminary light field image, extracting multi-depth plane feature points, separating light field data of different depth layers by applying a depth segmentation algorithm based on region growth, and generating a layered depth data set; and calculating quantitative indexes of spatial resolution and data processing precision from the fusion of the full-focal-depth image, and comparing the quantitative indexes with a preset standard value based on detection requirements to generate an imaging quality judgment result. The invention further provides a device adopting the visual detection method.

An orientation assistance system comprises means for acquiring a real or virtual visual environment, non-visual human-machine interface means and means for processing the digital representation of the visual environment in order to provide an electrical signal for controlling a haptic interface. The means for processing the digital representation periodically extracts at least one pulsed digital activation pattern for a subset of spikes of the haptic region. The haptic interface consists of a lumbar belt having an active surface of N×M actuators, where N and M are integers greater than or equal to 10. The processing means provides, for each acquisition of the visual environment, a sequence of P activation frames for the actuators, where P is an integer between 2 and 15, preferably between 5 and 10, each of the frames corresponding to the representation of the environment in an incremental depth plane.

Images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across depth planes may vary based on color. In some embodiments, a display system includes a stack of waveguides that each output light of a particular color, with some colors having fewer numbers of associated waveguides than other colors. The waveguide stack may include multiple pluralities (e.g., first and second pluralities) of waveguides, each configured to produce an image by outputting light corresponding to a particular color. The total number of waveguides in the second plurality of waveguides may be less than the total number of waveguides in the first plurality of waveguides.

An orientation assistance system comprises means for acquiring a real or virtual visual environment, non-visual human-machine interface means and means for processing the digital representation of the visual environment in order to provide an electrical signal for controlling a haptic interface. The means for processing the digital representation periodically extracts at least one pulsed digital activation pattern for a subset of spikes of the haptic region. The haptic interface consists of a lumbar belt having an active surface of N×M actuators, where N and M are integers greater than or equal to 10. The processing means provides, for each acquisition of the visual environment, a sequence of P activation frames for the actuators, where P is an integer between 2 and 15, preferably between 5 and 10, each of the frames corresponding to the representation of the environment in an incremental depth plane.

The embodiment of the invention provides an image depth estimation method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining an image to be subjected to depth estimation, and extracting a pixel point feature of each pixel point in the image and a plane feature of each depth plane in the image through a pre-trained depth estimation model; the depth plane is used for representing a plane in a view finding space of the image; a first distance is formed between a plane in a view finding space of the image and a camera shooting the image; determining a second distance between each pixel point and each depth plane through the depth estimation model according to the pixel point feature of each pixel point and the plane feature of each depth plane; and through the depth estimation model, according to a second distance between each pixel point and each depth plane, determining a depth value of each pixel point, and obtaining a depth map corresponding to the image.

The application discloses a kind of fruit tree image acquisition method and system based on two-dimensional skeleton and viewpoint planning, it is related to wisdom agricultural equipment technical field, method includes: obtaining crown image obtains branch mask and depth information;To mask thinning pruning obtains initial skeleton, identifies feature point and calculates growth direction after artifact removal;Based on feature point and direction vector, topological reconstruction is carried out to broken skeleton, and complete two-dimensional skeleton graph is obtained;Based on two-dimensional skeleton graph, viewpoint planning is carried out in reference depth plane, generates viewpoint sequence and is mapped into three-dimensional pose, realizes autonomous image acquisition.The application solves the problem of information loss caused by occlusion and three-dimensional reconstruction calculation lag, and realizes real-time, safe and high-resolution image acquisition.

A method of operating an AR system to display an image viewable by a user's eyes includes tracking, by an eye-tracking subsystem, a position of the user's eyes and determining, based on the position, a focus depth of the user's eyes. The method also includes selecting, from a plurality of light-guiding optical elements, a subset of light-guiding optical elements configured to focus light at a depth plane corresponding to the focus depth of the user's eyes, producing a plurality of light beams using a subset of sub-light sources of a plurality of sub-light sources, the subset of sub-light sources being configured to illuminate the subset of light-guiding optical elements, and imaging the plurality of light beams through an imaging system and onto the subset of light-guiding optical elements such that the image is generated at the depth plane corresponding to the focus depth of the user's eyes.

To provide a favorable multi-depth plane display system with reduced switching between depth planes.SOLUTION: Methods and systems for reduction in switching between depth planes of a multi-depth plane display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergences. The system may monitor the fixation points based upon the gaze of each of the user's eyes, with each fixation point being a three-dimensional location in the user's field of view. Location information of virtual objects to be presented to the user is obtained, with each virtual object being associated with a depth plane. In some embodiments, the depth plane on which the virtual object is to be presented is modified based upon the fixation point of the user's eyes.SELECTED DRAWING: Figure 1

The present specification relates to a technique by which a hologram generation device generates a hologram with reduced speckle noise by optimizing a carrier according to a specific distance. A method by which a hologram generation device generates a hologram, according to an embodiment of the present specification, comprises the steps of: setting a carrier by initializing an arbitrary complex field having a random phase and a random amplitude; removing a specific band component from the frequency band of the set carrier so as to transform the set carrier; propagating the transformed carrier for each specific distance, which is a depth plane in which a target object is present; setting a loss function for each specific distance on the basis of a target uniform amplitude at the specific distance and the amplitude of the carrier propagated to the specific distance; and updating the propagated carrier for each specific distance on the basis of the loss functions set for each specific distance.

This application relates to a 3D reconstruction method, apparatus, device, readable storage medium, and program product. The method includes: acquiring multi-view images of a target object and camera parameters during the acquisition of the multi-view images; determining the spatial range of the depth planes and the number of depth planes of the target object; determining the pixel movement range and unit movement amount of pixels in the multi-view images based on the spatial range and number of depth planes; determining the pixel movement positions of pixels in the multi-view images based on the pixel movement range and unit movement amount, with adjacent pixel movement positions spaced apart by a unit movement amount, and the number of pixel movement positions matching the number of depth planes; determining each virtual depth plane based on each pixel movement position; and performing 3D reconstruction of the target object based on the multi-view images, camera parameters, and each virtual depth plane to obtain the 3D reconstruction result of the target object. This method can improve the integrity of the 3D reconstruction.

Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

The invention discloses a structure multi-target deformation monitoring method based on visual segmentation and deblurring enhancement, and relates to the technical field of engineering structure health monitoring. The method comprises the following steps: acquiring continuous time sequence multi-target images of different depth-of-field planes of a to-be-monitored structural plane; inputting an interactive prompt point into a pre-training segmentation model in the first frame to generate a multi-target mask, and removing a noise region based on connected domain analysis; cutting by adopting a self-adaptive multi-scale cutting strategy based on boundary judgment to obtain sub-graphs; performing image enhancement on the sub-image by adopting a pre-trained deblurring neural network; extracting a central point and an external rectangle coordinate of a target mask area in the sub-graph and uniformly mapping the central point and the external rectangle coordinate back to a full-graph coordinate system; and dynamically updating a cutting window of a subsequent frame based on the central point and boundary information of the first frame, and converting pixel-level displacement into physical unit or three-dimensional coordinate change by comparing the central point positions of the first frame and the subsequent frame and combining camera calibration parameters, thereby realizing high-precision continuous monitoring.

The present invention proposes an optical transmission integrated imaging 3D display device with a large depth of field, which includes a projector I, a projector II and a double-focal length holographic optical element. The double-focal length holographic optical element is prepared by two holographic exposures, and the two holographic exposures respectively record focal lengths of f 1 and f 2 In the integrated imaging 3D display process with a large depth of field, the dual-focal-length holographic optical element reproduces a focal length of f under the illumination of searchlight I projected by projector I and searchlight II projected by projector II. 1 and f 2 A spherical wave array is used to simultaneously generate a central depth plane I and a central depth plane II, and the information of the micro-image array I and the micro-image array II are modulated respectively. At the same time, a 3D image I is reconstructed near the central depth plane I and a 3D image II is reconstructed near the central depth plane II, thereby increasing the depth of field.

Systems and methods for depth plane selection in display system such as augmented reality display systems, including mixed reality display systems, are disclosed. A display(s) may present virtual image content via image light to an eye(s) of a user. The display(s) may output the image light to the eye(s) of the user, the image light to have different amounts of wavefront divergence corresponding to different depth planes at different distances away from the user. A camera(s) may capture images of the eye(s). An indication may be generated based on obtained images of the eye(s), indicating whether the user is identified. The display(s) may be controlled to output the image light to the eye(s) of the user, the image light to have the different amounts of wavefront divergence based at least in part on the generated indication indicating whether the user is identified.

The present invention relates to a system for detecting and quantifying the volume of underwater seaweed based on multibeam water column data, a method thereof, and a recording medium thereof. More specifically, the invention relates to a system for detecting and quantifying the volume of underwater seaweed based on multibeam water column data that visualizes water column data acquired by a Multibeam Echo Sounder (MBES) in real time and quantifies the spatial distribution and volume of seabed seaweed through a user interaction-based detection workflow, as well as a recording medium thereof. The underwater seaweed detection and volume quantification system based on multi-beam water column data according to the present invention is a system for processing water column HDF5 data acquired by a multi-beam echo sounder (MBES), comprising: a data management module that loads amplitude, transverse coordinate (X), depth coordinate (Z), UTM coordinate, heading, and ping number from water column data in HDF5 format, and converts transverse-depth coordinates (X, Z) into UTM absolute coordinates through rotational transformation using heading; and a Fan Plot visualization module that includes an adaptive grid rendering function that converts water column data of each ping loaded in the data management module into a 2D grid of a transverse-depth plane, renders it in real-time as a Fan Plot, and dynamically adjusts the grid resolution according to the viewport magnification ratio, and an ROI editing function that generates an arbitrary polygonal ROI by user mouse input and automatically propagates the polygonal ROI to adjacent pings when the ping moves. The system is characterized by comprising: a multi-stage filtering pipeline module that sequentially performs amplitude range filtering, Ray-casting vectorization-based Point-in-Polygon discrimination, intensity percentile filtering, Otsu automatic threshold determination, morphological closing operation, and DBSCAN clustering on the order data loaded into the data management module; a 3D analysis module that performs KDTree-based nearest neighbor matching between sets of filtered result points of adjacent pings in the order data filtered by the pipeline module, generates a 3D point cloud through linear interpolation, and estimates volume through uniform voxel grid transformation; and an output module that outputs the filtering points, interpolated point cloud, voxel mesh, and volume statistics of the pipeline module and the analysis module in CSV, PLY, and OBJ formats.

A virtual reality (VR) and / or augmented reality (AR) display system is configured to control a display using control information that is embedded in or otherwise included with imagery data to be presented through the display. The control information can indicate depth plane(s) and / or color plane(s) to be used to present the imagery data, depth plane(s) and / or color plane(s) to be activated or inactivated, shift(s) of at least a portion of the imagery data (e.g., one or more pixels) laterally within a depth plane and / or longitudinally between depth planes, other adjustment(s) to the virtual imagery, and / or other suitable controls.

The application belongs to the technical field of three-dimensional display, and discloses a depth-of-field extension method and system for integral imaging. The method arranges a plurality of imaging devices with focal length-wavelength dependence on a micro display; in a first frame time, controls an element image area covered under each imaging device to display in a first color contrast relationship, and forms an image on a first depth plane; in a second frame time, controls the element image area covered under each imaging device to display in a second color contrast relationship, and forms an image on a second depth plane; and alternately displays the images on the two depth planes through time multiplexing. The depth of field can be extended, and high-quality imaging can be performed on two neutral depth planes.

This disclosure provides a method, apparatus, electronic device, and medium for reconstructing the dose distribution of a particle irradiation target area. The method includes: monitoring the irradiation information of particles on a monitoring plane along the incident path, including beam spot position, beam spot size, and dose corresponding to each position, wherein the particles include particles of various energies; calculating the dose of particles of different energies at different depth planes in the target area based on the particle dose ratio of particles of different energies at different depth planes in the target area to the monitoring plane; calculating the particle dose of each energy particle at each position in the target area at different depth planes based on the particle distribution pattern of each energy particle on the monitoring plane; constructing a planar dose model of the target area at different depth planes based on the particle dose of each energy particle at each position in the target area at different depth planes, and reconstructing a three-dimensional dose model by superimposing the models; and fusing the three-dimensional dose model with a three-dimensional image of the target area to obtain a three-dimensional particle dose distribution model of the target area.

This invention proposes a large depth-of-field holographic 3D display method based on a digital cone lens. The method includes the following steps: First, based on depth information, the 3D object to be recorded is segmented into different depth planes, and the wavefront information of each depth plane is extracted. Then, an improved 3D Fourier algorithm is used to obtain the phase distribution of the 3D object on the holographic plane, denoted as Φ. I The second step is to encode the optical cone lens into a digital cone lens using phase encoding, and denote the phase distribution of the digital cone lens as Φ. II The third step involves co-encoding the digital cone lens with the hologram of the 3D object, and then coherently superimposing the phase distribution Φ. I and Φ II The final large depth-of-field hologram is obtained. In the fourth step, the final large depth-of-field hologram is loaded onto the spatial light modulator, and the spatial light modulator is illuminated with a light source. Based on the 3D Fourier algorithm and the depth-of-focus characteristics of the cone lens, the large depth-of-field hologram of the 3D object is reconstructed.

A virtual reality (VR) and / or augmented reality (AR) display system is configured to control a display using control information that is embedded in or otherwise included with imagery data to be presented through the display. The control information can indicate depth plane(s) and / or color plane(s) to be used to present the imagery data, depth plane(s) and / or color plane(s) to be activated or inactivated, shift(s) of at least a portion of the imagery data (e.g., one or more pixels) laterally within a depth plane and / or longitudinally between depth planes, and / or other suitable controls.

To provide favorable depth based central fovea rendering for display systems.SOLUTION: A display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include determining a fixation point of user's eyes. Location information associated with a first virtual object to be presented to the user via a display device is obtained. A resolution-modifying parameter of the first virtual object is obtained. A particular resolution at which the first virtual object should be rendered is identified based on the location information and the resolution-modifying parameter of the first virtual object. The particular resolution is based on a resolution distribution specifying resolutions for corresponding distances from the fixation point. The first virtual object rendered at the identified resolution is presented to the user via the display system.SELECTED DRAWING: Figure 10A

To provide imaging of a virtual reality and an augmented reality, and a visualization system.SOLUTION: Component color images are used in which images in number equal to each other that are substantially recognized to a full color or a multi-color are distributed over a plurality of depth planes. Distribution of the component color images in the depth planes can vary on the basis of colors. A display system includes stacks of waveguides each outputting light of specific colors, and has waveguides of some colors with a smaller number of other colors. The stacks of the waveguides can collectively include a plurality (for example, plural such as first and second) of waveguides, and are each configured to output light corresponding to specific colors and thereby generate an image. The total number of the waveguides in the plurality of second waveguides is smaller than the total number of the waveguides in the plurality of first waveguides, in the embodiment using three component colors, it can be larger than the total number of waveguides in the plurality of third waveguides.SELECTED DRAWING: Figure 6

The invention provides a 3D target detection method and device, a storage medium and equipment, and the method comprises the steps: obtaining a visual image of the surrounding environment of a vehicle through a monocular camera, extracting image features from the visual image, inputting the image features into a depth prediction model, and enabling the depth prediction model to carry out the detection of a 3D target in a mode of constructing a visual cone. The method comprises the following steps: dividing the interior of a visual cone into a plurality of depth planes, predicting probability values of image features on the depth planes so as to obtain depth values of a detection target in a visual image, then obtaining two-dimensional image coordinates of a 3D central point of the detection target according to the image features, and combining the depth values and internal and external parameter data of a monocular camera so as to obtain a detection target. And determining three-dimensional position information of the detection target. Therefore, only the monocular camera is used, the three-dimensional position detection of the target is realized through depth classification prediction of the image features, and the hardware cost of environmental perception is effectively reduced.

The present invention relates to a method for correcting the lateral position error of an integrated imaging system based on a macro lens array. The method also includes obtaining the position of the convergence point of the light cone emitted by a point on the LCD plane after passing through the macro lens array and the position of the standard convergence point on the central depth plane; the standard convergence point is the point where the light cone emitted by the point on the LCD plane converges on the central depth plane after passing through the macro lens array; measuring the lateral position error of the macro lens array according to the average value and corresponding variance of the distance between the position of each convergence point and the position of the standard convergence point, and determining the measurement result; judging whether the measurement result exceeds a threshold; if it exceeds the threshold, measuring the axial position error and the lateral position error of the macro lens array, and then correcting according to the axial position error and the lateral position error of the macro lens array; if it does not exceed the threshold, performing integrated imaging. The present invention can reduce the workload and improve the display effect of integrated imaging.

A non-contact optical probe capable of increasing the depth of the contour of a back drilling hole comprises a fixing device, at least one plate body is installed on the fixing device, a reflection jig is arranged below the plate body, the plate body comprises at least one first drilling hole, and the fixing device is connected with a first moving module; the at least one optical probe body is arranged above the fixing device; the computer is electrically connected with the optical probe body and the first moving module, the computer starts the optical probe body to emit a light beam with the radius smaller than that of the first drill hole, the light beam irradiates the plate body, and meanwhile the computer controls the first power source to drive the fixing device to move, so that the first drill hole passes through the lower portion of the optical probe body, and the first drill hole is formed in the plate body. The first drill hole is continuously irradiated by the light beam, the computer records a plurality of first reflection points where the light beam enters the first drill hole and leaves the first drill hole and the reflection jig, and a first drill hole depth plane graph is generated according to the first reflection points.

The embodiment of the present invention discloses a method, device, electronic device and storage medium for generating navigable waters. The method comprises: obtaining first data of each water depth point within a preset range corresponding to a ship and second data corresponding to the ship in a waterway chart; the preset range is determined based on the ship; the first data comprises position data and water depth data of the water depth point, and the second data comprises draft data and surplus water depth data of the ship; the preset range is determined based on the ship, and the second data comprises draft data and surplus water depth data of the ship; a three-dimensional model corresponding to the underwater terrain is established based on the first data of each water depth point; an isobath is determined based on the second data; and the navigable waters of the ship are generated based on the isobath and the three-dimensional model. The technical solution of the embodiment of the present invention realizes the generation of navigable waters for different ships, and improves the accuracy and real-time performance of the generation of navigable waters.

The invention discloses a sphere height estimation method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a target image; wherein the target image comprises a reference object and a sphere; determining a reference position of the reference object in the target image and a sphere position of the sphere in the target image; determining a target reference point based on the reference position and the sphere position; wherein the target reference point and the reference position are located at the same height, and the target reference point and the sphere position are located at the same depth plane; and calculating the actual height of the sphere based on the actual height of the reference object, the sphere position and the target reference point. In this way, the height of the sphere can be obtained, and the accuracy of the height of the sphere is improved.

The present invention relates to a method and a system for processing the digital representation of a visual environment to control a haptic interface consisting of a lumbar belt having an active surface of N×M actuators, N and M being integers greater than or equal to 10, including an actuator activation protocol consisting in calculating, for each acquisition of the visual environment, a sequence of P activation frames for the actuators, where P is an integer between 2 and 1000, preferably between 5 and 50, each of the frames corresponding to the representation of the environment in an incremental depth plane, characterised in that it further includes a processing step that consists in applying a contextual corrective function modifying the haptic pixel activation protocol.

Generation and storage of compressed z-planes in graphics processing is described. An example of a processor includes a rasterizer to generate a fragment of pixel data including blocks of pixel data; a depth pipeline to receive the fragment, the pipeline including a first and second depth test hardware, the first depth test hardware to perform a coarse depth test including determining minimum and maximum depths for each block; and a depth buffer, wherein the processor is to determine whether the fragment meets requirements that the fragment fully covers a tile of pixel data and passes a first depth test, and that each of the minimum and maximum depths of the fragment has a same sign and exponent, and, upon determining that the fragment meets the requirements, to generate a compressed depth plane utilizing the first depth test and update the depth buffer with the compressed depth plane.