Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

2831 results about "Image plane" patented technology

In 3D computer graphics, the image plane is that plane in the world which is identified with the plane of the display monitor used to view the image that is being rendered. It is also referred to as screen space. If one makes the analogy of taking a photograph to rendering a 3D image, the surface of the film is the image plane. In this case, the viewing transformation is a projection that maps the world onto the image plane. A rectangular region of this plane, called the viewing window or viewport, maps to the monitor. This establishes the mapping between pixels on the monitor and points (or rather, rays) in the 3D world. The plane is not usually an actual geometric object in a 3D scene, but instead is usually a collection of target coordinates or dimensions that are used during the rasterization process so the final output can be displayed as intended on the physical screen.

Multispectral light field imaging system, three-dimensional temperature field measurement method and measurement system

A multispectral light field imaging system includes a primary lens, a microlens array, a first relay lens, a dichroic lens, a second relay lens, a third relay lens, a first image sensor, a first filter, a second image sensor and a second filter, wherein the microlens array is located at an image plane of the primary lens; the first relay lens together with the second relay lens and the third relay lens forms a 1:1 relay lens group imaging system on a spectral band 1 light path and a spectral band 2 light path respectively; the dichroic lens forms an included angle of 45° with a light axis; the first image sensor is located at a focal plane of the second relay lens, and the second image sensor is located at a focal plane of the third relay lens.
Owner:SOUTHEAST UNIV

Wafer detection scattered light acquisition objective lens and wafer detection equipment

The invention discloses a wafer detection scattered light collection objective lens, and relates to the technical field of optical imaging. The scattered light collecting lens is applied to wafer defect detection, the scattered light collecting lens sequentially comprises a first lens group, a second lens group, a third lens group and a fourth lens group from an object plane to an image plane in the optical axis direction of the lens, twelve lenses and an aperture diaphragm, and the twelve lenses and the aperture diaphragm are coaxially arranged; the first lens group is a catadioptric lens group, has positive focal power, and is used for imaging an object plane to an intermediate image plane through two times of reflection. The numerical aperture of the acquisition objective lens provided by the invention is equal to 0.9, the field of view is equal to 2.6 mm, the acquisition objective lens has the characteristics of large field of view, large numerical aperture and small center shielding, the capability of detecting scattered light of defects can be greatly improved, chromatic aberration is corrected by adopting a refraction and reflection mode, and a wider laser bandwidth can be realized compared with a general refraction mode of combining CaF2 and fused quartz.
Owner:HEFEI NANO SEMICON CO LTD

Coal bunker reserve real-time monitoring method integrating laser radar and camera

The invention discloses a coal bunker reserve real-time monitoring method integrating a laser radar and a camera. The method comprises the following steps: step 1, carrying out space-time joint calibration and hardware-level synchronization on a laser radar and a camera, and establishing a projection relationship between a point cloud and an image; 2, cooperatively collecting coal bunker data based on the calibration parameters, and obtaining a point cloud and a high-resolution image; step 3, heterogeneous preprocessing is carried out on the collected point cloud and the image, denoising, segmentation and down-sampling are carried out on the point cloud, semantic segmentation is carried out on the image, and coal and foreign matters are identified; step 4, based on image texture and point cloud coordinate coupling mapping, reconstructing a three-dimensional model with a semantic tag, projecting the point cloud to an image plane to perform feature matching so as to endow the texture, and fusing image semantic information to correct the model; and 5, dynamically calculating the volume of the coal pile by using the semantic three-dimensional model to realize real-time monitoring of reserves. The system overcomes the limitation of a single sensor, achieves the real-time and high-precision monitoring of the reserves of the coal bunker, and effectively improves the intelligent level of coal bunker management.
Owner:XUZHOU NORMAL UNIVERSITY

Optical lens

The invention provides an optical lens, which comprises seven lenses in total, and sequentially comprises a first lens with negative focal power, a second lens with negative focal power, a third lens with negative focal power, a fourth lens with positive focal power and a fifth lens with negative focal power from an object side to an imaging surface along an optical axis, the object side surface of the second lens is a convex surface, and the image side surface of the second lens is a concave surface; the object side surface of the third lens is a convex surface, and the image side surface of the third lens is a concave surface; the image side surface of the fourth lens is a convex surface; the fifth lens has positive focal power, and the image side surface of the fifth lens is a convex surface; the object side surface of the sixth lens is a concave surface, and the image side surface of the sixth lens near the optical axis is a convex surface; and the object side surface of the seventh lens is a concave surface near the optical axis, and the image side surface of the seventh lens is a convex surface. According to the optical lens provided by the invention, through specific surface shape matching and reasonable focal power distribution, the imaging quality of the optical lens is improved, and the lens has one or more advantages of ultra wide angle, ultra large aperture, large image plane, high pixel, high imaging quality and the like.
Owner:JIANGXI LIANYI OPTICS CO LTD

Fuzzy self-adaptive visual servo control method and system for multi-joint mechanical arm system for placing bobbins in textile workshop

The invention belongs to the technical field of position tracking control of rigid multi-joint mechanical arms, and discloses a fuzzy self-adaptive visual servo control method and system for a multi-joint mechanical arm system for placing bobbins in a textile workshop, and the method comprises the steps: constructing an image error model according to the positions of feature points on an image plane; the fuzzy logic system is used for processing uncertain items in the system, the instruction filtering and fuzzy self-adaption technology is used for achieving tracking control over the expected trajectory of the system, the problem of calculation complexity is solved, and adverse effects caused by filtering errors are eliminated. In the process of changing the bobbins, the bobbins are placed on a creel through a multi-degree-of-freedom robotic arm, a clamping jaw at the tail end of the robotic arm is required to accurately grab the bobbins for feeding and discharging, and the requirement for accurate and rapid control of the robotic arm is met, so that research on visual servo control of the robotic arm is of great significance. The method has a good control effect, the problem of calculation complexity in the design process of the controller is solved, the trajectory tracking error is smaller, and the system robustness is higher.
Owner:QINGDAO UNIV

Confocal microscope camera calibration method based on high-precision motion control

The invention discloses a confocal microscope camera calibration method based on high-precision motion control. The confocal microscope camera calibration method mainly comprises the steps of establishing four coordinate systems, placing a checkerboard calibration plate on a high-precision platform and adjusting the checkerboard calibration plate to the center of the view of a camera, and shooting and recording image coordinates of a calibration point. And based on the imaging relationship between the optical center of the camera and the object point, determining the mapping relationship between the coordinate systems so as to establish a preliminary imaging model. Then, nonlinear correction is performed on the imaging model, lens distortion is eliminated, and corrected image coordinates are converted into pixel coordinates. The non-linear correction parameters are optimized through the multi-view data, the mapping relation between the image plane and the platform physical plane is further calculated, and the mapping relation is optimized through the least square method so as to improve the calibration precision. Finally, pixel coordinates in the image are converted into physical coordinates of a platform through the optimized matrix, and support is provided for the automatic focusing process of the confocal microscope.
Owner:NANJING MUMUSILI TECH CO LTD +2

Railway tunnel foreign matter detection method based on radar point cloud and RGB image fusion

The invention discloses a railway tunnel foreign matter detection method based on radar point cloud and RGB image fusion. The method comprises the following steps: acquiring a laser radar point cloud and an RGB image in a railway tunnel; obtaining an RGB image by using an adversarial network model GAN to judge the abnormal occurrence state of the foreign matter in the railway tunnel, and if the abnormal state of the foreign matter occurs, projecting the obtained laser radar point cloud to an image plane to obtain a dense depth map; processing through a sliding window to obtain data slices which are approximately square; and carrying out data feature extraction, fusion and foreign object target detection on the data slices of the RGB image and the dense depth map by using a fusion target detection network based on the OfficientNet-FPN, and outputting a foreign object target information detection result containing a target category, a position, a confidence coefficient and a distance. According to the railway tunnel foreign matter detection method based on radar point cloud and RGB image fusion, high precision, high efficiency and high reliability of railway tunnel foreign matter detection are realized.
Owner:NANJING PIONEER AWARENESS INFORMATION TECH CO LTD

Optical detection device

The embodiment of the invention provides an optical detection device which comprises an imaging assembly and a photoelectric detection device, and the imaging assembly is used for forming an image on an image plane of a to-be-detected area of a wafer. And the photoelectric detection device is used for receiving images and is arranged at the image plane. The photoelectric detection device comprises a light beam separation assembly and a sensor assembly, the light beam separation assembly is used for dividing a continuous first light signal in an image into multiple beams of second light signals, and the light beam separation assembly comprises a microlens array. The sensor assembly is used for receiving multiple beams of second optical signals, and each pixel unit of each sensor in the sensor assembly is used for receiving one beam of second optical signal in the multiple beams of second optical signals. The sensor assembly comprises a single-pixel sensor, and the single-pixel sensor corresponds to one micro lens in the micro lens array; and / or, the sensor assembly comprises a multi-pixel sensor, the multi-pixel sensor corresponds to a plurality of microlenses in the microlens array, and spatial segmentation is beneficial to improving the signal-to-noise ratio.
Owner:JINGCHENG ZHONGAN SEMICONDUCTOR (BEIJING) LTD +1

Large-target-surface low-distortion low-chromatic-aberration industrial lens

ActiveCN119335697Aincrease chromatic aberrationimprove distortionOptical elementsLow distortionOphthalmology
The invention discloses an industrial lens with a large target surface, low distortion and low chromatic aberration. An optical system of the industrial lens is composed of a meniscus positive lens L1, a meniscus negative lens L2, a biconcave negative lens L3, a positive lens L4, a diaphragm C, a positive lens L5, a biconvex positive lens L6, a biconcave negative lens L7, a biconvex positive lens L8, a biconvex positive lens L9, a biconcave negative lens L10, a biconvex positive lens L11 and an image plane IMG which are sequentially arranged along an incident light path, and the object side face of the meniscus positive lens L1 is a convex face; the object side surface of the meniscus negative lens L2 is a convex surface; the biconvex positive lens L6 and the biconcave negative lens L7 form a first gluing group; and the biconvex positive lens L9 and the biconcave negative lens L10 form a second gluing group. The industrial lens has the advantages of small size, large target surface, low distortion, low chromatic aberration and high resolution.
Owner:SUZHOU LIGHTLNS OPTICAL TECH

Optical system and imaging device

An optical system and an imaging device are provided, and the optical system includes seven optical elements In order from an object side to an image side, the seven optical elements include: a first lens, a second lens, a third lens, a fourth lens, a fifth lens, a sixth lens and a seventh lens; each of seven optical elements includes an object-side surface facing towards the object plane and an image-side surface facing towards the image plane; at least one optical element of the seven optical elements is a metalens, and other optical element are aspheric optical lenses; and from the image side to the object side, both the first aspheric optical lens and the second aspheric optical lens include at least one aspheric surface, and the aspheric surface includes one point of inflection.
Owner:SHENZHEN METALENX TECH CO LTD

Optical lens

The invention provides an optical lens, which comprises eight lenses with focal power and sequentially comprises a first lens with negative focal power, a second lens with positive focal power, a third lens with negative focal power, a fourth lens with negative focal power, a fifth lens with negative focal power and a sixth lens with negative focal power from an object side to an imaging surface along an optical axis, the object side surface of the second lens is a convex surface, and the image side surface of the second lens is a concave surface; the third lens has negative focal power, the object side surface of the third lens near the optical axis is a convex surface, and the image side surface of the third lens is a concave surface; the fourth lens has positive focal power; the object side surface of the fifth lens is a convex surface, and the image side surface of the fifth lens is a convex surface; the sixth lens has positive focal power; the seventh lens has negative focal power; and the object side surface of the eighth lens is a convex surface, and the image side surface of the eighth lens is a convex surface. The optical lens provided by the invention has one or more advantages of short focus, large field angle, high imaging quality and the like.
Owner:JIANGXI LIANCHUANG ELECTRONICS CO LTD

Multiscopic display using multiscopic optical element with multiple liquid crystal layers

A display device includes a first liquid crystal (LC) layer and a second LC layer arranged between a backlight unit and a linear polarizer, and a multiscopic optical element arranged between the first LC layer and the second LC layer. Drive signals for LC cells of the first LC layer and the second LC layer are generated, based on corresponding images to be presented to each eye of each individual user, a relative location of each eye with respect to an image plane of the display device, and relative positions of the LC cells of the first LC layer and the second LC layer with respect to multiscopic cells of the multiscopic optical element. The LC cells are controlled using the drive signals, to adjust a polarization of light passing therethrough, for producing a synthetic light field presenting the corresponding images to each eye of each individual user.
Owner:DISTANCE TECHNOLOGIES OY

Objective lens module and photoetching imaging system

The invention provides an objective lens module and a photoetching imaging system, and relates to the technical field of optical imaging, the objective lens module is configured between an object plane and an image plane of the photoetching imaging system, and the objective lens module comprises a first lens group, a second lens group and a microobjective lens group which are sequentially arranged from the object plane to the image plane, the first lens group and the second lens group are both of a double-Gaussian structure or a double-Gaussian derivative structure, and the focal length of the first lens group is larger than that of the second lens group. The objective lens module can reduce the aperture size of the optical lens in the objective lens module, increase the object space working distance and improve the imaging quality on the premise of ensuring a large field of view.
Owner:NEW YIDONG (SHANGHAI) TECH CO LTD

Semantic simultaneous localization and mapping method and system based on Gaussian splashing

The invention relates to a semantic simultaneous localization and mapping method and system based on Gaussian splashing. The method comprises the following steps: firstly, collecting a frame of RGB-D image, modeling a scene into a 3D semantic Gaussian field containing a plurality of 3D semantic gausses according to the RGB-D image, and rendering the 3D semantic gausses by using a tile rasterization technology to obtain 2D image plane gausses; rendering results of RGB color, depth and semantic features are extracted from the 2D image plane in a Gaussian mode, and the semantic features are decoded into semantic tags; constructing a mapping and tracking loss function by using an RGB color rendering result, a depth rendering result, a semantic tag and a truth value, and jointly optimizing a camera pose and a semantic Gaussian field based on a tracking stage and a mapping stage; and repeating the steps for each new frame of RGB-D image to complete the construction of the incremental semantic Gaussian map. Compared with the prior art, the method has the advantages of realizing robust camera tracking, real-time high-quality rendering, accurate 3D semantic reconstruction and the like.
Owner:TONGJI UNIV

Crack image processing method based on neural network and plane geometry image transformation

The invention discloses a crack image processing method based on a neural network and plane geometry image transformation, and particularly relates to the field of general image data processing driven by plane geometry image transformation and neural network identification. Comprising the steps that an image collection platform projects a structured image coding pattern to the surface of a to-be-measured target through a preset image coding pattern template, and synchronously collects an image frame containing an image mark so as to construct a space anchor point used for image geometric reference in an image plane; view angle parameter change information in an image acquisition process is acquired through an image acquisition platform, and projection configuration parameters of an image coding pattern are combined. By constructing an image offset modeling mechanism jointly driven by an image coding pattern and a space anchor point, image in-plane correction of geometric distortion features in an image frame is realized, and structural consistency and texture continuity before subsequent image analysis are improved.
Owner:UNIV OF JINAN +1

High-dynamic deformation measurement system and method based on laser section contour differential scanning

The invention provides a high-dynamic deformation measurement system and method based on laser section contour differential scanning. The measurement system is composed of a section contour measurement unit, a calibration unit, an error compensation unit and a data processing unit, wherein the section contour measurement unit comprises a multi-sight-line structured light sensor module, a speed sensing module and a distance measurement module; the calibration unit comprises a synchronous control module, an adjustment module and a common tooth-shaped calibration target; the error compensation unit comprises a vibration detection module, a posture detection module and a temperature detection module; the data processing unit is a device with programming and computing functions. The measuring method comprises the following steps: (1) calibrating a laser plane and an image plane; (2) unifying a global coordinate system; (3) obtaining point cloud data; (4) error compensation; (5) constructing a deformation time-history model; and (6) carrying out maximum deformation global optimization. According to the measurement system and method, accurate expression and maximum value global optimization of a pavement micro-deformation three-dimensional space under the load effect can be realized.
Owner:WUHAN UNIV OF SCI & TECH

40-time infinite conjugate microscope objective

ActiveCN119535732Ahigh resolutionIncrease illuminationMicroscopesOptical axisImage resolution
The invention provides a 40-time infinite conjugate microscope objective, and relates to the field of objective lenses. The 40-time infinite conjugate microscope objective comprises a first lens group, a second lens group and a third lens group which are sequentially arranged along an optical axis from an object space to an image space. The first lens group comprises a first lens and a second lens which are sequentially arranged from the object side to the image side in the optical axis direction. The second lens group comprises a third lens, a fourth lens, a fifth lens, a sixth lens, a seventh lens, an eighth lens and a ninth lens which are sequentially arranged from the object space to the image space in the optical axis direction. The third lens group comprises a tenth lens and an eleventh lens which are sequentially arranged from the object space to the image space in the optical axis direction. The 40-time infinite conjugate microscope objective can realize a high-resolution flat image plane and apochromatic objective, under a short parfocal distance, the numerical aperture is larger, the illumination at the image plane is increased, the imaging is clearer, the on-axis field of view and the off-axis field of view are close to diffraction limits, and the point array radius is close to be within the Airy spot.
Owner:SHENZHEN SANZHI OPTICAL CONTROL TECHNOLOGY CO LTD

Inverse rendering method and device of fused semantic segmentation considering shadow

ActiveCN119399116AImage analysisInternal combustion piston enginesGraphicsInput reconstruction
The invention discloses an inverse rendering method and device of fused semantic segmentation considering shadow, and relates to the field of computer vision and graphics, and the method comprises the steps: taking a group of multi-view photos of a three-dimensional scene as the geometric shape of an input reconstruction scene, and achieving neural implicit surface reconstruction; taking the semantic segmentation map of the sparse view angle image albedo of the three-dimensional scene as input, obtaining a surface point set with an albedo semantic category of the scene, and projecting the surface point set to an image plane to obtain a semantic segmentation map of each view angle image albedo of the scene; taking a group of multi-view photos of a three-dimensional scene and the obtained semantic segmentation map as input, and carrying out light ray sampling on surface points of the scene; forward rendering is carried out based on incident light on sampling light and materials of surface points, illumination and materials are optimized through network training, and accurate illumination and materials are obtained through decomposition. According to the method and the device, the influence of shadow on material estimation can be effectively weakened, so that relatively accurate illumination and material estimation is realized.
Owner:WUHAN UNIV

Metasurface structure design method and metasurface structure

The invention provides a metasurface structure design method and a metasurface structure, and the method can comprise the steps: initializing a rotation angle of the metasurface structure; a first light field construction step: constructing a transmission light relation of the current metasurface structure based on the rotation angle; a second light field construction step: constructing a diffracted light relationship of the current metasurface structure based on the transmitted light relationship so as to determine the light intensity distribution of the image plane; an error construction step: calculating an iteration constraint value according to the image plane light intensity distribution and the target light intensity; wherein the target light intensity is a preposed parameter, the target light intensity is the light intensity corresponding to the target metasurface structure, and the target metasurface structure is a design target; if it is judged that the iteration constraint value is larger than the set value, the rotation angle is updated, the updated rotation angle is obtained, the first light field construction step, the second light field construction step and the error construction step are repeatedly executed till the iteration constraint value is not larger than the set value, and the target metasurface structure is determined based on the current rotation angle.
Owner:INST OF OPTICS & ELECTRONICS CHINESE ACAD OF SCI

Digital human rendering method based on Gaussian splashing and multi-scale characteristic field distillation

The invention discloses a digital human rendering method based on Gaussian splashing and multi-scale characteristic field distillation, and belongs to the field of three-dimensional human body digital reconstruction. According to the method, feature extraction is carried out through a Vision Transformer encoder, based on an SMPL model, through a cross-modal parameter estimation module and dynamic human body modeling of three-dimensional Gaussian splashing and semantic feature rendering, three-dimensional Gaussian is projected to a two-dimensional image plane to calculate a covariance matrix and color mixing, and after a rendered color image and an initial feature field image are output, a three-dimensional image is obtained. A student feature map is obtained through a convolution acceleration module, a teacher feature map is obtained after feature extraction is carried out through a two-dimensional basic model, the constructed model is trained, and optimization training is completed through comprehensive total loss function calculation; according to the method, the problems of fuzzy semantics, detail missing, low rendering efficiency and inaccurate human body-scene separation in the existing method are effectively solved, so that more efficient, fine and robust monocular or multi-view human body three-dimensional reconstruction is realized.
Owner:YUNNAN UNIV

Teleconverter lens

The invention discloses a teleconverter lens. The teleconverter lens comprises a system front group and a system rear group, the system front group comprises a first lens group and a second lens group, and the system rear group comprises a third lens group and a fourth lens group; the first lens group comprises a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are sequentially arranged from the object plane to the image plane along the optical axis; the second lens group comprises a sixth lens, a seventh lens, an eighth lens and a ninth lens which are sequentially arranged from the object plane to the image plane along the optical axis; the third lens group comprises a tenth lens and an eleventh lens which are sequentially arranged from the object plane to the image plane along the optical axis; the fourth lens group comprises a twelfth lens and a thirteenth lens; the focal length fz1 of the first lens group and the focal length fz2 of the second lens group satisfy 0.8200 lt; fz1 / fz2lt; the focal length fz3 of the third lens group and the focal length fz4 of the fourth lens group satisfy 1.6800 lt; fz3 / fz4lt; and 7.3000). Therefore, the lengths of front and back groups of the system can be reduced, the total length of the system is less than 120mm, and the characteristic of short total length of the system is achieved.
Owner:DONGGUAN YUTONG OPTICAL TECH

Digital imaging system and method

Methods and systems for providing multi-plane viewing of a digital image of a subject matter which do not require viewing multiple images taken at multiple image planes. Pseudo-focus images are generated from a flattened, merged image of a three-dimensional subject matter. The merged image is generated by merging a plurality of images taken at different focal planes of the subject matter which form a through-focus image stack. The merged image comprises the best focus pixels originating from different respective image planes. A depth map is also generated from the multiple images which associates each best focus pixel with a pixel depth value. A plane of interest (POI) is selected from the image planes. A pseudo-focus image is then generated using the merged image and pixel depth map by generating a blurred focus value for each best focus pixel based on the focus offset of each pixel from the POI.
Owner:HOLOGIC INC

Three-dimensional target labeling method and device based on point cloud data assisted two-dimensional image

The invention provides a three-dimensional target marking method and device based on a point cloud data-assisted two-dimensional image, and the method comprises the steps: fusing precise three-dimensional point cloud information obtained by a laser radar and two-dimensional image data collected by a camera based on a point cloud data and image data cooperation three-dimensional marking method; and a dynamic high-precision three-dimensional target marking system is constructed. Specifically, a space-image relationship is established through three-dimensional point cloud information and a two-dimensional image plane, and three-dimensional information of a target is mapped into a two-dimensional image, so that geometric and semantic information labeling is carried out on the target in the two-dimensional image, information loss of two-dimensional visual data in dimensions such as depth, attitude and space structure is made up, and the accuracy of the three-dimensional information labeling is improved. And meanwhile, when the three-dimensional point cloud is unmeasurable, a three-dimensional target labeling mode is dynamically adjusted in combination with two-dimensional image labeling information. According to the method, through dynamic high-precision three-dimensional target labeling, the obtained image-label can be used for training and reasoning of a three-dimensional target detection network, and the method has a wide application prospect.
Owner:NAT UNIV OF DEFENSE TECH

Vision and point cloud data fusion modeling coal face mining auxiliary method

The invention provides a coal face mining auxiliary method based on visual and point cloud data fusion modeling, and the method comprises the steps: collecting the visual image data of a coal face, collecting the three-dimensional point cloud data through a point cloud sensor, and obtaining the motion state information through an inertial sensor; based on internal and external parameters and IMU data of joint calibration, mapping point cloud data to an image plane, establishing a geometric mapping relationship between three-dimensional points and pixels, generating an attribute point cloud model containing geometry, color and semantics, and generating a high-precision global three-dimensional digital twinning model; and identifying and tracking equipment instances in the digital twinborn model, and resolving motion parameters of key components based on a URDF kinematics model and a principal component analysis algorithm to support remote control decisions. According to the invention, high-precision real-time sensing and three-dimensional visualization of the working space size, the equipment connection relation and the movement position of the coal face can be realized, and the remote control precision and the response efficiency of unmanned mining are remarkably improved.
Owner:CHINA COAL RES INST

Wharf unmanned vehicle obstacle detection and identification method based on multi-sensor fusion

The invention discloses a multi-sensor fusion-based obstacle detection and recognition method for a wharf unmanned vehicle, and relates to the technical field of intelligent driving, and the method comprises the steps: setting a maximum threshold value and a minimum threshold value, comparing a sensor coverage rate with the maximum threshold value and the minimum threshold value, executing a sensor increase and decrease strategy, and carrying out the time synchronization of sensor data; obtaining an internal parameter matrix, a distortion coefficient and an external parameter matrix, projecting three-dimensional point coordinates of the point cloud data into two-dimensional coordinates of an image plane, and converting the two-dimensional coordinates in the image data into three-dimensional coordinates in a global coordinate system; labeling the sensor data to obtain a two-dimensional bounding box and a three-dimensional bounding box, and obtaining the category and pose label of an obstacle; building a multi-modal fusion perception model, and training the multi-modal fusion perception model by taking the sensor data and the categories and pose labels of the obstacles as training data; and deploying the optimized multi-modal fusion perception model, and outputting the category and pose information of the obstacle, so that the method is suitable for a complex driving environment.
Owner:ZHENJIANG HIGH-TECH PORT CO LTD +1

Method and apparatus of hierarchical semantic mapping based on deep-learning perception

A method and an apparatus for constructing hierarchical semantic map based on deep-learning based perception, a server, a storage medium are provided. The method includes: obtaining 3D point cloud data, scene images and motion state data; projecting 3D point cloud data onto an image plane to obtain a depth image; performing a point cloud registration and a pose prediction on the 3D point cloud data and the motion state data to obtain an odometer pose; generating a point cloud map according to the 3D point cloud data and the odometer pose of multi-sensor system; based on the depth image and the odometer pose of the multi-sensor system, performing an external ellipse fitting process on each semantic region in the depth image to obtain an object-enveloped map for respective object images; fusing the coordinately aligned point cloud map and object-enveloped map into a semantic map.
Owner:INST OF INTELLIGENT MFG GUANGDONG ACAD OF SCI

Prime lens

The utility model discloses a prime lens comprising a front lens group, a diaphragm and a rear lens group which are arranged from an object plane to an image plane along an optical axis. The front lens group comprises a first lens, a second lens and a third lens which are sequentially arranged from the object plane to the image plane, the focal power of the first lens is negative, the focal power of the second lens is negative, and the focal power of the third lens is positive; the focal power of the rear lens group is positive, and the rear lens group comprises a fourth lens, a fifth lens, a sixth lens, a seventh lens and an eighth lens which are sequentially arranged from the object plane to the image plane, the focal power of the fourth lens is positive, the focal power of the fifth lens is negative, the focal power of the sixth lens is positive, the focal power of the seventh lens is negative, and the focal power of the eighth lens is positive; the focal power of the front lens group is phi front, the focal power of the rear lens group is phi rear, and the focal power of the prime lens is phi; wherein-0.085 < = phi front / phi < = 0.25, and 0.35 < = phi rear / phi < = 0.48. Through the lens group and the focal power distribution of each lens, the design of a large-aperture and large-target-surface prime lens can be realized.
Owner:DONGGUAN YUTONG OPTICAL TECH

Monocular vision-based material movement behavior monitoring method and system

The invention discloses a material movement behavior monitoring method and system based on monocular vision, and relates to the field of material movement monitoring, and the method comprises the steps: firstly collecting a material movement video through a monocular high-speed camera, and extracting a continuous state sequence of a material on a two-dimensional image plane through employing an instance segmentation and time sequence tracking technology; the method is characterized in that a time sequence deep learning model is introduced to analyze a state sequence, and a key event that a material collides with a working surface of equipment is automatically identified, so that the collision moment and contact point coordinates are accurately obtained. In this way, the collision contact point is used as a geometric anchor point for three-dimensional space back calculation, a two-dimensional image track is reversely projected and reconstructed into a three-dimensional space motion track in combination with internal parameters of a camera and physical parameters of an equipment reference plane, then key kinetic parameters such as the speed and the recovery coefficient are calculated, and low-cost and high-precision automatic online monitoring is achieved.
Owner:ZHEJIANG UNIV

Space-time correlation multi-camera personnel tracking method and system

The invention provides a time-space correlation multi-camera personnel tracking method and system, and the method comprises the steps: obtaining video streams of all cameras in a scene, carrying out the frame-by-frame detection of the video streams through a detection module based on a deep learning model, and obtaining pedestrian detection samples under different cameras at the current moment and corresponding appearance features. Associating the detection sample with a historical tracking trajectory to obtain a trajectory in each single camera; and carrying out inter-camera association on the trajectory in the single camera by combining a pedestrian re-identification ReID technology and homography-based spatial constraint to obtain a complete tracking trajectory of the current frame. According to the method, in the aspect of position representation of the trajectory, 2D Kalman prediction is used in an image plane, meanwhile, the 3D space position of the trajectory is predicted and tracked, and the trajectory position can be accurately drawn and output.
Owner:ECCOM NETWORK SYST CO LTD

Imaging lens and imaging apparatus

The imaging lens consists of, in order from the object side, a first lens group having a positive refractive power, a stop, a second lens group having a positive refractive power, and a third lens group. The third lens group includes one or more positive lenses and one or more negative lenses. During focusing, an entirety of the first lens group, the stop, and the second lens group, or an entirety of the second lens group integrally moves as a focus group, and the third lens group remains stationary with respect to an image plane. The imaging lens satisfies predetermined conditional expressions.
Owner:FUJIFILM CORP