A monocular high-resolution digital image stereovision microscope system

Abstract

The application provides a monocular high-resolution digital image stereovision microscope system, and relates to the technical field of stereovision microscopes. The system comprises: a computer photography control subsystem which controls a microscope body to complete zoom parfocal focusing and drives a sample platform to move a set baseline distance in the horizontal direction. The microscope body is photographed before and after movement to generate overlapping first digital left images and second digital right images to construct a stereoscopic image pair. A computer calculation storage subsystem performs calibration calculation correction on the stereoscopic image pair to eliminate image projection distortion, and pushes the corrected image data to a stereoscopic image display to observe digital stereovision images. The application solves the problems in the prior art that high-resolution monocular microscopes cannot realize stereovision image observation and that existing three-dimensional microscopic devices cannot simultaneously achieve high-resolution imaging and stereovision observation and detection.

Description

Technical Field

[0001] This invention relates to the field of stereoscopic microscopy technology, and in particular to a monocular high-resolution digital imaging stereoscopic microscopy system. Background Technology

[0002] Currently, this technology belongs to the field of monocular high-resolution digital imaging stereoscopic microscopy, with applications including: medical microscopic stereoscopic observation; biological observation and detection; metallographic material observation and detection; tool and process observation and detection; and other fields requiring high-resolution, high-magnification microscopic stereoscopic imaging. Traditional high-resolution monocular microscopes use only one objective lens to observe objects, and cannot achieve binocular physiological stereoscopic vision. Specific shortcomings include: 1) With only one objective lens, it cannot form binocular parallax, and has long been unable to achieve stereoscopic visual observation function in fields such as biology, metallography, and tool microscopes.

[0003] 2) Even with high-resolution microscopy, there is still a lack of digital stereoscopic visual images and intuitive observation of three-dimensional morphology; the three-dimensional morphology of the sample cannot be directly viewed.

[0004] 3) Manufacturing distortion or installation errors can cause projection deformation, affecting comfort and accuracy. Manufacturing distortion of the objective lens and the microscope magnifying lens can cause nonlinear projection distortion; inaccurate focal length can lead to inaccurate scale; all of which affect viewing comfort and inspection accuracy. Summary of the Invention

[0005] To overcome the shortcomings of the prior art, the purpose of this invention is to provide a monocular high-resolution digital imaging stereo vision microscope system. This invention solves the problems in the prior art where high-resolution monocular microscopes cannot achieve intuitive stereo vision observation and existing three-dimensional microscopy equipment is difficult to balance high-resolution imaging and real-time stereoscopic morphology presentation.

[0006] To achieve the above objectives, the present invention provides the following solution: A monocular high-resolution digital imaging stereo vision microscope system includes: Microscope body, mechanical moving platform, computer photography control subsystem, computer computing and storage subsystem, and stereoscopic image display; The microscope body is mounted on a movable slide; the microscope body is connected to the computer photography control subsystem and the computer computing and storage subsystem respectively; the mechanical moving platform is connected to the computer photography control subsystem; the stereoscopic image display is connected to the computer computing and storage subsystem. The microscope body is used to present magnified optical images on the focal plane through zoom and autofocus, and simultaneously captures digital image data for real-time transmission to the computer computing and storage subsystem; the mechanical moving platform is used to carry the object under inspection and move it in three-dimensional space; the computer photography control subsystem is used to control the zoom, autofocus, and exposure parameters of the microscope body and to control the mechanical moving platform to move a set baseline distance horizontally at a set position, and to control the microscope body to capture a first digital left image and a second digital right image before and after movement to form a stereo image pair; the computer computing and storage subsystem is used to perform calibration calculations and corrections on the stereo image pair to eliminate projection imaging distortion, and to store the calculated and corrected stereo image pair image data and push it to the stereo image display; the stereo image display is used to receive the overlapping digital images and present a digital image stereoscopic visual observation screen.

[0007] The present invention discloses the following technical effects: This invention provides a monocular high-resolution digital imaging stereoscopic microscope system. Using a single objective monocular microscope, it obtains stereoscopic image pairs with 50%-80% image overlap through a moving baseline M-distance photography. A computer-calibrated image analysis method calculates the image projection distortion error caused by objective lens distortion. This system is the world's first to achieve digital stereoscopic image observation and inspection using a single objective monocular microscope, improving microscope resolution and magnification, and enhancing the application performance of monocular microscope equipment. It overcomes the limitations of light diffraction principles and optical depth of field. The combination of objective lens magnification and digital image magnification improves the resolution and magnification of the stereoscopic image while maintaining a longer optical depth of field, expanding the viewing field of view. The stereoscopic image display provides a comfortable viewing experience, employing multiple modes of stereoscopic electronic display screens, including naked-eye 3D display, active stereoscopic display, and polarized light stereoscopic display, avoiding the posture of looking down and staring intently at the optical eyepiece, and preventing physical fatigue during prolonged stereoscopic image viewing. Using stereoscopic displays of different sizes, one can view large-scale microscopic stereoscopic images; using a digital imaging stereoscopic vision microscope system, a multi-distance, multi-focusing plane stacking stereoscopic imaging method is employed to capture images, which are then processed by computer super-depth-of-field synthesis calculations to obtain super-depth-of-field stereoscopic vision images for viewing; unlimited groups of people can simultaneously view microscopic stereoscopic vision images on stereoscopic (3D) image displays; remote sharing of microscopic digital stereoscopic images allows for real-time transmission of stereoscopic video images via network communication, enabling simultaneous viewing of stereoscopic vision images on stereoscopic (3D) displays worldwide; long-term preservation of microscopic digital stereoscopic images allows for later viewing to restore and reproduce the three-dimensional spatial morphology of microscopic objects; and microscopic digital imaging stereoscopic navigation and measurement functions enable the creation of three-dimensional point cloud models and the measurement of the three-dimensional spatial coordinates of objects. Attached Figure Description

[0008] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0009] Figure 1 A schematic diagram of a monocular high-resolution digital imaging stereo vision microscope system provided in an embodiment of the present invention; Figure 2 This is a schematic diagram showing the structural details of the monocular high-resolution digital imaging stereo vision microscope system provided in an embodiment of the present invention; Figure 3 This is a schematic diagram of the optical lens distortion structure of a microscope objective provided in an embodiment of the present invention; Figure 4 This is a schematic diagram illustrating the calculation and correction of the principal ray projection from the center of the objective lens onto the sensor position in the high-resolution digital image real-time stereo vision microscope system provided in an embodiment of the present invention. Figure 5 This is a schematic diagram of a stereoscopic image pair provided in an embodiment of the present invention; Figure 6 This is a schematic diagram of continuous stereo image pairs and multiple photographic lines provided in an embodiment of the present invention. Attached image description: 1-Zoom focusing objective lens optical module, 2-Optical image magnification imaging surface, 3-Microscopic magnification objective lens camera module, 4-Computer, 5-Stereoscopic image display, 6-Microscope body, 7-Computer computing and storage subsystem, 8-Computer photography control subsystem, 9-Mechanical moving platform. Detailed Implementation

[0011] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0012] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0013] like Figure 1 As shown, the present invention provides a monocular high-resolution digital imaging stereo vision microscope system, characterized in that it comprises: The microscope body 6, the mechanical moving platform 9, the computer photography control subsystem 8, the computer computing and storage subsystem 7, and the stereoscopic image display 5; The microscope body 6 is mounted on a movable slide; the microscope body 6 is connected to the computer photography control subsystem 8 and the computer computing and storage subsystem 7 respectively; the mechanical moving platform 9 is connected to the computer photography control subsystem 8; the stereoscopic image display 5 is connected to the computer computing and storage subsystem 7. The microscope body 6 is used to present magnified optical images on the focal plane through zoom and autofocus, and simultaneously take photographs to obtain digital image data for real-time transmission to the computer computing and storage subsystem 7; the mechanical moving platform 9 is used to carry the object under inspection and move it in three-dimensional space; the computer photography control subsystem 8 is used to control the zoom, autofocus, and exposure parameters of the microscope body 6 and to control the mechanical moving platform 9 to move horizontally along a set baseline distance at a set position, and to control the microscope body 6 to take a first digital left image and a second digital right image before and after the movement to form a stereo image pair; the computer computing and storage subsystem 7 is used to perform calibration calculations and corrections on the stereo image pair to eliminate projection imaging distortion, and to store the calculated and corrected stereo image pair image data and push it to the stereo image display 5; the stereo image display 5 is used to receive the overlapping digital images and present a digital image stereo visual observation screen.

[0014] Specifically, a monocular microscope body 6 is constructed by using a monocular objective lens optical system and a monocular microscopic magnifying objective lens and an area array electronic sensor to form a camera. A mechanical moving platform carries the object to be observed and detected and moves it in the X, Y, and Z directions. After capturing overlapping stereo images, microscopic digital stereoscopic visual images are observed and detected.

[0015] The monocular high-resolution digital imaging stereo vision microscope system improves the sampling resolution of digital images in the broad spectrum of light to the nanometer level, increases the microscope magnification, and enables stereo vision observation and detection of digital images in visible light, infrared light, fluorescence, etc. It provides comfortable viewing of digital stereo vision, convenient operation under the microscope, realizes ultra-depth stereo vision images, allows multiple people to view digital stereo images simultaneously, and enables long-term storage of digital stereo images. It can also remotely share and view digital stereo images through network communication, and has functions such as measuring three-dimensional coordinates and spatial positioning navigation in digital stereo images.

[0016] Furthermore, the microscope body 6 includes: Zoom-aligned focusing objective lens optical module 1 and microscope magnification objective lens camera module 3; The zoom-aligned focusing objective lens optical module 1 is used to present magnified optical images on the focal plane through optical-mechanical synchronous zoom and alignment. The microscope magnifying objective camera module 3 consists of a microscope magnifying objective and an area array electronic sensor. The microscope magnifying objective camera module 3 is vertically mounted on the optical image surface of the zoom focusing objective optical module 1 and is used to synchronously photograph and obtain the digital image data for real-time transmission to the computer computing and storage subsystem 7.

[0017] Specifically, the microscope body 6 consists of a zoom magnifying objective lens optical path and a microscope magnifying objective lens camera section. The microscope body 6 is mounted on a movable slide, allowing it to move at different heights or planar distances.

[0018] The zoom-parfocal magnifying objective lens presents a clear magnified optical image on the focusing plane of the optical path of the zoom-parfocal magnifying objective lens through optical-mechanical synchronous zoom and parallel focusing.

[0019] A microscope magnifying objective and an area array electronic sensor constitute a microscope magnifying objective camera. The camera is mounted perpendicular to the optical image magnification plane 2 of the zoom-focusing objective, simultaneously capturing nanometer-resolution digital images. The camera transmits the captured digital image data in real time to a computer 4 and stores it in the device. (See...) Figure 2 As shown.

[0020] The mechanical X, Y, Z mobile cargo platform is controlled by a computer photography control subsystem and moves in three-dimensional space during photography.

[0021] Furthermore, the ratio of the set baseline distance to the photographic height is greater than 0.1; The overlap between the first digital left image and the second digital right image is between 50% and 80%. The computer photography control subsystem 8 is also used to control the mechanical moving platform 9 to move a distance in the Y direction to shoot a second photography line after the continuous stereo image pairs of the first photography line are captured in the horizontal direction, and the lateral image overlap of the two adjacent photography lines is greater than 20%.

[0022] Specifically, it controls the zoom alignment and focusing of the microscope body 6 and adjusts the exposure parameters of the digital camera.

[0023] The computer photography control subsystem 8 is used to control the monocular microscope body to move up and down on the support, control the movement of the three-axis moving platform, control the exposure parameters of the camera when the microscope magnifying objective camera is taking pictures, and control the movement of the platform to perform cyclic shooting of multiple lines until the entire sample is covered, so as to obtain a full-coverage image set. The mechanical moving platform is controlled to move the object being observed or inspected in the X, Y, and Z directions. The platform moves in the X direction from the exposure setting position of the microscope magnifying lens camera. The distance between the camera exposure points during X-direction movement is called the baseline M. The required length of the baseline M is the ratio of baseline M to the imaging height H, K = M / H, where K > 0.1. (See...) Figure 5 As shown.

[0024] The microscope objective camera is controlled to capture the first digital image (left image P1). After the camera captures the first digital image (left image P1), the mechanical moving platform moves horizontally in the X direction by a baseline distance M before capturing the second digital image (right image P2). The overlap between the first left image and the second right image is between 50% and 80%. The overlapping left and right images form a stereo image pair. (See...) Figure 5 As shown, move horizontally to photograph P1, P2...P n Moving in the X direction to capture digital images of the covered object in the X direction P n Afterwards, continuous stereo image pairs are captured along the first camera line. Then, the camera moves horizontally by a distance in the Y direction to capture stereo image pairs of the remaining portion of the object covered by the second camera line. There is lateral image overlap between the images of the first and second camera lines, with the lateral image overlap exceeding 20%. This process continues until continuous stereo image pairs and multiple camera lines are used to cyclically capture images covering the entire observed and detected object. (See...) Figure 6 As shown.

[0025] Specifically, in the first line of image capture, the monocular microscope camera captures the first digital image as the left image P1. After controlling the platform to move horizontally along the X-direction by a baseline distance M, a second digital image is captured as the right image P2. The overlap rate between the left image P1 and the right image P2 is set between 50% and 90% to construct a stereo image pair. This process continues with horizontal movement along the X-direction by a baseline distance M to capture images P3, P4…P… n The first row of stereo image pairs was captured, resulting in a continuous sequence of stereo image pairs.

[0026] In the second line of photography, the mobile platform moves horizontally along the Y direction to capture images in the second line, and the first captured digital image is used as the left image P. 21 After controlling the platform to move horizontally along the X direction by a baseline distance M, a second digital image is captured as the right image P. 22 The left image P 21 and the right image P 22 The overlap ratio is set between 50% and 90% to construct stereo image pairs, and the baseline L is moved horizontally in the X direction to capture P. 23 P 24 …P 2nComplete the stereo image pair shooting of the second line to obtain continuous stereo image pairs.

[0027] The mobile platform moves horizontally along the Y direction, and the third line of photography is taken to the nth line until all the observed and tested samples are covered, resulting in a stereo image pair of a full-coverage image set.

[0028] The horizontal movement distance y of the moving platform along the Y direction in the first line of photography and the second line of photography is set to be greater than 5% (>5%) in the side image overlap.

[0029] Furthermore, the calibration calculation correction includes: Optical distortion calculation correction, spatial projection calculation correction, and objective lens focal length fitting calculation correction.

[0030] Specifically, the optical distortion of the parfocal magnifying objective is calculated and corrected. The manufacturing distortion of the optical lens in the parfocal magnifying objective and the manufacturing distortion of the microscopic magnifying objective cause projected image distortion. The distortion of the calibration objective is then calculated and corrected to correct the projected image. See [link to documentation]. Figure 3 .

[0031] The objective lens central principal ray projection onto the sensor position correction calculation is performed. The calculated pixel position o of the electronic sensor where the objective lens central principal ray projection is located is the origin of the image coordinate system o-xy for spatial projection calculation. See [link to relevant documentation]. Figure 4 As shown.

[0032] The objective lens focal length f is fitted and corrected; the focal length f value of the objective lens is calibrated and calculated; the scale of the quantitative stereo model is determined, satisfying the scale measurement distance as: A = fM / x L -x R The stereoscopic image data, corrected for projection distortion, is calculated and stored by computer 4 according to different stereoscopic image display format requirements, and simultaneously pushed to stereoscopic image display 5 and network platform. (See...) Figure 2 As shown.

[0033] Furthermore, the computer computing and storage subsystem 7 is also used to perform super-depth-of-field synthesis computing processing on the digital image data to obtain super-depth-of-field stereoscopic visual images.

[0034] Specifically, a multi-stage, multi-distance focal plane stacking stereoscopic image photography method is used to capture images, which are then processed by computer-aided super-depth-of-field synthesis to obtain super-depth-of-field stereoscopic visual images.

[0035] Furthermore, it also includes: The lighting source is any one of the following: a cold light source, a light-emitting diode light source, an infrared light source, a fluorescent source, a coaxial light source, or a polarized light source.

[0036] Furthermore, the stereoscopic image display 5 is any one of an active stereoscopic display, a polarized stereoscopic display, or a naked-eye 3D display.

[0037] Specifically, a digital imaging stereoscopic microscope system is used to capture images using a stacked stereoscopic imaging method with focal planes at different heights and distances. After processing by computer-aided super-depth-of-field synthesis, a super-depth-of-field stereoscopic image is obtained.

[0038] The stereoscopic image display 5 consists of two digital images, overlapping by 50%-80%, forming a stereoscopic image pair. This image pair constitutes the conditions for stereoscopic visual observation of digital images. Viewing stereoscopic microscopic images on a 3D display is described in [link to documentation]. Figure 2 As shown.

[0039] The stereoscopic image display 5 is an electronic display for viewing digital stereoscopic microscopic images. Types include active stereoscopic displays, polarized light stereoscopic displays, and glasses-free 3D displays. Digital stereoscopic images are pushed to networks and network platforms, enabling viewing on mobile glasses-free 3D laptops, glasses-free 3D tablets, glasses-free 3D mobile phones, wearable VR / AR devices, etc. Figure 2 As shown.

[0040] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0041] This document uses specific examples to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. Furthermore, those skilled in the art will recognize that, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A monocular high-resolution digital imaging stereo vision microscope system, characterized in that, include: Microscope body, mechanical moving platform, computer photography control subsystem, computer computing and storage subsystem, and stereoscopic image display; The microscope body is mounted on a movable slide; the microscope body is connected to the computer photography control subsystem and the computer computing and storage subsystem respectively; the mechanical moving platform is connected to the computer photography control subsystem; The stereoscopic image display is connected to the computer computing and storage subsystem; The microscope body is used to present magnified optical images on the focal plane through zoom and autofocus, and the microscope objective camera simultaneously captures digital image data for real-time transmission to the computer computing and storage subsystem. The mechanical moving platform is used to carry the object under inspection and move it in a two-dimensional plane. The computer imaging control subsystem is used to control the zoom, autofocus, and exposure parameters of the microscope body and to control the mechanical moving platform to move a set baseline distance in the horizontal direction. It also controls the microscope body to capture a first digital left image and a second digital right image before and after the movement to form a stereo image pair by creating image overlap. The computer computing and storage subsystem is used to perform calibration calculations and corrections on the stereo image pair to eliminate image projection distortion, and to store the calculated and corrected stereo image pair image data and push it to the stereo image display. The stereoscopic image display is used to receive overlapping digital images and present digital images for stereoscopic visual observation of stereoscopic images.

2. The monocular high-resolution digital imaging stereo vision microscope system according to claim 1, characterized in that, The microscope body includes: Zoom-aligned focusing objective lens optical module and microscope magnification objective lens camera module; The zoom-aligned focusing objective lens optical module is used to present magnified optical images on the focal plane through optical-mechanical synchronous zooming and alignment. The microscope magnifying objective camera module consists of a microscope magnifying objective and an area array electronic sensor. The microscope magnifying objective camera module is vertically mounted on the optical image surface of the zoom-aligned focusing objective optical module and is used to synchronously photograph and obtain the digital image data for real-time transmission to the computer computing and storage subsystem.

3. The monocular high-resolution digital imaging stereo vision microscope system according to claim 1, characterized in that, The ratio of the set baseline distance to the photographic height is greater than 0.1; The overlapping digital image is one in which the overlap between the first digital left image and the second digital right image is between 50% and 80%. The computer photography control subsystem is also used to control the mechanical moving platform to move a distance in the Y direction to shoot a second photography line after the continuous stereo image pairs of the first photography line are captured in the horizontal direction, and the lateral image overlap of the two adjacent photography lines is greater than 20%.

4. The monocular high-resolution digital imaging stereo vision microscope system according to claim 1, characterized in that, The calibration calculation correction includes: Optical distortion calculation correction, spatial projection calculation correction, and objective lens focal length calculation correction.

5. The monocular high-resolution digital imaging stereo vision microscope system according to claim 1, characterized in that, The computer computing and storage subsystem is also used to perform super-depth-of-field compositing processing on the digital image data to obtain super-depth-of-field stereoscopic visual images.

6. The monocular high-resolution digital imaging stereo vision microscope system according to claim 1, characterized in that, Also includes: The lighting source is any one of the following: a cold light source, a light-emitting diode light source, an infrared light source, a fluorescent source, a coaxial light source, or a polarized light source.

7. The monocular high-resolution digital imaging stereo vision microscope system according to claim 1, characterized in that, The stereoscopic image display can be any one of an active stereoscopic display, a polarized stereoscopic display, or a naked-eye 3D display.

Images