35 results about "Virtual microscope" patented technology

Systems and methods for assessing virtual microscope slide image quality are provided. In order to determine whether a virtual slide image has any out of focus areas and is therefore a candidate for manual inspection, the various focus points used to scan the virtual slide image are used to calculate a best fit surface for the virtual slide image. The distance of each focus point from the best fit surface is then calculated and the largest distance is compared to a predetermined value. If the largest distance from a focus point to the best fit surface is larger than the predetermined value, then the virtual slide image is designated as needing a manual inspection and possible re-scan.

A method of and apparatus for viewing microscopic images include transmitting tiled microscopic images from a server to a client. The client assembles the tiled images into a seamless virtual slide or specimen image and provides tools for manipulating image magnification and viewpoint. The method and apparatus also provides a virtual multi-headed microscope function which allows scattered viewers to simultaneously view and interact with a coherent magnified microscopic image.

A method and apparatus are disclosed for making and using a virtual microscope slide data structure having data for an overall image of the specimen or a substantial portion thereof along with data for higher magnification images of selected areas within the overall image and along with data useable for correlating, linking and / or coherently assembling low magnification, overall image segments with the higher image segments. This latter data may comprise a control program for manipulating images to allow zooming different, higher magnification images into view, scrolling adjacent high magnification images into view or marking the location of a displayed higher magnification view on the overall image to assist in navigation by a viewer to locate and quickly display suspicious areas within the specimen. The data structure may be sent over the Internet.

Systems and methods for retrieving, manipulating, and viewing 3D image objects from 3D virtual microscope slide images are provided. An image library module provides access to the imagery data in a 3D virtual slide and constructs 3D image objects that are coextensive with the 3D virtual slide or a 3D sub-portion thereof. From within the 3D image object, cross layer planar views spanning various depths of the 3D virtual slide are constructed as well as 3D prisms and other shaped image areas. The image library module allows a 3D image object to be sliced into horizontal and vertical views, skewed cross layer views and regular and irregular shaped 3D image areas for viewing by a user.

Systems and methods for assessing virtual microscope slide image quality are provided. In order to determine whether a virtual slide image has any out of focus areas and is therefore a candidate for manual inspection, the various focus points used to scan the virtual slide image are used to calculate a best fit surface for the virtual slide image. The distance of each focus point from the best fit surface is then calculated and the largest distance is compared to a predetermined value. If the largest distance from a focus point to the best fit surface is larger than the predetermined value, then the virtual slide image is designated as needing a manual inspection and possible re-scan.

A virtual microscope system capable of obtaining a stained sample image and a statistical data of spectra in a short period of time is provided, the virtual microscope system includes an image obtaining unit for obtaining a stained sample image, a spectrum obtaining unit for obtaining a spectrum of the stained sample image, an optical path setting unit for setting an optical path of a light flux passed through the stained sample with respect to the image obtaining unit and the spectrum obtaining unit and a control unit for controlling to repeat obtaining the stained sample image by the image obtaining unit and obtaining the spectrum of the stained sample image by the spectrum obtaining unit in the observation field of the stained sample to create a virtual slide and a spectrum table of the stained sample.

A method of and apparatus for viewing microscopic images include transmitting tiled microscopic images from a server to a client. The client assembles the tiled images into a seamless virtual slide or specimen image and provides tools for manipulating image magnification and viewpoint. The method and apparatus also provides a virtual multi-headed microscope function which allows scattered viewers to simultaneously view and interact with a coherent magnified microscopic image.

A system for visualizing an eye of a patient during corneal surgery includes a processor and a first and second camera in signal communication with the processor. The cameras are positionable for focusing on a cornea positioned for surgery. A first and a second display and optics therefor are in signal communication with the processor and are positionable for viewing through a first and a second eyepiece of a stereo microscope, respectively. Software is resident on the processor for receiving a first and second corneal image from the first and second cameras, for processing the received first and second images for display, and for transmitting the processed first and second images to the first and the second displays, respectively, via the display optics. The displays can then be viewed by a surgeon through the microscope at least during the surgery.

A system for visualizing an eye of a patient during corneal surgery includes a processor and a first and second camera in signal communication with the processor. The cameras are positionable for focusing on a cornea positioned for surgery. A first and a second display and optics therefor are in signal communication with the processor and are positionable for viewing through a first and a second eyepiece of a stereo microscope, respectively. Software is resident on the processor for receiving a first and second corneal image from the first and second cameras, for processing the received first and second images for display, and for transmitting the processed first and second images to the first and the second displays, respectively, via the display optics. The displays can then be viewed by a surgeon through the microscope at least during the surgery.

The present invention provides a medical diagnosis support device, which is capable of acquiring information to support medical diagnosis for easily and precisely determining chromosome abnormality and / or gene amplification related to cancer or genetic disorder.The medical diagnosis support device for acquiring information to support medical diagnosis from an image of a specimen stained by multiple staining, the image is obtained by photographing the stained specimen with transmitted light, the device comprises: staining characteristics quantity acquisition means for acquiring characteristics quantity of each staining, based on a pixel value of the image of the stained specimen; marker intensifying means for intensifying a marker, based on the characteristics quantity of each staining thus acquired; marker extracting means for extracting the marker of each staining, based on the characteristics quantity in which the marker has been thus intensified; marker state judging means for judging a state of the marker, based on the marker of each staining thus extracted; and marker state identifying and displaying means for identifying and displaying the marker state, based on the judgment result.

A system for visualizing an eye of a patient during corneal surgery includes a processor and a first and second camera in signal communication with the processor. The cameras are positionable for focusing on a cornea positioned for surgery. A first and a second display and optics therefor are in signal communication with the processor and are positionable for viewing through a first and a second eyepiece of a stereo microscope, respectively. Software is resident on the processor for receiving a first and second corneal image from the first and second cameras, for processing the received first and second images for display, and for transmitting the processed first and second images to the first and the second displays, respectively, via the display optics. The displays can then be viewed by a surgeon through the microscope at least during the surgery.

Systems and methods for retrieving, manipulating, and viewing 3D image objects from 3D virtual microscope slide images are provided. An image library module provides access to the imagery data in a 3D virtual slide and constructs 3D image objects that are coextensive with the 3D virtual slide or a 3D sub-portion thereof. From within the 3D image object, cross layer planar views spanning various depths of the 3D virtual slide are constructed as well as 3D prisms and other shaped image areas. The image library module allows a 3D image object to be sliced into horizontal and vertical views, skewed cross layer views and regular and irregular shaped 3D image areas for viewing by a user.

This invention relates to microscope slice method, which comprises the following steps: using total image with low resolution as virtual slice background image and establishing coordinates and background image on special part with high resolution with large times; then compressing it into virtual slice through network to user for decompressing virtual slice for displaying background image; then displaying image special part through coordinates. The virtual microscope slice system comprises the image catch device, virtual slice terminal, application terminal, virtual slice terminal.

Provided is an image processing apparatus including: a characteristic amount calculator for calculating a first characteristic amount for each pixel constituting a stained sample image; a component ratio calculator for calculating a component ratio of constituent elements in a target pixel, based on the calculation results; a reference value storage portion for storing a reference value of a second characteristic amount of each of the constituent elements; a constituent element correction coefficient calculator for calculating a constituent element correction coefficient, based on the reference value and the second characteristic amount of each of the constituent elements; a target pixel correction coefficient calculator for calculating a target pixel correction coefficient, based on the component ratio and the constituent element correction coefficient thus calculated; and a characteristic amount corrector for correcting the second characteristic amount, based on the calculation results.

The present invention provides a medical diagnosis support device which enables a user to acquire the most appropriate information to support medical diagnosis without causing the user so much trouble. Specifically, the medical diagnosis support device comprises: an image processing method storage portion 152 for memorizing plural types of image processing methods; a photographing method storage portion 153 for memorizing plural types of photographing methods; an identification information acquisition portion 160 for acquiring identification information of a specimen S;an image processing method selection portion 141 for selecting, based on identification information thus acquired, a corresponding image processing method from the image processing method storage portion 152; a photographing method selection portion 142 for selecting, based on the acquired identification information or the image processing method thus selected, a corresponding photographing method from the photographing method storage portion 153; a specimen photographing portion 110 for photographing the specimen S according to the selected photographing method to acquire a specimen image; and an image processing portion 145 for subjecting the specimen image acquired by the specimen photographing portion 110, to image processing, according to the image processing method selected by the image processing method selection portion 141.

The present invention is aimed at easily providing an image which is in focus at any position in the image to be an observation target of a user and is free from misalignment in the image in a virtual microscope or the like.An image outputting server 10 includes an image storing part 11 for storing a plurality of image data with different focal points taken in an imaging direction which are images of a predetermined imaging target, specified area inputting means 12 for inputting information specifying an area in the image data, focal point information obtaining means 13 for obtaining information indicating the matching degree of a focal point in a specified area of each of the plurality of image data, image selection means 14 for selecting an image data to be output from the plurality of image data on the basis of the matching degree of the focal point, and outputting means 15 for outputting the thus selected image data.

The invention provides a virtual microscope based on visual perception and application thereof, and belongs to the field of experimental equipment. The virtual microscope based on the visual perception comprises: a microscope body model; a rotation sensor, a remote communication module, a display, a camera, and an electronic chip disposed on the microscope body model; and a computing and display device. The rotation sensor, the remote communication module, the display, and the camera are respectively connected to the electronic chip. The remote communication module is capable of communicatingwith the computing and display device. On the one hand, according to the virtual microscope based on the visual perception and the application thereof, a virtual fusion technology is utilized to perform information enhancement on a user observation result, which is beneficial for the user to randomly explore the process, the mechanism, and the principle of the experimental phenomena; on the otherhand, according to the virtual microscope based on the visual perception and the application thereof, the operating experience under a real microscope condition is obtained through the physical operation, which helps an experimenter master relevant experimental skills.

The invention provides a navigation type virtual microscope based on an intention understanding model. The navigation type virtual microscope comprises a multi-mode input and sensing module, a multi-mode information integration module and an interactive application module; the multi-mode input and sensing module is used for obtaining voice information of a user through a microphone and obtaining an operation behavior of the user; and the multi-mode information integration module is used for processing the voice information through visual channel information and processing the operation behavior through tactile channel information, and then integrating the processed voice information with the operation behavior through the multi-channel information to complete the interaction between the microscope and the user. According to the invention, multi-modal information is acquired and integrated; simple sensing elements are utilized, signal input and intelligent sensing technologies of multiple modes are added, on the basis that the advantages of the digital microscope are guaranteed, vast common and poor middle school students can learn the microscope conditionally, the cognitive feelingof the micro world is improved, and the intelligent microscope is experienced.

An image processing device for processing a stained sample image including hematoxylin stain is provided with a dye spectrum storage unit that stores a dye spectrum of dye used in staining, a change characteristic calculation unit that calculates a change characteristic in a wavelength direction of the dye spectrum based on the dye spectrum, a dye amount / wavelength shift amount estimation unit that estimates at least a dye amount of the hematoxylin stain and a shift amount in the wavelength direction for each pixel in the stained sample image based on the dye spectrum and the change characteristic; and a cell nucleus extraction unit that extracts a cell nucleus region of the stained sample image based on the shift amount estimated in the wavelength direction.

The invention relates to a VR-based biological microscope three-dimensional simulation method. Based on the correlation among parts in the case of microscope operation, the parts are divided to fixedparts and movable parts, three-dimensional models and a father-son relationship are built respectively, a whole three-dimensional model is combined, and a Unity3D is adopted for collision detection ona moving process; an image database for biological experiments observed by the microscope is built; and a VR interactive handle is used to operate each part of the three-dimensional microscope, undersupport of an immersion VR device, interactive operation with a virtual microscope can be carried out, and the basic operation of a real microscope is simulated. A sense of operation is achieved to simulate the operation process of the microscope, which is helpful to accelerate understanding and operation of the microscope.

Provided is an image processing apparatus capable of analyzing a target sample image with high accuracy in line with a phenomenon occurring in the target sample. The image processing device includes: a dye spectrum storage portion (233) for storing a dye spectrum of a dye used in staining the stained sample; and an arithmetic portion (250) including: a variation characteristic calculating portion (2501) for calculating, based on the stored dye spectrum, a variation characteristic representing either a sharp or gradual change of the dye spectrum in the wavelength direction; and a dye-amount / variation-amount estimating portion (2503) for estimating, based on the stored dye spectrum and the calculated variation characteristic, a variation amount from a pixel value of each pixel forming the stained sample image based on the dye-amount and the variation characteristic, the arithmetic portion analyzing the stained sample image at least based on the variation amount.

A virtual microscope system capable of obtaining a stained sample image and a statistical data of spectra in a short period of time is provided, the virtual microscope system includes an image obtaining unit for obtaining a stained sample image, a spectrum obtaining unit for obtaining a spectrum of the stained sample image, an optical path setting unit for setting an optical path of a light flux passed through the stained sample with respect to the image obtaining unit and the spectrum obtaining unit and a control unit for controlling to repeat obtaining the stained sample image by the image obtaining unit and obtaining the spectrum of the stained sample image by the spectrum obtaining unit in the observation field of the stained sample to create a virtual slide and a spectrum table of the stained sample.

The invention discloses a multi-modal intention fusion method. The method comprises steps of acquiring sound information and visual information of a user through a sensor; converting the acquired sound information into a plurality of voice intentions by utilizing an intention perception algorithm, and converting the visual information into operation intentions; determining a real voice intention of the user through voice intention competition; enabling the operation intention to act on the sample image, and presenting an operation result on a screen; judging the real operation intention of the user; and constructing a system feedback rule base, inquiring and outputting corresponding system feedback according to the real operation intention and the real voice intention of the user, and guiding the user to operate. The invention also discloses a virtual microscope, and the virtual microscope comprises an input module, a control module and an output module, so that the device can sense the real intention of a user, gives corresponding feedback guidance, effectively reduces the number of times of misoperation of the user, and is convenient for the user to better complete a microscope operation experiment.

A method and apparatus for aligning microscope images. Microscope images of the same or very similar subjects provided by different microscopes are aligned. The images from two types of microscope, such as a Virtual Microscope (VM) and a Light Microscope (LM) are used. An image produced by the virtual microscope is easily read by a viewer, as it represents a scan of a whole slide rather than individual high power fields of view. An area of the image can be selected for further examination or objective analysis by the LM microscope. The qualitative or quantitative information obtained from the Light microscope using the method described may then be located back into the virtual microscope image to provide understandable context.

The invention provides a visual perception-based virtual microscope and its application, belonging to the field of experimental equipment. The virtual microscope based on visual perception includes: a microscope body model and a rotation sensor, a remote communication module, a display, a camera, and an electronic chip arranged on the microscope body model; computing and display equipment; the rotation sensor, a remote communication module, The display and the camera are respectively connected to the electronic chip; the remote communication module can communicate with computing and display equipment. On the one hand, the present invention uses virtual fusion technology to enhance the information of the user's observation results, which is conducive to the user's random exploration of the process, mechanism and principle of the experimental phenomenon; on the other hand, the present invention obtains the operation under real microscope conditions Experience helps experimenters master relevant experimental skills.

The invention relates to a virtual microscope system which comprises a microscope arm, an ocular lens, an objective lens, a base, a glass slide and an objective table, the microscope arm is rotatablyarranged on the base through a rotating shaft, and the ocular lens, the objective lens and the objective table are connected to the microscope arm through a hot melt adhesive. The virtual microscope system further comprises a cloud picture library used for storing pictures shot by a real microscope in advance; an identification code arranged on the glass slide; a main control board connected withan Ethernet interface and onboard WIFI; a wide-angle camera arranged on the objective lens and electrically connected with the main control board; a display screen arranged on the base and electrically connected with the main control board; and a rotary encoder rotatably arranged on the microscope arm and electrically connected with the main control board. The cost is relatively low, different pictures can be displayed by identifying the corresponding IDs, the problem of purchasing the microscope is solved, and the problems\ of purchasing and preserving experimental samples is also solved.

The invention provides a virtual microscope kit and an application thereof, which belong to the field of experimental equipment. The virtual microscope physical kit includes: a microscope body model and a screw sensor, a pressure sensor and a slide position sensor arranged on the microscope body model; an FPGA chip and a local display device; the screw sensor, a pressure sensor and a slide position sensor respectively connected with the FPGA chip; the FPGA chip communicates with the local display device through wired or wireless means. On the one hand, the present invention uses virtual fusion technology to enhance the information of the user's observation results, which is conducive to the user's random exploration of the process, mechanism and principle of the experimental phenomenon; on the other hand, the present invention obtains the operation under real microscope conditions Experience helps experimenters master relevant experimental skills.

The invention provides a virtual microscope physical kit and an application thereof and belongs to the field of experiment equipment. The virtual microscope physical kit includes a virtual microscopebody model, and a spiral sensor, a pressure sensor and a slide glass position sensor arranged on the virtual microscope body model, wherein an FPGA chip and a local display device are connected, the spiral sensor, the pressure sensor and the slide glass position sensor are connected with the FPGA chip, and the FPGA chip communicates with the local display device in a wired or wireless mode. The virtual microscope physical kit is advantaged in that on one hand, the virtual fusion technology is utilized, information enhancement of the user observation result is performed, a user is facilitated to randomly explore the process, the mechanism and principle of experimental phenomena, on the other hand, through physical operation, operating experience under the real microscope conditions is obtained, and experimental personnel are facilitated to master relevant experimental skills.

The present application relates to the technical field of computer-aided teaching, in particular to a virtual microscope network teaching interaction method and system, comprising the following steps: collecting the response time of the microscope hardware, extracting features to judge abnormalities, constructing a microscope hardware response performance feature model, combining the time stamp difference between teachers and students to estimate errors to generate interaction time sequence synchronization state information, mapping thread priority weight to construct a virtual microscope multi-thread resource scheduling scheme, configuring instructions, rendering thread priority and time slice to form a microscope network interaction synchronization scheduling instruction set, performing color brightness compensation on the image to output a virtual microscope display screen, in the present application, the response time of the microscope operation is collected and the time sequence features are extracted, the instruction and the image time difference are combined to estimate the error, the thread priority and the time slice are synchronously distributed, and the picture is pasted after pixel-level color brightness correction according to the operation change, thereby reducing the delay asynchronization and improving the remote teaching experience.