Guidance program, guidance method, imaging device, information processing device, and microscope device

Abstract

To make it easy to perform position adjustment of a camera with respect to an eyepiece lens of a microscope.SOLUTION: A guide program 15A is configured to guide a camera 19 held by a holding tool holding the camera 19 photographing a viewing field of a microscope through an eyepiece lens of the microscope to a proper holding position with respect to an optical axis of the eyepiece lens. The guide program 15A is configured to cause a computer to execute: acquiring an image that the camera 19 held by the holding tool photographs the viewing field from the camera 19; identifying a viewing-field area corresponding to a viewing field in the image; obtaining a center-of-gravity coordinate of the viewing-field area; and preparing guide information to the holding position on the basis of comparison of the center of gravity coordinate with a reference coordinate corresponding to a center of gravity of the viewing-field area obtained from the image that the camera 19 held in the holding position photographs.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a guidance program, a guidance method, an imaging device, an information processing device, and a microscope device.

Background Art

[0002] For example, Patent Document 1 describes a microscope that captures an image of a sample to be observed with a camera function provided in a portable information terminal and displays the image on a display. This microscope includes a microscope main body and a mounting table that can be detachably connected to the microscope main body at a plurality of connection positions, and on which the portable information terminal is placed in a state of being connected to the microscope main body. The microscope main body has a sample placement section for placing a sample, a light source for irradiating light onto the sample placed on the sample placement section, and an optical system disposed inside the microscope main body. The optical system includes an objective lens into which light from the sample placed on the sample placement section is incident, and an eyepiece lens into which light from the objective lens is incident and that emits the incident light to the outside of the microscope main body. The mounting table has a plurality of perspective windows formed at positions that coincide with any one of the camera lenses of various portable information terminals when any one of the plurality of types of portable information terminals is placed thereon, and the mounting table and the microscope main body are configured to be connectable such that the perspective window coincides with the position of the eyepiece lens in a state where the camera lens of the portable information terminal and the perspective window coincide.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in order to observe a sample well, it is necessary to adjust the optical axis of the eyepiece lens of the microscope and the optical axis of the camera and align the two as accurately as possible. However, delicate operations are required for the position adjustment with the optical axis of the eyepiece lens provided in a high-magnification microscope.

[0005] The purpose of this disclosure is to provide a guidance program, guidance method, imaging device, information processing device, and microscope device that can easily adjust the position of a camera relative to the eyepiece of a microscope. [Means for solving the problem]

[0006] To achieve the above objective, a guidance program according to one aspect of the present disclosure is a guidance program that guides a camera, which is held in a holder that holds a camera that images the field of view of a microscope through the eyepiece of the microscope, to an appropriate holding position with respect to the optical axis of the eyepiece, wherein the computer functions as an image acquisition unit that acquires an image of the field of view captured by the camera held in the holder from the camera, an identification unit that identifies a field of view region in the image that corresponds to the field of view, a centroid coordinate acquisition unit that determines the centroid coordinate of the field of view region, a guidance information creation unit that creates guidance information to the holding position based on a comparison of the centroid coordinate with a reference coordinate corresponding to the centroid of the field of view region obtained from an image captured by the camera held in the holding position, and an output unit that outputs the guidance information. [Effects of the Invention]

[0007] According to this disclosure, the effect is obtained that the position of the camera relative to the eyepiece of the microscope can be easily adjusted. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic side view showing an example of a microscope apparatus according to the first embodiment. [Figure 2] This block diagram shows an example of the electrical configuration of an imaging device according to the first embodiment. [Figure 3] This block diagram shows an example of the functional configuration of an imaging device according to the first embodiment. [Figure 4] These are schematic plan and side views illustrating an example of the positional relationship between an imaging device and a microscope held in the appropriate position according to the embodiment. [Figure 5] This figure shows an example of an image captured at the correct position, a binarized image, and reference coordinates. [Figure 6] These are schematic plan and side views illustrating an example of the positional relationship between an imaging device and a microscope held at a position deviated from the optimal position according to the embodiment. [Figure 7] This figure shows an example of an image captured at a position deviating from the optimal position, a binarized image, and the centroid coordinates. [Figure 8] This figure shows an example of an image captured at a position deviating from the optimal position, a binarized image, and the centroid coordinates. [Figure 9] This figure shows an example of the relationship between the reference coordinates and the centroid coordinates according to the embodiment. [Figure 10] This figure shows an example of guidance information displayed together with the captured image according to the embodiment. [Figure 11] This figure shows another example of guidance information displayed together with the captured image according to the embodiment. [Figure 12] This flowchart shows an example of the flow of the reference coordinate derivation process by the guidance program according to the first embodiment. [Figure 13] This flowchart shows an example of the flow of the guidance information display process by the guidance program according to the first embodiment. [Figure 14] This flowchart shows an example of the processing flow by the Y-direction guidance information creation subroutine executed in step S118 of Figure 13. [Figure 15] This flowchart shows an example of the processing flow by the X-direction guidance information creation subroutine executed in step S120 of Figure 13. [Figure 16] This flowchart shows an example of the processing flow by the X-direction guidance information and Y-direction guidance information creation subroutines executed in step S121 of Figure 13. [Figure 17] This figure schematically shows the configuration of the imaging device and motor according to the second embodiment. [Figure 18]It is a flowchart showing an example of the flow of guidance information output processing by a guidance program according to a second embodiment. [Figure 19] It is a diagram schematically showing an example of a microscope apparatus and an information processing apparatus according to a third embodiment. [Figure 20] It is a block diagram showing an example of the electrical configuration of an information processing apparatus according to a third embodiment.

Embodiments for Carrying Out the Invention

[0009] Hereinafter, an example of an embodiment for carrying out the technology of the present disclosure will be described in detail with reference to the drawings. Note that components and processes having the same functions may be given the same reference numerals throughout all the drawings, and duplicate explanations may be omitted as appropriate. Each drawing only schematically shows the technology of the present disclosure to such an extent that it can be sufficiently understood. Therefore, the technology of the present disclosure is not limited only to the illustrated examples. Also, in this embodiment, descriptions of configurations not directly related to the present disclosure and well-known configurations may be omitted.

[0010] [First Embodiment] FIG. 1 is a side view schematically showing an example of a microscope apparatus 100 according to a first embodiment.

[0011] As shown in FIG. 1, the microscope apparatus 100 according to this embodiment includes an imaging device 10, a holder 20, and a microscope 30. The imaging device 10 includes a display unit 16 and a camera 19. The camera 19 is, for example, a camera using a CCD (Charge Coupled Device), and a lens (hereinafter referred to as "camera lens") 19A is provided in the camera 19. A portable device such as a smartphone, a tablet terminal, or a digital still camera is applied to the imaging device 10. The display unit 16 is a display integrally provided with a touch panel, and displays an imaging image obtained by imaging with the camera 19.

[0012] As an example of a microscope device that allows imaging of the microscope's field of view with a smartphone camera, a portable microscope can be cited (for example, the Handy Microscope DX (distributor: Raymay Fujii, model number: RXT300N), reference website: https: / / www.raymay.co.jp / nature / contents / micro / item / RXT300 / ).

[0013] The microscope 30 comprises a lower housing 31, a housing support 32, an upper housing 33, a light source 34, a stage 35, and a lens 36. The housing support 32 is connected to the lower housing 31 at its lower end and to the upper housing 33 at its upper end. The light source 34 is located in the lower housing 31, and the lens 36 is located in the upper housing 33. A stage 35 on which a sample is placed is located between the light source 34 and the lens 36. The lens 36 includes an eyepiece lens 36A and an objective lens 36B. The eyepiece lens 36A is located in the upper housing 33 such that its optical axis points upward. Light from the light source 34 illuminates the stage 35, and the transmitted light that passes through the stage 35 enters the eyepiece lens 36A via the objective lens 36B. The light that enters the eyepiece lens 36A is emitted towards the imaging device 10.

[0014] The holder 20 has a through-hole 21 that penetrates vertically through its upper and lower surfaces, and is positioned on the upper part 33 of the microscope housing 30 so that the optical axis of the eyepiece lens 36A is exposed on the upper side of the holder 20 through the through-hole 21. The holder 20 detachably holds the imaging device 10 so that the optical axis of the camera lens 19A of the imaging device 10 points downward. Specifically, the imaging device 10 is placed on the upper surface of the holder 20. The camera lens 19A of the imaging device 10 and the eyepiece lens 36A of the microscope 30 are positioned opposite each other through the through-hole 21 of the holder 20. This allows the imaging device 10 to image the field of view of the microscope 30. The holder 20 holds the camera 19, i.e., the imaging device 10, so that the optical axis of the camera lens 19A and the optical axis of the eyepiece lens 36A are parallel. Here, "parallel" does not mean perfect parallelism, but is allowed to include a predetermined error. The holder 20 is structured to allow the held imaging device 10 to move horizontally (i.e., in a direction parallel to the display surface of the display unit 16), thereby allowing the two-dimensional position of the camera 19 to be adjusted.

[0015] Figure 2 is a block diagram showing an example of the electrical configuration of the imaging device 10 according to the first embodiment.

[0016] As shown in Figure 2, the imaging device 10 according to this embodiment includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an input / output interface (I / O) 14, a storage unit 15, a display unit 16, an operation unit 17, a communication unit 18, and a camera 19.

[0017] The control unit is comprised of a CPU 11, ROM 12, RAM 13, and I / O 14. These components are connected to each other via a bus.

[0018] I / O 14 is connected to various functional units, including a storage unit 15, a display unit 16, an operation unit 17, a communication unit 18, and a camera 19. These functional units can communicate with the CPU 11 via I / O 14.

[0019] The control unit may be configured as a sub-control unit that controls the operation of a part of the imaging device 10, or as part of the main control unit that controls the operation of the entire imaging device 10. Some or all of the blocks of the control unit may use integrated circuits such as LSIs (Large Scale Integrations) or IC (Integrated Circuit) chipsets. Individual circuits may be used for each of the above blocks, or circuits that integrate some or all of them may be used. The above blocks may be provided as a single unit, or some blocks may be provided separately. Furthermore, parts of each of the above blocks may be provided separately. For the integration of the control unit, dedicated circuits or general-purpose processors may be used, not just LSIs.

[0020] For example, the storage unit 15 can be an HDD (Hard Disk Drive), an SSD (Solid State Drive), or flash memory. The guidance program 15A according to this embodiment is stored in the storage unit 15. This guidance program 15A may also be stored in the ROM 12.

[0021] The guidance program 15A is a program for guiding the camera 19, held in the holder 20, to an appropriate holding position relative to the optical axis of the eyepiece 36A, for example, a holding position where the optical axis of the eyepiece 36A and the optical axis of the camera 19 (camera lens 19A) align (hereinafter referred to as the "appropriate position"). The guidance program 15A may be pre-installed in the imaging device 10, for example. The guidance program 15A may also be implemented by storing it in a non-volatile non-temporary storage medium or distributing it via a network line and installing or upgrading it in the imaging device 10 as appropriate. Examples of non-volatile non-temporary storage media include CD-ROMs (Compact Disc Read Only Memory), magneto-optical disks, HDDs, DVD-ROMs (Digital Versatile Disc Read Only Memory), flash memory, memory cards, etc. Furthermore, "the optical axis of the eyepiece 36A and the optical axis of the camera 19 are aligned" means not only that the optical axes of the eyepiece 36A and the camera 19 are perfectly aligned, but also that the optical axes of the eyepiece 36A and the camera 19 are roughly aligned so that the camera 19 can capture the field of view of the microscope 30 well.

[0022] The display unit 16 may use, for example, a liquid crystal display (LCD) or an organic EL (electroluminescence) display. The display unit 16 has an integrated touch panel. The operation unit 17 is provided with, for example, a power button and volume buttons. The display unit 16 displays the captured image obtained by the camera 19.

[0023] The communication unit 18 is connected to network lines such as the Internet, LAN (Local Area Network), and WAN (Wide Area Network), enabling communication with external devices via the network line.

[0024] As described above, camera 19 is, for example, a camera using a CCD, and it images the field of view of the microscope 30 through the eyepiece 36A and objective lens 36B of the microscope 30.

[0025] As mentioned above, in order to observe a sample well, it is necessary to adjust the optical axis of the microscope's eyepiece and the camera's optical axis and align them as accurately as possible. However, adjusting the position of the eyepiece of a high-magnification microscope requires delicate operation. Furthermore, the image seen through the eyepiece is often inverted vertically and horizontally, making position adjustment even more difficult.

[0026] In contrast, the imaging device 10 according to this embodiment, when guiding the camera 19 held in the holder 20 to the correct position, acquires the image captured by the camera 19 held in the holder 20, identifies the field of view area corresponding to the field of view of the microscope 30 from the acquired image, determines the centroid coordinates of the field of view area, and creates and outputs guidance information to the correct position based on a comparison of these centroid coordinates with the reference coordinates corresponding to the centroid of the field of view area obtained from the image captured by the camera 19 held in the correct position. The correct position is, as described above, the holding position when the optical axis of the eyepiece 36A and the camera 19, that is, the optical axis of the camera lens 19A, are aligned.

[0027] Specifically, the CPU 11 of the imaging device 10 according to this embodiment functions as the various parts shown in Figure 3 by writing the guidance program 15A stored in the memory unit 15 or ROM 12 to the RAM 13 and executing it.

[0028] Figure 3 is a block diagram showing an example of the functional configuration of the imaging device 10 according to the first embodiment.

[0029] As shown in Figure 3, the CPU 11 of the imaging device 10 according to this embodiment functions as an image acquisition unit 11A, a identification unit 11B, a centroid coordinate acquisition unit 11C, a guidance information creation unit 11D, and an output unit 11E.

[0030] The image acquisition unit 11A acquires an image from the camera 19, which is held by the holder 20, capturing the field of view of the microscope 30. The captured image includes the area (field of view region) that captures the field of view of the microscope 30. In other words, the captured image contains a field of view region corresponding to the field of view of the microscope 30.

[0031] The identification unit 11B identifies the field of view region corresponding to the field of view from the captured image acquired by the image acquisition unit 11A. In other words, it extracts the region corresponding to the field of view (field of view region) contained in the captured image. Since the field of view of the microscope 30 is brighter in the captured image than the parts outside the field of view, for example, the captured image is binarized by a binarization process, and the high-brightness region of the binarized image is identified as the field of view region. In addition to binarization, known methods such as the Snake / Active Contour method, Mean Shift method, Graph Cuts method, Region Growing method, and Otsu's binarization method can be used for region extraction.

[0032] The centroid coordinate acquisition unit 11C determines the centroid coordinate of the field of view area identified by the identification unit 11B. Specifically, for example, it calculates the centroid coordinate of the high-luminance area identified by the identification unit 11B as the centroid coordinate of the field of view area. For example, assuming that the weight of each coordinate (each pixel) in the field of view area is the same, the simple average of the field of view area is determined as the centroid coordinate. Specifically, the X coordinate values ​​of all coordinates (each pixel) included in the field of view area are summed, and the obtained sum is divided by the number of coordinates included in the field of view area to obtain the value obtained as the X coordinate of the centroid coordinate. Similarly, the Y coordinate values ​​of all coordinates (each pixel) included in the field of view area are summed, and the obtained sum is divided by the number of coordinates included in the field of view area to obtain the value obtained as the Y coordinate of the centroid coordinate. The calculation of the centroid coordinates uses known methods (see, for example, 1. https: / / www.higashisalary.com / entry / cv2-calc-moment, 2. https: / / plant-raspberrypi3.hatenablog.com / entry / 2018 / 11 / 13 / 185057). Note that these centroid coordinates are the coordinates in the coordinate system of the captured image.

[0033] The guidance information creation unit 11D creates guidance information to the correct position based on a comparison between the centroid coordinates obtained by the centroid coordinate acquisition unit 11C and the reference coordinates corresponding to the centroid of the field of view obtained from the captured image captured by the camera 19 held in the correct position.

[0034] Here, the centroid coordinates and the reference coordinates are represented by a first coordinate and a second coordinate, respectively, which represent a two-dimensional position on the captured image. The first coordinate is, for example, the X coordinate, and the second coordinate is, for example, the Y coordinate. The X coordinate in the captured image corresponds to the horizontal coordinate with the current position of the camera 19 as the origin, and the Y coordinate in the captured image corresponds to the vertical coordinate with the current position of the camera 19 as the origin. In other words, the X and Y coordinates in the captured image correspond to the position of the camera 19. Therefore, the vertical and horizontal positions of the camera 19 can be adjusted based on a comparison between the X and Y coordinates of the centroid coordinates and the X and Y coordinates of the reference coordinates.

[0035] The output unit 11E outputs the guidance information created by the guidance information creation unit 11D. The destination of the guidance information is, for example, the display unit 16.

[0036] Next, with reference to Figures 4 and 5, we will specifically explain how to determine the reference coordinates corresponding to the centroid of the field of view obtained from the image captured by the camera 19 held in the correct position.

[0037] Figure 4 is a schematic plan view and side view showing an example of the positional relationship between the imaging device 10 and the microscope 30 held in the appropriate position according to this embodiment. For the sake of simplicity, the holder 20 is not shown, and the microscope 30 is not shown in the plan view. Figure 5 is a diagram showing an example of an image captured at the appropriate position, a binarized image, and reference coordinates.

[0038] As shown in Figure 4, the imaging device 10 is positioned in the correct location on the holder 20 so that the display surface of the display unit 16 is aligned horizontally. The correct position of the imaging device 10 is the horizontal holding position of the imaging device 10 when the optical axis of the eyepiece lens 36A and the optical axis of the camera lens 19A are aligned. The image captured by the imaging device 10 in the correct position will include a circular field of view region. Therefore, the position of the imaging device 10 is adjusted while viewing the image displayed on the display unit 16, and the position of the imaging device 10 that yields an image including the circular field of view region is considered the correct position. In this embodiment, when the user views the display unit 16 from above, the longitudinal direction of the imaging device 10 is the vertical direction from the user's perspective, and the short direction is the left-right direction from the user's perspective. Here, the direction from the display unit 16 toward the camera lens 19A is considered upward. Note that the method of positioning the imaging device 10 in the correct location is not limited to this; for example, the position of the eyepiece lens 36A in the microscope 30 can be measured, and the correct position can be determined based on the measurement result.

[0039] The image shown in Figure 5 is an image captured at the appropriate position shown in Figure 4. The field of view is the area corresponding to the field of view of the microscope 30 and is identified from the image captured by the camera 19 and displayed on the display unit 16. In the example in Figure 5, the circular area in the center of the image represents the field of view (field of view area). The binarized image is an image obtained by binarizing the captured image, and the high-brightness area, which is the circular white area in the center of the image, is identified as the field of view area. The centroid coordinates of the high-brightness area identified from the binarized image can be calculated, and the reference coordinates P1(Xs, Ys) can be determined by using the obtained centroid coordinates as the centroid coordinates of the field of view area.

[0040] Next, referring to Figures 6 to 8, we will specifically explain a method for determining the direction in which to move the camera 19 based on the centroid coordinates and reference coordinates corresponding to the centroid of the field of view area included in the captured image captured by the camera 19, which is held at a position shifted from the proper position.

[0041] Figure 6 is a schematic plan view and side view showing an example of the positional relationship between the imaging device 10 and the microscope 30 when held at a position shifted from the optimal position according to this embodiment. For simplicity of explanation, the holder 20 is not shown, and the microscope 30 is also not shown in the plan view. Figures 7 and 8 show an example of an image, a binarized image, and centroid coordinates taken at a position shifted from the optimal position.

[0042] As shown in Figure 6, the display surface of the display unit 16 of the imaging device 10 is positioned so that it is aligned horizontally. When a user looks at the display unit 16, the longitudinal direction of the imaging device 10 is the vertical direction from the user's perspective, and the short direction is the left-right direction from the user's perspective. Here, the direction from the display unit 16 toward the camera lens 19A is defined as the upward direction. "Right-shifted position" is a position where the horizontal holding position of the imaging device 10 is shifted to the right from the correct position. "Left-shifted position" is a position where the horizontal holding position of the imaging device 10 is shifted to the left from the correct position. "Upward-shifted position" is a position where the horizontal holding position of the imaging device 10 is shifted upward from the correct position. "Downward-shifted position" is a position where the horizontal holding position of the imaging device 10 is shifted downward from the correct position. The imaging device 10 is positioned in the "right-shifted position", "left-shifted position", "upward-shifted position", and "downward-shifted position".

[0043] The captured images shown in FIG. 7 are the captured images taken at the right-shifted position and the left-shifted position shown in FIG. 6. In the captured image at the right-shifted position, a dark portion (kerare) can be seen on the left side of the visual field. In other words, the captured image captured by the imaging device 10 at the right-shifted position includes a visual field region having a shape missing the left side of the circle. On the other hand, in the captured image at the left-shifted position, a dark portion (kerare) can be seen on the right side of the visual field. In other words, the captured image captured by the imaging device 10 at the left-shifted position includes a visual field region having a shape missing the right side of the circle. Each of the centroid coordinates P2 (Xi, Yi) is calculated as the centroid coordinate of the high-brightness region specified from the binarized image. In the relationship between the centroid coordinate P2 of the visual field region at the right-shifted position and the centroid coordinate P1 (reference coordinate P1) of the visual field region at the proper position, Yi = Ys and Xi > Xs. In the relationship between the centroid coordinate P2 of the visual field region at the left-shifted position and the centroid coordinate P1 (reference coordinate P1) of the visual field region at the proper position, Yi = Ys and Xi < Xs. In other words, when Xi > Xs, since the imaging device 10 is shifted to the right from the proper position, the imaging device 10 is moved to the left. When Xi < Xs, since the imaging device 10 is shifted to the left from the proper position, the imaging device 10 is moved to the right.

[0044] The captured images shown in FIG. 8 are the captured images taken at the upward shift position and the downward shift position shown in FIG. 6. In the captured image at the upward shift position, a dark portion (vignetting) can be seen on the lower side of the visual field. In other words, the captured image captured by the imaging device 10 at the upward shift position includes a visual field region having a shape missing the lower side of the circle. On the other hand, in the captured image at the downward shift position, a dark portion (vignetting) can be seen on the upper side of the visual field. In other words, the captured image captured by the imaging device 10 at the downward shift position includes a visual field region having a shape missing the upper side of the circle. Each center-of-gravity coordinate P2(Xi, Yi) is calculated as the center-of-gravity coordinate of the high-brightness region specified from the binary image. In the relationship between the center-of-gravity coordinate P2 of the visual field region at the upward shift position and the center-of-gravity coordinate P1 (reference coordinate P1) of the visual field region at the proper position, Yi>Ys and Xi = Xs. In the relationship between the center-of-gravity coordinate P2 of the visual field region at the downward shift position and the center-of-gravity coordinate P1 (reference coordinate P1) of the visual field region at the proper position, Yi<Ys and Xi = Xs. In other words, when Yi>Ys, the imaging device 10 is shifted upward from the proper position, so the imaging device 10 is moved downward. When Yi<Ys, the imaging device 10 is shifted downward from the proper position, so the imaging device 10 is moved upward.

[0045] FIG. 9 is a diagram showing an example of the relationship between the reference coordinate P1 and the center-of-gravity coordinate P2 according to the present embodiment. The X and Y coordinate systems shown in FIG. 9 indicate a two-dimensional coordinate system set for the image displayed on the display unit 16.

[0046] As shown in FIG. 9, when the distance L1 between the center-of-gravity coordinate P2(Xi, Yi) and the reference coordinate P1(Xs, Ys) is outside a predetermined range, the guidance information creating unit 11D creates guidance information. When the distance between the center-of-gravity coordinate P2(Xi, Yi) and the reference coordinate P1(Xs, Ys) is within the predetermined range, the guidance information creating unit 11D does not create guidance information. The distance L1 is calculated using the following formula (1). The predetermined range is an appropriate value determined according to the specifications of the imaging device 10 and the microscope 30 and the like as a range in which an appropriate captured image can be obtained.

[0047] JPEG0007851828000001.jpg766···(1)

[0048] Furthermore, the guidance information generation unit 11D may create guidance information if at least one of the following is outside a predetermined range: a first value representing the absolute value of the difference between the x-coordinate Xi of the centroid coordinate P2(Xi, Yi) and the x-coordinate Xs of the reference coordinate P1(Xs, Ys); and a second value representing the absolute value of the difference between the y-coordinate Yi of the centroid coordinate P2(Xi, Yi) and the y-coordinate Ys of the reference coordinate P1(Xs, Ys). If both the first and second values ​​are within the predetermined range, the guidance information generation unit 11D may choose not to create guidance information.

[0049] Here, if both a first value representing the absolute value of the difference between the X coordinate Xi of the centroid coordinate P2(Xi, Yi) and the X coordinate Xs of the reference coordinate P1(Xs, Ys), and a second value representing the absolute value of the difference between the Y coordinate Yi of the centroid coordinate P2(Xi, Yi) and the Y coordinate Ys of the reference coordinate P1(Xs, Ys), the guidance information creation unit 11D creates guidance information to separately adjust the position of the camera 19 corresponding to the first value and the position of the camera 19 corresponding to the second value, for example, as shown in Figure 10.

[0050] Figure 10 shows an example of guidance information displayed together with the captured image according to this embodiment.

[0051] As shown in Figure 10, the output unit 11E outputs the direction to guide the camera 19 to the display unit 16 as guidance information, along with the captured image acquired by the image acquisition unit 11A. The direction to guide is represented, for example, by at least one of text and / or a graphic. In the example in Figure 10, the text "Position OK" is displayed when the camera is in the "correct position". When the camera is "shifted to the right", the text "Move the camera to the left" and a leftward-pointing arrow are displayed as guidance information. The leftward-pointing arrow is an example of a graphic. The graphic here is not limited to an arrow, but can be any graphic that indicates a direction. Similarly, when the camera is "shifted to the left", the text "Move the camera to the right" and a rightward-pointing arrow are displayed as guidance information. When the camera is "shifted upward", the text "Move the camera downward" and a downward-pointing arrow are displayed as guidance information. When the camera is "shifted downward", the text "Move the camera upward" and an upward-pointing arrow are displayed as guidance information. However, the up, down, left, and right directions referred to here correspond to the up, down, left, and right directions shown in Figures 4 and 6.

[0052] Furthermore, the guidance information generation unit 11D may also generate guidance information to simultaneously adjust the position of the camera 19 corresponding to the first value and the position of the camera 19 corresponding to the second value if both the first value, which represents the absolute value of the difference between the X coordinate Xi of the centroid coordinate P2(Xi, Yi) and the X coordinate Xs of the reference coordinate P1(Xs, Ys), and the second value, which represents the absolute value of the difference between the Y coordinate Yi of the centroid coordinate P2(Xi, Yi) and the Y coordinate Ys of the reference coordinate P1(Xs, Ys), are outside a predetermined range. For example, if the position is shifted diagonally upward to the right, the words "Move the camera diagonally downward to the left" and an arrow pointing diagonally downward to the left will be displayed as guidance information. Guidance information will be displayed in a similar relationship for other diagonal directions. In this case, the holder 20 is structured so that the imaging device 10 can move diagonally in addition to up, down, left, and right relative to the microscope 30.

[0053] Furthermore, if at least one of the first value, which represents the absolute value of the difference between the X coordinate Xi of the centroid coordinate P2(Xi, Yi) and the X coordinate Xs of the reference coordinate P1(Xs, Ys), and the second value, which represents the absolute value of the difference between the Y coordinate Yi of the centroid coordinate P2(Xi, Yi) and the Y coordinate Ys of the reference coordinate P1(Xs, Ys), is outside a predetermined range, the guidance information generation unit 11D may change the length of the figure according to the first or second value, for example, as shown in Figure 11.

[0054] Figure 11 shows another example of guidance information displayed together with the captured image according to this embodiment.

[0055] For example, in the case of a "rightward shift," the captured image and guidance information shown in Figure 11 are displayed. The guidance information is shown as the text "Move the camera to the left" and a leftward-pointing arrow. In the example in Figure 11, the length of the arrow is longer when the first value is large than when the first value is small. By changing the length of the arrow, it is possible to visually grasp the degree of adjustment required for the camera position.

[0056] Next, the operation of the imaging device 10 according to the first embodiment will be described with reference to Figures 12 to 16.

[0057] Figure 12 is a flowchart showing an example of the flow of the reference coordinate derivation process by the guidance program 15A according to the first embodiment.

[0058] When the system is instructed to execute the reference coordinate derivation process using the guidance program 15A, the CPU 11 of the imaging device 10 executes the process by writing the guidance program 15A, which is stored in the ROM 12 or memory unit 15, to the RAM 13.

[0059] In step S101 of Figure 12, the CPU 11 uses the camera 19 of the imaging device 10, which is held in the correct position by the holder 20, to image the field of view of the microscope 30, as shown in Figure 5 above, for example.

[0060] In step S102, the CPU 11, as an example, generates a binarized image by binarizing the image captured in step S101, as shown in Figure 5 above.

[0061] In step S103, the CPU 11 identifies high-luminance regions from the binarized image generated in step S102, as shown in Figure 5 above, for example, and identifies the field of view region.

[0062] In step S104, the CPU 11 derives a reference coordinate P1(Xs, Ys) corresponding to the centroid of the field of view identified in step S103, as shown in Figure 5 above, as an example, and terminates the reference coordinate derivation process by this guidance program 15A.

[0063] Figure 13 is a flowchart showing an example of the flow of the guidance information display process by the guidance program 15A according to the first embodiment.

[0064] When the guidance information display processing by the guidance program 15A is instructed to be executed, the CPU 11 of the imaging device 10 executes the guidance program 15A, which is stored in the ROM 12 or memory unit 15, by writing it to the RAM 13.

[0065] In step S111 of Figure 13, the CPU 11 uses the camera 19 of the imaging device 10, which is held by the holder 20, to image the field of view of the microscope 30, for example, as shown in Figures 7 and 8 above.

[0066] In step S112, the CPU 11 generates a binarized image by binarizing the captured image obtained in step S111, as shown in Figures 7 and 8 above, as an example.

[0067] In step S113, the CPU 11 identifies high-luminance regions from the binarized image generated in step S112 and identifies the field of view region, as shown in Figures 7 and 8 above, for example.

[0068] In step S114, the CPU 11 derives the centroid coordinates P2(Xi, Yi) corresponding to the centroid of the field of view identified in step S113, as shown in Figures 7 and 8 above, as an example.

[0069] In step S115, the CPU 11 determines, as an example, whether |Xi-Xs|, which is the first value representing the absolute difference between the x-coordinate Xi of the centroid coordinate P2(Xi, Yi) and the x-coordinate Xs of the reference coordinate P1(Xs, Ys), is within a predetermined range, as shown in Figure 9 above. If it is determined that |Xi-Xs| is within the predetermined range (positive determination), the process proceeds to step S116. If it is determined that |Xi-Xs| is outside the predetermined range (negative determination), the process proceeds to step S119.

[0070] In step S116, the CPU 11 determines, as an example, whether |Yi-Ys|, which is a second value representing the absolute difference between the Y coordinate Yi of the centroid coordinate P2(Xi, Yi) and the Y coordinate Ys of the reference coordinate P1(Xs, Ys), is within a predetermined range, as shown in Figure 9 above. If it is determined that |Yi-Ys| is within the predetermined range (positive determination), the process proceeds to step S117. If it is determined that |Yi-Ys| is outside the predetermined range (negative determination), the process proceeds to step S118.

[0071] In step S117, the CPU 11 displays information indicating that the imaging device 10 is in the correct position (for example, "Position OK") on the display unit 16, as shown in Figure 10 above, as an example, and terminates the guidance information display processing by the guidance program 15A.

[0072] Meanwhile, in step S118, the CPU 11 creates Y-direction guidance information. The Y-direction guidance information creation subroutine will be explained with reference to Figure 14.

[0073] Figure 14 is a flowchart showing an example of the processing flow by the Y-direction guidance information creation subroutine executed in step S118 of Figure 13.

[0074] In step S131 of Figure 14, the CPU 11 determines whether Yi-Ys > 0. If it determines that Yi-Ys > 0 (positive determination), it proceeds to step S132. If it determines that Yi-Ys > 0 (negative determination), it proceeds to step S133.

[0075] In step S132, the CPU 11 creates guidance information to move the camera 19 downwards, assuming that the centroid coordinates P2(Xi, Yi) are in an upward position, as an example, as shown in Figure 10 above, and returns to step S118 in Figure 13.

[0076] On the other hand, in step S133, the CPU 11 determines whether Yi-Ys < 0. If it determines that Yi-Ys < 0 (positive determination), it proceeds to step S134; if it determines that Yi-Ys < 0 (negative determination), it proceeds to return.

[0077] In step S134, the CPU 11 assumes that the centroid coordinates P2(Xi, Yi) are in a downward position and, as an example, creates guidance information to move the camera 19 upward, as shown in Figure 10 above, and returns to step S118 in Figure 13.

[0078] Returning to Figure 13, in step S119, the CPU 11 determines, for example, whether the second value, |Yi-Ys|, is within a predetermined range, as shown in Figure 9 above. If it determines that |Yi-Ys| is within the predetermined range (positive determination), the process proceeds to step S120. If it determines that |Yi-Ys| is outside the predetermined range (negative determination), the process proceeds to step S121.

[0079] In step S120, the CPU 11 creates X-direction guidance information. Refer to Figure 15 to explain the X-direction guidance information creation subroutine.

[0080] Figure 15 is a flowchart showing an example of the processing flow by the X-direction guidance information creation subroutine executed in step S120 of Figure 13.

[0081] In step S141 of Figure 15, the CPU 11 determines whether Xi-Xs > 0. If it determines that Xi-Xs > 0 (positive determination), it proceeds to step S142; if it determines that Xi-Xs > 0 (negative determination), it proceeds to step S143.

[0082] In step S142, the CPU 11 assumes that the centroid coordinates P2(Xi, Yi) are shifted to the right, and creates guidance information to move the camera 19 to the left, as shown in Figure 10 above, as an example, and returns to step S120 in Figure 13.

[0083] On the other hand, in step S143, the CPU 11 determines whether Xi-Xs < 0. If it determines that Xi-Xs < 0 (positive determination), it proceeds to step S144; if it determines that Xi-Xs < 0 (negative determination), it proceeds to return.

[0084] In step S144, the CPU 11 assumes that the centroid coordinates P2(Xi, Yi) are shifted to the left, and creates guidance information to move the camera 19 to the right, as shown in Figure 10 above, as an example, and returns to step S120 in Figure 13.

[0085] Returning to Figure 13, in step S121, the CPU 11 creates X-direction guidance information and Y-direction guidance information. Refer to Figure 16 to explain the subroutines for creating X-direction guidance information and Y-direction guidance information.

[0086] Figure 16 is a flowchart showing an example of the processing flow by the X-direction guidance information and Y-direction guidance information creation subroutines executed in step S121 of Figure 13.

[0087] In step S151 of Figure 16, the CPU 11 determines whether Yi-Ys > 0. If it determines that Yi-Ys > 0 (positive determination), it proceeds to step S152. If it determines that Yi-Ys > 0 (negative determination), it proceeds to step S153.

[0088] In step S152, the CPU 11 creates guidance information to move the camera 19 downwards, assuming that the centroid coordinates P2(Xi, Yi) are in an upward position, as shown in Figure 10 above as an example.

[0089] On the other hand, in step S153, the CPU 11 determines whether Yi-Ys < 0. If it determines that Yi-Ys < 0 (positive determination), it proceeds to step S154; if it determines that Yi-Ys < 0 (negative determination), it proceeds to return.

[0090] In step S154, the CPU 11 creates guidance information to move the camera 19 upwards, assuming that the centroid coordinates P2(Xi, Yi) are in a downward displacement position, as an example, as shown in Figure 10 above.

[0091] Next, in step S155, the CPU 11 determines whether Xi-Xs > 0. If it determines that Xi-Xs > 0 (positive determination), it proceeds to step S156; if it determines that Xi-Xs > 0 (negative determination), it proceeds to step S157.

[0092] In step S156, the CPU 11 assumes that the centroid coordinates P2(Xi, Yi) are shifted to the right, and creates guidance information to move the camera 19 to the left, as shown in Figure 10 above, as an example, and returns to step S121 in Figure 13.

[0093] On the other hand, in step S157, the CPU 11 determines whether Xi-Xs < 0. If it determines that Xi-Xs < 0 (positive determination), it proceeds to step S158; if it determines that Xi-Xs < 0 (negative determination), it proceeds to return.

[0094] In step S158, the CPU 11 assumes that the centroid coordinates P2(Xi, Yi) are shifted to the left, and creates guidance information to move the camera 19 to the right, as shown in Figure 10 above, and returns to step S121 in Figure 13.

[0095] Returning to Figure 13, in step S122, the CPU 11 displays the guidance information created in step S118, step S120, or step S121 on the display unit 16, and the guidance information display process by this guidance program 15A ends.

[0096] As described above, according to this embodiment, if the optical axis of the microscope's eyepiece lens and the optical axis of the camera lens are misaligned, the direction in which to move the camera to the correct position is displayed as guidance information. The user only needs to move the camera according to the guidance information, making it easy to adjust the position of the camera relative to the microscope's eyepiece lens.

[0097] [Second Embodiment] In the first embodiment described above, a configuration was described in which the user moves the camera to the correct position according to guidance information. In the second embodiment, a configuration is described in which the camera is automatically moved to the correct position by controlling the motor according to guidance information.

[0098] Figure 17 is a schematic diagram showing the configuration of the imaging device 10 and motors 40A and 40B according to the second embodiment.

[0099] As shown in Figure 17, the output unit 11E according to this embodiment outputs guidance information to motors 40A and 40B that adjust the position of the camera 19. Motor 40A is a motor that moves the imaging device 10 in the vertical direction, and motor 40B is a motor that moves the imaging device 10 in the horizontal direction. The guidance information output to motors 40A and 40B includes the direction and amount of movement based on the amount of deviation between the reference coordinates P1 (Xs, Ys) and the centroid coordinates P2 (Xi, Yi).

[0100] Next, with reference to Figure 18, the operation of the imaging device 10 according to the second embodiment will be described.

[0101] Figure 18 is a flowchart showing an example of the flow of the guidance information output process by the guidance program 15A according to the second embodiment.

[0102] When the instruction is given to execute the guidance information output processing by the guidance program 15A, the CPU 11 of the imaging device 10 executes the guidance program 15A, which is stored in the ROM 12 or memory unit 15, by writing it to the RAM 13.

[0103] The process from steps S161 to S171 in Figure 18 is the same as the process from steps S111 to S121 shown in Figure 13 above, so the explanation of its repetition will be omitted. The difference in the flow in Figure 13 is that the guidance information is displayed and output on the display unit 16, whereas in the flow in Figure 18 the guidance information is output to motors 40A and 40B.

[0104] In other words, in step S172 of Figure 18, the CPU 11 outputs the guidance information created in step S168, step S170, or step S171 to motors 40A and 40B, as shown in Figure 17 above, as an example, and terminates the guidance information output process by the guidance program 15A.

[0105] As described above, according to this embodiment, if the optical axis of the microscope's eyepiece lens and the optical axis of the camera lens are misaligned, the camera can be automatically moved to the correct position by controlling the motor with guidance information. Therefore, the position of the camera relative to the microscope's eyepiece lens can be easily adjusted.

[0106] [Third Embodiment] In the third embodiment, a configuration is described in which the guidance program is provided not in the imaging device, but in an information processing device connected to the imaging device via a network.

[0107] Figure 19 is a schematic diagram showing an example of a microscope apparatus 100A and an information processing apparatus 50 according to the third embodiment.

[0108] As shown in Figure 19, the microscope apparatus 100A includes an imaging device 10A. The imaging device 10A and the information processing device 50 are connected via a network N, and the information processing device 50 is accessible via the network N by the imaging device 10. The information processing device 50 can be a general-purpose computer device such as a server computer or a personal computer.

[0109] Figure 20 is a block diagram showing an example of the electrical configuration of the information processing device 50 according to the third embodiment.

[0110] As shown in Figure 20, the information processing device 50 according to this embodiment includes a CPU 51, a ROM 52, a RAM 53, an I / O 54, a storage unit 55, a display unit 56, an operation unit 57, and a communication unit 58.

[0111] The control unit is comprised of a CPU 51, ROM 52, RAM 53, and I / O 54. These components are connected to each other via a bus.

[0112] The I / O 54 is connected to various functional units, including the storage unit 55, the display unit 56, the operation unit 57, and the communication unit 58. These functional units are able to communicate with the CPU 51 via the I / O 54.

[0113] The control unit may be configured as a sub-control unit that controls some of the operations of the information processing device 50, or as part of the main control unit that controls the overall operation of the information processing device 50.

[0114] For the storage unit 55, for example, an HDD, SSD, flash memory, etc., can be used. The guidance program 15A according to this embodiment is stored in the storage unit 55. This guidance program 15A may also be stored in the ROM 52.

[0115] The display unit 56 may be, for example, a liquid crystal display (LCD), an organic EL display, or the like. The display unit 56 may also have an integrated touch panel. The operation unit 57 is equipped with, for example, a keyboard, a mouse, or other device for operation input. The display unit 56 and the operation unit 57 receive various instructions from the user of the information processing device 50. The display unit 56 displays various information such as the results of processing performed in response to instructions received from the user, and notifications regarding processing.

[0116] The communication unit 58 is connected to a network N such as the Internet, LAN, or WAN, and is capable of communicating with the imaging device 10A via the network N.

[0117] In this embodiment, the guidance program 15A is stored in the information processing device 50, not in the imaging device 10A. In this case, the imaging device 10A transmits the captured image of the field of view of the microscope 30 to the information processing device 50.

[0118] The CPU 51 of the information processing device 50 according to this embodiment functions as the respective units shown in Figure 3 above by writing the guidance program 15A stored in the storage unit 55 or ROM 52 to the RAM 53 and executing it. In other words, the CPU 51 of the information processing device 50 functions as the image acquisition unit 11A, the identification unit 11B, the centroid coordinate acquisition unit 11C, the guidance information creation unit 11D, and the output unit 11E. The image acquisition unit 11A according to this embodiment acquires the captured image of the field of view of the microscope 30 transmitted from the imaging device 10A, and the output unit 11E outputs the guidance information to the imaging device 10A. The identification unit 11B, the centroid coordinate acquisition unit 11C, and the guidance information creation unit 11D are as described in Figure 3 above, so repeated explanations are omitted. However, the reference coordinates P1(Xs, Ys) corresponding to the correct position are transmitted in advance from the imaging device 10A to the information processing device 50 and are held by the information processing device 50.

[0119] Thus, according to this embodiment, it is not necessary to have a guidance program in each imaging device, and guidance information can be obtained from an information processing device via a network.

[0120] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).

[0121] Furthermore, the processor operations in each of the above embodiments may not be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together. Also, the order of the processor operations is not limited to the order described in each of the above embodiments, but may be changed as appropriate.

[0122] The imaging device, microscope device, and information processing device according to the embodiments have been described above. The embodiments may take the form of a computer-readable non-temporary storage medium that stores a guidance program for causing the computer to execute the functions of each part of the imaging device or information processing device.

[0123] Furthermore, the configurations of the imaging device, microscope device, and information processing device described in the above embodiments are merely examples and may be modified as needed without departing from the main purpose.

[0124] Furthermore, the program processing flow described in the above embodiment is just one example, and unnecessary steps may be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0125] Furthermore, although the above embodiment describes a case in which the process according to the embodiment is realized by a software configuration using a computer by executing a program, the embodiment is not limited to this. The embodiment may also be realized by a hardware configuration or a combination of a hardware configuration and a software configuration.

[0126] The following is further disclosed regarding the embodiments described above.

[0127] The guidance program according to the first embodiment is a guidance program that guides a camera, which is held in a holder that holds a camera that images the field of view of a microscope through the eyepiece of the microscope, to an appropriate holding position with respect to the optical axis of the eyepiece, and causes a computer to function as an image acquisition unit that acquires an image of the field of view captured by the camera held in the holder from the camera, an identification unit that identifies a field of view region in the image that corresponds to the field of view, a centroid coordinate acquisition unit that determines the centroid coordinate of the field of view region, a guidance information creation unit that creates guidance information to the holding position based on a comparison of the centroid coordinate with a reference coordinate corresponding to the centroid of the field of view region obtained from an image captured by the camera held in the holding position, and an output unit that outputs the guidance information.

[0128] The guidance program according to the second embodiment is the guidance program according to the first embodiment, wherein the holding position is the holding position of the camera in which the optical axis of the eyepiece and the optical axis of the camera align.

[0129] The guidance program according to the third embodiment is a guidance program according to the first embodiment in which the guidance information creation unit creates the guidance information when the distance between the centroid coordinates and the reference coordinates is outside a predetermined range, and does not create the guidance information when the distance between the centroid coordinates and the reference coordinates is within the predetermined range.

[0130] The guidance program according to the fourth embodiment is a guidance program according to any one of the first to third embodiments, wherein the centroid coordinates and the reference coordinates are each represented by a first coordinate and a second coordinate representing a two-dimensional position on the image, and the guidance information creation unit creates the guidance information if at least one of a first value representing the absolute value of the difference between the first coordinate of the centroid coordinates and the first coordinate of the reference coordinates, and a second value representing the absolute value of the difference between the second coordinate of the centroid coordinates and the second coordinate of the reference coordinates is outside a predetermined range, and does not create the guidance information if both the first value and the second value are within the predetermined range.

[0131] The guidance program according to the fifth embodiment is a guidance program according to any one of the first to third embodiments, wherein the centroid coordinates and the reference coordinates are each represented by a first coordinate and a second coordinate representing a two-dimensional position on the image, and the guidance information creation unit creates guidance information for separately adjusting the camera position corresponding to the first value and the camera position corresponding to the second value when both a first value representing the absolute value of the difference between the first coordinate of the centroid coordinates and the first coordinate of the reference coordinates, and a second value representing the absolute value of the difference between the second coordinate of the centroid coordinates and the second coordinate of the reference coordinates are outside a predetermined range.

[0132] The guidance program according to the sixth embodiment is a guidance program according to any one of the first to third embodiments, wherein the centroid coordinates and the reference coordinates are each represented by a first coordinate and a second coordinate representing a two-dimensional position on the image, and the guidance information creation unit creates guidance information for simultaneously adjusting the camera position corresponding to the first value and the camera position corresponding to the second value when both a first value representing the absolute value of the difference between the first coordinate of the centroid coordinates and the first coordinate of the reference coordinates, and a second value representing the absolute value of the difference between the second coordinate of the centroid coordinates and the second coordinate of the reference coordinates are outside a predetermined range.

[0133] The guidance program according to the seventh embodiment is a guidance program according to any one of the first to third embodiments, wherein the centroid coordinates and the reference coordinates are each represented by a first coordinate and a second coordinate representing a two-dimensional position on the image, the guidance information is represented as a figure representing the direction in which the camera is guided, and the guidance information creation unit changes the length of the figure according to the first value or the second value if at least one of the first value representing the absolute value of the difference between the first coordinate of the centroid coordinates and the first coordinate of the reference coordinates, and the second value representing the absolute value of the difference between the second coordinate of the centroid coordinates and the second coordinate of the reference coordinates is outside a predetermined range.

[0134] The guidance program according to the eighth embodiment is a guidance program according to any one of the first to seventh embodiments, wherein the output unit outputs to the display unit the direction in which to guide the camera, along with the image acquired by the image acquisition unit, as guidance information.

[0135] In the guidance program according to the ninth embodiment, the guidance direction is represented by at least one of characters and a graphic in the guidance program according to the eighth embodiment.

[0136] The guidance program according to the 10th embodiment is a guidance program according to any one of the 1st to 7th embodiments, wherein the output unit outputs the guidance information to the motor that adjusts the position of the camera.

[0137] The guidance method according to the 11th embodiment is a guidance method for guiding a camera, which is held in a holder that holds a camera that images the field of view of a microscope through the eyepiece of the microscope, to an appropriate holding position with respect to the optical axis of the eyepiece, wherein the camera held in the holder captures an image of the field of view from the camera, the field of view region corresponding to the field of view is identified in the image, the centroid coordinates of the field of view region are determined, guidance information to the holding position is created based on a comparison of the centroid coordinates with reference coordinates corresponding to the centroid of the field of view region obtained from the image captured by the camera held in the holding position, and the guidance information is output.

[0138] The imaging device according to the 12th embodiment comprises a camera that images the field of view of the microscope through the eyepiece of the microscope, and a guidance program according to any one of the 1st to 10th embodiments that guides the camera to an appropriate holding position with respect to the optical axis of the eyepiece.

[0139] The information processing device according to the 13th embodiment is an information processing device accessible by an imaging device equipped with a camera that images the field of view of a microscope through the eyepiece of the microscope, and includes a guidance program according to any one of the 1st to 10th embodiments that guides the camera to a proper holding position with respect to the optical axis of the eyepiece.

[0140] In the 14th embodiment, the microscope apparatus includes a microscope, a camera that images the field of view of the microscope through the eyepiece of the microscope, and a holder that detachably holds an imaging device equipped with a guidance program described in any one of the 1st to 10th embodiments, which guides the camera to a proper holding position with respect to the optical axis of the eyepiece. [Explanation of Symbols]

[0141] 10 Imaging device 11.51 CPU 11A Image acquisition section 11B Specific part 11C Center of gravity coordinate acquisition part 11D Information Creation Department 11E Output Section 12, 52 ROM 13.53 RAM 14, 54 I / O 15, 55 Storage section 15A Guidance Program 16, 56 display section 17, 57 Operation section 18, 58 Communications Department 19 Cameras 19A Camera Lens 20 Holder 30 Microscopes 36A Eyepiece 40A, 40B motors 50 Information Processing Devices 100, 100A Microscope Apparatus

Claims

1. A guidance program for guiding a camera, which is held in a holder that holds a camera that images the field of view of a microscope through the eyepiece of the microscope, to an appropriate holding position with respect to the optical axis of the eyepiece, Computers, An image acquisition unit that acquires an image from the camera, which is held in the holder, capturing the field of view. A specific part in the aforementioned image that identifies a field of view region corresponding to the field of view, A centroid coordinate acquisition unit that determines the centroid coordinate of the aforementioned field of view area. A guidance information generation unit creates guidance information to the appropriate holding position based on a comparison between the centroid coordinates and a pre-determined reference coordinate, which corresponds to the centroid of the field of view obtained from an image captured by the camera while the camera is held in the appropriate holding position, and Output unit that outputs the aforementioned guidance information, To make it function as Guide program.

2. The appropriate holding position is the holding position of the camera in which the optical axis of the eyepiece aligns with the optical axis of the camera. The guidance program according to claim 1.

3. The guidance information generation unit generates the guidance information if the distance between the centroid coordinates and the reference coordinates is outside a predetermined range. If the distance between the centroid coordinates and the reference coordinates is within the predetermined range, the guidance information is not created. The guidance program described in claim 1.

4. Each of the centroid coordinates and the reference coordinates is represented by a first coordinate and a second coordinate, which represent a two-dimensional position on the image. The guidance information generation unit generates the guidance information if at least one of the first value representing the absolute value of the difference between the first coordinate of the centroid coordinate and the first coordinate of the reference coordinate, and the second value representing the absolute value of the difference between the second coordinate of the centroid coordinate and the second coordinate of the reference coordinate is outside a predetermined range. If both the first and second values ​​are within the predetermined range, the guidance information will not be created. The guidance program described in claim 1.

5. Each of the centroid coordinates and the reference coordinates is represented by a first coordinate and a second coordinate, which represent a two-dimensional position on the image. The guidance information generation unit generates guidance information for separately adjusting the camera position corresponding to the first value and the camera position corresponding to the second value if both the first value, which represents the absolute value of the difference between the first coordinate of the centroid coordinate and the first coordinate of the reference coordinate, and the second value, which represents the absolute value of the difference between the second coordinate of the centroid coordinate and the second coordinate of the reference coordinate, are outside a predetermined range. The guidance program described in claim 1.

6. Each of the centroid coordinates and the reference coordinates is represented by a first coordinate and a second coordinate, which represent a two-dimensional position on the image. The guidance information generation unit generates guidance information for simultaneously adjusting the camera position corresponding to the first value and the camera position corresponding to the second value if both the first value, which represents the absolute value of the difference between the first coordinate of the centroid coordinate and the first coordinate of the reference coordinate, and the second value, which represents the absolute value of the difference between the second coordinate of the centroid coordinate and the second coordinate of the reference coordinate, are outside a predetermined range. The guidance program described in claim 1.

7. Each of the centroid coordinates and the reference coordinates is represented by a first coordinate and a second coordinate, which represent a two-dimensional position on the image. The aforementioned guidance information is represented as a graphic indicating the direction in which the camera should be guided. The guidance information generation unit changes the length of the figure according to the first value or the second value if at least one of the first value representing the absolute difference between the first coordinate of the centroid coordinate and the first coordinate of the reference coordinate, and the second value representing the absolute difference between the second coordinate of the centroid coordinate and the second coordinate of the reference coordinate is outside a predetermined range. The guidance program described in claim 1.

8. The output unit outputs the direction to guide the camera to the display unit as guidance information, along with the image acquired by the image acquisition unit. The guidance program described in claim 1.

9. The aforementioned directions are indicated by at least one of letters and / or figures. The guidance program according to claim 8.

10. The output unit outputs the guidance information to the motor that adjusts the position of the camera. The guidance program described in claim 1.

11. A guiding method for guiding a camera, which is held in a holder that holds a camera for imaging the field of view of a microscope through the eyepiece of the microscope, to a proper holding position with respect to the optical axis of the eyepiece, The camera held in the holder acquires an image of the field of view from the camera. Identify the field of view region in the aforementioned image that corresponds to the field of view, The centroid coordinates of the aforementioned field of view region are determined. Based on a comparison between the centroid coordinates and a pre-determined reference coordinate, which corresponds to the centroid of the field of view area obtained from an image captured by the camera while the camera is held in the appropriate holding position, guidance information to the appropriate holding position is created. Outputting the aforementioned guidance information, Instructions for giving directions.

12. A camera that images the field of view of the microscope through the eyepiece of the microscope, A guidance program according to any one of claims 1 to 10, which guides the camera to a proper holding position with respect to the optical axis of the eyepiece, An imaging device equipped with [a specific feature].

13. An information processing device accessible by an imaging device equipped with a camera that images the field of view of the microscope through the eyepiece of the microscope, A guidance program according to any one of claims 1 to 10, which guides the camera to a proper holding position with respect to the optical axis of the eyepiece. Information processing device including

14. A microscope and, A camera that images the field of view of the microscope through the eyepiece of the microscope, and a holder that detachably holds an imaging device equipped with a guidance program according to any one of claims 1 to 10 that guides the camera to a proper holding position with respect to the optical axis of the eyepiece, A microscope device including a microscope.

Images