Imaging device, imaging condition setting method, and program

Abstract

To perform photographing in a proper exposure state, while reducing power consumption.SOLUTION: An imaging control device 100 includes an imaging control part 111 for allowing an imaging apparatus 200 to image an insertion part inserted into a hole part communicating with an object together with the object in such a state that the illumination of a light-emitting part 230 is controlled, and a setting part 112 for setting at least one of an imaging state by the imaging apparatus 200 and a light quantity by the light-emitting part 230 to be different between when the insertion part is a first insertion part and when the insertion part is a second insertion part different from the first insertion part in light reflectance on the basis of the image data of an image representing the insertion part imaged according to the control of the imaging apparatus 200 by the imaging control part 111, without illuminating by the light-emitting part 230. The imaging control part 111 controls, on the basis of at least one of the imaging state and the light quantity set by the setting part 112, the imaging apparatus 200 and the light-emitting part 230 corresponding to at least one of the imaging state and the light quantity, to acquire the recording image data of the object.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] This invention is Imaging device and imaging condition setting method and programs. [Background technology]

[0002] Devices that emit flashes of light when taking photographs have been used for some time. For example, a flash control device disclosed in Patent Document 1 emits a pre-flash before the strobe actually emits light to take a photograph, measures the light reflected from the subject at the pre-flash, and controls the light output of the strobe based on the photometric results. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 4858591 Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 for , pre-flash before the actual flash has been disclosed.

[0005] The present invention , suitable With the right exposure Imaging can be Imaging device and imaging condition setting method The purpose is to provide programs and [Means for solving the problem]

[0006] In order to achieve the above object, an imaging device according to the present invention is an imaging device that acquires image data for recording by capturing an image with a predetermined light-emitting unit emitting light, and when capturing an image of the depth of a hole in a living body from outside the hole with a predetermined instrument placed against the inner wall of the hole, the imaging device includes a control means that executes preliminary imaging for determining the type of the instrument in order to set imaging conditions for acquiring the image data for recording, the preliminary imaging being performed with the predetermined light-emitting unit not emitting light, and when determining the type of the instrument, the control means determines the type of the instrument based on a comparison of the brightness of the skin surface around the hole in the image data acquired in the preliminary imaging with the brightness of the portion of the instrument protruding out of the hole. and when acquiring the image data for recording, setting imaging conditions corresponding to the type of the instrument. It is characterized by: [Effects of the Invention]

[0007] According to the present invention , suitable With the right exposure Imaging It is possible. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the functional configuration of an imaging device according to a first embodiment. [Figure 2] 1A and 1B are diagrams illustrating an example of the appearance of a colposcope according to the first embodiment and a positional relationship between the colposcope and an imaging device during imaging. [Figure 3] FIG. 10 is a diagram illustrating an image captured from the entrance side of the colposcope. [Figure 4] 4 is a flowchart of an imaging control process according to the first embodiment. [Figure 5] 10 is a flowchart of an imaging control process according to the second embodiment. [Figure 6] 10 is a flowchart of an imaging control process according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals.

[0010] (First embodiment) The imaging device 200 according to the first embodiment is a device that captures an image of, for example, the cervix located deep inside the human vagina as an object to be imaged, and is a so-called colposcopy camera. As shown in FIG. 1, the imaging device 200 includes a lens 210, an imaging unit 220, a light emitting unit 230, an operation unit 240, a display unit 250, and an imaging control device 100. The imaging device 200 captures an image of the cervix with a light intensity and imaging state set by the imaging control device 100. Here, the light intensity is a value indicating the intensity of light emitted by the light emitting unit 230. The imaging state also includes parameters related to the exposure of the imaging device 200 (such as ISO sensitivity, aperture value (F-number), exposure time (shutter speed), and other values; hereinafter referred to as "exposure parameters").

[0011] The lens 210 focuses light from the subject to be photographed, such as the cervix, onto the imaging element included in the imaging unit 220. The lens 210 has a function of adjusting the focal length and the amount of extension of the lens so that the light from the subject to be photographed is focused on the imaging element.

[0012] The imaging unit 220 includes an imaging element such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. This imaging element captures an image by receiving light reflected from a subject that has passed through the lens 210 and converting the light into an electrical signal.

[0013] The light-emitting unit 230 includes a light-emitting element such as an LED (Light Emitting Diode) and illuminates the subject to be photographed. The light-emitting unit 230 functions as a lighting device. The light-emitting unit 230 is provided near the lens 210, for example, as shown in FIG. 2. FIG. 2 shows an example in which the imaging device 200 includes one light-emitting unit 230 above the lens 210, but the imaging device 200 may include multiple light-emitting units 230. In this case, the imaging device 200 may include multiple light-emitting units 230 in a ring shape around the lens 210.

[0014] The operation unit 240 is a user interface such as a push button switch, and receives operation input from the user. The imaging device 200 includes, as the operation unit 240, for example, a shooting button.

[0015] The display unit 250 includes a display device such as a liquid crystal display, and displays a user interface for various operations and captured images.

[0016] As shown in FIG. 1, the imaging control device 100 includes a control unit 110 and a storage unit 120.

[0017] The control unit 110 is configured with a CPU (Central Processing Unit) and the like, and controls the imaging control device 100 and the imaging device 200 by executing a program stored in the storage unit 120 .

[0018] The storage unit 120 includes a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and stores programs executed by the CPU of the control unit 110, necessary data, and the like.

[0019] The control unit 110 executes a program stored in the storage unit 120 to function as the imaging control unit 111, the setting unit 112, and the recording unit 113 shown in FIG.

[0020] The imaging control unit 111 causes the imaging device 200 to capture an image of an insertion unit (for example, a colposcope described later) inserted into a hole (for example, a vagina) connected to the imaging target (for example, the cervix) together with the imaging target while controlling the illumination of the light-emitting unit 230. For example, the imaging control unit 111 sets the amount of light emitted by the light-emitting unit 230 and the imaging state (exposure parameters) during imaging by the imaging unit 220 of the imaging device 200 to the setting values ​​set by the setting unit 112, and controls the imaging unit 220 to capture an image of the imaging target. Then, based on at least one of the imaging state of the imaging device 200 and the amount of light emitted by the light-emitting unit 230 set by the setting unit 112, the imaging control unit 111 controls the imaging device 200 and the light-emitting unit 230 corresponding to at least one of the imaging state and the light-emitting unit 230, thereby acquiring image data for recording of the imaging target captured by the imaging unit 220. The imaging control unit 111 functions as a control unit.

[0021] The setting unit 112 sets the amount of light illuminated by the light-emitting unit 230 and the imaging state (exposure parameters) when imaging is performed by the imaging unit 220. More specifically, based on image data of an image representing a colposcope captured without illumination by the light-emitting unit 230 in accordance with control of the imaging device 200 by the imaging control unit 111, the setting unit 112 sets at least one of the imaging state by the imaging device 200 and the amount of light by the light-emitting unit 230 so that the imaging state is different when the colposcope is a first insertion unit (to be described later) and the amount of light illuminated by the light-emitting unit 230 when the colposcope is a second insertion unit (to be described later) having a light reflectance different from that of the first insertion unit. The setting unit 112 functions as a setting means.

[0022] The recording unit 113 records the image data acquired by the imaging control unit 111 in the storage unit 120 as an image file.

[0023] When photographing the cervix with the imaging device 200, the colposcope 300 shown in FIG. 2 is inserted into the vagina connected to the cervix from the tip side (side A shown in FIG. 2), and the cervix is ​​photographed through the colposcope 300 from the entrance side (side B shown in FIG. 2). The colposcope 300 is divided into an upper part 301 and a lower part 302, and the tip side can be opened and closed using a main part 303 as a fulcrum. The user can observe and photograph the cervix deep inside the vagina from the entrance side of the colposcope 300 through the space between the upper part 301 and the lower part 302. The colposcope 300 is also called an insertion part because it is inserted into the vagina.

[0024] The illumination conditions inside the vagina when photographing changes depending on the material (steel, plastic, etc.) and surface finish (silver plating, black coating, translucency, etc.) of the colposcope 300. In this embodiment, it is assumed that one of two types of colposcopes 300 is used: a Cusco-style colposcope made of steel with a silver-plated surface (hereinafter referred to as a "silver-plated colposcope" or "first insertion part"), or a Cusco-style colposcope made of steel with a black-coated surface (hereinafter referred to as a "black-coated colposcope" or "second insertion part").

[0025] When a black-coated colposcope is used as the colposcope 300, light reflection from the colposcope 300 is minimized, resulting in a relatively stable illumination state inside the vagina. Therefore, when a black-coated colposcope is used, the light intensity and exposure parameters can be fixed to appropriate values ​​to capture good images. On the other hand, when a silver-plated colposcope is used as the colposcope 300, light is reflected from the colposcope 300, so capturing an image with the appropriate light intensity and exposure parameters using a black-coated colposcope is likely to result in overexposure. Therefore, assuming that the exposure parameters are fixed to optimal values ​​for capturing an image, when a silver-plated colposcope is used, it becomes necessary to reduce the amount of light emitted from the light-emitting unit 230 compared to when a black-coated colposcope is used.

[0026] To perform this process, the type of colposcope 300 being used is determined, and the amount of light emitted from the light-emitting unit 230 is adjusted according to the determination result. Since the tip and entrance sides of the colposcope 300 are usually made of the same material and have the same surface treatment, it is possible to determine the type of colposcope 300 from the color, brightness, etc. of the part protruding from the vagina (entrance side) even when it is inserted into the vagina. Furthermore, the part protruding from the vagina can usually be photographed without any problems (for example, under indoor light or sunlight) without emitting light from the light-emitting unit 230.

[0027] Therefore, the imaging device 200 captures an image of the vicinity of the entrance of the colposcope 300 and its surroundings without emitting light from the light-emitting unit 230, determines the type of colposcope 300 based on the image data of the captured image, and then captures an image of the cervix with the light-emitting unit 230 emitting the optimum amount of light according to the type of colposcope 300. Note that this image data is image data of an image of the colposcope 300 (image data of an image representing the colposcope 300), but it may also be image data consisting of only a portion of an image including the colposcope, or image data of an image that shows part of the colposcope.

[0028] When the imaging device 200 photographs the cervix 401 through the colposcope 300 while the colposcope 300 is inserted into the vagina, as shown in Fig. 3, the skin 402 around the vagina is photographed around the colposcope 300, the part 403 near the entrance of the colposcope 300 protruding from the vagina is photographed as the part hatched with diagonal lines in Fig. 3, and the part of the colposcope 300 inserted into the vagina is photographed as the black part in Fig. 3. Note that the colposcope 300 is usually made entirely of the same material as shown in Fig. 2, but for convenience, the part of the colposcope 300 protruding from the vagina and the part inserted into the vagina are distinguished by hatching and blacking out in Fig. 3.

[0029] If light is not emitted from the light-emitting unit 230 during imaging, the part of the vaginal speculum 300 inserted into the vagina and the cervix 401 behind it are not illuminated, and so these parts are photographed as black areas. However, the area around the entrance 403 of the vaginal speculum 300 and the skin 402 around the vagina are photographed at a brightness that corresponds to the ambient lighting conditions at the imaging location.

[0030] In this embodiment, the optimal exposure parameters are set to ISO sensitivity 400, aperture fully open (minimum F-number), and exposure time (shutter speed) 1 / 100 second, and the light-emitting unit 230 emits an optimal amount of light under these exposure parameters. Here, the optimal amount of light when photographing the cervix 401 using a black-coated colposcope with the above-mentioned optimal exposure parameters is set to a light amount reference value (e.g., light amount 10). Then, with the same exposure parameters, if the colposcope 300 is changed to a silver-plated colposcope, the optimal light amount will be smaller than when a black-coated colposcope is used, as described above, and will therefore be a value (e.g., 8) obtained by multiplying the light amount reference value by a silver reference coefficient (e.g., 0.8).

[0031] Next, the imaging control process executed by the control unit 110 will be described with reference to Fig. 4. This process determines the type of colposcope 300 and captures an image of the cervix with the light-emitting unit 230 emitting the optimum amount of light for the colposcope 300 being used. The imaging control process starts when an instruction to start the imaging control process is received from the user via the operation unit 240. For example, the imaging control process starts when the user presses the capture button on the operation unit 240.

[0032] First, the imaging control unit 111 captures an image for determination using the imaging unit 220 without emitting light from the light emitting unit 230 (step S101). Then, the control unit 110 acquires an image for determination in which the area inside the colposcope 300 is black and the area near the entrance of the colposcope 300 and its surrounding area is captured with brightness according to the lighting conditions of the shooting location. This image for determination 400 is an image in which the area of ​​the cervix 401 in FIG. 3 is also captured as a black area, for example.

[0033] Next, the setting unit 112 determines whether the colposcope 300 is a silver-plated colposcope based on the image data of the determination image (step S102). This determination can be made by, for example, comparing the brightness of the vicinity 403 of the entrance of the colposcope 300 (for example, the average value of the brightness I of the pixels in that vicinity) with the brightness of the surrounding skin 402 (for example, the average value of the brightness I of the pixels in that vicinity) using the image data of the determination image 400 as shown in Fig. 3 obtained in step S101.

[0034] The luminance I is a value calculated by the following formula (1) when the pixel value is expressed as R (the magnitude of the red component), G (the magnitude of the green component), and B (the magnitude of the blue component). The R, G, and B pixel values ​​each range from 0 to 1, and the luminance I also ranges from 0 to 1. I=0.299×R+0.587×G+0.114×B…(1)

[0035] For example, if the average brightness of the pixels in the area near the entrance 403 is lower than the average brightness of the pixels in the surrounding skin 402, the setting unit 112 determines that the vaginal speculum 300 is not a silver-plated vaginal speculum, i.e., is a black-painted vaginal speculum. If the average brightness of the pixels in the area near the entrance 403 is equal to or higher than the average brightness of the pixels in the surrounding skin 402, the setting unit 112 determines that the vaginal speculum 300 is a silver-plated vaginal speculum.

[0036] Normally, the positional relationship between the colposcope 300 and the image capturing device 200 is almost constant when capturing an image of the cervix 401, so the focus can be set in advance based on this positional relationship so that the focus is on the cervix 401. Alternatively, for example, the focus may first be set on the vicinity 403 of the entrance of the colposcope 300, and then the focus may be adjusted to the cervix 401 by moving the focus position by the distance to the cervix 401 (this "distance from the vicinity 403 of the entrance of the colposcope 300 to the cervix 401" will be referred to as the "cervix focus adjustment distance" below for convenience). When the focus is set to be on the cervix 401, the area near the entrance 403 of the colposcope 300 in the image for determination 400 is captured out of focus, but it is possible to determine in advance where in the image for determination 400 the pixels of the area near the entrance 403 of the colposcope 300 are located, and where in the image for determination 400 the pixels of the area of ​​the skin 402 surrounding the colposcope 300 are located, because the positional relationship between the colposcope 300 and the imaging device 200 is approximately constant.

[0037] Furthermore, when capturing the image for determination 400, the imaging control device 100 may, for example, focus on the area near the entrance 403 of the colposcope 300 when the capture button is pressed halfway, and may focus on the cervix 401 by moving the focus position by the cervix focus adjustment distance when the capture button is pressed all the way. By focusing on the area near the entrance 403 of the colposcope 300, it is possible to determine by image recognition where in the image for determination 400 the area near the entrance 403 of the colposcope 300 is located and where in the image for determination 400 the skin 402 around the vagina is located, and based on this determination, pixel values ​​of the area near the entrance 403 of the colposcope 300 and the area of ​​the skin 402 around the vagina may be obtained.

[0038] Since the focus adjustment distance for the cervix may differ from person to person, this distance may be set in advance for each subject to be photographed. Furthermore, in addition to the standard focus adjustment distance for the cervix, photographs may be taken at multiple focus positions by moving the focus position (from the state where the focus is set on the vicinity 403 of the entrance of the colposcope 300) by a distance that is increased or decreased in increments of a reference distance (for example, 2 cm). From these, an image in which the cervix 401 is in focus may be automatically selected.

[0039] 4, if the colposcope 300 is not a silver-plated colposcope (step S102; No), it is determined to be a black-painted colposcope, and the setting unit 112 sets the optimum photographing conditions for a black-painted colposcope as the setting values ​​(step S103). For example, the exposure parameter setting values ​​are set to an ISO sensitivity of 400, an aperture setting of maximum aperture (minimum F-number), and an exposure time (shutter speed) of 1 / 100 seconds, and the light intensity setting value is set to a light intensity reference value (for example, 10).

[0040] On the other hand, if the colposcope 300 is a silver-plated colposcope (step S102; Yes), the setting unit 112 sets the optimum photographing conditions for the silver-plated colposcope as the setting values ​​(step S104). For example, the exposure parameter setting values ​​are set to an ISO sensitivity of 400, an aperture setting (minimum F-number), and an exposure time (shutter speed) of 1 / 100 seconds, and the light intensity setting value is set to the above-mentioned light intensity reference value multiplied by a silver reference coefficient (for example, 8).

[0041] Then, the imaging control unit 111 performs preparation for imaging by setting exposure parameters and light intensity according to the setting values ​​set by the setting unit 112 in step S103 or step S104 (step S105). Next, the imaging control unit 111 photographs the cervix with the exposure parameters and light intensity set in the preparation for imaging (step S106). Then, the recording unit 113 records image data of the image photographed and acquired by the imaging control unit 111 in the storage unit 120 as an image file for recording (step S107), and the imaging control process ends.

[0042] In the above-described imaging control process, the imaging state (exposure parameters) is fixed to an optimum value, and the light intensity is set to an optimum value according to the fixed imaging state and the colposcope 300. However, this is not limiting. For example, the light intensity may be fixed, and the imaging state (exposure parameters) may be set to an optimum value according to the fixed light intensity and the colposcope 300.

[0043] As described above, the imaging control process eliminates the need to emit light from the light-emitting unit 230 when capturing the assessment image 400, thereby reducing power consumption. Furthermore, the exposure parameters and light intensity are set according to the type of colposcope 300 being used, allowing the cervix to be captured under appropriate exposure conditions.

[0044] In the above embodiment, the two types of colposcope 300, a black-painted colposcope and a silver-plated colposcope, are described, but this is not limiting. Even if other types of colposcopes 300 are present, the same process can be used to determine the type of colposcope 300 based on the image data of the determination image 400, and the optimal imaging conditions and light intensity can be set for each type of colposcope 300.

[0045] Furthermore, the light intensity setting value for the silver-plated colposcope does not have to be determined by calculation as described above. For example, a table in which the optimum light intensity or optimum image capturing state (exposure parameter) values ​​for each type of colposcope 300 are defined may be stored in advance in the storage unit 120, and the optimum light intensity or image capturing state (exposure parameter) may be obtained by referring to this table.

[0046] (Variation 1) In the first embodiment described above, optimal exposure parameters and light intensity are set depending on the type of vaginal speculum 300, but because a silver-plated vaginal speculum reflects light in various ways compared to a black-coated vaginal speculum, it is possible that the optimal exposure parameters and light intensity may change depending on the time and situation. Therefore, in the imaging control device 100 according to the first modification, the processing content of step S103 of the imaging control process (FIG. 4) is changed to setting the exposure parameters and light intensity using an AE (Automatic Exposure) function.

[0047] When a black-painted colposcope is used, the imaging control device 100 according to Modification 1 can capture an image of the cervix under appropriate exposure conditions while reducing power consumption, as in Embodiment 1. Furthermore, when a colposcope 300 other than a black-painted colposcope is used, the AE function can capture an image of the cervix under appropriate exposure conditions.

[0048] (Variation 2) As described above, when a silver-plated colposcope is used, light is reflected in various ways. In order to suppress this light reflection, the imaging control device 100 according to the second modification inserts a polarizing filter in front of the lens 210 (between the subject to be photographed and the lens 210) when it is determined that the colposcope 300 is a silver-plated colposcope. Note that the position at which the polarizing filter is inserted is not limited to in front of the lens 210, and it may also be in front of the light-emitting unit 230.

[0049] That is, imaging device 200 according to Modification 2 includes a polarizing filter that can be positioned (inserted) on or retracted from a path (path of the optical system from light-emitting unit 230 to the imaging element) along which light from light-emitting unit 230 is reflected by the subject and the reflected light from the subject is introduced into the imaging element. Therefore, in Modification 2, imaging states include a state in which the polarizing filter is positioned on the path (first state) and a state in which the polarizing filter is retracted from the path (second state).

[0050] In the imaging control device 100 according to the second modification, the processing content of step S101 of the imaging control process (FIG. 4) is changed to "the imaging control unit 111 moves the polarizing filter away from the path of the optical system and causes the imaging unit 220 to capture an image for determination without causing the light emitting unit 230 to emit light", and the processing content of step S103 is changed to "the imaging control unit 111 inserts the polarizing filter into the path of the optical system, and the setting unit 112 sets the optimum imaging conditions for the silver-plated colposcope as setting values ​​taking into account the polarizing filter".

[0051] When a polarizing filter is inserted into the path of the optical system, the amount of light reaching the imaging element is significantly reduced, so in Modification 2, in step S103, the amount of light emitted by the light-emitting unit 230 is set slightly brighter (for example, 40%) than when a black-painted vaginal speculum is used. For example, the exposure parameter settings are set to ISO sensitivity of 400, aperture open (minimum F-number), and exposure time (shutter speed) of 1 / 100 seconds, and the light amount setting is set to a value (for example, 14) obtained by multiplying the light amount reference value by the polarizing filter coefficient (for example, 1.4).

[0052] The imaging control device 100 according to Modification 2 can capture images of the cervix under appropriate exposure conditions while reducing power consumption, as in the first embodiment. Furthermore, by inserting a polarizing filter into the optical path, it is possible to capture images of the cervix under relatively stable exposure conditions even when using a silver-plated colposcope.

[0053] (Variation 3) In colposcopy cameras, a green filter is often inserted to capture an image of the cervix. Imaging device 200 according to Modification 3 is equipped with a green filter, and when capturing an image of the cervix, imaging control device 100 inserts the green filter in front of lens 210 (between the subject to be captured and lens 210). However, the position at which the green filter is inserted is not limited to in front of lens 210, and it may be in front of light-emitting unit 230. That is, imaging device 200 according to Modification 3 is configured so that the green filter can be positioned (inserted) on or removed from the path (the path of the optical system from light-emitting unit 230 to the image sensor) along which light from light-emitting unit 230 is reflected by the subject and the reflected light from the subject is introduced into the image sensor.

[0054] However, it is not necessary to insert a green filter when capturing an image for determination to determine the type of the colposcope 300. Therefore, in the imaging control device 100 according to the third modification, the processing content of step S101 of the imaging control process (FIG. 4) is changed to "the imaging control unit 111 retracts the green filter from the path of the optical system, and captures an image for determination with the imaging unit 220 without causing the light emitting unit 230 to emit light."

[0055] Then, the imaging control unit 111 performs a process of inserting a green filter into the path of the optical system, and the process content of step S103 is changed to "The setting unit 112 sets the optimum imaging conditions for a silver-plated colposcope taking into consideration the insertion of the green filter as set values," and the process content of step S104 is changed to "The setting unit 112 sets the optimum imaging conditions for a black-painted colposcope taking into consideration the insertion of the green filter as set values." Note that, in the imaging control process according to Modification 3, the process of inserting the green filter into the path of the optical system may be performed at any timing between immediately after step S101 and immediately before step S106, but is usually performed in step S105.

[0056] As described above, in the imaging control device 100 of variant example 3, the green filter is moved away from the path of the optical system when capturing the determination image 400, so that image data that is not affected by the green filter can be used when determining the type of colposcope, thereby reducing the probability of misdetermining the type of colposcope.

[0057] (Variation 4) In the above-described embodiment and modified examples, the imaging device 200 has been described as capturing visible light, but the imaging target is not limited to visible light. For example, infrared light or ultraviolet light may be captured. In this case, the light-emitting unit 230 may emit infrared light or ultraviolet light. In the imaging device 200 according to modified example 4, the light-emitting unit 230 emits infrared light or ultraviolet light, and captures the infrared light or ultraviolet light.

[0058] As in the first embodiment and its modifications, the imaging control device 100 according to the fourth modification also adjusts the light intensity according to the type of colposcope 300. That is, when a black-painted colposcope is used, the light intensity is set to a light intensity reference value (e.g., 10), and when a silver-plated colposcope is used, the light intensity is set to a value obtained by multiplying the light intensity reference value by a silver reference coefficient (e.g., 8).

[0059] In the imaging control device 100 according to variant example 4, even when imaging is performed using infrared or ultraviolet light, the image for determination is captured without emitting light from the light-emitting unit 230, so that the type of the colposcope 300 can be determined using image data that is not affected by infrared or ultraviolet light, thereby reducing the probability of misjudging the type of the colposcope 300.

[0060] (Second embodiment) In the first embodiment described above, two types of vaginal speculum 300, a silver-plated vaginal speculum and a black-painted vaginal speculum, are used, but a second embodiment that can accommodate more types of vaginal speculum 300 will be described.

[0061] The configurations of the imaging control device 100 and the imaging device 200 according to the second embodiment are the same as those of the first embodiment, and therefore a description thereof will be omitted.

[0062] The imaging control process according to the second embodiment will be described with reference to Fig. 5. In this process, steps S102 to S104 of the imaging control process according to the first embodiment are replaced with step S111, so only step S111 will be described.

[0063] In step S111, the setting unit 112 obtains the light reflectance of the colposcope 300 based on the image data of the image for determination, and sets the photographing conditions based on the obtained reflectance. This reflectance is obtained based on the ratio of the brightness of the vicinity 403 of the entrance of the colposcope 300 (for example, the average value of the brightness I of the pixels in that vicinity) to the brightness of the surrounding skin 402 (for example, the average value of the brightness I of the pixels in that vicinity) using the image data of the image for determination 400 as shown in Fig. 3 obtained in step S101.

[0064] For example, if the average value of the brightness I of the pixels in the area near the entrance 403 of the vaginal speculum 300 is V and the average value of the brightness I of the pixels in the surrounding skin 402 is S, the reflectance R is calculated using the following equation (2): R=V / S …(2)

[0065] Then, for example, the setting unit 112 sets the exposure parameter setting values ​​to ISO sensitivity of 400, aperture fully open (minimum F-number), and exposure time (shutter speed) of 1 / 100 seconds, and for light intensity, sets the light intensity setting value to a value (e.g., 11.25) obtained by dividing the reference light intensity value (e.g., 10) by a correction coefficient (e.g., 2), dividing the result by the reflectance R (e.g., 0.8), and adding a correction addition value (e.g., 5). Note that if this calculation results in the light intensity setting value exceeding the upper light intensity limit value (e.g., 20), the light intensity setting value may be reset to the upper light intensity limit value, and if the light intensity setting value is less than the lower light intensity limit value (e.g., 1), the light intensity setting value may be reset to the lower light intensity limit value.

[0066] The light intensity setting value does not have to be calculated using the above-mentioned formula. For example, a table in which optimal light intensity values ​​are determined according to various reflectances may be stored in advance in the storage unit 120, and the light intensity may be obtained from the reflectance by referring to this table.

[0067] The processes other than step S111 are the same as those in the first embodiment, and therefore will not be described further. In the second embodiment described above, as in the first embodiment, it is possible to capture an image of the cervix under appropriate exposure conditions while reducing power consumption. Furthermore, since the optimal light intensity can be set based on the reflectance of the colposcope 300, any colposcope 300 can be used, not just black-painted or silver-plated colposcopes.

[0068] (Third embodiment) In the above-described embodiments and modifications, the light intensity is set by determining the type of colposcope 300 and calculating the reflectance. However, various setting values ​​may be obtained by, for example, machine learning, without determining the type of colposcope 300 or calculating the reflectance. Here, a third embodiment will be described in which at least one of the imaging state (exposure parameters) and the light intensity is set using a neural network.

[0069] The configurations of the imaging control device 100 and the imaging device 200 according to the third embodiment are the same as those of the first embodiment, and therefore description thereof will be omitted. However, the setting unit 112 according to the third embodiment includes a CNN (Convolutional Neural Network). Also, it is assumed that a large amount of learning data (pairs of image data of an image for determination and optimal light intensity setting values) is prepared, in which optimal light intensity setting values ​​when exposure parameters are fixed (for example, ISO sensitivity of 400, aperture open (minimum F-number), and exposure time (shutter speed) of 1 / 100 seconds) are assigned as correct labels for each piece of image data of an image for determination.

[0070] The CNN provided in the setting unit 112 is trained in advance using the above-mentioned learning data so that when image data of a determination image capturing the vicinity of the entrance of the colposcope 300 and its surroundings as shown in FIG. 3 is input, the CNN will output an optimal light intensity setting value.

[0071] The imaging control process according to the third embodiment will be described with reference to Fig. 6. In this process, steps S102 to S104 of the imaging control process according to the first embodiment are replaced with step S121, so only step S121 will be described.

[0072] In step S121, the setting unit 112 inputs the image data of the determination image into the trained CNN to obtain an optimal light intensity setting value as the output of the CNN. Then, for example, the setting unit 112 sets the exposure parameter setting values ​​to an ISO sensitivity of 400, an aperture setting of open (minimum F-number), and an exposure time (shutter speed) of 1 / 100 seconds, and sets the light intensity setting value to the value output from the CNN.

[0073] The processes other than step S121 are the same as those in the first embodiment, and therefore will not be described further. In the third embodiment described above, as in the first embodiment, it is possible to capture an image of the cervix under appropriate exposure conditions while reducing power consumption. Furthermore, since the optimal light intensity can be set using CNN, there is no need to determine the type of colposcope 300, and any colposcope 300 can be used.

[0074] In the above explanation, the CNN is described as outputting the optimal light intensity setting value, but this is merely one example of how to use the CNN. For example, for each piece of image data of a judgment image, a large amount of training data is prepared in which the optimal exposure parameter setting values ​​(ISO sensitivity, aperture (F-number), exposure time (shutter speed)) are assigned as correct answer labels when the light intensity is fixed to a reference light intensity value (for example, 10), and the CNN can be trained using this training data so that when image data of a judgment image is input, the optimal exposure parameter setting values ​​are output.

[0075] By using the CNN trained in this way, it is possible to photograph the cervix 401 with optimal exposure parameters while keeping the light intensity of the light-emitting unit 230 fixed at the reference light intensity value.

[0076] Alternatively, neither the exposure parameters nor the light intensity may be fixed. For example, a large amount of learning data may be prepared in which optimal exposure parameter setting values ​​(ISO sensitivity, aperture (F-number), exposure time (shutter speed)) and optimal light intensity setting values ​​are assigned as correct answer labels for each piece of image data of the determination image 400, and the CNN may be trained using this learning data so that when image data of the determination image 400 is input, optimal exposure parameter setting values ​​and light intensity setting values ​​are output.

[0077] By using a CNN trained in this way, the cervix 401 can be photographed with the optimal exposure parameters and light intensity output from the CNN based on the image data of the determination image 400, without fixing the exposure parameters or the light intensity of the light-emitting unit 230.

[0078] (Other variations) It should be noted that the present invention is not limited to the above-described embodiments and modifications, and various modifications are possible. For example, each of the second and third embodiments can be combined with each of modifications 2 to 4. Furthermore, it is also possible to combine modifications (e.g., modifications 2 and 3) with each other. For example, the second embodiment and modification 2 can be combined, and when the reflectance R exceeds a reference reflectance (e.g., 1.5), a polarizing filter can be inserted into the path of the optical system, and the light intensity setting value can be set to a value that is multiplied by the polarizing filter coefficient (e.g., 1.4) compared to when the polarizing filter is not inserted.

[0079] Furthermore, the third embodiment and the second modification may be combined, and a CNN trained on the correct answer label of the training data may be used, and the setting unit 112 may set the exposure parameters, light intensity, and the presence or absence of a polarizing filter at the time of shooting based on the various setting values ​​output by the CNN and the presence or absence of a polarizing filter.

[0080] Furthermore, in the above-described embodiment and modified examples, the imaging device 200 for photographing the human cervix has been described as an example, but the subject photographed by the imaging device 200 is not limited to the human cervix, and may also be the cervix of an animal other than a human (e.g., a dog, cat, cow, pig, horse, etc.).

[0081] Furthermore, the subject of imaging by the imaging device 200 is not limited to the cervix, but any subject that can be imaged by inserting an insertion part such as the vaginal speculum 300, such as the mouth, nostrils (entrances of the nasal cavity), ear holes (entrances of the external auditory canal), anus, etc., can be imaged by the imaging device 200. The imaging device 200 can also be used to image inside pipes or gaps that people cannot enter in factories or work sites, and inside holes in nature (animal burrows, tree hollows, cracks and holes in the ground or cliffs).

[0082] That is, the imaging device 200 can generally be used to capture an image of an insertion part (vaginoscope, laryngoscope, nasal speculum, otoscope, anoscope, sewer pipe speculum, etc.) inserted into a hole (vagina, oral cavity, nostrils (entrances of nasal cavities), ear holes (entrances of external auditory canals), anus, piping such as sewer pipes, etc.) connected to an object (cervix, throat, wall of nasal cavity (superior turbinate, middle turbinate, inferior turbinate), wall of the external auditory canal or tympanic membrane, rectum, wall of a sewer pipe, wall of a cavity, etc.) together with the object without illuminating it with the light-emitting part 230 to obtain an image for determination 400, set at least one of the imaging condition and the light amount based on the image data of the image for determination 400, and photograph an object present deep inside the hole based on that setting.

[0083] Furthermore, in the above embodiment, the imaging device 200 has been described as having the imaging control device 100 built in, but the imaging control device 100 may be a device separate from the imaging device 200. In this case, both the imaging control device 100 and the imaging device 200 have a communication unit, and the imaging control device 100 is configured to be able to control the imaging device 200 via the communication unit.

[0084] Note that each function of the imaging control device 100 can also be implemented by a computer such as an ordinary PC. Specifically, in the above embodiment, the program for the illumination control process performed by the imaging control device 100 has been described as being pre-stored in the ROM of the storage unit 120. However, the program may be stored and distributed on a computer-readable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), a DVD (Digital Versatile Disc), an MO (Magneto-Optical disc), a memory card, or a USB (Universal Serial Bus) memory, and the program may be read and installed on a computer to configure a computer that can realize each of the above-described functions.

[0085] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these specific embodiments, and the present invention includes the inventions described in the claims and their equivalents. The inventions described in the original claims of this application are appended below.

[0086] (Appendix 1) a control means for controlling the imaging device to capture an image of the insertion portion inserted into a hole connected to the target together with the target while controlling the illumination of the illumination device; and a setting means for setting at least one of an imaging state by the imaging device and an amount of light by the lighting device so as to be different when the insertion section is a first insertion section and when the insertion section is a second insertion section having a light reflectance different from that of the first insertion section, based on image data of an image representing the insertion section captured without illumination by the lighting device in accordance with control of the imaging device by the control means, the control means acquires image data for recording of the object by controlling the imaging device and the lighting device corresponding to at least one of the imaging state and the light amount of the lighting device set by the setting means. Imaging control device.

[0087] (Appendix 2) The setting means determining whether the insertion section is the first or second insertion section based on image data of an image representing the insertion section captured without illumination by the illumination device in accordance with control of the imaging device by the control means; Based on a determination result as to whether the insertion section is the first or second insertion section, at least one of an imaging state by the imaging device and an amount of light by the lighting device is set to be different between a case where the insertion section is the first insertion section and a case where the insertion section is the second insertion section having a light reflectance different from that of the first insertion section. 2. An imaging control device according to claim 1.

[0088] (Appendix 3) the setting means acquires a reflectance of light at the insertion portion based on image data of an image representing the insertion portion captured without illumination by the illumination device in accordance with control of the imaging device by the control means, and sets at least one of an imaging state by the imaging device and an amount of light by the illumination device based on the acquired reflectance. 2. An imaging control device according to claim 1.

[0089] (Appendix 4) the setting means inputs image data of an image representing the insertion portion captured without illumination by the illumination device in accordance with control of the imaging device by the control means into a neural network, and sets at least one of an imaging state of the imaging device and an amount of light by the illumination device based on a value output from the neural network. 2. An imaging control device according to claim 1.

[0090] (Appendix 5) the imaging state includes a parameter related to exposure of the imaging device; the setting means sets the exposure-related parameters to the same values ​​when the insertion unit is the first insertion unit and when the insertion unit is the second insertion unit, and sets the light amount of the lighting device to different values ​​when the insertion unit is the first insertion unit and when the insertion unit is the second insertion unit. 5. An imaging control device according to any one of appendices 1 to 4.

[0091] (Appendix 6) the imaging device includes an imaging element that receives reflected light from the object and converts the light into an electrical signal, and a polarizing filter that is positioned and retractable on a path along which light from the illumination device is reflected by the object and the reflected light from the object is introduced into the imaging element; the imaging state includes a first state in which the polarizing filter is positioned on the path and a second state in which the polarizing filter is retracted from the path; the setting means sets the state of the polarizing filter to the first state when the insertion unit is the first insertion unit, and to the second state when the insertion unit is the second insertion unit. 6. An imaging control device according to any one of appendices 1 to 5.

[0092] (Appendix 7) the imaging device includes an imaging element that receives reflected light from the object and converts the light into an electrical signal, and a green filter that is positioned and retractable on a path along which light from the illumination device is reflected by the object and the reflected light from the object is introduced into the imaging element; the control means causes the imaging device to capture an image of the insertion portion inserted into a hole connected to the target together with the target without illuminating the insertion portion with the illumination device, with the green filter retracted from the path; Then, with the green filter positioned on the path, the imaging device and the lighting device corresponding to at least one of the imaging state and the amount of light from the lighting device set by the setting means are controlled based on the at least one of the imaging state and the amount of light from the lighting device, thereby acquiring image data for recording of the object. 7. An imaging control device according to any one of appendices 1 to 6.

[0093] (Appendix 8) An imaging device having a lens that focuses light from an object onto an imaging element, a control means for controlling the imaging device to capture an image of the insertion portion inserted into a hole connected to the target together with the target while controlling illumination from an illumination device; and a setting means for setting at least one of an imaging state by the imaging device and an amount of light by the lighting device so as to be different when the insertion section is a first insertion section and when the insertion section is a second insertion section having a light reflectance different from that of the first insertion section, based on image data of an image representing the insertion section captured without illumination by the lighting device in accordance with control of the imaging device by the control means, the control means acquires image data for recording of the object by controlling the imaging device and the lighting device corresponding to at least one of the imaging state and the light amount of the lighting device set by the setting means. Imaging device.

[0094] (Appendix 9) an imaging device that captures an image of the insertion portion inserted into a hole that is connected to the target together with the target while controlling the illumination of the illumination device; based on image data of an image representing the insertion portion captured without illumination by the illumination device in accordance with the control, at least one of an imaging state by the imaging device and an amount of light by the illumination device is set to be different between a case where the insertion portion is a first insertion portion and a case where the insertion portion is a second insertion portion having a light reflectance different from that of the first insertion portion; acquiring image data for recording of the object by controlling the imaging device and the lighting device corresponding to at least one of the set imaging state and light amount based on the set imaging state and light amount; Imaging control method.

[0095] (Appendix 10) On the computer, an imaging device that captures an image of the insertion portion inserted into a hole that is connected to the target together with the target while controlling the illumination of the illumination device; based on image data of an image representing the insertion portion captured without illumination by the illumination device in accordance with the control, at least one of an imaging state by the imaging device and an amount of light by the illumination device is set to be different between a case where the insertion portion is a first insertion portion and a case where the insertion portion is a second insertion portion having a light reflectance different from that of the first insertion portion; and acquiring image data for recording of the object by controlling the imaging device and the lighting device corresponding to at least one of the set imaging state and light amount based on the set imaging state and light amount. program. [Explanation of symbols]

[0096] 100...imaging control device, 110...control unit, 111...imaging control unit, 112...setting unit, 113...recording unit, 120...storage unit, 200...imaging device, 210...lens, 220...imaging unit, 230...light emitting unit, 240...operation unit, 250...display unit, 300...vaginal speculum, 301...upper part, 302...lower part, 303...main part, 400...image for determination, 401...cervix, 402...surrounding skin, 403...near entrance, BL...bus line

Claims

1. An imaging device that acquires image data for recording by capturing an image with a predetermined light-emitting unit emitting light, a control means for executing preliminary imaging for determining the type of the instrument in order to set imaging conditions for acquiring the image data for recording when imaging the depth of a hole from outside the hole with a predetermined instrument placed on the inner wall of the hole in a living body, the preliminary imaging being performed without emitting light from the predetermined light-emitting unit; The control means When determining the type of the tool, the type of the tool is determined based on a comparison of the brightness of the skin surface around the hole in the image data acquired by the preliminary image capture with the brightness of the portion of the tool protruding out of the hole, When acquiring the image data for recording, imaging conditions corresponding to the type of the instrument are set. An imaging device characterized by:

2. the control means sets an exposure condition as the imaging condition.

2. The imaging device according to claim 1.

3. the control means sets the amount of light emitted from the predetermined light-emitting unit as the exposure condition.

3. The imaging device according to claim 2.

4. An imaging condition setting method executed by an imaging device that acquires image data for recording by photographing with a predetermined light-emitting unit emitting light, comprising: a control process for executing preliminary imaging for determining the type of the instrument in order to set imaging conditions for acquiring the image data for recording when imaging the depth of a hole from outside the hole with a predetermined instrument placed on the inner wall of the hole in a living body, the preliminary imaging being performed without emitting light from the predetermined light-emitting unit; The control process includes: When determining the type of the tool, the imaging conditions when acquiring the image data for recording are determined based on a comparison of the brightness of the skin surface around the hole in the image data acquired in the preliminary imaging with the brightness of the part of the tool protruding out of the hole, and When acquiring the image data for recording, imaging conditions corresponding to the type of the instrument are set. An imaging condition setting method comprising:

5. a computer of an imaging device that acquires image data for recording by photographing with a predetermined light emitting unit emitting light; when imaging the depth of a hole in a living body from outside the hole with a predetermined tool applied to the inner wall of the hole, the control unit functions as a control unit that executes preliminary imaging for determining the type of the tool in order to set imaging conditions for acquiring the image data for recording, the preliminary imaging being performed without emitting light from the predetermined light-emitting unit; The control means When determining the type of the tool, the imaging conditions when acquiring the image data for recording are determined based on a comparison of the brightness of the skin surface around the hole in the image data acquired in the preliminary imaging with the brightness of the part of the tool protruding out of the hole, and When acquiring the image data for recording, imaging conditions corresponding to the type of the instrument are set. A program characterized by:

Images