Algae detection result display system, algae detection result display method, and program

Abstract

To facilitate the comprehension of measurement results of various algae.SOLUTION: An algae detection result display system according to an embodiment comprises a display control section that concurrently presents, on a display, a captured image of algae-containing water, information indicating the regions of the image that contain the algae, and data indicating the type of the algae.SELECTED DRAWING: Figure 19

Description

[Technical field]

[0001] An embodiment of the present invention relates to an algae detection result display system, an algae detection result display method, and a program. [Background technology]

[0002] In order to determine the type and number of algae in water from rivers, swamps, lakes, and other locations, or in water purification plants, the target water is sampled, and then passed through or filled into a container. The various types of algae present in the water are then detected by observing them with a microscope or other device.

[0003] However, with conventional methods, it is not easy to detect signs of problems caused by specific types of algae (such as the generation of unpleasant odors or filter blockages) from the algae detection results, or to predict future trends in algae growth. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2016-095259 A Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide an algae detection result display system, an algae detection result display method, and a program that make it easier to understand the detection results of various types of algae. [Means for solving the problem]

[0006] The embodiment of the algae detection result display system includes a display control unit that simultaneously displays on a display unit an image obtained by photographing water containing algae, information indicating the area in the image in which the algae is captured, and information indicating the type of algae. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of an algae detection result display system according to an embodiment. [Diagram 2] FIG. 2 is a diagram showing an example of the functional configuration of each unit of the algae detection result display system shown in FIG. [Diagram 3] FIG. 3 is a diagram showing an example of the configuration of an imaging device provided in the data acquisition unit 11. As shown in FIG. [Figure 4] FIG. 4 is a diagram showing an example of a specific configuration of the imaging device 110. As shown in FIG. [Diagram 5] FIG. 5 is a diagram showing an example of the configuration of the container 112. As shown in FIG. [Figure 6] FIG. 6 is a schematic diagram showing the classification of algae. [Figure 7] FIG. 7 is a diagram showing the relationship between various algae and pigments. [Figure 8] FIG. 8 is a diagram showing the absorption spectra of various algae and the wavelength ranges in which the light absorption peaks (maximum absorption) of various pigments are present. [Figure 9] FIG. 9 is a diagram showing an example of information obtained from an imaging signal output by the imaging device 110. In FIG. [Figure 10] FIG. 10 shows examples of images showing various types of algae. [Figure 11] FIG. 11 is a diagram showing an example of a table displayed by table display control unit 31. As shown in FIG. [Figure 12] FIG. 12 is a diagram showing an example of a captured image (a captured image obtained by capturing an image of water containing algae) used in image processing. [Figure 13] FIG. 13 is a diagram showing an example of an image obtained by binarizing image G1 of FIG. [Figure 14] FIG. 14 is a diagram showing an example of an image in which the frame lines of the minimum rectangles circumscribing the white areas in the images G2 and G3 in FIGS. 13(a) and 13(b) are superimposed. [Figure 15] FIG. 15 is a diagram showing an example of an image obtained by expanding frame lines W1 and W2 of the minimum rectangles in images G4 and G5 in FIGS. 14(a) and 14(b). [Figure 16] FIG. 16 is a diagram showing an example of a new image G8 in which frame lines W1 and W2 in images G6 and G7 in FIGS. 15(a) and 15(b) are superimposed on image G1 in FIG. [Figure 17] FIG. 17 is a diagram showing an example in which curved frame lines are used. [Figure 18] FIG. 18 is a diagram showing, in comparison, an example of an image on which a rectangular frame line is superimposed and an example of an image on which a curved frame line is superimposed. [Figure 19] FIG. 19 is a diagram showing an example of a display in which types of algae are represented by different "border colors." [Figure 20] FIG. 20 is a diagram showing an example of a display in which the type of algae is represented by different "frame line types." [Figure 21] FIG. 21 is a diagram showing an example of a display in which items corresponding to algae (all algae) are displayed with a "frame line of a specific color." [Figure 22] FIG. 22 is a diagram showing an example of a display in which types of algae (classes) are represented by different "colors of frame lines," and types of algae genuses are represented by different "types of frame lines." [Figure 23] FIG. 23 is a diagram showing an example of display in which the type of algae (class) is represented by different "border colors" and the type of algae genus is shown by "characters." [Figure 24] FIG. 24 is a diagram showing a modification of the display of FIG. [Diagram 25] FIG. 25 is a diagram showing an example of a display in which types of algae are represented by different "decorative colors." [Figure 26] FIG. 26 is a diagram showing a first modified example of the display in FIG. 24 (an example in which a frame line of a different type from that in FIG. 24 is used). [Figure 27] FIG. 27 is a diagram showing a second modified example of the display in FIG. 24 (an example in which a frame line of a different type from that in FIG. 24 is used). [Figure 28] FIG. 28 is a diagram showing a third modified example of the display in FIG. 24 (an example in which information on measured quantities such as area and length for each algae is further displayed). [Figure 29] FIG. 29 is a diagram showing a fourth modified example of the display in FIG. 24 (an example in which information on the type of shape of each algae is further displayed). [Diagram 30] FIG. 30 is a diagram showing another example of the image shown in FIG. [Diagram 31] FIG. 31 is a diagram showing an example of a display in which a plurality of images taken at different dates and times are arranged so as to be compared. [Diagram 32] FIG. 32 shows an example of a display in which multiple images of different water sources are arranged for comparison. [Diagram 33] FIG. 33 is a flowchart showing an example of the operation of the algae detection result display system. [Diagram 34] FIG. 34 is a flowchart showing an example of an image processing operation for superimposing a frame line on a captured image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an embodiment will be described with reference to the drawings.

[0009] <System configuration> FIG. 1 shows an example of the configuration of an algae detection result display system according to an embodiment.

[0010] The algae detection result display system shown in Fig. 1 includes a database management unit M, a data collection unit 10, an algae measurement unit 20, a display control unit 30, and user operation units 60-1 and 60-2.

[0011] The user operation unit 60-1 corresponds to a computer (PC) used by the operator of this system.

[0012] The data collection unit 10 and the user operation unit 60-2 are placed in the management area or management office of a water purification plant or a site such as a river or a swamp lake. The data collection unit 10 is equipped with an imaging device. The user operation unit 60-2 corresponds to a computer (PC, tablet, smartphone, etc.) used by a worker at the site.

[0013] The algae measurement unit 20, the display control unit 30, and the database management unit M correspond to computers and storage on the cloud (on the Internet). The algae measurement unit 20, the display control unit 30, and the database management unit M are realized as programs executed by one or more computers (one or more processors).

[0014] The database management unit M includes a storage unit that stores various databases. Note that various databases may be stored collectively by one database management unit M, or multiple database management units M may store different databases separately for each type of database.

[0015] The data collection unit 10 collects image data (in this example, multispectral data) obtained by photographing water containing algae with an imaging device and identification information (in this example, customer information) associated with the data, and sends the collected multispectral data and customer information to the database management unit M. However, the image data of the algae may be any of monochrome image data, color image data, and spectral image data obtained by photographing at multiple wavelengths.

[0016] The database management unit M stores the multispectral data and customer information, etc. sent from the data collection unit 10 in a designated memory unit, sends the multispectral data to the algae measurement unit 20 and stores the algae detection and measurement results returned from the algae measurement unit 20 in a designated memory unit, and in response to a request (data transmission request) sent from the display control unit 30 together with customer information, etc., sends the algae detection and measurement results corresponding to the customer information, etc. to the display control unit 30.

[0017] The algae measurement unit 20 acquires multispectral data from the database management unit M, detects and measures algae, and sends the detection and measurement results to the database management unit M. The detection and measurement of algae includes detection of the algae themselves, detection of the type of algae (class, genus, species, shape, etc.), and calculation of the measurement amount for each type of algae. The calculated measurement amount for each type of algae is expressed as a value based on a predetermined index (index value), for example, at least one of the number of algae individuals, number of colonies, length, and number of turns per unit volume. It is desirable to automate the process of detecting and measuring algae using an AI (Artificial Intelligence) engine or a deep learning model.

[0018] The display control unit 30 operates as a web system that provides information in response to requests from the user operation units 60-1 and 60-2. In response to a request (data transmission request) sent from the user operation unit 60-1 or the user operation unit 60-2, the display control unit 30 transmits customer information attached to the request to the database management unit M, thereby acquiring corresponding algae detection and measurement results from the database management unit M, and performs control to display information including the acquired algae detection and measurement results on the display unit 62 in a display method in response to a request from the user operation unit 60-1 or the user operation unit 60-2. The displayed algae detection and measurement results include the measured amount for each type of algae. The measured amount for each type of algae is expressed as a value based on a predetermined index (index value), for example, at least one of the number of algae individuals, number of colonies, length, and number of turns per unit volume.

[0019] The user operation unit 60-1 sends a request (data transmission request) including approval information for approval to the display control unit 30, thereby obtaining information or management data including the detection and measurement results of algae stored in the database management unit M from the display control unit 30 and displaying it on the display unit 62.

[0020] The user operation unit 60-2 sends a request (data transmission request) including customer information and approval information for approval to the display control unit 30, thereby obtaining information including the algae detection and measurement results stored in the database management unit M from the display control unit 30 and displaying it on the display unit 62.

[0021] <Functional configuration of each part> FIG. 2 shows an example of the functional configuration of each unit of the algae detection result display system shown in FIG.

[0022] In this example, the database management unit M is realized by two database management units M1 and M2. However, the present invention is not limited to this example, and it may be realized by one database management unit.

[0023] <Data Collection Unit 10> The data collection unit 10 includes a data acquisition unit 11 and a data transmission unit 12 .

[0024] (Data Acquisition Section 11) The data acquisition unit 11 acquires data of captured images obtained by capturing images of water containing algae with an imaging device. The imaging device for capturing images may be a microscope with a camera attached. The camera may be a multispectral camera that captures images at multiple wavelengths, a hyperspectral camera that captures images at many wavelengths, or a general color camera or grayscale camera. When detecting algae among microorganisms, it is desirable to employ a multispectral camera or hyperspectral camera that can easily determine the presence or absence of pigments possessed by algae. However, even with a color camera or grayscale camera, algae can be detected by constructing a sufficient detection algorithm (for example, by using a deep learning model that has previously learned images of the detection target). For example, algae can be detected by collecting data on observed algae in advance and creating a machine learning model.

[0025] The captured images may be processed. For example, a multispectral image captured by a multispectral camera may be converted into an RGB color image, which may be used together with the original multispectral image.

[0026] The data may also include things other than images. For example, the data may include the date and time of the image capture, the water source (such as a water purification plant), the volume of water per captured image, the air temperature, the water temperature, and other index values ​​of water quality. The date and time of the image capture may be substituted with the date and time information stored in the data storage unit 40.

[0027] Furthermore, the algae may be photographed continuously. For example, as described below, a flow cell may be used to photograph the algae while replacing the water in the image.

[0028] (Configuration of the imaging device provided in the data acquisition unit 11) FIG. 3 shows an example of the configuration of an imaging device provided in the data acquisition unit 11. As shown in FIG.

[0029] FIG. 3 shows an example in which the imaging device is equipped with a multispectral camera. The multispectral camera outputs multispectral data as an imaging signal. The imaging device 110 shown in Fig. 3 includes a light source 111, a container 112, a lens 113, and a detector 114. The imaging device 110 is connected to the data collection unit 10 described above. The imaging device 110 and the data collection unit 10 may be connected by wire using a cable, or may be connected wirelessly using a wireless communication device. The imaging device 110 and the data collection unit 10 may be connected via a predetermined network. Alternatively, the imaging device 110 may be provided in the data collection unit 10.

[0030] The light source 111 is a light source used for photographing algae. The light source 111 may have any light emission principle as long as its wavelength distribution is known. For example, the light source 111 may be configured using an LED (Light-Emitting Diode), a laser, or a halogen lamp. The light emitted from the light source 111 illuminates the water in the container 112.

[0031] The container 112 is a transparent container through which water collected from a river or a lake passes or into which it is filled. The container 112 may be, for example, a flow cell or a microscope plate. The container 112 may be made of any material as long as it is possible to obtain the transmitted light intensity in the absence of a sample. In the example of FIG. 3, the water in the container 112 contains algae A to be imaged. The light transmitted through the container 112 is directed toward the lens 113.

[0032] The lens 113 transmits the light transmitted through the container 112 and focuses the light on a sensor portion of the detector 114. Note that the lens 113 is not necessarily required.

[0033] The detector 114 has an imaging element that captures an image of the water in the container 112 by receiving light sent from the container 112 through the lens 113 with a sensor unit, and outputs the image or signal obtained by the imaging as an imaging signal. The signal is a signal indicating the signal intensity at a specific point, and is a signal substantially corresponding to one pixel. The detector 114 may be configured using, for example, a photodiode (PD), an avalanche photodiode (APD), a photomultiplier tube (PMT), a charge coupled device (CCD), or a complementary metal oxide semiconductor (CMOS). When algae A is present in the water of the container 112, an imaging signal in which all or a part of the algae A is captured is sent to the data collecting unit 10.

[0034] Furthermore, the detector 114 outputs signals corresponding to the light of the plurality of wavelengths. The plurality of wavelengths may be configured to be arbitrarily selected. For example, the detector 114 may have a spectral characteristic for an arbitrary wavelength, or may not have such a characteristic and may receive light of an arbitrary wavelength (e.g., monochromatic light) that passes through any of various color filters described later.

[0035] FIG. 4 shows an example of a specific configuration of the imaging device 110. As shown in FIG.

[0036] 4 further includes an optical filter 115 in addition to the light source 111, container 112, lens 113, and detector 114 described above. The optical filter 115 is disposed in the space between the container 112 and the lens 113, and has various color filters. Each of the various color filters transmits light (color) of a predetermined wavelength and attenuates light (color) of other wavelengths. Each color filter transmits a different wavelength (color).

[0037] By rotating / stopping such optical filter 115 with a driving unit (not shown), it is possible to insert any color filter into the optical axis X. The operation of rotating / stopping the optical filter 115 may be performed on the data collecting unit 10 side.

[0038] Incidentally, the optical filter 115 is not necessarily required. The optical filter 115 may not be provided, and the detector 114 may be configured to select an arbitrary wavelength. Also, even if the detector 114 does not have a function for selecting an arbitrary wavelength, as long as it is possible to output signals corresponding to light of a plurality of wavelengths, there is no problem even if such a function is not provided.

[0039] FIG. 5 shows an example of the configuration of the container 112.

[0040] 5 shows an example in which the container 112 is a flow cell. Although an example of a flow cell through which water flows is shown here, a container (such as a microscope plate) that is used in a state filled with water may be used instead.

[0041] The flow cell has a flow path inside through which raw water obtained from a water source passes. In the flow path of the flow cell, the raw water continues to flow almost without stopping. Specifically, the flow cell includes a main body 121, a water sampling pipe 122, and a drain pipe 123.

[0042] The water sampling pipe 122 has an inlet through which a portion of the raw water sampled from the water source flows into the main body 121. The raw water flowing in from the inlet is subjected to water pressure due to elevation differences, a pump, etc., and flows in the direction of the arrow. The raw water flowing in from the inlet of the water sampling pipe 122 passes through the water sampling pipe 122 and flows into the main body 121.

[0043] The main body 121 has a flow path inside. The main body 121 is made of a transparent material so that, at least in the area to be imaged by the imaging device 110, the light from the light source 111 is uniformly transmitted regardless of wavelength if the raw water is transparent.

[0044] The drain pipe 123 has a drain outlet for discharging the raw water that has passed through the main body 121. The raw water discharged from the drain outlet may be disposed of at a specific location or may be returned to the water source.

[0045] (Type of algae) Next, various types of algae will be described.

[0046] FIG. 6 shows a schematic diagram of the classification of algae.

[0047] Algae are broadly classified into "classes," and each "class" is further classified into "genera" and "species" (hereinafter referred to as "genera, etc.").

[0048] Examples of "classes" include Cyanobacteria (class), Diatoms (class), and Chlorophytes (class). There is also the Chrysophyte (class), which is not shown. Examples of "genera, etc." include Phormidium, Oscillatoria, and Anabaena in the Cyanobacteria (class), and Aulacoseira in the Diatoms (class).

[0049] (Photosynthetic pigments in algae) Next, the photosynthetic pigments (hereinafter referred to as "pigments") that various algae possess will be described.

[0050] FIG. 7 shows a schematic diagram of the relationship between various algae and pigments.

[0051] Cyanobacteria (class) have pigments such as phycocyanin in addition to chlorophyll a. Diatoms (class) have pigments such as fucoxanthin, diatoxanthin, and diadinoxanthin in addition to chlorophyll a. Chlorophytes (class) and Chrysophytes (class not shown) also have some pigments.

[0052] FIG. 8 shows the absorption spectra (hereinafter referred to as "spectra") of various algae, as well as the wavelength ranges in which the light absorption peaks (maximum absorption) of various pigments are present. In the graph of FIG. 8, the vertical axis represents light transmittance, and the horizontal axis represents wavelength. Light transmittance can be considered to be equivalent to signal intensity.

[0053] The graph in Figure 8 shows the spectra of the cyanobacterial genera Phormidium, Oscillatoria, and Anabaena, as well as the spectrum of the diatom genus Aulacoseira.

[0054] CHL-a in Fig. 8 indicates the wavelength region where light is particularly absorbed by chlorophyll a, and PHY in Fig. 8 indicates the wavelength region where light is particularly absorbed by phycocyanin.

[0055] In Phormidium, Oscillatoria, Anabaena, and Aulacoseira, light is absorbed by chlorophyll a, particularly at around 440 nm and 680 nm. Chlorophyll a is a pigment found in all algae. Therefore, by using information on the hue around 440 nm and 680 nm, where the absorption peaks of chlorophyll a are located, it is possible to determine whether or not algae are present in the area captured by the imaging device 110.

[0056] In the genera Phormidium, Oscillatoria, and Anabaena, light is absorbed by phycocyanin, particularly at around 620 nm. Phycocyanin is rarely found in algae other than cyanobacteria, and can be said to be a pigment unique to cyanobacteria. Therefore, by using information on the hue around 620 nm where the absorption peak of phycocyanin is located, and information on the hue around 440 nm and 680 nm where the absorption peak of chlorophyll a is located, it is possible to determine whether or not algae are present in the area imaged by the imaging device 110, and if so, whether the algae are cyanobacteria or algae other than cyanobacteria. In other words, the presence or absence of cyanobacteria can be determined.

[0057] Using a similar technique, it is possible to determine the presence or absence of not only blue-green algae but also diatoms.

[0058] For example, in the diatom genus Aulacoseira, light is absorbed in a specific wavelength range by fucoxanthin, diatoxanthin, and diadinoxanthin (not shown). Therefore, by using the information on the hues in these wavelength ranges and the information on the hues near 440 nm and 680 nm where chlorophyll a has its absorption peak, it is possible to determine whether or not algae are present in the area imaged by the imaging device 110, and if so, whether the algae are diatoms or algae other than diatoms. In other words, the presence or absence of diatoms can be determined.

[0059] The presence or absence of green algae, golden algae, etc. can also be determined using a similar method.

[0060] The presence or absence of each of the genera of blue-green algae, such as Phormidium, Oscillatoria, and Anabaena, can be determined from the characteristics of their spectral waveforms.

[0061] The presence or absence of various genera in blue-green algae (Phormidium, Oscillatoria, Anabaena, etc.) can be determined by the same method, as can the presence or absence of various genera in diatoms (Aulacoseira, etc.). The presence or absence of various genera in green algae and in golden algae can also be determined by the same method.

[0062] (Information obtained from imaging signals) FIG. 9 shows an example of information obtained from an imaging signal output by the imaging device 110. In FIG.

[0063] In the example of Fig. 9, algae A is present in the water in the container 112. The detector 114 captures an image of the area containing the algae A and outputs a plurality of images G corresponding to a plurality of wavelengths. Note that, although an example in which an image is output from the imaging device 110 is shown here, the imaging device 110 may be configured to output the above-mentioned signal instead of an image.

[0064] In the example of image G shown in FIG. 9, a plurality of images G corresponding to wavelengths of 400 nm, 450 nm, 500 nm, 550 nm, 600 nm, 650 nm, and 750 nm are obtained at intervals of 50 nm.

[0065] The number of images G and the interval between each wavelength may be changed as appropriate. For example, in a band where the characteristics of the pigment of the target algae are particularly apparent (e.g., around the wavelength range where the absorption peak of the pigment is present), more images G may be obtained at intervals shorter than 50 nm. Also, in order to make it easier to capture the spectral shape of the target algae, more images G may be obtained by shortening the interval between each wavelength over a wider range from short to long wavelength bands.

[0066] In addition, images G corresponding to each wavelength may all be generated simultaneously, or only images G corresponding to some wavelengths may be generated. For example, depending on the type of algae to be targeted, only images G corresponding to wavelengths in a band in which the characteristics of the pigment possessed by the algae are particularly apparent (for example, around the wavelength range in which the pigment has an absorption peak) may be generated.

[0067] The wavelength selection may be performed by operating the optical filter 115 as described above, or may be performed inside the detector 114 without using the optical filter 115. Individual wavelengths and image acquisition magnifications may be appropriately changed depending on the size and type of algae.

[0068] Figure 9 shows an example of a rod-shaped Phormidium in image G, but the shapes of algae that can appear in image G vary depending on the type. Figure 10 shows examples of images showing various types of algae.

[0069] Figure 10 shows example images of (a) Anabaena, (b) Oscillatoria, (c) Phormidium, and (d) Microcystis.

[0070] As shown in Figure 10, algae come in a variety of shapes, including beaded, filamentous, rod-like, and spherical.

[0071] (Data transmission unit 12) The data transmission unit 12 transmits the data acquired by the data acquisition unit 11 to the data holding unit 40 .

[0072] <Database Management Department M1> The database management unit M1 includes a data storage unit 40.

[0073] (Data storage unit 40) The data storage unit 40 stores the captured images described above, the capture date and time of the captured images, the water source, and other data (air temperature, water temperature, water quality index values), etc. In response to a request from the algae measurement unit 20 or the display control unit 30, the data storage unit 40 transmits the stored data to the algae measurement unit 20 or the display control unit 30 that is the request source.

[0074] <Algae measurement section 20> The algae measurement unit 20 includes a data acquisition unit 21, an algae detection unit 22, an index calculation unit 23, and a data transmission unit 24.

[0075] (Data Acquisition Unit 21) The data acquisition unit 21 sends a data transmission request to the database management unit M1, and acquires various data including the captured image data from the data storage unit 40. The various data includes information such as the date and time of capture and the water source.

[0076] (Algae detection unit 22) The algae detection unit 22 processes the various data acquired by the data acquisition unit 21 to detect algae appearing in the captured image. Specifically, it classifies the algae and generates, as a detection result, information indicating the presence or absence of algae, and if algae is detected, information indicating the type of algae, and further information indicating, in pixel units, the area in the captured image in which the algae appears.

[0077] The algae detection results generated by the algae detection unit 22 (information indicating the presence or absence of algae in the captured image, information indicating the type of algae, and information indicating the area in the captured image in which the algae is captured) are sent to the database management unit M2 from the data transmission unit 24, which will be described later.

[0078] There are several methods for classifying algae. The classification results from the following methods are used to show the type of algae on the screen.

[0079] · Classification of algae or not - Classify the captured object as algae or non-algae (whether or not algae is present).

[0080] - Specifically, it determines whether or not algae contain chlorophyll a, or determines whether or not a captured object is algae using a machine learning model that has previously been trained on images of algae.

[0081] Classification of algae based on pigments they possess - Classify algae such as cyanobacteria, diatoms, and green algae as explained in Figure 7.

[0082] Classification of algae by genus - Classify Anabaena, Oscillatoria, Phormidium, etc. as explained in Figure 8.

[0083] - The above classification is performed using a deep learning model that has been pre-trained on the target image.

[0084] Classification of algae by species - Classify Anabaena species such as affinis and spiroides.

[0085] - The above classification is performed using a deep learning model that has been pre-trained on the target image.

[0086] Classification of algae by shape - Classify as filamentous or not.

[0087] Classification of filaments as linear or helical - Classify as colony or not.

[0088] - The above classification is performed based on the image characteristics of the algae, using general image processing and a machine learning model that has learned the shape of algae.

[0089] (Indicator calculation unit 23) The index calculation unit 23 calculates an index value (a measurement amount based on a predetermined index) for each type of algae based on the detection result generated by the algae detection unit 22. The indexes include the following.

[0090] -Algae size - Image area (in pixels) - Cross-sectional area in the plane where the image was taken (in real-world scale units (e.g. square millimeters)) Location of algae - Centroid coordinates - circumscribed rectangle coordinates The index calculation unit 23 calculates various index values ​​for each classification (each type of algae) described above based on the information on the algae detected by the algae detection unit 22. The indexes are as follows. These numbers may be expressed as numbers (concentrations) per unit volume of water (e.g., 1 mL). In that case, the concentration is calculated using the volume of water per captured image.

[0091] Population To calculate the number of individuals, it is necessary to detect the individual algal clumps in the image. This can be done using known image processing techniques such as labeling. Once the individual algal clumps are detected, the size of the algae can be calculated by counting the number of pixels that belong to each clump.

[0092] ·Number of cells If an algae clump corresponds to one cell, the number of cells can be calculated by detecting the clumps described above. In other words, the number of clumps = the number of cells. If the algae is one where multiple cells form a clump, the number of cells can be estimated by dividing the clump area (e.g., 1,000px) by the standard area per cell for that type of algae (e.g., 100px) (e.g., 1,000px / 100px=10 cells).

[0093] Length of filaments (number of connected algae as one, measured per unit length (e.g. 100 μm)) The length of the filaments can be calculated by determining the centerline of the algae based on the mass of the algae in the image, using known image processing techniques such as vectorization of the pixels in which the algae are captured (e.g., Japanese Patent No. 2817885).

[0094] Number of turns of the helical filament To calculate the number of turns of the spiral filaments, we simply count the number of areas with large curvature (parts of the algae that are curved) based on the center line of the algae determined by the method described above. Alternatively, if the spiral algae is photographed as a circle, we can also calculate the number of circles made by the center line of the algae.

[0095] ·Number of colonies The number of colonies is equal to the number of algal clumps. For colonies that appear separated into multiple clumps on the image, known image processing techniques can be used to combine them into a single clump by dilation and shrinkage.

[0096] (Data transmission unit 24) The data transmission unit 24 transmits the detection results generated by the algae detection unit 22 described above, as well as the calculation results (index values ​​for each type of algae) generated by the index calculation unit 23, together with information on the shooting date and time or the detection / measurement date and time, to the database management unit M2.

[0097] <Database Management Department M2> The database management unit M2 includes a data storage unit 50.

[0098] The data storage unit 50 stores the algae detection results generated by the algae detection unit 22 (information indicating the presence or absence of algae in the captured image, information indicating the type of algae, and information indicating the area in the captured image in which algae is captured) and also stores the calculation results generated by the index calculation unit 23 (index values ​​for each type of algae) together with information on the shooting date and time or the detection / measurement date and time.

[0099] <Display control unit 30> The display control unit 30 sends a data transmission request to the database management unit M1, and obtains from the data storage unit 40 information indicating the image data acquired by the data collection unit 10, the date and time of shooting or the date and time of data acquisition, the water source, etc., and sends a data transmission request to the database management unit M2, and obtains from the data storage unit 50 the detection results generated by the algae detection unit 22 (information indicating the presence or absence of algae in the captured image, information indicating the type of algae, and information indicating the area in the captured image in which algae is captured) and the calculation results generated by the index calculation unit 23 (measurement quantities such as size and length for each type of algae), and generates a display screen in a specified display format using the various acquired information.

[0100] The display control unit 30 includes a table display control unit 31 , a graph display control unit 32 , and a detection image display control unit 33 .

[0101] (Table display control unit 31) The table display control unit 31 causes the display unit 62 to display information including the date and time of detection and measurement, the type of algae, and index values ​​in table format as the detection and measurement results of algae.

[0102] FIG. 11 shows an example of a table displayed by the table display control unit 31. As shown in FIG.

[0103] In the example of Figure 11, various items are provided, such as date and time, class, genus, species, shape, number of detections [individuals / colonies / mL], number of detections [unit length / mL], and number of volumes [volumes]. The detection and measurement results of each algae are added in chronological order, for example, in the order in which they were detected.

[0104] Class, genus, species, and shape correspond to the types of algae. Detection count [individuals·colonies / mL], detection count [unit length / mL], and volume [volume] correspond to the measured quantities or index values ​​for each type of algae. Detection count [individuals·colonies / mL] represents the number of individuals (or cells) or colonies per unit volume. Detection count [unit length / mL] represents the unit length per unit volume.

[0105] Depending on the type of genus, some species cannot be detected. For those with a spiral shape, the number of turns is used as an index value, but for those with a non-spiral shape, the number of turns is not used. Also, for those with a colonial shape, the detection number (unit length / mL) is not used.

[0106] By adopting this display format, it is possible to list detailed index values ​​by detection / measurement date and time and by algae classification (by type). It can also support the creation of reports.

[0107] (Graph display control unit 32) The graph display control unit 32 causes the display unit 62 to display information including the date and time of detection and measurement, the type of algae, and index values ​​in graph form as the detection and measurement results of algae.

[0108] (Detection image display control unit 33) The detection image display control unit 33 causes the display unit 62 to display a screen combining information showing the results of algae detection and measurement with the above-mentioned captured image.

[0109] The detection image display control unit 33 has, as a basic function, the ability to simultaneously display on the display unit 62 at least the captured image, information indicating the area in the captured image in which algae are captured, and information indicating the type of algae.

[0110] In addition, the detection image display control unit 33 has various functions as described below.

[0111] - A function to show the area where algae is reflected with a "border" The detection image display control unit 33 has a function of indicating an area in the captured image in which algae are captured by displaying a frame line. If multiple algae are captured in the captured image, a frame line is displayed for each algae. The detection image display control unit 33 also has a function of indicating the type of the algae by different colors or line types of the frame lines.

[0112] By using the above-described frame line, it becomes easier for the user to visually recognize where in the captured image what type of algae is shown.

[0113] The frame line referred to here includes not only a simple rectangular frame line, but also a rectangular frame line with part of it missing, and a frame line in which the rectangle is expressed using a line type other than a solid line (such as a dashed line, double line, one-dot chain line, or two-dot chain line). It is also not limited to a rectangle, but also includes shapes other than a rectangle, such as a polygon, and a frame line that surrounds the algae with a curve that matches the shape of the algae's edge.

[0114] The frame is displayed superimposed on the captured image and is displayed in a form that surrounds the algae.

[0115] Note that information indicating the area in the captured image where the algae is captured and information indicating the type of the algae have already been obtained by the algae measurement unit 20. Therefore, by using this information, the detection image display control unit 33 can provide the user with various information related to the algae in the captured image.

[0116] Furthermore, the detection image display control unit 33 has a function of changing the color or line type of the border for each type of algae in response to a user request, thereby making it easier for the user to distinguish between types of algae.

[0117] Furthermore, the detection image display control unit 33 has a function of expressing the type of algae (class) by different frame line colors or line types, and indicating the "genus" or "species" of the algae by displaying characters. The detection image display control unit 33 also has a function of changing the color of the characters for each type of algae in response to a user request.

[0118] Since the number of types of algae (classes) actually detected is relatively small, users can intuitively identify the type of algae (class) from the color or line type of the frame. On the other hand, since there are many types of algae "genera" or "species," it is difficult for users to intuitively identify the type of "genus" or "species" from the color or line type alone, and it is easier to understand if it is shown in text. In addition, by being able to change the color of the text for each type of algae, users can more easily identify the type of algae.

[0119] Here, an example of an image processing technique for superimposing a frame line on a captured image will be described with reference to FIGS.

[0120] FIG. 12 shows an example of a captured image (that is, an image obtained by capturing an image of water containing algae) used in image processing.

[0121] Here, it is assumed that the captured image is image G1 as shown in Fig. 12. There are multiple algae in image G1. In the following, image processing is performed on two algae that are clearly visible in image G1.

[0122] The image G1 is collected by the data collection unit 10 and stored in the data storage unit 40 managed by the database management unit M. Before performing image processing in the detected image display control unit 33, the algae detection unit 22 acquires the image G1 from the data storage unit 40 and performs processing to identify the area in the image G1 in pixel units in which the algae are captured.

[0123] Information indicating the area in image G1 in which algae are visible is sent to and stored in data storage unit 50 managed by database management unit M2.

[0124] The detection image display control unit 33 in the display control unit 30 acquires the image G1 from the data storage unit 40 and the data storage unit 50, and acquires information indicating an area in which algae are reflected in the image G1. Then, the detection image display control unit 33 performs a binarization process on the image G1.

[0125] Fig. 13 shows an example of an image obtained by binarizing image G1 in Fig. 12. Note that the areas that appear gray in Fig. 13 are actually black.

[0126] The two algae shown in image G1 of Fig. 12 are, for example, processed separately, where the color of each algae in image G1 is converted to white and the color of the background of each algae is converted to black, as shown in images G2 and G3 of Fig. 13(a) and (b), respectively.

[0127] Next, the detection image display control unit 33 creates an image in which the frame lines of the minimum rectangles circumscribing the white areas in the images G2 and G3 are superimposed.

[0128] FIGS. 14(a) and (b) show examples of images in which the frame lines of the minimum rectangles circumscribing the white areas in the images G2 and G3 in FIGS. 13(a) and (b) are superimposed.

[0129] In the white area shown in images G2 and G3 in Fig. 13(a) and (b), frame lines W1 and W2 of a minimum rectangle circumscribing the area are arranged as shown in images G4 and G5 in Fig. 14(a). It is preferable that the color of the frame lines W1 and W2 is a color that is visually easy to distinguish from white and black, such as blue. The rotation angle (tilt) of the minimum rectangle with respect to the reference is appropriately set according to the orientation of the long and short sides of the white area. The rotating caliper method may be applied to create the minimum rectangle.

[0130] Next, the detection image display control unit 33 creates images by expanding the frame lines W1 and W2 of the minimum rectangles in the images G4 and G5.

[0131] FIGS. 15(a) and (b) show examples of images obtained by expanding the frame lines W1 and W2 of the minimum rectangles in the images G4 and G5 in FIGS. 14(a) and (b).

[0132] The borders W1 and W2 of the minimum rectangle shown in images G4 and G5 in Figures 14(a) and (b) are expanded to move away from the white area by a fixed distance, as shown in images G6 and G7 in Figures 15(a) and (b). In this case, a method of multiplying the width and height of the rectangle by a fixed factor (for example, 1.2 times) or adding a fixed amount to the width and height may be adopted.

[0133] Finally, the detection image display control unit 33 creates a new image by superimposing the expanded rectangular frame lines W1 and W2 on the image G1 of FIG. 12, and ends the image processing.

[0134] FIG. 16 shows an example of a new image G8 in which the frame lines W1 and W2 in the images G6 and G7 in FIGS. 15(a) and 15(b) are superimposed on the image G1 in FIG.

[0135] By such image processing, the area of ​​the algae in the captured image is eliminated from overlapping portions with the frame lines W1 and W2, making it easier for the user to see the algae. However, the process of expanding the frame line of the minimum rectangle is not necessarily required. For example, the process of expanding the frame line of the minimum rectangle may be omitted, and the algae may be made easier to see by displaying the frame line of the minimum rectangle in a light color or semi-transparently.

[0136] Although a rectangular frame line is used here as an example, a curved frame line may be used instead.

[0137] An example of using a curved frame line is shown in Fig. 17. As shown in Fig. 17, a frame line W3 shown in an image G9 surrounds the algae with a curve that matches the shape of the periphery of the algae.

[0138] The frame line W3 may be displayed in an expanded form at a certain distance from the area of ​​the algae without touching the periphery of the algae, as shown in Fig. 17. This eliminates any overlap between the area of ​​the algae and the frame line W3, making it easier for the user to see the algae. However, the process of expanding the frame line is not necessarily required. Instead of expanding the frame line, the algae may be made easier to see by, for example, displaying the frame line in a light color or semi-transparently.

[0139] Such curved borders are effective in making it easier to visually recognize individual algae when multiple algae are crowded together in an image.

[0140] FIGS. 18(a) and (b) show, in comparison, an example of an image on which a rectangular frame line is superimposed and an example of an image on which a curved frame line is superimposed.

[0141] In the example image of Figure 18(a), two algae T1 and T2 are surrounded by rectangular frame lines W4 and W5, respectively. Since the two algae T1 and T2 are intertwined, there are parts where the rectangular frame lines W4 and W5 overlap each other.

[0142] In contrast, in the example image of Figure 18(b), two algae T1 and T2 are surrounded by curved borders W6 and W7, respectively. Although the two algae T1 and T2 are intertwined, the curved borders W6 and W7 do not overlap.

[0143] Comparing the images of Figures 18(a) and 18(b), it can be said that the image of Figure 18(b) makes it easier to visually identify individual algae than the image of Figure 18(a) because the frame lines W6 and W7 do not overlap.

[0144] - A function to show areas where algae are present by decorating them with "color" or "pattern" The detection image display control unit 33 has a function of showing the area in the captured image where algae is captured by displaying a decoration of a predetermined color or pattern. If multiple algae are captured in the captured image, a decoration of a color or pattern is displayed for each algae. The detection image display control unit 33 also has a function of showing the type of algae by differences in the color of the decoration (the color that decorates the area where the algae is captured) or the pattern (the pattern that decorates the area where the algae is captured).

[0145] By using the above-mentioned color or pattern decoration, it becomes easier for the user to visually recognize where and what type of algae is shown in the captured image.

[0146] It is desirable that the decorative color or pattern be displayed in a light color or semi-transparently so as not to make it difficult for the user to see the algae.

[0147] The shape of the area (decorative area) to which a decoration of a predetermined color or pattern is applied may be rectangular or may be a shape other than rectangular. For example, when replacing the rectangular frame lines W1 and W2 in FIG. 16 described above with decoration of a predetermined color or pattern, the area inside the frame lines W1 and W2 may be decorated with a predetermined color or pattern as a decorative area, and the frame lines W1 and W2 may be deleted. When replacing the curved frame line W3 in FIG. 17 described above with decoration of a predetermined color or pattern, the area inside the frame line W3 may be decorated with a predetermined color or pattern as a decorative area, and the frame line W3 may be deleted.

[0148] Furthermore, the detection image display control unit 33 has a function of changing the color or pattern of the decoration for each type of algae in response to a user request, thereby making it easier for the user to distinguish between types of algae.

[0149] Furthermore, the detection image display control unit 33 has a function to represent the type of algae (class) by different decorative colors (colors that decorate the area where the algae is shown) or patterns (patterns that decorate the area where the algae is shown), and to indicate the "genus" or "species" of the algae by displaying characters. The detection image display control unit 33 also has a function to change the color of the characters for each type of algae in response to a user request.

[0150] As mentioned above, the number of types of algae (classes) that are actually detected is relatively small, so the user can intuitively understand the type of algae (class) from the color or pattern of the decorative area. On the other hand, there are many types of algae "genera" or "species," so it is difficult for the user to intuitively understand the type of "genus" or "species" from the color or pattern of the decorative area alone, and it is easier to understand if it is shown in text. Furthermore, by being able to change the color of the text for each type of algae, the user can more easily identify the type of algae.

[0151] - Display information on measurements such as size (area, volume, etc.) and length of algae The detection image display control unit 33 has a function of further displaying information indicating measurement quantities such as the size (area, volume, etc.) and length of the algae captured in the captured image. The information indicating the measurement quantities of the algae is displayed near the area in which the algae is captured. When multiple algae are captured in the captured image, information indicating the measurement quantities for each algae is displayed. This allows the user to easily grasp the measurement quantities of each algae at a glance.

[0152] - Display information on algae shape type (straight chain, spiral, colony) The detected image display control unit 33 has a function of displaying information indicating the type of shape of the algae (straight chain, spiral, colony) captured in the captured image. The information indicating the type of shape of the algae is displayed near the area in which the algae is captured. When multiple algae are captured in the captured image, information indicating the type of shape of each algae is displayed. This allows the user to easily grasp the type of shape of each algae at a glance.

[0153] - Ability to show / hide information (border or decoration) for each type of algae The detection image display control unit 33 has a function of displaying or hiding information representing the type of algae (border or decoration) for each type of algae in response to a user request. This allows the user to hide the border or decoration that the user does not want to display for each type of algae, and display the border or decoration that the user wants to display.

[0154] - Ability to show / hide information showing measurements such as size and length of algae The detection image display control unit 33 has a function of displaying or hiding information indicating the measurement amount of the algae, such as the size and length, in response to a user request. This allows the user to hide the information indicating the measurement amount of the algae when he or she does not want to display the information, and to display the information when he or she wants to display the information.

[0155] - Display / hide information on algae shape type (straight chain, spiral, colony) The detection image display control unit 33 has a function of displaying or hiding information indicating the type of algae shape (straight chain, spiral, colony) in response to a user request. This allows the user to hide the information indicating the type of algae shape when he or she does not want to display the information, and to display the information when he or she wants to display the information.

[0156] - Ability to display images at different times for comparison The detection image display control unit 33 has a function of displaying multiple images taken at different dates and times so that they can be compared. Since the user can compare multiple images taken at different dates and times, the user can easily understand the changes and trends over time of each algae contained in the water.

[0157] - Ability to display images with different water sources for comparison The detection image display control unit 33 has a function of displaying a plurality of images of water from different water sources so that the images can be compared. Since the user can compare a plurality of images of water from different water sources, the user can easily understand the difference in the composition of algae contained in the water for each water source.

[0158] Hereinafter, various display examples realized by the detection image display control unit 33 will be shown with reference to FIGS.

[0159] Display example (1) Figure 19 shows an example of displaying the type of algae by different "border color." Note that in Figure 19, the three types of borders for blue-green algae, diatoms, and green algae appear to be black, gray, and diagonal patterns, respectively, but are actually solid blue, brown, and green lines.

[0160] In the display example of Fig. 19, an image G11 showing two types of algae surrounded by frames of different "colors" is displayed on a screen D. In addition, the names of various algae (classes) are displayed as a legend on the right side of the image G11, and frames of different "colors" are displayed for each type of algae (class).

[0161] For example, the color of the frame line corresponding to blue-green algae is blue, which is a color reminiscent of blue-green algae (a color relatively close to the color of actual blue-green algae), the color of the frame line corresponding to diatoms is brown, which is a color reminiscent of diatoms (a color relatively close to the color of actual diatoms), and the color of the frame line corresponding to green algae is green, which is a color reminiscent of green algae (a color relatively close to the color of actual green algae).This makes it easier for the user to intuitively identify the individual algae appearing in the captured image.

[0162] Display example (2) Figure 20 shows an example of displaying the type of algae by different "border line types." Note that in Figure 20, the three border colors for blue-green algae, diatoms, and green algae appear to be black, gray, and black, respectively, but in reality they are indigo, brown, and green.

[0163] In the display example of Fig. 20, image G12 showing two types of algae surrounded by frame lines of different "line types" is displayed on screen D. In addition, on the right side of image G12, the names of various algae (classes) are displayed as a legend, and frame lines of different "line types" are displayed for each type of algae (class).

[0164] For example, a solid line may be used for the border line corresponding to blue-green algae, a dotted line may be used for the border line corresponding to diatoms, and a dashed line may be used for the border line corresponding to green algae, allowing the user to easily identify individual algae (classes).

[0165] Display example (3) FIG. 21 shows an example of a display in which algae (all algae) are displayed with a "frame line of a specific color."

[0166] In the display example of Fig. 21, an image G13 showing two types of algae surrounded by frame lines is displayed on a screen D. Both frame lines are displayed in one specific color. In addition, on the right side of the image G13, frame lines corresponding to the algae are displayed in a specific color as a legend.

[0167] Such a display example is effective when it is not necessary to distinguish between types of algae, and allows the information displayed on screen D to be simplified.

[0168] Display example (4) Figure 22 shows an example of a display in which types of algae (classes) are represented by different "border line colors," and types of algae genus are represented by different "border line types." In Figure 22, the color of the border for "Microcystis," a genus of blue-green algae, appears to be black, but is actually indigo blue. Also, the color of the border for "Aulacoseira," a genus of diatoms, appears to be gray, but is actually brown.

[0169] In the display example of Fig. 22, image G14 is displayed on screen D, showing two types of algae surrounded by frames of different "colors" and "line types." In addition, on the right side of image G14, the names of the genera of various algae are displayed as a legend, and a frame of a different "line type" is displayed for each type of genera. The "color" of the frame represents the type of algae (class).

[0170] By expressing different borders in this way using both "color" and "line type," users can easily identify at a glance the classes and genera of the individual algae appearing in the captured image.

[0171] Display example (5) Figure 23 shows an example of a display in which the type of algae (class) is represented by different "border colors" and the type of algae genus is represented by "characters." In Figure 23, the color of the border and characters for "Microcystis," a genus of blue-green algae, appears to be black, but they are actually indigo blue. Also, the color of the border and characters for "Aulacoseira," a genus of diatoms, appears to be gray, but they are actually brown.

[0172] In the display example of FIG. 23, image G15 is displayed on screen D, showing two types of algae surrounded by different colored borders, with the name of the algae's genus displayed next to each algae area. No legend is displayed to the right of image G15. The color of the border in image G15 indicates the type of algae (class).

[0173] In this way, by displaying the name of the genus adjacent to each algae region in image G15, it is not necessary to display information on the right side of image G15, for example.

[0174] Display example (6) Figure 24 shows a modified example of the display in Figure 23. In Figure 24, the three types of frame lines for indicating blue-green algae, diatoms, and green algae appear to be black, gray, and diagonal patterns, respectively, but are actually solid blue, brown, and green lines.

[0175] In the display example of Fig. 24, similar to the display example of Fig. 23, image G16 showing two types of algae surrounded by frame lines of different "colors" is displayed on screen D, and the name of the algae genus is displayed near the area of ​​each algae. On the right side of image G16, the names of various algae (classes) are displayed as a legend, and a frame line of a different "color" is displayed for each type of algae (class).

[0176] By displaying both the name of each algae (class) and the name of the genus on screen D in this way, even an inexperienced user can easily understand at a glance the class and genus of each algae appearing in the captured image.

[0177] Display example (7) Fig. 25 shows an example of a display in which types of algae are represented by different "decorative colors" (colors used to decorate the areas in which the algae are displayed). Note that in Fig. 25, the three types of decorations representing blue-green algae, diatoms, and green algae appear to be different types of patterns, but in reality they are not patterns but rectangular decorations filled with blue, brown, and green. Of course, different types of patterns such as those shown in Fig. 25 may be used for the above three types of decorations.

[0178] In the display example of FIG. 25, image G17 is displayed on screen D, which shows two types of algae decorated with rectangular shapes in different "colors." In this case, the name of the algae genus may be displayed near the area of ​​each algae. In addition, the names of various algae (classes) are displayed as a legend on the right side of image G17, and decorations of different "colors" are displayed for each type of algae (class).

[0179] For example, the color of the decoration corresponding to blue-green algae is blue, which is a color reminiscent of blue-green algae (a color relatively close to the color of actual blue-green algae), the color of the decoration corresponding to diatoms is brown, which is a color reminiscent of diatoms (a color relatively close to the color of actual diatoms), and the color of the decoration corresponding to green algae is green, which is a color reminiscent of green algae (a color relatively close to the color of actual green algae).This makes it easier for the user to intuitively identify the individual algae appearing in the captured image.

[0180] Display example (8) FIG. 26 shows a first modified example of the display in FIG. 24 (an example using a frame line of a different type from that in FIG. 24).

[0181] As shown in the display example of Fig. 26, a different type of frame line is displayed in image G18 than the frame line shown in the display example of Fig. 24. For example, by adopting a frame line that occupies a small number of pixels as in the display example of Fig. 26, the display within the image can be simplified.

[0182] Display example (9) FIG. 27 shows a second modified example of the display in FIG. 24 (an example using a frame line of a different type from that in FIG. 24).

[0183] As shown in the display example of Fig. 27, a different type of frame line is displayed in image G19 from the frame line shown in the display example of Fig. 24. By using a curved frame line that matches the peripheral shape of each algae, as in the display example of Fig. 27, the user can accurately grasp the area of ​​each algae.

[0184] Display example (10) FIG. 28 shows a third modified example of the display in FIG. 24 (an example in which information on measured quantities such as area and length for each algae is further displayed).

[0185] As shown in the display example of Fig. 28, in addition to the name of the genus shown in the display example of Fig. 24, information on measured quantities such as area and length may be displayed in image G20. Note that the measured quantities are not limited to area and length, but may be the number of individuals, cells, or colonies per unit volume, or, in the case of spiral filaments, the number of turns. In this way, the user can easily obtain a lot of information about each algae at a glance.

[0186] Display example (11) Fig. 29 shows a fourth modified example (an example in which information on the type of shape of each algae is further displayed) of the display in Fig. 24. Fig. 30 shows another example of the image shown in Fig. 29.

[0187] As shown in the display example of Fig. 29, in addition to the genus name shown in the display example of Fig. 24, information on the type of shape of each algae may be displayed in image G21. Also, the above-mentioned area and length information may be displayed. In this way, the user can easily obtain more information about each algae at a glance.

[0188] In the display example of Fig. 29, "straight chain" and "colony" are displayed in image G21, but the shape type includes "spiral" in addition to "straight chain" and "colony." In the display example of Fig. 30, an example is shown in which "straight chain" and "spiral" are displayed in image G22.

[0189] Display example (12) FIG. 31 shows an example of a display in which multiple images taken at different dates and times are arranged for comparison.

[0190] In the display example of Fig. 31, a plurality of images G23 and G24 captured at different times are displayed side by side for comparison. Since the types of algae shown in the images G23 and G24 are different, the colors of the frame lines enclosing each type of algae are also different.

[0191] By displaying multiple images taken at different times side-by-side in this way for comparison, users can easily grasp the temporal changes and trends of each type of algae contained in the water.

[0192] Display example (13) Figure 32 shows an example of multiple images of different water sources displayed side by side for comparison.

[0193] In the display example of Fig. 32, a plurality of images G25 and G26 of different water sources are displayed side by side for comparison. Since the types of algae shown in the images G25 and G26 are different, the colors of the frame lines enclosing each type of algae are also different.

[0194] By displaying multiple images from different water sources side by side in this way for comparison, users can easily grasp the differences in the composition of algae contained in the water from each water source.

[0195] <User Operation Units 60-1, 60-2> The user operation unit 60-1 includes a request issuing unit 61 and a display unit 62. The user operation unit 60-2 also includes a request issuing unit 61 and a display unit 62, similar to the user operation unit 60-1.

[0196] (Request Issuer 61) The request issuing unit 61 transmits a request (user request) according to a user operation to the display control unit 30. This request may include a request to change any information displayed on the screen displayed on the display unit 62, or a request to display or hide any information. In addition, this request may include designation of the shooting date and time (period) or the detection / measurement date and time (period), designation of the type of screen to be displayed, or designation of the type of measurement amount (index value) to be displayed. These requests are transmitted to the display control unit 30.

[0197] (Display section 62) The display unit 62 displays the display screen created by the display control unit 30 in response to a request.

[0198] <Configuration with one or more devices> The functions of each unit shown in Fig. 2 may be realized by one device, or may be realized by dividing them into multiple devices. For example, the data collection unit 10 may be configured such that one device acquires and transmits data, or one device acquires data and another device transmits the data. Also, a single device may be configured such that the data retention unit 40 and the algae measurement unit 20 exist, and the algae measurement unit 20 calculates a measurement value (index value) using the data retained in the data retention unit 40 within the device.

[0199] <An example of the operation of the algae detection result display system> An example of the operation of the algae detection result display system will be described with reference to the flowchart in FIG.

[0200] First, in the data collection unit 10, the data acquisition unit 11 acquires algae data (including images) (S1). The data transmission unit 12 transmits the algae data to the database management unit M1, and the data storage unit 40 stores the data (S2).

[0201] Next, in the algae measurement unit 20, the data acquisition unit 21 acquires algae data from the data storage unit (S3). The algae detection unit 22 detects target algae based on the algae data (S4). Next, the index calculation unit 23 calculates an index value based on the algae detection results (S5). The data transmission unit 24 transmits the detection results generated by the algae detection unit 22 as well as the calculation results generated by the index calculation unit 23 (index value for each type of algae) together with information on the shooting date and time or the detection and measurement date and time to the database management unit M2, where they are stored in the data storage unit 50 (S6).

[0202] Next, in the user operation unit 60-1 or 60-2, the request issuing unit 61 issues a user request (S7). The user request may be, for example, a request to display an arbitrary screen. The arbitrary screen may correspond to the display of any of the screens shown in Figs. 19 to 32 described above. This request may also include a request to change arbitrary information displayed on the screen displayed on the display unit 62 or a request to display or hide arbitrary information.

[0203] Next, in the display control unit 30, the table display control unit 31 generates a screen displaying information such as index values ​​in a table format and displays it on the display unit 62 (S8), or the graph display control unit 32 generates a screen displaying information such as index values ​​in, for example, a time-series graph format and displays it on the display unit 62 (S9), or the detection image display control unit 33 generates a screen displaying information such as the algae detection results superimposed on the photographed image together with the photographed image and displays it on the display unit 62 (S10). The screen generated and displayed in step S10 corresponds to, for example, any of the example screens in Figures 19 to 32 described above.

[0204] In the display control unit 30, each of the display control units 31 to 33 displays information on the screen according to the user's request. For example, when the user requests to change any information on the screen displayed in step S10 or to display or hide any information, the detection screen display control unit 33 performs display processing according to the request. As a result, in the user operation unit 60-1 or 60-2, the display unit 62 displays a screen according to the user's request (S11). <An example of image processing operation for superimposing a frame on a captured image> An example of an operation related to image processing for superimposing a frame line on a captured image will be described with reference to the flowchart of Fig. 34. Here, an example of image processing for displaying a frame line in a captured image will be shown as an example. Here, the above-mentioned Figs. 12 to 16 will be referred to as appropriate.

[0205] Before performing image processing in the detection image display control unit 33, the algae detection unit 22 acquires the image G1 (captured image) shown in Fig. 12 from the data storage unit 40, and performs processing to identify the area in image G1 in which algae is captured, pixel by pixel (S20). Information indicating the area in image G1 in which algae is captured is sent to and stored in the data storage unit 50 managed by the database management unit M2.

[0206] The detection image display control unit 33 in the display control unit 30 acquires the image G1 from the data storage unit 40 and the data storage unit 50, and acquires information indicating an area in the image G1 in which the algae are shown. Then, the detection image display control unit 33 performs a binarization process on the image G1. For example, as shown in the images G2 and G3 in Figures 13(a) and (b), the color of each algae in the image G1 is converted to white, and the color of the background of each algae is converted to black.

[0207] Next, the detection image display control unit 33 creates an image in which the frame lines of the smallest rectangle circumscribing the white areas in the images G2 and G3 are superimposed (S21). For example, the white areas shown in the images G2 and G3 in Fig. 13(a) and (b) are provided with the frame lines W1 and W2 of the smallest rectangle circumscribing the areas, as shown in the images G4 and G5 in Fig. 14(a). The rotation angle (tilt) of the smallest rectangle with respect to the reference is appropriately set according to the orientation of the long and short sides of the white areas.

[0208] Next, the detection image display control unit 33 creates images by expanding the frame lines W1 and W2 of the minimum rectangles in the images G4 and G5 (S22). For example, the frame lines W1 and W2 of the minimum rectangles shown in the images G4 and G5 in Fig. 14(a) and (b) are expanded so as to move away from the white area by a certain distance, as shown in the images G6 and G7 in Fig. 15(a) and (b).

[0209] Finally, the detection image display control unit 33 creates a new image by superimposing the expanded rectangular frame lines W1 and W2 on the image G1 of Fig. 12 (S23). For example, as shown in Fig. 16, a new image G8 is created by superimposing the frame lines W1 and W2 in the images G6 and G7 of Fig. 15(a) and (b) on the image G1 of Fig. 12.

[0210] <Summary> The above-described embodiment provides at least the following advantages.

[0211] - Images equivalent to microscope images can be obtained, and the algae detection results can be displayed on the screen superimposed on the images. Therefore, the detection results can be managed in the same way as with general microscope observations.

[0212] -You can easily see where in the image and what kind of algae is in it.

[0213] - Detection results for each algae genus and species can be easily understood. This makes it possible to know the signs of problems caused by specific types of algae (e.g., odor generation, filter blockage, etc.) and to predict future trends in algae growth and types of problems.

[0214] As described above in detail, according to the embodiment, it is possible to easily understand the detection results of various types of algae.

[0215] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0216] 10...data collection unit, 11...data acquisition unit, 12...data transmission unit, 20...algae measurement unit, 21...data acquisition unit, 22...algae detection unit, 23...index calculation unit, 24...data transmission unit, 30...display control unit, 31...table display control unit, 32...graph display control unit, 33...detection image display control unit, 40...data retention unit, 50...data retention unit, 60-1...user operation unit, 60-2...user operation unit, 61...request issuance unit, 62...display unit, 111...light source, 112...container, 113...lens, 114...detector, 115...filter, 110...imaging device, D...screen, G1 to G9, G11 to G26...image, M, M1, M2...database management unit, T1, T2...algae, W1 to W7...frame line.

Claims

1. A display control unit is provided that simultaneously displays, on a display unit, an image obtained by photographing water containing algae, information showing an area in the image in which the algae is captured, and information showing the type of the algae. Algae detection result display system.

2. The display control unit is The area in the image in which the algae is present is indicated by displaying a frame surrounding the area. The algae detection result display system according to claim 1 .

3. The display control unit is The type of algae is represented by different colors or line types of the frame lines. The algae detection result display system according to claim 2 .

4. The display control unit is changing the color or line type of the border for each type of algae in response to a user request; The algae detection result display system according to claim 3 .

5. The display control unit is The area in the image in which the algae is present is displayed with a predetermined color or pattern decoration. The algae detection result display system according to claim 1 .

6. The display control unit is The type of algae is represented by a difference in color or pattern that decorates the area in which the algae is reflected. The algae detection result display system according to claim 5 .

7. The display control unit is changing the color or pattern of the decoration for each type of algae according to a user's request; The algae detection result display system according to claim 6 .

8. The display control unit is The type of algae, such as genus or species, is indicated by a letter designation; The algae detection result display system according to any one of claims 1 to 7.

9. The display control unit is changing the color of the characters for each type of algae in response to a user request; The algae detection result display system according to claim 8 .

10. The display control unit is and displaying information indicating the measured amount of the algae on the display unit. The algae detection result display system according to any one of claims 1 to 7.

11. The display control unit is and further displaying information indicating the type of shape of the algae on the display unit. The algae detection result display system according to any one of claims 1 to 7.

12. The display control unit is and displaying or hiding information representing the type of algae for each type of algae in response to a user request. The algae detection result display system according to any one of claims 1 to 7.

13. The display control unit is displaying or hiding information indicating the measured amount of algae in response to a user request; The algae detection result display system according to any one of claims 1 to 7.

14. The display control unit is displaying or hiding information indicating the type of shape of the algae in response to a user request; The algae detection result display system according to any one of claims 1 to 7.

15. The display control unit is Displaying a plurality of images taken at different dates and times on the display unit so that the images can be compared. The algae detection result display system according to any one of claims 1 to 7.

16. The display control unit is Displaying a plurality of images of water from different water sources on the display unit so that the images can be compared. The algae detection result display system according to any one of claims 1 to 7.

17. An algae detection result display method executed by an algae detection result display system, comprising: and simultaneously displaying on a display unit an image obtained by photographing water containing algae, information showing an area in the image in which the algae is captured, and information showing the type of the algae. How to display algae detection results.

18. On the computer, A program for realizing the function of simultaneously displaying on a display unit an image obtained by photographing water containing algae, information indicating the area in the image in which the algae appears, and information indicating the type of algae.

Images