Measuring devices, measuring methods, measuring systems

Abstract

To efficiently measure the target organism. [Solution] The measuring device comprises a stimulus control unit that generates an external stimulus from a stimulus generating device according to the tactile conditions of the organism, an imaging unit that images a predetermined imaging range where the external stimulus is generated, and a measuring unit that measures the target organism based on the image captured by the imaging unit.

Description

Technical Field

[0001] The present technology relates to a measuring device, a measuring method, and a measuring system, and particularly relates to a technology for measuring a target organism by applying an external stimulus to an organism exhibiting tropism.

Background Art

[0002] There has been proposed a measuring device that measures the abundance of phytoplankton by irradiating excitation light of a predetermined wavelength to excite the phytoplankton and measuring the intensity of fluorescence emitted from the excited phytoplankton (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the above-described measuring device, it is only possible to measure phytoplankton excited by excitation light. Therefore, when measuring zooplankton or larvae of aquatic organisms, a method of collecting and inspecting them with a water sampler or a plankton net is used. However, such a method takes time and cannot be measured efficiently.

[0005] Therefore, the present technology aims to efficiently measure a target organism.

Means for Solving the Problems

[0006] The measuring device according to the present technology includes a stimulus control unit that generates an external stimulus from a stimulus generator according to the tropism conditions of an organism, an imaging unit that images a predetermined imaging range where the external stimulus is generated, and a measuring unit that measures a target organism based on the image imaged by the imaging unit. With the above configuration, it becomes possible to measure the target organism by utilizing its taxis.

[0007] In the measuring device relating to the technology described above, the imaging unit may be equipped with a vision sensor that asynchronously acquires pixel data according to the amount of light incident on each of the multiple pixels arranged in two dimensions. This makes it possible to read only the pixel data of the pixel where the event occurred and to measure the target organism based on that pixel data.

[0008] In the measuring device relating to the present technology described above, the stimulus control unit is thought to generate the external stimulus that causes the target organism to exhibit positive chemotaxis. This makes it possible to gather the target organisms within the imaging range.

[0009] In the measuring device relating to the present technology described above, the stimulus control unit may generate the external stimulus that causes a non-target organism, other than the target organism, to exhibit negative taxis. This makes it possible to exclude non-target organisms from the imaging range.

[0010] In the measuring device relating to the present technology described above, the stimulus control unit may generate an external stimulus that causes a non-target organism (other than the target organism) to exhibit negative taxis, and the target organism to not exhibit negative taxis. This makes it possible to exclude non-target organisms from the imaging range while reducing the risk of excluding target organisms from the imaging range.

[0011] In the measuring device relating to the present technology described above, the stimulus control unit may generate the external stimulus that does not cause the target organism to exhibit taxis. This makes it possible to perform imaging without being affected by external stimuli.

[0012] In the measuring device relating to the present technology described above, the external stimulus is light, and the stimulus control unit may irradiate the target organism with light that does not exhibit taxis. This makes it possible to take measurements even in a dark external environment, without the target organism exhibiting taxis.

[0013] In the measuring device relating to the present technology described above, the imaging unit may be moved along a predetermined direction while imaging is performed. This enables measurements over a wide area.

[0014] In the measuring device relating to the present technology described above, the measuring unit may derive information based on the behavior of the target organism when it exhibits taxis, based on the image captured by the imaging unit, and identify the target organism based on the information. This makes it possible to measure organisms that exhibit taxis.

[0015] In the measuring device relating to the present technology described above, the measuring unit is capable of deriving at least one of the number, density, and average activity level of the target organisms. This makes it possible to measure the actual characteristics of the target organism.

[0016] In the measuring device relating to the present technology described above, the imaging unit may include the vision sensor and an imaging sensor that captures images at regular intervals according to the frame rate. This makes it possible to measure the target organism using either or both of the images captured by the vision sensor and / or imaging sensor.

[0017] In the measuring device relating to the technology described above, the stimulus control unit may irradiate light of a specific wavelength and intensity from the stimulus generating device, or generate heat. This makes it possible to measure target organisms by utilizing their taxis or thermotaxis.

[0018] In the measuring device according to the present technology described above, the stimulation control unit may cause the stimulation generator to release a specific substance. This makes it possible to measure organisms that exhibit tropism to a specific substance.

[0019] In the measuring method according to the present technology described above, an external stimulus corresponding to the tropism condition of an organism is generated from a stimulus generator, an imaging range where the external stimulus is output is imaged, and the target organism is measured based on the captured image. Such a measuring method also provides the same operation as the measuring device according to the present technology described above.

[0020] In the measuring system according to the present technology described above, a stimulus generator that generates an external stimulus corresponding to the tropism condition of an organism, a stimulation control unit that generates the external stimulus from the stimulus generator, an imaging unit that images a predetermined imaging range where the external stimulus is output, and a measuring unit that measures the target organism based on the image captured by the imaging unit are provided. Such a measuring system also provides the same operation as the measuring device according to the present technology described above.

Brief Description of the Drawings

[0021] [Figure 1] It is a diagram for explaining the configuration of the measuring system of the embodiment. [Figure 2] It is a diagram for explaining an example of measurement settings. [Figure 3] It is a diagram for explaining an example of an operation time sheet. [Figure 4] It is a flowchart showing the processing procedure of the measuring method. [Figure 5] It is a diagram for explaining the definition information of the target organism. [Figure 6] It is a diagram for explaining an example of the trajectory of the detected object and the image. [Figure 7] It is a diagram for explaining an example of the identification result. [Figure 8] It is a diagram for explaining the wavelength of the light irradiated in Use Example 1. [Figure 9] This diagram illustrates the wavelength of the light emitted in Example 2. [Figure 10] This diagram illustrates the wavelength of the light emitted in Example 3. [Figure 11] This diagram illustrates the measurement process in Example 4. [Figure 12] This diagram illustrates an example of how a measurement system is used in aquaculture farms. [Figure 13] This diagram illustrates the configuration of a measurement system in a modified example. [Figure 14] This diagram illustrates the configuration of a measurement system in a modified example. [Modes for carrying out the invention]

[0022] The embodiments will be described below in the following order. <1. Measurement System Configuration> <2. Measurement Process> <3. Usage example> [3-1. Usage example 1] [3-2. Usage example 2] [3-3. Usage example 3] [3-4. Usage example 4] <4. Specific Examples> [4-1. Specific Example 1] [4-2. Specific Example 2] [4-3. Specific Example 3] <5. Other configuration examples of the measurement system> <6. Summary> <7. This Technology>

[0023] <1. Measurement System Configuration> First, the configuration of the measurement system 1 as an embodiment of this technology will be described. Measurement System 1 is a system that measures target organisms by utilizing the taxis of organisms such as microorganisms contained in seawater or flying organisms in the air. Here, measurement is a concept that includes at least one of the following: identification of the species, number, activity level, density, or characteristics of the target organism, or recording or storing images of the target organism. Furthermore, the target organisms are not limited to organisms that exhibit taxis, but also include organisms that do not exhibit taxis.

[0024] Here, taxis are an innate behavior in which organisms respond to directional external stimuli. External stimuli include light, pressure, gravity, chemical substances (pheromones), electricity, vibration, temperature, and contact. For example, taxis in response to light are called taxis, and taxis in response to temperature are called thermotaxis. Furthermore, movement toward the source of an external stimulus is called positive taxis, and movement toward the source of an external stimulus is called negative taxis.

[0025] For example, the protozoan flagellate Euglena genus moves towards the light source when exposed to light. In this example, the directional external stimulus is light, and Euglena exhibits positive phototaxis. Furthermore, when nematodes are placed in an environment with a temperature gradient, they move towards the temperature field that is considered optimal for them (approximately 25°C). In this example, the directional external stimulus is temperature, and the nematodes exhibit thermotaxis.

[0026] As described above, certain organisms are known to exhibit taxis. Measurement system 1 utilizes the taxis of such organisms to perform measurements on target organisms. Organisms exhibiting taxis can be found in both plants and animals. Therefore, measurement system 1 is not limited to either plants or animals, and is capable of measuring target organisms.

[0027] Figure 1 is a diagram illustrating the configuration of the measurement system 1 of an embodiment. As shown in Figure 1, the measurement system 1 includes a measuring device 2 and a stimulus generating device 3.

[0028] The measuring device 2 controls each device of the measuring system 1 (measuring device 2 and stimulus generating device 3) as appropriate and performs measurements on the target organism using the organism's taxis. The measuring device 2 includes a control unit 10, a memory 11, a communication unit 12, a gravity sensor 13, an imaging unit 14, and a lens 15.

[0029] The control unit 10 is configured with, for example, a microcomputer having a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and performs overall control of the measurement system 1. In this embodiment, the control unit 10 functions as a stimulus control unit 21, an imaging control unit 22, and a class identification unit 23. The stimulus control unit 21, the imaging control unit 22, and the class identification unit 23 will be described in detail later. Furthermore, the control unit 10 performs data reading processing from the memory 11, processing to store data in the memory 11, and sending and receiving various types of data with external devices via the communication unit 12.

[0030] Memory 11 is composed of non-volatile memory. The communication unit 12 performs wired or wireless data communication with external devices. The gravity sensor 13 detects gravitational acceleration (direction of gravity) and outputs the detection result to the control unit 10. Note that the measuring device 2 does not necessarily have to be equipped with the gravity sensor 13.

[0031] The imaging unit 14 includes a vision sensor 14a and an imaging sensor 14b. The vision sensor 14a is a sensor called a DVS (Dynamic Vision Sensor) or EVS (Event-Based Vision Sensor). The vision sensor 14a captures a predetermined imaging range through the lens 15.

[0032] The vision sensor 14a is an asynchronous image sensor in which multiple pixels having photoelectric conversion elements are arranged in two dimensions, and a detection circuit for detecting address events in real time is provided for each pixel. An address event is an event that occurs for each address assigned to each of the multiple pixels arranged in two dimensions, and is, for example, when the current value of the current based on the charge generated by the photoelectric conversion element, or the amount of change thereof, exceeds a certain threshold.

[0033] The vision sensor 14a detects whether or not an address event has occurred for each pixel, and if an address event is detected, it reads out the pixel signal as pixel data from the pixel where the address event occurred.

[0034] In the vision sensor 14a, the pixel signal readout operation is performed for pixels where an address event has been detected. This allows for significantly faster readout than a synchronous image sensor, where the readout operation is performed for all pixels at a predetermined frame rate, and also results in a smaller amount of data being read out per frame.

[0035] Therefore, the measurement system 1 can detect the movement of the target organism more quickly by using the vision sensor 14a. In addition, the vision sensor 14a can reduce the amount of data and also reduce power consumption.

[0036] The image sensor 14b is, for example, a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide-Semiconductor) type image sensor, in which multiple pixels having photoelectric conversion elements are arranged in two dimensions. The image sensor 14b generates image data by capturing a predetermined imaging range through the lens 15 at regular intervals according to the frame rate. In the measuring device 2, a zone plate, pinhole plate, or transparent plate can be used instead of the lens 15.

[0037] The vision sensor 14a and the imaging sensor 14b are positioned to image substantially the same area through the lens 15. For example, a half-mirror (not shown) can be placed between the vision sensor 14a and the imaging sensor 14b and the lens 15, so that one portion of the light split by the half-mirror is incident on the vision sensor 14a and the other portion is incident on the imaging sensor 14b.

[0038] The stimulus generating device 3 is a device that generates (outputs) an external stimulus to the imaging range captured by the imaging unit 14, and delivers the external stimulus to organisms present in the imaging range. It is equipped with a photothermal generating device 30 and a stimulant substance releasing device 31.

[0039] The photothermal generator 30 comprises an illumination device 30a (light source) that irradiates light onto the imaging area and a heat source device 30b (heat source) that provides heat to the imaging area. The illumination device 30a is driven based on the control of the control unit 10 and can change the wavelength and intensity of the light irradiated onto the imaging area. The heat source device 30b is driven based on the control of the control unit 10 and can change the temperature of the imaging area.

[0040] The stimulant release device 31 includes, for example, a container with an opening / closing door that contains a pheromone (stimulant, chemical substance) inside, and can release the pheromone into the imaging range by opening and closing the opening / closing door based on the control of the control unit 10.

[0041] Although the lighting device 30a and the heat source device 30b are shown as being integrated into the photothermal generator 30, they may be provided as separate components. Furthermore, since light and temperature are common external stimuli that cause organisms to exhibit taxis, it is desirable that the stimulus generator 3 be equipped with at least a lighting device 30a and a heat source device 30b for versatility. However, the stimulus generator 3 may be equipped only with a stimulant release device 31 that releases stimulant substances as external stimuli. In other words, the stimulus generator 3 only needs to be equipped with a device that generates at least one external stimulus, and does not need to be equipped with any of the lighting device 30a, heat source device 30b, and stimulant release device 31. Furthermore, the stimulus generating device 3 may also include a device that generates light, temperature, and an irritating substance as an external stimulus, or a combination of two or more of these, namely, a lighting device 30a, a heat source device 30b, and an irritating substance emission device 31, or a combination of two or more of these.

[0042] Furthermore, the stimulus generating device 3 may be equipped with a device that generates external stimuli other than light, temperature, and pheromones. The stimulus generating device 3 may generate external stimuli corresponding to the taxis conditions that cause organisms to exhibit taxis, such as pressure, gravity, electricity, vibration, and contact.

[0043] <2. Measurement Method as an Embodiment> Next, we will describe an overview of the measurement method for target organisms as an embodiment. Figure 2 illustrates an example of measurement settings. Figure 3 illustrates an example of an operation time sheet.

[0044] The control unit 10 performs measurements according to the pre-specified measurement settings shown in Figure 2. The measurement settings specify the measurement start conditions, the operation time sheet for the stimulus generator 3, the identification program (identification method), and the measurement end conditions.

[0045] The measurement start conditions specify the conditions for starting the measurement, such as the time to start the measurement, or the receipt of a measurement start command input via the communication unit 12.

[0046] The operation time sheet specifies the time sheet for generating external stimuli from the stimulus generator 3 according to the taxis conditions, which are the conditions for external stimuli that cause organisms to exhibit taxis. For example, in the operation time sheet shown in Figure 3A, the lighting device 30a is controlled not to emit light, the heat source device 30b is controlled not to output heat, and the stimulant substance release device 31 is controlled not to release pheromones until 5 minutes have elapsed from the start of measurement. In addition, from 5 minutes to 10 minutes after the start of measurement, the lighting device 30a emits 3 W / m² at a wavelength of 420 nm. 2 The system is controlled to irradiate the device with light of a certain intensity, preventing heat output from the heat source device 30b and pheromone release from the irritant release device 31. Furthermore, from 10 minutes to 15 minutes after the start of measurement, the system is controlled to prevent light irradiation from the lighting device 30a, heat output from the heat source device 30b, and pheromone release from the irritant release device 31. Furthermore, from 15 minutes to 20 minutes after the start of measurement, the lighting device 30a emits light at a wavelength of 420 nm and a power of 10 W / m². 2 The device is irradiated with light of a certain intensity, and controlled so that heat is not output from the heat source device 30b and pheromones are not released from the stimulating substance release device 31.

[0047] Furthermore, in the operation time sheet shown in Figure 3B, the system is controlled so that light is not emitted from the illumination device 30a, heat is not output from the heat source device 30b, and pheromones are not released from the stimulant release device 31 until 1 minute has elapsed from the start of measurement. Also, from 1 minute after the start of measurement until 11 minutes have elapsed, light with a wavelength increasing by 20 nm every minute from 400 nm is emitted at 5 W / m 2 The lighting device 30a is sequentially irradiated with light at the specified intensity, the heat source device 30b outputs heat so that the measurement range is 15°C, and the irritant emission device 31 is controlled not to release pheromones. In addition, from 11 minutes after the start of measurement until 21 minutes have passed, light with a wavelength increasing by 20 nm every minute from 400 nm is emitted at 5 W / m². 2The light source 30a is sequentially irradiated with light at the specified intensity, the heat source 30b is output to maintain a measurement range of 20°C, and the stimulant release device 31 is controlled to prevent the release of pheromones. Furthermore, from 21 minutes to 31 minutes after the start of measurement, light with a wavelength increasing by 20 nm every minute from 400 nm is emitted at 5 W / m². 2 The lighting device 30a is sequentially irradiated at the specified intensity, the heat source device 30b outputs heat so that the measurement range is 25°C, and the stimulant emission device 31 is controlled not to release pheromones.

[0048] Thus, the operation time sheet specifies what kind of external stimuli the stimulus generator 3 should generate and at what timing within the measurement range.

[0049] The identification program specifies a program (method) for identifying the target organism, such as machine learning-based identification, rule-based identification, or identification using input / output parameters.

[0050] The measurement termination conditions specify the conditions for ending the measurement, such as the time at which the measurement will end, or the receipt of a measurement termination command input via the communication unit 12.

[0051] Figure 4 is a flowchart of the measurement method's processing procedure. As shown in Figure 4, in step S1, the control unit 10 determines whether the measurement start condition specified in the measurement settings has been met. The control unit 10 then repeats step S1 until the measurement start condition is met.

[0052] On the other hand, if the measurement start condition is met (Yes in step S1), in step S2 the stimulus control unit 21 operates the stimulus generator 3 to generate an external stimulus corresponding to the chemotaxis condition of the organism, according to the operation time sheet specified in the measurement settings. In step S3 the imaging control unit 22 controls the imaging unit 14 to image the imaging range and acquire pixel data and image data. Then, in step S4 the class identification unit 23 performs the identification process.

[0053] In the identification process, the class identification unit 23 performs measurements on the target organism based on the image (pixel data and image data) captured by the imaging unit 14. In this embodiment, the class identification unit 23 derives identification information from the image captured by the imaging unit 14 for each external stimulus condition and detects the target organism by comparing it with definition information stored in the memory 11. The class identification unit 23 also derives identification results such as the number of detected target organisms, density, and average activity level.

[0054] Figure 5 is a diagram illustrating the definition information of the target organism. Figure 6 is a diagram illustrating an example of the trajectory and image of the detected object. Figure 7 is a diagram illustrating an example of the identification result.

[0055] Definition information, as shown in Figure 5, is provided for each target organism and stored in memory 11. The definition information includes the species (organism name), external stimulus information, tactic response information, and image information of the target organism. The external stimulus information indicates the conditions under which the target organism exhibits tactic response to external stimuli.

[0056] Taxis response information is information detected primarily based on images captured by the vision sensor 14a, and is based on the behavior taken by the target organism when it exhibits taxis in response to an external stimulus. Taxis response information includes, for example, information such as the direction of movement (positive or negative), velocity, and trajectory relative to the source of the external stimulus. Note that taxis response information may also be information detected based on images captured by the imaging sensor 14b. The taxis response information illustrated in Figure 5 is merely an example, and some information may be omitted, or other information may be included.

[0057] Image information is information detected mainly based on images captured by the imaging sensor 14b, and is information about the external shape of the target organism. Image information may include, for example, information such as the size of the target organism and whether or not it has tentacles. Note that image information may also be information detected based on images captured by the vision sensor 14a. The image information exemplified in Figure 5 is merely an example, and some information may be omitted, or other information may be included.

[0058] This definition information will be stored in memory 11 in a different way for each identification program. For example, in a rule-based identification program, the definition information is pre-set by the user and stored in memory 11. In a machine learning identification program, the definition information is generated and updated by machine learning in learning mode and stored in memory 11.

[0059] Furthermore, the definition information may include the direction of gravity detected by the gravity sensor 13 and external environmental information acquired via the communication unit 12. Examples of external environmental information include electrical conductivity, temperature, pH, gas concentrations (e.g., methane, hydrogen, helium), and metal concentrations (e.g., manganese, iron).

[0060] The class identification unit 23 detects objects present in the imaging range based on the image (pixel data) captured by the vision sensor 14a. For example, the class identification unit 23 creates a single frame data based on the pixel data input within a predetermined period, and detects a group of pixels within a predetermined range in which motion is detected as an object within that frame data.

[0061] Furthermore, as shown in Figures 6A and 6C, the class identification unit 23 tracks the object across multiple frame data using pattern matching or the like. Based on the object tracking results, the class identification unit 23 derives the direction of movement, velocity, and trajectory relative to the stimulus source as identification information. In Figures 6A and 6C, the position of the object for each frame data is shown by black circles. In the example in Figure 6A, the object moves in a spiral, while in the example in Figure 6C, the object moves in a meandering manner.

[0062] Furthermore, the period during which the class identification unit 23 generates frame data from pixel data may be the same as, or shorter than, the period (frame rate) during which the imaging sensor 14b acquires image data.

[0063] Furthermore, the class identification unit 23 extracts the image portion corresponding to the object from the image data input from the imaging sensor 14b, as shown in Figures 6B and 6D, for the object whose identification information has been derived. Figure 6B is an image of the object that followed the trajectory shown in Figure 6A, and Figure 6D is an image of the object that followed the trajectory shown in Figure 6C.

[0064] The class identification unit 23 then derives identification information such as the size of the object and the presence or absence of tactile sensation based on the extracted image portion through image analysis. Since known methods can be used for image analysis, their explanation is omitted here.

[0065] The class identification unit 23 determines whether an object is one of the target organisms by comparing the identification information (direction of movement, trajectory, speed, size, presence or absence of touch) derived from the external stimulus generated by the stimulus generator 3 and the detected object with definition information according to a specified identification program. Here, for example, if the identification information of the derived object falls within the range indicated in the definition information of the target organism, the class identification unit 23 identifies the derived object as the species indicated in that definition information.

[0066] The class identification unit 23 then derives the number of each target organism (species) by counting the detected target organisms by species, as shown in Figure 7. The class identification unit 23 also derives the density and average activity level for each target organism. The density is derived based on the number of target organisms relative to the imaging range, and the average activity level is derived based on the speed of the target organisms. As shown in Figure 7, for objects other than target organisms, the number, density, and average activity level are derived for each similar characteristic, such as "unknown A" and "unknown B".

[0067] Subsequently, in step S5 (see Figure 4), the class identification unit 23 outputs the identification results, such as the type, number, density, and average activity level of the detected target organisms, or the image captured by the imaging sensor 14b, which is stored in the memory 11 or transmitted to an external device via the communication unit 12.

[0068] In step S6, the control unit 10 determines whether the measurement termination condition specified in the measurement settings has been met. The control unit 10 then repeats steps S2 to S5 until the measurement termination condition is met. If the measurement termination condition is met (Yes in step S6), the control unit 10 stops the stimulus generator 3 and terminates imaging by the imaging unit 14, thereby ending the process.

[0069] <3. Usage example> The following describes examples of how to use the measurement system 1. In examples 1 to 4 described below, light is generated from the illumination device 30a as an external stimulus, and no external stimuli (heat, pheromones) are generated from the heat source device 30b and the irritant emission device 31. Therefore, the explanation of how to control the heat source device 30b and the irritant emission device 31 will be omitted.

[0070] [3-1. Usage example 1] Figure 8 illustrates the wavelength of light emitted in Example 1. In Example 1, the stimulus generator 3 generates an external stimulus that causes the target organism to exhibit positive taxis.

[0071] For example, suppose the target organism exhibits a relationship between its motion and wavelength as shown in Figure 8. In such a case, since the target organism exhibits positive motion in the wavelength range R1, the measurement settings are specified to illuminate the imaging area from the illumination device 30a with light within the wavelength range R1 in which the target organism exhibits positive motion. The stimulus control unit 21 then illuminates the imaging area from the illumination device 30a with light within the wavelength range R1 in which the target organism exhibits positive motion, according to the measurement settings.

[0072] While the target organism is being illuminated by light from the stimulus generator 3 that indicates positive kinetic activity, the imaging control unit 22 causes the vision sensor 14a to acquire pixel data and the imaging sensor 14b to acquire image data.

[0073] The class identification unit 23 derives the identification result of the target organism based on the pixel data and image data acquired by the imaging unit 14.

[0074] In Example 1, light that exhibits positive phototaxis towards the target organism is shone into the imaging area, causing the organism within the imaging area to move towards the light source. Additionally, in Example 1, the organism outside the imaging area will move into the imaging area in order to move towards the light source. Therefore, Example 1 allows for efficient determination of the presence or absence of the target organism.

[0075] [3-2. Usage example 2] Figure 9 illustrates the wavelength of light irradiated in Example 2. Unlike Example 1, in Example 2, the stimulus generator 3 generates an external stimulus that causes organisms other than the target organism (hereinafter referred to as non-target organisms) to exhibit negative taxis. In Example 2, it is desirable that the stimulus generator 3 generates an external stimulus that causes non-target organisms to exhibit negative taxis, while the target organism does not. However, if the external stimulus exhibits relatively weak negative taxis, such as a slower speed due to taxis compared to non-target organisms, it is acceptable to generate an external stimulus that causes the target organism to exhibit negative taxis.

[0076] For example, suppose the non-target organism exhibits a relationship between its motion and wavelength as shown in Figure 9. In this case, since the non-target organism exhibits negative motion in the wavelength range R10, the measurement settings are specified to illuminate the imaging area from the illumination device 30a with light within the wavelength range R10 in which the non-target organism exhibits negative motion. The stimulus control unit 21 then illuminates the imaging area from the illumination device 30a with light within the wavelength range R10 in which the non-target organism exhibits negative motion, according to the measurement settings.

[0077] While the imaging control unit 22 is irradiating the non-target organism with light that exhibits negative tactile behavior from the stimulus generator 3, it causes the vision sensor 14a to acquire pixel data and the imaging sensor 14b to acquire image data.

[0078] The class identification unit 23 derives the identification result of the target organism based on the pixel data and image data acquired by the imaging unit 14.

[0079] In Example 2, light that exhibits negative phototaxis in non-target organisms is shone into the imaging area. As a result, non-target organisms present in the imaging area will move away from the light source, i.e., out of the imaging area. Therefore, in Example 2, non-target organisms are excluded from the imaging area, enabling efficient measurements focused on the target organisms.

[0080] [3-3. Usage example 3] Figure 10 illustrates the wavelength of light emitted in Example 3. Unlike Examples 1 and 2, in Example 3, the stimulus generator 3 generates an external stimulus that does not cause the target organism to exhibit taxis (positive and negative taxis). Note that an external stimulus that does not cause taxis includes not only an external stimulus that does not cause taxis at all, but also an external stimulus that causes taxis but in a smaller proportion compared to other external stimuli.

[0081] For example, suppose two target organisms exhibit the relationship between their meteoroidism and wavelength as shown in Figure 10. In this case, one target organism shows meteoroidism to light in the wavelength range R20, and the other target organism shows meteoroidism to light in the wavelength range R21. Therefore, the measurement settings are specified to illuminate the imaging area from the illumination device 30a with light in the wavelength range R22, which neither target organism shows meteoroidism to. The stimulus control unit 21 then illuminates the imaging area from the illumination device 30a with light in the wavelength range R22, which neither target organism shows meteoroidism to, according to the measurement settings.

[0082] While the imaging control unit 22 is irradiating light from the stimulus generator 3 that does not cause both target organisms to exhibit motility, it causes the vision sensor 14a to acquire pixel data and the imaging sensor 14b to acquire image data.

[0083] The class identification unit 23 derives the identification result of the target organism based on the pixel data and image data acquired by the imaging unit 14.

[0084] When measuring target organisms in locations where natural light does not reach, such as at night or in the deep sea, it is necessary to illuminate the imaging area with illumination light. However, if the illumination light that causes the target organisms to exhibit taxis is shone into the imaging area, accurate measurements of the target organisms within the imaging area will become impossible. Specifically, if the illumination light that causes the target organisms to exhibit positive taxis is shone into the imaging area, the number of target organisms in the imaging area will increase. Conversely, if the illumination light that causes the target organisms to exhibit negative taxis is shone into the imaging area, the number of target organisms in the imaging area will decrease.

[0085] Therefore, in Example 3, the illumination light that does not cause the target organism to exhibit taxis is shone into the imaging area, allowing images to be captured without affecting the target organism, and enabling efficient measurements in its natural environment.

[0086] [3-4. Usage example 4] Figure 11 illustrates the measurement in Example 4. In Example 4, the measuring device 2 moves while imaging, as in Example 3. Therefore, the illumination device 30a irradiates the imaging area with light within the wavelength range R22 in which neither target organism exhibits tactile behavior, similar to Example 3.

[0087] Then, as shown in Figure 11, the measuring device 2 moves, for example, along the optical axis of the light emitted from the photothermal generator 30 of the stimulation generating device 3. The measuring device 2 may be connected to a moving mechanism (not shown) and its movement may be controlled by the control unit 10, or it may be moved manually. Furthermore, the measuring device 2 only needs to be able to move along a predetermined direction; for example, it may move along the direction of gravity, or it may move along a direction perpendicular to the optical axis of the light emitted from the photothermal generator 30.

[0088] Then, while the measuring device 2 is moving along the optical axis, the imaging control unit 22 causes the vision sensor 14a to acquire pixel data and the imaging sensor 14b to acquire image data.

[0089] The class identification unit 23 derives the identification result of the target organism based on the pixel data and image data acquired by the imaging unit 14.

[0090] In Example 4, the imaging range moves, making it possible to measure target organisms over a wide area. Also, in Example 4, for example, if the optical axis direction and the direction of gravity coincide, and the measuring device 2 is moved in the direction of gravity, it becomes possible to measure the distribution of target organisms in the direction of gravity.

[0091] <4. Specific Examples> Measurement System 1 is intended for use both underwater and on land. For example, in water, Measurement System 1 is intended to measure target organisms such as feed organisms (rotifers, Artemia, copepods), parasites that infest farmed animals (fish lice, parasitic copepods, parasitic ciliates, skin flukes), larvae of deep-sea animals, zooplankton endemic to hydrothermal plumes, phytoplankton that cause red tides, and fish. Furthermore, on land, Measurement System 1 is intended to measure harmful insects such as mosquitoes, moths, and flies. Specific examples will be provided below.

[0092] [4-1. Specific Example 1] Figure 12 illustrates an example of how the measurement system 1 is used in a fish farm. In Specific Example 1, as shown in Figure 12, the measurement system 1 is placed within the fish farm to estimate the amount of brine shrimp larvae used as feed in fish farming. In Specific Example 1, machine learning is specified as the identification program.

[0093] In this case, the class identification unit 23 estimates the number of brine shrimp (larval quantity) using machine learning in the environment of the aquaculture farm where zooplankton and floating matter such as dust are present.

[0094] Here, brine shrimp are known to exhibit remarkable taxis to light with a wavelength of around 420 nm. In addition, copepods, which make up the vast majority of zooplankton communities (more than 80% on average), are known to exhibit remarkable taxis to light with a wavelength of around 400-500 nm.

[0095] Therefore, in learning mode, the stimulation control unit 21 irradiates each liquid sample, which contains only one brine shrimp, one copepod, and one dust, with light at wavelengths of 420 nm and 530 nm from the illumination device 30a. The imaging control unit 22 operates the imaging unit 14 to capture images while the stimulation generator 3 is irradiating with light of each wavelength.

[0096] The class identification unit 23 learns identification information for brine shrimp, copepods, and dust using the images captured by the imaging unit 14 as training data.

[0097] Therefore, in learning mode, definition information for brine shrimp, copepods, and dust is generated based on the identification information obtained when irradiated with 420 nm wavelength light and when irradiated with 530 nm wavelength light, respectively.

[0098] Then, in a farm containing brine shrimp, zooplankton, and dust, the stimulation control unit 21 irradiates light with wavelengths of 420 nm and 530 nm from the illumination device 30a. The imaging control unit 22 operates the imaging unit 14 to capture images while the stimulation generator 3 is irradiating with light of each wavelength.

[0099] The class identification unit 23 uses the definition information learned in learning mode, based on the image captured by the imaging unit 14, to derive the amount of brine shrimp larvae (identification result). Thus, by pre-learning the characteristics of the target organism through machine learning, the measurement system 1 can efficiently and accurately derive identification results for the target organism in an unknown liquid sample.

[0100] [4-2. Specific Example 2] In Specific Example 2, we will estimate the number of juvenile fish that generally inhabit shallow sea areas. Furthermore, in Specific Example 2, a rule-based identification program is specified. Here, the juvenile fish being measured are assumed to have visual sensitivity to green light, and to have visual sensitivity to blue light as they mature. In other words, the juvenile fish being measured exhibit taxis to light with a wavelength of around 550 nm (green light).

[0101] In this case, the stimulus control unit 21 irradiates light with a wavelength of 550 nm from the illumination device 30a. The imaging control unit 22 operates the imaging unit 14 to capture an image while the stimulus generator 3 is irradiating light. The class identification unit 23 derives the identification result of the juvenile fish based on the image captured by the imaging unit 14, using the definition information stored in the memory 11 according to the rule base.

[0102] [4-3. Specific Example 3] In Specific Example 3, we will estimate the number of nematodes present in the soil. Furthermore, in Specific Example 3, a rule-based identification program is specified. Here, the nematodes being measured are known to exhibit thermotaxis, meaning they move to a temperature field of around 25°C.

[0103] The stimulation control unit 21 operates the heat source device 30b so that the measurement range is 25°C. The imaging control unit 22 operates the imaging unit 14 to capture an image while the temperature is controlled by the heat source device 30b.

[0104] The class identification unit 23 derives a nematode identification result based on the image captured by the imaging unit 14, using definition information stored in the memory 11 according to a rule base.

[0105] <5. Other configuration examples of the measurement system> It should be noted that the embodiments are not limited to the specific examples described above, and various other modified configurations are possible.

[0106] In the embodiment described above, the measurement system 1 is provided with one measuring device 2 and one stimulus generating device 3. However, the number of measuring devices 2 and stimulus generating devices 3 is not limited to one, and may be provided with multiple devices.

[0107] Figure 13 illustrates the configuration of a modified measurement system 100. As shown in Figure 13, the modified measurement system 100 comprises one measuring device 2 and two stimulus generating devices 3 (photothermal generators 30). The two photothermal generators 30 are arranged so that light can be irradiated in directions orthogonal to each other, and light of different wavelengths can be irradiated onto the imaging range. In such a measurement system 100, since light of different wavelengths can be irradiated from two photothermal generators 30, identification information of target organisms that exhibit kinetic activity in response to light of different wavelengths can be derived in a single measurement, enabling efficient measurement.

[0108] Figure 14 is a diagram illustrating the configuration of a modified measurement system 200. As shown in Figure 14, the modified measurement system 200 comprises two measuring devices 2 and one stimulus generating device 3 (photothermal generator 30). The two measuring devices 2 are arranged to enable the acquisition of images in mutually orthogonal directions. In such a measurement system 100, images can be captured by two measuring devices 2 (imaging units 14), making it possible to detect the three-dimensional movement of an object and perform measurements more efficiently. Furthermore, if two measuring devices 2 are provided, one of the measuring devices 2 may be equipped only with an imaging unit 14.

[0109] Furthermore, in the embodiment described above, the imaging unit 14 is equipped with a vision sensor 14a and an imaging sensor 14b. However, the imaging unit 14 may be equipped with only one of the vision sensor 14a or the imaging sensor 14b, as long as it can capture an image from which identification information indicating tactile behavior can be derived. Alternatively, the imaging unit 14 may be equipped with a SPAD (Single Photon Avalanche Diode) sensor instead of the vision sensor 14a and the imaging sensor 14b.

[0110] Furthermore, in the above embodiment, identification information is derived based on pixel data acquired by the vision sensor 14a and image data acquired by the imaging sensor 14b. However, identification information may be derived based on either or both of the pixel data acquired by the vision sensor 14a and the image data acquired by the imaging sensor 14b. Alternatively, the imaging sensor 14b may be stopped and only the vision sensor 14a may be driven, and both the vision sensor 14a and the imaging sensor 14b may be driven when pixel data is acquired by the vision sensor 14a.

[0111] Furthermore, in the embodiment described above, the illumination device 30a is capable of changing the wavelength and intensity of the emitted light. However, in addition to the wavelength and intensity of the emitted light, or alternatively, the illumination device 30a may also be capable of changing the presence or absence of flashing, the frequency of flashing, the presence or absence of polarization, the direction of polarization, the size of the light source, the shape of the light source, gravity, and the orientation of the light source relative to the orientation of the measuring device 2 or the direction of movement, depending on the taxis of the organism.

[0112] <6. Summary of Embodiments> As described above, the measurement device 2 of the embodiment includes a stimulus control unit 21 that generates external stimuli from a stimulus generator 3 according to the tactile conditions of an organism, an imaging unit 14 that images a predetermined imaging range where the external stimulus is generated, and a measurement unit (class identification unit 23) that measures the target organism based on the image captured by the imaging unit 14. With the above configuration, it becomes possible to measure the target organism by utilizing its taxis. Therefore, the measuring device 2 can efficiently measure plants and animals as target organisms by utilizing their taxis.

[0113] In the measuring device 2 related to the technology described above, the imaging unit 14 is equipped with a vision sensor 14a that acquires pixel data asynchronously according to the amount of light incident on each of the multiple pixels arranged in two dimensions. This makes it possible to read only the pixel data of the pixel where the event occurred and to measure the target organism based on that pixel data. Therefore, the measuring device 2 can reduce power consumption.

[0114] In the measurement device 2 related to the technology described above, the stimulus control unit 21 generates an external stimulus that causes the target organism to exhibit positive chemotaxis. This makes it possible to gather the target organisms within the imaging range. Therefore, the measuring device 2 can efficiently measure the presence or absence of the target organism.

[0115] In the measurement device 2 related to the technology described above, the stimulus control unit 21 generates an external stimulus that causes a non-target organism, which is not the target organism, to exhibit negative taxis. This makes it possible to exclude non-target organisms from the imaging range. Therefore, the measuring device 2 can exclude non-target organisms and focus on measuring only the target organisms.

[0116] In the measuring device 2 related to the technology described above, the stimulus control unit 21 generates an external stimulus that causes non-target organisms (those other than the target organism) to exhibit negative taxis, and the target organism to not exhibit negative taxis. This makes it possible to exclude non-target organisms from the imaging range while reducing the risk of excluding target organisms from the imaging range. Therefore, the measuring device 2 can accurately measure the target organism.

[0117] In the measuring device 2 related to the technology described above, the stimulus control unit 21 generates an external stimulus that does not cause the target organism to exhibit chemotaxis. This makes it possible to perform imaging without being affected by external stimuli. Therefore, the measuring device 2 can accurately measure the target organism without being affected by external stimuli.

[0118] In the measurement device 2 related to the technology described above, the external stimulus is light, and the stimulus control unit 21 irradiates the target organism with light that does not cause it to exhibit chemotaxis. This makes it possible to take measurements even in a dark external environment, without the target organism exhibiting taxis. Therefore, the measuring device 2 can accurately measure the target organism without being affected by external stimuli.

[0119] In the measuring device 2 related to the present technology described above, the imaging unit 14 performs imaging while being moved along a predetermined direction. This enables measurements over a wide area. Therefore, the measuring device 2 can measure the target organism over a wider range.

[0120] In the measuring device 2 related to the technology described above, the measuring unit (class identification unit 23) derives information (identification information) based on the behavior taken by the target organism when it exhibits taxis, based on the image captured by the imaging unit 14, and identifies the target organism based on the information. This makes it possible to measure organisms that exhibit taxis. Therefore, the measuring device 2 can accurately identify the target organism based on information derived from the behavior exhibited when it shows taxis.

[0121] In the measuring device 2 related to the present technology described above, the measuring unit (class identification unit 23) derives at least one of the number of target organisms, the density, and the average activity level. This makes it possible to measure the actual characteristics of the target organism. Therefore, the measuring device 2 can identify at least one of the number of target organisms, their density, and their average activity level.

[0122] In the measuring device 2 related to the present technology described above, the imaging unit 14 includes a vision sensor 14a and an imaging sensor 14b that captures images at regular intervals according to the frame rate. This makes it possible to measure the target organism using either or both of the images captured by the vision sensor 14a and the imaging sensor 14b. Furthermore, since the measuring device 2 uses information based on the image captured by the vision sensor 14a, the image captured by the image sensor 14b can be less coarse compared to when measuring the target organism using only the image sensor, and a wider area can be captured with the same number of pixels compared to when using only the image sensor.

[0123] In the measuring device 2 related to the technology described above, the stimulus control unit 21 irradiates light of a specific wavelength and intensity from the stimulus generating device 3, or generates heat. This makes it possible to measure target organisms by utilizing their taxis or thermotaxis. Therefore, the measuring device 2 can efficiently measure target organisms by utilizing the taxis of organisms exhibiting taxis or thermotaxis.

[0124] In the measuring device 2 related to the technology described above, the stimulus control unit 21 causes a specific substance to be released from the stimulus generating device 3. This makes it possible to measure organisms that exhibit taxis towards specific substances. Therefore, the measuring device 2 can efficiently measure target organisms by utilizing the taxis of organisms that exhibit taxis towards specific substances.

[0125] The measurement system 1 related to the present technology described above includes a stimulus generator 3 that outputs an external stimulus according to the tactile conditions of an organism, a stimulus control unit 21 that generates an external stimulus from the stimulus generator 3, an imaging unit 14 that images a predetermined imaging range where the external stimulus is output, and a measurement unit (class identification unit 23) that measures the target organism based on the image captured by the imaging unit 14. This measurement system 1 can also provide the same functions and effects as the measurement device 2 related to the present technology described above.

[0126] Furthermore, the effects described herein are merely illustrative and not limited to those described herein, and other effects may also occur.

[0127] <7. This Technology> This technology can also be configured as follows: (1) A stimulus control unit that generates external stimuli from a stimulus generating device according to the tactile conditions of an organism, An imaging unit that images a predetermined imaging area where the external stimulus occurs, A measuring unit that measures the target organism based on the image captured by the imaging unit, A measuring device equipped with this device. (2) The imaging unit is The vision sensor is equipped with a two-dimensional arrangement of multiple pixels and asynchronously acquires pixel data according to the amount of light incident on each pixel. (1) The measuring device described above. (3) The aforementioned stimulus control unit, The target organism generates the external stimulus that causes it to exhibit positive taxis. The measuring device described in (1) or (2). (4) The aforementioned stimulus control unit, A non-target organism, other than the aforementioned target organism, generates the aforementioned external stimulus that exhibits negative taxis. A measuring device as described in any of (1) to (3). (5) The aforementioned stimulus control unit, The external stimulus is generated such that a non-target organism, other than the target organism, exhibits negative taxis, and the target organism does not exhibit negative taxis. (4) The measuring device described above. (6) The aforementioned stimulus control unit, The target organism generates the external stimulus in which it does not exhibit taxis. The measuring device described in (1) or (2). (7) The aforementioned external stimulus is light, The aforementioned stimulus control unit, The target organism is irradiated with light that does not cause it to exhibit taxis. (6) The measuring device described above. (8) The imaging unit is Image is taken while moving along a predetermined direction. A measuring device as described in any of (1) to (7). (9) The aforementioned measuring unit is Based on the images captured by the imaging unit, information is derived based on the behavior the target organism exhibits when it shows taxis, and the target organism is identified based on this information. A measuring device as described in any of (1) to (8). (10) The aforementioned measuring unit is The number, density, and average activity level of the aforementioned target organisms are derived. (9) The measuring device described above. (11) The imaging unit is The system includes the aforementioned vision sensor and an imaging sensor that captures images at regular intervals according to the frame rate. (2) The measuring device described above. (12) The aforementioned stimulus control unit, The stimulus generating device emits light of a specific wavelength and intensity, or generates heat. A measuring device as described in any of (1) to (11). (13) The aforementioned stimulus control unit, The aforementioned stimulus generating device releases a specific substance. A measuring device as described in any of (1) to (12). (14) External stimuli corresponding to the tactile conditions of the organism are generated from a stimulus generating device. The predetermined imaging range in which the aforementioned external stimulus is output is imaged, Measurements are taken about the target organism based on the captured images. Measurement method. (15) A stimulus generating device that generates external stimuli corresponding to the tactile conditions of an organism, A stimulus control unit that generates the external stimulus from the stimulus generating device, An imaging unit that images a predetermined imaging range where the external stimulus is output, A measuring unit that measures the target organism based on the image captured by the imaging unit, A measurement system equipped with this system. [Explanation of symbols]

[0128] 1. Measurement System 2. Measuring device 3. Stimulus Generating Device 10 Control Unit 14 Imaging Unit 14a Vision Sensor 14b Imaging sensor 21 Stimulus Control Unit 22 Imaging control unit 23 Class Identification Unit

Claims

1. A stimulus control unit that generates external stimuli from a stimulus generating device according to the tactile conditions of an organism, An imaging unit that images a predetermined imaging area where the external stimulus occurs, A measuring unit that measures the target organism based on the image captured by the imaging unit, A measuring device equipped with this device.

2. The imaging unit is The vision sensor is equipped with a two-dimensional arrangement of multiple pixels and asynchronously acquires pixel data according to the amount of light incident on each pixel. The measuring device according to claim 1.

3. The aforementioned stimulus control unit, The target organism generates the external stimulus that causes it to exhibit positive taxis. The measuring device according to claim 1.

4. The aforementioned stimulus control unit, A non-target organism, other than the aforementioned target organism, generates the aforementioned external stimulus that exhibits negative taxis. The measuring device according to claim 1.

5. The aforementioned stimulus control unit, The external stimulus is generated such that a non-target organism, other than the target organism, exhibits negative taxis, and the target organism does not exhibit negative taxis. The measuring device according to claim 4.

6. The aforementioned stimulus control unit, The target organism generates the external stimulus in which it does not exhibit taxis. The measuring device according to claim 1.

7. The aforementioned external stimulus is light, The aforementioned stimulus control unit, The target organism is irradiated with light that does not cause it to exhibit taxis. The measuring device according to claim 6.

8. The imaging unit is Image is taken while moving along a predetermined direction. The measuring device according to claim 1.

9. The aforementioned measuring unit is Based on the images captured by the imaging unit, information is derived based on the behavior the target organism exhibits when it shows taxis, and the target organism is identified based on this information. The measuring device according to claim 1.

10. The aforementioned measuring unit is The number, density, and average activity level of the aforementioned target organisms are derived. The measuring device according to claim 9.

11. The imaging unit is The system includes the aforementioned vision sensor and an imaging sensor that captures images at regular intervals according to the frame rate. The measuring device according to claim 2.

12. The aforementioned stimulus control unit, The stimulus generating device emits light of a specific wavelength and intensity, or generates heat. The measuring device according to claim 1.

13. The aforementioned stimulus control unit, The aforementioned stimulus generating device releases a specific substance. The measuring device according to claim 1.

14. External stimuli corresponding to the tactile conditions of the organism are generated from a stimulus generating device. The predetermined imaging range in which the aforementioned external stimulus is output is imaged, Measurements are taken about the target organism based on the captured images. Measurement method.

15. A stimulus generating device that generates external stimuli corresponding to the tactile conditions of an organism, A stimulus control unit that generates the external stimulus from the stimulus generating device, An imaging unit that images a predetermined imaging range where the external stimulus is output, A measuring unit that measures the target organism based on the image captured by the imaging unit, A measurement system equipped with this system.

Images