Server device, generation method, electronic device generation method, and database generation method

Abstract

A server device comprising a data acquisition unit that acquires first data related to a submerged object acquired for a first purpose and a purpose-specific software generation unit that generates, on the basis of the first data, software to be used for a second purpose different from the first purpose.

Description

[Technical Field]

[0001] This technology relates to a server device, a generation method, an electronic device generation method, and a database generation method. By law The present invention relates to a technology for measuring underwater objects. [Background technology]

[0002] A measuring device has been proposed that measures the abundance of phytoplankton by irradiating it with excitation light of a predetermined wavelength to excite the phytoplankton and measuring the intensity of the fluorescence emitted from the excited phytoplankton (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-165687 Summary of the Invention [Problem to be solved by the invention]

[0004] In the measurement devices described above, dedicated software is installed and executed for each purpose. However, if dedicated software for each purpose is created separately, the efficiency of software creation decreases.

[0005] Therefore, the present technology aims to efficiently generate software that can be used for different purposes. [Means for solving the problem]

[0006] The server device according to the present technology includes a data acquisition unit that acquires first data relating to an underwater object acquired for a first purpose, and a purpose-specific software generation unit that generates software to be used for a second purpose different from the first purpose based on the first data. This makes it possible to generate software to be used for a second purpose based on first data acquired for a first purpose that is different from the second purpose.

[0007] In the server device according to the present technology described above, the purpose-specific software generation unit may generate software to be used for the first purpose based on second data relating to underwater objects acquired for the second purpose. This makes it possible to generate software to be used for a first purpose based on both first data about underwater objects acquired for a first purpose and second data acquired for a second purpose different from the first purpose.

[0008] In the server device according to the present technology described above, it is conceivable that the purpose-specific software generation unit generates software to be used for the first purpose based on the first data. This makes it possible to generate both software to be used for a first purpose and software to be used for a second purpose based on first data acquired for a first purpose.

[0009] In the server device according to the present technology described above, the purpose-specific software generation unit may generate software to be used for the first purpose and software to be used for the second purpose based on the first data and second data relating to the underwater object acquired for the second purpose. This makes it possible to generate both software to be used for a first purpose and software to be used for a second purpose based on both first data acquired for a first purpose and second data acquired for a second purpose.

[0010] The server device according to the present technology described above may be provided with an identification program generation unit that generates an identification program for identifying underwater objects in the software used for the first purpose and the software used for the second purpose. This allows the underwater object to be identified using an identification program in the software used for the first purpose and in the software used for the second purpose.

[0011] In the server device according to the present technology described above, it is conceivable that the identification program is used in common by the software used for the first purpose and the software used for the second purpose. This allows a common identification program to be used to identify underwater objects in the software used for the first purpose and in the software used for the second purpose.

[0012] In the server device according to the present technology described above, it is conceivable that the database used when generating the identification program is generated based on the first data and second data regarding underwater objects acquired for the second purpose. As a result, a database is generated based on both the first data about underwater objects acquired for the first purpose and the second data about underwater objects acquired for the second purpose.

[0013] In the server device according to the present technology described above, it is conceivable that at least some of the underwater objects to be identified may differ between the first purpose and the second purpose. This makes it possible to generate software to be used for a second purpose based on first data acquired for a first purpose in which at least some of the underwater objects to be identified are different.

[0014] In the server device according to the present technology described above, it is conceivable that the operations to be executed when an underwater object to be identified is detected may differ between the first purpose and the second purpose. This makes it possible to generate software to be used for a second purpose based on first data acquired for a first purpose, where the action to be taken when an underwater object to be identified is detected is different.

[0015] The generation method of the present technology involves acquiring first data about an underwater object acquired for a first purpose, and generating software based on the first data to be used for a second purpose different from the first purpose. This generation method also provides the same effect as the server device according to the present technology described above.

[0016] The method for generating an electronic device according to the present technology involves acquiring first data relating to an underwater object acquired for a first purpose, generating software based on the first data to be used for a second purpose different from the first purpose, and storing the software on a medium. In the method for generating an electronic device according to the present technology described above, it is conceivable to acquire second data relating to an underwater object acquired for a second purpose, acquire an identification result obtained by processing the second data using software used for the second purpose, and store the identification result on a medium. Such a method for generating an electronic device also provides the same effects as the server device according to the present technology described above.

[0017] The database generation method of the present technology involves acquiring first data related to an underwater object acquired for a first purpose, extracting from the first data a first data portion necessary for generating software to be used for a second purpose different from the first purpose, and storing all or a portion of the first data on a medium so that the first data portion can be identified. In the database generation method according to the present technology described above, it is conceivable to acquire second data relating to an underwater object acquired for a second purpose, integrate the second data and the first data portion, and store the information on a medium as information necessary for generating software to be used for the second purpose. Such a database generation method also provides the same effects as the server device according to the present technology described above. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a diagram illustrating the configuration of an underwater measurement system according to an embodiment. [Figure 2] FIG. 1 is a diagram illustrating an example of how the measurement device is used. [Figure 3] FIG. 2 is a diagram illustrating the configuration of a measurement device. [Figure 4] 10 is a flowchart showing a procedure of a measurement operation process. [Figure 5] 10 is a flowchart showing the procedure of a purpose-specific measurement operation process. [Figure 6] FIG. 10 is a diagram illustrating an example of a purpose-specific operation. [Figure 7] FIG. 2 is a diagram illustrating a configuration of a server device. [Figure 8] FIG. 10 is a diagram illustrating an underwater object table. [Figure 9] FIG. 10 is a diagram illustrating detailed information of an underwater object table. [Figure 10] 10 is a flowchart showing the procedure of a generation process. [Figure 11] FIG. 10 is a diagram illustrating the configuration of a measurement device according to a modified example. DETAILED DESCRIPTION OF THE INVENTION

[0020] The embodiments will be described below in the following order. <1. Underwater measurement system configuration> <2. Measuring equipment> [2-1. Examples of using measuring equipment] [2-2. Measuring device configuration] [2-3. Measurement processing using measuring equipment] [2-4. Examples of purpose-specific actions] <3. Server equipment> [3-1. Server Configuration] [3-2. Generation process] <4. Other examples of underwater measurement system configurations> <5. Summary> <6. This technology>

[0021] <1. Underwater measurement system configuration> First, the configuration of an underwater measurement system 1 as an embodiment according to the present technology will be described. The underwater measurement system 1 is a system that measures underwater objects such as microorganisms and microplastics present in water. Measurement here is a concept that includes at least one of identifying the type or characteristics of underwater objects, and recording or storing images taken underwater, and in a broad sense, is a concept that includes investigating or exploring underwater objects.

[0022] Figure 1 is a diagram illustrating the configuration of an underwater measurement system 1. As shown in Figure 1, the underwater measurement system 1 includes a server device 2 and measurement devices 3A, 3B, and 3C. As will be described in detail below, the measurement devices 3A, 3B, and 3C have different purposes of use and run different software, but they have the same configuration. When describing the measurement devices 3A, 3B, and 3C without distinguishing between them, they will be referred to as measurement device 3.

[0023] The server device 2 is capable of communicating with the measuring device 3, and acquires data on underwater objects measured by the measuring device 3, as well as generates software to be executed by the measuring device 3 and transmits it to the measuring device 3. Note that generating software also includes updating the software.

[0024] The measurement device 3 executes the software generated by the server device 2 and measures underwater objects. Furthermore, the measurement device 3 executes a specific operation when an underwater object (hereinafter referred to as a target object) that is preset for each piece of software is detected.

[0025] <2. Measuring equipment> [2-1. Examples of using measuring equipment] Figure 2 is a diagram illustrating an example of how the measuring device 3 can be used. The measuring device 3 can be used for a variety of purposes, including marine life surveys, aquaculture water quality measurements, fishing ground selection surveys, microplastic measurements, marine development impact surveys, ship ballast water surveys, marine resource exploration, blue carbon measurements, and global warming surveys.

[0026] For example, as shown in FIG. 2, measuring device 3A is placed in an aquaculture pen and is used for measuring the quality of aquaculture water as a first purpose. Measuring device 3B is placed in the deep sea and is used for investigating deep-sea organisms (marine organism investigations) as a second purpose. Measuring device 3C is placed underwater and is used for measuring microplastics as a third purpose. In this example, three types of measuring devices 3A, 3B, and 3C with different purposes (software) are used as an example, but the number of purposes does not matter as long as the measuring device 3 is used for two or more different purposes (software). Furthermore, the first, second, and third purposes are merely examples, and other purposes may also be used.

[0027] Therefore, measurement device 3A runs software for measuring aquaculture water quality, measurement device 3B runs software for investigating deep-sea organisms, and measurement device 3C runs software for measuring microplastics.

[0028] For example, in the software executed by measurement device 3A, as shown by the circle in the figure, harmful plankton that is considered harmful to aquaculture is the target object, and the presence or absence of the target harmful plankton and the number of the target harmful plankton are detected. In addition, in the software executed by measurement device 3B, as shown by the square in the figure, deep-sea organisms that live in the deep sea are the target object, and the presence or absence and number of the target deep-sea organisms are detected. In addition, in the software executed by measurement device 3C, as shown by the triangle in the figure, microplastics floating in the ocean are the target object, and the presence or absence and number of the target microplastics are detected.

[0029] [2-2. Measuring device configuration] 3 is a diagram illustrating the configuration of the measurement device 3. As shown in FIG. 3, the measurement device 3 includes a measurement unit 10 and a stimulus generation unit 11.

[0030] The measurement unit 10 is a device that can appropriately control the measurement device 3 and measure a target object by utilizing at least one of the taxis and fluorescence of the underwater object (mainly aquatic organisms), for example.

[0031] Here, taxis is an innate behavior of living organisms in response to directional external stimuli. Examples of external stimuli include light, pressure, gravity, chemical substances (pheromones), electricity, temperature, and contact. For example, taxis to light are called phototaxis, and taxis to temperature are called thermotaxis. Furthermore, movement toward the source of the external stimulus is called positive taxis, and movement away from the source of the external stimulus is called negative taxis.

[0032] For example, the protozoan flagellate Euglena moves toward the light source when illuminated. In this example, the directional external stimulus is light, and Euglena can be said to exhibit positive phototaxis. Furthermore, when nematodes are placed in an environment with a temperature gradient, they move toward the temperature field that is considered optimal for them (approximately 25°C). In this example, the directional external stimulus is temperature, and the nematodes can be said to exhibit thermotaxis. As such, certain organisms are known to exhibit taxis. Organisms that exhibit taxis can be found in both plants and animals.

[0033] Fluorescence is a phenomenon in which, when irradiated with excitation light of a predetermined wavelength, an underwater object is excited and emits light of a wavelength different from that of the excitation light.

[0034] The measuring device 3 utilizes at least one of the taxis and fluorescence of such underwater objects to measure the target object.

[0035] The measurement unit 10 includes a control unit 20 , a memory 21 , a communication unit 22 , a gravity sensor 23 , an imaging unit 24 , and a lens 25 .

[0036] The control unit 20 is configured with a microcomputer having, for example, a CPU (Central Processing Unit), ROM (Read Only Memory), and RAM (Random Access Memory), and performs overall control of the measurement device 3. In this embodiment, the control unit 20 functions as a stimulus control unit 31, an imaging control unit 32, a discrimination unit 33, and an operation control unit 34. The stimulus control unit 31, the imaging control unit 32, the discrimination unit 33, and the operation control unit 34 will be described in detail later. The control unit 20 also reads data stored in the memory 21 , stores data in the memory 21 , and transmits and receives various data to and from the server device 2 via the communication unit 22 .

[0037] The memory 21 is configured by a non-volatile memory. The communication unit 22 performs wired or wireless data communication with the server device 2. The gravity sensor 23 detects gravitational acceleration (direction of gravity) and outputs the detection result to the control unit 20. Note that the measuring device 3 does not necessarily have to include the gravity sensor 23.

[0038] The imaging unit 24 includes a vision sensor 24a and an imaging sensor 24b. The vision sensor 24a is a sensor called a DVS (Dynamic Vision Sensor) or an EVS (Event-Based Vision Sensor). The vision sensor 24a captures an image of a predetermined imaging range through a lens 25.

[0039] The vision sensor 24a is an asynchronous image sensor in which a plurality of pixels each having a photoelectric conversion element are arranged two-dimensionally, and a detection circuit for detecting address events in real time is provided for each pixel. Note that an address event is an event that occurs for each address assigned to each of the plurality of pixels arranged two-dimensionally, such as when the current value or the change in the current value based on the charge generated in the photoelectric conversion element exceeds a certain threshold.

[0040] The vision sensor 24a detects whether an address event has occurred for each pixel, and when the occurrence of an address event is detected, it reads out a pixel signal from the pixel where the address event has occurred as pixel data.

[0041] In the vision sensor 24a, a pixel signal read operation is performed for pixels where an address event is detected, which allows for much faster readout than a synchronous image sensor in which a readout operation is performed for all pixels at a predetermined frame rate, and the amount of data read out for one frame is also small.

[0042] Therefore, by using the vision sensor 24a, the measurement device 3 can detect the movement of the target object more quickly. Furthermore, the vision sensor 24a can reduce the amount of data and also reduce power consumption.

[0043] The imaging sensor 24b is, for example, a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Oxide-Semiconductor) type image sensor, and has a plurality of pixels, each having a photoelectric conversion element, arranged two-dimensionally. The imaging sensor 24b captures an image of a predetermined imaging range through the lens 25 at regular intervals according to the frame rate to generate image data. Note that in the measurement unit 10, a zone plate, a pinhole plate, or a transparent plate can be used instead of the lens 25.

[0044] Vision sensor 24a and image sensor 24b are arranged so as to capture images of substantially the same imaging range through lens 25. For example, a half mirror (not shown) may be arranged between lens 25 and vision sensor 24a and image sensor 24b, and one of the light beams split by the half mirror may be incident on vision sensor 24a, and the other may be incident on image sensor 24b.

[0045] The stimulus generating unit 11 is a device that generates (outputs) an external stimulus to the imaging range imaged by the imaging unit 24, and applies the external stimulus to living organisms present in the imaging range, and is equipped with a photothermal generating device 40 and a stimulating substance releasing device 41.

[0046] The photothermal generating device 40 includes an illumination device 40a (light source) that irradiates the imaging area with light, and a heat source device 40b (heat source) that provides heat to the imaging area. The illumination device 40a is driven under the control of the control unit 20, and is capable of changing the wavelength and intensity of the light irradiated onto the imaging area. The heat source device 40b is driven under the control of the control unit 20, and is capable of changing the temperature of the imaging area.

[0047] The stimulating substance release device 41 has, for example, a container with an opening / closing door that contains a pheromone (stimulating substance, chemical substance) inside, and can release the pheromone into the imaging range by opening the opening / closing door based on the control of the control unit 20.

[0048] It is sufficient that the stimulus generating section 11 includes a device that generates at least one external stimulus.

[0049] As a result, unlike devices that measure the wavelength and light intensity of fluorescent reactions, the measuring device 3 can measure a wide range of underwater objects, including not only phytoplankton, but also aquatic microorganisms such as phytoplankton, zooplankton, and the larvae of aquatic organisms, as well as underwater particles such as microplastics, dust, sand, and marine snow.

[0050] [2-3. Measurement operation processing] 4 is a flowchart showing the procedure of the measurement operation process. The control unit 20 executes purpose-specific software (purpose-specific programs) stored in the memory 21 to perform the measurement operation process shown in FIG.

[0051] In step S1, the control unit 20 determines whether the identification program stored in the memory 21 is the latest. Here, the control unit 20 determines that the identification program is the latest when the version of the identification program stored in the memory 21 matches the version of the identification program provided by the server device 2, and determines that the identification program is not the latest when they do not match. The identification program is a program for identifying underwater objects, as will be described in detail later.

[0052] If it is determined that the identification program stored in the memory 21 is not the latest (No in step S1), then in step S2 the control unit 20 downloads the latest identification program from the server device 2 and stores it in the memory 21. On the other hand, if it is determined that the identification program stored in the memory 21 is the latest (Yes in step S1), then the process proceeds to step S3.

[0053] In step S3, the control unit 20 executes a purpose-specific measurement operation process to measure a target object for each purpose and to execute an operation when a target object is detected. The purpose-specific measurement operation process will be described in detail later. Then, in step S4, the control unit 20 determines whether a termination condition for terminating the measurement operation process is met, and if it is determined that the termination condition for terminating the measurement operation process is met (Yes in step S4), the control unit 20 terminates the measurement operation process. Note that the termination condition for terminating the measurement operation process may be, for example, the passage of a predetermined time, or the input of a user instruction to terminate the measurement operation process.

[0054] 5 is a flowchart showing the procedure of the purpose-specific measurement operation process. As shown in FIG. 5, in step S11, the control unit 20 executes an underwater object detection process for detecting an underwater object. Here, the stimulus control unit 31 operates the stimulus generation unit 11 to generate an external stimulus according to the taxis condition or fluorescence condition of the organism in accordance with a pre-specified action time sheet. Also, the imaging control unit 32 controls the imaging unit 24 to capture an image of the imaging range and acquire pixel data and image data.

[0055] The identification unit 33 then detects underwater objects present within the imaging range based on the image (pixel data) captured by the vision sensor 24a. For example, the identification unit 33 creates one frame of data based on pixel data input within a predetermined period, and detects a group of pixels within a predetermined range in which movement is detected within the frame of data as an underwater object.

[0056] In step S12, the identification unit 33 determines whether an underwater object has been detected in step S11. As a result, if it is determined that an underwater object has been detected (Yes in step S11), the identification unit 33 executes an underwater object identification process to identify the type of the detected underwater object. Here, the identification unit 33 first acquires environmental information indicating the environment in which the image was captured. The environmental information may include the conditions of the external stimulus generated by the stimulus generation unit 11, as well as the direction of gravity detected by the gravity sensor 23 and external environmental information acquired via the communication unit 22. Note that possible examples of the external environmental information include electrical conductivity, temperature, pH, gas (e.g., methane, hydrogen, helium) concentration, and metal concentration (e.g., manganese, iron).

[0057] The identification unit 33 also derives identification information for the detected underwater object based on the image (pixel data, image data). Here, the identification unit 33 tracks the underwater object between multiple frame data by pattern matching or the like. Then, based on the object tracking results, the identification unit 33 derives the moving direction, speed, trajectory, etc. relative to the stimulus source as identification information.

[0058] Furthermore, the identification unit 33 extracts an image portion corresponding to the underwater object from the image (image data) captured by the imaging sensor 24b for which identification information has been derived. Then, based on the extracted image portion, the identification unit 33 derives the size of the object, the presence or absence of tactile sensations, and the like as identification information by image analysis. Note that a known method can be used for image analysis, and therefore a description thereof will be omitted here.

[0059] The identification unit 33 then executes an identification program, described in detail below, based on the derived environmental information and identification information to derive a confidence rate between the detected underwater object and the underwater objects shown in the underwater object table, described below. The confidence rate is a percentage of certainty that indicates whether the underwater object has been correctly identified.

[0060] In step S14, the identification unit 33 determines whether any of the detected underwater objects has a confidence rate equal to or higher than a predetermined first threshold, i.e., whether the detected underwater object is a known underwater object. As a result, if it is determined that the detected underwater object is not a known underwater object (No in step S14), in step S15 the identification unit 33 stores the environmental information, identification information, and extracted image portion (hereinafter collectively referred to as underwater object information) in memory 21 (medium) as new underwater object information (identification result) and transmits (uploads) it to the server device 2.

[0061] On the other hand, if it is determined that the detected underwater object is a known underwater object (Yes in step S14), then in step S16 the identification unit 33 determines whether the detected underwater object is a target object that has been preset for each purpose. Here, if the confidence rate between the detected underwater object and the target object is equal to or greater than a second threshold that is higher than the first threshold, the detected underwater object is determined to be the target object. As a result, if it is determined that the detected underwater object is a target object (Yes in step S16), in step S17 the operation control unit 34 executes an operation that is preset for each purpose (hereinafter referred to as a purpose-specific operation).

[0062] In step S18, the control unit 20 determines whether the termination condition for terminating the purpose-specific measurement operation process is met. Then, the control unit 20 repeats steps S11 to S18 until the termination condition for terminating the purpose-specific measurement operation process is met, and when the termination condition for terminating the purpose-specific measurement operation process is met (Yes in step S18), the control unit 20 terminates the purpose-specific measurement operation process.

[0063] [2-4. Examples of purpose-specific actions] 6 is a diagram illustrating an example of a purpose-specific operation. Here, a measurement device 3A that detects harmful plankton as a target object is used as an example. The measurement device 3A includes a measurement unit 10, a stimulus generation unit 11, and a chemical spray unit 12.

[0064] Chemical spraying unit 12 contains a chemical for exterminating harmful plankton. In the above-described objective-specific measurement operation process, if harmful plankton, which is the target object, is detected in step S16, operation control unit 34 drives chemical spraying unit 12 in step S17 to perform an objective-specific operation of spraying a chemical onto the fish pen. In this way, by performing the above-described objective-specific measurement operation process, when harmful plankton, which is the target object, is detected, chemical spraying unit 12 will spray a chemical for exterminating the harmful plankton. This allows the measuring device 3A to eliminate harmful plankton when it is detected.

[0065] Although the measuring device 3A has been described as an example here, the measuring devices 3B and 3C also execute a predetermined purpose-specific operation when a predetermined target object is detected for each of them. However, the purpose-specific operation executed when a target object is detected may not only actually execute some operation as in the measuring device 3A, but may also execute a software-based operation such as counting the number of objects.

[0066] <3. Server equipment> [3-1. Server Configuration] 7 is a diagram illustrating the configuration of the server device 2. As shown in FIG.

[0067] The control unit 50 is configured with, for example, a microcomputer having a CPU, ROM, and RAM, and performs overall control of the server device 2. The control unit 50 functions as a data acquisition unit 60, an underwater object table generation unit 61, an identification program generation unit 62, and a purpose-specific software generation unit 63. The data acquisition unit 60, the underwater object table generation unit 61, the identification program generation unit 62, and the purpose-specific software generation unit 63 will be described in detail later.

[0068] The storage unit 51 is configured by a nonvolatile memory. The communication unit 22 performs data communication with the measurement device 3 via wired or wireless communication.

[0069] The data acquisition unit 60 acquires (receives) new underwater object information (identification results) transmitted from the measuring device 3 and stores it in the storage unit 51 (medium). Here, the data acquisition unit 60 acquires new underwater object information transmitted from any of the measuring devices 3A, 3B, and 3C without distinguishing between them.

[0070] The underwater object table generation unit 61 generates an underwater object table (database) based on the new underwater object information acquired by the data acquisition unit 60, and stores the generated underwater object table in the storage unit 51. Note that generating the underwater object table includes updating (adding) the underwater object table.

[0071] Fig. 8 is a diagram illustrating the underwater object table. Fig. 9 is a diagram illustrating detailed information in the underwater object table. As shown in Fig. 8, the underwater object table stores detailed information for each underwater object. As shown in Fig. 9, the detailed information includes information on the identification name, morphology, fluorescent response, phototaxis, thermotaxis, chemotaxis, tactic behavior, and habitat. For example, the identification name includes information about a unique ID and species name. The morphology includes size and image information. The fluorescence response includes information about the presence or absence of a fluorescence response, the fluorescence wavelength, and the excitation light wavelength. The phototaxis includes information about the presence or absence of phototaxis, the positive phototaxis wavelength, the negative phototaxis wavelength, the presence or absence of light source blinking, the light source blinking frequency, the presence or absence of light source polarization, the direction of light source polarization, the size of the light source, the shape of the light source, and the direction of the light source. The thermotaxis includes information about the presence or absence of thermotaxis and the thermotaxis temperature. The chemotaxis includes information about the presence or absence of chemotaxis and the chemotactic substance. The tactic behavior includes information about the movement characteristics of the tactic (movement speed, movement vector relative to the stimulus source and gravity). The habitat includes information about the known habitat area or the measured area.

[0072] When new underwater object information is acquired by the data acquisition unit 60, the underwater object table generation unit 61 generates an underwater object table based on the new underwater object information and stores it in the storage unit 51. Here, the underwater object table generation unit 61 may, for example, identify the underwater object indicated in the new underwater object information by matching the new underwater object information with information about underwater objects indicated in an existing external database, and add detailed information about the identified underwater object to the underwater object table. Alternatively, the user may analyze new underwater object information and manually add detailed information to the underwater object table. In addition, new underwater object information and information about underwater objects shown in existing external databases may contain only some of the above detailed information items.In such cases, it is possible to register highly accurate detailed information by combining (integrating) all or part of the matched information and adding the detailed information. In addition, information about underwater objects determined to be known underwater objects by the measuring device 3 may be sent to the server device 2, and detailed information about the corresponding underwater object in the underwater object table may be further updated based on that underwater object information. As a result, the underwater object table generation unit 61 can, for example, extract information (first data portion) necessary for generating software to be used in the measuring device 3B from the new underwater object information (first data) acquired by the measuring device 3A, and add all or part of the new underwater object information to the underwater object table and store it in the memory unit 51 so that the extracted information can be identified. In addition, the underwater object table generation unit 61 can, for example, integrate all or part of the new underwater object information acquired by the measuring device 3A and all or part of the new underwater object information (second data) acquired by the measuring device 3B, add it to the underwater object table as information necessary for generating software to be used by the measuring device 3B, and store it in the memory unit 51.

[0073] Once the underwater object table is generated, the identification program generation unit 62 generates an identification program by machine learning using the generated underwater object table as training data. The identification program is a program for deriving a confidence rate between the underwater object detected by the measurement device 3 and the underwater object shown in the underwater object table. After generating the identification program, the identification program generation unit 62 transmits the same identification program to all the measuring devices 3 (3A, 3B, 3C). That is, the measuring devices 3 will identify underwater objects using the same identification program regardless of the purpose. The identification program generating unit 62 may generate an identification program at predetermined intervals.

[0074] The purpose-specific software generation unit 63 generates software for each purpose of the measurement device 3. For example, the purpose-specific software generation unit 63 generates software that defines the target object (target plankton) for each purpose, a second threshold for identifying the target object, and an action (objective-specific action) when the target object is detected. Note that in the purpose-specific software, at least a portion of the target object is different, or the action to be executed when the target object is detected is different. Then, once the purpose-specific software generation unit 63 has generated the software for each purpose, it transmits the generated software to the corresponding measurement device 3. In other words, the purpose-specific software generation unit 63 stores the purpose-specific software in the memory 21 (medium) of the measurement device 3, thereby generating a measurement device 3 in which the software is stored.

[0075] For example, when the server device 2 acquires new underwater object information (first data) acquired by the measurement device 3A that executes software for measuring aquaculture water quality, which is the first objective, the server device 2 generates (updates) an underwater object table and an identification program based on the new underwater object information, and generates software for investigating deep-sea organisms, which is the second objective, based on the underwater object table and the identification program. In other words, when the server device 2 acquires new underwater object information acquired for the first objective, the server device 2 generates software for investigating deep-sea organisms, which is the second objective, based on the new underwater object information.

[0076] Furthermore, when the server device 2 acquires new underwater object information (second data) acquired by the measurement device 3B executing software for investigating deep-sea organisms, which is the second objective, it generates (updates) an underwater object table and an identification program based on the new underwater object information, and generates software for measuring aquaculture water quality, which is the first objective, based on the underwater object table and the identification program. In other words, when the server device 2 acquires new underwater object information (second data) acquired for the second objective, it generates software for investigating deep-sea organisms, which is the first objective, based on the new underwater object information.

[0077] Furthermore, when the server device 2 acquires new underwater object information (first data) acquired by the measurement device 3A executing software for aquaculture water quality measurement, which is the first objective, it generates (updates) an underwater object table and an identification program based on the new underwater object information, and generates software for aquaculture water quality measurement, which is the first objective, based on the underwater object table and the identification program. In other words, when the server device 2 acquires new underwater object information (first data) acquired for the first objective, it generates software for aquaculture water quality measurement, which is the first objective, based on the new underwater object information.

[0078] Furthermore, when server device 2 acquires new underwater object information (first data) acquired by measurement device 3A executing software for measuring aquaculture water quality, which is the first objective, and new underwater object information (second data) acquired by measurement device 3B executing software for investigating deep-sea organisms, which is the second objective, server device 2 generates (updates) an underwater object table and an identification program based on the new underwater object information, and generates software for measuring aquaculture water quality, which is the first objective, and software for investigating deep-sea organisms, which is the second objective, based on the underwater object table and the identification program. In other words, when server device 2 acquires new underwater object information (first data) acquired for the first objective and new underwater object information (second data) acquired for the second objective, server device 2 generates software for measuring aquaculture water quality, which is the first objective, and software for measuring aquaculture water quality, which is the second objective, based on the new underwater object information.

[0079] In this way, in the underwater measurement system 1, by networking multiple measuring devices 3 (3A, 3B, 3C) and connecting them to the server device 2, the server device 2 can learn based on underwater object information measured at a wide range of different measurement locations, and can efficiently generate a variety of software for specific purposes.

[0080] [3-2. Generation process] Fig. 10 is a flowchart showing the steps of the generation process. As shown in Fig. 10, in step S21, the underwater object table generation unit 61 determines whether new underwater object information has been acquired by the data acquisition unit 60. As a result, if it is determined that new underwater object information has been acquired (Yes in step S21), in step S22 the underwater object table generation unit 61 reads out the underwater object table stored in the storage unit 51 and generates (adds) the underwater object table based on the new underwater object information acquired by the data acquisition unit 60.

[0081] In step S23, the identification program generation unit 62 determines whether an underwater object table has been generated. As a result, if it is determined that an underwater object table has been generated (Yes in step S23), the identification program generation unit 62 reads the generated underwater object table in step S24. Then, in step S25, the identification program generation unit 62 performs machine learning using the underwater object table to generate an identification program.

[0082] In step S26, the objective-specific software generation unit 63 determines whether to update the software. Here, it determines to update the software when, for example, the identification program has been updated or the user has performed an operation to update. Then, if the software is to be updated (Yes in step S26), the objective-specific software generation unit 63 updates the objective software that needs to be updated and transmits the updated software to the measurement device 3.

[0083] <4. Other examples of underwater measurement system configurations> The embodiment is not limited to the specific example described above, and various modified configurations can be adopted.

[0084] The measuring device 3 in the above embodiment is an example, and other configurations may be used as long as it is capable of measuring at least underwater objects.

[0085] Fig. 11 is a diagram illustrating the configuration of a modified measuring device 103. As shown in Fig. 11, the measuring device 103 includes a sample container 110, a cleaning liquid container 111, a sample switching unit 112, a flow cell 113, a sample discharge unit 114, a front light source 115, a back light source 116, a detection light source 117, a SPAD (Single Photon Avalanche Diode) sensor 118, an imaging sensor 119, a half mirror 120, a mirror 121, a lens 122, a lens 123, a control unit 124, a memory unit 125, and a communication unit 126.

[0086] The sample container 110 is a container for containing a fluid (seawater or lake water) as a sample, and contains the sample taken in from outside the device via the sample inlet Mi. The cleaning liquid container 111 is a container that contains a cleaning liquid for cleaning the flow path in the flow cell 113 . The sample switching unit 112 switches the fluid to be introduced into the flow channel in the flow cell 113 between the sample from the sample container 110 and the washing liquid from the washing liquid container 111 .

[0087] The flow cell 113 functions as a sample container, and a fluid as a sample is sampled into a flow path formed inside the flow cell 113. As will be described later, when the sample switching unit 112 is switched to the cleaning liquid container 111 side, cleaning liquid flows into the flow path of the flow cell 113.

[0088] The sample discharge section 114 has a pump for discharging fluid, and when the pump is driven, the fluid in the flow channel of the flow cell 113 is discharged through a sample discharge port Mo located outside the device. In this example, the flow path from the sample container 110 via the sample switching unit 112 and flow cell 113 to the sample discharge unit 114, and the flow path from the cleaning liquid container 111 via the sample switching unit 112 and flow cell 113 to the sample discharge unit 114 are each made into a consistent flow path, and the flow of sample from the sample container 110 to the flow cell 113 and the flow of cleaning liquid from the cleaning liquid container 111 to the flow cell 113 are performed by driving the pump in the sample discharge unit 114.

[0089] The front light source 115 is a light source for illuminating the fluid in the flow cell 113 in response to imaging by the imaging sensor 119. Here, the "front" refers to the surface on the imaging sensor 119 side, with the position of the flow cell 113 as the reference. In a modified example, the front light source 115 is an annular light source, which prevents interference with imaging by the imaging sensor 119 and illuminates the sample from the front side of the flow cell 113 at an oblique angle. The rear light source 116, like the front light source 115, is a light source for illuminating the fluid in the flow cell 113 in response to imaging by the imaging sensor 119, and is positioned on the opposite side of the flow cell 113 from the front light source 115.

[0090] The backlight source 116 is used for bright-field imaging. Light transmitted through the sample is received by the image sensor 119, similar to the method used in general microscopes. Because the illumination light is incident directly on the lens 15, the background becomes bright. On the other hand, the front light source 115 is used for dark-field imaging. Light is applied to the sample from an oblique side, and the scattered and reflected light from the object is received by the image sensor 119. Even transparent objects can be measured with high contrast and in detail. In this case, the illumination light does not directly enter the lens 15, so the background is dark.

[0091] The detection light source 117 emits light for detecting an object in the sample sampled in the flow cell 113. For example, a semiconductor laser or the like is used as the detection light source 117. As shown in the figure, the light emitted from the detection light source 117 is reflected by a half mirror 120 and irradiated onto the fluid sampled in the flow channel within the flow cell 113.

[0092] The SPAD sensor 118 functions as a sensor for detecting underwater objects in the fluid within the flow cell 113. The measurement device 103 uses a pixel array in which multiple light-detecting pixels are arranged to detect weak light (excited light, etc.) from microorganisms and particles. One possible technology for these light-detecting pixels is SPAD. In SPAD, avalanche amplification occurs when a single photon enters a PN junction region in a high electric field under the condition that a voltage greater than the breakdown voltage is applied. By detecting the position and timing of the pixel through which current flows instantaneously at this time, it is possible to identify the presence, position, size, etc. of underwater objects within the flow cell 113. The SPAD sensor 118 has a SPAD element that performs photoelectric conversion of incident light using the electron avalanche phenomenon. The electron avalanche phenomenon in a SPAD element is a type of phenomenon known as the internal photoelectric effect. The internal photoelectric effect is a phenomenon in which the number of conduction electrons inside a semiconductor or insulator increases when light is irradiated onto the material. As is well known, a SPAD element is an element that has a light receiving resolution in photon units, in other words, an element that can distinguish the presence or absence of received light in photon units.

[0093] The SPAD sensor 118 in this example has a configuration in which a plurality of pixels each having a SPAD element are arranged two-dimensionally. Light emitted from an underwater object in the fluid in the flow cell 113 is incident on the SPAD sensor 118 via the half mirror 120, the mirror 13, and the lens .

[0094] The image sensor 119 is configured as, for example, a CCD-type or CMOS-type image sensor, and has a plurality of pixels, each having a photoelectric conversion element, arranged two-dimensionally. The photoelectric conversion element in each pixel of the image sensor 119 does not perform photoelectric conversion using the electron avalanche phenomenon, but rather employs a photoelectric conversion element, such as a photodiode, that is used in general imaging. In other words, the photoelectric conversion element has a lower light receiving resolution than a SPAD element. The imaging sensor 119 captures an image of the flow path in the flow cell 113 (an image including at least the flow path within the imaging field of view). Light (image light) from the flow cell 113 passes through the half mirror 120 and enters the imaging sensor 119 via the lens 15.

[0095] The control unit 124 is configured with, for example, a microcomputer having a CPU, ROM, and RAM, and performs overall control of the measuring device 103. For example, the control unit 124 performs switching control of the sample switching unit 112, light emission drive control of the front light source 115 and back light source 116, drive control of the pump in the sample discharge unit 114, light emission drive control of the detection light source 117, etc. Furthermore, the control unit 124 reads data stored in the storage unit 125, stores data in the storage unit 125, and exchanges various data with external devices via the communication unit 126. For example, the storage unit 125 is configured with a nonvolatile memory. The communication unit 126 performs wired or wireless data communication with the external devices. Furthermore, the control unit 124 in this example performs a process of detecting an underwater object based on a light reception signal from the SPAD sensor 118, various image analysis processes based on an image captured by the imaging sensor 119, and the like.

[0096] Furthermore, in the above-described embodiment and modified example, underwater objects are measured using the taxis and fluorescence of the underwater objects, but underwater objects may be measured using a different method.

[0097] Furthermore, in the above-described embodiment and variant examples, the underwater object table is stored in the memory unit 51 of the server device 2, but the underwater object table may also be stored in the memory 21 of the measuring device 3.

[0098] <5. Summary> As described above, the server device 2 of the embodiment includes a data acquisition unit 60 that receives first data regarding underwater objects acquired for a first purpose, and a purpose-specific software generation unit 63 that generates software to be used for a second purpose different from the first purpose based on the first data. This makes it possible to generate software to be used for a second purpose based on first data acquired for a first purpose that is different from the second purpose. Therefore, software for different purposes can be efficiently generated.

[0099] In the server device 2 according to the present technology described above, the purpose-specific software generation unit 63 may generate software to be used for a first purpose based on second data relating to underwater objects acquired for a second purpose. This makes it possible to generate software to be used for a first purpose based on both first data about underwater objects acquired for a first purpose and second data acquired for a second purpose different from the first purpose. Therefore, since both the first data and the second data are used to generate the software to be used for the first purpose, the software to be used for the first purpose can be generated more efficiently.

[0100] In the server device 2 according to the present technology described above, the purpose-specific software generation unit 63 may generate software to be used for a first purpose based on the first data. This makes it possible to generate both software to be used for a first purpose and software to be used for a second purpose based on first data acquired for a first purpose. Therefore, based on first data acquired for one purpose, software to be used for the first purpose and software to be used for the second purpose can be generated more efficiently.

[0101] In the server device 2 according to the present technology described above, the purpose-specific software generation unit 63 may generate software to be used for the first purpose and software to be used for the second purpose based on the first data and the second data relating to the underwater object acquired for the second purpose. This makes it possible to generate both software to be used for a first purpose and software to be used for a second purpose based on both first data acquired for a first purpose and second data acquired for a second purpose. Therefore, software to be used for a first purpose and software to be used for a second purpose can be efficiently generated based on first data and second data acquired for different purposes.

[0102] The server device 2 according to the present technology described above may be provided with an identification program generation unit 62 that generates an identification program for identifying underwater objects in software used for a first purpose and software used for a second purpose. This makes it possible to identify underwater objects using an identification program in the software used for the first purpose and in the software used for the second purpose. Therefore, underwater objects can be identified based on the identification program.

[0103] In the server device 2 according to the present technology described above, it is considered that the identification program generation unit 62 is used in common by the software used for the first purpose and the software used for the second purpose. This allows a common identification program to be used to identify underwater objects in the software used for the first purpose and in the software used for the second purpose. Therefore, there is no need to generate an identification program separately, and software can be generated efficiently.

[0104] In the server device 2 according to the present technology described above, the database used when generating the identification program is considered to be generated based on the first data and the second data relating to the underwater object acquired for the second purpose. As a result, a database is generated based on both the first data about underwater objects acquired for the first purpose and the second data about underwater objects acquired for the second purpose. Therefore, the database can be efficiently generated based on the first data and the second data.

[0105] In the server device 2 according to the present technology described above, it is conceivable that at least some of the target underwater objects will be different between the first objective and the second objective. This makes it possible to generate software to be used for a second purpose based on first data acquired for a first purpose in which at least some of the underwater objects to be identified are different. Therefore, even if the target underwater object differs for each purpose, software for each purpose can be efficiently generated.

[0106] In the server device 2 according to the present technology described above, it is conceivable that the operation to be executed when an underwater object to be identified is detected differs between the first purpose and the second purpose. This makes it possible to generate software to be used for a second purpose based on first data acquired for a first purpose, where the action to be taken when an underwater object to be identified is detected is different. Therefore, even if the operations to be executed are different, software for each purpose can be efficiently generated.

[0107] The method for generating an electronic device (measuring device 3) according to the present technology includes receiving first data relating to an underwater object acquired for a first purpose, generating software based on the first data to be used for a second purpose different from the first purpose, and storing the software in a medium (memory 21). In the method for generating the electronic device (measuring device 3) according to the present technology described above, it is conceivable to acquire second data relating to an underwater object acquired for a second purpose, acquire an identification result obtained by processing the second data using software used for the second purpose, and store the identification result on a medium. This method of generating an electronic device also provides the same effects as the server device 2 according to the present technology.

[0108] The method for generating a database (underwater object table) according to the present technology involves acquiring first data relating to underwater objects acquired for a first purpose, extracting from the first data a portion of the first data necessary for generating software to be used for a second purpose different from the first purpose, and storing all or a portion of the first data on a medium so that the first data portion can be identified.

[0109] In the method for generating a database (underwater object table) according to the present technology described above, it is conceivable to acquire second data relating to underwater objects acquired for a second purpose, integrate the second data and the first data portion, and store the information necessary for generating software to be used for the second purpose on a medium. This database generation method also provides the same effects as the server device 2 according to the present technology described above.

[0110] The electronic device (measuring device 3) according to the present technology includes a medium on which a database is stored. Such an electronic device can also provide the same effects as the server device 2 according to the present technology described above.

[0111] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0112] <6. This technology> The present technology can also be configured as follows. (1) a data acquisition unit that receives first data related to the underwater object acquired for a first purpose; a purpose-specific software generation unit that generates software to be used for a second purpose different from the first purpose based on the first data; A server device comprising: (2) The purpose-specific software generation unit and generating software to be used for the first purpose based on second data about the underwater object acquired for the second purpose. The server device according to (1). (3) The purpose-specific software generation unit generating software to be used for the first purpose based on the first data; A server device according to (1) or (2). (4) The purpose-specific software generation unit generating software to be used for the first purpose and software to be used for the second purpose based on the first data and second data regarding the underwater object acquired for the second purpose; A server device according to any one of (1) to (3). (5) an identification program generating unit that generates an identification program for identifying underwater objects in the software used for the first purpose and the software used for the second purpose; A server device according to any one of (1) to (4). (6) The identification program is used in common by the software used for the first purpose and the software used for the second purpose. (5) A server device according to the present invention. (7) The database used in generating the identification program is generated based on the first data and second data regarding the underwater object acquired for the second purpose. A server device according to (5) or (6). (8) At least a part of the underwater objects to be identified is different between the first purpose and the second purpose. A server device according to any one of (1) to (7). (9) The first and second objectives differ in the actions that are performed when an underwater object to be identified is detected. A server device according to any one of (1) to (8). (10) receiving first data regarding the underwater object acquired for a first purpose; generating software based on said first data to be used for a second purpose different from said first purpose; Generation method. (11) receiving first data regarding the underwater object acquired for a first purpose; generating software based on the first data to be used for a second purpose different from the first purpose; Save the software on a medium How electronic devices are generated. (12) acquiring second data about the underwater object acquired for a second purpose; obtaining an identification result obtained by processing the second data using software used for the second purpose; The identification result is stored in a medium. A method for producing an electronic device according to (11). (13) acquiring first data relating to the underwater object acquired for a first purpose; extracting, from the first data, a portion of the first data necessary for generating software to be used for a second purpose different from the first purpose; storing all or a part of the first data on a medium so that the first data part is identifiable; How to generate the database. (14) acquiring second data about the underwater object acquired for a second purpose; aggregating the second data and the first data portion and storing the combined data on a medium as information necessary for generating software to be used for the second purpose; (13) A method for generating a database according to (13). (15) An electronic device comprising a medium on which the database described in (13) or (14) is stored. (16) a communication unit that acquires software that is generated based on first data about underwater objects acquired for a first purpose and that is used for a second purpose different from the first purpose; a medium for storing the acquired software; An electronic device comprising: (17) An information processing system having a server device and an electronic device, The server device a data acquisition unit that acquires first data related to the underwater object acquired for a first purpose; a purpose-specific software generation unit that generates software to be used for a second purpose different from the first purpose based on the first data; a communication unit for transmitting the software; Equipped with The electronic device includes: a communication unit for acquiring the software; a medium for storing the acquired software; Equipped with Information processing system. (18) Computer, a data acquisition unit that acquires first data related to the underwater object acquired for a first purpose; a purpose-specific software generation unit that generates software to be used for a second purpose different from the first purpose based on the first data; A program to function as a [Explanation of symbols]

[0113] 1 Underwater measurement system 2. Server device 3 Measuring equipment (electronic equipment) 60 Data Acquisition Section 61 Underwater object table generation unit 62 Identification program generation unit 63 Purpose-specific Software Generation Department

Claims

1. a data acquisition unit that acquires first data related to the underwater object acquired for a first purpose; a database generation unit that extracts, from the first data, a first data portion necessary for generating software to be used for a second purpose different from the first purpose, and adds all or a part of the first data to a database so that the first data portion can be identified; a purpose-specific software generation unit that generates software to be used for the second purpose based on the database; A server device comprising:

2. The data acquisition unit acquires second data regarding the underwater object acquired for the second purpose, The database generation unit integrates the second data and the first data portion and adds the integrated data to the database as information necessary for generating software to be used for the second purpose. The server device according to claim 1 .

3. The purpose-specific software generation unit generating software to be used for the first purpose based on the database; The server device according to claim 1 .

4. and an identification program generating unit that generates an identification program for identifying an underwater object in the software used for the first purpose and the software used for the second purpose based on the database. The server device according to claim 1 .

5. The identification program is used in common by the software used for the first purpose and the software used for the second purpose. The server device according to claim 4.

6. At least some of the underwater objects targeted for the first purpose and the second purpose are different. The server device according to claim 1 .

7. The first and second objectives differ in the actions that are performed when an underwater object of interest is detected. The server device according to claim 1 .

8. A server device, acquiring first data relating to the underwater object acquired for a first purpose; extracting, from the first data, a first data portion necessary for generating software to be used for a second purpose different from the first purpose, and adding all or a part of the first data to a database so that the first data portion can be identified; generating software to be used for the second purpose based on the database; Generation method.

9. acquiring first data relating to the underwater object acquired for a first purpose; extracting, from the first data, a first data portion necessary for generating software to be used for a second purpose different from the first purpose, and adding all or a part of the first data to a database so that the first data portion can be identified; generating software to be used for the second purpose based on the database; Store the software on a medium of an electronic device. How electronic devices are generated.

10. A server device, acquiring first data relating to the underwater object acquired for a first purpose; extracting, from the first data, a portion of the first data necessary for generating software to be used for a second purpose different from the first purpose; storing all or a part of the first data on a medium so that the first data portion is identifiable; How to generate the database.

11. A server device, acquiring second data relating to the underwater object acquired for a second purpose; The second data and the first data portion are integrated and stored on a medium as information necessary for generating software to be used for the second purpose. The method for generating a database according to claim 10.

Images