Growth analysis system, growth analysis method, and computer program

Abstract

To provide a growth analysis system capable of managing camera storage data, etc., according to growth conditions.SOLUTION: The growth analysis system is configured to analyze a growth period of a plant on the basis of images captured by a camera and store the images as saved data in the camera. The growth analysis system has control means that changes at least one of the deletion method for the saved data and the shooting schedule of the camera according to the plant variety and the growth period.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a growth analysis system, a growth analysis method, a computer program, and the like. [Background technology]

[0002] To make up for the labor shortage caused by the decline in the number of agricultural workers and the aging of the population, it is being considered to introduce the latest IT technologies such as AI and IoT to, for example, monitor the growth status of rice. This monitoring involves, for example, using cameras installed in the fields to automatically take pictures of the growth status at set times each day, and visualizing the results of analyzing the images by graphing them.

[0003] The cameras in the farm fields are powered by solar panels or connected to a network using radio waves such as LTE (Long Term Evolution). Patent Document 1 also describes a configuration in which, for monitoring the growth status, the shooting conditions are changed for each of multiple cultivation areas according to the growth status of the crops, and the camera shooting method is changed according to the growth conditions. This allows for the effect of capturing images under shooting conditions suited to each cultivation area. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-201778 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, when using outdoor cameras powered by solar panels to automatically photograph fields and send the data to the cloud to monitor growth conditions, the cameras and batteries are susceptible to adverse effects from weather, animals, insects, etc.

[0006] This can lead to poor LTE signal strength, which can cause data transmission to the cloud to fail. Furthermore, if poor signal strength continues for several days, data may not be transmitted to the cloud for a long period of time, causing the camera's memory to reach its capacity, making it impossible to capture images.

[0007] On the other hand, if the oldest data is deleted in order to free up memory space in the camera, the data required for analysis will not be available, and the monitoring graphs provided to users will be missing, making it impossible to communicate the growth status to users.

[0008] SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems and to provide a growth analysis system that can manage data stored in a camera according to the growth status. [Means for solving the problem]

[0009] One aspect of the present invention is a growth analysis system, comprising: A growth analysis system that analyzes the growth period of a plant based on an image of the plant taken by a camera and stores the image in the camera as saved data, and is characterized by having a control means that changes at least one of the method of deleting the saved data and the camera's shooting schedule depending on the variety and growth period of the plant. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide a growth analysis system that can manage data stored in a camera according to the growth status. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a system configuration diagram showing an example of the overall configuration of a growth analysis system 100 for monitoring the growth status of rice in an embodiment. [Figure 2] 1 is a block diagram showing an example of the hardware configuration of a camera 101 according to an embodiment. [Figure 3]FIG. 2 is a functional block diagram illustrating a program configuration of a cloud 103 according to the embodiment. [Figure 4] 10 is a flowchart illustrating an example of processing during initial camera setup in the embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of an operation plan according to an embodiment. [Figure 6] 10A and 10B are diagrams showing examples of how data is thinned out in the "stable period plan." [Figure 7] 10A and 10B are conceptual diagrams of graph formation when all data is available and when the data is thinned out in the embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of a growing season and an operation plan according to an embodiment. [Figure 9] 10 is a flowchart illustrating an example of processing when executing a management plan in an embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of changing the operation plan in step S904. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments. In each drawing, the same members or elements are designated by the same reference numerals, and duplicate descriptions will be omitted or simplified.

[0013] 1 is a system configuration diagram showing an example of the overall configuration of a growth analysis system 100 for monitoring the growth status of rice in this embodiment. Note that in the following embodiment, rice is used as an example of the plant, but this embodiment can also be applied to other plants other than rice, such as ornamental plants.

[0014] The growth analysis system of this embodiment is configured to analyze the growth period of plants such as rice based on images of the plants such as rice taken by a camera, and to store the images in the camera as storage data.

[0015] Note that some of the functional blocks shown in FIG. 1 are realized by causing a CPU or the like serving as a computer (not shown) included in the growth analysis system 100 to execute a computer program stored in a memory (not shown) serving as a storage medium.

[0016] However, some or all of these functions may be implemented by hardware, which may be a dedicated circuit (ASIC) or a processor (reconfigurable processor, DSP).

[0017] 1 may not be contained in the same housing, but may be configured as separate devices connected to each other via signal paths. The above explanation regarding FIG. 1 also applies to FIG. 3.

[0018] The growth analysis system 100 includes a camera 101, a network 102, a cloud 103, and a client PC 109. The cloud 103 includes a device management unit 104, an analysis unit 106, a data management unit 105, a display unit 107, a recording unit 108, and the like.

[0019] The cloud 103 has at least one CPU (not shown) as a computer, and executes computer programs stored in a memory (not shown) to perform processing of each part within the cloud.

[0020] Camera 101 is a camera installed in a field, facing downwards, and takes pictures of rice plants in the field. Camera 101 connects to network 102 using a communication device such as LTE, and transmits data to cloud 103 via network 102.

[0021] The device management unit 104 sets various settings and operation schedules for the device. The data management unit 105 receives various data and records it in an appropriate location in the recording unit .

[0022] The analysis unit 106 analyzes the data read from the recording unit 108. The data management unit 105 records the analysis results of the data, etc., in the recording unit 108. The client PC 109 can view the analysis results recorded in the recording unit 108 via the display unit 107.

[0023] 2 is a block diagram showing an example of the hardware configuration of the camera 101 according to the embodiment. The CPU 201 is a central processing unit serving as a computer, and controls the operation of each part of the camera 101 based on a computer program stored in memory.

[0024] The ROM 202 is a read-only memory that stores basic programs, data used for basic processing, etc. The RAM 203 is a writable memory that functions as a work area for the CPU 201. The recording device 204 is a device that functions as a large-capacity memory such as an SSD (solid state drive).

[0025] Various computer programs and data are stored in the recording device 204. The operation unit 205 is a device that accepts instructions and command input from a user, and corresponds to a touch panel, etc. The display unit 206 includes a display device for displaying commands input from the operation unit 205 and various response outputs thereto.

[0026] The communication I / F 207 is a device that relays data exchange with external devices, and transmits, for example, images captured by a camera to an external cloud, etc. It also receives instructions from the cloud or other external sources.

[0027] The input unit 208 is a device for inputting data such as images captured by the camera. The system bus 209 is a data bus that controls the flow of data within the camera 101. Note that software that realizes the same functions as the above devices can also be configured as an alternative to hardware devices.

[0028] Fig. 3 is a functional block diagram showing an example of the configuration of the cloud 103 according to the embodiment. 301 to 305 in Fig. 3 correspond to 104 to 108 in Fig. 1. A device management unit 301 sets a method for deleting data stored in the recording device 204 of the camera 101 and a shooting schedule via the network 102.

[0029] The device management unit 301 also authenticates whether the camera 101 is a valid device that can access the cloud 103. The device management unit 301 functions as a control means that changes at least one of the method for deleting data stored in the camera and the camera's shooting schedule depending on the plant variety and growing season.

[0030] The data management unit 302 records the data transmitted from the camera 101 in an appropriate location in the recording unit 305, and transmits the data stored in the recording unit 305 to the camera 101. The data management unit 302 also receives the results of data analysis from the analysis unit 303 and records them in the recording unit 108.

[0031] The analysis unit 303 analyzes data such as images recorded in the recording unit 305 by performing image recognition or the like. The analysis results are stored as is in the recording unit 305. Furthermore, the analysis results are graphed and stored in the recording unit 305. The analysis unit 303 functions as an analysis means that analyzes images of plants and identifies the current growth period according to the plant variety.

[0032] The display unit 304 performs display control for displaying the results of the analysis by the analysis unit 303 on the client PC 109. The display unit 304 displays the results of the analysis by the analysis unit 303 as numerical values ​​or graphs. The recording unit 305 stores data such as camera settings managed by the data management unit 302, the analysis results of the analysis unit 303, and the like.

[0033] FIG. 4 is a flowchart showing an example of processing during initial camera setup in an embodiment, and shows an example of processing during initial camera setup performed when installing a camera in a farm field when constructing the growth analysis system shown in FIG. 1.

[0034] The operations of the steps in the flowchart of FIG. 4 are performed sequentially by a CPU or the like serving as a computer included in each of the cameras and the cloud of the growth analysis system 100 executing a computer program stored in memory.

[0035] Step S401 is a process in which, when the camera 101 is installed, the CPU in the camera 101 inputs the rice variety to be photographed in the field, and the rice variety input from the operation unit 205 is stored in the recording device 204.

[0036] Step S402 is a process in which the CPU in the camera 101 transmits the rice variety stored in step S401 and the image captured at the time of installation to the cloud. Using the operation unit 205, the captured image and the rice variety stored in the recording device 204 are transmitted to the cloud 103 via the communication IF 207.

[0037] In step S403, the data management unit 302 receives the rice variety and image transmitted from the camera 101 in step S402, and the CPU of the cloud 103 records them in the recording unit 305. Then, the analysis unit 303 analyzes the rice variety and image recorded in the recording unit 305 to analyze the growth stage of the rice.

[0038] In step S404, the CPU of the cloud 103 creates a camera operation plan suitable for the growing season based on the variety and the growing stage analyzed in step S403. The camera operation plan in this embodiment is an operation plan that includes the number of times images are taken using the camera 101 and a method for deleting data when the remaining capacity of the recording device 204 (the remaining amount relative to the recording capacity) becomes low.

[0039] In this embodiment, the camera's shooting schedule, such as the number of times the camera takes pictures (shooting frequency), and the above-mentioned data deletion method are determined according to the growth stage and variety. Here, step S404 functions as a control step for changing at least one of the camera's stored data deletion method and the camera's shooting schedule according to the plant variety and growth period.

[0040] In step S405, the CPU of the cloud 103 transmits the operation plan for the camera 101 determined in step S404 to the camera 101 via the data management unit 302.

[0041] In step S406, the camera operation plan transmitted to the camera 101 in step S405 is received by the CPU of the camera 101 and set in the camera 101. Thereafter, the flow of camera initial setting in FIG. 4 ends.

[0042] 5 is a diagram showing an example of an operation plan in step S404. In this embodiment, as shown in table 500, the operation plan for the camera 101 includes three plans: a "stable period plan," a "pre-change plan," and a "change period plan."

[0043] The "stable period plan" is a plan for a period when there is little change in the growth stage, i.e., when the rate of change in plant growth is low, and the number of shots (shooting frequency) is reduced to, for example, once a day. Also, the data deletion method when the remaining capacity (remaining capacity relative to the recording capacity) of the recording device 204 in the camera falls below a predetermined value is set to the "thinning out" method.

[0044] The "pre-change plan" is a plan for a period shortly before (e.g., one week before) a change in the growth stage occurs, and the number of shots (shooting frequency) is set to the normal number (e.g., three times a day). In addition, the method for deleting data when the remaining capacity of the recording device 204 in the camera falls below a predetermined value is set to "thinning out."

[0045] The "change period plan" is a plan for a period when a change in the growth stage occurs, i.e., when the rate of change in plant growth is large, and the number of shots (shooting frequency) is set to the normal number (for example, three times a day). Also, the data deletion method when the remaining capacity of the recording device 204 in the camera falls below a predetermined value is set to "delete oldest data first."

[0046] In addition, in the period following the "pre-change plan" or "change period plan," predetermined tasks such as fertilizing the plants and managing the amount of water required are required. On the other hand, such predetermined tasks are not required in the "stable period plan." In this way, in this embodiment, the growth period is divided into multiple periods, including periods in which predetermined tasks are required for the plants and periods in which predetermined tasks are not required, depending on the rate of change in plant growth.

[0047] In this manner, in this embodiment, as shown in FIG. 5, the expected growth period is divided into multiple periods, and at least one of the method of deleting stored data in the camera's recording device 204 and the camera's shooting schedule is changed according to the divided periods.

[0048] As described above, the predicted growth period is divided into multiple periods according to the rate of change in plant growth. Depending on the growth period, a method of deleting stored data starting with the oldest data or a method of thinning data while retaining data necessary for graph formation is selected. Furthermore, the frequency of camera photography during periods when a specific task is not required is reduced compared to the frequency of camera photography during periods when a specific task is required.

[0049] 6(A) and (B) are diagrams showing examples of how data is thinned out in the "stable period plan," and FIG. 6(A) is a graph showing an example of the data deletion interval. As shown in FIG. 6(A), when the results of analysis by the cloud analysis unit 303 are displayed as a graph 600 on the cloud display unit 304, the data stored in the camera's recording device 204 is thinned out at intervals that do not cause any loss of data in the graph 600. Note that the "stable period plan" is a plan for a period when there is little change in the growth stage, so the number of images taken is set to, for example, once a day.

[0050] In graph 600 of FIG. 6(A), if data is saved every two days, the curve of graph 600 can be displayed relatively smoothly, and there is no significant difference in the curve of graph 600 compared to when data is saved every day, for example.

[0051] Therefore, in this embodiment, as shown in table 601 in FIG. 6B, images captured by a camera are sent to the cloud every two days, and the image data stored in the recording device 204 in the camera is thinned out.

[0052] 6B shows an example of three days' worth of image data that is preferentially stored in the camera's recording device 204, with data from transmitted days being preferentially stored and data from days that are not transmitted being preferentially deleted starting with the oldest data. Also, when the data in the recording device 204 is left only with data from transmitted days, the oldest data is deleted first.

[0053] 7A shows an example of a graph when all the data is available in the embodiment, and FIG. 7B shows an example of a graph when the data is thinned out. Graph 701 when the data is thinned out is compared to graph 700 when all the data is available, showing an example in which there is not a significant difference in the amount of information provided. In other words, graph 701 does not deviate significantly from graph 700.

[0054] Figure 8 is a diagram showing an example of a growth period and operation plan in an embodiment, and 800 shows an example of the operation plan and application period of Figure 5, which is based on the subsequent growth conditions when the specified variety ``Akitakomachi'' is planted on May 15th.

[0055] That is, Figure 8 shows an example in which the "stable period plan" is applied immediately after the change in growth stage, the "pre-change plan" is applied when the growth stage is approaching a change, and the "change period plan" is applied at the change in growth stage.

[0056] FIG. 9 is a flowchart showing an example of processing when an operation plan is executed in the embodiment, and shows an example of processing when an actual growth situation is compared with the growth plan and the plan is adjusted when the operation plan is executed.

[0057] Furthermore, the operations of each step in the flowchart of Figure 9 are performed sequentially and at a predetermined interval by a CPU or the like as a computer contained in each of the cameras and the cloud of the growth analysis system 100 executing a computer program stored in memory.

[0058] In step S901, the CPU of the camera 101 transmits an image captured in the field to the cloud. That is, the captured image and the rice variety data stored in the recording device 204 are transmitted to the cloud 103 via the communication IF 207.

[0059] In step S902, the cloud CPU receives the images and variety data sent in step S901 via the data management unit 302 and records them in the recording unit 305, and the analysis unit 303 analyzes the captured image data to analyze the growth stage of the rice.

[0060] In step S903, the cloud CPU determines whether there is a discrepancy between the growth period in the operation plan and the current growth stage based on the growth stage analyzed in step S902. If there is a discrepancy in the growth status, proceed to the processing of step S904. If there is no discrepancy, end the flow of FIG.

[0061] In step S904, the cloud CPU changes the camera operation plan. That is, based on the analysis results of the current growth status (growth stage), it corrects any deviation from the operation plan. If the current growth status (growth stage) is ahead of the operation plan, the operation plan is also advanced, and if the current growth status (growth stage) is behind the operation plan, the operation plan is also delayed.

[0062] In this way, in step S904, the cloud CPU acting as the control means corrects the predicted growing season based on the current growing season of the plant.

[0063] In step S905, the cloud CPU transmits the camera operation plan changed in step S904 to the camera. That is, the cloud CPU transmits the camera settings to the camera 101 via the data management unit 302.

[0064] In step S906, the camera's CPU sets the camera operation plan transmitted to the camera 101 in step S905 in the camera 101. After this process is completed, the flow in FIG. 9 ends.

[0065] FIG. 10 is a diagram showing an example of changing the operation plan in step S904, and shows an example of adjusting the operation plan when a discrepancy occurs between the current growth situation (growth stage) and the operation plan 1000.

[0066] In the example of Figure 9, the current growth conditions (growth stage) mean that the ineffective tillering period has arrived earlier than planned in operation plan 1000, so the operation plan is changed in step S904 to operation plan 1001, thereby shortening the period until the end of the ripening period.

[0067] In this way, in this embodiment, when the user does not frequently check the growth graph and there are not many changes in the growth situation, the remaining capacity of the recording unit can be prevented from falling below a predetermined value, making it possible to prevent the growth graph from being interrupted. On the other hand, when the user frequently checks the growth graph and there are changes, it is possible to ensure that the most recent growth graph, which is most important to the user, is not missed.

[0068] The present invention has been described in detail above based on its preferred embodiments, but the present invention is not limited to the above embodiments, and various modifications are possible based on the spirit of the present invention, and these modifications are not excluded from the scope of the present invention.

[0069] The present invention also includes those that realize the functions of the above embodiments using, for example, at least one processor such as a CPU, memory, or circuit (for example, ASIC). Also, multiple processors may be used to perform distributed processing.

[0070] In order to realize part or all of the control in the above embodiments, a computer program that realizes the functions of the above embodiments may be supplied to a growth analysis system or the like via a network or various storage media. Then, a computer (or a CPU, MPU, etc.) in the growth analysis system or the like may read and execute the program. In this case, the program and the storage medium storing the program constitute the present invention. The present invention also includes the following combinations.

[0071] (Configuration 1) A growth analysis system that analyzes the growth period of a plant based on images of the plant taken with a camera and stores the images in the camera as saved data, characterized in that the growth analysis system has a control means that changes at least one of the method of deleting the saved data and the camera's shooting schedule depending on the variety of the plant and the growth period.

[0072] (Configuration 2) The growth analysis system according to Configuration 1, further comprising an analysis means for analyzing the image and identifying the current growth stage according to the variety of the plant.

[0073] (Configuration 3) The growth analysis system according to configuration 1 or 2, wherein the control means corrects the predicted growth period based on the current growth period of the plant.

[0074] (Configuration 4) A growth analysis system described in any one of configurations 1 to 3, characterized in that the control means divides the predicted growth period into multiple periods and changes at least one of the method of deleting the stored data and the camera's shooting schedule according to the divided periods.

[0075] (Configuration 5) The growth analysis system according to any one of Configurations 1 to 4, wherein the control means divides the growth period according to a rate of change in the growth of the plant.

[0076] (Configuration 6) A growth analysis system described in any one of configurations 1 to 5, characterized in that the control means divides the growth period into multiple periods including periods in which specified work on the plant is required and periods in which the specified work is not required, depending on the rate of change of the growth of the plant.

[0077] (Configuration 7) The growth analysis system described in Configuration 6, characterized in that the control means reduces the frequency of photography by the camera during periods when the specified work is not required to be less than the frequency of photography by the camera during periods when the specified work is required.

[0078] (Configuration 8) A growth analysis system described in any one of configurations 1 to 7, characterized in that the control means selects, depending on the growth period, a method of deleting the stored data starting with the oldest data, or a method of thinning out the data and leaving only the data necessary for graph formation.

[0079] (Method) A growth analysis system that analyzes the growth period of a plant based on images of the plant taken with a camera and stores the images in the camera as saved data, the growth analysis method having a control step that changes at least one of the method of deleting the saved data and the camera's shooting schedule depending on the variety of the plant and the growth period.

[0080] (Program) A computer program for controlling each means of the growth analysis system according to any one of configurations 1 to 8 by a computer. [Explanation of symbols]

[0081] 100: Growth analysis system 101: Camera 102: Communication path 103: Cloud 109: Client PC

Claims

1. A growth analysis system that analyzes the growth period of a plant based on images of the plant taken with a camera and stores the images in the camera as saved data, characterized in that the growth analysis system has a control means that changes at least one of the method of deleting the saved data and the camera's shooting schedule depending on the plant variety and the growth period.

2. 2. The growth analysis system according to claim 1, further comprising an analysis means for analyzing the image and identifying the current growth period according to the variety of the plant.

3. 2. The growth analysis system according to claim 1, wherein the control means corrects the predicted growth period based on the current growth period of the plant.

4. The growth analysis system described in claim 1, characterized in that the control means divides the predicted growth period into multiple periods and changes at least one of the method of deleting the stored data and the camera's shooting schedule according to the divided periods.

5. 2. The growth analysis system according to claim 1, wherein the control means divides the growth period according to a rate of change in the growth of the plant.

6. The growth analysis system described in claim 1, characterized in that the control means divides the growth period into multiple periods including periods in which specified work on the plant is required and periods in which the specified work is not required, depending on the rate of change of the growth of the plant.

7. The growth analysis system according to claim 6, wherein the control means reduces the frequency of photography by the camera during periods when the specified work is not required to be less than the frequency of photography by the camera during periods when the specified work is required.

8. The growth analysis system according to claim 1, characterized in that the control means selects, depending on the growth period, a method of deleting the stored data starting from the oldest data or a method of thinning out the data and leaving only the data necessary for graph formation.

9. A growth analysis system that analyzes the growth period of a plant based on images of the plant taken with a camera and stores the images in the camera as saved data, and the growth analysis method includes a control step that changes at least one of the method for deleting the saved data and the camera's shooting schedule depending on the variety of the plant and the growth period.

10. A computer program for controlling each means of the growth analysis system according to any one of claims 1 to 8 by a computer.

Images