Measurement program for cultivated plants and mobile terminal implementing measurement program for cultivated plants

Abstract

To provide a measurement program that enables low-cost and precise measurement of a cultivated plant, and a mobile terminal implementing the measurement program.SOLUTION: A measurement program that causes a computer to execute an imaging function of capturing an image and acquiring imaging data in a state where a top portion Rh of a main stem 51 of a cultivated plant and a node portion 55, which is a location where each of a flower cluster portion 53 and a branch and leaf portion 52 is differentiated from the main stem 51, are present within an imaging range 14, a recognition function of recognizing the main stem 51 from the imaging data, and a stem diameter calculation function of calculating a stem diameter D of the main stem recognized by the recognition function.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to a cultivated plant measurement program and a mobile terminal that implements the cultivated plant measurement program. [Background technology]

[0002] For example, in the system of a horticultural facility disclosed in Patent Document 1, an imaging device (referred to as a "fixed camera" in the document) is attached to the ceiling. The imaging device captures images of cultivated plants from above, and the system calculates index values ​​based on the images captured by the imaging device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2024-046278 Summary of the Invention [Problem to be solved by the invention]

[0004] However, introducing a system such as that disclosed in Patent Document 1 into a horticultural facility requires a large initial cost, which makes small-scale farmers and businesses hesitant to adopt it. On the other hand, highly functional mobile devices such as smartphones have become widespread in recent years, and if there were a program that could take full advantage of the functions of a mobile device to measure cultivated plants, it would become easier for even small-scale farmers and businesses to carry out precision cultivation of cultivated plants.

[0005] An object of the present invention is to provide a measurement program that enables precise measurement of cultivated plants at low cost, and a mobile terminal that implements the measurement program. [Means for solving the problem]

[0006] The cultivated plant measurement program of the present invention is characterized in that it causes a computer to execute an imaging function that captures images of the top of the main stem of a cultivated plant and the nodes at which the inflorescence and the branches and leaves differentiate from the main stem within an imaging range to obtain imaging data, a recognition function that recognizes the main stem from the imaging data, and a stem diameter calculation function that calculates the stem diameter of the main stem recognized by the recognition function.

[0007] According to the present invention, the stem diameter of the main stem is calculated by executing the imaging function, the recognition function, and the stem diameter calculation function. Therefore, when the imaging function, the recognition function, and the stem diameter calculation function are executed on a mobile device such as a smartphone, it becomes possible to measure cultivated plants using the functions of the mobile device. In this way, the present invention realizes a measurement program that can accurately measure cultivated plants at low cost.

[0008] In the present invention, it is preferable that the imaging data includes color information and depth information, the recognition function is configured to recognize the main stem based on at least one of the color information and the depth information, and the stem diameter calculation function is configured to calculate the stem diameter based on the depth information.

[0009] With this configuration, depth information is also acquired by the imaging function, which allows for more accurate calculation of the stem diameter by the stem diameter calculation function.

[0010] In the present invention, it is preferable to have the computer execute a first display function that displays the cultivated plants within the imaging range imaged by the imaging function and superimposes a marking image highlighting the main stem on the part of the cultivated plants within the imaging range that corresponds to the main stem.

[0011] With this configuration, a manager (including an operator) can check whether the cultivated plant has been properly photographed using the imaging function, and can also check on the screen display whether the main stem has been properly recognized using the recognition function.

[0012] In the present invention, before executing the imaging function, it is preferable that the computer executes a specific information acquisition function to acquire specific information indicating which of the multiple cultivated plants the cultivated plant is, and that the specific information is included in the imaging data.

[0013] This configuration makes it easier to manage cultivated plants in horticultural facilities, etc., compared to a configuration in which specific information is not acquired.

[0014] In the present invention, it is preferable to have a computer execute a memory function that stores the imaging data together with the acquisition date and time and stores the stem diameter in association with the acquisition date and time, and a second display function that displays the stem diameter as a time-series graph.

[0015] This configuration allows managers (including operators) to easily check changes in the main stem over time and accurately grasp trends in the growth status of cultivated plants.

[0016] In the present invention, it is preferable that the second display function is configured to select at least one of the plurality of pieces of image data and display the image of the cultivated plant together with the graph.

[0017] This configuration allows a manager (including an operator) to more accurately grasp the trends in the growth status of cultivated plants while checking the graph.

[0018] The present invention is also applicable to a mobile terminal that has an imaging device and that implements the above-described cultivated plant measurement program.

[0019] According to the present invention, the stem diameter of the main stem is calculated by utilizing the functions of the mobile device and executing the imaging function, recognition function, and stem diameter calculation function. Therefore, according to the present invention, a mobile device equipped with a measurement program that can accurately measure cultivated plants at low cost can be realized. [Brief explanation of the drawings]

[0020] [Figure 1]FIG. 1 is a diagram illustrating an example of a horticultural facility. [Figure 2] FIG. 10 is a functional block diagram showing a program for calculating stem diameter. [Figure 3] FIG. 10 is a diagram showing the procedure for imaging to calculate the stalk diameter. [Figure 4] FIG. 10 is a functional block diagram showing a program for calculating the stem length. [Figure 5] FIG. 10 is a diagram showing the flow of imaging for calculating the stem length. [Figure 6] FIG. 10 is a diagram showing the flow of imaging for calculating the stem length. [Figure 7] FIG. 10 is a diagram showing a history display on a screen. [Figure 8] FIG. 10 is a diagram showing a graph display on the screen. DETAILED DESCRIPTION OF THE INVENTION

[0021] An embodiment of the present invention will be described with reference to the drawings. As shown in FIG. 1, a horticultural facility has multiple ridges A arranged vertically and horizontally for planting cultivated plants Q. Multiple cultivated plants Q are planted in each ridge A. Passages are provided between the ridges A for the manager of the cultivated plants Q (including operators, etc.). The horticultural facility may be, for example, a greenhouse or a solar-powered plant factory. In this embodiment, the manager carries a smartphone S. A measurement program for the cultivated plants Q is installed on the smartphone S. The smartphone S also has an imaging device. The imaging device may be, for example, a stereo camera having multiple cameras with complementary metal-oxide semiconductor (CMOS) sensors, or a combination of a CMOS sensor camera and a light-detecting reflective photoelectric range finder (LiDAR). The measurement program may be, for example, an executable program generated by a compiler and a linker, or may be code executed sequentially by an interpreter.

[0022] The measurement program of this embodiment has a stem diameter calculation function 7 shown in Figures 2 and 3, a stem length calculation function 22 shown in Figures 4 to 6, and a flowering judgment value calculation function 21. When a manager of a horticultural facility or the like captures an image of a cultivated plant Q with the imaging device of a smartphone S, the program of this embodiment calculates the stem diameter D and length (stem length L) of the main stem 51 (see Figures 3, 6, and 7) of the cultivated plant Q. Furthermore, the program of this embodiment has a growth judgment value calculation function 23 that calculates a growth judgment value based on the stem length L and the flowering judgment value.

[0023] 3, 5, and 6 show the captured images S1 and S2. The captured images S1 and S2 are displayed on the touch panel display of the smartphone S. FIG. 3 shows the captured image S1. The captured image S1 is a screen for capturing an image of the main stem 51. FIGS. 5 and 6 show the captured image S2. The captured image S2 is a screen for capturing an image of the main stem 51 and the inflorescence portion 53.

[0024] The measurement target selection unit 12 is shown on the image capture screen S1 in Fig. 3, and the measurement target selection unit 32 is shown on the image capture screen S2 in Fig. 5. The measurement target selection units 12, 32 accept a selection operation from an administrator or the like as to whether to measure the stem diameter D or the stem length L.

[0025] When the administrator or the like operates the measurement target selection unit 12 on the imaging screen S1 to select "flowering position," the screen displayed on the touch panel display of the smartphone S switches from the imaging screen S1 to the imaging screen S2. Also, when the administrator or the like operates the measurement target selection unit 32 on the imaging screen S2 to select "stem diameter," the screen displayed on the touch panel display of the smartphone S switches from the imaging screen S2 to the imaging screen S1.

[0026] [Stem diameter calculation program] As shown in Figure 2, the program for calculating the stem diameter D has a specific information acquisition function 1A, an imaging function 2A, a feature recognition function 3A, a three-dimensional coordinate calculation function 4A, an XYZ image output function 5A, a stem diameter calculation position determination function 6, a stem diameter calculation function 7, a memory function 8A, a marking display function 9A, and a graph display function 10A. The marking display function 9A corresponds to the "first display function," and the graph display function 10A corresponds to the "second display function."

[0027] The specific information acquisition function 1A acquires specific information indicating which of the multiple cultivated plants Q it is. As shown in screen step #01 of FIG. 3, the specific information acquisition unit 13 is displayed on the imaging screen S1. When the manager or the like operates the specific information acquisition unit 13, information regarding the location of the greenhouse in which the cultivated plant is grown and which plant (cultivated plant Q) it is is input. At this time, the imaging function 2A is disabled, and the manager or the like cannot image the cultivated plant Q. In other words, before executing the imaging function 2A, the specific information acquisition function 1A acquires specific information indicating which of the multiple cultivated plants Q it is.

[0028] Alternatively, a two-dimensional code tag (e.g., QR Code (registered trademark), Data Matrix, etc.) or RFID (radio frequency identification) tag may be attached to each of the multiple cultivated plants Q. For example, a two-dimensional code tag or RFID tag may be attached to an attraction clip for attracting the cultivated plants Q. In this case, when an administrator or the like holds a smartphone S over the two-dimensional code tag or RFID tag, the specific information acquisition function 1A may acquire, from the two-dimensional code tag or RFID tag, specific information indicating which of the multiple cultivated plants Q it is.

[0029] When the specific information acquisition function 1A acquires the specific information, the imaging range 14 is displayed on the imaging screen S1, as shown in screen step #02 in FIG. 3. At this time, the imaging function 2A is enabled, allowing the manager or the like to capture an image of the cultivated plant Q. The manager or the like adjusts the angle of the smartphone S so that the upper end of the cultivated plant Q and a portion of the main stem 51 of the cultivated plant Q located approximately 20 to 30 centimeters below the upper end are captured in the imaging range 14. After completing the angle adjustment, the manager or the like operates the shutter button 11 to capture an image of the cultivated plant Q.

[0030] When the cultivated plant Q is imaged, imaging data of the cultivated plant Q is acquired. The imaging data of the cultivated plant Q includes color information and depth information of the cultivated plant Q. The color information of the cultivated plant Q is image data of the cultivated plant Q, etc. The depth information of the cultivated plant Q is information regarding the distance between the imaging device of the smartphone S and each part of the cultivated plant Q. In addition, specific information acquired by the specific information acquisition function 1A is added to the imaging data of the cultivated plant Q. In other words, the specific information is included in the imaging data of the cultivated plant Q.

[0031] The recognition function 3A recognizes the main stem 51, the apex Rh of the main stem 51, the branch and leaf portion 52, the inflorescence portion 53, and the node portion 55 of the cultivated plant Q from image data of the cultivated plant Q. The branch and leaf portion 52 is the portion of the cultivated plant Q where leaves grow from the secondary vines. The inflorescence portion 53 is the portion of the cultivated plant Q where inflorescences bloom and fruit are borne from the secondary vines. The node portion 55 is the portion where the secondary vines of the inflorescence portion 53 and the branch and leaf portion 52 differentiate from the main stem 51. A neural network capable of machine learning using deep learning is constructed in the recognition function 3A. Neural networks are known for their ability to identify input-output relationships with nonlinear characteristics through deep learning. The recognition function 3A is configured to be able to identify the types of branches, leaves, stems, etc. of the cultivated plant Q by utilizing a neural network trained using deep learning. The color information, etc. of the image data may be determined based on RGB data or YUV data. That is, the recognition function 3A recognizes the main stem 51, branches and leaves 52, inflorescences 53, nodes 55, etc. of the cultivated plant Q based on color information of the imaging data acquired by the imaging function 2A.

[0032] That is, the imaging function 2A captures and acquires imaging data of the apex Rh of the main stem 51 of the cultivated plant Q and the nodes 55, which are the locations at which the inflorescence 53 and the branches and leaves 52 differentiate from the main stem 51, within the imaging range 14. The recognition function 3A then recognizes the main stem 51 from the imaging data.

[0033] The three-dimensional coordinate calculation function 4A converts coordinate information indicating the distance between the imaging device of the smartphone S and each part of the cultivated plant Q into three-dimensional coordinate information of the cultivated plant Q. In other words, the three-dimensional coordinate calculation function 4A calculates the three-dimensional shape of the cultivated plant Q based on the depth information of the cultivated plant Q imaged by the imaging function 2A.

[0034] The XYZ image output function 5A plots the three-dimensional coordinate information of the cultivated plant Q calculated by the three-dimensional coordinate calculation function 4A onto XYZ image data, and outputs XYZ image data that indicates a collection of the three-dimensional coordinate information.

[0035] Based on the main stem 51 recognized by the recognition function 3A and the XYZ image data output by the XYZ image output function 5A, the stem diameter calculation position determination function 6 extracts portions of the XYZ image data of the cultivated plant Q that correspond to the top Rh, the main stem 51, and the nodes 55. The stem diameter calculation position determination function 6 calculates the length of the main stem 51 below the top Rh by integrating the distance between adjacent vertices in the coordinates of multiple vertices of the XYZ image data. The stem diameter calculation position determination function 6 then identifies a portion of the main stem 51 that is a preset length Lh below the top Rh as the reference point 56. The set length Lh from the top Rh to the reference point 56 is, for example, 10 to 20 centimeters. Note that this set length Lh may be calculated appropriately depending on the type of cultivated plant Q, environmental conditions, etc.

[0036] Furthermore, the stem diameter calculation position determination function 6 acquires the coordinate positions of two adjacent nodes 55 above and below the reference point 56, and determines the middle point of the main stem 51 that is equally distant from the two nodes 55 as the stem diameter measurement position 57.

[0037] The stem diameter calculation function 7 calculates the stem diameter D of the main stem 51 recognized by the recognition function 3A. The stem diameter calculation function 7 calculates a tangent 58 that touches the main stem 51 at the stem diameter measurement position 57, and calculates a normal line that is perpendicular to this tangent 58. This normal line crosses the main stem 51. The stem diameter D of the main stem 51 can be calculated from the three-dimensional coordinates of the XYZ image data. Therefore, the stem diameter calculation function 7 calculates the length of the part of the normal line that overlaps with the main stem 51 from the three-dimensional coordinates of the XYZ image data. In other words, the stem diameter calculation function 7 is configured to calculate the stem diameter D based on depth information.

[0038] After the stem diameter D is calculated by the stem diameter calculation function 7, the marking display function 9A displays the cultivated plant Q within the imaging range 14 captured by the imaging function 2A on the touch panel display of the smartphone S (screen step #03 in Figure 3). Furthermore, the marking display function 9A superimposes a marking image that highlights the top part Rh, main stem 51, node 55, reference point 56, and stem diameter measurement position 57 on the image of the cultivated plant Q (screen step #03 in Figure 3).

[0039] In this way, the marking display function 9A superimposes and displays each marking image highlighting the main stem 51, the node 55, the reference point 56, and the stem diameter measurement position 57 on the part of the cultivated plant Q within the imaging range 14 corresponding to the main stem 51.

[0040] The above-mentioned XYZ image data, marking image data, and stem diameter D data are stored together with the imaging data by the memory function 8A. The memory function 8A stores the imaging data acquired by the imaging function 2A together with the acquisition date and time, and further stores the XYZ image data, marking image data, and stem diameter D data in association with the acquisition date and time. The graph display function 10A will be described later.

[0041] [Stem length and growth discrimination value calculation program] As shown in Figure 2, the program for calculating the stem length L and the growth discrimination value has a specific information acquisition function 1B, imaging functions 2B and 2C, a characteristic part recognition function 3B, a three-dimensional coordinate calculation function 4B, an XYZ image output function 5B, a memory function 8B, marking display functions 9B and 9C, a graph display function 10B, a flowering discrimination value calculation function 21, and a stem length calculation function 22.

[0042] Like the above-described identification information acquisition function 1A, the identification information acquisition function 1B acquires identification information indicating which of the multiple cultivated plants Q it is. As shown in screen step #11 of FIG. 5, the identification information acquisition unit 33 is displayed on the captured image screen S2. When the manager or the like operates the identification information acquisition unit 33, information regarding the greenhouse in which the cultivated plant is grown and which plant (cultivated plant Q) it is is input. At this time, the imaging functions 2B and 2C are disabled, and the manager or the like cannot capture an image of the cultivated plant Q. That is, before executing the imaging functions 2B and 2C, the identification information acquisition function 1B acquires identification information indicating which of the multiple cultivated plants Q it is.

[0043] As in the case described above with the specific information acquisition function 1A, when an administrator or the like holds a smartphone S over a two-dimensional code tag or RFID tag attached to an attraction clip or the like of a cultivated plant Q, the specific information acquisition function 1B may be configured to acquire the specific information from the two-dimensional code tag or RFID tag.

[0044] When the specific information acquisition function 1B acquires the specific information, the imaging range 34 is displayed on the imaging screen S2, as shown in screen step #12 of FIG. 5. At this time, the imaging function 2B is enabled, allowing the administrator or the like to capture the cultivated plant Q. At this time, a message such as "Please photograph the highest blooming inflorescence" may be displayed on the imaging screen S2. The administrator or the like adjusts the angle of the smartphone S so that the highest inflorescence 53, which differentiates from the main stem 51 at the highest position among the inflorescence parts 53 containing blooming inflorescence 53A, is captured prominently within the frame of the imaging range 34 as the subject. After completing the angle adjustment, the administrator or the like operates the shutter button 31A to capture the highest inflorescence part 53.

[0045] That is, the imaging function 2B captures an image of the inflorescence part 53, which is a collection of inflorescences differentiated from the main stem 51 of the cultivated plant Q, within the imaging range to obtain imaging data.

[0046] When the uppermost inflorescence 53 is imaged, imaging data of the uppermost inflorescence 53 is acquired. The imaging data of the uppermost inflorescence 53 includes the color information and depth information described above. In addition, the specific information acquired by the specific information acquisition function 1B is added to the imaging data of the uppermost inflorescence 53. That is, the specific information is included in the imaging data of the uppermost inflorescence 53 acquired based on the imaging function 2B.

[0047] The recognition function 3B recognizes the inflorescence part 53 from the image data of the topmost inflorescence part 53. The data of the inflorescence part 53 recognized by the recognition function 3B is sent to the flowering determination value calculation function 21.

[0048] The imaging data of the uppermost inflorescence part 53 and the data of the inflorescence part 53 recognized by the recognition function 3B are used to calculate a discrimination value by the flowering discrimination value calculation function 21. The flowering discrimination value calculation function 21 recognizes the shape and color of the multiple inflorescences 53A based on the color information of the uppermost inflorescence part 53 in the imaging data, and calculates a flowering discrimination value that indicates the degree to which the multiple inflorescences 53A have bloomed. The flowering discrimination value calculation function 21 quantifies the flowering stages of the multiple inflorescences 53A as flowering discrimination values, including a state where the flower is not yet bloomed, a state where the sepals are just beginning to split, a state where the sepals have completely split and the inner petals are beginning to protrude, a flowering state where the sepals and petals repeatedly bend and extend, a state where the flower has set fruit, etc.

[0049] After the flowering discrimination value calculation function 21 calculates the flowering discrimination value, the marking display function 9B displays the inflorescence portion 53 within the imaging range 34 captured by the imaging function 2B on the touch panel display of the smartphone S (screen step #13 in FIG. 5). Furthermore, the marking display function 9B displays the inflorescence 53A and a frame image (marking image) color-coded according to the flowering discrimination value superimposed on the image of the inflorescence portion 53 (screen step #13 in FIG. 5). Therefore, in screen step #13 in FIG. 5, the inflorescence 53A in a bloomed state is displayed surrounded by a frame colored according to the flowering discrimination value.

[0050] In this way, the marking display function 9B displays the cultivated plant Q within the imaging range 34 captured by the imaging function 2B, and also superimposes a marking image highlighting the inflorescence portion 53 on the part of the cultivated plant Q within the imaging range 34 corresponding to the inflorescence portion 53.

[0051] After the imaging data of the inflorescence portion 53 is acquired based on the imaging function 2B and the flowering determination value is calculated, the imaging range 35 is displayed on the imaging screen S2, as shown in screen step #14 of FIG. 5. At this time, the imaging function 2C is enabled, allowing the manager or the like to capture an image of the cultivated plant Q. At this time, a message such as "Please take a picture that includes the inflorescence imaged previously, all the way up to the top of the main stem" may be displayed on the imaging screen S2. In addition, the shutter button 31B shown on screen step #14 has a different design (at least one of the shape, pattern, and color) from the shutter button 31A.

[0052] The manager or the like adjusts the angle of the smartphone S so that the upper end of the cultivated plant Q, the inflorescence 53 (the uppermost inflorescence 53) imaged based on the imaging function 2B, and the node 55 into which the inflorescence 53 differentiates are captured within the imaging range 14. After completing the angle adjustment, the manager or the like operates the shutter button 31B to capture an image of the upper part of the cultivated plant Q.

[0053] That is, the imaging function 2C captures the top Rh of the main stem 51 and the node 55, which is the point where the inflorescence section 53 and the branch and leaf section 52 each differentiate from the main stem 51, within the imaging range 35 to obtain imaging data.

[0054] When the cultivated plant Q is imaged based on the imaging function 2C, imaging data of the cultivated plant Q is acquired. The imaging data of the cultivated plant Q includes the color information and depth information described above. In addition, the specific information acquired by the specific information acquisition function 1B is added to the imaging data of the cultivated plant Q. That is, the specific information is included in the imaging data of the cultivated plant Q acquired based on the imaging function 2C.

[0055] The recognition function 3B recognizes the main stem 51, the apex Rh of the main stem 51, the branches and leaves 52, the inflorescence 53, and the nodes 55 of the cultivated plant Q from the image data of the cultivated plant Q. The nodes 55 are the locations where the inflorescence 53 and the branches and leaves 52 are differentiated from the main stem 51. Like the recognition function 3A, the recognition function 3B is configured with a neural network capable of machine learning using deep learning. The recognition function 3B recognizes the main stem 51, the branches and leaves 52, the inflorescence 53, the nodes 55, etc. of the cultivated plant Q based on the color information of the image data acquired by the imaging function 2C.

[0056] From the above, recognition function 3B recognizes main stem 51, inflorescence portion 53, and node portion 55 from the imaging data acquired by imaging function 2B and the imaging data acquired by imaging function 2C.

[0057] The three-dimensional coordinate calculation function 4B converts coordinate information indicating the distance between the imaging device of the smartphone S and each part of the cultivated plant Q into three-dimensional coordinate information of the cultivated plant Q. In other words, the three-dimensional coordinate calculation function 4B calculates the three-dimensional shape of the cultivated plant Q based on the depth information of the cultivated plant Q imaged by the imaging function 2C.

[0058] The XYZ image output function 5B plots the three-dimensional coordinate information of the cultivated plant Q calculated by the three-dimensional coordinate calculation function 4B onto XYZ image data, and outputs XYZ image data that indicates a collection of the three-dimensional coordinate information.

[0059] The stem length calculation function 22 calculates the length of the main stem 51 recognized by the recognition function 3B, between the apex Rh and the node 55 from which the uppermost inflorescence 53 differentiates. At this time, the stem length calculation function 22 calculates the length of the main stem 51 by integrating the distance between adjacent vertices in the coordinates of multiple vertices of the XYZ image data. That is, the stem length calculation function 22 is configured to calculate the length of the main stem 51 (stem length L) based on depth information.

[0060] After the length of the main stem 51 is calculated by the stem length calculation function 22, the marking display function 9C displays the cultivated plant Q within the imaging range 35 captured by the imaging function 2C on the touch panel display of the smartphone S (screen step #15 in FIG. 6). Furthermore, the marking display function 9C superimposes a marking image that highlights each of the apex Rh, main stem 51, branches and leaves 52, inflorescence 53, and nodes 55 on the image of the cultivated plant Q (screen step #15 in FIG. 6).

[0061] In this way, the marking display function 9C displays the cultivated plant Q within the imaging range 35 captured by the imaging function 2C, and superimposes a marking image highlighting the main stem 51 and the nodes 55 on the parts of the cultivated plant Q within the imaging range 35 that correspond to the main stem 51 and the nodes 55, respectively.

[0062] The above-mentioned data on the flowering determination value, XYZ image data, marking image data, and data on the length of the main stem 51 (stem length L) are stored by memory function 8B along with the imaging data acquired by imaging functions 2B and 2C. Memory function 8B stores each of the imaging data acquired by imaging functions 2B and 2C together with the date and time of acquisition, and further stores the flowering determination value data, XYZ image data, marking image data, and data on the length of the main stem 51 (stem length L) in association with the date and time of acquisition. The graph display function 10B will be described later.

[0063] The growth discrimination value calculation function 23 determines a growth discrimination value, which is a discrimination value for the growth state of the cultivated plant Q, based on a flowering discrimination value indicating the flowering state of the inflorescence portion 53 and the length (stem length L) of the main stem 51 between the upper end of the main stem 51 and the inflorescence portion 53. The growth discrimination value is a value indicating whether the cultivated plant Q is inclined toward vegetative growth, in which the main stem 51 grows, or toward reproductive growth, in which the inflorescence portion 53 differentiated from the main stem 51 grows. Note that the growth discrimination value calculation function 23 may be configured to determine the growth discrimination value based on the stem diameter D of the main stem 51, data indicating the environmental conditions of the horticultural facility (temperature, humidity, amount of solar radiation, etc.), meteorological information, etc., in addition to the flowering discrimination value and the length of the main stem 51 described above. Furthermore, the data of the growth discrimination value may be stored by the storage function 8B in association with the calculation date and time.

[0064] [Image history display program] 7, a history display section 41 is displayed in the lower left portion of each of the captured images S1 and S2. When an administrator or the like operates the history display section 41, a history display screen S3 as shown in screen step #22 is displayed on the touch panel display of the smartphone S.

[0065] The history display screen S3 shows a marking display switching section 42, a measurement value input section 43, and a history selection section 44. The history selection section 44 displays a list of thumbnails showing image data captured in the past. The history selection section 44 can be scrolled horizontally. When an administrator or the like touches one of the multiple thumbnails displayed in the history selection section 44, the image of the cultivated plant Q displayed on the history display screen S3 switches to the image of the cultivated plant Q corresponding to the touched thumbnail.

[0066] When the manager or the like touches the marking display switching unit 42, as shown in screen step #23 (history display screen S4) of FIG. 7, the marking display functions 9A, 9B, and 9C superimpose a marking image highlighting each of the apex Rh, main stem 51, branch and leaf portions 52, inflorescence portion 53, and node portions 55 on the image of the cultivated plant Q. The marking image data is stored in the memory functions 8A and 8B. Therefore, the marking display functions 9A, 9B, and 9C read out the marking image data corresponding to the image capture date and time of the displayed cultivated plant Q, and superimpose the marking image on the image of the cultivated plant Q. Each time the manager or the like touches the marking display switching unit 42, the marking image is switched between being displayed and not displayed.

[0067] When the administrator or the like touches the measurement value input section 43, a soft keyboard 45 for inputting a measurement value (the stem diameter D or stem length L of the main stem 51) is displayed on the history display screen S5, as shown in screen step #24 in Figure 7. For example, if there is a difference between the stem diameter D calculated by the stem diameter calculation function 7 and the actual stem diameter, and the administrator or the like inputs the correct value using the soft keyboard 45, the value input into the measurement value input section 43 will be reflected in the graph display or the like as the stem diameter D. Also, for example, if there is a difference between the stem length L calculated by the stem length calculation function 22 and the actual stem length, and the administrator or the like inputs the correct value using the soft keyboard 45, the value input into the measurement value input section 43 will be reflected in the graph display or the like as the stem length L.

[0068] [Graph display program] As shown in screen step #31 and screen step #32 of Figure 8, this embodiment is programmed to display a graph screen S6 on the display. The graph screen S6 displays a time series graph showing the changes over time in the stem diameter D and stem length L of the main stem 51.

[0069] The graph screen S6 displays a period selection section 61, a specific information acquisition section 62, a measurement target selection section 63, a status selection section 64, a graph display section 65, a captured image display section 66, and a marking display switching section 67. In the graph display section 65, plot points indicating the stem diameter D or stem length L are arranged in order of calculation date and time, and adjacent plot points are connected by lines to display a time-series line graph.

[0070] The period selection section 61 displays the start and end dates of the time series to be displayed in the graph display section 65. By touching the period selection section 61, the administrator or the like can set the start and end dates of the time series to be displayed in the graph display section 65. In other words, the graph display program is provided with a period setting function for setting the start and end dates of the time series to be displayed in the graph display section 65.

[0071] When the manager or the like operates the specific information acquisition unit 62, information regarding the location of the greenhouse in which the cultivated plant is grown and the type of plant (cultivated plant Q) is input. A time series graph showing the stem diameter D or stem length L of the cultivated plant Q selected by the manager or the like based on the operation of the specific information acquisition unit 62 is displayed on the graph display unit 65. That is, the graph display program is provided with a specific information acquisition function that acquires specific information indicating which cultivated plant Q among multiple cultivated plants Q it is, similar to the specific information acquisition functions 1A and 1B.

[0072] The measurement target selection unit 63 accepts a selection operation from the administrator or the like to select whether to display the stem diameter D or the stem length L on the graph. When the administrator or the like operates the measurement target selection unit 63 to select "flowering position," the graph displayed on the graph display unit 65 switches to a time-series graph showing the stem length L. When the administrator or the like operates the measurement target selection unit 63 to select "stem diameter," the graph displayed on the graph display unit 65 switches to a time-series graph showing the stem diameter D. In other words, the graph display program is provided with a measurement target selection function that selects whether to display the stem diameter D or the stem length L, which is also the measurement target. In addition to stem diameter D and stem length L, the program may be configured to display time-series graphs of the above-mentioned flowering determination value and the above-mentioned growth determination value.

[0073] A plurality of plot points are displayed on the graph display section 65. One of the plurality of plot points is highlighted as an emphasis point 65A. When an administrator or the like touches one of the plurality of plot points, the plot point is highlighted as the emphasis point 65A. In other words, the emphasis point 65A is a plot point selected and designated by the administrator or the like.

[0074] A captured image corresponding to the plot point selected as the highlighted point 65A is displayed on the captured image display section 66. That is, when an administrator or the like touches one of the plot points to change the plot point highlighted as the highlighted point 65A, the imaging data corresponding to the plot point highlighted as the highlighted point 65A is read out, and an image of the imaging data is displayed.

[0075] The plot points highlighted as the highlighted points 65A are different between imaging step #31 and imaging step #32. Therefore, the captured image display unit 66 shown in imaging step #31 and the captured image display unit 66 shown in imaging step #32 display different images according to the plot points highlighted as the highlighted points 65A.

[0076] When stem diameter D is selected by the measurement target selection function, an image of the cultivated plant Q captured in the imaging data acquired based on imaging function 2A is displayed on the captured image display unit 66. When stem length L is selected by the measurement target selection function, an image of the cultivated plant Q captured in the imaging data acquired based on imaging function 2B or imaging function 2C is displayed on the captured image display unit 66. In other words, the graph display program is provided with a captured image display function that reads imaging data corresponding to a selected and specified plot point from among a plurality of plot points and displays an image of the cultivated plant Q captured in that imaging data.

[0077] When the manager or the like touches the marking display switching unit 67, the marking display functions 9A, 9B, and 9C superimpose marking images highlighting the apex Rh, main stem 51, branch and leaf portions 52, inflorescence portion 53, and nodes 55 on the image of the cultivated plant Q displayed on the captured image display unit 66, as in the case shown in screen step #23 (history display screen S4) of FIG. 7 . The marking image data is stored in the memory functions 8A and 8B. Therefore, the marking display functions 9A, 9B, and 9C read out the marking image data corresponding to the selected plot point and superimpose the marking image on the image of the cultivated plant Q displayed on the captured image display unit 66. Each time the manager or the like touches the marking display switching unit 67, the marking image is switched between being displayed and not displayed.

[0078] [Another embodiment] The present invention is not limited to the configurations exemplified in the above-described embodiments, and other representative embodiments of the present invention will be exemplified below.

[0079] (1) The above-described recognition functions 3A and 3B may be configured to recognize the main stem 51 based on at least one of color information and depth information.

[0080] (2) The above-mentioned three-dimensional coordinate calculation function 4A and XYZ image output function 5A may be configured integrally. Also, the above-mentioned stem diameter calculation position determination function 6 and stem diameter calculation function 7 may be configured integrally. Furthermore, the above-mentioned three-dimensional coordinate calculation function 4A, XYZ image output function 5A, stem diameter calculation position determination function 6 and stem diameter calculation function 7 may be configured integrally.

[0081] (3) The marking display function 9A may be configured to superimpose a marking image highlighting at least one of the main stem 51, the node 55, the reference point 56, and the stem diameter measurement position 57 on the part of the cultivated plant Q within the imaging range 14 that corresponds to the main stem 51.

[0082] (4) In the above embodiment, the mobile terminal is exemplified as a smartphone S. The mobile terminal may be a tablet computer with an imaging device or a notebook computer with an imaging device.

[0083] (5) In the above-described embodiment, the cultivated plant measurement program is installed on the smartphone S. However, this is not limiting, and the measurement program may be configured to be executable on a web browser, for example. In this case, functions of the cultivated plant measurement program other than the image capture functions 2A, 2B, and 2C may be executed on a server.

[0084] The configurations disclosed in the above-described embodiments (including other embodiments, the same applies hereinafter) can be applied in combination with the configurations disclosed in other embodiments, unless a contradiction arises. Furthermore, the embodiments disclosed in this specification are merely examples, and the present invention is not limited to these, and can be modified as appropriate within the scope of the present invention. [Industrial Applicability]

[0085] The present invention is applicable to a cultivated plant measurement program and a mobile terminal that has an imaging device and that implements the cultivated plant measurement program. [Explanation of symbols]

[0086] 1A: Specific information acquisition function 2A: Imaging function 3A: Recognition function 7: Stem diameter calculation function 8A: Memory function 9A: Marking display function (first display function) 10A:Graph display function (secondary display function) 14: Image capture area 51: Main stem 52: Branches and leaves 53: Inflorescence part 55 : Node D: Stem diameter Q: Cultivated plants Rh:Top S: Smartphone (mobile device)

Claims

1. an imaging function for capturing images of the top of a main stem of a cultivated plant and nodes at which inflorescences and branches and leaves differentiate from the main stem within an imaging range to obtain imaging data; a recognition function for recognizing the main stem from the imaging data; A stem diameter calculation function that calculates the stem diameter of the main stem recognized by the recognition function.

2. the imaging data includes color information and depth information; the recognition function is configured to recognize the main stem based on at least one of the color information and the depth information; The cultivated plant measurement program according to claim 1 , wherein the stem diameter calculation function is configured to calculate the stem diameter based on the depth information.

3. 2. The cultivated plant measurement program according to claim 1, wherein the computer is caused to execute a first display function that displays the cultivated plant within the imaging range imaged by the imaging function and superimposes a marking image highlighting the main stem on a portion of the cultivated plant within the imaging range that corresponds to the main stem.

4. before executing the imaging function, causing the computer to execute a specific information acquisition function to acquire specific information indicating which of the plurality of cultivated plants the cultivated plant is; The cultivated plant measurement program according to claim 1 , wherein the imaging data includes the identification information.

5. a storage function for storing the imaging data together with the acquisition date and time, and storing the stem diameter in association with the acquisition date and time; 2. The measurement program for cultivated plants according to claim 1, which causes a computer to execute a second display function of displaying the stem diameter as a time series graph.

6. The cultivated plant measurement program according to claim 5 , wherein the second display function is configured to select at least one of the plurality of imaging data and display the image of the cultivated plant together with the graph.

7. A mobile terminal having an imaging device and implementing the cultivated plant measurement program according to any one of claims 1 to 6.

Images