Information processing device, information processing system, information processing method, and computer program

Abstract

To provide an information processing device, an information processing method and an information processing system which can reduce the labor and time required for estimating an average size of a target plant.SOLUTION: In a plant cultivation management system for managing cultivation of plants in a farm field, a plant cultivation management server being a type of an information processing device comprises: a target data acquisition unit 115 which acquires target image data being image data generated by imaging a cultivation section in which a plurality of target plants being a specific type of plant are cultivated; and an average size estimation unit 116 which estimates an average size being an average value of the size of each target plant cultivated in the cultivation section by using the image data including color information of the acquired target image data and a model created with prescribed machine learning.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The technology disclosed in this specification relates to an information processing device or the like that estimates the size of a plant under cultivation. [Background technology]

[0002] In recent years, various techniques have been proposed for improving the efficiency and optimizing the cultivation of plants (leafy vegetables, fruit trees, ornamental plants, etc.).For example, a technique is known in which, in fruit tree cultivation carried out by a dedicated farmer, the size of the fruit and the integrated value of the leaf area are calculated from images of the fruit tree, a growth curve that approximates the growth state of the fruit is determined based on the integrated value of the fruit size and the leaf area, the growth curve is used to evaluate the growth state of the cultivated fruit, and the harvest date of the fruit is predicted based on the evaluation results (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-187259 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above conventional technology, the size of each fruit in the image is measured manually, and therefore it takes a lot of time and effort to specify the size of the fruit. This problem is not limited to specifying the size of a fruit for harvest date prediction, but is a common problem when specifying (estimating) the size of a plant under cultivation.

[0005] This specification discloses a technique that can solve the above-mentioned problems. [Means for solving the problem]

[0006] The technology disclosed in this specification can be realized, for example, in the following forms.

[0007] (1) The information processing device disclosed in the present specification includes a target data acquisition unit and an average size estimation unit. The target data acquisition unit acquires target image data, which is image data generated by photographing a cultivation section in which a plurality of target plants, which are specific types of plants, are cultivated. The average size estimation unit estimates an average size, which is an average value of the sizes of the target plants cultivated in the cultivation section, using image data including color information of the target image data and a model created by a predetermined machine learning. In this way, the information processing device acquires target image data generated by photographing a cultivation section, and can estimate the average size of the target plants using image data including color information of the target image data and a model created by machine learning. Therefore, according to the information processing device, the average size of the target plants can be estimated simply by acquiring the target image data, and the effort and time required for estimating the average size of the target plants can be reduced.

[0008] (2) The information processing device may further include a training data acquisition unit that acquires training data in which a plurality of training image data, which is image data generated by photographing a cultivation section in which a plurality of target plants are cultivated, at a plurality of dates and times, and average size data indicating an average size of the target plants in the cultivation section represented by the training image data, are associated with each other, and a model acquisition unit that acquires the model by the machine learning using the training data. According to this information processing device, it is possible to acquire a model for estimating the average size of the target plants without using another device, and to estimate the average size of the target plants using the model, thereby further reducing the effort and time required for estimating the average size of the target plants.

[0009] (3) In the above information processing device, the training image data and the target image data may include overhead image data, which is image data generated by photographing the cultivation area with a photographing device having an angle of 20 degrees or more between the optical axis of the lens and the horizontal plane. According to this information processing device, the average size can be estimated using an image in which the cultivation area is shown in a relatively wide image area, and the accuracy of estimating the average size of the target plant can be improved.

[0010] (4) In the above information processing device, the training image data and the target image data may include, in addition to the overhead image data, horizontal image data, which is image data generated by photographing the cultivation area with a photographing device in which the angle between the optical axis of the lens and the horizontal plane is less than 20 degrees, the model acquisition unit may acquire the first model by the machine learning using the training data for the overhead image data, and may acquire the second model by the machine learning using the training data for the horizontal image data, and the average size estimation unit may estimate the average size for the target image data that is the overhead image data using the first model, and estimate the average size for the target image data that is the horizontal image data using the second model. According to this information processing device, the average size can be estimated using a model optimized according to the photographing angle of the image, and the accuracy of estimating the average size of the target plant can be further improved.

[0011] (5) In the above information processing device, the training image data and the target image data may be image data generated by photographing the cultivation area during a preset daytime time. According to this information processing device, the average size of the target plants grown in the cultivation area can be estimated using an image in which the color of the target plants is relatively faithfully represented, and the accuracy of estimating the average size of the target plants can be improved.

[0012] (6) In the above information processing device, the training image data and the target image data may be image data generated by photographing an area including a plurality of the cultivation sections and trimming the image data for each cultivation section. According to this information processing device, even if the growth conditions of the target plants differ among the cultivation sections, the average size of the target plants cultivated in each cultivation section can be estimated with high accuracy.

[0013] (7) In the information processing device, the trimming may be performed so that a trimmed image of one of the cultivation sections does not include pixels representing the target plants cultivated in the other cultivation sections. According to this information processing device, the influence of pixels representing the target plants in the other cultivation sections can be eliminated, and the average size of the target plants cultivated in each cultivation section can be estimated with higher accuracy.

[0014] (8) The information processing device may further include a harvest date / time prediction unit that predicts a harvest date / time of the target plant based on an average size of the target plant estimated from the target image data. According to this information processing device, the harvest date / time of the target plant can be predicted simply by acquiring the target image data, and the efficiency and optimization of plant cultivation can be effectively achieved.

[0015] (9) In the above information processing device, the target data acquisition unit may acquire a plurality of target image data generated by photographing the cultivation area at a plurality of dates and times, the average size estimation unit may estimate an average size of the target plants for the plurality of target image data, and the harvest date and time prediction unit may predict a harvest date and time of the target plants for one of the target image data based on the average size of the target plants estimated for the one of the target image data and the average size of the target plants estimated for each of the target image data photographed before the photographing date and time of the one of the target image data. According to this information processing device, the harvest date and time of the target plants can be predicted with high accuracy, and the efficiency and optimization of plant cultivation can be more effectively realized.

[0016] (10) In the information processing device, the target plant may be a leafy vegetable, and the average size may be an average plant height of the target plant. According to the information processing device, it is possible to reduce the effort and time required to estimate the average plant height of the leafy vegetable.

[0017] (11) The information processing system disclosed in this specification includes the information processing device and a terminal device capable of communicating with the information processing device via a communication network. The information processing device further includes an information transmission unit that transmits information indicating the estimated average size of the target plant to the terminal device via the communication network. According to this information processing system, since the information transmission unit of the information processing device transmits information indicating the estimated average size of the target plant to the terminal device, a person holding the terminal device can grasp the average size of the target plant even if he or she is in a location other than the field, and the efficiency and optimization of plant cultivation can be more effectively achieved.

[0018] (12) The above information processing system may further include a photographing device that is installed in the field where the target plant is cultivated and is capable of communicating with the information processing device via a communication network, and the target data acquisition unit may acquire the target image data generated by the photographing device photographing the cultivation area via the communication network. According to this information processing system, a photographer (e.g., a farm worker) can acquire the target image data without going to the field, and the average size of the target plant can be estimated using the acquired target image data, thereby making it possible to extremely effectively realize efficiency and optimization of plant cultivation.

[0019] The technology disclosed in this specification can be realized in various forms, such as an information processing device, an information processing system, an information processing method, a computer program for realizing those methods, a non-transitory recording medium on which that computer program is recorded, etc. [Brief description of the drawings]

[0020] [Figure 1] FIG. 1 is an explanatory diagram showing a schematic configuration of a plant cultivation management system 10 according to an embodiment of the present invention. [Diagram 2] A block diagram showing a schematic configuration of a plant cultivation management server 100. [Diagram 3] A flowchart showing the contents of an average size estimation model creation process in this embodiment. [Figure 4] An explanatory diagram conceptually illustrating an example of training data TD. [Diagram 5] An explanatory diagram conceptually illustrating an example of training data TD. [Figure 6] FIG. 6 is an explanatory diagram showing the conditions for trimming image data I. [Figure 7] An explanatory diagram conceptually illustrating an example of an average size estimation model MO. [Figure 8] A flowchart showing the contents of a plant cultivation support process according to the present embodiment. [Figure 9] FIG. 2 is an explanatory diagram showing an example of a screen displayed on the display unit 210 of the terminal device 200 during the plant cultivation support process in this embodiment. [Figure 10] FIG. 1 is an explanatory diagram showing an example of a method for predicting a harvest date and time Te based on an average size AS in this embodiment. [Figure 11] FIG. 2 is an explanatory diagram showing an example of a screen displayed on the display unit 210 of the terminal device 200 during the plant cultivation support process in this embodiment. [Figure 12] An explanatory diagram showing the prediction accuracy of the average size AS for each average size estimation model MO. [Figure 13] An explanatory diagram showing the prediction accuracy of the average size AS for each trimming condition. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] A. Embodiment: A-1. Configuration of the plant cultivation management system 10: FIG. 1 is an explanatory diagram showing a schematic configuration of a plant cultivation management system 10 in this embodiment. The plant cultivation management system 10 is a system for managing the cultivation of plants in a field. More specifically, the plant cultivation management system 10 is a system that uses image data I generated by photographing a cultivation section PL in which a plurality of specific types of plants (hereinafter referred to as "target plants OP") are cultivated, to estimate an average size, which is an average value of the sizes of the target plants OP cultivated in the cultivation section PL, and aims to improve the efficiency and optimization of plant cultivation. In this embodiment, the field is a semi-open type (sunlight utilization type) plant factory PF. Here, the semi-open type plant factory PF is a field surrounded by a material that does not block sunlight, such as a vinyl greenhouse. However, the plant cultivation management system 10 can also be applied to other types of fields (for example, other types of plant factories such as closed type and open type, fields for outdoor cultivation, etc.). Note that, although only one plant factory PF is shown in FIG. 1, the plant cultivation management system 10 can also be applied to the management of plant cultivation in each of a plurality of plant factories PF. In this embodiment, the target plant OP is spinach, which is a leafy vegetable, and the average size is the average plant height. However, the plant cultivation management system 10 can also be applied to estimate other average sizes (for example, average fruit diameters) for other plants (leafy vegetables other than spinach, fruit trees, ornamental plants, etc.). The plant cultivation management system 10 is an example of an information processing system in the claims.

[0022] The plant cultivation management system 10 includes a plant cultivation management server 100, a terminal device 200, and an imaging device 300 installed in the plant factory PF. The devices constituting the plant cultivation management system 10 are connected to each other so as to be able to communicate with each other via a communication network NET.

[0023] The photographing device 300 is a device that is installed in the plant factory PF and generates image data I (e.g., RGB data) by photographing a cultivation section PL in which a plurality of target plants OP are cultivated. In this embodiment, the photographing device 300 is a web camera that takes photographs of a preset range in the plant factory PF, specifically, a range covering one or a plurality of cultivation sections PL, periodically (e.g., every hour) or continuously. The photographing device 300 also has a communication interface (not shown) and transmits image data I generated by photographing each time photographing is performed to the plant cultivation management server 100 via the communication network NET. When there are a plurality of plant factories PF to be managed by the plant cultivation management system 10, the photographing device 300 is installed in each plant factory PF.

[0024] In this embodiment, two types of photographing devices 300 are used: an overhead photographing device 300A and a horizontal photographing device 300B. The overhead photographing device 300A is a photographing device 300 installed at a position where the angle between the optical axis of the lens and the horizontal plane is 20 degrees or more, and generates image data I capturing the cultivation section PL from an overhead view (hereinafter referred to as "overhead image data Io"). On the other hand, the horizontal photographing device 300B is a photographing device 300 installed at a position where the angle between the optical axis of the lens and the horizontal plane is less than 20 degrees, and generates image data I capturing the cultivation section PL from a direction close to horizontal (hereinafter referred to as "horizontal image data Ih"). Both the overhead photographing device 300A and the horizontal photographing device 300B may be installed in each plant factory PF, or either one of the overhead photographing device 300A and the horizontal photographing device 300B may be installed.

[0025] The terminal device 200 is, for example, a smartphone or a tablet terminal. The terminal device 200 includes a display unit 210 configured, for example, by a liquid crystal display or the like (see FIGS. 9 and 11). An application program for plant cultivation management is installed in the terminal device 200. Although the details will be described later, a user (farm worker) of the terminal device 200 can grasp the average size of the target plants OP being cultivated in the plant factory PF and the predicted harvest date and time by using the application program.

[0026] The plant cultivation management server 100 is a server device for managing the cultivation of plants in the plant factory PF. FIG. 2 is a block diagram showing a schematic configuration of the plant cultivation management server 100. The plant cultivation management server 100 includes a control unit 110, a storage unit 120, a display unit 130, an operation input unit 140, and an interface unit 150. These units are connected to each other via a bus 190 so as to be able to communicate with each other. The plant cultivation management server 100 is an example of an information processing device in the claims.

[0027] The display unit 130 of the plant cultivation management server 100 is, for example, a liquid crystal display, and displays various images and information. The operation input unit 140 is, for example, a keyboard, a mouse, buttons, a microphone, and receives operations and instructions from an administrator. The display unit 130 may be provided with a touch panel to function as the operation input unit 140. The interface unit 150 is, for example, a LAN interface, a USB interface, and communicates with other devices via wired or wireless communication.

[0028] The storage unit 120 of the plant cultivation management server 100 is composed of, for example, a ROM, a RAM, a hard disk drive (HDD), etc., and is used to store various programs and data, and as a working area when executing various programs and a temporary storage area for data. For example, the storage unit 120 stores a plant cultivation management program CP, which is a computer program for executing an average size estimation model creation process and a plant cultivation support process, which will be described later. The plant cultivation management program CP is provided in a state stored in a computer-readable recording medium (not shown), such as a CD-ROM, a DVD-ROM, or a USB memory, and is stored in the storage unit 120 by installing it in the plant cultivation management server 100.

[0029] During the execution of an average size estimation model creation process and a plant cultivation support process, which will be described later, the training data TD, the average size estimation model MO, the target image data I(o), the estimated average size data GD, and the predicted harvest date and time data PD are stored in the storage unit 120 of the plant cultivation management server 100. The contents of this information will be described together with the explanation of the average size estimation model creation process and the plant cultivation support process, which will be described later.

[0030] The control unit 110 of the plant cultivation management server 100 is configured with, for example, a CPU, and controls the operation of the plant cultivation management server 100 by executing a computer program read from the storage unit 120. For example, the control unit 110 functions as a plant cultivation management unit 111 that executes an average size estimation model creation process and a plant cultivation support process described below by reading and executing a plant cultivation management program CP from the storage unit 120. The plant cultivation management unit 111 includes a training data acquisition unit 112, a model acquisition unit 114, a target data acquisition unit 115, an average size estimation unit 116, a harvest date and time prediction unit 117, and an information transmission unit 118. The functions of each of these units will be described in conjunction with the description of the average size estimation model creation process and the plant cultivation support process described below.

[0031] A-2. Average size estimation model creation process: Next, an average size estimation model creation process executed by the plant cultivation management server 100 of this embodiment will be described. FIG. 3 is a flowchart showing the contents of the average size estimation model creation process in this embodiment. The average size estimation model creation process is a process for creating an average size estimation model MO for estimating an average size (average plant height in this embodiment), which is an average value of the sizes of each target plant OP (spinach in this embodiment) cultivated in a cultivation section PL, from image data I generated by photographing the cultivation section PL in which a plurality of target plants OP are cultivated, using a predetermined machine learning. The average size estimation model creation process is started in response to an administrator operating the operation input unit 140 of the plant cultivation management server 100 to input a start instruction.

[0032] First, the training data acquisition unit 112 (FIG. 2) of the plant cultivation management server 100 acquires training data TD (S110). The training data TD is data in which a plurality of training image data I(t) generated by photographing the cultivation section PL with the photographing device 300 in the plant factory PF is associated with average size data indicating the average size of the target plants OP in the cultivation section PL represented by each training image data I(t). The acquired training data TD is stored in the memory unit 120 of the plant cultivation management server 100.

[0033] 4 and 5 are explanatory diagrams conceptually illustrating an example of training data TD. FIG. 4 illustrates an example of training data TD using overhead image data Io, and FIG. 5 illustrates an example of training data TD using horizontal image data Ih. As described above, the photographing device 300 (overhead photographing device 300A and horizontal photographing device 300B) installed in the plant factory PF periodically photographs, and transmits image data I (overhead image data Io and horizontal image data Ih) generated by photographing each time to the plant cultivation management server 100 via the communication network NET. The training data acquisition unit 112 of the plant cultivation management server 100 acquires the image data I transmitted from the photographing device 300 via the interface unit 150 and stores it in the storage unit 120 as training image data I(t).

[0034] As described above, in this embodiment, the photographing device 300 photographs an area covering one or more cultivation sections PL as a subject. Therefore, the training data acquisition unit 112 performs trimming on the image data I transmitted from the photographing device 300 for each cultivation section PL, and stores the trimmed image data I in the storage unit 120 as training image data I(t). FIG. 6 is an explanatory diagram showing the conditions (hereinafter referred to as "trimming conditions") when trimming the image data I. In this embodiment, three trimming conditions (trimming conditions 1 to 3) are set. Column A of FIG. 6 shows an example of a trimming frame TF corresponding to each cultivation section PL (PL1 to 3) when the overhead image data Io is trimmed according to trimming condition 1, column B of FIG. 6 shows an example of a trimming frame TF corresponding to each cultivation section PL when the overhead image data Io is trimmed according to trimming condition 2, and column C of FIG. 6 shows an example of a trimming frame TF corresponding to each cultivation section PL when the overhead image data Io is trimmed according to trimming condition 3.

[0035] Cropping condition 1 (see column A in FIG. 6) is a condition for performing cropping such that, for each cultivation section PL, among the pixels depicting the target plants OP being cultivated in the cultivation section PL, the pixels closest to the top, bottom, left, and right edges of the image are the top, bottom, left, and right edges of the cropped image, respectively. In other words, cropping according to cropping condition 1 results in image data I that depicts the entirety of the multiple target plants OP being cultivated for each cultivation section PL.

[0036] Moreover, cropping condition 2 (see column B in FIG. 6) is a condition for performing cropping based on cropping condition 1 so as to include as many pixels as possible and not to include pixels showing target plants OP cultivated in other cultivation sections PL. In other words, cropping according to cropping condition 2 results in image data I for each cultivation section PL that does not show target plants OP cultivated in other cultivation sections PL.

[0037] Moreover, trimming condition 3 (see column C in FIG. 6) is a condition for trimming such that both ends of the long side of the image are cut so that the vertical and horizontal sizes of the image are the same, based on trimming condition 2. That is, trimming according to trimming condition 3 results in image data I that is prevented from distorting when the image data I is converted for learning into data with an aspect ratio of 1:1.

[0038] As shown in FIG. 4 and FIG. 5, hereinafter, image data I (overhead image data Io and horizontal image data Ih) photographed and generated at date and time Ti will be represented as image data Ii (overhead image data Ioi and horizontal image data Ihi). Image data I photographed at planting date and time Ts is image data Is (overhead image data Ios and horizontal image data Ihs), and image data I photographed at harvest date and time Te is image data Ie (overhead image data Ioe and horizontal image data Ihe). The training data acquisition unit 112 identifies the image data Is photographed at planting date and time Ts and the image data Ie photographed at harvest date and time Te from among the multiple image data stored in the storage unit 120 by a known image recognition process. In addition, the training data acquisition unit 112 selects image data I whose photographing date and time is within the period from planting date and time Ts to harvest date and time Te from among the multiple image data I stored in the storage unit 120. However, in this embodiment, the target is a semi-open plant factory PF where cultivation is performed using sunlight, and only image data I generated by photographing during a preset daytime period (e.g., 7:00 to 17:00) is used, and image data I photographed during other times is excluded because there is a risk that the plant's shape will not be clearly captured in the image data I. In this way, the training data acquisition unit 112 selects multiple image data Ii (Is, I1, I2, . . . , Ie) photographed and generated at multiple dates and times Ti (Ts, T1, T2, . . . , Te) during the period from the planting date and time Ts to the harvest date and time Te as the training image data I(t).

[0039] The training data acquisition unit 112 also acquires the value of the average size AS (average plant height) of the target plant OP for each of the multiple image data I stored in the storage unit 120. The average size AS of the target plant OP can be measured, for example, by referring to an image of a ruler that appears together with the target plant OP in the image data I. The average size AS of the target plant OP may also be acquired by referring to a document showing an actual measurement value measured by a farm worker at the plant factory PF and recorded together with the date and time. The training data acquisition unit 112 creates training data TD as labeled data by associating the acquired value of the average size AS with the training image data I(t). For example, as shown in FIG. 4, when the average size AS of the target plant OP is 7 cm for the overhead image data Iom captured at a certain date and time Tm, data in which the value of 7 cm is associated with the overhead image data Iom as the average size ASm is created as the training data TD. The same applies to other image data Ii.

[0040] The training data acquisition unit 112 may acquire training data TD for one crop of the target plant OP, or may acquire training data TD for multiple crops of the target plant OP in order to improve the accuracy of the average size estimation model MO. In addition, when multiple image capture devices 300 are installed in one plant factory PF, the training data acquisition unit 112 may acquire training data TD based on image data acquired from the multiple image capture devices 300. In addition, the training data acquisition unit 112 may acquire training data TD based on image data acquired from the image capture devices 300 installed in each of the multiple plant factories PF. In addition, the training image data I(t) may be generated by performing data augmentation (data expansion) on the image data acquired from the image capture devices 300 by rotating, shifting, adjusting brightness, etc.

[0041] Next, the model acquisition unit 114 (FIG. 2) of the plant cultivation management server 100 creates an average size estimation model MO by a predetermined machine learning using the training data TD (S120 in FIG. 3). FIG. 7 is an explanatory diagram conceptually showing an example of the average size estimation model MO. As shown in FIG. 7, the average size estimation model MO is a model for estimating the average size AS (i.e., the average size AS at the photographing date and time) of the target plant OP cultivated in the cultivation section PL represented by the image data I generated by photographing the cultivation section PL of the target plant OP from the image data I including color information (e.g., RGB value). Note that, in this embodiment, as the average size estimation model MO, an overhead average size estimation model MOo for estimating the average size AS of the target plant OP from the overhead image data Io and a horizontal average size estimation model MOh for estimating the average size AS of the target plant OP from the horizontal image data Ih are created.

[0042] The model acquisition unit 114 uses the training image data I(t) included in the training data TD for each of the overhead view and horizontal view as input data, and uses the average size AS associated with each training image data I(t) as the objective variable. The model acquisition unit 114 uses the root mean square error (RMSE), the mean absolute error (MAE), the coefficient of determination (R 2 ), to create an average size estimation model MO (overhead average size estimation model MOo and horizontal average size estimation model MOh). The created average size estimation model MO is stored in the storage unit 120 of the plant cultivation management server 100. Note that, for example, various known machine learning algorithms such as multiple regression analysis, Random Forest, XGBoost, and convolutional neural network (CNN) can be used to create the average size estimation model MO. The average size estimation model MO is an example of a model in the claims, the overhead average size estimation model MOo is an example of a first model in the claims, and the horizontal average size estimation model MOh is an example of a second model in the claims. The above steps complete the growth rate estimation model creation process for creating the average size estimation model MO.

[0043] In this embodiment, an overhead average size estimation model MOo is created using training data TD for overhead image data Io, and a horizontal average size estimation model MOh is created using training data TD for horizontal image data Ih, but it is also possible to create a single common average size estimation model MO using training data TD that is a mixture of overhead view image data Io and horizontal image data Ih, without distinguishing between overhead and horizontal use.

[0044] A-3. Plant cultivation support treatment: Next, a plant cultivation support process executed by the plant cultivation management server 100 of this embodiment will be described. Fig. 8 is a flowchart showing the contents of the plant cultivation support process in this embodiment. Figs. 9 and 11 are explanatory diagrams showing an example of a screen displayed on the display unit 210 of the terminal device 200 during the plant cultivation support process in this embodiment, and Fig. 10 is an explanatory diagram showing an example of a method for predicting the harvest date and time Te based on the average size AS in this embodiment.

[0045] The plant cultivation support process is a process for supporting the cultivation of a target plant OP by a farm worker. More specifically, the plant cultivation support process is a process for estimating the average size AS of a target plant OP cultivated in a cultivation section PL represented by the target image data I(o) (i.e., the average size AS at the photographing date and time of the target image data I(o)) using image data including color information of the target image data I(o), which is image data I generated by photographing a cultivation section PL in which a plurality of target plants OP are cultivated, and the above-mentioned average size estimation model MO. Furthermore, the plant cultivation support process is a process for predicting the harvest date and time Te of the target plant OP based on the estimated average size AS, and displaying information indicating the average size AS and the harvest date and time Te on the terminal device 200 of the farm worker. The plant cultivation support process is started in response to input of a start instruction by the farm worker operating the terminal device 200 or the manager of the plant cultivation management server 100 operating the operation input unit 140.

[0046] In the plant cultivation support process, first, the target data acquisition unit 115 (FIG. 2) of the plant cultivation management server 100 acquires the target image data I(o) (S210). As described above, the photographing device 300 installed in the plant factory PF periodically takes photographs, and transmits the image data I generated by the photographing to the plant cultivation management server 100 via the communication network NET each time the photographing is performed. The target data acquisition unit 115 of the plant cultivation management server 100 acquires the image data I transmitted from the photographing device 300 via the interface unit 150, and stores it in the storage unit 120 as the target image data I(o). As with the above-mentioned training data TD, the target data acquisition unit 115 trims the image data I transmitted from the photographing device 300 for each cultivation section PL, and stores the trimmed image data I in the storage unit 120 as the target image data I(o).

[0047] Next, the average size estimation unit 116 (FIG. 2) of the plant cultivation management server 100 estimates the average size AS of the target plant OP cultivated in the cultivation section PL represented by the target image data I(o) (i.e., the average size AS at the photographing date and time of the target image data I(o)) using the target image data I(o) acquired in the immediately preceding S210 and the above-mentioned average size estimation model MO (S220). As shown in FIG. 7, the average size estimation unit 116 inputs image data including color information of the target image data I(o) to the average size estimation model MO and acquires the average size AS output from the average size estimation model MO to estimate the average size AS. For example, in the example shown in FIG. 7, the average size AS of the target plant OP is estimated to be "10 cm". The average size estimation unit 116 generates estimated average size data SD, which is information indicating the estimated average size AS, and stores it in the storage unit 120 of the plant cultivation management server 100.

[0048] In this embodiment, two average size estimation models MO are created: an overhead average size estimation model MOo and a horizontal average size estimation model MOh. The average size estimation unit 116 determines whether the target image data I(o) is overhead image data Io or horizontal image data Ih, and estimates the average size AS using the overhead average size estimation model MOo if the target image data I(o) is overhead image data Io, and estimates the average size AS using the horizontal average size estimation model MOh if the target image data I(o) is horizontal image data Ih. The determination of whether the target image data I(o) is overhead image data Io or horizontal image data Ih can be realized, for example, by analyzing the image contents of the target image data I(o) or by referring to the attached information of the target image data I(o). In addition, the determination may be realized by creating a model for the determination by machine learning and performing classification using the model.

[0049] Next, the plant cultivation management unit 111 (FIG. 2) of the plant cultivation management server 100 judges whether the number N of the target image data I(o) for which the average size AS has been estimated is equal to or greater than a predetermined threshold Th (e.g., 30) (S230). If it is judged in the judgment of S230 that the number N of the target image data I(o) for which the average size AS has been estimated is less than the threshold Th (S230: NO), the prediction of the harvest date and time Te (described later) is not executed because it is difficult to formulate (S240). In this case, the information transmission unit 118 (FIG. 2) of the plant cultivation management server 100 transmits the target image data I(o) acquired in the immediately preceding S210 and the estimated average size data SD indicating the average size AS estimated in the immediately preceding S220 to the farmer's terminal device 200 via the interface unit 150 and the communication network NET (S250). As a result, as shown in FIG. 9, a current photo (more precisely, the time when the target image data I(o) was captured) and the estimated average size AS of the target plant OP (spinach in this embodiment) being cultivated in the plant factory PF are displayed on the display unit 210 of the terminal device 200. This allows the farm worker to ascertain the current average size AS of the target plant OP without having to go to the plant factory PF. Note that, as described above, if it is determined in the determination of S230 that the number N of the target image data I(o) for which the average size AS has been estimated is less than the threshold value Th, the prediction of the harvest date and time Te (S240) has not been performed, and therefore the symbol "-" indicating unpredictability is displayed in the column for the predicted harvest date and time Te.

[0050] After the process of S250, the plant cultivation management unit 111 (FIG. 2) of the plant cultivation management server 100 judges whether the cultivation has been completed (whether the plant has been harvested) (S270). When it is judged in the judgment of S270 that the cultivation has not been completed yet (S270: NO), the processes from S210 onwards are repeatedly executed.

[0051] The process from S210 onwards is repeatedly executed, and if it is determined in S230 that the number N of the target image data I(o) for which the average size AS has been estimated is equal to or greater than the threshold value Th (S230: YES), the harvest date and time prediction unit 117 (FIG. 2) of the plant cultivation management server 100 predicts the harvest date and time Te of the target plant based on the average size AS estimated for each target image data I(o) (S240). As shown in FIG. 10, in this embodiment, a regression equation is established by simple regression analysis using the average size ASi as the objective variable and the elapsed time ΔTi (=Ti-Ts) from the planting date and time Ts as the explanatory variable, and the harvest date and time Te is predicted by back-calculating the elapsed time ΔTi at which the average size AS becomes a predetermined harvest average size ASe (for example, ASe=20 cm) in the regression equation. For example, in FIG. 10, (k+1) points (ΔTi, ASi) are plotted indicating the data for which the average size AS has been estimated so far at the time when the estimation of the average size AS for the target image data I(o) photographed at the date and time Tk is completed. The harvest date and time prediction unit 117 uses these (k+1) data to derive a simple regression equation RL: ASi=a×ΔTi+b. Then, the harvest date and time prediction unit 117 calculates the value of ΔTi (=ΔTe) where ASi=ASe (for example, 20 cm) in this simple regression equation RL, and calculates the date and time (=Ts+ΔTe) at which this elapsed time ΔTe has elapsed from the planting date and time Ts as the predicted harvest date and time Te. The harvest date and time prediction unit 117 generates predicted harvest date and time data PD, which is information indicating the predicted harvest date and time Te, and stores it in the memory unit 120 of the plant cultivation management server 100.

[0052] When the harvest date and time Te is predicted (S240), the information transmission unit 118 (FIG. 2) of the plant cultivation management server 100 transmits the target image data I(o) acquired in the immediately preceding S210, the estimated average size data SD indicating the average size AS estimated in the immediately preceding S220, and the predicted harvest date and time data PD indicating the harvest date and time Te predicted in the immediately preceding S240 to the farm worker's terminal device 200 via the interface unit 150 and the communication network NET (S260). As a result, as shown in FIG. 11, the display unit 210 of the terminal device 200 displays a photo of the target plant OP (spinach in this embodiment) cultivated in the plant factory PF at the current time (more precisely, at the time of photographing the target image data I(o)), the estimated average size AS, and the predicted harvest date and time Te. This allows the farm worker to grasp the current average size AS of the target plant and the predicted harvest date and time Te without going to the plant factory PF.

[0053] After the process of S260, the plant cultivation management unit 111 (FIG. 2) of the plant cultivation management server 100 judges whether the cultivation has ended (whether the plant has been harvested) (S270). If it is judged in the judgment of S270 that the cultivation has not ended yet (S270: NO), the process from S210 onwards is repeatedly executed. The above-mentioned process is repeatedly executed, and if it is judged in the judgment of S270 that the cultivation has ended (S270: YES), the plant cultivation support process is terminated.

[0054] A-4. Advantages of this embodiment: As described above, the plant cultivation management server 100 of this embodiment includes a target data acquisition unit 115 and an average size estimation unit 116. The target data acquisition unit 115 acquires target image data I(o), which is image data generated by photographing a cultivation section PL in which a plurality of target plants OP are cultivated. The average size estimation unit 116 estimates an average size AS, which is an average value of the sizes of the target plants OP cultivated in the cultivation section PL, using image data including color information of the target image data I(o) and an average size estimation model MO created by a predetermined machine learning.

[0055] In this way, the plant cultivation management server 100 of this embodiment can acquire the target image data I(o) generated by photographing the cultivation section PL, and estimate the average size AS of the target plant OP by using the image data including the color information of the target image data I(o) and the average size estimation model MO. Therefore, according to the plant cultivation management server 100 of this embodiment, the average size AS of the target plant OP can be estimated simply by acquiring the target image data I(o), and the effort and time required for estimating the average size AS of the target plant OP can be reduced.

[0056] The plant cultivation management server 100 of the present embodiment further includes a training data acquisition unit 112 that acquires training data TD in which a plurality of training image data I(t), which is image data generated by photographing a cultivation section PL in which a plurality of target plants OP are cultivated, and average size data indicating the average size AS of the target plants OP in the cultivation section PL represented by the training image data I(t), are associated with each other, and a model acquisition unit 114 that acquires an average size estimation model MO by machine learning using the training data TD. Therefore, according to the plant cultivation management server 100 of the present embodiment, it is possible to acquire the average size estimation model MO without using any other device, and to estimate the average size AS of the target plants OP using the average size estimation model MO, thereby further reducing the effort and time required for estimating the average size AS of the target plants OP.

[0057] In the plant cultivation management server 100 of this embodiment, the training image data I(t) and the target image data I(o) include overhead image data Io, which is image data generated by photographing the cultivation section PL with an imaging device 300 (overhead imaging device 300A) in which the angle between the optical axis of the lens and the horizontal plane is 20 degrees or more. Therefore, according to the plant cultivation management server 100 of this embodiment, the average size AS can be estimated using an image in which the cultivation section PL is shown in a relatively wide image area, and the accuracy of estimating the average size AS of the target plant OP can be improved.

[0058] In the plant cultivation management server 100 of this embodiment, the training image data I(t) and the target image data I(o) include, in addition to the overhead image data Io, horizontal image data Ih, which is image data generated by photographing the cultivation plot PL with a photographing device 300 (horizontal photographing device 300B) in which the angle between the optical axis of the lens and the horizontal plane is less than 20 degrees. The model acquisition unit 114 acquires an overhead average size estimation model MOo by machine learning using the training data TD for the overhead image data Io, and acquires a horizontal average size estimation model MOh by machine learning using the training data TD for the horizontal image data Ih. The average size estimation unit 116 estimates the average size AS for the target image data I(o), which is the overhead image data Io, using the overhead average size estimation model MOo, and estimates the average size AS for the target image data I(o), which is the horizontal image data Ih, using the horizontal average size estimation model MOh. Therefore, according to the plant cultivation management server 100 of this embodiment, the average size AS can be estimated using a model optimized according to the image shooting angle, thereby further improving the accuracy of estimating the average size AS of the target plant OP.

[0059] In the plant cultivation management server 100 of this embodiment, the training image data I(t) and the target image data I(o) are image data I generated by photographing the cultivation section PL during a preset daytime time. Therefore, according to the plant cultivation management server 100 of this embodiment, the average size AS can be estimated using an image in which the color of the target plants OP cultivated in the cultivation section PL is relatively faithfully represented, and the accuracy of estimating the average size AS of the target plants OP can be improved.

[0060] In addition, in the plant cultivation management server 100 of this embodiment, the training image data I(t) and the target image data I(o) are image data I generated by photographing an area including a plurality of cultivation sections PL and trimming each cultivation section PL. Therefore, according to the plant cultivation management server 100 of this embodiment, even if the growth conditions of the target plants OP differ for each cultivation section PL, the average size AS of the target plants OP cultivated in each cultivation section PL can be estimated with high accuracy. Note that the trimming at this time may be performed such that the image trimmed for one cultivation section PL does not include pixels representing the target plants OP cultivated in the other cultivation sections PL, as in the above-mentioned trimming conditions 2 and 3. In this way, the influence of the pixels representing the target plants OP of the other cultivation sections PL can be eliminated, and the average size AS of the target plants OP cultivated in each cultivation section PL can be estimated with even higher accuracy.

[0061] Moreover, the plant cultivation management server 100 of this embodiment further includes a harvest date and time prediction unit 117. The harvest date and time prediction unit 117 predicts the harvest date and time Te of the target plant OP based on the average size AS estimated for the target image data I(o). Therefore, according to the plant cultivation management server 100 of this embodiment, it is possible to predict the harvest date and time Te of the target plant OP simply by acquiring the target image data I(o), and it is possible to effectively realize the efficiency and optimization of plant cultivation.

[0062] In the plant cultivation management server 100 of this embodiment, the target data acquisition unit 115 acquires a plurality of target image data I(o) generated by photographing the target plant OP at a plurality of dates and times, and the average size estimation unit 116 estimates the average size AS for the plurality of target image data I(o). In addition, the harvest date and time prediction unit 117 predicts the harvest date and time Te of the target plant OP for one target image data I(o) based on the average size AS estimated for the one target image data I(o) and the average size AS estimated for each target image data I(o) photographed before the photographing date and time of the one target image data I(o). Therefore, according to the plant cultivation management server 100 of this embodiment, the harvest date and time Te of the target plant can be predicted with high accuracy, and the efficiency and optimization of plant cultivation can be more effectively realized.

[0063] In the plant cultivation management server 100 of this embodiment, the target plant OP is a leafy vegetable, and the average size AS is the average plant height of the target plant OP. Therefore, according to the plant cultivation management server 100 of this embodiment, it is possible to reduce the effort and time required to estimate the average plant height of the leafy vegetable.

[0064] The plant cultivation management system 10 of this embodiment includes a plant cultivation management server 100 and a terminal device 200 capable of communicating with the plant cultivation management server 100 via a communication network NET. The plant cultivation management server 100 further includes an information transmission unit 118 that transmits estimated average size data SD indicating the estimated average size AS of the target plant OP to the terminal device 200 via the communication network NET. In this manner, in the plant cultivation management system 10 of this embodiment, the information transmission unit 118 of the plant cultivation management server 100 transmits the estimated average size data SD indicating the estimated average size AS of the target plant OP to the terminal device 200, so that the farm worker holding the terminal device 200 can grasp the average size AS of the target plant OP even if he or she is at a location other than the plant factory PF, and the efficiency and optimization of plant cultivation can be more effectively realized.

[0065] The plant cultivation management system 10 of this embodiment further includes a photographing device 300 that is installed in a field (e.g., a plant factory PF) where the target plants OP are cultivated and is capable of communicating with the plant cultivation management system 10 via a communication network NET. The target data acquisition unit 115 of the plant cultivation management system 10 acquires, via the communication network NET, target image data I(o), which is image data I generated by the photographing device 300 photographing the cultivation section PL. Therefore, in the plant cultivation management system 10 of this embodiment, the photographer (e.g., a farm worker) can acquire the target image data I(o) without going to the field, and the average size AS of the target plants OP can be estimated using the acquired target image data I(o), thereby making it possible to extremely effectively realize efficiency and optimization of plant cultivation.

[0066] A-5. Example: An example performed to verify the accuracy of the estimation of the average size AS by the plant cultivation management server 100 of the present embodiment described above will be described below. FIG. 12 is an explanatory diagram showing the prediction accuracy of the average size AS for each average size estimation model MO. FIG. 12 shows the coefficient of determination (R 2) is shown. Example E1 is an example in which the average size AS is estimated using the average size estimation model MOo for the overhead image data Io only, Example E2 is an example in which the average size AS is estimated using the average size estimation model MOh for the horizontal image data Ih only, and Example E3 is an example in which the average size AS is estimated using the average size estimation model MOo for the overhead image data Io and the average size AS is estimated using the average size estimation model MOh for the horizontal image data Ih. Example E4 is an example in which the average size AS is estimated for the target image data I(o) in which the overhead image data Io and the horizontal image data Ih are mixed, using a common average size estimation model MO created using training data TD in which the overhead image data Io and the horizontal image data Ih are mixed, without distinguishing between the overhead image data and the horizontal image data. In each example, only the image data I taken in the time period from 7:00 to 17:00 is targeted, and an image trimmed according to the above-mentioned trimming condition 1 is used. In addition, the machine learning used to create the average size estimation model MO was VGG16, and the prediction results of five basic learners were simply averaged according to the parallel ensemble method.

[0067] Comparing the embodiment E3 and the embodiment E4, the estimation accuracy of the average size AS is higher in the embodiment E3. Therefore, it is preferable to estimate the average size AS for the overhead image data Io using the average size estimation model MOo for the overhead image data and to estimate the average size AS for the horizontal image data Ih using the average size estimation model MOo for the horizontal image data Ih, rather than estimating the average size AS for the target image data I(o) in which the overhead image data Io and the horizontal image data Ih are mixed, using a common average size estimation model MO created using the training data TD in which the overhead image data Io and the horizontal image data Ih are mixed. The reason for this is that if the average size estimation model MOo for the overhead image data is created using only the overhead image data Io, the model becomes a model specialized for the overhead image data Io, and the accuracy of the estimation of the average size AS from the overhead image data Io is improved (similar to the horizontal image data Ih).

[0068] Moreover, comparing Example E1 and Example E2, Example E1 has a higher estimation accuracy of the average size AS. Therefore, it can be said that it is preferable to create the average size estimation model MO and estimate the average size AS using the overhead image data Io rather than using the horizontal image data Ih. The reason for this is considered to be that the overhead image data Io is an image in which the cultivation section PL is represented in a relatively wide image area, and is an image that clearly shows the characteristics related to the size of the target plant OP cultivated in the cultivation section PL.

[0069] FIG. 12 is an explanatory diagram showing the prediction accuracy of the average size AS for each trimming condition. FIG. 13 shows the coefficient of determination (R 2 ) values ​​are shown. Example E11 is an example in which an average size estimation model MO is created and an average size AS is estimated using image data I that has been trimmed according to the above-mentioned trimming condition 1, Example E12 is an example in which an average size estimation model MO is created and an average size AS is estimated using image data I that has been trimmed according to the above-mentioned trimming condition 2, and Example E13 is an example in which an average size estimation model MO is created and an average size AS is estimated using image data I that has been trimmed according to the above-mentioned trimming condition 3. In each example, only image data I taken during the time period from 7:00 to 17:00 is targeted. In addition, machine learning for creating the average size estimation model MO uses VGG16, and the prediction results of five basic learning devices are simply averaged according to the parallel ensemble method. In addition, for the overhead image data Io, the average size AS is estimated using the overhead average size estimation model MOo, and for the horizontal image data Ih, the average size AS is estimated using the horizontal average size estimation model MOh.

[0070] Comparing Examples E11, E12, and E13, the estimation accuracy of the average size AS is higher in Examples E12 and E13 than in Example E11. It can be said that it is more preferable to create an average size estimation model MO and estimate the average size AS using image data I cropped according to cropping condition 2 or cropping condition 3 than to create an average size estimation model MO and estimate the average size AS using image data I cropped according to cropping condition 1. Cropping condition 2 and cropping condition 3 are cropping conditions executed so that an image cropped for one cultivation section PL does not include pixels representing target plants OP cultivated in other cultivation sections PL. Therefore, it can be said that the average size AS of the target plants OP cultivated in each cultivation section PL can be estimated with even higher accuracy by adopting cropping conditions executed so that an image cropped for one cultivation section PL does not include pixels representing target plants OP cultivated in other cultivation sections PL.

[0071] B. Variations: The technology disclosed in this specification is not limited to the above-described embodiments, and can be modified in various forms without departing from the spirit of the invention. For example, the following modifications are also possible.

[0072] The configuration of the plant cultivation management system 10 in the above embodiment is merely an example and can be modified in various ways. For example, in the above embodiment, the plant cultivation management system 10 includes the photographing device 300, but the plant cultivation management system 10 does not need to include the photographing device 300. Even if the plant cultivation management system 10 does not include the photographing device 300, for example, a farm worker uses a photographing device (e.g., a camera mounted on the terminal device 200) to photograph a plant cultivated in the plant factory PF to generate image data, and transmits the image data to the plant cultivation management server 100, so that the plant cultivation management server 100 can acquire image data of the plant.

[0073] In addition, in the above embodiment, the photographing device 300 transmits image data generated by photographing to the plant cultivation management server 100 each time photographing is performed, but the image data may also be transmitted to the plant cultivation management server 100 at other times (for example, when a request is received from the plant cultivation management server 100).

[0074] In the above embodiment, the plant cultivation management server 100 executes the average size estimation model creation process for creating the average size estimation model MO, but the average size estimation model creation process may be executed by a device other than the plant cultivation management server 100, and the model acquisition unit 114 of the plant cultivation management server 100 may acquire the average size estimation model MO from the other device. Alternatively, the plant cultivation management server 100 may transmit the target image data I(o) to the other device, and the plant cultivation management server 100 may acquire the average size AS estimated by the other device using the average size estimation model MO.

[0075] In addition, the contents of the plant cultivation support process in the above embodiment are merely examples and can be modified in various ways. For example, in the plant cultivation support process in the above embodiment, the estimation of the average size AS (S220) and the prediction of the harvest date and time Te (S240) are executed, but it is also possible to execute only the estimation of the average size AS and not the prediction of the harvest date and time Te.

[0076] In the above embodiment, the prediction of the harvest date and time Te from the average size AS is performed by simple regression, but the prediction of the harvest date and time Te may be performed by other methods (for example, multiple regression).

[0077] In addition, in each of the above embodiments, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. [Explanation of symbols]

[0078] 10: Plant cultivation management system 100: Plant cultivation management server 110: Control unit 111: Plant cultivation management unit 112: Training data acquisition unit 114: Model acquisition unit 115: Target data acquisition unit 116: Average size estimation unit 117: Harvest date and time prediction unit 118: Information transmission unit 120: Memory unit 130: Display unit 140: Operation input unit 150: Interface unit 190: Bus 200: Terminal device 210: Display unit 300: Shooting device 300A: Bird's-eye shooting device 300B: Horizontal shooting device CP: Plant cultivation management program GD: Estimated average size data MO: Average size estimation model MOh: Horizontal average size estimation model MOo: Bird's-eye average size estimation model NET: Communication network OP: Target plant PD: Estimated harvest date and time data PF: Plant factory PL: Cultivation area SD: Estimated average size data TD: Training data TF: Trimming frame

Claims

1. An information processing device, a target data acquisition unit that acquires target image data, which is image data generated by photographing a cultivation section in which a plurality of target plants, which are specific types of plants, are cultivated; an average size estimation unit that estimates an average size, which is an average value of the sizes of the target plants cultivated in the cultivation area, by using image data including color information of the target image data and a model created by a predetermined machine learning method; a training data acquisition unit that acquires training data in which a plurality of training image data, which is image data generated by photographing a cultivation section in which a plurality of target plants are cultivated at a plurality of dates and times, and average size data indicating an average size of the target plants in the cultivation section represented by the training image data are associated with each other; a model acquisition unit that acquires the model by the machine learning using the training data; Equipped with The training image data and the target image data include overhead image data, which is image data generated by photographing the cultivation area with a photographing device having an angle between the optical axis of a lens and a horizontal plane of 20 degrees or more, The training image data and the target image data include, in addition to the overhead image data, horizontal image data, which is image data generated by photographing the cultivation area with a photographing device in which the angle between the optical axis of the lens and the horizontal plane is less than 20 degrees, the model acquisition unit acquires a first model by the machine learning using the training data for the overhead image data, and acquires a second model by the machine learning using the training data for the horizontal image data; the average size estimation unit estimates the average size of the target image data, which is the overhead image data, using the first model, and estimates the average size of the target image data, which is the horizontal image data, using the second model. Information processing device.

2. 2. The information processing device according to claim 1, The training image data and the target image data are image data generated by photographing the cultivation area during a preset daytime time. Information processing device.

3. 3. The information processing device according to claim 1, The training image data and the target image data are image data generated by photographing an area including a plurality of the cultivation sections and trimming the area for each cultivation section. Information processing device.

4. 4. The information processing device according to claim 3, The cropping is performed such that a cropped image of one of the cultivation sections does not include pixels representing the target plants being cultivated in other of the cultivation sections. Information processing device.

5. The information processing device according to any one of claims 1 to 4, further comprising: a harvest date and time prediction unit that predicts a harvest date and time of the target plant based on an average size of the target plant estimated for the target image data; Information processing device.

6. 6. The information processing device according to claim 5, The target data acquisition unit acquires a plurality of target image data generated by photographing the cultivation area at a plurality of dates and times, The average size estimation unit estimates an average size of the target plant for a plurality of the target image data; the harvest date and time prediction unit predicts a harvest date and time of the target plant for one of the target image data based on an average size of the target plant estimated for the one of the target image data and an average size of the target plant estimated for each of the target image data photographed before the photographing date and time of the one of the target image data; Information processing device.

7. The information processing device according to any one of claims 1 to 6, The target plant is a leafy vegetable, The average size is the average plant height of the target plant; Information processing device.

8. An information processing device according to any one of claims 1 to 7; a terminal device capable of communicating with the information processing device via a communication network; An information processing system comprising: The information processing device further includes an information transmitting unit that transmits information indicating the estimated average size of the target plant to the terminal device via the communication network. Information processing system.

9. The information processing system according to claim 8, further comprising: a photographing device that is installed in a field where the target plant is cultivated and is capable of communicating with the information processing device via a communication network; The target data acquisition unit acquires the target image data generated by the photographing device photographing the cultivation area via the communication network. Information processing system.

10. 1. An information processing method, comprising: acquiring target image data, the target image data being image data generated by photographing a cultivation plot in which a plurality of target plants of a particular type are cultivated; A step of estimating an average size, which is an average value of the sizes of each of the target plants cultivated in the cultivation area, using image data including color information of the target image data and a model created by a predetermined machine learning method; acquiring training data in which a plurality of training image data, which is image data generated by photographing a cultivation section in which a plurality of target plants are cultivated, at a plurality of dates and times, is associated with average size data indicating an average size of the target plants in the cultivation section represented by the training image data; obtaining the model by the machine learning using the training data; Equipped with The training image data and the target image data include overhead image data, which is image data generated by photographing the cultivation area with a photographing device having an angle between the optical axis of a lens and a horizontal plane of 20 degrees or more, The training image data and the target image data include, in addition to the overhead image data, horizontal image data, which is image data generated by photographing the cultivation area with a photographing device in which the angle between the optical axis of the lens and the horizontal plane is less than 20 degrees, the step of acquiring the model includes a step of acquiring a first model by the machine learning using the training data for the overhead image data, and acquiring a second model by the machine learning using the training data for the horizontal image data; the step of estimating the average size is a step of estimating the average size of the target image data, which is the overhead image data, using the first model, and estimating the average size of the target image data, which is the horizontal image data, using the second model; Information processing methods.

11. A computer program comprising: On the computer, acquiring target image data, the target image data being image data generated by photographing a cultivation plot in which a plurality of target plants of a particular type are cultivated; A process of estimating an average size, which is an average value of the sizes of each of the target plants cultivated in the cultivation area, using image data including color information of the target image data and a model created by a predetermined machine learning method; A process of acquiring training data in which a plurality of training image data, which is image data generated by photographing a cultivation section in which a plurality of target plants are cultivated, at a plurality of dates and times, and average size data indicating an average size of the target plants in the cultivation section represented by the training image data are associated with each other; obtaining the model by the machine learning using the training data; Run the command, The training image data and the target image data include overhead image data, which is image data generated by photographing the cultivation area with a photographing device having an angle between the optical axis of a lens and a horizontal plane of 20 degrees or more, The training image data and the target image data include, in addition to the overhead image data, horizontal image data, which is image data generated by photographing the cultivation area with a photographing device in which the angle between the optical axis of the lens and the horizontal plane is less than 20 degrees, the process of acquiring the model includes a process of acquiring a first model by the machine learning using the training data for the overhead image data, and acquiring a second model by the machine learning using the training data for the horizontal image data, The process of estimating the average size is a process of estimating the average size of the target image data, which is the overhead image data, using the first model, and estimating the average size of the target image data, which is the horizontal image data, using the second model. Computer program.

Images