Plant imaging system
The plant imaging system addresses the challenge of limited viewing range in plant factories by using a movable camera and synthesis device to cover multiple tiers efficiently, enhancing defect detection and yield through reduced camera requirements and humidity management.
Patent Information
- Application Number
- PCT/JP2024/016662
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-31
- Filing Date
- 2024-04-30
- Publication Date
- 2024-12-05
AI Technical Summary
In plant factories, it is challenging to achieve a wide viewing range for monitoring plant growth due to limited space, leading to delayed detection of defective plants and reduced yields, as existing systems require multiple cameras, increasing costs and complexity.
A plant imaging system comprising a movable imaging device and transport mechanism that captures images from above the cultivation panel, combined with a synthesis device to combine images and a control unit for efficient image processing, allowing a single camera to cover a wider area without obstructing light sources and minimizing humidity-related issues.
Enables efficient monitoring of plant growth across multiple tiers with fewer cameras, reducing costs and improving yield by enabling early detection of defects and maintaining image quality through humidity control and foreign matter prevention.
Smart Images

Figure JP2024016662_05122024_PF_FP_ABST
Abstract
Description
Plant Imaging System
[0001] The present invention relates to a plant imaging system.
[0002] Patent Document 1 discloses a plant cultivation device having a plurality of sensors that monitor the growth state of the plants being cultivated, an environmental control means that controls the environment, which is at least one of the conditions of light, air, water, and space, within the plant cultivation device, and a process control means that controls the work process of cultivating the plants, with the aim of providing a mechanism for both environmental control within the device and process control for the work process of cultivating the plants.
[0003] Patent Publication No. 2021-166495
[0004] In this embodiment, a plant imaging system is provided that can ensure a wider field of view even in a location where it is difficult to ensure a wide field of view, even with a small number of imaging devices.
[0005] A plant imaging system according to one aspect of the present invention includes an imaging device that images a plant and a transport mechanism that transports the imaging device, and the imaging device captures an image of the plant while being transported by the transport mechanism.
[0006] According to the present invention, it is possible to provide a plant imaging system that can ensure a wider field of view even with a small number of imaging devices in a location where it is difficult to ensure a wide field of view.
[0007] 1B is a schematic perspective view showing one aspect of the plant imaging system of the present embodiment; FIG. 1C is a schematic cross-sectional view showing one aspect of the plant imaging system of the present embodiment; FIG. 1D is a flowchart showing one aspect of processing by a synthesis device; and FIG. 1E is a schematic diagram showing the configuration of the plant imaging system in the upper part of FIG.
[0008] Hereinafter, an embodiment of the present invention (hereinafter referred to as "the present embodiment") will be described in detail with reference to the drawings as necessary. However, the present invention is not limited to this embodiment, and various modifications are possible without departing from the spirit of the present invention. In the drawings, the same elements are given the same reference numerals, and redundant explanations will be omitted. Furthermore, positional relationships such as up, down, left, and right are based on the positional relationships shown in the drawings unless otherwise specified. Furthermore, the dimensional ratios of the drawings are not limited to those shown in the drawings.
[0009] 1. Plant Factory The plant imaging system 300 of this embodiment may be used in, for example, a plant factory. Before describing the plant imaging system 300 of this embodiment, an overview of a plant factory will be described. Note that the use of the plant imaging system 300 of this embodiment is not limited to a plant factory.
[0010] A plant factory is a type of greenhouse horticulture where plants are grown by controlling their growth environment (light, temperature, humidity, carbon dioxide concentration, nutrients, water, etc.) within the facility. This refers to a cultivation facility that allows for year-round, planned production of vegetables and other plants by controlling the environment and predicting growth based on environmental and growth monitoring. Plant factories can be broadly divided into two types: "fully artificial light type," which controls the environment without using sunlight in a closed environment and performs year-round, planned production, and "sunlight-utilizing type," which uses sunlight in a semi-closed environment such as a greenhouse and performs year-round, planned production by using supplemental lighting on rainy or cloudy days and techniques to suppress high temperatures in the summer.
[0011] The cultivation method carried out in the plant factory may be either hydroponic cultivation or soil cultivation. Here, hydroponic cultivation is a method of growing plants using water and liquid fertilizer (nutrient solution) without using soil, and is also called hydroculture. In hydroponic cultivation, the roots of the plants are immersed in water (solution) containing fertilizer, and the necessary water, nutrients, and oxygen are absorbed through the roots. In contrast, soil cultivation refers to cultivation using soil. Hereinafter, this embodiment will be described using an example of carrying out hydroponic cultivation in a plant factory, but this embodiment is not limited to hydroponic cultivation.
[0012] FIG. 1A shows a schematic perspective view of a cultivation shelf 110 in a plant factory. In the cultivation shelf 110 shown in FIG. 1A, plants 200 are grown on cultivation panels 120 installed on the cultivation shelf 110. The cultivation shelf 110 is configured in a multi-tiered structure, which allows the plants 200 to be grown over a large area while saving space. However, the space between the upper and lower tiers is narrow, and the installation locations for the imaging device 410 and the like are limited, making it difficult to monitor the growth of the plants 200 on each tier.
[0013] A cultivation tank 130 is installed on each level of the cultivation shelf 110, and the cultivation panels 120 float in a pool of nutrient solution flowing through the cultivation tank 130. As an example, the cultivation tank 130 can store water used in hydroponic cultivation, and it is preferable that the water flows in a predetermined direction without stagnating. To create a water flow, each cultivation tank 130 may be provided with a water inlet and a drain outlet. Furthermore, the water flowing through the cultivation tank 130 may contain dissolved nutrients required for hydroponic cultivation.
[0014] The cultivation panel 120 may be a floating board that can float in the nutrient solution pool with the plant 200 placed on it. The cultivation panel 120 may have a through-hole for installing the plant 200 to be grown. In this case, the plant 200 is fixed to the cultivation panel 120 with its leaves exposed to the air and its roots immersed in the nutrient solution pool.
[0015] The cultivation panel 120 may be fixed to a predetermined position in the cultivation tank 130, or may be movable horizontally in the cultivation tank 130. As an example, in a cultivation shelf 110 configured to be long in the longitudinal direction Y, the cultivation panel 120 may be moved from one end to the other end of the cultivation tank 130 over a period of several hours to several days. Specifically, the cultivation panel 120 with the seedlings of the plants 200 fixed thereto may be introduced into one end of the cultivation shelf 110, and the plants 200 grown from the seedlings may be discharged from the other end of the cultivation shelf 110 after several days. This allows the plants 200 to be grown continuously.
[0016] In soil cultivation, plants are prone to disease due to various bacteria in the soil, necessitating the use of pesticides, so it is desirable to monitor the plants and check for any abnormalities. In contrast, hydroponic cultivation in plant factories is generally said to be less prone to insect infestation and disease. However, plants do not necessarily grow smoothly, and even in a completely enclosed environment, defective plants can occur when growth conditions tend to deviate from the adjusted range, such as during seasonal changes. Examples of defective plants here include, for leafy vegetables, defects in the head size or number of leaves, or various symptoms such as chip burn.
[0017] In outdoor cultivation, defective plants are easily identified by visual inspection, but as shown in Figure 1A, because the height of each shelf of the cultivation shelf 110 is low, it is difficult to visually check every corner of the shelf for defective plants. In other words, defective plants are often discovered late. This can lead to missed treatment times for plants that could have been improved, or defective plants being grown to the end, which can reduce factory yields.
[0018] To manage a plant factory more efficiently, it is desirable to detect defects early and strive to improve harvest yields. Therefore, it is conceivable to use a camera to observe the condition of the plants 200 on the cultivation shelves 110. However, because the height of each shelf of the cultivation shelves 110 is low, the field of view of the camera is also narrow. Furthermore, if an attempt is made to ensure a wide field of view, the number of cameras must be increased, which increases overall costs. Therefore, in this embodiment, as an example, a plant imaging system suitable for the environment of a plant factory is provided.
[0019] 2. Plant Imaging System The plant imaging system 300 of this embodiment includes an imaging device 410 that captures an image of a plant, and a transport mechanism 450 that transports the imaging device above the cultivation panel 120 (plant 200). When the transport mechanism 450 transports the imaging device 410 above the cultivation panel 120, the imaging device 410 captures an image of the plant 200 grown on the cultivation panel 120 installed on the cultivation shelf 110. This eliminates the need to install multiple imaging devices on the cultivation shelf 110 to observe the entire plant, and reduces the number of imaging devices 410 required.
[0020] As shown in FIG. 1A , the transport mechanism 450 may be configured to be movable on rails 440 installed on the cultivation shelf 110. The rails 440 may be installed to avoid the light source 150 so as not to block the light from the light source 150. The direction of movement of the transport mechanism 450 is not particularly limited. For example, if the cultivation panel 120 is configured to move in the cultivation tank 130 over several hours to several days, the plants 200 at the same cultivation date and time can be imaged by moving the transport mechanism 450 in the width direction X. In this case, the plants 200 can be imaged for each cultivation date and time by moving the transport mechanism 450 in the length direction Y.
[0021] FIG. 1B shows an XZ cross-sectional view of the cultivation shelf 110 shown in FIG. 1A. Arrow F in the figure indicates the movement direction of the imaging device 410. In the example shown in FIG. 1B, the transport mechanism 450 is movable in the width direction X, but the transport mechanism 450 may also be movable in the length direction Y. As shown in FIG. 1B, when not capturing images, the transport mechanism 450 may move the imaging device 410 outside the cultivation shelf 110, or the transport mechanism 450 may move the imaging device 410 from above the plant 200. In this case, the imaging device 410 may capture an image of the plant while being transported by the transport mechanism 450 with its lens facing downward. The plant 200, the cultivation panel 120, the cultivation tank 130, and the areas around and above the plant 200 are high-humidity spaces. Therefore, by moving the imaging device 410 outside the cultivation shelf 110 when not capturing images, evaporation from the plant 200 can be avoided, and malfunctions due to moisture and poor imaging due to lens fogging can be avoided.
[0022] The plant imaging system 300 may have a storage box 420 that stores the imaging device 410. This prevents transpiration from the plant 200 and prevents malfunctions due to moisture. From a similar perspective, the storage box 420 may have a humidity adjustment mechanism 430 for reducing the humidity inside. The humidity adjustment mechanism 430 may be, for example, a blower such as a fan.
[0023] The storage box 420 may be fixed to a position to which the imaging device 410 is moved when not taking images, and may be configured so that the imaging device 410 is stored in the storage box 420 when the transport mechanism 450 moves the imaging device 410 to the non-imaging position.
[0024] The storage box 420 may also have a window 421 for storing the imaging device 410 during imaging. For example, the transport mechanism 450 transports the storage box 420 above the cultivation panel 120 with the imaging device 410 stored therein, and the imaging device 410 can capture an image of the plant 200 through the window 421 of the storage box 420. This makes it possible to avoid transpiration from the plant 200 during imaging, and to avoid failure due to humidity.
[0025] From the viewpoint of preventing foreign matter from falling onto the plant 200 and becoming mixed in when the imaging device 410 moves on the rail 440 by the transport mechanism 450, the plant imaging system 300 may have covers or the like for preventing foreign matter from entering the imaging device 410, the rail 440, and the transport mechanism 450. For example, the storage box 420 may function as a cover to prevent foreign matter from entering the imaging device 410. Furthermore, since the storage box 420 is located directly below the point where the rail 440 and the transport mechanism 450 slide against each other, it may also function as a cover to prevent foreign matter from entering the rail 440 and the transport mechanism 450.
[0026] The plant imaging system 300 may have a blower mechanism 460 that blows air to the imaging device 410. This can reduce the humidity around the imaging device 410 and prevent malfunctions due to humidity. The blower mechanism 460 may also function to remove foreign matter floating in the air by blowing air, and to prevent the foreign matter from falling onto the plant 200 and becoming mixed in.
[0027] The plant imaging system 300 may have a swing mechanism 411 that changes the orientation of the lens of the imaging device 410 by changing the inclination of the imaging device 410 relative to the rail 440. This tends to increase the range that the imaging device 410 can capture. In addition, related to this, the number of imaging devices 410 required to observe the entire cultivation shelf 110 can be reduced.
[0028] The plant imaging system 300 may include a composition device 500 that composes the images captured by the imaging devices. The composition device 500 is, for example, a general-purpose computer, and may be a desktop, laptop, or other computer.
[0029] The image acquired by the imaging device 410 may be a moving image or a still image. If the image acquired by the imaging device 410 is a moving image, the composition device 500 may compose frames to create an image that is long in the movement direction of the imaging device 410. If the image acquired by the imaging device 410 is a still image, the composition device 500 may compose still images to create an image that is long in the movement direction of the imaging device 410.
[0030] If necessary, the synthesis device 500 may control the display of the created image on a display. Fig. 2 shows a flowchart of the processing by the synthesis device 500. This allows the user to more appropriately understand the growing status of the plant 200 on the cultivation shelf 110.
[0031] The plant imaging system 300 may further include a control unit 600 that controls transportation by the transport mechanism 450 and imaging by the imaging device 410. The control unit 600 may control the timing, frequency, speed, etc. of driving the transport mechanism 450 to transport the imaging device 410. The control unit 600 may also control the timing, etc. of imaging by the imaging device 410.
[0032] The plant imaging system 300 may include a sensor (not shown) that detects the position of the cultivation panel 120. The sensor is not particularly limited as long as it can detect the position of the cultivation panel 120. The control unit 600 may control the transportation by the transport mechanism 450 and the imaging by the imaging device 410 based on the position of the cultivation panel 120 detected by the sensor. For example, the sensor may detect that the plant 200 has moved to a position directly below the rail 440, and based on the detection information, the control unit 600 may control the transport mechanism 450 to move the imaging device 410 along the rail 440 and perform imaging by the imaging device 410.
[0033] The imaging device 410, the swing mechanism 411, the transport mechanism 450, the synthesis device 500, and the control unit 600 may be configured to transmit and receive various data to and from each other via the network N. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as the communication between them is possible.
[0034] A specific installation mode of the plant imaging system 300 will be described below with reference to FIGS. 1B and 3. FIG.
[0035] As shown in the upper part of FIG. 1B and in FIG. 3 , the plant imaging system 300 includes a storage box 420 in a position where the imaging device 410 is not imaging, and a blower mechanism 460 dries the imaging device 410 during imaging. This allows the imaging device 410 to dry both during imaging and when not imaging. As shown in FIG. 3 , the space between the shelves is narrow, limiting the field of view S of the imaging device 410. However, in this embodiment, the imaging device 410 passes through a rail 440 using a transport mechanism 450 to image plants, thereby increasing the range that can be captured by a single imaging device 410. Furthermore, when the imaging device 410 is installed in a fixed position, light L from the light source 150 may be blocked by the imaging device 410. However, by having the imaging device 410 pass through a rail 440 to image plants as in this embodiment, the time that such light L is blocked is reduced, enabling imaging of a wider range.
[0036] 1B, the storage box 420 may be provided with a humidity adjustment mechanism 430. As shown in the lower part of FIG. 1B, the imaging device 410 may be stored in the storage box 420 with a window 421 and transported by a transport mechanism 450.
[0037] The present invention has industrial applicability as a component technology that can be used in smart agriculture systems.
[0038] 100...plant factory, 110...cultivation shelf, 120...cultivation panel, 130...cultivation tank, 150...light source, 200...plant, 300...plant imaging system, 410...imaging device, 411...swing mechanism, 420...storage box, 421...window, 430...humidity adjustment mechanism, 440...rail, 450...transport mechanism, 460...air blowing mechanism, 500...combining device, 600...control unit
Claims
1. A plant imaging system comprising: an imaging device that images a plant; and a transport mechanism that transports the imaging device, wherein the imaging device images the plant while being transported by the transport mechanism.
2. The plant imaging system according to claim 1, further comprising a storage box for storing the imaging device when not in use.
3. The plant imaging system according to claim 2, wherein the storage box has a humidity adjustment mechanism.
4. The plant imaging system according to claim 1, wherein the imaging device captures images of the plants grown on a cultivation panel installed on a cultivation shelf, and the transport mechanism moves the imaging device to the outside of the cultivation shelf when imaging is not being performed.
5. The plant imaging system according to claim 1, wherein the transport mechanism transports the imaging device above the plant, and when imaging is not being performed, the transport mechanism moves the imaging device from above the plant.
6. The plant imaging system according to claim 1, further comprising a blowing mechanism for blowing air to the imaging device.
7. The plant imaging system according to claim 1, further comprising a swing mechanism for changing the orientation of the lens of the imaging device.
8. The plant imaging system according to claim 1, further comprising a synthesis device that synthesizes images captured by the imaging devices.
9. The plant imaging system according to claim 1, wherein the imaging device images the plants grown in a cultivation panel installed on a cultivation shelf, and the cultivation shelf is of a multi-tiered type.
10. The plant imaging system according to claim 1, wherein the imaging device is adapted to image the plant grown in a cultivation panel installed on a cultivation shelf, and is provided with a sensor for detecting the position of the cultivation panel.
Citation Information
Patent Citations
Mobile monitoring system and monitoring method thereof
JP2008252643A
Movable blower unit and plant cultivation method in cultivation factory
JP2021013303A
Imaging apparatus
JP2021177608A
Cultivation facility
WO2022024485A1
Cited By
Smart hydroponic cultivation system based on crop monitoring using mobile camera
KR102866068B1
