Autonomous Surveillance System
The monitoring system addresses vertical farming challenges by standardizing lighting conditions and using a carriage unit with cameras to capture consistent crop images, enhancing disease detection and harvest timing accuracy.
Patent Information
- Application Number
- JP2023027400
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-03-14
- Filing Date
- 2023-02-24
- Publication Date
- 2025-01-17
- Estimated Expiration
- 2039-08-28
AI Technical Summary
Vertical farming environments pose challenges in monitoring crop health and growth due to confined spaces and varying lighting conditions, making it difficult to detect diseases and determine optimal harvest times.
A monitoring system with a carriage unit equipped with a camera and illumination means that moves along rails, capturing images under different lighting conditions (white and UV light) to standardize illumination, enabling accurate crop health assessment.
The system allows for consistent and detailed crop monitoring, facilitating early disease detection and optimal harvest timing by ensuring uniform lighting conditions and utilizing UV light for bacterial and fungal recognition.
Smart Images

Figure 0007617158000002 
Figure 0007617158000003 
Figure 0007617158000004
Abstract
Description
[Technical field]
[0001] The present disclosure relates to autonomous food / crop monitoring. [Background technology]
[0002] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of U.S. Provisional Patent Application No. 62 / 7251377, filed August 30, 2018, and U.S. Provisional Patent Application No. 62 / 818432, filed March 14, 2019, both of which are incorporated by reference in their entireties.
[0003] As the world's population grows and arable land decreases, it becomes more difficult to meet the ever-increasing demand for food. In recent years, "vertical farming" has been proposed as a solution to produce sufficient food with the decrease in arable land. Vertical farming is the cultivation / production of food on a vertically sloping surface. In other words, instead of cultivating / producing vegetables / products on a single surface like a field or greenhouse, vegetables / products are cultivated / produced in vertically stacked layers / racks that are usually arranged in a storage area such as a shipping container or warehouse (see Figure 1).
[0004] Like any farm, vertical farmers must deal with issues such as pests, diseases, and other environmental threats to their crops. When plants / crops become infected with disease, bacteria, mold, fungus, etc., these threats can spread quickly, especially in a closed environment like a vertical farm. To ensure a steady supply of high-quality crops in large quantities, vertical farmers need to have a system for monitoring the health of their plants / crops and avoid unnecessary waste. Like any farm, vertical farmers need to be aware of crop problems early on.
[0005] Vertical farmers, like any other farm, need to monitor the health of their crops as well as determine the optimal time to harvest the crops. This is commonly done by measuring the growth (size) of the crops. In an outdoor environment, this is largely easy to do, but in a vertical farming environment, it is difficult to observe the growth of the plants / crops due to the physical structure of the vertical farm; e.g., the height of the vertical farm, the distance between levels, etc.
[0006] Lighting in vertical farms can vary with white light, blue light, red light, etc. Under certain lighting conditions such as blue and red light, it can be difficult to inspect and determine disease or damage in crops.
[0007] What is required of a monitoring system is the ability to easily monitor the health and growth of plants / crops even in a limited space such as a vertical farm. Summary of the Invention
[0008] A system for monitoring plants in a specified space includes an imaging means, a lighting means, and a rail unit along which the imaging means and the lighting means move, wherein when the lighting state of the specified space is a first lighting state, the imaging means photographs the plants, and when the lighting state of the specified space is a second lighting state different from the first lighting state, the imaging means does not photograph the plants.
[0009] This and other aspects, features, and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure, taken in conjunction with the accompanying drawings and the appended claims. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is an exemplary structure of layers / racks in a conventional vertical farm. [Diagram 2] FIG. 2 is a block diagram showing the carriage unit. [Diagram 3] FIG. 3 is an explanatory diagram of the monitoring system. [Figure 4] FIG. 4 illustrates the process of searching for a home charging station. [Diagram 5] FIG. 5 is a flowchart of the processing of the monitoring system. [Figure 6] FIG. 6 shows a computer configuration for verifying plant / crop images. [Figure 7A] , [Figure 7B] 7A and 7B show example displays of plant / crop images. [Figure 8] FIG. 8 shows an example table of plant / crop images for inspecting plants / crops. [Figure 9A] FIG. 9A is an example of a line graph showing two waveforms. [Figure 9B] FIG. 9B is an example of a line graph showing battery movement and charging periods. [Figure 10] FIG. 10 is a general high-level exemplary depiction of the processing of a surveillance system. [Figure 11] , [Figure 12] , [Figure 13] 11, 12 and 13 are more detailed exemplary depictions of the processing of the surveillance system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] One aspect of the present disclosure provides a monitoring system for monitoring the condition of plants / crops in a vertical farming environment.
[0012] Hereinafter, exemplary embodiments will be described in detail with reference to the accompanying drawings. The following exemplary embodiments are merely examples, and can be appropriately modified or changed according to the individual structures and various conditions of the applicable devices. Therefore, the present disclosure is not to be regarded as limiting.
[0013] 2 is a block diagram showing an example of a configuration of a carriage unit 100, which is an example of an electronic device according to an illustrative embodiment. A central processing unit (CPU) 101, a memory 102, a non-volatile memory 103, an image processing unit 104, a motor 105, an NFC reader 107, an operation member 108, a recording medium interface (I / F) 109, a communication I / F 111, a camera unit 113, a wireless charger 114, a white LED unit 116, and a UV LED unit 117 are connected to an internal bus 150. Each of these components is capable of exchanging data and / or communicating with each other via the internal bus 150.
[0014] The CPU 101 is a processor that controls the carriage unit 100 using the memory 102 as a working memory based on, for example, a program or instruction stored in the non-volatile memory 103. The memory 102 may be a random access memory (RAM), but is not limited to RAM, and any memory that can enable the implementation of this exemplary embodiment is applicable. The non-volatile memory 103 stores image data, audio data, other data, and programs or instructions used by the CPU 101 to perform or execute various operations described below. The non-volatile memory 103 includes, for example, a hard disk (HD), a read-only memory (ROM), or a flash memory.
[0015] The image processing unit 104 performs various types of image processing on image data stored in the non-volatile memory 103 and the recording medium 110 and image data acquired via the communication I / F 111 under the control of the CPU 101. The image processing includes analog-to-digital (A / D) conversion processing, digital-to-analog (D / A) conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise removal processing, and color conversion processing. The image processing unit 104 may be a dedicated circuit block for performing specific image processing. In another embodiment, depending on the type of image processing, the CPU 101 may perform the image processing based on a program without using the image processing unit 104.
[0016] The motor 105 drives a drive system 106 including, but not limited to, tires, gears, and a drive shaft based on a motor control signal generated by the CPU 101 .
[0017] Near Field Communication (NFC) reader 107 reads the signal from NFC chip 206. In another exemplary embodiment, a radio frequency ID (RFID) reader / marker can be used instead of the NFC reader / chip. In another exemplary embodiment, mechanical switches, optical sensing, audio sensing, etc. can be employed to achieve the same results as using NFC.
[0018] A Hall effect magnetic sensor (hereinafter referred to as "mag sensor") 118 detects a magnet 120 located at the home station of the carriage unit 100. The mag sensor 118 allows for stopping and charging of the carriage unit 100. The magnetic sensor 118 may be a mechanical switch, an optical sensor, or other type of position sensor.
[0019] The operation members 108 may include an input device that accepts user operations, such as a button, a dial, a joystick, and the like.
[0020] The recording medium I / F 109 is configured so that a recording medium 110 such as a memory card, a compact disc (CD), or a digital versatile disc (DVD) can be attached. The CPU 101 controls the recording medium I / F 109 to read data from the attached recording medium 110 and write data to the recording medium 110. The communication I / F 111 is an interface for communicating with an external device, the Internet, or an intranet 112, and transmitting and receiving various data such as files and commands.
[0021] The camera unit 113 includes a lens group including a zoom lens and a focus lens, and an image sensor that converts an optical image into an electrical signal. The image sensor includes a charge-coupled device (CCD) sensor or a complementary metal-oxide semiconductor (CMOS) sensor. The camera unit 113 can generate object image data.
[0022] The wireless charger 114 supplies power to the battery 115. The battery 115 supplies driving power to each of the above-mentioned components via an internal bus 150. A battery current monitor 119 monitors the state of the battery 115.
[0023] The white light emitting diode (LED) unit 116 illuminates an object, such as a plant / crop, where the illuminated area is larger than the area imaged by the camera unit 113 .
[0024] The ultraviolet (UV) LED unit 117 illuminates an object, such as a plant / crop, where the illuminated area is larger than the area imaged by the camera unit 113.
[0025] 3 is an explanatory diagram of the surveillance system of this exemplary embodiment. The carriage unit 100 includes a thin body with a height of, for example, 3 cm. This height is merely an example and is not considered limiting. The rail 201 is installed between the top surface of the rack 203 and the LED 202, and the carriage unit 100 is connected to the rail. In another exemplary embodiment, the rail may be installed below the LED 202.
[0026] The rack 203 may be of a multi-layer or single-layer structure, in which a carriage unit 100 may be installed on each layer, or a single carriage unit 100 may be moved between layers.
[0027] The lighting of the vertical farming area provided by the LEDs 202 can be programmed or otherwise cycled to cycle on and off at predetermined intervals, for example to mimic a diurnal pattern. The lighting can also be controlled at optimal intervals to promote plant / crop growth or other desired results. In this exemplary embodiment, the monitoring system is active while the lighting of the vertical farming area is off.
[0028] The carriage unit 100 moves on a rail 201 via a drive system 106. Next to the rail 201, a charging station 205 is installed. In this exemplary embodiment, the charging station 205 is a wireless charging system. The wireless charging system is protected from possible sparks and short circuits that may occur, for example, due to splashing water from the planting bed.
[0029] A Near Field Communication (NFC) chip 206 is installed next to the rail 201. The NFC chip 206 communicates with the NFC reader 107. The NFC chips 206 are installed at multiple locations along the rail 201. The locations are selected so that all the plants / crops on the rack 203 can be photographed.
[0030] 4 illustrates the process of finding a charging location. The mag sensor 118 is used to sense the presence of a magnet 120 on the rail 201 in a position that allows the wireless charger 114 to align with the wireless transmitter 121. In other words, the magnet 120 and the wireless transmitter 121 are placed in the charging station 205.
[0031] As the carriage unit 100 moves on the rail 201, the CPU 101 continuously monitors the magnetic sensor 118. When the magnetic sensor 118 approaches the magnetic field of the magnet 120, it sends an interrupt to the CPU 101, which in turn causes the CPU 101 to issue a command to the motor 105 to stop the drive system 106. This allows the carriage unit 100 to stop accurately at the charging station 105, and allows the maximum current to be exchanged between the wireless transmitter 121 and the wireless receiver 114.
[0032] Through the use of magnets 120, mag sensors 118, wireless charging, and an NFC locator, the carriage unit 100 is sealed and requires no exposed or mechanical contacts, providing protection against moisture and splashes common in vertical agriculture environments.
[0033] The battery current monitor 119 provides a continuous status reading of the battery 115 to the CPU 101. The battery current monitor 119 provides a positive reading when the battery 115 is charging, thereby ensuring that the wireless charger 114 is functioning properly. When the carriage unit 100 is moving, the battery current monitor 119 provides a negative reading, indicating that the battery 115 is discharging. In the event of a mechanical failure, such as the carriage unit 100 becoming stuck, the battery current monitor 119 provides a high negative reading, and the CPU 101 can notify the user of the error condition.
[0034] Fig. 5 is a flow chart of a process of the surveillance system according to the exemplary embodiment. The process is realized by CPU 101 extracting a program stored in non-volatile memory 103, storing it in memory 102, and executing it. Fig. 10 is a general high-level exemplary depiction of the process shown in Fig. 5. Figs. 11, 12, and 13 are more detailed exemplary depictions of the process shown in Fig. 5.
[0035] 5, in S1, the CPU 101 controls the carriage unit 100 to start running on the rail 201 at a predetermined time, for example, 12:00 a.m. At this time, the illumination by the LED 202 is turned off. In one exemplary embodiment, the CPU 101 can control both the white LED light unit 116 and the UV LED light unit 117 as well as the LED 202. In another exemplary embodiment, when the illumination provided by the LED 202 is turned off, a light sensor (not shown) detects that the illumination has been turned off, and then the CPU 101 controls the carriage unit 100 to start running.
[0036] In S2, it is determined whether or not the NFC reader 107 has detected the NFC chip 206. If the NFC reader 107 has detected a signal from the NFC chip 206, the process proceeds to S3. If the NFC chip 206 has not been detected, the determination process of S2 is repeated.
[0037] At S3, the carriage unit 100 stops traveling. Then, at S4, the white LED unit 116 is turned on. Next, at S5, the camera unit 113 captures an image of the plant / crop. The image is captured using white LEDs so that the color of the plant / crop is clearly visible. When the captured image is analyzed or displayed to check the condition of the plant / crop, the analysis is performed under similar lighting color conditions, so that the influence of light is reduced. The captured image is analyzed in a known manner to determine the condition of the plant / crop.
[0038] The lighting in the vertical farm can be changed between white light or other colors such as a mixture of blue and red light, the type of lighting depends on the type of plant / crop or the type of technology used. Under lighting other than white light, it can be very difficult to determine disease or damage, which is a change in the color of the plant / crop. Diseases of the plant / crop or bacteria on the plant / crop can be recognized by white spots or black spots on the plant / crop. Images with original colors are therefore useful to achieve correct diagnosis of diseases, etc. All images taken by the carriage unit 100 are acquired under the same lighting conditions every time and in all vertical farm environments. In this way, color does not matter, even white light, since different spectrums of light are used depending on the environment.
[0039] At S6, the white LED unit 116 is turned OFF. At S7, the captured image is sent to a remote server (not shown) along with the NFC ID, which is a unique NFC serial number used to identify the location and a timestamp when the image was captured. At S8, the UV LED 117 unit is turned ON.
[0040] At S9, the camera unit 113 captures an image of the plant / crop illuminated by the UV LED unit 117. Illuminating the plant / crop with UV light in the dark allows easier recognition of bacteria and / or mold present on the plant / crop due to their autofluorescence response to the UV light. Also, bacteria and / or mold can be recognized by scattered light caused by the illumination of the UV light. The camera unit 113 can detect the fluorescence and / or scattered light.
[0041] At S10, the UV LED unit 116 is turned off. At S11, the captured image is sent to a remote server (not shown) along with the NFC ID and a timestamp.
[0042] At S12, a determination is made whether the NFC reader 107 detects an "END" signal from the NFC chip 206. If the signal is detected, the process ends. If the signal is not detected, the process returns to S2.
[0043] In S13, a determination is made as to whether the magnetic sensor 118 detects the magnet 120. If the magnet 102 is detected, the process proceeds to S14. If the magnet 102 is not detected, the process proceeds to S15.
[0044] In S14, the carriage unit 100 moves to the charging station 205 or stops traveling at the charging station 205. Then, the battery 115 is charged by the wireless charger 114. When charging of the battery 115 is completed, the process returns to S1.
[0045] In parallel with the process of S14, in S16, the CPU 101 checks the output value from the battery current monitor 119. In a normal state, when the battery 115 is charged, the battery current monitor 119 outputs a positive value. If the battery current monitor 119 outputs a negative value when the battery 115 is being charged, the CPU 101 determines that an error has occurred. The CPU 101 stops the current operation and provides a notification of the error to the user. In other words, the battery 115 can continue to be charged when two conditions are met: the mag sensor 118 detects the magnet 120, and the battery current monitor 119 outputs a positive value when the battery 115 is being charged.
[0046] In S15, the carriage unit 100 is moved to the position of the next NFC 206. After that, the process returns to S2.
[0047] In one exemplary embodiment, the image, NFC ID, and time stamp transmitted in S7 and S11 may be transmitted while the carriage unit 100 is traveling along the rail 201. In another exemplary embodiment, the image, NFC ID, and time stamp may be transmitted while the carriage unit 100 is in the charging station 205. In yet another exemplary embodiment, the captured image, NFC ID, and time stamp may be stored in the non-volatile memory 103, and when the carriage unit 100 reaches the charging station 205, the stored image, NFC ID, and time stamp may be transmitted to a remote server and deleted from the non-volatile memory 103.
[0048] To monitor plants / crops, cameras probably provide the best solution, but due to the typical height of each shelf in a vertical farm environment (e.g. 60cm), the camera lens may be too close to the plants / crops to capture a clear image. Therefore, a wide-angle lens camera can be used to obtain a "top" image of the plants / crops, resulting in a more usable image.
[0049] In one exemplary embodiment, two images are taken at each NFC chip 206 location before the LED 202 is turned ON again. Although the LED 202 is described above as being turned OFF at 12:00 AM, this time is not considered limiting and the LED 202 may be turned off at any time. The length of time that the LED 202 is OFF may be automatically or user controlled.
[0050] In the above description of S1, the carriage unit 100 started moving when the LED 202 was OFF. In another exemplary embodiment, it is not necessary to turn the LED 202 completely OFF to start moving the carriage unit 100. Also, when the lighting conditions are darker or lower than normal, the captured image contains less red light, blue light, and white fluorescent light, which can be beneficial.
[0051] In the above description of S3 and S13, the carriage unit 100 has stopped moving. In another exemplary embodiment, instead of stopping the motor 105, the CPU 101 can slow down the speed of the motor 105, and the carriage unit 100 can continue moving at a slower speed without stopping. The camera unit 113 can take images of the plants / crops when the carriage unit 100 moves at a very slow speed.
[0052] In the above description of S16, the CPU 101 checks the output value from the battery current monitor 119 when the battery 115 is being charged. In another exemplary embodiment, the CPU 101 can check the output value when the battery 115 is being discharged. In a normal state, when the battery 115 is being discharged, the battery current monitor 119 outputs a negative value. When the battery 115 is being discharged, if the battery current monitor 119 outputs a positive value, the CPU 101 determines that an error has occurred. The CPU 101 stops operation and notifies the user of the error. The CPU 101 can determine the period during which the battery 115 is being discharged using a sensor (not shown) for detecting the rotation state of the motor 105.
[0053] Although the processing in the above exemplary embodiment has been described as being performed by CPU 101, in another exemplary embodiment, the processing may be shared and performed by a plurality of processing units.
[0054] In the above exemplary embodiment, a case where a camera is used has been described, but the present disclosure is not limited to this example. Any imaging device that enables the implementation of the present disclosure is applicable.
[0055] 6 shows the configuration of a computer 300 that enables a user to check an image of a plant / crop photographed by the carriage unit 100. The computer 300 includes a CPU 101, a RAM 302, a ROM 303, an input unit 304, an external interface 305, and an output unit 306.
[0056] The CPU 301 controls the computer 300 via computer programs and data stored in the RAM 302 or the ROM 303. The computer 300 may include one or more dedicated hardware components or a graphics processing unit (GPU) different from the CPU 101, and the GPU or dedicated hardware component may execute some or all of the processes executed by the CPU 301. Examples of dedicated hardware include an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), etc. The RAM 302 temporarily stores computer programs and data read from the ROM 303, and data supplied from the computer 300 to the outside via the external interface 305. The ROM 303 stores computer programs and data that do not require modification.
[0057] The input unit 304 may be, for example, a joystick, a jog dial, a touch panel, a keyboard, a mouse, or the like, and receives user operations and provides various instructions to the CPU 301. The external interface 305 communicates with an external device such as a server. The external interface 305 can directly communicate with the carriage unit 100. The communication with the external device may be performed via a wired interface using a local area network (LAN) cable, a signal digital interface (SDI) cable, or the like, or may be a wireless interface such as a Wi-Fi (registered trademark) connection. The output unit 306 may be, for example, a display unit 306a such as a display, and an audio output unit 306b such as a speaker, and displays a graphical user interface (GUI) and outputs a guide sound so that the user can operate the computer 300.
[0058] 7A and 7B show examples of images displayed on the display unit 306a. FIGS. 7A and 7B show a selection screen 400 that allows a user to select a plant image displayed on the display unit 306a. In FIG. 7A, the selection screen 400 includes a rail image 401, a "Select Rail" drop-down list 402, and a "Select Image" drop-down list 403. For illustrative purposes, in this example, there is only one carriage unit 100 for one rail 201. The user can select one rail 201 from the drop-down list 402.
[0059] In FIG. 7B, when the user selects "first rail" from the drop-down list 402, a rectangle 404 is displayed on the rail image 401. Five rectangles 404 are displayed on the rail image 401. The positions of the rectangles 404 may be different for each rail 201. Since the rectangles 404 correspond to the NFC chip 206, there are five locations on the "first rail" where the carriage unit 100 takes images of plants / crops. The user can select one rectangle 404 from among the five rectangles 404. In other words, the user can select one shooting location from among the five shooting locations. The user can select one image of the plant / crop from the drop-down list 403. The drop-down list 403 includes images of multiple plants / crops taken by the carriage unit 100 at the selected shooting location. The images of the multiple plants / crops differ in timing of shooting.
[0060] According to one exemplary embodiment, the plant / crop images are displayed in the following steps: (a) When the user selects one of the rails 201 from the drop-down list 402, a rectangle 404 appears on the rail image 401.
[0061] (b) The user selects one rectangle 404 from two or more rectangles 404 .
[0062] (c) When the user selects an image of one plant / crop from the drop-down list 403, the image of the selected plant / crop is displayed.
[0063] The above procedure provides a method for displaying plant / crop images according to one exemplary embodiment, however, this procedure should not be considered limiting and variations of the procedure that allow for displaying plant / crop images are applicable.
[0064] Fig. 8 is a display example of a plant / crop image on the display unit 306a. More specifically, Fig. 8 shows a check screen 500 that enables a user to inspect the plant / crop image. The check screen 500 is displayed when the user selects a plant / crop image on the selection screen 400. The check screen 500 includes a main section 501, a bar graph section 502, a line graph section 503, an environmental information section 504, an ID information section 505, a period information section 506, and a log information section 507.
[0065] The main section 501 displays an image of a plant / crop photographed by the carriage unit 100. The bar graph section 502 includes seven bar graphs, and the line graph section 503 includes seven line graphs. One set of bar graphs and line graphs corresponds to the battery 115 of one carriage unit 100. The bar graphs indicate the remaining rate (remaining capacity) and state of the corresponding battery 115. The line graphs indicate the remaining rate history of the corresponding battery 115. The bar graph section 502 and the line graph section 503 will be described later.
[0066] The environmental information section 504 indicates temperature, humidity, and chip temperature. The temperature and humidity are information for enabling the user to grasp the surrounding environment of the plant / crop. The temperature and humidity are detected by sensors installed in the vertical farm or on the rail 201, for example. The chip temperature is information for preventing overheating of the chip. The chip is mounted on the carriage unit 100. The ID information section 505 indicates a list of the IDs of each carriage unit 100. The ID of the selected carriage unit 100 is highlighted. The cycle information section 506 indicates the cycle at which the information from the carriage unit 100 is updated. The log information section 507 indicates past information that the computer 300 received from the carriage unit 100.
[0067] Next, the bar graph section 502 will be described. Each bar graph is composed of two bar parts, a left section 502a and a right section 502b. The length of the left section 502a indicates the current battery percentage. The length of the left section 502a can indicate the voltage value or current value of the battery 115. The color or pattern of the right section 502b indicates the current state of the battery 115. In this example, the color of the right section 502b can be green, red, or yellow. When the color is green, it indicates a state in which the carriage unit 100 is stopped at the charging station 205, the battery 115 is being charged, and the battery percentage is increasing. When the color is red, it indicates a state in which the carriage unit 100 is moving and the battery percentage is decreasing. When the color is yellow, it indicates a state in which the battery 115 was previously charged or a poor contact occurs between the carriage unit 100 and the charging station 205, and the battery percentage is not changing.
[0068] Next, the line graph section 503 will be described. The horizontal axis of each line graph is the time axis, which indicates that time passes from left to right. The vertical axis of each line graph is the battery percentage. The line graphs allow the user to check whether the battery 115 is being properly charged in the charging station 205. The line graphs allow the user to check the condition of the battery 115. Through these checks, the user can determine whether the battery 115 has deteriorated.
[0069] Although the line graph in FIG. 8 shows one waveform, the line graph may show two or more waveforms. FIG. 9A is an example of a line graph showing two waveforms. There is an actual waveform 600 and an ideal waveform 601. The actual waveform 600 shows the actual percentage history of the battery 115. The ideal waveform 601 shows an ideal (virtual) percentage history for comparison. "Ideal" means that the battery 115 is properly charged and the battery 115 is not degraded. A user can easily check errors related to the battery 115 by comparing the actual waveform 600 and the ideal waveform 601. In other words, the ideal waveform 601 serves as a reference.
[0070] In general, the charging period during which the battery 115 is charged is often shorter than the operating period during which the battery 115 operates. Therefore, the line graph may show a waveform in which the charging period is omitted. Fig. 9B is an example of a line graph including an operating period portion 602 and a charging period portion 603. By using such a display, necessary information can be highlighted.
[0071] The check screen 500 described above is displayed when the user selects a plant / crop image in the selection screen 400. However, such a configuration is not considered limiting. In another exemplary embodiment, the check screen 500 can automatically display a set of images such as a slideshow for a particular day from all locations so that the user can view all images. The selection screen 400 is a tool screen, whereas the check screen 500 is a main screen. The check screen 500 may be always displayed so that the user can check the plants / crops and battery status. The selection screen 400 is only displayed when the user uses the toolbar to check the plants / crops in a particular area.
[0072] Next, the warning system will be described. The warning system notifies the user of an error in the battery 115 by displaying an image or a message on the display unit 306a, outputting a sound from the sound output unit 306b, or displaying an image / message and outputting a sound. In this exemplary embodiment, the warning is output based on the following conditions: JPEG0007617158000001.jpg36144
[0073] In this exemplary embodiment, there are four warning levels. In the case of level 1, the background color of the corresponding bar graph and line graph set is orange. The background color and pattern can be changed. In the case of level 2, the display unit 306a displays an error image or an error message, or the audio output unit 306b emits an alarm sound. In the case of level 3, the display unit 306a displays an error image or an error message, and the audio output unit 306b emits an alarm sound. In the case of level 4, the carriage unit 100 does not move from the charging station 205 unless the user allows it. However, even if the battery percentage falls below 20%, the carriage unit 100 can continue moving without outputting a warning if the time until the next movement timing is long.
[0074] In addition to the exemplary embodiment described above, in another exemplary embodiment, if the computer 300 does not receive information from the carriage unit 100 at the timing defined in the periodic information section 506, the background color of the corresponding set of bar graphs and line graphs becomes yellow. If the carriage unit 100 is not responding via the network, the background color of the corresponding set of bar graphs and line graphs becomes red. The warning may be output based on information other than the battery percentage, such as temperature or humidity.
[0075] The exemplary embodiments described above provide a monitoring system for a vertical farming environment that can operate when the environment is dark and the plants / crops are illuminated with white LED lights, allowing images to be taken under similar lighting conditions, and UV light can be used to illuminate the plants / crops for detection of bacteria, mold, and the like.
[0076] The exemplary embodiment described above provides a wireless power system that uses magnetic sensors to allow a carriage with a wireless receiver to perfectly line up with a wireless transmitter to provide optimal charging current to the carriage's battery, and a current monitor allows monitoring of the battery to ensure the carriage is charging and is in the optimal location for maximum charging current.
Claims
1. 1. A system for monitoring plants in a given space, comprising: A photographing means; Illumination means; a detection means for detecting an illumination state in which a first light illuminates the plant; having When the detection means detects that the illumination state of the first light is darker than a predetermined brightness level or that the illumination state of the first light is off, the photographing means photographs the plant illuminated by the lighting means with a second light different from the first light, and When the illumination state of the first light is brighter than the predetermined brightness level, the photographing means does not photograph the plant illuminated with the second light, The system according to claim 1, wherein the second light is ultraviolet light.
2. 2. The system of claim 1, wherein said illumination means includes a first illumination means for emitting said first light and a second illumination means for emitting said second light.
3. 3. The system of claim 2, wherein said first light emitted by said first illumination means is ambient light.
4. A system described in any one of claims 1 to 3, characterized in that the photographing means photographs the autofluorescence reaction to ultraviolet light.
5. 3. The system of claim 1 or 2, wherein the detection means includes an optical sensor.
6. The system further comprises a determining means; the photographing means photographs a first image of the plant illuminated with a first type of the second light and a second image of the plant illuminated with a second type of the second light different from the first type; The determining means determines a state of the plant based on an analysis of the first image and the second image, 2. The system of claim 1, wherein the second light of the first type and the second light of the second type are each a different type of light than the first light.
7. a computer connected to the imaging means, the lighting means, and a detection means for detecting an illumination state in which the first light illuminates the plant; a process of causing the photographing means to photograph the plant illuminated by the lighting means with a second light different from the first light, when the detection means detects that the illumination state of the first light is darker than a predetermined brightness level or that the illumination state of the first light is off; a process of not causing the photographing means to photograph the plant illuminated with the second light when the illumination state of the first light is brighter than the predetermined brightness level; A program for executing The second light is ultraviolet light.
8. 8. The program according to claim 7, wherein the illumination means includes a first illumination means for emitting the first light and a second illumination means for emitting the second light.
9. 9. The computer-readable storage medium according to claim 8, wherein the first light emitted by the first illumination means is ambient light.
10. A program described in any one of claims 7 to 9, further comprising a process for causing the computer to execute a process of causing the photographing means to photograph the autofluorescence reaction to ultraviolet light.
11. The program is a process of causing the photographing means to photograph a first image of the plant illuminated with the second light of a first type and a second image of the plant illuminated with the second light of a second type different from the first type; determining a state of the plant based on an analysis of the first image and the second image; and causing the computer to further execute the steps:
8. The program according to claim 7, wherein the second light of the first type and the second light of the second type are different types of light from the first light.
Citation Information
Patent Citations
Picture image-discriminating device eof harvest robot
JP1996037883A
Farm crop-monitoring system
JP2007006716A
Plant cultivation apparatus
JP2016198055A
Plant cultivation facility
JP2016202124A