Plant treatment system in agriculture
The plant treatment system addresses image quality issues in weed identification by using distributed lighting sources with specific LED characteristics, enhancing image quality and reducing phytosanitary product use.
Patent Information
- Application Number
- FR2019008025
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-07-16
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2039-07-16
AI Technical Summary
Existing plant treatment systems face challenges in obtaining high-quality images for accurate weed identification due to issues like poor contrast, under/overexposure, and varying lighting conditions, leading to inefficient use of phytosanitary products.
A plant treatment system with a spray boom equipped with distributed lighting sources that provide illumination from multiple angles, using LEDs with specific color temperature and CRI index, to enhance image quality and improve plant recognition, thereby minimizing treatment product consumption.
The system achieves improved image quality and efficient plant identification, reducing the need for phytosanitary products and environmental impact by optimizing lighting conditions for better weed detection.
Smart Images

Figure 00000009_0000 
Figure 00000010_0000
Abstract
Description
Title of the invention: Plant treatment system in agriculture
[0001] The present invention relates generally to the field of plant treatment in the agricultural field.
[0002] Methods and systems are already known in particular from documents WO2018142371A1 and WO2018154490A1 in the name of the Applicant for selectively treating weeds in cultivated areas. Such a system comprises a spray boom moved by a tractor and equipped with a series of spaced spray nozzles. The boom also comprises one or more cameras capturing images of the field while the system is moving, and one or more processing units capable, by image recognition techniques based on learning, of recognizing weeds in the captured images, and of controlling the spray nozzles in real time to apply a treatment, for example a herbicide treatment, only at the locations where the presence of weeds is detected.
[0003] This system makes it possible to considerably reduce the use of phytosanitary products.
[0004] The recognition of the species to be treated is carried out all the more effectively if the captured images are of good quality. Thus, images with too low or too high contrast, or even under- or overexposed images, make the identification of the plants to be treated difficult.
[0005] The present invention aims to enable the obtaining of images of improved quality, to make the identification of plants to be treated more efficient, and therefore to further minimize the consumption of treatment products and in particular the impact on the environment.
[0006] To this end, according to a first aspect, a system is proposed for treating plants in agriculture, comprising a spray boom provided with a plurality of spray nozzles supplied by a spray control device, the apparatus comprising a set of cameras capable of taking images of a growing area, a digital processing device capable of analyzing the images taken by the camera, identifying plants to be treated and applying instructions to the spray control device in order to spray a product selectively on plants to be treated, the apparatus also comprising an arrangement for lighting the growing area captured by the cameras, apparatus characterized in that the lighting arrangement comprises a plurality of light sources distributed along the boom and having illumination fields such that each scene taken by a camera receives light from at least two light sources.
[0007] Preferred aspects of this system include the following optional additional features, taken individually or in any combinations that those skilled in the art will understand to be technically compatible:
[0008] * light sources include light sources having axes principals of different orientations.
[0009] * the system comprises a plurality of lighting groups located in the vicinity of respective cameras.
[0010] * at least some lighting groups include are capable of generating at least two streams of light in two different main directions.
[0011] * a light flux has a general direction close to the axis of the camera at vicinity of which the group is located, and at least one other light flux has a general direction oblique to the axis of said camera.
[0012] * two other streams of light have two other streams of light have two general directions oblique to the axis of said camera.
[0013] * at least one lighting group comprises a set of light sources and a set of associated optics.
[0014] * at least one lighting group comprises at least one light source common to two flows, and at least two optics capable of generating at least two corresponding flows in two different directions.
[0015] * the system comprises means for differentiated control of luminous flux of different main axes.
[0016] * the luminous fluxes have an emission power all the greater as their axis main is inclined relative to the cameras' line of sight.
[0017] * the light sources are light-emitting diodes with a temperature of color between approximately 5000 and 6500°K.
[0018] * light-emitting diodes have a CRI index of at least 80.
[0019] * the system further comprises a light polarizer in front of at least some light sources, and a light polarizer in front of at least some cameras.
[0020] * the polarizers associated with the sources and the polarizers associated with the cameras are orthogonal linear polarizers.
[0021] Other aspects, aims and advantages of the present invention will become more apparent upon reading the following detailed description of preferred embodiments thereof, given by way of non-limiting example and with reference to the accompanying drawings.
[0022] On the drawings:
[0023] [Fig-1] is a partial schematic top view of a spray boom according to the present invention.
[0024] [Fig.2] is a partial side elevational view of the spray boom of [Fig.l].
[0025] With reference to the drawings, a spray boom has been shown which comprises, in a manner known per se, a supporting structure 100, for example metallic, a series of spray nozzles 110 preferably regularly spaced along the boom, each nozzle being selectively supplied by a respective solenoid valve from a reservoir of product to be sprayed, pipes and pressurizing means, all in a manner known per se, under the control of a spray control unit 120. The boom is either integrated into a machine, or towed by a machine, or carried by a machine.
[0026] Also in a known manner, the boom 100 comprises a set of cameras 210i (i being an order number starting from one end of the boom towards the opposite end and varying from 2 to n-1) whose axes ACi are oriented in a plunging direction in vertical planes parallel to the direction D of movement of the machine and capable of taking images of a field on which the boom 100 is moving, in order to identify plants to be treated. These plants may be weeds on which it is desired to selectively spray a herbicide product, or cultivated plants on which it is desired to selectively spray a phytosanitary product (insecticide, fertilizer, growth regulator, etc.).
[0027] These cameras 210i are connected to one or more digital processing units 220 capable of analyzing the images taken by the cameras to determine the presence of target plants. This analysis is carried out for example by decomposing each image into sub-images of determined size, applying a convolution function to each of the sub-images using weight matrices, and determining a probability of presence of a target plant as a function of the result of the convolution. Document WO2018142371A1 in the name of the applicant describes such techniques.Each time a plant to be treated is located in an image, its position in the image makes it possible to deduce its real position in the area being treated, and the processing unit 220 sends the spray control device 120 an instruction to trigger spraying on a nozzle chosen as a function of this real position, and at a time chosen as a function of this position and of machine progress data available to the processing unit 220.
[0028] According to the invention, the ramp also comprises a lighting device 400 consisting of a plurality of light sources intended to illuminate the scenes taken by the respective cameras 210.
[0029] This lighting device comprises several groups of light sources, these groups being designated by the reference 400i and each group of sources 400i being located in the close vicinity of an associated camera 210i. Each group (with the exception groups of ends of the ramp as will be seen later) comprises a so-called axial light source 410i having a main plunging lighting axis Ai oriented substantially parallel to the line of sight of the associated camera, and therefore located in the axial plane PAi, and two so-called oblique sources 420i, 430i, the source 420i having a main plunging lighting axis and oriented in an oblique vertical plane POli making an angle -a with the plane PAi, and the source 430i having a plunging lighting axis oriented in an oblique vertical plane PO2i symmetrical to the plane POli with respect to the plane PAn, that is to say making an angle +a with the plane PAi.
[0030] Thus, each scene taken by a 210i camera is illuminated on the one hand by the axial source 410i located in its close vicinity, and on the other hand by the oblique sources 430i-1 and 420i+1 located at the level of the neighboring groups of sources 400i-1 and 400i+1 respectively.
[0031] More generally, it is advantageous for the illumination fields of the sources to be such that each scene receives light from at least two light sources.
[0032] Images are thus obtained at the camera level whose lighting presents a homogeneity conducive to the recognition of plants to be treated, with a difference in luminance between the frontal zone of the plant and its lateral zones which is lower than with simple frontal lighting.
[0033] Advantageously, the oblique sources generate a light density at least equal to that generated by the axial source. To this end, the oblique sources being on average further away from the filmed scene than the axial source (the light having to travel an oblique path), the power of the oblique sources is preferentially higher than that of the axial sources. The ratio between the powers being linked at least approximately to the value of the angle a.
[0034] As illustrated on the left part of [Fig.l], the end lighting groups (here 400i, 400n), where there is no camera, are provided only with an oblique camera in the re-entrant direction, respectively 430i and 420n, for the oblique lighting of the scene taken by the immediately neighboring camera (respectively 2102 and 210n-l).
[0035] In the same vein, the lighting groups 4002, 400n-l do not include a light source directed towards the outside since there is no camera on this side and therefore no scene to be illuminated obliquely.
[0036] The lighting device is advantageously used for night work, but it can also be used in addition to low daytime lighting.
[0037] Furthermore, when working with highly lateralized solar lighting (working at the beginning or end of the day, or in winter), it is possible to control the light sources 410i, 420i, 430i selectively so as to at least partially compensate for the laterality of the solar illumination. Where appropriate, the control of the light sources can be automated as a function of the ambient brightness, possibly measured directionally using photocells facing in different directions (for example upwards and laterally).
[0038] To limit the power consumed by the sources, and therefore the need for the device to carry bulky and heavy batteries, the sources are advantageously light-emitting diodes.
[0039] It has also been observed that light with a high color temperature, preferably close to that of natural light and typically between 5000 and 6500°K, makes it possible to obtain an absorption / reflection law for plant chlorophyll that is well suited to image analysis.
[0040] It has further been observed that the value of the CRI index (Color Rendering Index in English terminology) of the LED sources has an impact on the ability to generate images favorable to the recognition of plants. Thus, light-emitting diodes having a CRI index at least equal to 80, and preferably at least equal to 90, are preferably used, indicating a good ability to restore natural colors.
[0041] Generally speaking, the spectrum of the light emitted by the sources can be advantageously adapted to the sensitivity spectrum of the 210i cameras and to the type of plant detection used (detection by contours where a homogeneous contrast is desirable, colorimetric detection where there must be a significant component of the light emitted in the vicinity of a peak of reflection or absorption by the plant, etc.). This spectrum can also extend into the invisible domain, when using hyperspectral or multispectral cameras.
[0042] The light sources 410n, 420n and 430n are either of the direct illumination type or equipped with optics such as reflectors and / or lenses so as to channel the light flux into a given solid angle. In the latter case, the reflective surfaces can be chosen so as to generate a uniform light density.
[0043] However, for the case of oblique sources, asymmetrical reflectors can be provided intended to project a light intensity that is higher the further the points of the scene are from the source, so as to make the density of light on the plants to be identified more homogeneous (between the most distant plants and the closest plants).
[0044] According to a variant of the invention,
[0045] Of course, the present invention is in no way limited to the embodiments described and shown, but those skilled in the art will be able to make numerous variations and modifications thereto. In particular:
[0046] - the light sources can be arranged in a grouped manner or not;
[0047] - each group of light sources can comprise a number of sources different from three;
[0048] - to define the general lighting axis, each light source can comprise, means for deflecting and / or concentrating and / or dispersing light; for example, a group of sources may comprise a single source, or even a common group of sources, and optical elements for generating light fluxes with lighting axes in two or three main directions, or even more;
[0049] - the light sources or their groups can be positioned so as to dissociated from the position of the cameras, according to an interval identical to that of the cameras or different;
[0050] - various combinations of light sources can be used in terms of power, spectrum, flow distribution;
[0051] - the nature and emission spectrum of light sources can vary widely in depending on needs, and in particular covering a spectrum going beyond the visible to cooperate with hyperspectral or multispectral cameras;
[0052] - all or part of the light sources and all or part of the cameras can be equipped polarizers; these polarizers are preferably linear polarizers, with orthogonal axes between the source polarizers and the camera polarizers (analyzers); the use of polarizers makes it possible to limit numerous parasitic reflections likely to pollute the images and harm the recognition of plants.
Claims
Claims
1. System for treating plants in agriculture, comprising a spray boom provided with a plurality of spray nozzles powered by a spray control device, the system comprising a set of cameras capable of taking images of a growing area, a digital processing device capable of analyzing the images taken by the camera, identifying plants to be treated and applying instructions to the spray control device in order to spray a product selectively on plants to be treated, the system also comprising an arrangement for lighting the growing area captured by the cameras, the system being characterized in that the lighting arrangement comprises a plurality of light sources distributed along the boom and having illumination fields such that each scene taken by a camera receives light from at least two light sources,light sources comprising light sources having principal axes of different orientations.,
2. System according to claim 1, characterized in that it comprises a plurality of lighting groups located in the vicinity of respective cameras.
3. System according to claim 2, characterized in that at least some lighting groups are capable of generating at least two light fluxes in two different main directions.
4. System according to claim 3, characterized in that a light flux has a general direction close to the axis of the camera in the vicinity of which the group is located, and at least one other light flux has a general direction oblique to the axis of said camera.
5. System according to claim 4, characterized in that two other light streams have two general directions oblique to the axis of said camera.
6. System according to one of claims 2 to 5, characterized in that at least one lighting group comprises a set of light sources and a set of associated optics.
7. System according to one of claims 2 to 5, characterized in that at least one lighting group comprises at least one common light source with two fluxes, and at least two optics capable to generate at least two corresponding flows in two different directions.
8. System according to one of claims 1 to 7, characterized in that it comprises means for differentiated control of luminous fluxes of different main axes.
9. System according to one of claims 1 to 8, characterized in that the light fluxes have an emission power that is all the greater as their main axis is inclined relative to the viewing axes of the cameras.
10. System according to one of claims 1 to 9, characterized in that the light sources are light-emitting diodes with a color temperature of between approximately 5000 and 6500 °K.
11. System according to claim 10, characterized in that the light-emitting diodes have a CRI index at least equal to 80.
12. System according to one of claims 1 to 11, characterized in that it further comprises a light polarizer in front of at least some of the light sources, and a light polarizer in front of at least some cameras.
13. System according to claim 12, characterized in that the polarizers associated with the sources and the polarizers associated with the cameras are orthogonal linear polarizers.
