Rape pod identification method based on deep learning

Abstract

The invention discloses a rape pod identification method based on deep learning. The method comprises the following steps: S1, randomly selecting rape samples in different forms; s2, the rape sample is placed on a fixing device, and siliques on the rape sample are located on the same plane; s3, shooting branches with siliques of the rape sample and obtaining a picture set; s4, 70% of pictures are selected from the picture set to be marked into a silique database manually; s5, constructing a silique recognition model by using a convolutional neural network, and training by using data of a silique database; and S6, verifying and correcting the pod identification model by using the remaining 30% of the pictures in the picture set, and compiling the pod identification model into pod identification software. According to the method, the speed of counting the quantity of the rape siliques can be greatly increased, and the working efficiency and accuracy of rape breeding test and yield estimation are improved.

Description

Technical Field

[0001] The present invention relates to the field of rapeseed silique identification technology, and more specifically, to a rapeseed silique identification method based on deep learning. Background Art

[0002] In the scientific research work related to rapeseed breeding and cultivation technology, both seed testing and yield estimation require testing the number of siliques of each rapeseed plant. Currently, the number of rapeseed siliques is still obtained by manual counting. The manual counting method has the following problems: manual counting requires a lot of labor, is costly, time-consuming and labor-intensive, inefficient, and has human errors. Moreover, in many scientific studies involving the counting of rapeseed siliques, due to the limitations of the above factors, the sample size is relatively small, which is prone to the problem of insufficient sample size affecting the research results. Summary of the invention

[0003] The purpose of the present invention is to overcome the deficiencies of the prior art and provide a method for identifying rapeseed siliques.

[0004] In order to achieve the above object, the present invention adopts the following technical scheme: a method for identifying rapeseed siliques based on deep learning, comprising the following steps:

[0005] S1: Randomly selected rapeseed samples with different morphologies;

[0006] S2: Place the rapeseed sample on a fixing device so that all siliques on the rapeseed sample are on the same plane;

[0007] S3: Take photos of the branches with siliques of rapeseed samples and obtain a picture set;

[0008] S4: 70% of the images in the image collection are selected for manual labeling to construct a silique database;

[0009] S5: Use convolutional neural network to build a silique recognition model and use the data of silique database for training;

[0010] S6: Use the remaining 30% of the images in the image set to verify and correct the silique recognition model and compile it into silique recognition software.

[0011] Furthermore, the first transparent plate is provided with a length mark.

[0012] Furthermore, a light box is provided below the fixing plate, and a transmissive light source is installed in the light box.

[0013] Furthermore, the fixing device includes a fixed plate, the fixed plate is equipped with a movable plate that can move along a first direction, the fixed plate includes a first frame, the first frame is equipped with a first transparent plate, and the movable plate includes a second frame, the second frame is equipped with a second transparent plate.

[0014] Furthermore, the first frame is provided with a first installation groove extending in a first direction, the second frame is provided with a moving block extending into the first installation groove, and the moving block moves along the first installation groove when the movable plate moves in a first reverse direction.

[0015] Furthermore, a guide plate extending along the first direction is provided in the first mounting groove, and gaps are provided between the guide plate and at least one side wall and the bottom surface of the first mounting groove. The movable block extends into the first mounting groove through the gap between the guide plate and the side wall of the first mounting groove, and the movable plate is equipped with a first roller, which abuts against a side of the guide plate facing the bottom surface of the first mounting groove.

[0016] Furthermore, the guide plate includes a first section and a second section, a side of the first section facing the bottom surface of the first mounting groove is parallel to the bottom surface of the first mounting groove, and a side of the second section facing the bottom surface of the first mounting groove is inclined toward the bottom surface of the first mounting groove, and when the first roller moves along the second section, the distance between the first transparent plate and the second transparent plate decreases.

[0017] Furthermore, the first frame is provided with a second installation groove, and the second installation groove is provided with a retractable second roller, and the second roller can roll along the first direction and abut against the second frame.

[0018] Furthermore, a support frame is arranged in the second mounting groove, and the support frame includes a bottom plate, the bottom plate is connected to two side plates extending upward, the second roller is installed between the two side plates, and a first spring is arranged between the bottom plate and the bottom surface of the second mounting groove.

[0019] Furthermore, a first guide rod is disposed in the second mounting groove, and the bottom plate is provided with a positioning plate extending toward a side wall of the second mounting groove, and the first guide rod passes through the positioning plate.

[0020] Furthermore, a support plate is provided on the inner wall of the second frame, and the second transparent plate is installed on the support plate. A third mounting groove is provided on the inner wall of the second frame, and the support plate partially extends into the third mounting groove. A second guide rod extending in a vertical direction is provided in the third mounting groove, and the second guide rod passes through the support plate and extends into the third mounting groove. A second spring is provided between the support plate and the top of the third mounting groove.

[0021] In summary, the present invention has the following beneficial effects:

[0022] The method is fast and accurate, and can effectively solve the problems of time-consuming and labor-intensive manual counting, low efficiency, and human error. It can greatly increase the speed of counting rapeseed siliques, and improve the efficiency and accuracy of rapeseed breeding and yield estimation. The method is applied to related scientific research, which is not only efficient, but also can increase the number of research samples and improve the accuracy of research results. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 is a schematic structural diagram of the fixing device in this embodiment;

[0024] Figure 2 is a schematic diagram of the structure in the first installation slot;

[0025] Figure 3 for Figure 2 The enlarged view of point A in the middle;

[0026] Figure 4 To indicate the structure in the second mounting slot;

[0027] Figure 5 for Figure 4 The enlarged view of point B in the middle;

[0028] Figure 6 is a cross-sectional view of the fixing device;

[0029] Figure 7 for Figure 6 Enlarged view of point C in the middle;

[0030] Figure 8 These are manually labeled pictures;

[0031] Fig. 9 This is the software interface for silique identification;

[0032] Fig.10 It is a structural diagram of the light box location;

[0033] Figure numerals: fixed plate 100, first frame 110, first transparent plate 120, movable plate 200, second frame 210, second transparent plate 220, support plate 230, moving block 240, first roller 241, first mounting groove 300, guide plate 310, first section 311, second section 312, second mounting groove 400, second roller 410, support frame 420, bottom plate 421, side plate 422, positioning plate 423, first spring 430, first guide rod 440, third mounting groove 500, second guide rod 510, second spring 520; light box 600. DETAILED DESCRIPTION

[0034] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0035] Embodiment 1:

[0036] See also Figures 1 to 10 , this embodiment provides a rapeseed silique identification method based on deep learning.

[0037] In the late stage of rapeseed growth, hundreds of rapeseed samples with different morphologies were randomly selected from the rapeseed field, and the branches with siliques were photographed separately to obtain 2,200 pictures. The samples cover different forms of rapeseed siliques. Based on the pictures, 70% of the pictures were first selected as learning samples, and polygon marking was performed manually to build a silique recognition database. Then, a silique recognition model was built using a convolutional neural network; the remaining 30% of the pictures were used to verify and correct the silique recognition model, and rapeseed silique recognition and counting software was compiled. This method is fast and accurate, and can effectively solve the problems of time-consuming and labor-intensive manual counting, low efficiency, and human errors. It can greatly improve the speed of counting the number of rapeseed siliques, and improve the efficiency and accuracy of rapeseed breeding and yield estimation. This method is applied to related scientific research, which is not only efficient, but also can increase the number of research samples and improve the accuracy of research results.

[0038] The fixing device includes a fixing plate 100, on which a movable plate 200 capable of moving in a first direction is installed. The fixing plate 100 includes a first frame 110, on which a first transparent plate 120 is installed. The movable plate 200 includes a second frame 210, on which a second transparent plate 220 is installed. The rapeseed siliques are clamped between the first transparent plate 120 and the second transparent plate 220, so that the rapeseed siliques on each branch of the rapeseed sample are on the same plane, preventing the rapeseed siliques from interlacing and overlapping with each other and affecting the identification.

[0039] The first frame 110 is provided with a first mounting groove 300 along a first direction, and a guide plate 310 is provided in the first mounting groove 300, and the guide plate 310 extends along the first direction. The guide plate 310 extends from one side wall of the first mounting groove 300 in the length direction toward the other side wall and forms a gap with the other side wall. The second frame 210 is provided with a moving block 240 extending into the first mounting groove 300 and passing through the gap on one side facing the first frame 110, and the moving block 240 is provided with a first roller 241 on one side facing the guide plate 310, and the first roller 241 contacts with a side of the guide plate 310 facing the bottom of the first mounting groove 300. When the movable plate 200 moves, the movable plate can move along the guide plate 310.

[0040] The guide plate 310 includes a first section 311 and a second section 312. The first section 311 is parallel to the ground of the first mounting groove 300 on one side facing the bottom surface of the first mounting groove 300. The second section 312 is inclined on one side facing the bottom surface of the first mounting groove 300, and the inclination direction is inclined toward the bottom surface of the first mounting groove 300. When the moving block 240 moves to the second section 312, the first roller 241 moves along the second section 312 toward the bottom of the first mounting groove 300, thereby driving the first frame 110 and the second frame 210 to fit together, thereby reducing the distance between the first transparent plate 120 and the second transparent plate 220, thereby clamping the rapeseed siliques placed between the first transparent plate 120 and the second transparent plate 220.

[0041] The first frame 110 is also provided with a plurality of second mounting grooves 400 located on one side of the first mounting groove 300. A retractable second roller 410 is provided in the second mounting groove 400. The second roller 410 contacts the second frame 210, thereby providing space for changing the distance between the first frame and the second frame 210. Specifically, a support frame 420 is provided in the second mounting groove 400. The support frame 420 includes a bottom plate 421 and two side plates 422 extending upward from the bottom plate 421. The second roller 410 is installed between the two side plates 422 via a rotating shaft, so that the second roller 410 can rotate in the first direction. A first spring 430 is arranged between the bottom plate 421 and the bottom surface of the second mounting groove 400, and the extension and retraction of the second roller 410 can be realized through the first spring 430. At the same time, positioning plates 423 extending toward the side walls of the second mounting groove 400 are arranged on both sides of the bottom plate 421, and a guide rod extending upward is arranged at the bottom of the second mounting groove 400. The guide rod passes through the positioning plate 423, thereby guiding the extension and retraction of the second roller 410 to prevent displacement during extension and retraction.

[0042] When the second frame 210 moves along the first direction, the second roller 410 supports the movement of the second frame 210, and when the first roller 241 moves along the first section 311 of the guide plate 310, the first transparent plate 120 gradually overlaps with the second transparent plate 220. When the first roller 241 moves along the second section 312 of the guide plate 310, the first roller 241 gradually moves toward the bottom of the first mounting groove 300, thereby driving the second frame 210 to move toward the first frame 110, so that the second frame 210 is close to the first frame 110, and the second transparent plate 220 is close to the first transparent plate 120, so that the rapeseed silique placed between the first transparent plate 120 and the second transparent plate 220 is fixed, and at this time, the second roller 410 moves downward to compress the first spring 430. The end of the second section 312 of the guide plate 310 is provided with a horizontal section parallel to the bottom surface of the first mounting groove 300. When the first roller 241 moves to the horizontal section, the first frame 110 and the second frame 210 can be kept in a fitted state, which facilitates the photography of the rapeseed siliques placed between the first transparent plate 120 and the second transparent plate 220.

[0043] The inner wall of the second frame 210 is provided with a support plate 230, and the second transparent plate 220 is fixed to the support plate 230. The inner wall of the second frame 210 is provided with a third mounting groove 500, and a portion of the second transparent plate 220 extends into the third mounting groove 500. Meanwhile, a second guide rod 510 is provided in the third mounting groove 500, and the second guide rod 510 passes through the portion of the support plate 230 extending into the third mounting groove 500. Meanwhile, a second spring 520 is sleeved on the second guide rod 510, and one end of the second spring 520 abuts against the support plate 230, and the other end abuts against the top of the third mounting groove 500, thereby limiting the support plate 230 and the second transparent plate 220 from moving upward. When the second frame 210 moves toward the first frame 110, the rapeseed siliques placed on the first transparent plate 120 abut against the second transparent plate 220. When the second frame 210 continues to move toward the first frame 110, the rapeseed siliques will abut against the second transparent plate 220, so that the support plate 230 moves upward in the third mounting groove 500, and the second spring 520 is compressed, thereby preventing the second transparent plate 220 from crushing the rapeseed siliques placed on the first transparent plate 120, ensuring that the boundaries of the rapeseed siliques are clear and facilitating the photographing of the rapeseed siliques.

[0044] Embodiment 2:

[0045] See also Figure 1 , which is different from Example 1, in this embodiment, a length mark 121 with a length of 10 cm is provided in the first transparent plate 120, and the length is photographed together with the silique as a standard reference length for identification and as a reference, so that the software can quickly identify the number of siliques and also obtain the length data of the siliques.

[0046] Embodiment 3:

[0047] See also Fig.10 , which is different from the first embodiment, in this embodiment, a light box 600 is installed under the fixing plate 100, and a transmissive light source is installed in the light box 600, so that the light box 600 serves as a backlight, and when photographing the silique, the light can penetrate the silique skin, and the grains cannot be penetrated by the light, leaving dot-shaped shadows on the picture. A program for identifying dot-shaped shadows is added to the silique recognition software to count the number of grains, so that the software can quickly identify the number of siliques and the number of grains inside the siliques.

[0048] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A method for identifying rapeseed siliques based on deep learning, characterized in that: The following steps are involved: S1: Randomly selected rapeseed samples with different morphologies; S2: Place the rapeseed sample on a fixing device so that all siliques on the rapeseed sample are on the same plane; S3: Take photos of the branches with siliques of rapeseed samples and obtain a picture set; S4: 70% of the images in the image collection are selected for manual labeling to construct a silique database; S5: Use convolutional neural network to build a silique recognition model and use the data of silique database for training; S6: Use the remaining 30% of the images in the image set to verify and correct the silique recognition model and compile it into silique recognition software.

2. A method for identifying rapeseed siliques based on deep learning according to claim 1, characterized in that: The fixing device comprises a fixing plate (100), the fixing plate (100) being mounted with a movable plate (200) capable of moving along a first direction, the fixing plate (100) comprising a first frame (110), the first frame (110) being mounted with a first transparent plate (120), the movable plate (200) comprising a second frame (210), the second frame (210) being mounted with a second transparent plate (220).

3. A method for identifying rapeseed siliques based on deep learning according to claim 2, characterized in that: The first transparent plate (120) is provided with a length mark (121).

4. The method for identifying rapeseed siliques based on deep learning according to claim 2, characterized in that: A light box (600) is arranged below the fixing plate (100), and a transmissive light source is installed in the light box (600).

5. A method for identifying rapeseed siliques based on deep learning according to claim 3 or 4, characterized in that: The first frame (110) is provided with a first mounting groove (300) extending in a first direction, the second frame (210) is provided with a moving block (240) extending into the first mounting groove (300), when the movable plate (200) moves in a first reverse direction, the moving block (240) moves along the first mounting groove (300), a guide plate (310) extending in the first direction is provided in the first mounting groove (300), a gap is provided between the guide plate (310) and at least one side wall and bottom surface of the first mounting groove (300), the moving block (240) passes through the gap between the guide plate (310) and the side wall of the first mounting groove (300) and extends into the first mounting groove (300), the moving plate is provided with a first roller (241), the first roller (241) abuts against a side of the guide plate (310) facing the bottom surface of the first mounting groove (300).

6. The method for identifying rapeseed siliques based on deep learning according to claim 5, characterized in that: The guide plate (310) comprises a first section (311) and a second section (312); a side of the first section (311) facing the bottom surface of the first mounting groove (300) is parallel to the bottom surface of the first mounting groove (300); a side of the second section (312) facing the bottom surface of the first mounting groove (300) is inclined toward the bottom surface of the first mounting groove (300); when the first roller (241) moves along the second section (312), the distance between the first transparent plate (120) and the second transparent plate (220) decreases.

7. A method for identifying rapeseed siliques based on deep learning according to claim 3 or 4, characterized in that: The first frame (110) is provided with a second installation groove (400), and the second installation groove (400) is provided with a retractable second roller (410), and the second roller (410) can roll along a first direction and abut against the second frame (210).

8. The method for identifying rapeseed siliques based on deep learning according to claim 7, characterized in that: A support frame (420) is arranged in the second installation groove (400), and the support frame (420) includes a bottom plate (421), and the bottom plate (421) is connected to two side plates (422) extending upward, and the second roller is installed between the two side plates (422), and a first spring (430) is arranged between the bottom plate (421) and the bottom surface of the second installation groove (400).

9. The method for identifying rapeseed siliques based on deep learning according to claim 8, characterized in that: A first guide rod (440) is disposed in the second installation groove (400), and the bottom plate (421) is provided with a positioning plate (423) extending toward the side wall of the second installation groove (400), and the first guide rod (440) passes through the positioning plate (423).

10. A method for identifying rapeseed siliques based on deep learning according to claim 3 or 4, characterized in that: The inner wall of the second frame (210) is provided with a support plate (230), and the second transparent plate (220) is installed on the support plate (230). The inner wall of the second frame (210) is provided with a third mounting groove (500), and the support plate (230) partially extends into the third mounting groove (500). The third mounting groove (500) is provided with a second guide rod (510) extending in a vertical direction, and the second guide rod (510) passes through the support plate (230) and extends into the third mounting groove (500). A second spring (520) is provided between the support plate (230) and the top of the third mounting groove (500).

Images