Measuring device for detecting honeybee mites and pests

Abstract

The present invention relates to a measuring device for detecting honeybee mites and pests and, more specifically, to a measuring device which, while rotating a honeycomb frame having a honeybee colony formed thereon, can capture images of the honeybee colony on both sides of the honeycomb frame, and after capturing the images, can analyze the images to quickly and accurately detect honeybees infected with mites or pests.

Description

Measuring device for detecting honeybee mites and pests

[0001] The present invention relates to a measuring device for detecting mites and pests in honeybees, and more specifically, to a measuring device capable of quickly and accurately detecting honeybees infected with mites or pests by rotating a bee swarm in which a honeybee colony is formed, taking images of the honeybee colony on both sides of the bee swarm, and analyzing the images obtained after taking the images.

[0002]

[0003] In general, the beekeeping industry is a business sector that generates income by producing high-quality, nutritious health foods (e.g., honey) through rational beekeeping management, including beekeeping management, breeding and production, distribution of products, disease and pest control measures, improvement of beekeeping equipment, and cultivation and utilization of nectar plants, utilizing the ecology and habits of bees.

[0004] The beekeeping industry is currently facing crises such as decreased productivity, declining bee populations, and colony collapse due to climate change and bee pests and diseases. Among bee pests, honey bee mites in particular cause greater economic damage than other bee diseases.

[0005] Honey bee mites are a type of mite that parasitize honey bees, sucking their body fluids and fats and transmitting pathogenic viruses. When honey bees are infected with honey bee mites, they cannot develop and function normally, their lifespan is shortened, and larvae may even die.

[0006] Currently, methods for isolating bees infected with honey bee mites from other bees include visual inspection by beekeepers, use of pesticides, and inducing honey bee mites using drone swarm lights.

[0007] To control these honeybee mites, a method of removing honeybee mites using pesticides is currently being used, but long-term use of pesticides has led to the development of resistance in honeybee mites, and the problem of contamination of beekeeping products due to residual pesticides has arisen.

[0008] In addition to the method of controlling bee mites using pesticides, a method of separating bees infected with bee mites from other bees and discarding them is being implemented to prevent the spread of bee mites in the early stages.

[0009] However, since honeybee mites are small and reddish brown in color, it is difficult to distinguish them from honeybees when they are attached to honeybees. Therefore, the separation method described above has the problem of low accuracy as well as differences in working speed and results depending on the experience and skill of the beekeeper.

[0010] To solve this problem, an analysis system was developed to determine whether honeybees are infected by placing a honeybee (10) on a stand (15), photographing honeybee colonies formed on both sides of the honeybee (10) using a camera (20), and analyzing the acquired images through a server (not shown) (30) (see Fig. 1).

[0011] However, in the case of these analysis systems, there was a problem that it was difficult to always position the light in the correct position because the operator had to manually place the light on the stand and move the light manually.

[0012] In addition, since honeybee colonies are formed on both sides of the light source, both the front and back of the light source where the honeybee colony is formed must be photographed in order to accurately identify infected bees in the honeybee colony. However, in the process of rotating the light source to photograph the back after photographing the front of the light source, the vibration causes the bees to fall off the light source, which reduces the accuracy of the analysis. In addition, the process of manually rotating the light source takes a long time and is inconvenient, which delays the overall photographing and analysis work.

[0013]

[0014] Accordingly, the technical problem of the present invention is conceived from this point, and provides a measuring device that can quickly and accurately detect bees infected with mites or pests by rotating a bee swarm where a bee swarm is formed, taking images of the bee swarm on both sides of the bee swarm, and analyzing the images obtained after taking the images.

[0015]

[0016] According to one embodiment of the present invention, the device may include: a base plate; a fixing unit provided on one side of the base plate for fixing a consumption light in which a honeybee colony is formed and allowing the consumption light to rotate; a photographing unit provided on the other side of the base plate for photographing the consumption light; and a control unit for controlling the fixing unit and the photographing unit.

[0017] At this time, the fixed unit may include a guide frame formed along the outer periphery of the base plate; a guide block connected to the guide frame; and a rotation frame that fixes the consumption light therein and is rotatably coupled to the guide block to rotate the consumption light in the left / right direction.

[0018] At this time, a pair of protrusions may be formed at both ends of the upper frame of the above-mentioned consumption light, and a first insertion groove may be formed at both ends of the above-mentioned rotating frame for inserting the protrusions.

[0019] At this time, a first elastic pressing portion may be formed on the inner surface of the first insertion groove to press and fix the protrusion of the light source.

[0020] Meanwhile, the fixing unit may include a pair of fixing members formed spaced apart from each other on one side of the base plate; and a pair of grippers formed on each of the pair of fixing members to hold and fix both ends of the light consumption member, and rotatably coupled to the fixing members so that the light consumption member can be rotated in the up / down direction.

[0021] At this time, a support for supporting both ends of the lower portion of the consumption light may be formed on each end of the pair of grippers.

[0022] At this time, the support may include an extension formed by extending from one end of the gripper; and a bend formed by bending at an end of the extension, and a second insertion groove formed for inserting both ends of the lower end of the consumption light.

[0023] At this time, a second elastic pressing portion may be formed on the inner surface of the second insertion groove to press and fix both ends of the consumption light.

[0024] Meanwhile, the photographing unit may include a first column fixed to the other side of the base plate; and a camera coupled to the first column.

[0025] Meanwhile, the photographing unit may include a ball screw formed along the other side of the base plate; a moving block provided to move linearly along the ball screw; a second column coupled to the moving block; and a camera coupled to the second column.

[0026] Meanwhile, the base plate may be installed and may further include a moving unit for moving the base plate above the beehive.

[0027] At this time, the moving unit may include: a fixed frame for fixing the base plate; a support frame coupled to the fixed frame to position the fixed frame above the beehive including the consumption light; and a wheel coupled to one end of the support frame to move the fixed frame.

[0028]

[0029] According to an embodiment of the present invention, by rotating a bee swarm where a honeybee colony is formed, an image of the honeybee colony on both sides of the bee swarm is captured, and the image obtained after the capture is analyzed to quickly and accurately detect honeybees infected with mites or pests. Through this, by quickly recognizing infected honeybees, the infected honeybees are separated from the honeybee colony, and further transmission of honeybee mites or pests can be prevented at an early stage.

[0030] In addition, by always positioning the light source in the correct position for shooting, the part of the light source being shot is kept constant, which not only improves the accuracy of the analysis, but also allows shooting while rotating the light source, thereby successively shooting both sides of the light source, which has the effect of shortening the shooting time of the honeybee colony formed on the front and back of the light source.

[0031] In addition, by implementing the process of the worker turning the light so that the light automatically rotates after taking a picture of the front side of the light, the problem of bees being separated from the light during the process of the worker turning the light is solved, and by reducing the error in the shooting distance between the light and the camera, the accuracy of video image analysis can be improved.

[0032]

[0033] The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

[0034]

[0035] The detailed description of preferred embodiments of the present application, as well as the summary described above, will be better understood when read in conjunction with the accompanying drawings. For the purpose of illustrating the present invention, preferred embodiments are depicted in the drawings. However, it should be understood that the present application is not limited to the precise arrangements and means illustrated.

[0036] Figure 1 is a schematic diagram of a honeybee analysis system according to the prior art.

[0037] Figures 2 to 6 are reference drawings for explaining a measuring device for detecting mites and pests of honeybees according to one embodiment of the present invention.

[0038] FIG. 7 is a reference diagram for explaining the light consumption used in a measuring device for detecting mites and pests of honeybees according to one embodiment of the present invention.

[0039] FIGS. 8 to 10 are reference drawings for explaining a method for detecting mites and pests of honeybees using a measuring device for detecting mites and pests of honeybees according to one embodiment of the present invention.

[0040] FIGS. 11 to 15 are reference drawings for explaining a measuring device for detecting mites and pests of honeybees according to another embodiment of the present invention.

[0041] FIG. 16 is a reference diagram for explaining a measuring device for detecting mites and pests of honeybees according to one embodiment of the present invention and a modified example of another embodiment.

[0042]

[0043] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. However, the attached drawings are provided solely to more easily disclose the contents of the present invention, and those skilled in the art will readily understand that the scope of the present invention is not limited to the scope of the attached drawings.

[0044] In addition, in describing the embodiments of the present invention, it is to be noted in advance that components having the same function are not completely identical to components of the prior art, although the same names and symbols are used.

[0045] In addition, the terminology used in this application is only used to describe some embodiments and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly indicates otherwise. In this application, it should be understood that the terms "comprise" or "have" are intended to specify the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0046]

[0047] Hereinafter, a measuring device for detecting mites and pests of honeybees according to the present invention will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical or corresponding components are assigned the same drawing numbers and redundant descriptions thereof will be omitted.

[0048]

[0049] FIGS. 2 to 6 are reference diagrams for explaining a measuring device for detecting mites and pests of honeybees according to one embodiment of the present invention. Referring to FIGS. 2 to 6, the measuring device for detecting mites and pests of honeybees according to the present embodiment may include a base plate (200), a fixing unit (300), a photographing unit (400), and a control unit (500).

[0050] The base plate (200) is formed into a rectangle having a constant area, and a fixing unit (300), a shooting unit (400), and a control unit (500) to be described later are placed inside.

[0051] The fixed unit (300) fixes the consumer light (100) where the honeybee colony is formed, and is provided on one side of the base plate (200) so that the consumer light (100) can rotate.

[0052] The fixed unit (300) is provided to fix the light consumption (100) and rotate on the base plate (200), and as it rotates, the photographing unit (400) can photograph both sides of the light consumption (100).

[0053] At this time, the consumption light (100) may include a small light (110) and a small light (130).

[0054] The shovel (110) is formed into a hexagonal room and serves as the foundation for bees to build a nest, and the shovel (130) is used as a border of the shovel (110) to cross the beehive (610), and the combination of the shovel (110) and the shovel (130) is called a consumption shovel (100).

[0055] Specifically, the honeycomb (110) is where bees build their honeycombs, and may be formed into a plate shape with multiple hexagonal cross-sections. The honeycomb (130) is a frame that surrounds the edge of the honeycomb (110), and is provided on the edge of the honeycomb (110). It is formed of a material such as wood or plastic, so that the honeycomb (110) is not damaged by external impact, and the honeycomb (110) can be placed across the beehive (610) using the honeycomb (130).

[0056] At this time, the light source (130) can be formed into a rectangular shape consisting of an upper frame (131), a lower frame (132), and a pair of vertical frames (133).

[0057] Meanwhile, the fixed unit (300) may include a guide frame (310), a guide block (320), and a rotation frame (330).

[0058] The guide frame (310) is formed along the outer periphery of the base plate (200), and the guide block (320) is connected to the guide frame (310). At this time, the guide block (320) can be fixed to the center of one side of the guide frame (310).

[0059] The rotating frame (330) fixes the light consumption (100) inside and is rotatably coupled to the guide block (320) to rotate the light consumption (100) in the left / right direction.

[0060] Specifically, the rotating frame (330) includes a lower frame (341) formed to a certain length to support the lower frame (132) of the light source (130) and a pair of vertical frames (343) provided parallel to each other on both sides of the lower frame (341), and the light source (130) is fixed to the rotating frame (330) by being coupled to the inside of the rotating frame (330).

[0061] At this time, the lower frame (341) is rotatably coupled to the guide block (320) through the rotation shaft (331), and the rotation frame (330) rotates left / right with respect to the guide block (320). At this time, the rotation shaft (331) can be connected to a motor (not shown) provided in the guide block (320), and the rotation shaft (331) rotates by the motor (not shown), thereby rotating the lower frame (341) of the rotation frame (330).

[0062] That is, since the guide block (320) is fixedly installed on the guide frame (310) and the rotation frame (330) is connected to the guide block (320), the consumption light (100) can be positioned in a fixed position so that the area to be photographed by the photographing unit (400) to be described later is always constant, and since the rotation frame (330) rotates with respect to the guide block (320), the photographing unit (400) can photograph the front and back sides of the consumption light (100), thereby obtaining an image of a honeybee colony formed on both sides of the consumption light (100).

[0063] At this time, a pair of protrusions (135) may be formed on both ends of the upper frame (131) of the consumption light (100), and a first insertion groove (345) may be formed on both ends of the rotating frame (330) for inserting the protrusions (135).

[0064] Referring to FIG. 4, a pair of protrusions (135) are formed at both ends of the upper frame (131) of the light source (100) so that the upper frame (131) protrudes from the vertical frame (133), and a first insertion groove (345) is formed in the vertical frame (133) of the rotating frame (330) for inserting the protrusions (135). That is, in order to photograph the light source (100), the light source (100) must be fixed to the rotating frame (330), and the protrusions (135) formed in the upper frame (131) of the light source (100) are inserted into the first insertion grooves (345) formed in the rotating frame (330), thereby coupling and fixing the light source (100) inside the rotating frame (330).

[0065] Meanwhile, referring to FIG. 5, a first elastic pressing portion (347) may be formed on the inner surface of the first insertion groove (345) to press and fix the protrusion (135) of the consumption light (100). Specifically, in order to prevent bees from escaping from the bee colony formed in the consumption light (100) when the guide block (320) moves or the rotation frame (330) rotates, the consumption light (100) must be firmly fixed to the rotation frame (330). According to the present embodiment, the first elastic pressing portion (347) is formed on the inner surface of the first insertion groove (345) to press the protrusion (135) of the consumption light (100) when the consumption light (100) is inserted into the rotation frame (330), thereby ensuring that the consumption light (100) is firmly fixed inside the rotation frame (330).

[0066] According to one embodiment of the present invention, by using a guide block (320) provided in a guide frame (310) and a rotation frame (330) rotatably coupled to the guide block (320), the consumption light (100) is positioned at a fixed position in the shooting area through the shooting unit (400), thereby ensuring that the shooting portion of the consumption light (100) is constant, thereby improving the analysis accuracy. In addition, by enabling shooting while rotating the consumption light (100), by continuously shooting both sides of the consumption light (100), there is an effect of shortening the shooting time of the honeybee colony formed on the front and back of the consumption light (100) (see FIG. 6).

[0067] In addition, by implementing the process of rotating the light (100) to take a picture of the back side after taking a picture of the front side of the light (100) so that the light (100) automatically rotates without the need for the worker to manually turn the light (100) over, the problem of bees escaping from the light (100) during the process of the worker turning the light (100) is solved, and by reducing the error in the shooting distance between the light and the camera, there is an effect of improving the accuracy of video image analysis.

[0068] The shooting unit (400) is provided on the other side of the base plate (200) and shoots the light consumption (100).

[0069] The shooting unit (400) may include a first column (410) fixed to the other side of the base plate (200) and a camera (430) coupled to the first column (410) (see FIGS. 2 and 3).

[0070] The camera (430) of the shooting unit (400) photographs the bee larva (100), and as the bee larva (100) rotates, photographs the front and back of the bee larva (100), transmits the photographed image data to a server (not shown), and the server (not shown) analyzes the transmitted image data to detect mites and pests of the bee.

[0071] At this time, the camera (430) is provided so as to be movable up and down on the first column (410), and specifically, the camera (430) is installed on a fixed plate (450) that is movably coupled to the first column (410), and as the fixed plate (450) moves, the camera (430) moves up and down, and at this time, the fixed plate (450) can be coupled to and fixed on the first column (410) by a fixing means (451) such as a bolt.

[0072] Meanwhile, Fig. 7 is a reference diagram for explaining a consumption light (100) used in a measuring device for detecting mites and pests of honeybees. In general, the consumption light (100) is sized for compatibility and efficiency of beekeeping work, and the size is standardized as follows: the horizontal length of the upper frame (131) is 488 mm, the horizontal length of the lower frame (132) is 440 mm, and the height including the upper frame (131) and the lower frame (132) is 235 mm.

[0073] Accordingly, the distance between the camera (430) and the light source (100) is determined according to the field of view performance of the camera (430) of the shooting unit (400), and the image data area is extracted with an area size (640*640) for analysis of infected honeybee objects. Since the honeybee colony image data shows more than 150 pixels for honeybee mites, stable object recognition is possible. In order to cover the entire area of ​​the light source (100) with a single shot of the camera (430), the distance between the camera (430) and the light source (100) needs to be set.

[0074] In the case of the present invention, the horizontal angle of view of the camera (430) is 66°, the vertical angle of view is 41°, and considering the angle of view of the camera (430), the size of the light consumption (100), the image data area of ​​4608*2592, and the pixels of 156 or more in the extraction area of ​​640*640, it is preferable that the distance between the camera (430) and the light consumption (100) be set to 390 mm to 400 mm. That is, when the distance between the camera (430) and the light source (100) is less than 390 mm, the entire area of ​​the light source (100) cannot be captured due to the angle of view limitation of the camera (430), so there is an inconvenience in that the shooting area of ​​the light source (100) must be divided by moving the light source (100) or the camera (430) to capture the image twice with the camera (430), and when the distance between the camera (430) and the light source (100) exceeds 400 mm, the pixels of the captured image data are reduced to less than 156 pixels, making it difficult to identify and analyze bees infected with mites and infectious diseases in the acquired image data, resulting in a decrease in analysis accuracy.

[0075] Meanwhile, the control unit (500) controls the fixed unit (300) and the photographing unit (400). That is, the control unit (500) controls the rotation of the rotating frame (330) of the fixed unit (300) so that the camera (430) can continuously photograph the front and back of the light source (100). That is, when the light source (100) is inserted into the rotating frame (330) connected to the guide block (320) and the light source (100) is positioned in the correct position, the control unit (500) controls the photographing unit (400) so that the camera (430) can photograph the front of the light source (100), and when the photographing of the front of the light source (100) is completed, the rotating frame (330) is rotated so that the camera (430) can photograph the back of the light source (100).

[0076] At this time, the control unit (500) may be a PC for controlling the fixed unit (300) and the shooting unit (400), and may include a power supply unit (not shown) for supplying power to the fixed unit (300) and the shooting unit (400).

[0077] Through this process, the measuring device for detecting mites and pests of honeybees according to the present invention can quickly and accurately detect honeybees infected with mites or pests by rotating the honeybee colony-forming light (100) and taking images of honeybee colonies on both sides of the honeybee colony-forming light (100), and analyzing the images obtained after taking the images.

[0078] Hereinafter, with reference to FIGS. 8 to 11, a method for detecting mites and pests of honeybees using a measuring device for detecting mites and pests will be described.

[0079] The camera (430) of the shooting unit (400) captures an image of a honeybee colony formed in the consumption light (100), and a server (not shown) recognizes and analyzes mites (pests) from the image data captured by the camera (430).

[0080] Specifically, the method for recognizing a mite (pest) may include a step of obtaining image data by measuring both sides of a light source (100) through a camera (430) of a photographing unit (400), a step of processing the image data obtained through the camera (430), and a step of recognizing a mite (pest) from the image data processed through an object recognition algorithm.

[0081] The step of obtaining image data by photographing both sides of the light source (100) through the camera (430) is to position the light source (100) at the shooting position, photograph the front side of the light source (100) through the camera (430), and then rotate the light source (100) to photograph the back side of the light source (100) to obtain image data.

[0082] At this time, a honeybee colony is formed in the consumption light (100), and in addition to normal honeybees, the honeybee colony may contain deformed honeybees, honeybees infected with mites (disease), larvae, etc.

[0083] The step of processing image data acquired through the camera (430) may include a step of extracting a region of interest from the image data acquired through the camera (430), and applying the developed honey bee mite and beekeeping object recognition model to the image data acquired through the camera (430) to determine honey bee mites. At this time, the step may include a step of improving the performance of determining whether an object is a mite (pest) by correcting the image data through a histogram normalization and smoothing process.

[0084] The image data measuring the entire consumption light (100) can be analyzed in two main ways. The first method uses the entire measurement data, and the second method analyzes the image data of the extracted region of interest. The entire measurement image data also includes data where bees are present but mites (pests) are not present. Therefore, it is necessary to find the region of interest in the image and extract the region of interest for analysis. The extracted region of interest can be used as a dataset for optimal image processing, and the process of extracting the region of interest is as follows.

[0085] To explore image processing methods, we selected images of bees infested with mites (pests) as the image data of interest. The selected images were images without bees or other obstacles overlapping the mite-infested bees.

[0086] Fig. 8 is a reference diagram for explaining a method for extracting a region of interest in a honeybee mite recognition method. Extraction of a region of interest is performed by tracking the drag of a mouse within an image, designating a region based on coordinate values, and extracting the corresponding part. Fig. 8 (a) is a selected image data source, and Fig. 8 (b) is an image from which a region of interest (ROI) is extracted from the image data source.

[0087] In order to improve the recognition rate of honeybees and mites (pests) in image data acquired through a camera (430), a step of correcting the image data is performed through a histogram normalization and smoothing process.

[0088] At this time, the color model of the image data acquired through camera (430) shooting may be an RGB color model.

[0089] Below, the histogram normalization and smoothing process for correcting the acquired image data will be described in detail.

[0090] Since infection with a mite (disease) is checked by taking out the consumer light (100), image measurement using a camera (430) is usually performed outdoors. Image data measured outdoors is affected by environmental factors such as time and weather. That is, outdoor shooting data is subject to changes in measurement conditions such as sunlight, light saturation, measurement error, exposure time, and aperture value. Due to these influences, in RGB image data, color component values ​​are not evenly distributed within the range of 0 to 255, but there are cases where some values ​​are biased. Histogram analysis of image data can confirm the distribution of the overall values, analyze pixel information according to intensity, and analyze color information of a certain area of ​​the image.

[0091] Histogram normalization and smoothing can be applied to homogenize unevenly collected image data and enhance outlines and contrast. Histogram normalization is calculated using the following equation (1) and is a method for correcting biased values ​​so that they are distributed more widely across the entire range.

[0092]

[0093]

[0094] I normalization : Normalized image

[0095] I original : Original image

[0096] Max original : Maximum value of original image

[0097] Min original : Minimum value of original image

[0098] Equation (1)

[0099] Histogram equalization redistributes the intensities concentrated in some values ​​using the accumulated value, and is calculated as in Equation (2). There are various algorithms for smoothing methods, such as Global Histogram Equalization (GHE), Local Histogram Equalization (LHE), and Dynamic Histogram Equalization (DHE). However, among the various smoothing methods, we selected a method that equalizes the entire image and Contrast limited adaptive histogram equalization (CLAHE) that divides the image into grids and calculates. In addition, color images have three channels, and the channel to which smoothing is applied differs depending on the color model. Therefore, in this embodiment, smoothing was applied to the component representing the brightness component for the HSV, YCrCb, and Lab models, and to all components for RGB and Gray.

[0100]

[0101]

[0102] v: Pixel intensity

[0103] H'(v) : Equalized v

[0104] cdf(v): Histogram cumulative function

[0105] cdf min : Minimum cumulative value

[0106] M*N: Resolution of image, Width*Height

[0107] L: Range of pixel values, 256

[0108] Round: Round function

[0109] Equation (2)

[0110] The acquired image data can be homogenized through the normalization and smoothing process of the histogram.

[0111] Object recognition algorithms learn object characteristics through supervised learning, which requires annotated data to be used as a reference value. Annotated data for supervised learning was generated from images containing honey bee mites, and images acquired at the optimal measurement distance (the distance between the camera (430) and the light source (100)) for honey bee and mite (pest) recognition were used to develop an object recognition model.

[0112] In order to develop a pest recognition algorithm, normal honeybees, mites (pests), infected honeybees, bees with deformed wings (disease), abnormal larvae (disease), and normal larvae that may exist in a polluted light (100) were selected as recognition targets. Since a large number of honeybees exist in the polluted light (100) measurement image, if the size of the captured image is excessively large, the required amount of computation may increase. Therefore, in order to improve the efficiency of model development, it is necessary to limit the size of the image to be used for learning, and in this embodiment, in order to limit the size of the image of interest, a region of interest (ROI) of 640*640 pixels in size was extracted from the entire image, and the region of interest was selected as an area where at least one of bees infected with mites (pests), bees with deformed wings (disease), and abnormal larvae (disease) exists. Fig. 9 (a) is the original image data selected, and Fig. 9 (b) is an image in which the region of interest (ROI) is extracted from the original image data.

[0113] Data labeling is a method for creating annotated data for supervised learning. For labeling, the target area of ​​image data can be designated as a box, polygon, or other shape. In this example, the YOLO model was used as the object recognition algorithm, resulting in a box-shaped target area.

[0114] For accurate learning, annotation information must be specified with the same rule in all images. Fig. 10 is a reference diagram for explaining the target class designation and labeling rules for applying the object recognition algorithm in the mite (pest) recognition method. Referring to Fig. 10, in this embodiment, the labeling rules for each object are specified such that the entire body of the bee is included in the case of a normal bee, the entire wing area is included in the case of a bee with a malformed wing (disease), and a bee parasitized by a mite or infected with a pest is designated as an infected bee, and a mite (pest) is designated as a mite (pest) regardless of the object (bee or larva) to which it is attached. If a mite (pest) is present in a bee with a malformed wing (disease), the wing-malformed bee (disease) and the mite (pest) are designated respectively. Normal and abnormal larvae are designated to include the entire body, and in the case of fireflies, even when they are gathered together, they are designated separately considering the honeycomb structure.

[0115] For the label class, the class names were set as B for honeybees, UB for bees with deformed wings (disease), BnM for bees infected with mites (pests), M for mites (pests), UL for abnormal larvae (disease), L for normal larvae, and C for firefighting.

[0116] To develop a honeybee mite object recognition algorithm, the entire data was divided into training, testing, and validation sets in a ratio of 7:2:1. The train and test datasets are used for training and validation during the deep learning process, while the validation dataset, which is random data not used in training, is used to verify the model's performance. During this dataset division process, classes may become concentrated in some datasets. This phenomenon can lead to overfitting or underfitting. In this example, random distribution and stratified sampling distribution methods were applied to consider the impact of dataset distribution.

[0117] Furthermore, since deep learning model development requires big data, image processing and data augmentation were utilized as methods for securing big data. Image processing can enhance the characteristics of honeybee mites, thereby improving the robustness of object recognition algorithms.

[0118] In this embodiment, the object recognition algorithm for recognizing honeybee mites uses the You Only Look Once (YOLO) algorithm. Since the YOLO algorithm is a known technology, a detailed description thereof will be omitted.

[0119] In the above, a method for recognizing honey bee mites has been specifically described through a step of acquiring image data through a camera (430), a step of processing the image data acquired through the camera (430), and a step of recognizing honey bee mites from the image data processed through an object recognition algorithm.

[0120] In this way, by utilizing the YOLO algorithm as an object recognition technology from image data captured by a camera (430), it is possible to quickly and accurately recognize bees infected with mites and pests from a bee colony of a consumer light (100).

[0121] FIGS. 11 to 15 are reference diagrams for explaining a measuring device for detecting mites and pests of honeybees according to another embodiment of the present invention. The measuring device for detecting mites and pests of honeybees according to this embodiment is the same as the measuring device for detecting mites and pests of honeybees according to the previous embodiment except for the detailed configuration of the fixing unit (300) and the photographing unit (400). Therefore, the description of the previous embodiment will be omitted for the same configuration, and the following description will focus on the modified fixing unit (300) and the photographing unit (400).

[0122] Referring to FIGS. 11 and 12, the fixing unit (300) of the measuring device for detecting mites and pests of honeybees according to the present embodiment may include a pair of fixing posts (350) and a pair of grippers (360) each coupled to a pair of fixing posts (350).

[0123] The fixed members (350) have a constant length and are formed in pairs spaced apart from each other on one side of the base plate (200). At this time, a gripper (360) is rotatably coupled to each of the pair of fixed members (350).

[0124] A gripper (360) is formed on each of a pair of fixing members (350) to grip and fix both sides of the light source (100), and a pair of grippers (360) are rotatably coupled to the fixing members (350) so that the light source (100) can be rotated in the up / down direction.

[0125] Specifically, a pair of jaws included in the gripper (360) pressurize both sides of the light source (100) to hold the light source (100), and the gripper (360) holding the light source (100) rotates through a motor (365) connected to the gripper (360). As the gripper (360) rotates, the light source (100) rotates in the up / down direction.

[0126] At this time, a support (370) may be formed on each end of a pair of grippers (360) to support both ends of the lower portion of the light source (100). The support (370) can not only support both ends of the lower portion of the light source (100) to fix the light source (100) so that it does not move when the light source (100) rotates, but also allows the gripper (360) to grip the center of the vertical frame (133) of the light source (100). That is, in order to capture the entire area of ​​the light source (100) with one camera (490) shot, the light source (100) must be positioned in the correct position, and the support (370) supports the lower portion of the light source (100) to restrict the movement of the light source (100) and position the light source (100) in the correct position. In addition, the support member limits the position of the light consumption (100), thereby allowing the gripper (360) to grip the center of the vertical frame (133) of the light consumption (100), so that the light consumption (100) rotates around the center of gravity when the light consumption (100) rotates up / down, thereby ensuring that the light consumption (100) rotates stably without tilting.

[0127] Referring to FIG. 13, the support (370) may include an extension (371) and a bending portion (373).

[0128] The extension part (371) is formed to extend downward from the bottom of the gripper (360), and a bend part (373) is formed at the end of the extension part (371) to support the lower end of the consumption light (100). Specifically, the bend part (373) is formed to be bent to a certain length at the end of the extension part (371), and a second insertion groove (375) is formed to insert both ends of the lower end of the consumption light (100), and the consumption light (100) is inserted into the second insertion groove (375), thereby fixing the consumption light (100) to the bend part (373).

[0129] Specifically, after positioning the light consumption (100) between a pair of grippers (360), the light consumption (100) is moved so that it is seated in the second insertion groove (375) of the bending portion (373) (see (a) of FIG. 14), and when the lower end of the light consumption (100) is seated in the second insertion groove (375), the control unit (500) operates the jaw of the gripper (360) so that the gripper (360) grips both ends of the light consumption (100), thereby fixing the light consumption (100) to the fixing unit (300) (see (b) of FIG. 14).

[0130] Meanwhile, referring to FIG. 14, a second elastic pressing portion (377) may be formed on the inner surface of the second insertion groove (375) to press and fix both ends of the consumption light (100).

[0131] Specifically, in order to prevent bees from escaping from the bee colony formed in the consumption light (100) when the gripper (360) rotates, the consumption light (100) must be firmly fixed. According to the present embodiment, a second elastic pressure part (377) is formed on the inner surface of the second insertion groove (375), so that when the bending part (373) of the consumption light (100) is inserted into the second insertion groove (375), both ends of the consumption light (100) are pressed so that the consumption light (100) is firmly fixed to the bending part (373).

[0132] According to one embodiment of the present invention, by using a gripper (360) that is rotatable by a motor (365) and a support (370) for positioning the light source (100) in the correct position of the shooting area, the entire surface of the light source (100) can be photographed with a single shot, and by enabling the light source (100) to be photographed while rotating, the two sides of the light source (100) can be photographed continuously, thereby shortening the shooting time of the honeybee colony formed on the front and back sides of the light source (100) (see FIG. 16).

[0133] In addition, by implementing the process of rotating the light (100) to take a picture of the back side after taking a picture of the front side of the light (100) so that the light (100) automatically rotates without the need for the worker to manually turn the light (100) over, the problem of bees being separated from the light (100) during the process of the worker turning the light (100) is solved, thereby improving the accuracy of video image analysis.

[0134] The shooting unit (400) is provided on the other side of the base plate (200) and shoots the light consumption (100).

[0135] The shooting unit (400) may include a ball screw (460), a moving block (470), a second column (480), and a camera (490) (see FIGS. 11 and 12).

[0136] A ball screw (460) is formed along the other side of the base plate (200) to a certain length, and a moving block (470) is provided to move linearly along the ball screw (460). A second column (480) is formed to extend upward on the upper surface of the moving block (470), and a camera (490) is coupled to the second column (480) to photograph the consumption light (100). At this time, the camera (490) photographs the front and back of the consumption light (100) as the consumption light (100) rotates (see Fig. 15 (a)).

[0137] In addition, the camera (490) is coupled to the moving block (470) via the second column (480), and the camera (490) moving together with the moving block (470) can capture the consumed light (100) while changing the shooting area as the moving block (470) moves along the length direction of the ball screw (460) (see FIG. 15 (b)).

[0138] Image data captured by the camera (490) is transmitted to a server (not shown), and the server (not shown) analyzes the transmitted image data to detect mites and pests of honeybees.

[0139] Meanwhile, the control unit (500) controls the fixed unit (300) and the photographing unit (400). That is, the control unit (500) controls the movement of the moving block (470) to position the camera (490) at the photographing position so that the camera (490) can photograph the central portion of the consumption light (100) fixed by the fixed unit (300), and controls the gripping of the consumption light (100) by the gripper (360) and the rotation of the gripper (360) so that the camera (490) can continuously photograph the front and back of the consumption light (100). That is, when the gripper (360) grasps the light consumption (100) under the control of the control unit (500) and the moving block (470) moves to a position where the camera (490) can capture the central portion of the light consumption (100), the control unit (500) controls the photographing unit (400) to enable the camera (490) to capture the front of the light consumption (100), and when the photographing of the front of the light consumption (100) is completed, the gripper (360) is rotated by the motor (365) to enable the camera (490) to capture the back of the light consumption (100).

[0140] Through this process, the measuring device for detecting mites and pests of honeybees according to the present invention can quickly and accurately detect honeybees infected with mites or pests by rotating the honeybee colony-forming light (100) and taking images of honeybee colonies on both sides of the honeybee colony-forming light (100), and analyzing the images obtained after taking the images.

[0141] Meanwhile, since the method for detecting mites and pests of honeybees using the measuring device for detecting pests and diseases according to the present embodiment is the same as that described in the previous embodiment, the detailed description of the method for detecting mites and pests of honeybees will be replaced with the description in the previous embodiment.

[0142] Meanwhile, FIG. 16 is a reference diagram for explaining a measuring device for detecting mites and pests of honeybees according to one embodiment of the present invention and a modified example of another embodiment. Referring to FIG. 16, the measuring device for detecting mites and pests of honeybees according to the present embodiment may further include a moving unit for moving the base plate (200) above the beehive (610) and having the base plate (200) mounted thereon.

[0143] The measuring device for detecting mites and pests of honeybees according to this embodiment can be used in an outdoor field where a beehive (610) is located, and therefore needs to be manufactured in a portable form to improve the convenience of workers.

[0144] Accordingly, the measuring device for detecting mites and pests of honeybees according to the present embodiment can be formed to be movable, including a moving unit, wherein a base plate (200) is mounted on the upper portion of the moving unit, and the base plate (200) is provided to move on the upper portion of the beehive (610) through the moving unit.

[0145] Specifically, referring to FIG. 16, the moving unit may include a fixed frame (620), a support frame (630), and wheels (640).

[0146] A fixed frame (620) is coupled to a base plate (200) to fix the base plate (200), and a support frame (630) is coupled to the fixed frame (620) to position the fixed frame (620) above a beehive (610) containing a light source (100). In addition, a wheel (640) is coupled to one end of the support frame (630) to move the fixed frame (620).

[0147] According to this embodiment, the base plate (200) equipped with the fixed unit (300), the photographing unit (400), and the control unit (500) can be moved while positioned on the upper part of the beehive (610) through the moving unit, thereby improving the convenience of the worker's work. That is, in the present embodiment, the worker does not need to move the beehive (610) containing multiple consumption lights (100) one by one, but instead, by moving the base plate (200) using a moving unit, picking out one consumption light (100) contained in the beehive (610), photographing both sides of the consumption light (100), then positioning the consumption light (100) again in the beehive (610), and then photographing another consumption light (100), the process is repeated, thereby shortening the photographing time of all consumption lights (100) contained in the beehive (610). In particular, when there are many beehives (610) and many consumption lights (100) contained therein, this work convenience can be greatly improved.

[0148]

[0149] Thus, according to the present invention, by rotating the bee swarm where the bee swarm is formed, images of the bee swarm on both sides of the bee swarm are captured, and the images obtained after the capture are analyzed to quickly and accurately detect bees infected with mites or pests. Through this, infected bees can be quickly recognized, thereby isolating the infected bees from the bee swarm, and preventing further transmission of mites or pests at an early stage.

[0150] In addition, by always positioning the light source in the correct position for shooting, the part of the light source being shot is kept constant, which not only improves the accuracy of the analysis, but also allows shooting while rotating the light source, thereby successively shooting both sides of the light source, which has the effect of shortening the shooting time of the honeybee colony formed on the front and back of the light source.

[0151] In addition, by implementing the process of the worker turning the light so that the light automatically rotates after taking a picture of the front side of the light, the problem of bees being separated from the light during the process of the worker turning the light is solved, and by reducing the error in the shooting distance between the light and the camera, the accuracy of video image analysis can be improved.

[0152] In addition, there is an effect of improving the convenience of the worker's work, as the worker can take pictures of multiple consumers included in the hive by moving the base plate while positioning it on the top of the hive using a moving unit, without having to move the hive containing multiple consumers one by one.

[0153]

[0154] As described above, preferred embodiments of the present invention have been described. It will be apparent to those skilled in the art that the present invention may be embodied in other forms, in addition to the embodiments described above, without departing from the spirit or scope thereof. Therefore, the above-described embodiments should be considered illustrative rather than restrictive, and accordingly, the present invention is not limited to the above description, but may be modified within the scope of the appended claims and their equivalents.

Claims

1. Base plate; A fixing unit provided on one side of the base plate for fixing a consumer light in which a honeybee colony is formed and for allowing the consumer light to rotate; A photographing unit provided on the other side of the base plate for photographing the light consumption; and A measuring device for detecting mites and pests of honeybees, characterized in that it comprises a control unit for controlling the fixed unit and the photographing unit.

2. In paragraph 1, The above fixed unit is, A guide frame formed along the outer periphery of the above base plate; a guide block connected to the above guide frame; and A measuring device for detecting mites and pests of honeybees, characterized in that it includes a rotating frame that fixes the consumption light inside and is rotatably coupled to the guide block so as to rotate the consumption light in the left / right direction.

3. In paragraph 2, A pair of protrusions are formed at both ends of the upper frame of the above-mentioned consumer light, A measuring device for detecting mites and pests of honeybees, characterized in that a first insertion groove for inserting the protrusion is formed on both ends of the rotating frame.

4. In paragraph 3, A measuring device for detecting mites and pests of honeybees, characterized in that a first elastic pressing portion is formed on the inner surface of the first insertion groove to press and fix the protrusion of the consumption light.

5. In paragraph 1, The above fixed unit is, A pair of fixing members formed spaced apart from each other on one side of the base plate; and A measuring device for detecting mites and pests of honeybees, characterized in that it comprises a pair of grippers, each formed on a pair of the above-mentioned fixed stands, which grip and fix both sides of the consumption light, and are rotatably coupled to the fixed stands so that the consumption light can be rotated in the up / down direction.

6. In paragraph 5, A measuring device for detecting mites and pests in honeybees, characterized in that a support is formed at each end of a pair of the grippers to support both ends of the lower end of the consumption light.

7. In paragraph 6, The above support is, An extension formed from one end of the gripper; and A measuring device for detecting mites and pests of honeybees, characterized in that it includes a bending portion formed by bending at an end of the extension portion and having a second insertion groove formed for inserting both ends of the lower end of the consumption light.

8. In paragraph 7, A measuring device for detecting mites and pests in honeybees, characterized in that a second elastic pressure portion is formed on the inner surface of the second insertion groove to press and fix both ends of the consumption light.

9. In paragraph 1, The above shooting unit is, A first column fixed to the other side of the base plate; and A measuring device for detecting mites and pests of honeybees, characterized in that it comprises a camera coupled to the first column.

10. In paragraph 1, The above shooting unit is, A ball screw formed along the other side of the base plate; A moving block provided to move linearly on the above ball screw; a second column coupled to the above moving block; and A measuring device for detecting mites and pests of honeybees, characterized in that it comprises a camera coupled to the second column.

11. In paragraph 1, A measuring device for detecting mites and pests in honeybees, characterized in that the base plate is fixed thereon and further includes a moving unit for moving the base plate above the beehive.

12. In paragraph 11, The above moving unit is, A fixed frame for fixing the above base plate; A support frame coupled to the fixed frame and positioning the fixed frame above the beehive containing the consumption light; and A measuring device for detecting mites and pests of honeybees, characterized in that it comprises a wheel connected to one end of the support frame and moving the fixed frame.

Images