Litchi phenotype recognition device based on multi-modal learning

Abstract

The utility model relates to the technical field of phenotype recognition, in particular to a litchi phenotype recognition device based on multi-modal learning, and adopts the technical scheme that a uniform and stable lighting environment is formed, external light interference is reduced, image consistency is improved, and a standardized and controllable image acquisition environment is provided through arrangement of a quadrangular prism structure and internal strip-shaped lamps; the angle-adjustable rotary suspension arm is adopted, flexible adjustment of the position and the angle of the camera is supported, multi-view images of litchis can be conveniently obtained, the comprehensiveness of feature extraction is enhanced, and multi-angle and adjustable image acquisition is realized; the suspension arms are fixed through plum blossom hand screws, manual adjustment and locking are facilitated, the design of hinges facilitates opening and closing of a glass plate, placement and taking of samples are facilitated, and the operation convenience and structural stability of the device are enhanced; the functions of illumination, shooting, sample placement and the like are integrated, a closed collection space is formed, the system is suitable for being conveniently used in a laboratory or a field, and the practicability and reliability of the recognition system are improved.

Description

TECHNICAL FIELD

[0001] The utility model relates to phenotype identification technical field especially relates to a kind of litchi phenotype identification device based on multi-modal learning. BACKGROUND

[0002] Litchi phenotype identification refers to using modern imaging technology and data analysis method, the external morphological characteristics of litchi are measured and analyzed automatically, with high precision. Traditional litchi phenotype identification is mostly dependent on artificial observation or single-view shooting, lacks standardized collection environment, and is easily affected by factors such as light, angle, background; litchi phenotype identification needs to obtain high-quality images from multiple angles under stable and uniform light conditions, and existing devices are difficult to simultaneously meet the uniformity of light, the adjustability of angle and the stability of shooting; the camera in the traditional recognition device is usually fixedly installed, and cannot flexibly adjust the shooting angle and height, so it is difficult to adapt to litchi samples of different sizes and shapes; open or semi-closed devices are easily affected by ambient light, resulting in unstable image quality and affecting the accuracy of subsequent recognition algorithms.

[0003] In view of this, we propose a litchi phenotype identification device based on multi-modal learning to solve the existing problems. CONTENT OF THE UTILITY MODEL

[0004] The utility model aims at providing a litchi phenotype identification device based on multi-modal learning to solve the problems raised in the background.

[0005] To achieve the above-mentioned purpose, the utility model provides the following technical scheme: a litchi phenotype identification device based on multi-modal learning, the shape of the photographic studio device is a quadrangular prism, one side of the quadrangular prism is provided with a glass plate, the top of the glass plate is connected to the top of the outer side of the side wall through a hinge, the part of the side wall covered by the glass plate is provided with a window, and the inner sides of the other three side walls are each provided with a strip-shaped lamp; the inside of the photographic studio device is provided with a suspension arm and a camera, one end of the suspension arm is connected to the lower surface of the top surface of the photographic studio device, and the other end of the suspension arm is connected to the camera.

[0006] Further, the suspension arm is an angle-adjustable rotary suspension arm, the rotary suspension arm comprises a rotary suspension upper arm and a rotary suspension lower arm, the two ends of the rotary suspension upper arm are respectively provided with an upper arm connecting end and an upper arm suspension end, the two ends of the rotary suspension lower arm are respectively provided with a lower arm connecting end and a lower arm suspension end, the upper arm connecting end is rotationally connected to the lower arm connecting end, and a fixing screw is arranged at the rotationally connected position.

[0007] Further, the upper arm suspension end is provided with an upper end connecting component, one end of the upper end connecting component is provided with an upper end suspension position, the other end of the upper end connecting component is provided with an upper end connecting position, the upper end suspension position is fixedly connected to the lower surface of the top surface of the photographic studio device, and the upper end connecting position is rotationally connected to the upper arm suspension end.

[0008] Further, the lower arm suspension end is provided with a lower end connecting part, one end of the lower end connecting part is provided with a lower end suspension position, the other end of the lower end connecting part is provided with a lower end connecting position, the lower end suspension position is fixedly connected with the camera, and the lower end connecting position is rotationally connected with the lower arm suspension end.

[0009] Further, the fixing screw is a hexagonal hand screw.

[0010] Further, the hinge comprises a first fixing part and a second fixing part, the first fixing part is rotationally connected with the second fixing part, the surfaces of the first fixing part and the second fixing part are provided with a plurality of fixing holes, the first fixing part is fixedly connected with the top of the outer side of the side wall provided with the glass plate through the fixing hole and the bolt fixing connection device, and the second fixing part is fixedly connected with the top of the glass plate through the fixing hole.

[0011] Further, the strip-shaped lamp comprises a lamp body and a lamp body connecting part, and the lamp body is fixedly connected with the inner side of the side wall not provided with the glass plate through the lamp body connecting part.

[0012] Further, the shape of the window is a unit circle.

[0013] Further, the strip-shaped lamp is arranged in a horizontal direction.

[0014] Further, the camera is a binocular depth camera.

[0015] Compared with the prior art, the device has the beneficial effects that:

[0016] The four-prism structure and the internal strip-shaped lamp arrangement are adopted, a uniform and stable illumination environment is formed, external light interference is reduced, image consistency is improved, a standardized and controllable image acquisition environment is provided, the rotation suspension arm with adjustable angle is adopted, the flexible adjustment of the camera position and angle is supported, the multi-view image of litchi is conveniently acquired, the comprehensiveness of feature extraction is enhanced, multi-angle and adjustable image acquisition is realized, the hexagonal hand screw is adopted to fix the suspension arm, manual adjustment and locking are facilitated, the hinge is designed to facilitate the opening and closing of the glass plate, sample placement and taking are facilitated, and the operation convenience and structural stability of the device are enhanced, the functions of illumination, shooting and sample placement are integrated into one, a closed acquisition space is formed, the device is suitable for laboratory or field portable use, the practicality and reliability of the identification system are improved, and the device is compact in structure and high in function integration. BRIEF DESCRIPTION OF DRAWINGS

[0017] Figure 1 It is a structural schematic view of a litchi phenotype identification device based on multi-modal learning of the utility model;

[0018] Figure 2 It is a structural schematic view of a hinge of the utility model;

[0019] Figure 3 It is the structure schematic view of the strip lamp of the utility model;

[0020] Figure 4 It is the structure schematic view of the hanging arm of the utility model;

[0021] Figure 5 It is the connection schematic view of the hanging arm and the camera of the utility model;

[0022] Figure 6 It is the communication connection schematic view of the photographic booth and the computer host and the display screen of the utility model.

[0023] In the figure: 0, litchi; 1, glass plate; 2, hinge; 3, window; 4, strip lamp; 5, hanging arm; 6, camera; 01, photographic booth; 02, computer host; 03, display screen; 201, first fixed part; 202, second fixed part; 203, fixed hole; 401, lamp body; 402, lamp body connecting part; 501, rotating hanging upper arm; 502, rotating hanging lower arm; 503, fixed screw; 504, upper end connecting part; 505, lower end connecting part; 5011, upper arm connecting end; 5012, upper arm hanging end; 5021, lower arm connecting end; 5022, lower arm hanging end; 5041, upper end hanging place; 5042, upper end connecting place; 5051, lower end hanging place; 5052, lower end connecting place. DETAILED DESCRIPTION

[0024] The technical scheme of the utility model will be further explained below in combination with the drawings and specific embodiments. EMBODIMENT

[0025] As Figure 1 shown, a litchi phenotype recognition device based on multi-modal learning, the shape of the photographic booth device is a quadrangular prism, one side of the outer side of which is provided with a glass plate 1, the top of the glass plate 1 is connected with the top of the outer side of the side wall through the hinge 2 provided, the part of the side wall covered by the glass plate 1 is provided with a window 3, the shape of the window 3 is a circle, the inner side of the remaining three side walls is respectively provided with a strip lamp 4, and the strip lamp 4 is arranged in a horizontal direction; the inside of the photographic booth device is provided with a hanging arm 5 and a camera 6, one end of the hanging arm 5 is connected with the lower surface of the top surface of the photographic booth device, the other end of the hanging arm 5 is connected with the camera 6, and the camera 6 is a binocular depth camera.

[0026] As Figure 2As shown, the hinge 2 includes a first fixing component 201 and a second fixing component 202. The first fixing component 201 and the second fixing component 202 are rotatably connected. The surfaces of the first fixing component 201 and the second fixing component 202 are provided with a plurality of fixing holes 203. The first fixing component 201 is fixed to the top of the outer side wall of the glass plate 1 provided by the device through the fixing holes 203 and bolts. The second fixing component 202 is fixed to the top of the glass plate 1 through the fixing holes 203 and bolts.

[0027] like Figure 3 As shown, the strip light 4 includes a lamp body 401 and a lamp body connecting component 402. The lamp body 401 is fixedly connected to the inner side of the side wall of the device without the glass plate 1 through the lamp body connecting component 402.

[0028] like Figure 4 and Figure 5 As shown, the suspension arm 5 is an angle-adjustable rotating suspension arm, which includes a rotating upper suspension arm 501 and a rotating lower suspension arm 502. The upper suspension arm 501 has an upper arm connecting end 5011 and an upper arm suspension end 5012 at both ends, and the lower suspension arm 502 has a lower arm connecting end 5021 and a lower arm suspension end 5022 at both ends. The upper arm connecting end 5011 and the lower arm connecting end 5021 are rotatably connected, and a fixing screw 503 is provided at the rotatable connection point. The fixing screw 503 is a Torx screw. The upper arm suspension end 5012 has an upper connecting component 504. One end of 04 is provided with an upper suspension point 5041, and the other end of the upper connecting part 504 is provided with an upper connection point 5042. The upper suspension point 5041 is fixedly connected to the lower surface of the top of the photography studio device, and the upper connection point 5042 is rotatably connected to the upper arm suspension end 5012. The lower arm suspension end 5022 is provided with a lower connecting part 505. One end of the lower connecting part 505 is provided with a lower suspension point 5051, and the other end of the lower connecting part 505 is provided with a lower connection point 5052. The lower suspension point 5051 is fixedly connected to the camera 6, and the lower connection point 5052 is rotatably connected to the lower arm suspension end 5022.

[0029] The working principle of the litchi phenotypic recognition device based on multimodal learning according to Embodiment 1 is as follows:

[0030] The glass plate 1 is connected to the outer wall of the device via hinge 2, and the hinge 2 is fixedly connected via fixing hole 203. The glass plate 1 is flipped through the rotational connection of the first fixing component 201 and the second fixing component 202. The lychee 0 is placed inside the device through window 3, and the lychee 0 is illuminated by strip light 4 to ensure the brightness of the lychee 0 captured by camera 6. The lamp body 401 is fixedly connected to the inner wall of the device via lamp body connecting component 402, and the angle of the lychee 0 captured by camera 6 is adjusted via suspension arm 5.

[0031] The fixed screw 503 is tightened to fix the connection angle of the upper arm connecting end 5011 and the lower arm connecting end 5021, and the fixed screw 503 is loosened to adjust the connection angle of the upper arm connecting end 5011 and the lower arm connecting end 5021. The rotation connection of the upper arm suspension end 5012 and the upper end connecting part 5042, the rotation connection of the lower arm suspension end 5022 and the lower end connecting part 5052, and the rotation connection of the rotating suspension upper arm 501 and the rotating suspension lower arm 502 jointly enhance the flexibility of the camera 6 in adjusting the angle of collecting the lychee 0. In addition, the upper end suspension part 5041 of the upper end connecting part 504 and the lower end suspension part 5051 of the lower end connecting part 505 realize the stability of the camera 6.

[0032] As shown in Figure 6 The collected image of the camera 6 in the studio 01 is displayed on the display screen 03 after being processed by the computer host 02, so as to process the RGB and depth information of the lychee image.

[0033] The above specific embodiments are only several preferred embodiments of the present application, and based on the technical scheme of the present application and the related inspiration of the above embodiments, those skilled in the art can make various alternative improvements and combinations on the above specific embodiments.

Claims

1. A device for identifying the phenotype of a litchi based on multi-modal learning, characterized in that: The shape of the studio device is quadrangular prism, one side of which is provided with a glass plate (1), the top of which is connected to the top of the outer side of the side wall by a hinge (2), the part of the side wall covered by the glass plate (1) is provided with a window (3), and the inner sides of the remaining three side walls are each provided with a strip-shaped lamp (4); the inside of the studio device is provided with a suspension arm (5) and a camera (6), one end of the suspension arm (5) is connected to the lower surface of the top surface of the studio device, and the other end of the suspension arm (5) is connected to the camera (6).

2. The litchi phenotype recognition device based on multi-modal learning according to claim 1, characterized in that: The suspension arm (5) is an angle-adjustable rotary suspension arm, which includes a rotary suspension upper arm (501) and a rotary suspension lower arm (502), both ends of the rotary suspension upper arm (501) are respectively provided with an upper arm connecting end (5011) and an upper arm suspension end (5012), both ends of the rotary suspension lower arm (502) are respectively provided with a lower arm connecting end (5021) and a lower arm suspension end (5022), the upper arm connecting end (5011) is rotationally connected with the lower arm connecting end (5021), and a fixing screw (503) is arranged at the rotationally connected position. 3.The litchi phenotype recognition device based on multi-modal learning of claim 2, wherein: The upper arm suspension end (5012) is provided with an upper end connecting part (504), one end of the upper end connecting part (504) is provided with an upper end suspension position (5041), and the other end of the upper end connecting part (504) is provided with an upper end connecting position (5042), the upper end suspension position (5041) is fixedly connected with the lower surface of the top surface of the studio device, and the upper end connecting position (5042) is rotationally connected with the upper arm suspension end (5012).

4. The lychee phenotype recognition device based on multi-modal learning according to claim 2, characterized in that: The lower arm suspension end (5022) is provided with a lower end connecting part (505), one end of the lower end connecting part (505) is provided with a lower end suspension position (5051), and the other end of the lower end connecting part (505) is provided with a lower end connecting position (5052), the lower end suspension position (5051) is fixedly connected with the camera (6), and the lower end connecting position (5052) is rotationally connected with the lower arm suspension end (5022).

5. The lychee phenotype recognition device based on multi-modal learning according to claim 2, characterized in that: The fixing screw (503) is a hexagonal hand screw. 6.The litchi phenotype recognition device based on multi-modal learning of claim 1, wherein: The hinge (2) includes a first fixed part (201) and a second fixed part (202), the first fixed part (201) is rotationally connected with the second fixed part (202), a plurality of fixed holes (203) are arranged on the surfaces of the first fixed part (201) and the second fixed part (202), the first fixed part (201) is fixedly connected with the top of the outer side of the side wall of the glass plate (1) through the fixed holes (203), and the second fixed part (202) is fixedly connected with the top of the glass plate (1) through the fixed holes (203).

7. The device according to claim 1, wherein the device is characterized by: The strip-shaped lamp (4) includes a lamp body (401) and a lamp body connecting part (402), and the lamp body (401) is fixedly connected with the inner side of the side wall of the device which is not provided with the glass plate (1) through the lamp body connecting part (402). 8.The litchi phenotype recognition device based on multi-modal learning of claim 1, wherein: The shape of the window (3) is a circle. 9.The litchi phenotype recognition device based on multi-modal learning of claim 1, wherein: The strip-shaped lamp (4) is arranged in a horizontal direction. 10.The litchi phenotype recognition device based on multi-modal learning of claim 1, wherein: The camera (6) is a binocular depth camera.

Images