Nose print acquisition and display system

Abstract

To provide an acquisition display system of a muzzle pattern which is capable of clearly acquiring a muzzle pattern of an animal with a simple system using a terminal with a camera, and of outputting and displaying the muzzle pattern of an animal to a registration document.SOLUTION: An administrative server 10 can connect a terminal 20 with a camera and a registration document server 30 storing a registration document R of an animal individual 1 via a network 40. The terminal 20 with a camera photographs a face image of an animal individual to which an individual identification number is attached and transmits the face image to the administrative server 10. The administrative server 10 is provided with: an image storage part 13; a nose part image cutting part 14 for cutting a nose image out of the face image; an image response part 15 responding the nose part image to the terminal 20 with a camera; a muzzle pattern image conversion part 16 performing threshold processing of the nose part image by using a plurality of thresholds and converting the nose part image into a plurality of muzzle pattern images; a muzzle pattern image registration part 17 which registers one image out of the plurality of muzzle pattern images as a registered muzzle pattern image; a muzzle pattern image embedding part 18 calling the registration document out of the registration document server and embedding the registered muzzle pattern image in a muzzle pattern column of the registration document; and an output display part 19 outputting and displaying the registration document in which the registered muzzle pattern image is embedded.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a system for obtaining and displaying nose prints of animals, particularly livestock, with clarity, and for outputting and displaying the nose prints on a registration document. [Background technology]

[0002] Like human fingerprints, nose prints of animals are unique to each individual, and so nose prints are used as a means of identifying individual livestock, particularly cattle. A nose print is a pattern formed on the surface of the nose, and traditionally, ink or similar would be applied to the nose of a livestock animal with a roller, absorbent Japanese paper would be pasted on the surface, the nose print would be collected, and the Japanese paper with the transferred nose print would then be pasted on the individual's registration document, and the individual would be verified by the nose print pasted on the registration document.

[0003] With the conventional matching method described above, the ink stains the nose of livestock, and it is difficult to clearly transfer the nose print onto Japanese paper in the case of calves and other animals with shallow nose prints. For these reasons, a method has been proposed in which the nose print surface is illuminated with a light source to clearly show the shadows, and the nose print is photographed with a camera (Patent Document 1, Patent Document 2).

[0004] In addition to the above, a management system has been proposed that captures an image of a nose print using a CCD camera, adds feature data to the nose print image, and registers and manages it as nose print data (Patent Document 3), and a method that uses machine learning to match nose prints (Patent Document 4). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 9-140288 [Patent Document 2] Japanese Patent Application Publication No. 11-45330 [Patent Document 3] Japanese Patent Application Laid-Open No. 2001-148957 [Patent Document 4] Patent No. 6795243 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the methods of Patent Documents 1 and 2 require a light source, and differences in shading occur depending on the direction and angle of the light source, making it difficult to obtain a clear nose print. There is also the problem of the need for specialized equipment, which is expensive. The method of Patent Document 3 requires adding feature data to the nose print image, and the method of Patent Document 4 is advanced in that it uses machine learning, but both methods result in complex systems.

[0007] The present invention has been made in consideration of the above-mentioned problems, and aims to provide a nose print acquisition and display system that is a simple system using a camera-equipped terminal and that can clearly acquire an animal's nose print and output and display it on a registration document. [Means for solving the problem]

[0008] In order to solve the above problems, the muzzle print acquisition and display system according to the present invention comprises: The management server is connectable via a network to a camera-equipped terminal and a registry server that stores the registry data of individual animals for each individual identification number. the camera-equipped terminal is capable of taking a facial image of the individual animal to which an individual identification number has been assigned, focusing on the nose, and transmitting the facial image after taking the image to the management server; The management server is a nose image cutting means for cutting out a nose image from a face image of an individual animal transmitted from a camera-equipped terminal; an image returning means for returning the cut-out nose image to the camera-equipped terminal of the sender; a nose print image conversion means for threshold processing the cutout nose image using a plurality of different thresholds to convert it into a plurality of nose print images that differ in one or more elements of color tone, brightness, and luminance; a nose print image registration means for registering one nose print image selected and determined from the plurality of nose print images as a registered nose print image for each individual identification number; a nose print image embedding means for retrieving the registry data of each individual animal for each individual identification number from the registry server and embedding a corresponding registered nose print image in the muzzle field of the registry data of the retrieved individual animal; The first feature is that the device is provided with an output display means for outputting and displaying the registration data of an individual in which the registered nose print image is embedded in the nose print field.

[0009] The muzzle print acquisition and display system according to the present invention comprises: In the management server, The second feature is that the image returning means transmits the plurality of nose print images converted by the nose print image converting means to the camera-equipped terminal, and the camera-equipped terminal selects and determines one nose print image from the plurality of nose print images displayed on the screen as a registered nose print image and transmits it to the management server.

[0010] The muzzle print acquisition and display system according to the present invention comprises: In the management server, A third feature is that the muzzle pattern image conversion means sets a plurality of block sizes including a central pixel to be processed when determining a plurality of threshold values. [Effects of the Invention]

[0011] As explained above, the nose print acquisition and display system of the present invention has the advantage that, compared to the conventional method of transferring nose prints onto Japanese paper, it is a simple system that uses a camera-equipped terminal and can clearly acquire the nose print of individual animals for each individual identification number and easily output and display it on a registration document. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing the overall configuration of a muzzle print acquisition and display system according to the present invention; [Figure 2] (A) and (B) are the configuration diagrams of the management server and the image storage unit, [Figure 3] (A) and (B) are diagrams showing the login screen and start screen of a camera-equipped mobile phone. [Figure 4](A) and (B) are diagrams showing the procedure for taking a facial image using a camera-equipped mobile phone; [Figure 5] (A) and (B) are diagrams showing the procedure for displaying a nose image on the screen of a camera-equipped mobile phone. [Figure 6] (A) and (B) are diagrams showing the procedure for displaying a nose print image on the screen of a camera-equipped mobile phone. [Figure 7] A diagram showing a registered nose print image displayed on the screen of a camera-equipped mobile phone. [Figure 8] (A) and (B) are diagrams showing the procedure for displaying the registration document on the screen of a camera-equipped mobile phone. [Figure 9] FIG. 10 is a diagram showing a registration document in which a registered nose print image is displayed in the nose print column. BEST MODE FOR CARRYING OUT THE INVENTION

[0013] The best mode for carrying out the present invention will be described with reference to the drawings. In this embodiment, Wagyu cattle are used as an example of an animal from which a muzzle print is to be acquired. Figure 1 shows an example of the network configuration of a muzzle print acquisition and display system according to the present invention.

[0014] As shown in Figure 1, the nose print acquisition and display system S (hereinafter referred to as the present system S) of the present invention comprises a management server 10 installed in an office that can be connected to multiple camera-equipped terminals 20 and a registration server 30 via a network 40.

[0015] 2(A), the management server 10 includes a communication unit 11, a program registration unit 12, an image storage unit 13, a nose image extraction unit 14, an image return unit 15, a nose print image conversion unit 16, a nose print image registration unit 17, a nose print image embedding unit 18, and an output display unit 19. The communication unit 11 communicates data between a plurality of camera-equipped terminals 20 and the registry server 30.

[0016] Various programs executed in this embodiment are registered in the program registration unit 12. The programs executed in this embodiment include a program for cutting out a nose image from a face image of an individual cow, a program for converting the nose image into a muzzle print image, and a program for embedding the registered muzzle print image in the muzzle print column of the registration document.

[0017] Image storage unit 13 stores images sent from camera-equipped terminal 20. The stored images include facial images of individual cattle to which individual identification numbers have been assigned, i.e., facial images of individual cattle viewed from the front with the nose at the center, along with the individual identification numbers. Nose images, nose reference model images, and muzzle print images, which will be described later, are also stored.

[0018] The nose image cropping unit 14 crops out nose images from the facial images of individual cows stored in the image storage unit 13, based on a reference model image of the cow's nose. The reference image of the cow's nose is created by acquiring a large number of images of cows (especially facial images viewed from the front with the nose at the center), surrounding the nose, and having the AI ​​learn from them, thereby creating a reference model image of the cow's nose. The cropped nose image is stored in the image storage unit 13 together with the individual identification number.

[0019] Image reply unit 15 returns the cut-out nose image to the sender's camera-equipped terminal 20. The sender can check the cut-out nose image on the screen of their own camera-equipped terminal 20 and instruct management server 10 to execute threshold processing.

[0020] In response to an instruction from camera-equipped terminal 20, nose print image conversion unit 16 performs threshold processing on the nose image stored in image storage unit 13, i.e., converts it into a nose print image with different elements of gradation, brightness, and luminance using multiple (four in this embodiment) different thresholds, thereby generating multiple (four in this embodiment) different nose print images for each individual identification number. The threshold processing procedure will be described later. The multiple generated nose print images are stored in image storage unit 13 together with the individual identification number.

[0021] Image reply unit 15 returns the acquired multiple nose print images to the sender's camera-equipped terminal 20. The sender can check the four nose print images on the screen of their own camera-equipped terminal 20, select and determine the nose print image with the clearest pattern as the registered nose print image, and instruct management server 10 to register it as the registered nose print image.

[0022] In response to an instruction from the camera-equipped terminal 20 that is the sender, the nose print image registration unit 17 registers and stores in the image storage unit 13 the nose print image determined as the registered nose print image from among the four nose print images together with the individual identification number.

[0023] In response to an instruction from the camera-equipped terminal 20 that is the sender, the nose print image embedding unit 18 calls up the registry data registered for each individual identification number in the registry server 30, and embeds the corresponding registered nose print image, i.e., the registered nose print image that matches the individual identification number, in the muzzle field of the called-up registry data. The registry data with the registered nose print image embedded is registered and saved in the registry server 30 separately from the original registry data.

[0024] In response to an instruction from the camera-equipped terminal 20 that is the sender, the output display unit 19 outputs the registry data in which the registered nose print image is embedded in the muzzle print column, transmits the data to the camera-equipped terminal 20 that is the sender, and displays the registry data in which the registered nose print image is embedded in the muzzle print column on the screen of the camera-equipped terminal 20. In addition, the data can also be printed out from a printer in response to an instruction from the camera-equipped terminal 20 or an instruction from the office PC.

[0025] As shown in FIG. 2(B), the image storage unit 13 includes a face image storage unit 13A, a nose image storage unit 13B, a reference model image storage unit 13C in which a reference model of the nose is stored, a nose print image storage unit 13D, and a registered nose print image storage unit 13E, in which face images, nose images, nose print images, and registered nose print images linked to individual identification numbers are registered and stored, respectively.

[0026] The registration server 30 stores a registration R of each individual cattle for each individual identification number.

[0027] Next, a series of steps from acquiring a muzzle print image to outputting and displaying it on a registration document will be described below with reference to FIGS. 3 to 9 using the present system S configured as described above.

[0028] First, referring to Figure 3, an inspector qualified as a calf inspector (hereinafter referred to as the inspector) calls up the login screen S0 of this system S shown in Figure 3(A) on the screen of the camera-equipped terminal 20, enters the ID and password, and then selects the menu item [Muzzle Print Photograph] M1 from the start screen (menu screen) S1 shown in Figure 3(B).

[0029] Next, referring to Figure 4, when the inspector enters the individual identification number in the individual identification number field a on the next screen S2 shown in Figure 4(A) and clicks the muzzle print photograph button b, the camera is started and a facial image of the individual cow 1 (see Figure 1) corresponding to the individual identification number is taken, that is, a facial image of the individual cow 1 viewed from the front with the nose of the individual cow 1 at the center. Screen S3 in Figure 4(B) shows the photographed facial image G0 with the nose 2 of the individual cow at the center. After checking the facial image G0 displayed on screen S3, the inspector clicks the send button c and the facial image G0 is sent to the management server 10.

[0030] The inspector checks the facial image G0 displayed on screen S3, and if the photograph is not taken properly, he or she can click the retake button d on screen S3 and then click the retake button e displayed on the next screen S4 to return to the previous screen S2, press the muzzle print photograph button b to restart the camera, and take another photograph of the facial image G0 of the individual cow.

[0031] When the facial image G0 is retaken, the retaken facial image G0 can be sent to the management server 10 by clicking the send button c. The facial image G0 of the individual cow sent to the management server 10 is stored in the facial image storage unit 13A of the image storage unit 13 together with the individual identification number.

[0032] When the facial image G0 of the individual cow is stored in the image storage unit 13, the nose image cutting unit 14 of the management server 10 cuts out the nose image of the individual cow's nose 2 from the facial image of the individual cow stored in the image storage unit 13, based on the reference model image of the cow's nose. The cut-out nose image is stored in the nose image storage unit 13B of the image storage unit 13 together with the individual identification number.

[0033] Next, image reply unit 15 of management server 10 replies with the cut-out nose image to camera-equipped terminal 20, which is the sender. The returned nose image G1 is displayed on screen S5 shown in FIG. 5(B). The examiner checks whether nose image G1 has been correctly cut out from screen S5 of camera-equipped terminal 20, and determines whether or not to perform threshold processing on the displayed nose image G1.

[0034] If the examiner decides not to perform threshold processing on the nose image G1 displayed on the screen S5 of the camera-equipped terminal 20, he or she can repeat each step from photographing the face image G0 to acquiring the nose image G1 until an appropriate nose image is obtained.

[0035] Next, if the inspector determines that the nose image G1 displayed on the screen S5 of the camera-equipped terminal 20 is appropriate, he or she instructs the management server 10 to execute threshold processing by clicking the conversion button f.

[0036] When the management server 10 receives an instruction to perform threshold processing from the camera-equipped terminal 20 of the inspector, the nose print image conversion unit 16 selects the nose image G1 of the corresponding individual identification number from the nose images stored in the image storage unit 13 and performs threshold processing.

[0037] In the threshold processing, multiple (four in this embodiment) different thresholds are set for each pixel, and binarization processing is performed to generate multiple (four in this embodiment) nose print images. The threshold processing procedure is as follows.

[0038] In this embodiment, the conversion process was performed by implementing each parameter in NumPy in OpenCV (an open source computer vision library). Table 1 shows the function formulas and parameters used in threshold processing.

[0039] [Table 1]

[0040] In this embodiment, when converting a nose image into four nose print images, four types of "block size" are set: "31, 51, 71, 91." The "block sizes" of "31, 51, 71, 91" indicate that the block sizes of the surrounding pixels including the central pixel are 31 rows x 31 columns, 51 rows x 51 columns, 71 rows x 71 columns, and 91 columns x 91 columns. The types and sizes of "block sizes" can be set arbitrarily.

[0041] According to the above parameter settings, the threshold value for the central pixel is determined by calculating the average value of the central pixel and surrounding pixels, and if the central pixel value is below the threshold, the binarization process sets the central pixel value to 0, and if the central pixel value is above the threshold, the binarization process sets the central pixel value to the maximum value of 255. The following formula (Formula 1) was used to calculate the threshold value for the central pixel.

[0042]

number

[0043] Next, the nose print image conversion unit 16 determines a plurality of different thresholds for each pixel included in the nose image, performs threshold processing (binarization processing) for each of the plurality of different thresholds, and converts the image into a plurality of nose print images with different elements of one or more of color tone value, brightness, and luminance, and then the image return unit 15 returns the generated plurality of nose print images to the camera-equipped terminal 20 that sent the image.

[0044] The examiner can check on the screen the multiple nose print images sent to camera-equipped terminal 20, and select and decide on the optimum nose print image, i.e., the nose print image with the clearest pattern, as the registered nose print image. Screen S6 in Figure 6(A) shows two nose print images Gm1 and Gm2, and the next screen S7 shows two nose print images Gm3 and Gm4. The examiner can select one nose print image from the four nose print images Gm1 to Gm4 and decide on it as the registered nose print image.

[0045] When the examiner selects one nose print image (for example, nose print image Gm1) as the registered nose print image on the screen S6 of the camera-equipped terminal 20, the examiner can click the decision button g to send the nose print image Gm1 that has been decided as the registered nose print image to the management server 10.

[0046] The examiner checks a plurality of nose print images on the next screen S7 of the camera-equipped terminal 20, and if he / she is unable to select a registered nose print image, he / she can click the re-photograph button e to return to the previous screen S2 and re-take a face image.

[0047] When management server 10 receives nose print image Gm1 that has been determined to be the registered nose print image from camera-equipped terminal 20 that is the sender, nose print image registration unit 17 registers nose print image Gm1 that has been determined to be the registered nose print image in registered nose print image storage unit 13E of image storage unit 13 together with the individual identification number, and image reply unit 15 replies with the registered nose print image Grm1 to camera-equipped terminal 20. Figure 7 shows registered nose print image Gm1 displayed on screen S8.

[0048] The inspector can check the registered nose print image Grm1 on the screen S8 of the camera-equipped terminal 20. The inspector can return to the start screen S1 and select the menu item [Print registration form] M2 to display the registration form with the registered nose print image embedded on the screen of the camera-equipped terminal 20 and print it out.

[0049] When the inspector selects [Print registration form] M2 on the start screen S1 of the camera-equipped terminal 20 and clicks the print button h on the next screen S9, the management server 10 causes the muzzle print image embedding unit 18 to call up the registered muzzle print image corresponding to the input individual identification number from the image storage unit 13, and also call up the registration form corresponding to the input individual identification number from the registration form server 30, and embed the registered muzzle print image in the muzzle print column of the called registration form. Figure 9 shows a registration form R1 with the registered muzzle print image Grm1 embedded in the muzzle print column A1.

[0050] In management server 10, output display unit 19 outputs data of registration form R1 in which registered nose print image Grm1 is embedded in muzzle print field A1, and transmits the data to camera-equipped terminal 20, the sender. The inspector can display the transmitted data of registration form R1 on the screen of camera-equipped terminal 20 and print it out. Figure 8(B) shows registration form R1 displayed on screen S10 of camera-equipped terminal 20.

[0051] Compared to the conventional method of transferring nose prints onto Japanese paper, this system S uses a simple system that utilizes a camera-equipped terminal 20, allowing inspection committee members to clearly obtain the nose print of individual animals for each individual identification number and easily output and display it on the registration form.

[0052] In this embodiment, the images are converted into four types of muzzle print images, but this is not limited to four types and any number can be set. Also, although the target is individual cattle, the objects for obtaining muzzle prints are not limited to this, and all animals for which a registration document is issued for each individual identification number that has a muzzle print column are eligible.

[0053] Thus, the nose print acquisition and display system of the present invention makes it possible to provide a simple system that uses a camera-equipped terminal, allowing an inspection committee member to clearly acquire the nose print of an individual animal that has been assigned an individual identification number, embed the acquired nose print image in a registration document, and easily output and display it. [Industrial Applicability]

[0054] The nose print acquisition and display system according to the present invention can be used as a system for acquiring nose prints from individual animals and outputting and displaying registration documents in which the acquired nose print images are embedded. [Explanation of symbols]

[0055] 1 individual cow 2 Nose 10 Management Server 11 Communications Department 12 Program Registration Department 13 Image storage section 14 Nose image extraction part 15 Image reply section 16 Nose print image conversion unit 17 Nose print image registration section 18. Nose print image embedding section 19 Output display section 20 Camera-equipped devices 30 Registry Server 40 Network G0 Facial Image G1 Nose image Gm1,Gm2,Gm3,Gm4 Nose print image Grm1 registered nose print image R,R1 registration document S. Nose print acquisition and display system

Claims

1. The management server is connectable via a network to a camera-equipped terminal and a registry server that stores the registry data of individual animals for each individual identification number. the camera-equipped terminal is capable of taking a facial image of the individual animal to which an individual identification number has been assigned, focusing on the nose, and transmitting the facial image after taking the image to the management server; The management server is a nose image cutting means for cutting out a nose image from a face image of an animal individual transmitted from a camera-equipped terminal; an image returning means for returning the cut-out nose image to the camera-equipped terminal of the sender; a nose print image conversion means for threshold processing the cutout nose image using a plurality of different thresholds to convert it into a plurality of nose print images that differ in one or more elements of color tone, brightness, and luminance; a nose print image registration means for registering one nose print image selected and determined from the plurality of nose print images as a registered nose print image for each individual identification number; a nose print image embedding means for retrieving the registry data of each individual animal for each individual identification number from the registry server and embedding a corresponding registered nose print image in the muzzle field of the registry data of the retrieved individual animal; A system for acquiring and displaying a muzzle print, comprising an output display means for outputting and displaying registration data of an individual in which a registered muzzle print image is embedded in a muzzle print field.

2. In the management server, 2. The system for acquiring and displaying nose prints according to claim 1, wherein the image returning means transmits the plurality of nose print images converted by the nose print image converting means to a camera-equipped terminal, and the camera-equipped terminal selects and determines one nose print image from the plurality of nose print images displayed on the screen as a registered nose print image and transmits it to a management server.

3. In the management server, 2. The system for acquiring and displaying a muzzle pattern according to claim 1, wherein said muzzle pattern image conversion means sets a plurality of block sizes including a central pixel to be processed when determining a plurality of threshold values.

Images