Quality Determination Device and Quality Inspection Method
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- DELAVAL HLDG AB
- Filing Date
- 2023-06-21
- Publication Date
- 2026-06-25
AI Technical Summary
Conventional methods waste entire carriers of lateral flow sticks due to a single defective stick, leading to resource inefficiency and high management demands on farmers.
An apparatus and method for quality inspection of lateral flow sticks on a carrier using image processing and visual indication to identify and mark defective sticks before distribution, allowing for selective use and reducing waste.
Ensures reliable use of functional lateral flow sticks while minimizing resource waste and reducing farmer intervention, maintaining biomarker measurement reliability.
Smart Images
Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] This specification discloses an apparatus arranged to determine the quality of lateral flow sticks disposed on a carrier including a plurality of lateral flow sticks separated from each other on the carrier, the lateral flow sticks being configured to determine biomarker values of milk extracted from an animal. A corresponding method at a farm is also disclosed for inspecting the quality of the lateral flow sticks on the carrier before applying a milk sample to the lateral flow stick to determine the biomarker value of the milk extracted from the animal.
Background Art
[0002] On animal farms, it is important to keep animals healthy in order to enhance milk / meat production and / or to monitor, for example, when an animal is in heat and / or pregnant. In order to successfully fertilize an animal, it is important to fertilize the animal at the optimal time. If an animal is not successfully fertilized, milk production is affected.
[0003] For example, several biomarker measurements can be performed on animals, such as measuring the levels of progesterone, LDH (Lactate Dehydrogenase), BHB (Beta-Hydroxybutyrat), and urea. Thereby, important information regarding, for example, estrus detection and / or pregnancy of individual animals (based on the measured progesterone level) can be created, and the same applies to mastitis (based on LDH) and ketosis (based on BHB). Also, the energy balance of the animal (based on urea) can be estimated.
[0004] Thereby, important information regarding the state of each individual animal is provided to the farmer. However, for example, by applying milk samples onto prepared dry sticks, performing and analyzing biomarker measurements on all individual animals on the farm, and analyzing these samples is time-consuming for the farmer who would have to address various other important issues. Additionally, to distinguish biomarker measurements from different animals; the time to repeat biomarker measurements for each individual animal, and the time to change biomarker measurement units; high demands are placed on the management techniques for the farmer to continuously track the maintenance time of the biomarker testing device, and high demands are placed on the cleanliness to prevent biomarker measurements of one animal from being contaminated by biological substances of another animal.
[0005] For example, to periodically analyze the milk samples of an animal during or around a milking session, the milk analysis device can be arranged to cooperate with the milk extraction component device. The milk analysis device can extract the milk sample and provide it onto a lateral flow stick / dry stick / lateral flow test strip or other similar milk analysis unit. The milk can typically be diluted with a diluent before being applied to the lateral flow stick.
[0006] The lateral flow stick may be held on a carrier such as a carrier tape, for example. The carrier tape may then be held within a cassette as disclosed in International Publication No. WO 2018 / 236271 (Patent Document 1). Thereby, by advancing one lateral flow stick onto the carrier tape at a time, the lateral flow stick can be easily administered on the farm. Usually, one lateral flow stick is used for each test sample. When all the lateral flow sticks on the cassette are used, the cassette may be replaced with a new one, and the old cassette may be returned to the manufacturer for recycling purposes.
[0007] The carrier may be provided with, for example, 200 lateral flow sticks, or about 400 lateral flow sticks, in order to avoid the agricultural workers having to replace the carrier / cassette too frequently.
[0008] The problem when manufacturing the carrier and applying the lateral flow sticks thereon is that various errors can sometimes occur during the process. Individual lateral flow sticks may, for example, have adhesive bleed or discoloration, or may be attached in an unexpected way, for example, upside down and too close to the boundary of the carrier or another lateral flow stick.
[0009] These deviations can be detected immediately during manufacturing or during post - manufacturing quality inspection, but may also be detected after the carrier with the lateral flow sticks has been delivered to the user. In that case, typically, the entire carrier with all the lateral flow sticks already attached will be discarded.
[0010] Consequently, conventionally, if there is even one defective lateral flow stick on the carrier, all the fully functional lateral flow sticks on the carrier will be wasted.
[0011] It would be desirable to avoid wasting the lateral flow sticks and thereby conserve resources.
Prior Art Documents
Patent Documents
[0012]
Patent Document 1
Summary of the Invention
[0013] Accordingly, an object of the present invention is to solve at least some of the above problems and enable the use of a carrier including a plurality of lateral flow sticks even when one or some of the lateral flow sticks are found to be unfit for use in quality inspection.
[0014] According to a first aspect of the present invention, this object is achieved by an apparatus arranged to determine the quality of lateral flow sticks arranged on a carrier including a plurality of lateral flow sticks. This apparatus is typically installed at the production site where the lateral flow sticks are attached to the carrier.
[0015] The carrier has an extension in the longitudinal direction in the Y direction. The lateral flow sticks are individually arranged on the carrier and separated from each other at a distance in the Y direction. The longitudinal direction of each lateral flow stick extends substantially transversely to the Y direction of the carrier, for example, having a rotational displacement of about 45 to 90 degrees with respect to the Y direction.
[0016] The lateral flow sticks are configured to determine biomarker values of milk extracted from animals.
[0017] A biomarker, or biological marker, generally refers to a measurable indicator of some biological state or condition of an animal. The measurement of biomarker values can be associated with the pregnancy / reproduction of the animal, the health of the animal, and / or the quality of the animal's milk.
[0018] The device comprises a camera oriented to capture an image of at least one of a plurality of lateral flow sticks, which is disposed, i.e., mounted, on a carrier. The device also comprises a marker arranged to apply a visual indication indicative of the quality of the lateral flow stick on the lateral flow stick or on the carrier. Additionally, the device comprises a controller communicatively connected to the camera and the marker. The controller is configured to obtain from the camera an image of at least one lateral flow stick and a part of the carrier. The controller is also configured to perform image processing of the obtained image. Additionally, the controller is configured to determine the quality of at least one lateral flow stick based on the performed image processing. The controller is further configured to generate a command for the marker to apply a visual indication indicative of the quality of at least one lateral flow stick.
[0019] The visual indication of the marker may include, for example, an integer, a character, a geometric shape, a color, a character string, a barcode, a QR code (registered trademark), a punch hole of the carrier, etc.
[0020] The quality inspection of each individual lateral flow stick on the carrier is performed during or after manufacturing, but before distributing the carrier having the lateral flow sticks to each user's farm. If a lateral flow stick that does not meet certain predetermined criteria, such as the shape of the lateral flow stick, the width of the lateral flow stick, the color of the lateral flow stick, the position of the lateral flow stick, etc., is detected by the image processing, the lateral flow stick is marked by the visual indication.
[0021] By a visual display that marks incorrect lateral flow sticks, the carrier can be provided to the user in any way. On the user's farm, when the visual display is detected, the carrier is advanced and the marked lateral flow stick is passed to a subsequent lateral flow stick on the carrier, and a test can be performed on this.
[0022] By adding some additional lateral flow sticks to the carrier, the user corrects the defective lateral flow sticks that could not be used.
[0023] Due to the interaction between the device for detecting and marking any defective lateral flow sticks before distribution and the detection of visual instructions on the user side, quality inspection does not need to be performed on the farm, and only the step of monitoring the presence / absence of the visual display is performed. Therefore, the hardware requirements of the controller in the user facility can be significantly relaxed.
[0024] With the solution according to the present disclosure, even if there is one or some defective lateral flows on the carrier, not all lateral flows will necessarily be wasted, and resources are saved. Furthermore, the user is guaranteed to receive at least the same number of lateral flow sticks as the lateral flow sticks on the carrier that each user expects, and the reliability of the biomarker measurement values of the lateral flow sticks that have passed the manufacturer's quality inspection is guaranteed.
[0025] In a first implementation of the device according to the first aspect, the controller may be configured to perform image processing and estimate the width of at least one lateral flow stick, and the quality may be related to the estimated width of at least one lateral flow stick. Therefore, a comparison can be made between the estimated width of the lateral flow stick and the minimum reference width. A lateral flow stick whose width does not exceed the minimum reference width may be considered to have insufficient quality and may be considered unqualified for use.
[0026] If the width of the lateral flow stick is less than the minimum reference width, the lateral flow test may not be performed for several reasons. First, it may be difficult or impossible to find the lateral flow stick and / or align the needle with a very narrow lateral flow stick. Another reason may be that the amount of reactive particles on the lateral flow stick is too small to provide a reliable visual indication on the test line and / or control line of the lateral flow stick.
[0027] By disqualifying lateral flow sticks that are too narrow, i.e., have a width less than the minimum reference width, the risk of user-side failure of the lateral flow test due to such reasons is eliminated or at least reduced.
[0028] In a second implementation of the device according to the first aspect or any of its implementations, the controller may be configured to perform image processing by contour analysis of at least one lateral flow stick in the image. The controller may also be configured to determine the outer contour of at least one lateral flow stick based on the contour analysis. The controller may be further configured to compare the determined outer contour of at least one lateral flow stick with a reference contour. Quality may be associated with the difference between the determined outer contour and the reference contour of at least one lateral flow stick. Thus, a lateral flow stick having a determined outer contour that deviates from the reference contour may be considered to have insufficient quality and may be deemed unfit for use.
[0029] If the lateral flow stick has an outer contour that deviates from the reference contour due to, for example, a damaged edge, an asymmetric cut of the lateral flow stick, etc., the lateral flow test may not be successfully performed on the farm.
[0030] By disqualifying lateral flow sticks that deviate from the reference contour, the risk of failure of the lateral flow test on the user side for such reasons is eliminated or at least reduced.
[0031] In a third implementation of the device according to the first aspect or any of its implementations, the controller may be configured to detect discoloration on at least one lateral flow stick based on image processing, and the quality may be related to the color and / or discoloration of at least one lateral flow stick. A lateral flow stick having a color and / or discoloration that deviates from the reference color by more than a threshold level is considered to have insufficient quality and may be considered unfit for use.
[0032] If the lateral flow stick has a color that deviates from the expected reference color, regardless of the reason, it may be a sign of insufficient quality for obtaining good results.
[0033] By disqualifying lateral flow sticks that deviate from the expected reference color, the risk of failure of the lateral flow test on the user side for such reasons is eliminated or at least reduced.
[0034] In a fourth implementation of the device according to the first aspect or any of its implementations, the controller may be configured to determine, based on image processing, whether at least one lateral flow stick is arranged on the carrier in a predetermined arrangement method. The quality may be related to the arrangement of at least one lateral flow stick on the carrier compared to the predetermined arrangement method.
[0035] If the lateral flow stick is arranged upside down, arranged in the reverse direction, arranged on the carrier with an unexpected inclination outside the reference range, or bundled inappropriately, etc., it is highly likely that it is impossible to determine the biomarker value of the milk sample on the farm using the target lateral flow stick.
[0036] By disqualifying a lateral flow stick that deviates from the expected placement method on the carrier, the risk of failure of the lateral flow test on the user side for such reasons is eliminated or at least reduced.
[0037] In a fifth implementation of the device according to the first aspect or any of its implementations, the shape of the visual display provided by the marker, the number of visual displays, and / or the position of the visual display on the carrier or the lateral flow stick form a carrier of information regarding the determined quality of the lateral flow stick.
[0038] Thanks to the visual display provided, various information regarding the lateral flow stick can be provided to the farm device. The information provided may be, for example, an evaluation of the estimated quality of the lateral flow stick, an instruction to prohibit the use of the lateral flow stick, an instruction to advance the carrier to a subsequent lateral flow stick, an instruction to adjust the speed when advancing the carrier to a subsequent lateral flow stick, etc. (Lateral flow sticks of different quality levels may be used for different purposes).
[0039] In a sixth implementation of the device according to the first aspect or any of its implementations, the marker may be arranged to apply a visual display by making a hole in the carrier.
[0040] The advantage of providing the visual display as a hole in the carrier is that the marking becomes very easily recognizable by the user.
[0041] In a seventh implementation of the device according to the first aspect or any of its implementations, the marker may be arranged to apply a visual display at a predetermined position on the carrier.
[0042] By providing a visual display at a predetermined position on the carrier that is dedicated to one specific lateral flow stick, the quality of the targeted lateral flow stick can be easily and clearly determined on the user side / farm.
[0043] In an eighth implementation of the device according to the first aspect, or any implementation thereof, a predetermined position for visual display may be defined on the carrier proximate to or in relation to the lateral flow stick whose quality is determined.
[0044] In a ninth implementation of the device according to the first aspect, or any implementation thereof, the carrier may be arranged to be advanced in the Y direction, whereby, when image processing is performed by the controller, one lateral flow stick at a time is sequentially arranged at a position where the camera can capture an image. A predetermined position for visual display of the lateral flow stick is defined on the carrier proximate to the immediately preceding lateral flow stick of the carrier in the Y direction.
[0045] When a visual indication that can be made when taking a photo of the lateral flow stick n is detected on the user side, that visual indication is associated with the subsequent lateral flow stick n + 1. Thereby, the quality of the subsequent lateral flow stick n + 1 can be immediately determined. If the visual display of the next lateral flow stick n + 1 indicates that the target lateral flow stick is unfit for use, the carrier can be immediately advanced to the next subsequent lateral flow stick n + 2 and the procedure can be repeated there.
[0046] According to a second aspect of the present invention, this object is achieved by a method on a farm. The method aims to perform operations based on the quality of the lateral flow stick indicated by the visual display provided on the carrier and / or the lateral flow stick by means of the device according to the first aspect, or any implementation thereof, with respect to the lateral flow stick on the carrier including a plurality of lateral flow sticks.
[0047] This method includes the step of obtaining an image of part of a carrier and / or a lateral flow stick. The method also includes the step of performing image processing on the obtained image. Further, this method also includes the step of detecting a visual indication on the lateral flow stick or the carrier that indicates the quality of the lateral flow stick. This method also includes the step of performing an operation related to the lateral flow stick based on the quality of the lateral flow stick indicated by the detected visual indication.
[0048] Thanks to the visual indication that marks defective lateral flow sticks, it becomes possible to directly and clearly determine on the farm whether the lateral flow stick has the quality that enables the application of the lateral flow test in order to determine the biomarker value of the applied milk sample, without the need to perform a separate quality inspection of the lateral flow sticks on the carrier. Thus, the user is guaranteed that all lateral flow tests performed with an approved lateral flow stick, i.e., a lateral flow stick associated with a visual indication of quality indicating approval by the manufacturer, can be reliably used for biomarker measurements without the need to perform a separate quality inspection of the lateral flow stick.
[0049] In a first implementation of the method according to the second aspect, the operation performed in relation to the lateral flow stick can include applying the milk sample to the lateral flow stick when the use of the lateral flow stick for determining the biomarker value of the milk sample extracted from the animal is permitted by the detected visual indication of the lateral flow stick.
[0050] In a second implementation of the method according to the second aspect or any implementation thereof, the operation performed in relation to the lateral flow stick may include disallowing the application of the milk sample to the lateral flow stick when the use of the lateral flow stick for determining the biomarker value of the milk sample extracted from the animal is not permitted by the detected visual indication of the lateral flow stick.
[0051] In a third implementation of the method according to the second aspect or any implementation thereof, the carrier may have a longitudinal extension in the Y direction and be arranged to be advanced in the Y direction, whereby the lateral flow sticks are sequentially arranged one at a time at a position where the application of the milk sample is possible. Each of the lateral flow sticks may be separated by a minimum distance from any other lateral flow stick on the carrier and arranged individually.
[0052] When the detected visual indication of the lateral flow stick does not enable the use of the lateral flow stick to determine the biomarker value, the actions performed in relation to the lateral flow stick include advancing the carrier in the Y direction to a subsequent lateral flow stick and repeating each step of the method according to the second aspect or any implementation thereof for the subsequent lateral flow stick.
[0053] In a fourth implementation of the method according to the second aspect or any implementation thereof, the actions performed in relation to the lateral flow stick when the detected visual indication of the lateral flow stick does not enable the use of the lateral flow stick to determine the biomarker value may include adjusting the speed at which the carrier is advanced in the Y direction to a subsequent lateral flow stick.
[0054] In some cases, for example, when the lateral flow stick has a spot of adhesive thereon, or when two or more lateral flow sticks are adhered to each other on the carrier, it is desirable to advance the carrier at a reduced speed, i.e., a speed lower than a threshold limit. This avoids or at least minimizes problems associated with the advancement of the carrier.
[0055] In a fifth implementation of the method according to the second aspect or any implementation thereof, the image may be obtained from a part of the carrier that includes a predetermined position dedicated to a visual display indicating the quality of one particular lateral flow stick.
[0056] Thereby, the quality of the lateral flow stick is obtained by inspecting only a predetermined position on the dedicated part of the carrier, thereby shortening the search time for visual display. For example, the risk of misinterpreting accidental spots or discoloration on the carrier as a visual display is also fundamentally reduced.
[0057] Furthermore, an advantage of using a predetermined position on the dedicated part of the carrier to transfer the quality information of the lateral flow stick is that the absence of a visual indicator at the predetermined position can also be advantageously used as an indicator of the quality of the lateral flow stick. For example, the complete absence of a visual indicator at a predetermined position on the dedicated part of the carrier indicates high quality of the lateral flow stick.
[0058] By automatically recognizing defective lateral flow sticks according to the disclosed method, the requirement for intervention and / or manual input by agricultural workers is eliminated or at least alleviated. The costs, maintenance, and labor of agricultural workers associated with the management of lateral flow sticks for determining biomarker values of milk samples are also thereby reduced.
[0059] Other advantages and further novel features will become apparent from the following detailed description.
Brief Description of the Drawings
[0060] Here, embodiments of the present invention will be described in more detail with reference to the accompanying drawings.
Figure 1
Figure 2
Figure 3
Figure 4
[0061] Embodiments of the invention described herein are defined as apparatuses and methods in a farm and may be practiced in the embodiments described below. However, these embodiments can be exemplified and realized in many different forms and are not limited to the examples described herein. Rather, these illustrative examples of the embodiments are provided so that this disclosure will be detailed and complete.
[0062] Further objects and features may become apparent from the following detailed description when considered in conjunction with the accompanying drawings. However, it should be understood that the drawings are designed for illustrative purposes only and are not designed as a definition of the limitations of the embodiments disclosed herein, to which the appended claims will be referred. Furthermore, the drawings are not necessarily drawn to scale and are merely intended to conceptually illustrate the structures and procedures described herein, unless otherwise stated.
[0063] FIG. 1 shows a scenario having a production site apparatus 100 arranged to determine the quality of lateral flow sticks 110a, 110b, 110c disposed on a carrier 120 and to provide a visual indication either on each of the lateral flow sticks 110a, 110b, 110c or on the carrier 120 regarding the determined quality.
[0064] The device 100 is configured to capture an image of one lateral flow stick 110b on the carrier 120 at a time and includes a directed camera 130. The device 100 also includes a marker 140 arranged to apply a visual display 180 indicating the quality of the lateral flow stick 110b on the lateral flow stick 110b or on the carrier 120 associated with the lateral flow stick 110b.
[0065] The quality of the lateral flow stick 110b is determined by a controller 150 included in the device 100. The controller 150 is communicably connected to the camera 130 and the marker 140.
[0066] The controller 150 is configured to determine the quality of the lateral flow sticks 110a, 110b, 110c on the carrier 120 based on image processing of each image showing one of the lateral flow sticks 110a, 110b, 110c captured by the camera 130. The quality of the lateral flow sticks 110a, 110b, 110c in this context may be estimated on a binary scale, which may be, for example, permission / non - permission for use. Or, for example, it is estimated on a graduated scale having five levels (any non - limiting example).
[0067] The controller 150 is configured to obtain from the camera 130 images of at least one lateral flow stick 110b and a part of the carrier 120. For example, by triggering the shooting operation of the camera 130, an image of the lateral flow stick 110b is captured and provided to the controller 150.
[0068] Also, the control unit 150 is configured to perform image processing on the acquired images.
[0069] Image processing is related to the analysis of one or more predetermined important parameters of the lateral flow stick 110b, such as the width of the lateral flow stick 110b, the position of the lateral flow stick 110b on the carrier 120, the color of the lateral flow stick 110b, the outer shape of the lateral flow stick 110b, the thickness of the lateral flow stick 110b, etc. Thereby, visual error inspection of the lateral flow stick 110b is performed.
[0070] Based on the executed image processing, the quality of the lateral flow stick 110b is determined by the controller 150, for example, by comparing the determined width of the lateral flow stick 110b with the reference minimum width of the lateral flow stick and disqualifying the lateral flow sticks 110a, 110b, 110c that are too narrow.
[0071] When the quality of the lateral flow stick 110b is determined, a command is generated and sent to the marker 140 to be applied to the visual display 180 indicating the quality of the lateral flow stick 110b.
[0072] In some embodiments, the visual display 180 regarding the quality of the lateral flow stick 110b may be applied to a predetermined position 170 of the carrier 120, for example, by making a hole at the predetermined position 170 of the carrier 120.
[0073] However, the visual display 180 may include codes such as color marks, graphic shapes, characters, numbers, QR codes (registered trademarks), barcodes, Morse codes, etc.
[0074] Therefore, the shape of the visual display 180, the number of the visual displays 180, and / or the position of the visual display 180 on the carrier 120 or on the lateral flow stick 110b can form a carrier of information regarding the determined quality of the lateral flow stick 110b.
[0075] One particular visual indication 180 can mark the lateral flow sticks 110a, 110b, 110c having approved quality, and another distinct visual indication 180 can mark the lateral flow sticks 110a, 110b, 110c having unapproved quality. In some embodiments, the visual indication 180 may be performed only for the unapproved lateral flow sticks 110a, 110b, 110c, i.e., if the lateral flow sticks 110a, 110b, 110c have approved quality, the visual indication 180 may not be provided. Alternatively, it may be the reverse, i.e., only for the approved lateral flow sticks 110a, 110b, 110c.
[0076] A predetermined position 170 for the visual indication 180 may be defined on the carrier 120 proximate to the lateral flow stick 110b for which the quality is determined in some embodiments.
[0077] The carrier 120 is embodied as, for example, a carrier tape, blister, etc., and extends in the Y direction. The plurality of lateral flow sticks 110a, 110b, 110c included on the carrier 120 are separated from each other and are defined at a distance d from each other on the carrier 120. The lateral flow sticks 110a, 110b, 110c may also be defined at a minimum margin distance with respect to any lateral edges 121, 122 of the carrier 120.
[0078] The lateral flow sticks 110a, 110b, 110c are arranged on the carrier 120 such that the longitudinal direction of each lateral flow stick 110a, 110b, 110c extends substantially transversely to the Y direction. The lateral flow sticks 110a, 110b, 110c may be arranged, for example, offset by 45° to 90° from the Y direction.
[0079] Each of the lateral flow sticks 110a, 110b, 110c is configured to determine biomarker values of milk extracted from animals on a farm.
[0080] "Animal" can be any type of domesticated female mammal that produces milk, such as cows, goats, sheep, etc., which are usually raised on dairy farms.
[0081] The biomarkers determined by the lateral flow sticks 110a, 110b, 110c may, in different embodiments, be, for example, progesterone, glycoprotein, estrogen and / or gonadotropin releasing hormone, or any other similar biomarker related to the reproduction, milk production or general health of the animal.
[0082] The lateral flow sticks 110a, 110b, 110c may also be referred to as dry sticks, lateral flow test strips, milk analysis units, etc. The biomarker value of the extracted milk can indicate progesterone in the milk sample by a lateral flow test, for example, when the milk sample is applied to the lateral flow sticks 110a, 110b, 110c.
[0083] The production site device 100 may be defined at the production site where the lateral flow sticks 110a, 110b, 110c are attached to the carrier 120 before the carrier 120 having the lateral flow sticks 110a, 110b, 110c is delivered to the dairy farm.
[0084] The device 100 may also include one or several motors for advancing the carrier 120 in the Y direction, thereby enabling the camera 130 to capture images of one lateral flow stick 110a, 110b, 110c at a time for image processing purposes. Thereby, the camera 130 may be enabled to capture images of the lateral flow sticks 110a, 110b, 110c when image processing is performed by the controller 150.
[0085] The carrier 120 may be included in a cassette or a roll in some embodiments, but not necessarily.
[0086] Carrier 120 (or a cassette or roll containing carrier 120) may be removably inserted into apparatus 100 after or during attachment of lateral flow sticks 110a, 110b, 110c to carrier 120.
[0087] In some embodiments, carrier 120 may be arranged to be advanced in the Y direction, thereby enabling camera 130 to sequentially position one lateral flow stick 110b at a time in a position where an image of lateral flow stick 110b, whose quality is determined by controller 150, is captured. A predetermined position 170 for visual display 180 of lateral flow stick 110b, whose quality is to be determined, may be defined in the vicinity of the immediately preceding lateral flow stick 110a in the Y direction.
[0088] The advantage thereof is that when carrier 120 is distributed to a farm, when a camera on the farm captures an image of the immediately preceding lateral flow stick 110a in the Y direction, it is thereby known whether the next / subsequent lateral flow stick 110b on carrier 120 in the Y direction has a quality that enables a lateral flow test. The advancement speed of carrier 120 may be determined based on the quality of the next / subsequent lateral flow stick 110b.
[0089] Some examples of possible errors, i.e., deviations from the expected state of the lateral flow stick 110b that can be detected when the controller 150 performs image processing or image error checking procedures, may be, for example, detecting glue, dirt, or discoloration on the lateral flow stick 110b, detecting that the position of the lateral flow stick 110b is at least partially outside the expected position range of the lateral flow stick 110b on the carrier 120, detecting that there is no lateral flow stick 110b within the expected position range of the lateral flow stick 110b on the carrier 120, detecting that the lateral flow stick 110b is attached upside down on the carrier 120, and / or detecting that the lateral flow stick 110b is attached in the reverse direction on the carrier 120.
[0090] This enables the use of the carrier 120 on the farm even when some of the lateral flow sticks 110a, 110b, 110c are not usable.
[0091] Thereby, it is avoided that the carrier 120 / cassette including the carrier 120 becomes wasted only because one or some of the lateral flow sticks 110a, 110b, 110c on the carrier 120 are defective.
[0092] On the farm, the visual display 180 for identifying the failed lateral flow stick 110b is much easier to detect (i.e., requires fewer computational resources) than when image processing of the image lateral flow stick 110b including quality determination of at least one lateral flow stick 110b based on the performed image processing must be performed at each farm.
[0093] Since there are fewer carriers 120 / cassettes including the carrier 120 that are necessarily wasted, the supply source is saved, and the computational effort of the farm site controller is also saved.
[0094] Figure 2 shows an example of an image 200 of the lateral flow stick 110b on the carrier 120, captured by the camera 130 of the apparatus 100 as shown in Figure 1, or by a corresponding camera included in a corresponding apparatus on the farm.
[0095] The image 200 is provided to the controller 130 of the apparatus 100 for performing image processing on the obtained image 200. Thereby, the quality of at least one lateral flow stick 110b based on the performed image processing is determined by the controller 130.
[0096] The width w of the lateral flow stick 110b may be estimated during image processing in some embodiments. The quality of the lateral flow stick 110b may be related to the estimated width w of the lateral flow stick 110b. A comparison with a reference minimum width of the lateral flow stick can be made. If the lateral flow stick 110b is narrower than the reference minimum width, the lateral flow stick 110b may be considered non - compliant.
[0097] An example of a predetermined position 170 for a visual display 180 indicating the determined quality of the lateral flow stick 110b is also shown in the image 200.
[0098] Figure 3 shows an apparatus 300 on the farm. The milk of the animal 301 may be extracted and discharged by a milking device, which is part of a milking parlor, via a milk line to a milk tank or a similar milk storage unit.
[0099] A milk sample of the animal 301 may be extracted during a milking session and provided to the tube element 325 via the valve 340, and the tube element is configured to receive the milk sample of the animal 301 and provide the milk sample to the needle 320.
[0100] Device 300 includes various electronic devices and instruments such as camera 330, one or more pumps, tube element 325, needle 320, controller 350, and optionally light source 360. Device 300 may also include a motor or other similar device for advancing carrier 120 in the Y direction.
[0101] The intention is to provide a milk sample to lateral flow stick 110b on carrier 120 via needle 320.
[0102] However, first, a method is executed to determine whether the quality of lateral flow stick 110b enables the application of the milk sample.
[0103] Method 400 is shown in FIG. 4. Method 400 may be executed by controller 350 of device 300 at a farm. Method 400 is aimed at performing operations regarding lateral flow stick 110b on carrier 120 including a plurality of lateral flow sticks 110a, 110b, 110c. Carrier 120 may have a longitudinal extension in the Y direction and may be arranged to be advanced in the Y direction, thereby sequentially arranging one of the lateral flow sticks 110a, 110b, 110c at a position where the application of the milk sample is enabled.
[0104] Each of lateral flow sticks 110a, 110b, 110c is individually arranged separated by a minimum distance from any other lateral flow stick 110a, 110b, 110c on carrier 120.
[0105] The operations to be performed are based on the quality of the lateral flow stick 110b as indicated by the visual display 180 provided to carrier 120 and / or lateral flow stick 110b by the aforementioned device 100 shown in FIG. 1.
[0106] The visual representation 180 is, for example, an integer, a character, a geometric shape, a color, a character string, a hole in the carrier 120 and / or the lateral flow sticks 110a, 110b, 110c, a barcode, a QR code (registered trademark), or other visual markers such as encoding, and can carry information regarding the quality of the associated lateral flow sticks 110a, 110b, 110c.
[0107] The method 400 includes a step 401 of obtaining an image 200 of a part of the carrier 120 and / or the lateral flow stick 110b. The image 200 may be captured by the camera 330 of the device 300 and may be triggered by the controller 350 of the device 300.
[0108] The image 200 may be obtained from a part of the carrier 120 that includes a predetermined position 170 dedicated to the visual representation 180 indicating the quality of one specific lateral flow stick 110b (401).
[0109] The method 400 also includes a step 402 of performing image processing on the obtained image 200.
[0110] Image processing or computer vision is a technical field that includes methodologies for obtaining, processing, analyzing, and understanding images and generally high-dimensional data from the real world in order to generate numerical information or symbolic information.
[0111] In this case, computer vision includes searching for the visual representation 180 on the lateral flow stick 110b or the carrier 120 that indicates the quality of the lateral flow stick 110b.
[0112] The method 400 also includes a step 403 of detecting the visual representation 180 on the lateral flow stick 110b or the carrier 120. When the visual representation 180 is detected, it may be decoded by the controller 350, thereby enabling the determination of the quality of the lateral flow stick 110b, for example, determining whether a milk sample can be applied to the lateral flow stick 110b.
[0113] In addition, method 400 includes a step (404) of performing an operation regarding the lateral flow stick 110b based on the quality of the lateral flow stick 110b indicated by the detected 403 visual display 180.
[0114] The operation performed in relation to the lateral flow stick 110b may include applying the milk sample to the lateral flow stick 110b when the use of the lateral flow stick 110b for determining the biomarker value of the milk sample extracted from the animal 301 is permitted by the detected 403 visual display 180 of the lateral flow stick 110b.
[0115] Additionally or alternatively, the operation performed in relation to the lateral flow stick 110b may include prohibiting the application of the milk sample to the lateral flow stick 110b when the use of the lateral flow stick 110b for determining the biomarker value of the milk sample extracted from the animal 301 is not permitted by the detected 403 visual display 180 of the lateral flow stick 110b.
[0116] The operation performed in relation to the lateral flow stick 110b may, in some embodiments, include advancing the carrier 120 in the Y direction to a subsequent lateral flow stick 110c on the carrier 120 and repeating the above steps 401 - 404 for the subsequent lateral flow stick 110c when the use of the lateral flow stick 110b for determining the biomarker value is not permitted by the detected 403 visual display 180 of the lateral flow stick 110b.
[0117] If the detected visual indication 180 of the lateral flow stick 110b does not permit the use of the lateral flow stick 110b to determine biomarker values, the actions performed with respect to the lateral flow stick 110b may alternatively include adjusting the speed when advancing the carrier 120 in the Y direction to a subsequent lateral flow stick 110c.
[0118] In different embodiments, the measured biomarker can be, for example, progesterone, glycoprotein, estrogen and / or gonadotropin releasing hormone, or any other similar biomarker associated with the reproduction or health of the animal 301. However, the biomarker to be measured can include, in some embodiments, LDH (lactate dehydrogenase), BHB (beta-hydroxybutyric acid), and / or urea. Or other biomarkers associated with the state of the animal 301. In some embodiments, multiple biomarkers listed above can be measured.
[0119] The lateral flow sticks 110a, 110b, 110c can be arranged to indicate biomarkers in the milk sample of the animal 301 when a lateral flow test is performed. The lateral flow sticks 110a, 110b, 110c can comprise a sample pad to which a milk sample can be applied. The lateral flow sticks 110a, 110b, 110c may also include a conjugate pad containing a conjugate that is dispersed in the milk sample as the milk sample flows from the sample pad through the conjugate pad. The lateral flow sticks 110a, 110b, 110c can further include a porous membrane that receives the capillary flow of the milk sample from the conjugate pad, thereby advancing the conjugate dispersed in the milk sample to the test line and the control line. The test line is prepared to change color when exposed to milk containing the biomarker, while the control line is prepared to change color when exposed to the milk sample, regardless of the presence of the biomarker in the milk sample.
[0120] As shown in the accompanying drawings, the terms used in the description of the embodiments are not intended to limit the apparatus 100 and / or method 400 being described. Various changes, substitutions and / or modifications can be made without departing from the embodiments of the invention, as defined by the appended claims.
[0121] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. The term "or" as used herein must be construed as the mathematical OR, i.e., the inclusive disjunction, and not as the mathematical exclusive OR (XOR), unless otherwise specified. Additionally, the singular forms "a", "an", and "the" should be construed as "at least one" unless otherwise specified, and thus may in some cases include multiple entities of the same type. The terms "includes", "comprises", "including", and / or "comprising" specify the presence of the stated features, operations, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, operations, integers, steps, operations, elements, components, and / or groups thereof. For example, a single unit, such as a processor, may perform the functions of several items recited in the claims. The fact that certain measures or features are recited in mutually different dependent claims, illustrated in different figures, or considered in relation to different embodiments, does not indicate that combinations of these measures or features cannot be used advantageously. A computer program may be stored / distributed on a suitable medium, such as an optical storage medium or a solid state medium, provided together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless communication systems.
Claims
1. An apparatus (100) arranged to determine the quality of lateral flow sticks (110a, 110b, 110c) placed on a carrier (120) having a longitudinal extension in the Y direction, wherein the carrier (120) includes a plurality of lateral flow sticks (110a, 110b, 110c) on the carrier (120) that are separated from each other by a distance (d) in the Y direction, the longitudinal direction of each lateral flow stick (110a, 110b, 110c) extends substantially laterally with respect to the Y direction, the lateral flow sticks (110a, 110b, 110c) are configured to determine the biomarker value of milk extracted from an animal (301), and the apparatus (100) is configured A camera (130) positioned on the carrier (120) and then oriented to capture an image (200) of at least one of the plurality of lateral flow sticks (110a, 110b, 110c), the camera (130) being positioned to capture an image (200) of the lateral flow stick (110b), A marker (140) is positioned on the lateral flow stick (110b) or on the carrier (120) to apply a visual indication (180) of the quality of the lateral flow stick (110b), A controller (150) is communicably connected to the camera (130) and the marker (140), wherein the controller (150) The camera (130) is used to acquire an image (200) of at least one lateral flow stick (110b) and a portion of the carrier (120), The acquired image (200) is subjected to image processing, Based on the image processing performed, the quality of the at least one lateral flow stick (110b) is determined, Apparatus (100) comprising: a controller (150) configured to generate a command to apply the visual indicator (180) indicating the quality of the at least one lateral flow stick (110b) to the marker.
2. The apparatus (100) according to claim 1, wherein the controller (150) is configured to perform the image processing and estimate the width (w) of the at least one lateral flow stick (110b), and the quality is related to the estimated width (w) of the at least one lateral flow stick (110b).
3. The controller (150) performs the image processing by contour analysis of the at least one lateral flow stick (110b) in the image (200), Based on the contour analysis, the outer contour of the at least one lateral flow stick (110b) is determined, The apparatus (100) according to claim 1 or 2, configured to compare the determined outer contour of the at least one lateral flow stick (110b) with a reference contour, wherein the quality is related to the difference between the determined outer contour of the at least one lateral flow stick (110b) and the reference contour.
4. The controller (150) performs the following actions based on the image processing: The apparatus (100) according to claim 1 or 2, configured to detect discoloration on the at least one lateral flow stick (110b), wherein the quality is related to the color and / or discoloration of the at least one lateral flow stick (110b).
5. The controller (150) performs the following actions based on the image processing: The apparatus (100) according to claim 1 or 2, configured to determine whether the at least one lateral flow stick (110b) is arranged on the carrier (120) in a predetermined arrangement manner, wherein the quality is related to the arrangement of the at least one lateral flow stick (110b) on the carrier (120) compared to the predetermined arrangement manner.
6. The apparatus (100) according to claim 1 or 2, wherein the shape of the visual indicators (180), the number of the visual indicators (180), and / or the position of the visual indicators (180) on the carrier (120) or the lateral flow stick (110b) forms a carrier for the determined quality information of the lateral flow stick (110b).
7. The apparatus (100) according to claim 1 or 2, wherein the marker (140) is arranged to apply the visual indication (180) by making a hole in the carrier (120).
8. The apparatus (100) according to claim 1 or 2, wherein the marker (140) is arranged to apply the visual display (180) to a predetermined position (170) on the carrier (120).
9. The apparatus (100) according to claim 8, wherein the predetermined position (170) for the visual display (180) is located on the carrier (120) in close proximity to the lateral flow stick (110b) on which the quality is determined.
10. The apparatus (100) according to claim 8, wherein the carrier (120) is positioned to be advanced in the Y direction, thereby sequentially positioning one lateral flow stick at a time in a position that enables the camera (130) to capture the image (200), and the predetermined position (170) for the visual display (180) of the lateral flow stick (110b) whose quality is determined is set to be close to the lateral flow stick (110a) immediately preceding it in the Y direction.
11. A farm method (400) for performing an operation relating to a lateral flow stick (110b) on a carrier (120) including a plurality of lateral flow sticks (110a, 110b, 110c), based on the quality of the lateral flow stick (110b) as indicated by a visual indicator (180) provided to the carrier (120) and / or the lateral flow stick (110b) by the apparatus (100) according to claim 1 or 2, wherein the method (400) is: Step (401) of acquiring an image (200) of a portion of the carrier (120) and / or the lateral flow stick (110b), The steps include: (401) performing image processing on the acquired image (200) (402), Step (403) of detecting the visual indication (180) on the lateral flow stick (110b) or the carrier (120) that indicates the quality of the lateral flow stick (110b), A method (400) comprising the step (404) of performing an action related to the lateral flow stick (110b) based on the quality of the lateral flow stick (110b) indicated by the visual display (180) detected (403).
12. The method of claim 11 (400), wherein the operation performed in connection with the lateral flow stick (110b) includes applying the milk sample to the lateral flow stick (110b) when the detected (403) visual indication (180) of the lateral flow stick (110b) permits the use of the lateral flow stick (110b) to determine the biomarker value of the milk sample of milk extracted from an animal (301).
13. The method according to claim 11 (400), wherein the operation performed in connection with the lateral flow stick (110b) includes prohibiting the application of the milk sample to the lateral flow stick (110b) if the detected (403) visual indication (180) of the lateral flow stick (110b) does not permit the use of the lateral flow stick (110b) to determine the biomarker value of the milk sample extracted from an animal (301).
14. The carrier (120) has a longitudinal extension in the Y direction and is positioned to be advanced in the Y direction, thereby sequentially positioning one lateral flow stick (110a, 110b, 110c) at a time at the position where the milk sample can be applied, each of the lateral flow sticks (110a, 110b, 110c) is positioned individually separated by the minimum distance from any other lateral flow sticks (110a, 110b, 110c) on the carrier (120), and the operation performed with respect to the lateral flow stick (110b) is not permitted to use the lateral flow stick (110b) for determining the biomarker value by the detected (403) visual indication (180) of the lateral flow stick (110b), The method according to claim 13 (400), comprising the step of advancing the carrier (120) in the Y direction toward the subsequent lateral flow stick (110c), and repeating steps (401) to (404) toward the subsequent lateral flow stick (110c).
15. If the visual indication (180) detected (403) of the lateral flow stick (110b) does not permit the use of the lateral flow stick (110b) to determine the biomarker value, the action performed with respect to the lateral flow stick (110b) is: The method according to claim 14 (400), comprising the step of adjusting the speed at which the carrier (120) is advanced in the Y direction toward the subsequent lateral flow stick (110c).
16. The method (400) of claim 11, wherein the image (200) is obtained from a portion of the carrier (120) (401), which includes a predetermined position (170) dedicated to the visual indication (180) showing the quality of one particular lateral flow stick (110b).