Camera rotating mechanism, photoelectric microfluidic device and camera automatic calibration method

By designing a camera rotation mechanism and image processing algorithm, the imaging angle of the camera in the optoelectronic microfluidic device is automatically identified and adjusted, solving the problem of image tilt in the optoelectronic microfluidic device, realizing efficient and accurate automatic calibration, and improving imaging quality and data processing accuracy.

CN121397342APending Publication Date: 2026-01-23ZHUIGUANG BIOTECHNOLOGY (SHENZHEN) CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202511308479.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-09-15
Publication Date
2026-01-23

AI Technical Summary

Technical Problem

In existing technologies, during the installation or use of optoelectronic microfluidic devices, the angular offset between the camera and the chip causes image tilting, affecting the accuracy and efficiency of image processing and data analysis. Traditional manual calibration is inefficient and inaccurate, while software calibration cannot achieve real-time high-precision calibration.

Method used

Design a camera rotation mechanism that combines high-precision motor drive and image processing algorithm to automatically identify reference points, calculate and adjust the camera imaging angle, and achieve automated high-precision calibration of the camera and chip.

Benefits of technology

It ensures that the image of the optoelectronic microfluidic chip is always horizontal and without offset, improves imaging quality and data processing accuracy, simplifies operation, lowers the technical threshold, is suitable for batch processing scenarios, and is low in cost and easy to integrate.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121397342A_ABST
    Figure CN121397342A_ABST
Patent Text Reader

Abstract

The invention discloses a camera rotating mechanism for a photoelectric micro-fluidic device, an automatic calibration method and the photoelectric micro-fluidic device. The camera rotating mechanism comprises a camera, a rotating mechanism, a driving unit and a control module, the control module is integrated with an image processing algorithm, and the imaging angle of the camera is calibrated by calculating the deviation angle of a micro-fluidic chip and controlling the driving unit and the rotating mechanism to accurately rotate. The invention also discloses an automatic calibration method for the camera, and the automatic calibration of the imaging angle of the camera is realized through image acquisition, offset calculation and angle adjustment. According to the invention, the problems that the calibration of the imaging angle of the camera in the photoelectric microfluidic device depends on manual operation and the efficiency is low are solved, automatic and high-precision image calibration is realized, and the automation level of the device and the accuracy of data processing are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the fields of microfluidics and optical imaging technology, specifically relating to a camera rotation mechanism and an optoelectronic microfluidic imaging device and camera calibration method that achieves automatic camera angle calibration through motor drive. Background Technology

[0002] In the application of optoelectronic microfluidic devices, accurately capturing high-quality images of the internal flow channels of the microfluidic chip is crucial. However, in practice, minute deviations during the installation or use of the microfluidic chip can cause an angular offset between the flow channel image and the camera's photosensitive surface. This offset results in an unevenly oriented image, severely impacting subsequent image processing, data analysis, and quantitative measurements, such as cell counting, particle analysis, and image stitching.

[0003] Traditional solutions typically rely on manually adjusting the position of the camera or chip, which is inefficient, difficult to guarantee accuracy, and cannot achieve real-time, automated calibration.

[0004] Several technologies in this field attempt to address similar problems. For example, Hong Kong Patent Application No. HK40044348A (Patent Title: Automatic Detection and Characterization of Micro-objects in Microfluidic Devices) proposes an image processing method that performs geometric correction on an image using a predefined calibration procedure or algorithm. This method may involve identifying specific calibration markers in the image and calculating and correcting geometric distortions or tilts of the image based on the positional information of these markers.

[0005] However, these methods are typically purely software-based corrections, which have limitations: Limited accuracy: Software correction relies on the precision of the algorithm and the sharpness of the calibration markers; for large-angle tilts or complex distortions, the correction effect may be unsatisfactory. Poor real-time performance: Software correction consumes computational resources, and in scenarios with large batches or high-speed data streams, it may not be able to achieve real-time, latency-free processing. Moreover, software correction only repairs the tilted image and does not fundamentally eliminate the physical root cause of the tilt, namely the angular deviation between the camera and the chip.

[0006] Therefore, developing a mechanism that can automatically and accurately calibrate the camera's imaging angle at a physical level to ensure the acquisition of horizontal, offset-free original images has become a pressing technical problem in this field. Summary of the Invention

[0007] The present invention aims to provide a camera rotation mechanism and an optoelectronic microfluidic device including the same, so as to solve the technical problems of low efficiency and poor accuracy of manual calibration in the prior art, and realize automated and high-precision calibration of camera imaging angle.

[0008] This application provides a camera rotation mechanism, including:

[0009] Camera, used to acquire images of optoelectronic microfluidic chips;

[0010] A rotating mechanism is fixedly connected to the camera and driven by the drive unit to adjust the imaging angle of the camera;

[0011] and a drive unit for driving the rotating mechanism.

[0012] Furthermore, the rotating mechanism also includes a reflective assembly and a light guide tube, wherein the reflective assembly includes a reflective element.

[0013] Preferably, the camera rotation mechanism further includes a control module, which is used to acquire an image of the photoelectric microfluidic chip from the camera;

[0014] Based on the preset reference point information in the image, the offset angle of the photoelectric microfluidic chip is calculated using a preset algorithm;

[0015] Furthermore, based on the offset angle, the drive unit and the rotating mechanism are controlled to rotate precisely, thereby calibrating the imaging angle of the camera.

[0016] Furthermore, the control unit integrates an image processing algorithm, which is used to identify preset reference points in the image and calculate the angle difference between the reference points and the ideal horizontal line.

[0017] Furthermore, the rotating mechanism includes a coupling and a rotating bracket. One end of the coupling is fixedly connected to the output shaft of the motor, and the other end is connected to one end of the rotating bracket. The other end of the rotating bracket is detachably connected to the camera.

[0018] This application provides an automatic camera calibration method for an optoelectronic microfluidic device, including the following steps:

[0019] Image acquisition: Use a camera to capture raw images of the optoelectronic microfluidic chip;

[0020] Angle adjustment: Based on the original image information, the control unit sends a control command to the motor to drive the camera to rotate, so that the original image is in a horizontal state.

[0021] This application also provides another method for automatic camera calibration in optoelectronic microfluidic devices, including the following steps:

[0022] Image acquisition: Use a camera to capture raw images of the optoelectronic microfluidic chip;

[0023] Offset Calculation: The original image is analyzed using an image processing algorithm to identify a preset reference point in the image, and the angle difference between the reference point and the ideal horizontal line is calculated to obtain the actual offset angle of the chip; and

[0024] Angle adjustment: Based on the offset angle, the control unit sends a control command to the motor to drive the camera to rotate in the opposite direction, so that the imaging angle of the camera is equal to the offset angle.

[0025] Furthermore, after the angle adjustment step, the method repeats the image acquisition and angle adjustment steps until the original image is completely horizontal.

[0026] Preferably, the offset calculation is based on one or more preset reference points on the photoelectric microfluidic chip.

[0027] This application also provides an optoelectronic microfluidic device, including:

[0028] The aforementioned camera rotation mechanism; and

[0029] The optoelectronic microfluidic chip assembly and the fluorescence microscope assembly are provided. The optoelectronic microfluidic chip assembly is disposed below the fluorescence microscope assembly, and the camera rotation mechanism is disposed above the fluorescence microscope assembly. The fluorescence microscope assembly further includes a light source emitting assembly, a filter, and a microscope objective.

[0030] Compared with the prior art, the technical solution disclosed in this invention has the following beneficial effects:

[0031] 1. Improve imaging quality: Ensure that the acquired images of the optoelectronic microfluidic chip are always horizontal and without tilt or offset, providing high-quality raw data for subsequent image processing and analysis.

[0032] 2. Achieve automation and high efficiency: Automating the tedious manual calibration process greatly improves operational efficiency and shortens preparation time, making it particularly suitable for scenarios requiring batch or continuous processing.

[0033] 3. Improve data processing accuracy: Horizontal images greatly improve the accuracy of image processing algorithms, thereby improving the reliability of overall experimental data.

[0034] 4. Simplified operation: Users do not need to perform tedious manual calibration, which lowers the technical threshold and improves the user experience.

[0035] 5. Low cost and easy integration: Compared to existing products, this mechanism is low in cost and easy to integrate into existing or future optoelectronic microfluidic devices, exhibiting good versatility and practicality. 6. Ultra-high control precision and reliability: The motor, rotating mechanism, and artificial intelligence algorithms provide extremely high angle / displacement control precision for the motion control system. Attached Figure Description

[0036] Exemplary embodiments of the present invention can be more fully understood by referring to the accompanying drawings. The drawings are provided to further illustrate the embodiments of this application and form part of the specification. They are used together with the embodiments of this application to explain the present invention and do not constitute a limitation thereof. In the drawings, the same reference numerals generally represent the same components or steps.

[0037] Figure 1 This is a schematic diagram of the camera rotation mechanism provided according to an exemplary embodiment 1 of this application.

[0038] Figure 2 This is a partially enlarged schematic diagram of the camera rotation mechanism with respect to the rotation bracket provided in an exemplary embodiment 1 of this application.

[0039] Figure 3 This is a flowchart illustrating an automatic camera calibration method for an optoelectronic microfluidic device according to Exemplary Example 2 of this application.

[0040] Figure 4 This is a flowchart illustrating an automatic camera calibration method for an optoelectronic microfluidic device according to Exemplary Example 3 of this application.

[0041] Figure 5 This is a schematic diagram of a photoelectric microfluidic device structure provided according to Exemplary Example 4 of this application.

[0042] Figure Labels

[0043] 1. Support base; 2. Drive unit; 3. Rotation mechanism; 31. L-shaped bracket; 32. Limiting component; 4. Camera; 5. Light guide tube; 6. Reflection assembly; 7. Reflection element; 8. Coupling; 9. Rotation bracket; 10. Support structure. Detailed Implementation

[0044] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0045] In the description of this invention, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are used only for the convenience of describing the invention and for simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0046] In the description of this invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention based on the specific circumstances.

[0047] Furthermore, the technical features involved in the different embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0048] Example 1:

[0049] This invention provides a camera rotation mechanism for an optoelectronic microfluidic device. Its design aims to overcome the limitations of software correction, which only repairs tilted images without fundamentally eliminating the physical cause of the tilt—the angular deviation between the camera and the chip. This allows for automated, high-precision adjustment of the camera's imaging angle. The following will combine... Figure 1 The document provides a detailed explanation of the organization's core components and how they work together.

[0050] The rotating mechanism of this camera mainly consists of the following components:

[0051] Drive unit (2): This is the core that provides rotational power to the entire mechanism. A high-precision stepper motor or servo motor is typically used. Stepper motors are commonly used due to their precise step angles (e.g., 1.8° or 0.9°) and lower cost, while servo motors offer higher dynamic response and control precision, especially in scenarios requiring rapid, real-time calibration. The drive motor (2) is mounted on a support base (1), which serves as the mounting foundation for the entire mechanism and is typically the internal frame of the optoelectronic microfluidic device or a separate support plate. In some embodiments, the drive motor (2) further enhances torque and control resolution through a reducer (not shown in the figure).

[0052] The rotating mechanism (3) includes a coupling (8), a rotating bracket (9), and a support structure (10). The coupling (8) serves as the connecting component between the drive unit (1) and the rotating bracket (9), and its function is to transmit torque and compensate for radial, angular, and axial deviations that may exist during assembly. In some embodiments, the coupling (8) is selected as an elastic coupling (such as a plum blossom coupling) or a rigid coupling, depending on the requirements for transmission accuracy and deviation compensation. One end of the coupling (8) is fixedly connected to the output shaft of the drive unit (2), and the other end is connected to one end of the rotating bracket (9). The rotating bracket (9) is a key mechanical load-bearing structure. The rotating bracket (9) consists of an L-shaped bracket (31) and a limiting component (32) for defining the position of the camera (4). The rotating bracket (9) can be made of materials such as aluminum alloy, stainless steel, or high-strength engineering plastics to ensure its rigidity and lightweight, and reduce inertia.

[0053] The support structure (10) is directly fixed to the support base (1). Its design must have sufficient rigidity and stability to firmly support all subsequent rotating parts. The support structure (10) can be made of high-strength aluminum alloy or stainless steel and is connected to the support base (1) by screws or welding.

[0054] The camera (4) is the core component used to acquire images of the optoelectronic microfluidic chip. It is typically an industrial-grade high-resolution camera with a high frame rate, global shutter, and compatibility with multiple communication interfaces, such as a CMOS or CCD sensor camera, to ensure that the captured images of the optoelectronic microfluidic chip are clear and rich in detail. The camera (4) is fixedly mounted on a rotating bracket (9) and can rotate synchronously with the rotating mechanism (3). The lens of the camera (4) can be selected with different magnifications and depths of field depending on the specific application scenario.

[0055] The light guide tube (5) is positioned between the camera (4) and the reflector (6) to provide a stable optical path and prevent stray light interference. It is usually made of a metal or plastic tube coated with an anti-reflective material to absorb reflected light.

[0056] Reflective component (6): Contains reflective elements (7), typically a highly reflective plane mirror or prism. Its function is to alter the optical path, enabling the camera (4) to image from a position not perpendicular to the optoelectronic microfluidic chip. This is crucial for optimizing spatial layout in compact devices.

[0057] The control unit (not shown in the figure) integrates a microprocessor (MCU) or a more powerful processor and embeds image processing and motor control algorithms. The control unit is connected to the camera (4) and the drive unit (2) via a data cable or wirelessly. It receives digital image signals from the camera (4), processes them using algorithms, and outputs PWM (pulse width modulation) signals or other forms of electrical signals based on the calculation results to precisely control the rotation direction and angle of the motor (2).

[0058] The entire camera rotation structure works on a closed-loop feedback control process, which can be divided into the following steps:

[0059] Initial image acquisition: At the start of calibration, the camera (4) receives the light signal from the fluorescence microscopy component (7) through the light guide (5) and the reflective component (6) and takes a raw image of the optoelectronic microfluidic chip. This image may be tilted due to mechanical assembly deviations.

[0060] Image analysis and offset calculation: The acquired images are transmitted in real time to the control module (not shown), which is usually a circuit board with a built-in processor (such as an FPGA or microcontroller).

[0061] The control module runs an image processing algorithm. This algorithm first preprocesses the image (such as grayscale conversion and threshold segmentation), and then identifies preset reference points in the image through methods such as edge detection or template matching.

[0062] The algorithm then uses precise mathematical models, such as the Hough Transform or least squares method, to fit the data and calculate the angle between the straight line formed by these reference points and the ideal horizontal line, thus obtaining the chip's actual offset angle. The accuracy of this angle calculation is crucial to the entire calibration process and typically needs to reach 0.01° or higher.

[0063] Precise rotation execution: Based on the calculated offset angle, the control module sends a high-precision control command to the drive unit (1) through a PID control algorithm or direct command. For example, if a stepper motor is used, the control module will calculate the number of rotation steps required (number of steps = motor step angle offset angle); if a servo motor is used, it will send a precise angular position signal.

[0064] After receiving the command, the drive unit (1) drives the coupling (2) and the rotating bracket (3) to rotate so that the imaging angle of the camera (4) is equal to the actual offset angle of the chip, thereby achieving calibration.

[0065] Closed-loop verification and optimization:

[0066] After completing one rotation, the system will automatically take another image and recalculate the offset.

[0067] If the calculated new offset angle is less than the preset tolerance threshold (e.g., 0.05°), the calibration is complete.

[0068] If the value still exceeds the threshold, the system will make fine adjustments and repeat the angle adjustment process. This closed-loop feedback mechanism ensures the final accuracy of the calibration and can adapt to minor changes under different operating conditions.

[0069] This embodiment constructs a highly automated and high-precision camera imaging angle calibration system through the close integration of mechanical structure, precision drive unit and intelligent algorithm. Its fully disclosed technical details ensure the feasibility of the present invention.

[0070] Example 2:

[0071] refer to Figure 3 This embodiment details an automatic camera calibration method for optoelectronic microfluidic devices. The method employs an interactive iterative calibration process, whereby the operator observes and judges the original image information, and the system then performs corresponding adjustments until the image is horizontal. To improve the accuracy of human judgment, the method also integrates an image magnification function.

[0072] This method includes the following steps:

[0073] S1: Image Acquisition:

[0074] First, the operator uses a camera to take a raw image of the photoelectric microfluidic chip, which is then displayed in real time on a monitor or screen for the operator to observe.

[0075] In some embodiments, the control unit provides an image magnification function to facilitate the operator's accurate judgment of the image's tilt. The operator can choose to magnify the image partially or entirely as needed. The magnified image can more clearly present the edges of the optoelectronic microfluidic chip, preset channels, or specific reference points, allowing the human eye to more accurately determine whether these features are aligned with the horizontal line of the screen.

[0076] S2: Angle Adjustment:

[0077] The operator visually observes the magnified image to determine if there is any tilt and the direction of the tilt. Based on this visual assessment, the operator sends control commands to the drive unit via a control unit (e.g., a software interface, control panel, or joystick). These commands are qualitative and directional, such as "fine-tune clockwise," "rotate counter-clockwise by a small angle," or "stop." Upon receiving the commands, the drive unit (e.g., a stepper motor or servo motor) drives the camera to make the corresponding rotational adjustments via a rotating mechanism.

[0078] S3: Closed-loop iterative calibration:

[0079] After the camera completes a slight rotation, the system will automatically execute the "image acquisition" step again, capturing and updating the image on the screen. The operator then observes the new image (the zoom function can still be used) and determines whether its level is satisfactory. If the image is still tilted, the operator will repeat the "angle adjustment" step, sending a new adjustment command to drive the camera to rotate again.

[0080] This closed-loop cycle of "observation-judgment-execution-re-observation" will continue until the operator believes that the key features in the image are perfectly aligned with the ideal horizontal line, at which point the calibration process ends.

[0081] The core of this method lies in its human-machine collaborative calibration mode. By integrating image magnification, this approach leverages the intuitive judgment of the human eye while enhancing the accuracy of that judgment, and utilizes the precision of motor control, making the calibration process more intuitive and efficient. It is particularly suitable for specific application scenarios that require extremely high calibration accuracy and necessitate final confirmation by the human eye.

[0082] Example 3:

[0083] This embodiment is basically the same as embodiment 2 in terms of logic and principle. The difference is that this method is a fully automated calibration scheme. Its core is to accurately calculate the offset angle and calibrate accordingly to ensure that the image reaches a high level.

[0084] refer to Figure 4 This method includes the following steps:

[0085] S1: Image Acquisition:

[0086] First, a camera is used to capture a raw image of the optoelectronic microfluidic chip. The camera is fixedly connected to a rotating mechanism, which is driven by a drive unit (such as a stepper motor or servo motor). The resulting raw image is then transmitted to the control module for further processing.

[0087] S2: Offset Calculation:

[0088] The image is transmitted to the control module, which integrates an image processing algorithm that automatically identifies preset reference points in the image. These reference points can be pre-designed geometric features on the optoelectronic microfluidic chip, such as: specific markers (e.g., cross or circular markers at chip corners); chip edges (straight edges of the chip); and flow channel structures (main flow channels within the chip). The algorithm calculates the angle difference between the reference points (or the straight lines formed by the reference points) and an ideal horizontal line to obtain the actual offset angle of the chip. The ideal horizontal line is typically a preset reference line aligned with the device's coordinate system. This calculation can utilize various image processing techniques, such as the Hough Transform: First, the original image is preprocessed, such as by grayscale conversion and Gaussian filtering to remove noise. Then, the Canny edge detection algorithm or a similar algorithm is used to extract all possible edges in the image. Finally, the Hough Transform is applied to the edge image to detect straight lines. This algorithm maps points in image space to curves in parameter space, thus finding the most prominent straight line in the image. The Hough transform provides the parameters of the straight line, including its angle with the horizontal. The algorithm then selects the line representing the chip's baseline from the detected lines and precisely calculates its angle θ. This angle θ is the chip's actual offset angle. Least squares fitting: By pre-setting specific geometric markers (such as cross-shaped or L-shaped markers) on the optoelectronic microfluidic chip, a matching algorithm is used to accurately identify and locate these reference points. The algorithm searches the image for the region most similar to the pre-set template and returns its center coordinates. Once multiple reference points are identified, a straight line can be fitted using these coordinates. Least squares is a commonly used fitting method that finds a "best-fit" line that minimizes the sum of the squared distances from all reference points to that line. Then, based on the equation of the fitted line: y = mx + b, its slope m can be used to calculate the angle θ = arctan(m). This angle θ is the chip's actual offset angle.

[0089] S3: Angle Adjustment:

[0090] Based on the calculated offset angle, the control module precisely calculates the required rotation angle, typically the reverse value of the offset angle. The control module sends high-precision control commands to the motor, specifying the number of rotation steps or pulses. The motor drives the rotating mechanism to rotate in the opposite direction by the corresponding angle, ensuring that the camera's imaging angle matches the chip's actual offset angle, thus achieving the initial calibration.

[0091] S4: Closed-loop calibration:

[0092] After calibration, the system automatically repeats the "image acquisition," "offset calculation," and "angle adjustment" steps. It then captures another image and calculates any remaining offset angle. If the new offset angle is less than a preset minimum threshold (e.g., 0.1 degrees), the calibration is considered complete, and the system stops rotating. This closed-loop feedback mechanism effectively eliminates residual deviations caused by mechanical backlash, insufficient motor precision, or initial calculation errors, significantly improving the final accuracy and reliability of the calibration.

[0093] The advantage of this embodiment lies in its high degree of automation and accuracy. It eliminates the reliance on manual judgment and can complete calibration quickly and accurately, making it particularly suitable for optoelectronic microfluidic devices that require batch processing or integration into fully automated production lines.

[0094] Example 4:

[0095] refer to Figure 5 This embodiment details a photoelectric microfluidic device according to the present invention. This device achieves full automation and high precision by combining a camera rotation mechanism with optical and microfluidic components.

[0096] The optoelectronic microfluidic device mainly consists of three core components:

[0097] The photoelectric microfluidic chip assembly is the core of the device's sample processing, housing the photoelectric microfluidic chip.

[0098] The fluorescence microscopy component, located above the chip assembly, is used for fluorescence excitation and imaging of samples on the chip.

[0099] The camera rotation mechanism, located at the top of the fluorescence microscope assembly, is used to acquire images and achieve automatic calibration of the imaging angle.

[0100] The optoelectronic microfluidic chip assembly is positioned below the fluorescence microscope assembly, while the camera rotation mechanism is positioned directly above the fluorescence microscope assembly. This vertically stacked structure ensures optical path alignment, facilitating effective acquisition of fluorescence signals.

[0101] The fluorescence microscope assembly is a key component connecting the chip and the camera, and it integrates the following parts:

[0102] Light source emitting component: responsible for emitting excitation light of a specific wavelength to excite specific substances (such as fluorescently labeled cells or particles) on the optoelectronic microfluidic chip.

[0103] Optical filters typically include excitation filters and emission filters. Excitation filters allow only specific wavelengths of excitation light to pass through, reducing stray light. Emission filters allow only specific wavelengths of fluorescence emitted by the fluorescent material to pass through, blocking excess excitation light and thus improving the signal-to-noise ratio.

[0104] Microscope objective: Located directly above the chip, it is used to focus the excitation light onto the chip sample and simultaneously collect the fluorescence emitted by the sample, converging it to form an image.

[0105] During the experiment, the entire device worked in concert:

[0106] Step 1: Fluorescence Excitation and Signal Acquisition. The light source emitting component emits excitation light, which, after passing through an excitation filter, is projected onto the optoelectronic microfluidic chip through a microscope objective. Fluorescent substances in the chip (such as cells with fluorescent dyes) are excited.

[0107] Step 2: Image Acquisition and Transmission. The excited fluorescence signal is focused through a microscope objective, then passes through an emission filter, and enters the camera in the rotating camera mechanism above. The camera acquires a real-time fluorescence image of the chip.

[0108] Step 3: Automatic Calibration. The image acquired by the camera is transmitted to the control module. At this point, the automatic camera calibration method provided by this invention (as described in Embodiment 2 or Embodiment 3) begins to operate. Whether it adopts interactive iterative calibration or fully automated precise calculation calibration, the ultimate goal is to ensure that the camera imaging angle is perfectly aligned with the optoelectronic microfluidic chip.

[0109] Step 4: Data Processing and Analysis. After horizontal correction, the leveled and clear image is used for subsequent image processing and analysis. This includes, but is not limited to: fluorescence analysis: quantitative analysis of fluorescence intensity; image segmentation: accurate identification and segmentation of cells, droplets, or channels in the image; and data statistics: cell counting, morphological analysis, flow rate calculation, etc.

[0110] The optoelectronic microfluidic device described in this embodiment solves the imaging tilt problem encountered during long-term use or frequent chip replacement by organically combining mechanical structure, control algorithm, and image processing technology. This optoelectronic microfluidic device utilizes an automatic camera calibration mechanism to achieve full automation from image acquisition to data analysis, demonstrating significant practical value and broad application prospects. Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application, and they should all be covered within the scope of the claims and specification of this application.

Claims

1. A camera rotation mechanism, characterized in that, include: Camera, used to acquire images of optoelectronic microfluidic chips; A rotating mechanism is fixedly connected to the camera to adjust the imaging angle of the camera; and a drive unit for driving the rotating mechanism.

2. The camera rotation mechanism according to claim 1, characterized in that, The rotating mechanism further includes a reflective assembly and a light guide tube, wherein the reflective assembly includes a reflective element.

3. The camera rotation mechanism according to claim 2, characterized in that, The camera rotation mechanism also includes a control module, which is used to acquire images of the photoelectric microfluidic chip from the camera. Based on the preset reference point information in the image, the offset angle of the photoelectric microfluidic chip is calculated using a preset algorithm; Furthermore, based on the offset angle, the drive unit and the rotating mechanism are controlled to rotate precisely, thereby calibrating the imaging angle of the camera.

4. The camera rotation mechanism according to claim 3, characterized in that, The control unit integrates an image processing algorithm, which is used to identify preset reference points in the image and calculate the angle difference between the reference points and the ideal horizontal line.

5. The camera rotation mechanism according to any one of claims 1-4, characterized in that, The rotating mechanism includes a coupling and a rotating bracket. One end of the coupling is fixedly connected to the output shaft of the motor, and the other end is connected to one end of the rotating bracket. The other end of the rotating bracket is detachably connected to the camera.

6. An automatic camera calibration method for an optoelectronic microfluidic device, characterized in that, Includes the following steps: S1: Image Acquisition: Use a camera to capture raw images of the optoelectronic microfluidic chip; S2: Angle Adjustment: Based on the original image information, the control unit sends a control command to the motor to drive the camera to rotate, so that the original image is in a horizontal state.

7. An automatic camera calibration method for an optoelectronic microfluidic device, characterized in that, Includes the following steps: S1: Image Acquisition: Use a camera to capture raw images of the optoelectronic microfluidic chip; S2: Offset Calculation: The original image is analyzed by an image processing algorithm to identify a preset reference point in the image and calculate the angle difference between the reference point and the ideal horizontal line to obtain the actual offset angle of the chip. as well as S3: Angle Adjustment: Based on the offset angle, the control unit sends a control command to the motor to drive the camera to rotate in the opposite direction, so that the imaging angle of the camera is equal to the offset angle.

8. The automatic camera calibration method according to claim 6 or 7, characterized in that, The method repeats the image acquisition and angle adjustment steps after the angle adjustment step until the original image is completely horizontal.

9. The automatic camera calibration method according to claim 8, characterized in that, The offset calculation is based on one or more preset reference points on the optoelectronic microfluidic chip.

10. A photoelectric microfluidic device, characterized in that, include: The camera rotation mechanism as described in any one of claims 1 to 5; as well as The optoelectronic microfluidic chip assembly and the fluorescence microscope assembly are provided. The optoelectronic microfluidic chip assembly is disposed below the fluorescence microscope assembly, and the camera rotation mechanism is disposed above the fluorescence microscope assembly. The fluorescence microscope assembly further includes a light source emitting assembly, a filter, and a microscope objective.

Citation Information

Patent Citations

  • Automated detection and characterization of micro-objects in microfluidic devices

    HK40044348A