Image acquisition control circuit and image acquisition device

Through the combination of image sensor module, FPGA module, output interface module, MCU control module and serial conversion module, the stability problem of high-precision image acquisition and transmission is solved, efficient image data processing and transmission is realized, and the needs of medical testing and surgical scenarios are met.

CN223194782UActive Publication Date: 2025-08-05SHENZHEN PROXINSE MEDICAL LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202422143134.0
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-09-02
Publication Date
2025-08-05
Estimated Expiration
2034-09-02

AI Technical Summary

Technical Problem

How to ensure the quality of high-precision image acquisition and transmission in medical testing and surgical scenarios, especially the stability and efficiency when the data volume is large.

Method used

The combination of image sensor module, FPGA module, output interface module, MCU control module, serial conversion module and control input module is adopted to ensure efficient transmission and control of image signals through signal reconstruction and data processing.

Benefits of technology

It realizes stable acquisition and transmission of high-precision images, meets the high requirements of medical testing and surgical scenarios, and improves the speed and efficiency of image data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN223194782U_ABST
    Figure CN223194782U_ABST
Patent Text Reader

Abstract

The utility model relates to the image acquisition circuit technology, and discloses an image acquisition control circuit and an image acquisition device, which comprise an image sensor module, a field programmable gate array (FPGA) module, an output interface module, a microprogrammed control unit (MCU) control module, a serial conversion module and a control input module, the image sensor module is electrically connected with the input end of the signal reconstructor through the FPGA module, the output end of the signal reconstructor is electrically connected with the signal output interface, the control output end of the MCU control module is electrically connected with the control end of the image sensor module, the communication end of the MCU control module is electrically connected with the signal output interface through the serial conversion module, and the MCU control module is further electrically connected with the FPGA module. The control input module is electrically connected with the control input end of the MCU control module. The utility model aims to ensure the quality of high-precision image acquisition and transmission.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model relates to the technical field of image acquisition circuits, in particular to an image acquisition control circuit and an image acquisition device. Background Art

[0002] With the development of intelligent medical technology, real-time image acquisition technology is becoming increasingly popular in medical testing and surgical scenarios. For example, using cameras to monitor or peer into a patient's body helps medical staff understand the patient's physical condition on-site or remotely, enabling better diagnosis and treatment. While the acquisition of high-precision images undoubtedly makes it easier for medical staff to understand the patient's physical condition, high-precision images require large amounts of data processing. Therefore, ensuring the quality of high-precision image acquisition and transmission is a major challenge.

[0003] The above content is only used to assist in understanding the technical solution of the present invention and does not constitute an admission that the above content is prior art. Utility Model Content

[0004] The utility model provides an image acquisition control circuit and an image acquisition device, aiming to ensure the quality of high-precision image acquisition and transmission.

[0005] To achieve the above objectives, the present invention provides a control circuit for image acquisition, comprising: an image sensor module, an FPGA (Field Programmable Gate Array) module, an output interface module, an MCU (Microcontroller Unit) control module, a serial conversion module, and a control input module, wherein the output interface module comprises a signal reconstructor and a signal output interface, the image sensor module is electrically connected to the input end of the signal reconstructor via the FPGA module, the output end of the signal reconstructor is electrically connected to the signal output interface, the control output end of the MCU control module is electrically connected to the control end of the image sensor module, the communication end of the MCU control module is electrically connected to the signal output interface via the serial conversion module, the MCU control module is also electrically connected to the FPGA module, and the control input module is electrically connected to the control input end of the MCU control module;

[0006] Among them, the type of the signal reconstructor is compatible with the type of the signal output interface; and the signal output interface includes at least one of an HDMI (High Definition Multimedia Interface) interface, a DVI (Digital Visual Interface) interface, a DP (DisplayPort) interface and an SDI (Serial Digital Interface) interface; the signal reconstructor includes at least one of an HDMI reconstructor, a DVI reconstructor, a DP reconstructor and an SDI driver.

[0007] Optionally, the image acquisition control circuit further includes a power supply module, and the power supply module is electrically connected to a power supply terminal of the FPGA module.

[0008] Optionally, the serial conversion module is a Uart to RS232 module.

[0009] Optionally, the control input module is a key control input module.

[0010] Optionally, the image sensor module is provided with one or more ultra-high-definition image sensors.

[0011] Optionally, the image sensor module includes an image sensor bridge and two image sensors, and the two image sensors are electrically connected to the FPGA module through the image sensor bridge.

[0012] Optionally, the image acquisition control circuit further includes a gravity sensing module, and the gravity sensing module is electrically connected to the MCU control module.

[0013] The present invention further provides an image acquisition device, comprising the image acquisition control circuit as described above.

[0014] The beneficial effects of this utility model's technical solution are as follows: the image signal captured by the image sensor module is processed and controlled by the FPGA module, then reconstructed and converted at high speed by the output interface module, and ultimately output through the signal output interface. Simultaneously, the MCU control module controls and adjusts parameters of the image sensor module, and the serial conversion module performs data processing and transmission. This design ensures high-precision image acquisition and transmission quality, and enables precise control of the image acquisition process. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a structural diagram of an embodiment of a control circuit for image acquisition according to the present invention;

[0016] Figure 2This is a structural diagram of another embodiment of the control circuit for image acquisition of the present invention;

[0017] Figure 3 This is a structural diagram of another embodiment of the control circuit for image acquisition of the present invention;

[0018] Figure 4 This is a structural diagram of another embodiment of the image acquisition control circuit of the present invention.

[0019] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0020] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the schemes in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0021] It should be noted that all directional indications (such as up, down, left, right, front, back, etc.) in the embodiments of the present invention are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0022] It should also be noted that when an element is referred to as being "fixed on" or "disposed on" another element, it may be directly on the other element or there may be an intermediate element. When an element is referred to as being "connected to" another element, it may be directly connected to the other element or there may be an intermediate element.

[0023] Furthermore, if terms such as "first" or "second" are used in this utility model, they are used solely for descriptive purposes (e.g., to distinguish identical or similar components) and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined as "first" or "second" may explicitly or implicitly include at least one such feature. Furthermore, the technical solutions of various embodiments may be combined, but only if they are achievable by persons of ordinary skill in the art. If a combination of technical solutions contradicts or is unachievable, such combination shall be deemed non-existent and outside the scope of protection claimed by this utility model.

[0024] The utility model proposes a control circuit for image acquisition, referring to Figure 1The image acquisition control circuit includes an image sensor module, an FPGA module, an output interface module, an MCU control module, a serial conversion module, and a control input module, wherein the output interface module includes a signal reconstructor and a signal output interface, the image sensor module is electrically connected to the input end of the signal reconstructor via the FPGA module, the output end of the signal reconstructor is electrically connected to the signal output interface, the control output end of the MCU control module is electrically connected to the control end of the image sensor module, the communication end of the MCU control module is electrically connected to the signal output interface via the serial conversion module, the MCU control module is also electrically connected to the FPGA module, and the control input module is electrically connected to the control input end of the MCU control module;

[0025] Among them, the type of the signal reconstructor is compatible with the type of the signal output interface; and the signal output interface includes at least one of an HDMI interface, a DVI interface, a DP interface and an SDI interface; the signal reconstructor includes at least one of an HDMI reconstructor, a DVI reconstructor, a DP reconstructor and an SDI driver.

[0026] In this embodiment, the image sensor module is responsible for collecting image signals and transmitting them to the FPGA module for processing. The image sensor module is provided with at least one image sensor.

[0027] Optionally, the FPGA module is responsible for receiving the image signal from the image sensor module, processing the image signal, converting the image signal into a high-speed signal of a high transmission protocol, and outputting it to the signal output interface.

[0028] It's important to note that the FPGA module's flexible programmability enables various image processing and conversion operations, such as image compression, encryption, and filtering. After completing the necessary processing, the FPGA module converts the image signal into a high-speed signal and outputs it to a signal output interface using an appropriate transmission protocol for further processing. Using the FPGA module can improve the speed and efficiency of image data transmission, meeting the requirements of high-speed transmission and processing.

[0029] Among them, the FPGA module can use three BANK terminals to connect to the image sensor module. The three BANK terminals are used to receive image signals and output horizontal and vertical data synchronization control signals respectively.

[0030] In addition, the XCVR end of the FPGA module is responsible for connecting to the signal output interface and outputting high-speed signals.

[0031] Optionally, the output interface module includes a signal reconstructor and a signal output interface.

[0032] Among them, the signal reconstructor is used to reconstruct and optimize the high-speed signal converted by the FPGA module based on the image signal, so as to optimize the quality of the image signal and improve the signal stability.

[0033] Signal reconstructors are specialized chips, such as those for different video protocols like HDMI and DisplayPort. To ensure signal integrity, these reconstructors eliminate intersymbol interference (ISI) jitter and loss caused by bandwidth-limited circuit board traces or cables. Built-in clock and data recovery removes high-frequency input jitter and random jitter from the video source.

[0034] Optionally, the signal output interface is connected to the output end of the signal reconstructor and is responsible for outputting the optimized high-speed signal to the target device or system.

[0035] The type of the signal reconstructor is compatible with the type of the signal output interface; the signal output interface includes at least one of an HDMI interface, a DVI interface, a DP interface, and an SDI interface (such as the existing one); the signal reconstructor includes at least one of an HDMI reconstructor, a DVI reconstructor, a DP reconstructor, and an SDI driver (such as an ultra-high-speed SDI driver).

[0036] HDMI stands for High-Definition Multimedia Interface, used for transmitting fully digital video and sound. An HDMI reconstructor is a device used to repair or improve the quality of HDMI signals.

[0037] DVI is a digital video interface based on the TMDS electronic protocol, which encodes pixel data and transmits it over a serial connection. A DVI reconstructor, similar to an HDMI reconstructor, is a device used to process and improve DVI signals.

[0038] The DP interface supports high-resolution, high-refresh-rate, and deep-color video transmission, as well as multi-channel audio transmission. DP reconstructors are devices used to process and improve DP signals.

[0039] The SDI interface features high speed, high bandwidth, and low latency, supporting the transmission of digital video, audio, and auxiliary data signals. An SDI driver is a device used to enhance and transmit SDI signals.

[0040] Optionally, the signal reconstructor can also reconstruct and process the signal based on high-speed data transmission technology. High-speed digital signal processors can be used to perform digital signal processing, such as noise reduction, enhancement, and color correction. High-speed digital signal processors have efficient signal processing capabilities and algorithms, enabling real-time processing of high-speed image signals.

[0041] High-speed data transmission technologies, based on transmission protocols such as HDMI or DP, provide high-speed data transmission channels to ensure accurate and stable signal transmission. These technologies support high-bandwidth transmission and high-resolution image display, meeting the requirements for processing and transmitting high-speed image signals (e.g., supporting high-speed signals with a transmission rate of 10Gbps).

[0042] Optionally, the MCU control module is used to control the functions and parameters of the image sensor module and communicate and control the FPGA module. For example, the MCU control module can be used to control the start and stop of image signal acquisition and transmission.

[0043] Optionally, the MCU control module can monitor various input signals from the control input module, such as buttons, sensors, or external trigger signals, to determine when to start the image acquisition process. Once the trigger condition is met, the MCU will send a corresponding control signal to the image sensor module to start image signal acquisition.

[0044] Optionally, the MCU control module can also decide when to stop transmitting the image signal. It can send a stop signal to the FPGA module to terminate image transmission under specific conditions, such as when a certain acquisition time has elapsed, a set number of image frames has been reached, or a specific signal trigger is received.

[0045] In summary, the MCU control module is responsible for controlling the normal and stable operation of the entire image sensor module, including initializing the parameters of the image sensor module and dynamically adjusting the relevant image data parameters during operation.

[0046] For example, when the image sensor module starts up, the MCU control module is responsible for initializing parameters. This includes setting the sensor's operating mode, frame rate, exposure time, gain, and more. Depending on the specific application scenario and requirements, the MCU control module can configure the image sensor according to pre-set parameters to ensure proper operation and achieve the desired image quality.

[0047] During image sensor module operation, the MCU control module can dynamically adjust relevant image data parameters based on real-time scene changes. For example, it can dynamically adjust exposure based on light intensity and adjust image gain based on scene contrast. This enables the image sensor module to automatically adapt to different environmental conditions, providing better image quality and performance.

[0048] By initializing and dynamically adjusting the parameters of the image sensor module through the MCU control module, stable operation of the image sensor module can be achieved and image quality can be optimized according to scene requirements.

[0049] Optionally, the FPGA module can use two BANK terminals to connect to the MCU control module, which are used for communicating with the MCU control module and loading and upgrading running programs from the MCU control module.

[0050] It's important to note that the "bank" side of an FPGA module refers to the grouping of the module's input / output (I / O) ports. An FPGA typically contains multiple banks, each with a set of I / O pins. These I / O pins can be used to communicate with other circuits or external devices.

[0051] Optionally, the serial conversion module is used to convert the communication signal output by the MCU control module into a serial signal suitable for long-distance transmission, and then output the converted serial signal to the target device or system through the signal output interface.

[0052] Optionally, the serial conversion module is a UART to RS232 module. UART is a common serial communication protocol that can transmit data between a microcontroller and an external device; RS232 is a widely used serial communication standard for transmitting data over a long distance.

[0053] Optionally, the control input module is connected to the control input terminal of the MCU control module for inputting a control signal to achieve real-time control of image acquisition parameters.

[0054] Optionally, the control input module is a key control input module; of course, in some optional configurations, the control input module may also be a touch input module.

[0055] With this solution, the image signal captured by the image sensor module is processed and controlled by the FPGA module, then reconstructed and converted at high speed by the output interface module, and ultimately output through the signal output interface. Simultaneously, the MCU control module controls and adjusts parameters of the image sensor module, while the serial conversion module performs data processing and transmission. This design ensures high-precision image acquisition and transmission quality, and enables precise control of the image acquisition process.

[0056] In one embodiment, based on the above embodiment, referring to Figure 2 The image acquisition control circuit also includes a power supply module, which is electrically connected to the power supply end of the FPGA module.

[0057] In this embodiment, the image acquisition control circuit also includes a power supply module for providing power to the entire circuit system. By connecting the power supply module to the power supply terminal of the FPGA module, a stable power supply is ensured for the FPGA and its associated circuits, enabling the normal operation of the entire image acquisition control circuit. This meets the power requirements of the image acquisition control circuit, ensuring reliable signal processing and image data transmission, and high-quality image acquisition.

[0058] In one embodiment, based on the above embodiment, the image sensor module is provided with one or more ultra-high-definition image sensors.

[0059] In this embodiment, by using one or more ultra-high-definition image sensors, the image sensor module can provide ultra-high-definition image quality and more powerful image capture capabilities. This provides users with a better image experience and a wider range of application possibilities, whether in photography, surveillance, medical treatment, or other fields.

[0060] Optionally, the ultra-high-definition image sensor is a 4K camera (i.e., a camera with a 4K resolution of 60FPS). The use of a 4K camera can be compatible with single, dual, and triple 4K resolution CMOSs at the same time, and output 4K60FPS image data in real time. The image colors are clear and smooth, meeting the doctor's high requirements for image fineness in related minimally invasive surgeries, helping doctors to complete the operation smoothly and accurately, benefiting both doctors and patients.

[0061] Optional control circuit composed of image sensor modules built based on ultra-high-definition image sensors can be used in application scenarios such as 4K and 4K fluorescence medical endoscopes, achieving extremely high image performance.

[0062] In one embodiment, based on the above embodiment, referring to Figure 3 The image sensor module includes an image sensor bridge and two image sensors, and the two image sensors are electrically connected to the FPGA module through the image sensor bridge.

[0063] In this embodiment, two image sensors in the image sensor module form a 3D camera (such as a 3D endoscope).

[0064] In this case, the image sensor module includes an image sensor bridge and two image sensors. The image sensor bridge provides circuit bridging and signal processing functions for the image sensors. By connecting the two image sensors with the FPGA module, it can provide high-speed image data transmission and processing capabilities.

[0065] The optional image sensor bridge is a key component that connects two image sensors to the FPGA module. It bridges the two image sensors by providing high-speed differential signal lines and power supply, while also providing image data format conversion and processing.

[0066] Optionally, these two image sensors typically feature ultra-high-definition pixels and fast capture capabilities, enabling the capture of high-resolution, high-rate image data. These image sensors can be two extremely compact packages supporting 1080p resolution at 60 FPS. The image sensor bridge converts the analog signals output by the image sensors into digital output, enabling image signal acquisition and conversion of optical signals into electrical signals for transmission.

[0067] By electrically connecting two image sensors to an FPGA module via an image sensor bridge, high-speed, high-definition image data capture and transmission can be achieved. This solution improves the overall performance of image sensors, optimizing image quality and data processing capabilities, and quickly and reliably meets the image acquisition needs of various surveillance, medical, and high-speed photography applications.

[0068] Optionally, the two image sensors can be 4mm 3D cameras, which can simultaneously use two 1080P resolution CMOS to output 1080P 60FPS image data in real time, and finally display a three-dimensional 3D image on the 3D monitor. The picture color is clear and smooth, meeting the doctor's demand for image fineness in related minimally invasive surgeries, helping doctors to locate and operate more accurately, shortening the operation time, and benefiting both doctors and patients.

[0069] Optional control circuit composed of an image sensor module built based on a 3D camera can be used for medical electronic endoscopes with a steel tube diameter of 4mm. It is widely used in application scenarios such as neurology, orthopedics, and gynecology where the surgical space is relatively small and high operational precision and accuracy are required.

[0070] In one embodiment, based on the above embodiment, referring to Figure 4 The image acquisition control circuit also includes a gravity sensing module, which is electrically connected to the MCU control module.

[0071] In this embodiment, the image acquisition control circuit further includes a gravity sensing module, which is used to detect the posture and gravity acceleration of the image sensor and transmit the relevant data to the MCU control module for processing.

[0072] Optionally, the gravity sensing module may adopt MEMS (Micro-Electro-Mechanical Systems) technology, including a three-axis accelerometer and a three-axis gyroscope, which can detect the tilt, rotation and acceleration changes of the image sensor in real time.

[0073] Optionally, the gravity sensing module transmits the detected gravity sensing data to the MCU control module through an electrical connection. This can be done through a digital interface such as I2C, SPI or UART to ensure high-speed data transmission and reliability.

[0074] Optionally, the MCU control module is responsible for receiving and processing data from the gravity sensing module. It can use this data to automatically adjust the direction, angle, and stability of the image sensor to ensure accuracy and stability during image acquisition.

[0075] Optionally, by working in conjunction with the image sensor module, the gravity sensing module can achieve adaptive image acquisition, automatically adjusting the angle and direction of the image based on the device's posture. This can provide users with a better experience and accurate image acquisition.

[0076] By integrating a gravity sensor module with the MCU control module, the image acquisition control system can achieve automatic posture perception and image correction, improving the accuracy and stability of image acquisition. This solution can better meet user needs and enhance the functionality and performance of the image acquisition system in different application scenarios.

[0077] For example, by using a gravity sensing module, the gravity sensing and video stabilization functions of a 4mm 3D camera can be realized.

[0078] The present invention further proposes an image acquisition device, which includes an image acquisition control circuit. The specific structure of the image acquisition control circuit refers to the above-mentioned embodiment. Since the present image acquisition device adopts all the technical solutions of all the above-mentioned embodiments, it has at least all the technical effects brought about by the technical solutions of the above-mentioned embodiments, which will not be described one by one here.

[0079] The above description is only part or preferred embodiments of the present invention. Neither the text nor the drawings can limit the scope of protection of the present invention. All equivalent structural transformations made by using the contents of the present invention specification and drawings under the overall concept of the present invention, or direct / indirect application in other related technical fields are included in the scope of protection of the present invention.

Claims

1. A control circuit for image acquisition, characterized in that: include: An image sensor module, an FPGA module, an output interface module, an MCU control module, a serial conversion module, and a control input module, wherein the output interface module includes a signal reconstructor and a signal output interface, the image sensor module is electrically connected to the input end of the signal reconstructor via the FPGA module, the output end of the signal reconstructor is electrically connected to the signal output interface, the control output end of the MCU control module is electrically connected to the control end of the image sensor module, the communication end of the MCU control module is electrically connected to the signal output interface via the serial conversion module, the MCU control module is also electrically connected to the FPGA module, and the control input module is electrically connected to the control input end of the MCU control module; Among them, the type of the signal reconstructor is compatible with the type of the signal output interface; and the signal output interface includes at least one of an HDMI interface, a DVI interface, a DP interface and an SDI interface; the signal reconstructor includes at least one of an HDMI reconstructor, a DVI reconstructor, a DP reconstructor and an SDI driver.

2. The image acquisition control circuit according to claim 1, wherein: The image acquisition control circuit further includes a power supply module, which is electrically connected to a power supply terminal of the FPGA module.

3. The image acquisition control circuit according to claim 1, wherein: The serial conversion module is a Uart to RS232 module.

4. The image acquisition control circuit according to claim 1, wherein: The control input module is a key control input module.

5. The image acquisition control circuit according to any one of claims 1 to 4, characterized in that: The image sensor module is provided with one or more ultra-high-definition image sensors.

6. The image acquisition control circuit according to any one of claims 1 to 4, characterized in that: The image sensor module includes an image sensor bridge and two image sensors, and the two image sensors are electrically connected to the FPGA module through the image sensor bridge.

7. The image acquisition control circuit according to claim 6, characterized in that: The image acquisition control circuit further includes a gravity sensing module, and the gravity sensing module is electrically connected to the MCU control module.

8. An image acquisition device, characterized in that: The image acquisition device includes the image acquisition control circuit according to any one of claims 1 to 7.