Control system and method for dual-channel camera

Through the combination of a dual-channel camera control system, touch screen and portable terminal, the problem of single parameter control method of medical surgical imaging system is solved, more efficient image analysis and system control are achieved, and surgical efficiency and image quality are improved.

CN118264894BActive Publication Date: 2024-11-22NANJING NUOYUAN MEDICAL DEVICES CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410675108.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-05-29
Publication Date
2024-11-22
Estimated Expiration
2044-05-29

AI Technical Summary

Technical Problem

The existing medical surgical imaging system has a single parameter control method, cumbersome operation, and it is difficult to achieve complex image analysis and parameter adjustment, which affects the efficiency and quality of the surgical procedure.

Method used

The dual-channel camera control system is adopted to output image data through the core module, and combine it with a touch screen and a portable terminal to provide a rich user interface. Users can analyze image data on the interface and adjust system parameters. The core module receives operation instructions to adjust the corresponding parameters. Improve the interactive experience and efficiency of parameter control.

Benefits of technology

It provides richer visual effects and diverse operating methods, improves the efficiency and interactive experience of parameter control, and realizes more complex image processing and system control functions to meet doctors' needs for high-quality surgical images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118264894B_ABST
    Figure CN118264894B_ABST
Patent Text Reader

Abstract

The invention provides a control system and method for a dual-channel camera, comprising: a dual-channel camera, a core module, a display screen, a touch screen and a portable terminal; the dual-channel camera collects visible light images and fluorescent images in the same field of view in an environment, and converts the visible light images into visible light images, and converts the fluorescent images into fluorescent images; the core module performs multi-mode image processing, multi-mode image splicing processing and multi-mode image selection processing on the visible light images and the fluorescent images to obtain a multi-mode image group and a spliced ​​image, and uses any image or spliced ​​image in the multi-mode image group as an image to be displayed, and receives an operation instruction sent by the touch screen or the portable terminal, and adjusts corresponding parameters according to the operation instruction; the display screen is used to display the image to be displayed; the touch screen and the portable terminal can display a user interface for a user to control parameters.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of medical video image processing, and in particular to a control system and method for a dual-channel camera. Background Art

[0002] With the rapid development of modern science and technology, medical surgical imaging systems based on video imaging technology have flourished and have been widely used in fluorescent surgical navigation and endoscopic imaging, greatly improving the efficiency and quality of surgical operations. Dual-channel cameras can simultaneously capture visible light images and fluorescent images, and can intuitively indicate the location of the fluorescent area when used in combination with medical contrast agents. Therefore, they play an important role in tumor surgery.

[0003] With the iterative development of technology and actual clinical needs, doctors have higher and higher requirements for surgical image quality and display effects. Therefore, medical surgical imaging systems need to integrate a large number of image processing algorithms to achieve richer functions. With the increase of image processing functions, the number of controllable parameters also increases, and higher requirements are placed on the parameter control of medical surgical imaging systems.

[0004] At present, conventional parameter control methods for medical surgical imaging systems include physical button control, configuration screen / serial port screen control, and OSD menu overlay.

[0005] However, the number of parameters that can be controlled by the physical button control method is limited, and too many physical buttons will cause inconvenience in operation or accidental touches; the configuration screen / serial port screen control method is usually implemented by embedding the configuration screen / serial port screen outside the chassis, which requires the doctor to move to the vicinity of the chassis for operation, which will affect the doctor's surgical rhythm; the OSD menu overlay method uses buttons to switch or select menu options, and the operation process is relatively cumbersome, time-consuming and labor-intensive.

[0006] In summary, the interactive interface platform and interactive mode that the above control methods can provide are relatively simple, and are only suitable for simple parameter adjustment control. They cannot obtain image data, and therefore it is difficult to achieve control functions that require image analysis. Summary of the invention

[0007] In view of this, the purpose of the present invention is to provide a control system and method for a dual-channel camera, which outputs image data through a core module, displays the image data on a display screen, and can present the image data on a touch screen and a user interface of a portable terminal as needed. The user can analyze the image data on the user interface as needed, and can also adjust the system parameters by operating the user interface; the core module receives the operation instructions sent by the touch screen or the portable terminal, and adjusts the corresponding parameters according to the operation instructions, thereby achieving the purpose of parameter control; using the touch screen as a fixed control terminal and the portable terminal as a mobile control terminal can provide a user operation interface platform with richer visual effects and more diverse control methods, thereby improving the human-computer interaction experience of parameter control and the system control efficiency.

[0008] In a first aspect, an embodiment of the present invention provides a control system for a dual-channel camera, the system comprising: a dual-channel camera, a core module, a display screen, a touch screen, and a portable terminal;

[0009] The dual-channel camera, the display screen, the touch screen and the portable terminal are respectively connected to the core module;

[0010] The dual-channel camera is used to collect visible light pictures and fluorescent pictures in the same field of view in the environment, and convert the visible light pictures into visible light images, and convert the fluorescent pictures into fluorescent images;

[0011] The core module is used to perform multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on the visible light image and the fluorescent image to obtain a multi-mode image group and a stitched image, and use any one image in the multi-mode image group or the stitched image as an image to be displayed, and receive an operation instruction sent by the touch screen or the portable terminal, and adjust corresponding parameters according to the operation instruction;

[0012] The display screen is used to display the image to be displayed.

[0013] Further, the core module includes an FPGA component;

[0014] The FPGA component is connected to the display screen and is used to preprocess the visible light image to obtain a preprocessed visible light image; and preprocess the fluorescence image to obtain a preprocessed fluorescence image;

[0015] Processing the preprocessed visible light image and the preprocessed fluorescence image by a multi-mode image processing algorithm to obtain a plurality of images in different modes;

[0016] constructing the preprocessed visible light image, the preprocessed fluorescence image and the plurality of different mode images into the multi-mode image group;

[0017] Processing multiple images in the multi-mode image group by a multi-mode image stitching algorithm to obtain the stitched image;

[0018] The multi-mode image group and the stitched image are processed by a multi-mode image selection algorithm, and any one image in the multi-mode image group or the stitched image is selected as the image to be displayed.

[0019] Furthermore, the core module also includes a DDR component;

[0020] The DDR component is connected to the FPGA component and is used to obtain the multi-mode image group and the stitched image output by the FPGA component.

[0021] Furthermore, the core module also includes a software component, in which an application is deployed;

[0022] The software component is connected to the DDR component and the touch screen, respectively, and is used to obtain a first operation instruction of a user on the touch screen, and adjust the first operation instruction to correspond to the parameter;

[0023] When the parameter is an image processing parameter, sending the image processing parameter to the FPGA component so that the FPGA component adjusts the image processing parameter;

[0024] When the parameter is a camera control parameter, the camera control parameter is sent to the dual-channel camera through the FPGA component, so that the dual-channel camera adjusts the camera control parameter.

[0025] Furthermore, the image processing parameters include at least: visible light image preprocessing parameters, fluorescence image preprocessing parameters, multi-mode image processing parameters, multi-mode image stitching parameters and multi-mode image selection parameters; the camera control parameters include at least: visible light channel exposure time, visible light channel gain, fluorescence channel exposure time and fluorescence channel gain.

[0026] Furthermore, the software component is connected to the portable terminal and is used to obtain a second operation instruction input by the user on the operation interface of the portable terminal through a wireless network, and adjust the second operation instruction to correspond to the parameter.

[0027] Furthermore, the portable terminal includes at least: a smart phone, a laptop computer and a tablet computer.

[0028] In a second aspect, an embodiment of the present invention provides a control method for a dual-channel camera, which is applied to the control system of the dual-channel camera as described above, wherein the system includes: a dual-channel camera, a core module, a display screen, a touch screen, and a portable terminal; the method includes:

[0029] The dual-channel camera collects visible light images and fluorescent images in the same field of view in the environment, and converts the visible light images into visible light images, and converts the fluorescent images into fluorescent images;

[0030] The core module performs multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on the visible light image and the fluorescent image to obtain a multi-mode image group and a stitched image, and uses any one image in the multi-mode image group or the stitched image as an image to be displayed, and receives an operation instruction sent by the touch screen or the portable terminal, and adjusts corresponding parameters according to the operation instruction;

[0031] The display screen displays the image to be displayed.

[0032] In a third aspect, an embodiment of the present invention provides an electronic device, including a memory and a processor, wherein the memory stores a computer program executable on the processor, and the processor implements the method described above when executing the computer program.

[0033] In a fourth aspect, an embodiment of the present invention provides a computer-readable medium having a non-volatile program code executable by a processor, wherein the program code enables the processor to execute the method as described above.

[0034] The embodiment of the present invention provides a control system and method for a dual-channel camera, including: a dual-channel camera, a core module, a display screen, a touch screen and a portable terminal; the dual-channel camera is used to collect visible light images and fluorescent images in the same field of view in an environment, and convert the visible light images into visible light images, and convert the fluorescent images into fluorescent images; the core module is used to perform multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on the visible light image and the fluorescent image to obtain a multi-mode image group and a stitched image, and use any image or stitched image in the multi-mode image group as an image to be displayed, and receive an operation instruction sent by the touch screen or the portable terminal, and display the image according to the operation instruction. Adjust the corresponding parameters; the display screen is used to display the image to be displayed; the image data is output through the core module, and the image data is presented on the user interface of the touch screen and the portable terminal, and the user can analyze the image data on the user interface, and can also adjust the system parameters on the user interface; the core module receives the operation instructions sent by the touch screen or the portable terminal, and adjusts the corresponding parameters according to the operation instructions, so as to achieve the purpose of parameter control; using the touch screen as the fixed control terminal and the portable terminal as the mobile control terminal can provide a user operation interface platform with richer visual effects and more diverse control methods, thereby improving the human-computer interaction experience of parameter control and the system control efficiency.

[0035] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0036] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0038] Figure 1 A schematic diagram of a control system for a dual-channel camera provided in Embodiment 1 of the present invention;

[0039] Figure 2 A schematic diagram of a control system of another dual-channel camera provided in Embodiment 1 of the present invention;

[0040] Figure 3A schematic diagram of the processing process of the FPGA component provided in the first embodiment of the present invention;

[0041] Figure 4 This is a flow chart of a control method for a dual-channel camera provided in Embodiment 2 of the present invention.

[0042] icon:

[0043] 1-dual-channel camera; 2-core module; 3-display screen; 4-touch screen; 5-portable terminal; 21-FPGA component; 22-DDR component; 23-software component. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0045] To facilitate understanding of this embodiment, the embodiment of the present invention is described in detail below.

[0046] Embodiment 1:

[0047] Figure 1 A schematic diagram of a control system for a dual-channel camera provided in Embodiment 1 of the present invention.

[0048] Reference Figure 1 , the system includes: a dual-channel camera 1, a core module 2, a display screen 3, a touch screen 4 and a portable terminal 5;

[0049] The dual-channel camera 1, the display screen 3, the touch screen 4 and the portable terminal 5 are respectively connected to the core module 2;

[0050] A dual-channel camera 1 is used to collect visible light images and fluorescent images in the same field of view in the environment, and convert the visible light images into visible light images, and convert the fluorescent images into fluorescent images;

[0051] The core module 2 is used to perform multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on visible light images and fluorescent images to obtain a multi-mode image group and a stitched image, and use any image or stitched image in the multi-mode image group as an image to be displayed, and receive an operation instruction sent by the touch screen 4 or the portable terminal 5, and adjust corresponding parameters according to the operation instruction; the display screen 3 is used to display the image to be displayed.

[0052] Among them, refer to Figure 2The core module 2 includes an FPGA component 21, a DDR component 22 and a software component 23.

[0053] Furthermore, the core module 2 includes an FPGA component 21, which receives the visible light image and the fluorescent image sent by the dual-channel camera and processes the visible light image and the fluorescent image using an image processing flow. The image processing flow is as follows: Figure 3 As shown, there is no restriction on the specific implementation method of the image processing algorithm used in each step of the image processing flow. For example, image denoising can be implemented using mean filtering, Gaussian filtering, or other denoising methods;

[0054] The FPGA component 21 is connected to the display screen 3 and is used to preprocess the visible light image to obtain a preprocessed visible light image; and preprocess the fluorescence image to obtain a preprocessed fluorescence image;

[0055] Specifically, the visible light image is preprocessed to obtain a preprocessed visible light image, and the preprocessing process includes but is not limited to color correction, brightness correction and image denoising. The fluorescence image is preprocessed to obtain a preprocessed fluorescence image, and the preprocessing process includes but is not limited to brightness correction and image denoising.

[0056] Processing the preprocessed visible light image and the preprocessed fluorescence image by a multi-mode image processing algorithm to obtain a plurality of images with different modes;

[0057] Specifically, the multi-mode image processing algorithm includes but is not limited to image fusion and color scale processing, etc. A fusion mode image is obtained by image fusion processing, and a color scale mode image is obtained by color scale processing.

[0058] constructing the preprocessed visible light image, the preprocessed fluorescence image and a plurality of different mode images into the multi-mode image group;

[0059] Specifically, the specific method and number of methods for multi-mode image processing are not limited herein. The pre-processed visible light image, the pre-processed fluorescence image and a plurality of different mode images are constructed as a multi-mode image group.

[0060] Processing multiple images in the multi-mode image group by a multi-mode image stitching algorithm to obtain a stitched image;

[0061] The multi-mode image group and the spliced ​​image are processed by a multi-mode image selection algorithm, and any one image or spliced ​​image in the multi-mode image group is selected as the image to be displayed.

[0062] Specifically, after the image processing process, the FPGA component 21 outputs all the mode images and the stitched images in the multi-mode image group to the DDR component 22, and outputs the image to be displayed to the display screen for display. When the software component needs a certain image, it is called from the DDR component 22. Among them, the method of adding or reducing the function in a certain step on the basis of the image processing process framework of the present application but not changing the process framework structure and using the same control method as the present application is within the scope of protection of the claims of the present application.

[0063] Further, the core module also includes a DDR component 22;

[0064] The DDR component 22 is connected to the FPGA component 21 and is used to obtain the multi-mode image group and the stitched image output by the FPGA component 21 .

[0065] Furthermore, the core module 2 also includes a software component 23, in which an application is deployed;

[0066] The software component 23 is connected to the DDR component 22 and the touch screen 4 respectively, and is used to obtain the first operation instruction of the user on the touch screen, and adjust the first operation instruction to the corresponding parameter;

[0067] When the parameter is an image processing parameter, the image processing parameter is sent to the FPGA component 21 so that the FPGA component 21 adjusts the image processing parameter;

[0068] When the parameter is a camera control parameter, the camera control parameter is sent to the dual-channel camera 1 through the FPGA component 21, so that the dual-channel camera 1 adjusts the camera control parameter.

[0069] Specifically, the dual-channel camera 1 adjusts the image acquisition effect of the camera by adjusting the camera control parameters.

[0070] Furthermore, the image processing parameters at least include: visible light image preprocessing parameters, fluorescence image preprocessing parameters, multi-mode image processing parameters, multi-mode image stitching parameters and multi-mode image selection parameters, but are not limited to the above parameters, and also include other parameters; the camera control parameters at least include: visible light channel exposure time, visible light channel gain, fluorescence channel exposure time and fluorescence channel gain, but are not limited to the above parameters, and also include other parameters. Among them, the effect of each image processing algorithm can be adjusted by the image processing parameters.

[0071] Furthermore, the software component 23 is connected to the portable terminal 5 and is used to obtain the second operation instruction input by the user on the operation interface of the portable terminal 5 through a wireless network, and adjust the second operation instruction to a corresponding parameter.

[0072] Furthermore, the portable terminal 5 at least includes: a smart phone, a laptop computer and a tablet computer. The portable terminal 5 includes but is not limited to a smart phone, a laptop computer and a tablet computer, and can also be other terminals. The portable terminal 5 can use any one of the smart phone, the laptop computer and the tablet computer.

[0073] Specifically, the software component 23 can obtain the image output by the FPGA component 21 in the DDR component 22, and can also obtain and adjust image processing parameters and camera control parameters. Applications can be deployed in the software component, and specific system functions can be implemented using the applications as needed.

[0074] A control method combining software components and touch screens uses the touch screen as a fixed control terminal of the system. Applications are deployed in the software components. The application displays a touch screen control interface on the touch screen and responds to user operations on the touch screen control interface. The application can obtain and adjust image processing parameters and camera control parameters, and view and analyze the output image of the FPGA component according to the operation instructions of the touch screen control interface. Specifically: when the parameter is an image processing parameter, the software component sends the image processing parameter to the FPGA component so that the FPGA component adjusts the image processing parameter; when the parameter is a camera control parameter, the software component sends the camera control parameter to the dual-channel camera through the FPGA component so that the dual-channel camera adjusts the camera control parameter.

[0075] The control method of the software component and the portable terminal uses the portable terminal as the mobile control terminal of the system. The portable terminal uses a device with certain computing and rendering capabilities, such as a smart phone, a laptop, a tablet computer, etc. The portable terminal and the software component are interconnected through a wireless network, and the portable terminal can move freely within the effective range of the wireless signal.

[0076] The terminal program runs on the portable terminal, the application is deployed in the software component, and the terminal program and the application exchange data through the wireless network. The terminal program renders the terminal control interface on the portable terminal. According to the operation instructions of the terminal control interface, the terminal program exchanges data with the application software in the software component, thereby achieving the purpose of obtaining and adjusting image processing parameters and camera control parameters, and viewing and analyzing the output image of the FPGA component. Specifically: when the parameter is an image processing parameter, the software component sends the image processing parameter to the FPGA component so that the FPGA component adjusts the image processing parameter; when the parameter is a camera control parameter, the software component sends the camera control parameter to the dual-channel camera through the FPGA component so that the dual-channel camera adjusts the camera control parameter.

[0077] Embodiment 2:

[0078] Figure 4This is a flow chart of a control method for a dual-channel camera provided in Embodiment 2 of the present invention.

[0079] Reference Figure 4 , applied to the control system of the dual-channel camera as described above, the system includes: a dual-channel camera, a core module, a display screen, a touch screen and a portable terminal; the method includes the following steps:

[0080] Step S101, a dual-channel camera collects a visible light picture and a fluorescent picture in the same field of view in an environment, and converts the visible light picture into a visible light image, and converts the fluorescent picture into a fluorescent image;

[0081] Step S102, the core module performs multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on the visible light image and the fluorescence image to obtain a multi-mode image group and a stitched image, and uses any image or stitched image in the multi-mode image group as an image to be displayed;

[0082] Step S103, the core module receives an operation instruction sent by the touch screen or the portable terminal, and adjusts corresponding parameters according to the operation instruction;

[0083] Step S104: the display screen displays the image to be displayed.

[0084] The dual-channel camera pre-processes visible light images and fluorescent images, and can realize image processing functions such as color correction, brightness correction, image denoising, image fusion, and image stitching. It also provides adjustment rights for camera control parameters and image processing parameters, and users can obtain rich image effects by controlling parameters.

[0085] By deploying applications in software components to control parameters, the applications can achieve more powerful functions than physical buttons, configuration screens / serial port screens, OSD overlay menus and other methods, thereby providing an easier-to-use user interface, a more natural human-computer interaction experience, and richer system control methods.

[0086] The software component can obtain the image data output by the FPGA component and present the image data on the touch screen and the user interface of the portable terminal. This method can further expand the parameter control method of the system. For example, the user can analyze the image data, and the software component converts the analysis results into parameters and feeds them back to the FPGA component. The FPGA component adjusts the image processing effect according to the parameters, thereby achieving the purpose of parameter control. This control method is difficult to achieve with physical buttons, configuration screens / serial port screens, OSD overlay menus, etc.

[0087] Using a touch screen as a fixed control terminal and a portable terminal as a mobile control terminal can provide a user operation interface platform with richer visual effects and more diverse control methods, thereby improving the human-computer interaction experience of parameter control and system control efficiency.

[0088] A portable terminal is used as a mobile control terminal. The portable terminal and the core module are connected via wireless signals. The portable terminal can move arbitrarily within the effective range of the wireless signal, thus expanding the activity radius of the system user.

[0089] An embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the dual-channel camera control method provided in the above embodiment are implemented.

[0090] An embodiment of the present invention further provides a computer-readable medium having a non-volatile program code executable by a processor, wherein a computer program is stored on the computer-readable medium, and when the computer program is executed by the processor, the steps of the control method of the dual-channel camera of the above embodiment are executed.

[0091] The computer program product provided in the embodiment of the present invention includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the method described in the previous method embodiment. The specific implementation can be found in the method embodiment and will not be repeated here.

[0092] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0093] In addition, in the description of the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0094] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0095] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0096] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

Claims

1. A control system for a dual-channel camera, characterized in that: The system includes: a dual-channel camera, a core module, a display screen, a touch screen and a portable terminal; The dual-channel camera, the display screen, the touch screen and the portable terminal are respectively connected to the core module; The dual-channel camera is used to collect visible light pictures and fluorescent pictures in the same field of view in the environment, and convert the visible light pictures into visible light images, and convert the fluorescent pictures into fluorescent images; The core module is used to perform multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on the visible light image and the fluorescent image to obtain a multi-mode image group and a stitched image, and use any one image in the multi-mode image group or the stitched image as an image to be displayed, and receive an operation instruction sent by the touch screen or the portable terminal, and adjust corresponding parameters according to the operation instruction; The display screen is used to display the image to be displayed; The core module includes an FPGA component; The FPGA component is connected to the display screen and is used to preprocess the visible light image to obtain a preprocessed visible light image; and preprocess the fluorescence image to obtain a preprocessed fluorescence image; Processing the preprocessed visible light image and the preprocessed fluorescence image by a multi-mode image processing algorithm to obtain a plurality of images in different modes; constructing the preprocessed visible light image, the preprocessed fluorescence image and the plurality of different mode images into the multi-mode image group; Processing multiple images in the multi-mode image group by a multi-mode image stitching algorithm to obtain the stitched image; The multi-mode image group and the stitched image are processed by a multi-mode image selection algorithm, and any one image in the multi-mode image group or the stitched image is selected as the image to be displayed.

2. The control system of the dual-channel camera according to claim 1, characterized in that: The core module also includes a DDR component; The DDR component is connected to the FPGA component and is used to obtain the multi-mode image group and the stitched image output by the FPGA component.

3. The control system of the dual-channel camera according to claim 1, characterized in that: The core module also includes a software component, in which an application is deployed; The software component is connected to the DDR component and the touch screen, respectively, and is used to obtain a first operation instruction of a user on the touch screen, and adjust the first operation instruction to correspond to the parameter; When the parameter is an image processing parameter, sending the image processing parameter to the FPGA component so that the FPGA component adjusts the image processing parameter; When the parameter is a camera control parameter, the camera control parameter is sent to the dual-channel camera through the FPGA component, so that the dual-channel camera adjusts the camera control parameter.

4. The control system of the dual-channel camera according to claim 3, characterized in that: The image processing parameters include at least: visible light image preprocessing parameters, fluorescence image preprocessing parameters, multi-mode image processing parameters, multi-mode image stitching parameters and multi-mode image selection parameters; the camera control parameters include at least: visible light channel exposure time, visible light channel gain, fluorescence channel exposure time and fluorescence channel gain.

5. The control system of the dual-channel camera according to claim 3, characterized in that: The software component is connected to the portable terminal and is used to obtain the second operation instruction input by the user on the operation interface of the portable terminal through a wireless network, and adjust the second operation instruction to correspond to the parameter.

6. The control system of the dual-channel camera according to claim 1, characterized in that: The portable terminal includes at least: a smart phone, a notebook computer and a tablet computer.

7. A control method for a dual-channel camera, characterized in that: A control system for a dual-channel camera according to any one of claims 1 to 6, the system comprising: a dual-channel camera, a core module, a display screen, a touch screen and a portable terminal; the method comprising: The dual-channel camera collects visible light images and fluorescent images in the same field of view in the environment, and converts the visible light images into visible light images, and converts the fluorescent images into fluorescent images; The core module performs multi-mode image processing, multi-mode image stitching processing and multi-mode image selection processing on the visible light image and the fluorescent image to obtain a multi-mode image group and a stitched image, and uses any one image in the multi-mode image group or the stitched image as an image to be displayed, and receives an operation instruction sent by the touch screen or the portable terminal, and adjusts corresponding parameters according to the operation instruction; The display screen displays the image to be displayed; The core module includes an FPGA component, and the core module performs multi-mode image processing, multi-mode image stitching processing, and multi-mode image selection processing on the visible light image and the fluorescent image to obtain a multi-mode image group and a stitched image, including: The FPGA component preprocesses the visible light image to obtain a preprocessed visible light image; and preprocesses the fluorescence image to obtain a preprocessed fluorescence image; Processing the preprocessed visible light image and the preprocessed fluorescence image by a multi-mode image processing algorithm to obtain a plurality of images in different modes; constructing the preprocessed visible light image, the preprocessed fluorescence image and the plurality of different mode images into the multi-mode image group; Processing multiple images in the multi-mode image group by a multi-mode image stitching algorithm to obtain the stitched image; The multi-mode image group and the stitched image are processed by a multi-mode image selection algorithm, and any one image in the multi-mode image group or the stitched image is selected as the image to be displayed.

8. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the computer program, the method according to claim 7 is implemented.

9. A computer-readable medium having a non-volatile program code executable by a processor, characterized in that: The program code causes the processor to execute the method of claim 7.