Scanning control method, device and system for photoacoustic and fluorescence dual-modality imaging

Abstract

The present specification relates to the technical field of multimodal imaging and provides a scanning control method, device, and system for photoacoustic and fluorescence dual-modal imaging. The system comprises: a laser; a first data acquisition card for acquiring imaging data of a target in a fluorescence mode; a second data acquisition card for acquiring imaging data of the target in a photoacoustic mode; the first data acquisition card and the second data acquisition card taking the same amount of time to complete single-frame acquisition; and a programmable logic device for, after confirming that the first data acquisition card is in a ready state, synchronously outputting a trigger signal to the first data acquisition card and the second data acquisition card when a specific edge of a laser pulse output by the laser arrives, so that the first data acquisition card and the second data acquisition card operate synchronously.

Description

Technical Field

[0001] This specification relates to the field of multimodal imaging technology, and in particular to a scanning control method, device, and system for photoacoustic and fluorescence dual-modal imaging. Background Art

[0002] With the advancement of biomedical imaging technology, single-modality imaging techniques can now depict the structure and function of living organisms at various scales, including in vivo, tissue, and molecular levels. However, single-modality representation is susceptible to interference from objective factors and has certain limitations. Therefore, the complementary integration of multimodal imaging techniques is a development trend in the field of biomedical imaging, enabling the dynamic depiction of life processes across multiple scales.

[0003] Photoacoustic-fluorescence dual-modality imaging, a type of multimodal imaging technology, can be used to obtain microscopic images of objects being examined, such as blood vessels and neurons. However, the inventors of this application have discovered that current photoacoustic-fluorescence dual-modality imaging technologies are all pseudo-real-time imaging, meaning that each modality is imaged separately (i.e., each modality is independently acquired and stored). This makes it difficult to ensure accurate synchronization of photoacoustic-fluorescence dual-modality imaging. Summary of the Invention

[0004] The purpose of the embodiments of this specification is to provide a scanning control method, device and system for photoacoustic and fluorescence dual-modality imaging to achieve accurate synchronization of photoacoustic and fluorescence dual-modality imaging.

[0005] To achieve the above objectives, on the one hand, embodiments of this specification provide a scanning control system for photoacoustic and fluorescence dual-modality imaging, comprising:

[0006] Lasers;

[0007] A first data acquisition card is used to acquire imaging data of the target in a fluorescence mode;

[0008] a second data acquisition card, configured to acquire imaging data of the target in a photoacoustic mode; wherein the first data acquisition card and the second data acquisition card require the same amount of time to complete single-frame acquisition;

[0009] The programmable logic device is used to synchronously output a trigger signal to the first data acquisition card and the second data acquisition card when a specific edge of the laser pulse output by the laser arrives after confirming that the first data acquisition card is in a ready state, so that the first data acquisition card and the second data acquisition card work synchronously.

[0010] In the scanning control system for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the programmable logic device confirms whether the first data acquisition card is in a ready state according to the following method, including:

[0011] confirming whether a ready signal output by the first data acquisition card is received;

[0012] When a ready signal output by the first data acquisition card is received, it is confirmed that the first data acquisition card is in a ready state.

[0013] In the scanning control system for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the specific edge is a rising edge.

[0014] In the scanning control system for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the synchronous output of the trigger signal to the first data acquisition card and the second data acquisition card includes:

[0015] A single trigger signal is output to the first data acquisition card so that the first data acquisition card drives the scanning galvanometer and receives the fluorescence image signal collected by the fluorescence detection device; and multiple trigger signals are synchronously output to the second data acquisition card in sequence so that the second data acquisition card receives the photoacoustic signal collected by the photoacoustic detection device.

[0016] In the scanning control system for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the programmable logic device is further used for:

[0017] After confirming that the first data acquisition card is in a ready state, a pre-trigger signal is output to the second data acquisition card to achieve memory filling of the second data acquisition card.

[0018] In the scanning control system for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the programmable logic device is further used for:

[0019] After confirming that the single-frame acquisition is completed, the first data acquisition card provides a signal indicating that the single-frame acquisition is completed to the host computer, so that the host computer reads the single-frame imaging data from the first data acquisition card and the second data acquisition card.

[0020] In the scanning control system for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the programmable logic device confirms whether single-frame acquisition is completed in the following manner:

[0021] The trigger signals output to the second data acquisition card are counted, and when the count value is equal to the number of scanning points, it is confirmed that the second data acquisition card has completed single-frame acquisition.

[0022] On the other hand, the embodiments of this specification also provide a scanning control method for photoacoustic and fluorescence dual-modality imaging, including:

[0023] confirming whether a first data acquisition card is in a ready state; the first data acquisition card is used to acquire imaging data of the target in a fluorescence mode;

[0024] When the first data acquisition card is in a ready state, detecting whether a specific edge of a laser pulse output by a laser has arrived; the laser is used to stimulate photoacoustic imaging;

[0025] When a specific edge of the laser pulse output by the laser arrives, a trigger signal is synchronously output to the first data acquisition card and the second data acquisition card, so that the first data acquisition card and the second data acquisition card work synchronously; the second data acquisition card is used to acquire imaging data of the target in the photoacoustic mode, and the time required for the first data acquisition card and the second data acquisition card to complete single-frame acquisition is the same.

[0026] In the scanning control method for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the step of confirming whether the first data acquisition card is in a ready state includes:

[0027] confirming whether a ready signal output by the first data acquisition card is received;

[0028] When a ready signal output by the first data acquisition card is received, it is confirmed that the first data acquisition card is in a ready state.

[0029] In the scanning control method for photoacoustic and fluorescence dual-modality imaging according to the embodiment of this specification, the specific edge is a rising edge.

[0030] In the scanning control method for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, the synchronous output of the trigger signal to the first data acquisition card and the second data acquisition card includes:

[0031] A single trigger signal is output to the first data acquisition card so that the first data acquisition card drives the scanning galvanometer and receives the fluorescence image signal collected by the fluorescence detection device; and multiple trigger signals are synchronously output to the second data acquisition card in sequence so that the second data acquisition card receives the photoacoustic signal collected by the photoacoustic detection device.

[0032] The scanning control method for photoacoustic and fluorescence dual-modality imaging according to the embodiment of this specification further includes:

[0033] After confirming that the first data acquisition card is in a ready state, a pre-trigger signal is output to the second data acquisition card.

[0034] The scanning control method for photoacoustic and fluorescence dual-modality imaging according to the embodiment of this specification further includes:

[0035] After confirming that the single-frame acquisition is completed, the first data acquisition card provides a signal indicating that the single-frame acquisition is completed to the host computer, so that the host computer reads the single-frame imaging data from the first data acquisition card and the second data acquisition card.

[0036] In the scanning control method for photoacoustic and fluorescence dual-modality imaging of the embodiment of this specification, whether single-frame acquisition is completed is confirmed by the following method:

[0037] counting the trigger signals output to the second data acquisition card;

[0038] When the count value is equal to the number of scanning points, it is confirmed that the single frame acquisition is completed.

[0039] On the other hand, an embodiment of this specification further provides a computer device, including a memory, a processor, and a computer program stored in the memory, wherein the computer program executes instructions of the above method when executed by the processor.

[0040] On the other hand, an embodiment of this specification further provides a computer storage medium having a computer program stored thereon, wherein the computer program executes the instructions of the above method when executed by a processor of a computer device.

[0041] On the other hand, an embodiment of this specification further provides a computer program product, which includes a computer program. When the computer program is executed by a processor of a computer device, the computer program executes the instructions of the above method.

[0042] It can be seen from the technical solutions provided in the embodiments of this specification that, in the embodiments of this specification, since the time required for the first data acquisition card and the second data acquisition card to complete single-frame acquisition is the same; for each frame, when the first data acquisition card and the second data acquisition card start acquisition synchronously, the end time for each of them to complete single-frame acquisition will also be the same, thereby ensuring accurate synchronization of photoacoustic and fluorescence dual-modality imaging; and thus, image information with strict alignment of the two modalities can be obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the following briefly introduces the drawings required for the embodiments or the description of the prior art. Obviously, the drawings described below are only some of the embodiments described in this specification. For those skilled in the art, other drawings can be obtained based on these drawings without inventive work. In the drawings:

[0044] Figure 1 Schematic diagram of a scanning control system for photoacoustic and fluorescence dual-modality imaging in some embodiments of this specification is shown;

[0045] Figure 2 A flowchart showing a scanning control method for photoacoustic and fluorescence dual-modality imaging in some embodiments of this specification is shown;

[0046] Figure 3A flowchart showing a scanning control method for photoacoustic and fluorescence dual-modality imaging in other embodiments of this specification is shown;

[0047] Figure 4 It shows a structural block diagram of a computer device in some embodiments of this specification.

[0048] [Description of Reference Numerals]

[0049] 1. Laser;

[0050] 2. Programmable logic devices;

[0051] 31. First data acquisition card;

[0052] 32. Second data acquisition card;

[0053] 4. Scanning galvanometer;

[0054] 5. Fluorescence detection devices;

[0055] 6. Photoacoustic detection devices;

[0056] 7. Host computer;

[0057] 402. Computer equipment;

[0058] 404, processor;

[0059] 406. Memory;

[0060] 408, driving mechanism;

[0061] 410, input / output interface;

[0062] 412. Input devices;

[0063] 414. Output device;

[0064] 416. Presentation equipment;

[0065] 418. Graphical User Interface;

[0066] 420, network interface;

[0067] 422, communication link;

[0068] 424. Communication bus. DETAILED DESCRIPTION

[0069] To help those skilled in the art better understand the technical solutions in this specification, the following will provide a clear and complete description of the technical solutions in the embodiments of this specification, in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of them. All other embodiments derived by those skilled in the art based on the embodiments in this specification without creative effort shall fall within the scope of protection of this specification.

[0070] Photoacoustic-fluorescence dual-modality imaging technology is one of the multimodal imaging technologies that integrates photoacoustic imaging (PAI) technology and fluorescence imaging technology. Using photoacoustic-fluorescence dual-modality imaging technology, the photoacoustic image and fluorescence image of the object being detected can be displayed simultaneously, or a fusion image formed by the fusion of the photoacoustic image and fluorescence image of the object being detected can be displayed. Photoacoustic imaging refers to the process in which when a pulsed laser emitted by a laser irradiates biological tissue, the light absorption domain of the biological tissue generates an ultrasonic signal (the ultrasonic signal generated by light excitation is generally referred to as a photoacoustic signal). The photoacoustic signal generated by biological tissue carries the light absorption characteristic information of the tissue, and by detecting the photoacoustic signal, the light absorption distribution image in the tissue can be reconstructed. Fluorescence imaging refers to the process in which a fluorescent substance is excited by specific external energy (such as high-energy rays such as lasers), causing its electron orbit to transition to a high-energy orbit, and eventually releasing energy to return to the ground state, which generates a detectable fluorescence signal. Among them, not all substances can be excited to produce fluorescence. Only when the substance has the same frequency as the excitation light and has high fluorescence efficiency after absorbing the energy instead of consuming the energy in the process of intermolecular collisions, its fluorescence signal can be detected.

[0071] Given that current photoacoustic and fluorescence dual-modality imaging technologies are difficult to ensure accurate synchronization of photoacoustic and fluorescence dual-modality imaging, the embodiments of this specification provide a technical solution that can achieve accurate synchronization of photoacoustic and fluorescence dual-modality imaging.

[0072] Figure 1 FIG2 shows a scanning control system for photoacoustic and fluorescence dual-modality imaging according to some embodiments of the present disclosure. The scanning control system may include a laser 1, a programmable logic device 2, a first data acquisition card 31, and a second data acquisition card 32.

[0073] The laser 1 is a part of the photoacoustic imaging system, and the pulsed laser it outputs can be used to stimulate photoacoustic imaging. In the embodiment of this specification, the laser 1 can also serve as a synchronization trigger signal for the scanning control system.

[0074] The first data acquisition card 31 is used to acquire imaging data of a target in a fluorescence modality. The target is the object being detected; for example, in some embodiments, the target may be biological tissue (e.g., blood vessels, neurons, etc.). Since the imaging data in the fluorescence modality is pulsed data, the first data acquisition card 31 may be a data acquisition card capable of acquiring digital signals. For example, in one exemplary embodiment, the first data acquisition card 31 may be an NI 6323 data acquisition card, etc.

[0075] The second data acquisition card 32 is used to acquire imaging data of the target in the photoacoustic modality. Given that imaging data in the fluorescence modality is an analog waveform signal, the second data acquisition card 32 can be a data acquisition card capable of acquiring analog signals. For example, in one exemplary embodiment, the second data acquisition card 32 can be an Alazar card. Furthermore, in the embodiments of this specification, the first data acquisition card 31 and the second data acquisition card 32 require the same amount of time to complete single-frame acquisition. For example, if the first data acquisition card 31 requires 2 milliseconds to complete single-frame fluorescence image acquisition, the second data acquisition card 32 also requires 2 milliseconds to complete single-frame photoacoustic image acquisition.

[0076] The programmable logic device 2 is configured to, after confirming that the first data acquisition card 31 is in a ready state, synchronously output a trigger signal to the first data acquisition card 31 and the second data acquisition card 32 when a specific edge (e.g., a rising edge) of the laser pulse output by the laser 1 arrives, thereby causing the first data acquisition card 31 and the second data acquisition card 32 to operate synchronously. In some embodiments, the programmable logic device 2 may be, for example, a field programmable gate array (FPGA).

[0077] In the embodiment of the present specification, the first data acquisition card 31 operates in a frame-by-frame mode. In this mode, the programmable logic device 2 provides a trigger signal to the first data acquisition card 31, and the first data acquisition card 31 can automatically complete the scanning and acquisition of a frame of data. Therefore, before sampling each frame, it is necessary to determine whether the first data acquisition card 31 is in a ready state (i.e., ready to go). The second data acquisition card 32 operates in a point-by-point mode, and the sampling time of a single point is very short. In this mode, the programmable logic device 2 needs to sequentially provide multiple trigger signals to the second data acquisition card 32, and the second data acquisition card 32 can complete the scanning and acquisition of a frame of data. Therefore, before sampling each frame, it is not necessary to determine whether the second data acquisition card 32 is in a ready state.

[0078] In some embodiments, the programmable logic device 2 can confirm whether the first data acquisition card 31 is in a ready state according to the following methods:

[0079] Confirm whether a ready signal is received from the first data acquisition card 31. When the ready signal is received, the first data acquisition card 31 is confirmed to be in the ready state. When the first data acquisition card 31 is ready, it outputs a rising edge signal to the programmable logic device 2 via the IO port. When the programmable logic device 2 detects this rising edge signal, it confirms that the first data acquisition card 31 is ready for sampling.

[0080] In some embodiments, taking the rising edge of a laser pulse as an example, when the programmable logic device 2 detects that the laser 1 has output a rising edge, it can immediately output a single trigger signal to the first data acquisition card 31, causing the first data acquisition card 31 to drive the scanning galvanometer 4 and receive the fluorescence image signal collected by the fluorescence detection device 5. It can also synchronously output multiple trigger signals in sequence to the second data acquisition card 32, causing the second data acquisition card to receive the photoacoustic signal collected by the photoacoustic detection device 6. Sequentially outputting multiple trigger signals means: first outputting the first trigger signal, then the second trigger signal, then the third trigger signal, and so on, recursively until the number of trigger signals output reaches a specified value. Because the first data acquisition card 31 and the second data acquisition card 32 require the same time to complete single-frame acquisition, for each frame, when the first data acquisition card 31 and the second data acquisition card 32 synchronously begin acquisition, the end time for each to complete single-frame acquisition is also the same, thereby ensuring accurate synchronization of photoacoustic and fluorescence dual-modality imaging, thereby obtaining image information with strict registration of the two modalities.

[0081] Among them, the scanning galvanometer 4 is used to achieve graphical scanning or image scanning. The fluorescence detection device 5 is used to convert the detected fluorescence (optical signal) reflecting the target image into a fluorescence signal (electrical signal). The scanning galvanometer 4 and the fluorescence detection device 5 are both part of the fluorescence imaging system. In some embodiments, the scanning galvanometer 4 can be, for example, a micro-electro-mechanical system (MEMS) galvanometer; the fluorescence detection device 5 can be, for example, a photomultiplier tube, etc. The photoacoustic detection device 6 is used to convert the detected ultrasound (pressure wave) reflecting the target image into a photoacoustic signal. In some embodiments, the photoacoustic detection device 6 can be, for example, an ultrasonic detector.

[0082] In some embodiments, the programmable logic device 2 can also be configured to output a pre-trigger signal to the second data acquisition card 32 after confirming that the first data acquisition card 31 is in a ready state, thereby filling the memory of the second data acquisition card. This can help ensure the subsequent normal reading of the data cached by the second data acquisition card. On this basis, it is then determined whether a specific edge of the laser pulse output by the laser 1 has arrived.

[0083] In some embodiments, the programmable logic device 2 can also be configured to, after confirming the completion of single-frame acquisition, provide a signal indicating the completion of single-frame acquisition to the host computer 7 via the first data acquisition card 31, so that the host computer 7 reads the imaging data of the single frame from the first data acquisition card 31 and the second data acquisition card 32, performs image reconstruction processing (e.g., image reconstruction processing based on LabVIEW), and then outputs the data to the display screen for display. This ensures synchronization between each frame acquisition and output display, and facilitates subsequent expansion of the system.

[0084] In some embodiments, the host computer 7 may output the target's fluorescence image to one or more display screens for display, and simultaneously output the target's photoacoustic image to another or more display screens for display. In other embodiments, the host computer 7 may also fuse the target's fluorescence image and photoacoustic image into a fused image, and then output the fused image to one or more display screens for display. The specific method may be selected based on actual needs.

[0085] In some embodiments, the programmable logic device 2 can confirm whether single-frame acquisition is completed by counting the trigger signals output to the second data acquisition card 32, and when the count value is equal to the number of scanning points, confirming that the second data acquisition card 32 has completed single-frame acquisition.

[0086] The present invention provides a scanning control method for photoacoustic and fluorescence dual-modality imaging, which can be applied to the programmable logic device side of the above scanning control system. Figure 2 As shown, in some embodiments, the scanning control method of photoacoustic and fluorescence dual-modality imaging may include the following steps:

[0087] Step 201: confirm whether the first data acquisition card is in a ready state.

[0088] Step 202: When the first data acquisition card is in a ready state, detect whether a specific edge of a laser pulse output by a laser arrives.

[0089] Step 203: When a specific edge of the laser pulse output by the laser arrives, a trigger signal is synchronously output to the first data acquisition card and the second data acquisition card, so that the first data acquisition card and the second data acquisition card work synchronously.

[0090] In the embodiments of the present specification, since the time required for the first data acquisition card and the second data acquisition card to complete single-frame acquisition is the same; for each frame, when the first data acquisition card and the second data acquisition card start acquisition synchronously, the end time for each of them to complete single-frame acquisition will also be the same, thereby ensuring accurate synchronization of photoacoustic and fluorescence dual-modality imaging; and thus, image information with strict alignment of the two modalities can be obtained.

[0091] In some embodiments, confirming whether the first data acquisition card is in a ready state may include:

[0092] confirming whether a ready signal output by the first data acquisition card is received;

[0093] When a ready signal output by the first data acquisition card is received, it is confirmed that the first data acquisition card is in a ready state.

[0094] In some embodiments, the specific edge is a rising edge.

[0095] In some embodiments, the synchronously outputting a trigger signal to the first data acquisition card and the second data acquisition card includes:

[0096] A single trigger signal is output to the first data acquisition card so that the first data acquisition card drives the scanning galvanometer and receives the fluorescence image signal collected by the fluorescence detection device; and multiple trigger signals are synchronously output to the second data acquisition card in sequence so that the second data acquisition card receives the photoacoustic signal collected by the photoacoustic detection device.

[0097] The present invention provides another scanning control method for photoacoustic and fluorescence dual-modality imaging, which can be applied to the programmable logic device side of the above scanning control system. Figure 3 As shown, in other embodiments, the scanning control method of photoacoustic and fluorescence dual-modality imaging may include the following steps:

[0098] Step 301: confirm whether the first data acquisition card is in the ready state; when the first data acquisition card is in the ready state, execute step 302; otherwise, continue to determine whether the first data acquisition card is in the ready state.

[0099] Step 302: Output a pre-trigger signal to the second data acquisition card.

[0100] Step 303 , detecting whether a specific edge of the laser pulse output by the laser has arrived; if the specific edge of the laser pulse output by the laser has arrived, executing step 304 ; otherwise, continuing the detection.

[0101] Step 304: synchronously output a trigger signal to the first data acquisition card and the second data acquisition card, so that the first data acquisition card and the second data acquisition card work synchronously.

[0102] Step 305 , confirm whether the single-frame acquisition is completed; if the single-frame acquisition is completed, execute step 306 ; otherwise, continue to determine whether the single-frame acquisition is completed.

[0103] For example, the trigger signals output to the second data acquisition card are counted; when the count value is equal to the number of scanning points, it is confirmed that the single-frame acquisition is completed; otherwise, it is confirmed that the single-frame acquisition is not completed.

[0104] Step 306: Provide a signal indicating completion of single-frame acquisition to a host computer through the first data acquisition card, so that the host computer reads single-frame imaging data from the first data acquisition card and the second data acquisition card.

[0105] Step 307: confirm whether the acquisition of all frames is completed; if the acquisition of all frames is not completed, execute step 303; otherwise, end.

[0106] In the embodiment of the present specification, whether all frames have been captured can be confirmed based on user needs. For example, before detecting that the user has shut down the system, it is confirmed that all frames have not been captured; when detecting that the user has shut down the system, it is confirmed that all frames have been captured.

[0107] For the convenience of description, the above devices are described as being divided into various units according to their functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0108] Although the process flows described above include multiple operations occurring in a particular order, it should be understood that these processes may include more or fewer operations, which may be performed sequentially or in parallel (eg, using parallel processors or a multi-threaded environment).

[0109] It should be noted that in the embodiments of this specification, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user and fully authorized by all parties.

[0110] The embodiment of this specification also provides a computer device. Figure 4As shown, in some embodiments of this specification, the computer device 402 may include one or more processors 404, such as one or more central processing units (CPUs) or graphics processing units (GPUs), each of which may implement one or more hardware threads. The computer device 402 may also include any memory 406 for storing any type of information, such as code, settings, data, etc. In one specific embodiment, the memory 406 may contain a computer program executable on the processor 404. When executed by the processor 404, the computer program may execute instructions for the scanning control method for photoacoustic and fluorescence dual-modality imaging described in any of the above embodiments. For example, and without limitation, the memory 406 may include any one or more combinations of the following: any type of RAM, any type of ROM, a flash memory device, a hard disk, an optical disk, etc. More generally, any memory may use any technology to store information. Furthermore, any memory may provide volatile or non-volatile retention of information. Furthermore, any memory may represent a fixed or removable component of the computer device 402. In one embodiment, when the processor 404 executes the associated instructions stored in any memory or combination of memories, the computer device 402 can perform any operation of the associated instructions. The computer device 402 also includes one or more drive mechanisms 408 for interacting with any memory, such as a hard disk drive mechanism, an optical disk drive mechanism, etc.

[0111] The computer device 402 may also include an input / output interface 410 (I / O) for receiving various inputs (via input devices 412) and for providing various outputs (via output devices 414). A specific output mechanism may include a presentation device 416 and an associated graphical user interface 418 (GUI). In other embodiments, the input / output interface 410 (I / O), input devices 412, and output devices 414 may not be included, and the computer device 402 may simply be a computer device in a network. The computer device 402 may also include one or more network interfaces 420 for exchanging data with other devices via one or more communication links 422. One or more communication buses 424 couple the components described above together.

[0112] The communication link 422 can be implemented in any manner, for example, through a local area network, a wide area network (e.g., the Internet), a point-to-point connection, etc., or any combination thereof. The communication link 422 can include any combination of hardwired links, wireless links, routers, gateway functions, name servers, etc., governed by any protocol or combination of protocols.

[0113] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), computer-readable storage media, and computer program products of some embodiments of the present specification. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processor to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processor generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0114] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processor to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, the instruction device being implemented in the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0115] These computer program instructions can also be loaded onto a computer or other programmable data processor so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0116] In a typical configuration, a computer device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0117] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.

[0118] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computer device. As defined in this specification, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0119] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, the embodiments of this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the embodiments of this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0120] Embodiments of this specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, and the like that perform specific tasks or implement specific abstract data types. Embodiments of this specification may also be practiced in distributed computing environments where tasks are performed by remote processors connected via a communications network. In distributed computing environments, program modules may be located in local and remote computer storage media, including storage devices.

[0121] It should also be understood that in the embodiments of this specification, the term "and / or" is merely a description of the association relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. Furthermore, the character " / " in this document generally indicates that the associated objects are in an "or" relationship.

[0122] The various embodiments in this specification are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiments are generally similar to the method embodiments, so the description is relatively simple. For relevant parts, refer to the description of the method embodiments.

[0123] In the description of this specification, the reference terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the embodiments of this specification. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.

[0124] The foregoing is merely an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present application should be included within the scope of the claims of the present application.

Claims

1. A scanning control system for photoacoustic and fluorescence dual-modality imaging, characterized in that: include: Lasers; A first data acquisition card is used to acquire imaging data of the target in a fluorescence mode; a second data acquisition card, configured to acquire imaging data of the target in a photoacoustic mode; wherein the first data acquisition card and the second data acquisition card require the same amount of time to complete single-frame acquisition; a programmable logic device, configured to, after confirming that the first data acquisition card is in a ready state, synchronously output a trigger signal to the first data acquisition card and the second data acquisition card when a specific edge of the laser pulse output by the laser arrives, so as to enable the first data acquisition card and the second data acquisition card to operate synchronously; The synchronously outputting a trigger signal to the first data acquisition card and the second data acquisition card comprises: Outputting a single trigger signal to the first data acquisition card so that the first data acquisition card drives a scanning galvanometer and receives a fluorescence image signal collected by a fluorescence detection device; and synchronously outputting multiple trigger signals in sequence to the second data acquisition card so that the second data acquisition card receives a photoacoustic signal collected by a photoacoustic detection device, wherein outputting multiple trigger signals in sequence means: first outputting a first trigger signal, then outputting a second trigger signal, then outputting a third trigger signal, and so on recursively until the number of output trigger signals reaches a specified value.

2. The scanning control system for photoacoustic and fluorescence dual-modality imaging according to claim 1, wherein: The programmable logic device confirms whether the first data acquisition card is in a ready state according to the following method, including: confirming whether a ready signal output by the first data acquisition card is received; When a ready signal output by the first data acquisition card is received, it is confirmed that the first data acquisition card is in a ready state.

3. The scanning control system for photoacoustic and fluorescence dual-modality imaging according to claim 1, wherein: The specific edge is a rising edge.

4. The scanning control system for photoacoustic and fluorescence dual-modality imaging according to claim 1, wherein: The programmable logic device is further used for: After confirming that the first data acquisition card is in a ready state, a pre-trigger signal is output to the second data acquisition card to achieve memory filling of the second data acquisition card.

5. The scanning control system for photoacoustic and fluorescence dual-modality imaging according to claim 1, wherein: The programmable logic device is further used for: After confirming that the single-frame acquisition is completed, the first data acquisition card provides a signal indicating that the single-frame acquisition is completed to the host computer, so that the host computer reads the single-frame imaging data from the first data acquisition card and the second data acquisition card.

6. The scanning control system for photoacoustic and fluorescence dual-modality imaging according to claim 5, characterized in that: The programmable logic device confirms whether the single frame acquisition is completed in the following manner: The trigger signals output to the second data acquisition card are counted, and when the count value is equal to the number of scanning points, it is confirmed that the second data acquisition card has completed single-frame acquisition.

7. A scanning control method for photoacoustic and fluorescence dual-modality imaging, characterized in that: include: Confirm whether the first data acquisition card is in a ready state; The first data acquisition card is used to acquire imaging data of the target in a fluorescence mode; When the first data acquisition card is in a ready state, detecting whether a specific edge of a laser pulse output by the laser arrives; The laser is used to stimulate photoacoustic imaging; When a specific edge of the laser pulse output by the laser arrives, a trigger signal is synchronously output to the first data acquisition card and the second data acquisition card, so that the first data acquisition card and the second data acquisition card work synchronously; the second data acquisition card is used to acquire imaging data of the target in the photoacoustic mode, and the time required for the first data acquisition card and the second data acquisition card to complete single-frame acquisition is the same; The synchronously outputting a trigger signal to the first data acquisition card and the second data acquisition card comprises: Outputting a single trigger signal to the first data acquisition card so that the first data acquisition card drives a scanning galvanometer and receives a fluorescence image signal collected by a fluorescence detection device; and synchronously outputting multiple trigger signals in sequence to the second data acquisition card so that the second data acquisition card receives a photoacoustic signal collected by a photoacoustic detection device, wherein outputting multiple trigger signals in sequence means: first outputting a first trigger signal, then outputting a second trigger signal, then outputting a third trigger signal, and so on recursively until the number of output trigger signals reaches a specified value.

8. The scanning control method for photoacoustic and fluorescence dual-modality imaging according to claim 7, wherein: The step of confirming whether the first data acquisition card is in a ready state includes: confirming whether a ready signal output by the first data acquisition card is received; When a ready signal output by the first data acquisition card is received, it is confirmed that the first data acquisition card is in a ready state.

9. The scanning control method for photoacoustic and fluorescence dual-modality imaging according to claim 7, wherein: The specific edge is a rising edge.

10. The scanning control method for photoacoustic and fluorescence dual-modality imaging according to claim 7, wherein: Also includes: After confirming that the first data acquisition card is in a ready state, a pre-trigger signal is output to the second data acquisition card.

11. The scanning control method for photoacoustic and fluorescence dual-modality imaging according to claim 7, wherein: Also includes: After confirming that the single-frame acquisition is completed, the first data acquisition card provides a signal indicating that the single-frame acquisition is completed to the host computer, so that the host computer reads the single-frame imaging data from the first data acquisition card and the second data acquisition card.

12. The scanning control method for photoacoustic and fluorescence dual-modality imaging according to claim 11, wherein: Confirm whether single-frame acquisition is complete by the following methods: counting the trigger signals output to the second data acquisition card; When the count value is equal to the number of scanning points, it is confirmed that the single frame acquisition is completed.

13. A computer device comprising a memory, a processor, and a computer program stored in the memory, characterized in that: When the computer program is executed by the processor, the computer program executes the instructions of the method according to any one of claims 7 to 12.

14. A computer storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor of a computer device, the computer program executes the instructions of the method according to any one of claims 7 to 12.

15. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program executes instructions of the method according to any one of claims 7 to 12.

Images