Ophthalmologic video image processing method, processing device and processing equipment

Abstract

The invention discloses an ophthalmology video image processing method, device and equipment, and the method comprises the following steps: S100, collecting an ophthalmology video image at a preset frame frequency through an image collection unit, and transmitting each frame of ophthalmology image in the collected ophthalmology video image; s200, performing alignment and registration on the ophthalmological images based on a registration structure determined in a reference frame ophthalmological image to screen the ophthalmological images, and generating a static video image and a dynamic video image based on the screened ophthalmological images; and S300, presenting a static video image and / or a dynamic video image corresponding to a specified position based on the specified position in the reference frame ophthalmic image.

Description

Technical Field

[0001] This disclosure generally relates to the field of ophthalmic imaging technology, and more specifically, to a method, apparatus, and device for processing ophthalmic video images. Background Technology

[0002] The eye is the human visual organ, and fundus images have significant reference value in clinical diagnosis and treatment in ophthalmology. Currently, fundus images are typically acquired using fundus angiography, specialized digital cameras, and specialized acquisition equipment to obtain high-resolution fundus images. Clinically, the fundus refers to the collective term for the eyeball wall composed of the retina, choroid, sclera, and the intraocular segment of the optic nerve, as well as the vitreous humor closely connected to it. The retinal vessels in the fundus are the only blood vessels in the human body that can be directly observed non-invasively, and they include the three major blood vessels in the human body: arteries, veins, and capillaries. The health of the body can be reflected through blood vessels. Therefore, fundus examination is not only an important means of examining diseases of the vitreous body, retina, choroid, and optic nerve, but also an important means of examining certain systemic diseases such as those of the brain, cardiovascular system, blood, and endocrine system. Its examination has certain preliminary reference value for the diagnosis of some systemic diseases. Summary of the Invention

[0003] This disclosure provides a method for processing ophthalmic video images, including the following steps:

[0004] S100: The image acquisition unit acquires ophthalmic video images at a predetermined frame rate, and transmits each frame of ophthalmic image in the acquired ophthalmic video images.

[0005] S200: The ophthalmic images are aligned and registered based on the registration structure determined in the reference frame ophthalmic image to filter the ophthalmic images; static video images and dynamic video images are generated based on the filtered ophthalmic images; and

[0006] S300: Based on the specified location in the ophthalmic image of the reference frame, present the static video image and / or dynamic video image corresponding to the specified location shown.

[0007] In some embodiments, the process of aligning and registering the ophthalmic images based on the registration structure determined in the reference frame ophthalmic image to filter the ophthalmic images, and generating static and dynamic video images based on the filtered ophthalmic images, includes the following steps:

[0008] S210: Select a reference frame ophthalmic image and determine the registration structure in the reference frame ophthalmic image;

[0009] S220: Using alignment and registration technology, qualified ophthalmic images are selected from the ophthalmic images, and static and dynamic components are marked in the qualified ophthalmic images;

[0010] S230: Generate and store static and dynamic video images based on the static and dynamic components.

[0011] In some embodiments, selecting a reference frame ophthalmic image and determining the registration structure in the reference frame ophthalmic image includes the following steps:

[0012] S211: Select a frame of ophthalmic image from the ophthalmic video images or a previously acquired frame of ophthalmic image of the same patient as the reference frame ophthalmic image;

[0013] S212: Select at least a portion of the structures in the reference frame ophthalmic image that are stable in the time dimension as the registration structure of the reference frame ophthalmic image.

[0014] In some embodiments, selecting qualified ophthalmic images from the ophthalmic images using alignment and registration techniques, and marking static and dynamic components in the qualified ophthalmic images, includes the following steps:

[0015] S221: Receive the current frame ophthalmic image from the ophthalmic video image;

[0016] S222: Calculate the registration fit between the current frame ophthalmic image and the reference frame ophthalmic image. If the fit is below a threshold, discard the current frame ophthalmic image. If the fit is below a threshold, determine the static and dynamic components in the current frame ophthalmic image.

[0017] S223: Repeat steps S221 and S222 until all ophthalmic images of the acquired ophthalmic video images have been traversed.

[0018] In some embodiments, calculating the registration fit between the current frame ophthalmic image and the reference frame ophthalmic image includes:

[0019] S2221: Extract the registration structure corresponding to the registration structure of the reference frame ophthalmic image from the current frame ophthalmic image;

[0020] S2222: Estimate the spatial alignment transformation field between the current frame ophthalmic image and the reference frame ophthalmic image using image registration technology, and perform alignment transformation operation on the current frame ophthalmic image;

[0021] S2223: Calculate the degree of registration fit between the current frame ophthalmic image and the reference frame ophthalmic image based on the registration structure of the current frame ophthalmic image after alignment transformation and the registration structure of the reference frame ophthalmic image.

[0022] In some embodiments, determining the static and dynamic components of the ophthalmic image in the current frame includes:

[0023] The registration structure of the current frame ophthalmology image after alignment transformation is taken as the static component of the current frame ophthalmology image, and the unregistered structure of the current frame ophthalmology image after alignment transformation is taken as the dynamic component of the current frame ophthalmology image.

[0024] In some embodiments, generating and storing static and dynamic video images based on the static and dynamic components includes the following steps:

[0025] S231: Generate static video images from the static components of the selected ophthalmic images arranged in chronological order and store them;

[0026] S232: Generate dynamic video images from the dynamic components of the selected ophthalmic images arranged in chronological order and store them.

[0027] In some embodiments, presenting the static video image and / or dynamic video image corresponding to the specified location based on the specified location in the reference frame ophthalmic image includes the following steps:

[0028] S310: The reference frame ophthalmic image is displayed in the human-computer interaction interface, and the human-computer interaction interface prompts the user that the video image can be viewed;

[0029] S320: In response to the user selecting a specified location in the reference frame ophthalmic image, a video playback window is presented at the specified location, and the video playback window plays a corresponding static video image and / or dynamic video image of a local area centered on the specified location.

[0030] This disclosure provides an ophthalmic video image processing apparatus according to some embodiments, the processing apparatus comprising:

[0031] The image acquisition unit is configured to acquire ophthalmic video images at a predetermined frame rate and to transmit each frame of ophthalmic image in the acquired ophthalmic video images.

[0032] The filtering processing unit is configured to perform alignment and registration on the ophthalmic images based on the registration structure determined in the reference frame ophthalmic images to filter the ophthalmic images, and generate static video images and dynamic video images based on the filtered ophthalmic images; and

[0033] The presentation unit is configured to present static and / or dynamic video images corresponding to a specified location in the ophthalmic image of the reference frame.

[0034] This disclosure provides an ophthalmic video image processing device, including a processor and a memory. The memory stores computer program instructions that can be executed by the processor. When the processor executes the computer program instructions, it implements the method steps described in the foregoing embodiments.

[0035] According to the technical solution of the embodiments of this disclosure, ophthalmic video images are acquired at a predetermined frame rate. The registration structure determined in the reference frame ophthalmic image of each frame of the ophthalmic video image is aligned, registered, and filtered. Qualified ophthalmic images are selected to generate static video images and dynamic video images. The corresponding static video images and / or dynamic video images are presented based on the specified position of the reference frame ophthalmic image. This facilitates medical personnel to observe the continuous changes in their region of interest, so as to make accurate diagnoses, improve the interactive experience, and improve the efficiency of clinical diagnosis and treatment. Attached Figure Description

[0036] The above and other features of this disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, wherein:

[0037] Figure 1 A flowchart illustrating a method for processing ophthalmic video images provided in some embodiments of this disclosure;

[0038] Figure 2 for Figure 1 The detailed flowchart of step S200;

[0039] Figure 3 for Figure 1 The detailed flowchart of step S210;

[0040] Figure 4 for Figure 2 The detailed flowchart of step S220;

[0041] Figure 5 for Figure 4 The detailed flowchart of step S222;

[0042] Figure 6 for Figure 2 The detailed flowchart of step S230;

[0043] Figure 7 for Figure 1 The detailed flowchart of step S300;

[0044] Figure 8 for Figure 1 A schematic diagram of the scenario corresponding to step S300 in the middle section;

[0045] Figure 9 A schematic diagram of the module structure of an ophthalmic video image processing apparatus provided in some embodiments of this disclosure;

[0046] Figure 10 Electronic structural diagram of an ophthalmic video image processing apparatus provided in some embodiments of this disclosure.

[0047] In the accompanying drawings, identical or similar structures are identified by the same or similar reference numerals. Detailed Implementation

[0048] To make the objectives, technical solutions, and advantages of this disclosure clearer, the disclosure will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0049] The terminology used in the embodiments of this disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of this disclosure. The singular forms “a,” “the,” and “the” as used in the embodiments of this disclosure and the appended claims are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.

[0050] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0051] It should be understood that although the terms first, second, third, etc., may be used to describe structures in the embodiments of this disclosure, these structures should not be limited to these terms. These terms are only used to distinguish different structures. For example, without departing from the scope of the embodiments of this disclosure, a first component may also be referred to as a second component, and similarly, a second component may also be referred to as a first component.

[0052] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0053] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or device. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or device that includes said element.

[0054] In related technologies, medical personnel usually diagnose patients by observing static fundus images. However, some dynamic changes in the human eye cannot be observed concretely, resulting in a single diagnostic method and requiring a high level of experience and judgment from medical personnel.

[0055] To overcome the above problems, this disclosure provides a method for processing ophthalmic video images, comprising the following steps: S100: acquiring ophthalmic video images at a predetermined frame rate using an image acquisition unit, and transmitting each frame of the acquired ophthalmic video images; S200: aligning and registering the ophthalmic images based on a registration structure determined in a reference frame ophthalmic image to filter the ophthalmic images, and generating static video images and dynamic video images based on the filtered ophthalmic images; and S300: presenting the static video image and / or dynamic video image corresponding to a specified position in the reference frame ophthalmic image.

[0056] In this disclosure, ophthalmic video images are acquired at a predetermined frame rate. The registration structure determined in the reference frame ophthalmic image of each frame of the ophthalmic video image is aligned, registered, and filtered. Qualified ophthalmic images are selected to generate static and dynamic video images. The corresponding static and / or dynamic video images are presented based on the specified positions of the reference frame ophthalmic image. This facilitates medical personnel to observe the continuous changes in their regions of interest, enabling accurate diagnosis, improving the interactive experience, and increasing the efficiency of clinical diagnosis and treatment.

[0057] The specific embodiments of this disclosure are described in detail below with reference to the accompanying drawings.

[0058] Figure 1 This is a flowchart illustrating a method for processing ophthalmic video images provided in some embodiments of this disclosure. For example... Figure 1 As shown, some embodiments of this disclosure provide a method for processing ophthalmic video images, the method comprising the following steps:

[0059] S100: The image acquisition unit acquires ophthalmic video images at a predetermined frame rate, and transmits each frame of ophthalmic image in the acquired ophthalmic video images.

[0060] S200: The ophthalmic images are aligned and registered based on the registration structure determined in the reference frame ophthalmic image to filter the ophthalmic images, and static video images and dynamic video images are generated based on the filtered ophthalmic images.

[0061] S300: Based on the specified location in the ophthalmic image of the reference frame, present the static video image and / or dynamic video image corresponding to the specified location shown.

[0062] In step S100, the ophthalmic device starts operating, and its image acquisition unit, such as a high-precision fundus camera, begins to acquire ophthalmic video images at a predetermined frame rate, and transmits each frame of ophthalmic image in the ophthalmic video images to the screening and processing unit in real time; when the acquisition ends, the imaging module can also transmit the end signal to the screening and processing unit.

[0063] Figure 2 for Figure 1 A detailed flowchart of step S200 is provided in some embodiments, such as... Figure 2 As shown, step S200: The process of aligning and registering the ophthalmic images based on the registration structure determined in the reference frame ophthalmic image to filter the ophthalmic images, and generating static and dynamic video images based on the filtered ophthalmic images, includes the following steps:

[0064] S210: Select a reference frame ophthalmic image and determine the registration structure in the reference frame ophthalmic image;

[0065] S220: Using alignment and registration technology, qualified ophthalmic images are selected from the ophthalmic images, and static and dynamic components are marked in the qualified ophthalmic images;

[0066] S230: Generate and store static and dynamic video images based on the static and dynamic components.

[0067] Figure 3 for Figure 1 A detailed flowchart of step S210 is provided in some embodiments, such as... Figure 3 As shown, step S210: Selecting a reference frame ophthalmic image and determining the registration structure in the reference frame ophthalmic image includes the following steps:

[0068] S211: Select a frame of ophthalmic image from the ophthalmic video images or a previously acquired frame of ophthalmic image of the same patient as the reference frame ophthalmic image;

[0069] S212: Select at least a portion of the structures in the reference frame ophthalmic image that are stable in the time dimension as the registration structure of the reference frame ophthalmic image.

[0070] In step S211, the reference frame ophthalmic image provides a reference system containing a specified registration structure and a corresponding spatial coordinate system. Using the reference frame ophthalmic image, each frame of the ophthalmic video image can be mapped to a unified reference system, achieving temporal and spatial consistency. In some embodiments, the reference frame ophthalmic image can be selected from a single frame of the current ophthalmic video image, or it can use other external ophthalmic images, such as a frame from an ophthalmic video image of the same patient taken using the same imaging principle, or an ophthalmic image of the same patient acquired using a different imaging principle. This application does not limit the method of acquiring the reference frame ophthalmic image, as long as it has a consistent, stable, and registerable spatial structure with the ophthalmic video image frame.

[0071] In step S212, after specifying the reference frame ophthalmic image, it is necessary to specify the structure in the reference frame ophthalmic image used for registration, hereinafter referred to as the registration structure, which is the structure used for spatial alignment during registration. This application does not restrict the specific selection of the registration structure, but requires that such structure has temporal and spatial consistency, that is, no significant structural changes occur during the acquisition of ophthalmic video images. Appropriate registration structures include, but are not limited to, blood vessels, well-defined tissue structures, stable lesions, etc. These registration structures represent static components in ophthalmic videos, that is, structural stability in the temporal dimension. In contrast, there are dynamic components in ophthalmic videos, that is, those that will undergo significant structural changes in the temporal dimension, such as pulsating tissue, solid floating objects, etc.

[0072] Figure 4 for Figure 2 A detailed flowchart of step S220 is provided in some embodiments, such as... Figure 4 As shown, step S220 uses alignment and registration technology to screen qualified ophthalmic images from the ophthalmic images, and marks static and dynamic components in the qualified ophthalmic images, including the following steps:

[0073] S221: Receive the current frame ophthalmic image from the ophthalmic video image;

[0074] S222: Calculate the registration fit between the current frame ophthalmological image and the reference frame ophthalmological image. If the fit is lower than a threshold, discard the current frame ophthalmological image. If the fit is lower than a threshold, determine the static and dynamic components in the current frame ophthalmological image.

[0075] S223: Repeat steps S221 and S222 until all ophthalmic images of the acquired ophthalmic video images have been traversed.

[0076] In step S221, the filtering and processing unit receives each frame of ophthalmic image from the ophthalmic video image acquired by the image acquisition unit in chronological order.

[0077] In step S222, the current frame ophthalmic image and the reference frame ophthalmic image are aligned and registered. Then, the degree of registration fit between the current frame ophthalmic image and the reference frame ophthalmic image is determined by calculation. If the degree of fit is lower than a threshold, it indicates that the registration effect between the current frame ophthalmic image and the reference frame ophthalmic image is not good, and the current frame ophthalmic image is discarded to avoid adverse effects on the subsequent presentation effect. If the degree of fit is lower than a threshold, it indicates that the registration effect between the current frame ophthalmic image and the reference frame ophthalmic image is not good. Next, the static and dynamic components in the current frame ophthalmic image are determined.

[0078] Figure 5 for Figure 4 The detailed flowchart of step S222 is as follows: Figure 5 As shown, in some embodiments, in step S222, calculating the registration fit between the current frame ophthalmic image and the reference frame ophthalmic image specifically includes:

[0079] S2221: Extract the registration structure corresponding to the registration structure of the reference frame ophthalmic image from the current frame ophthalmic image;

[0080] S2222: Estimate the spatial alignment transformation field between the current frame ophthalmic image and the reference frame ophthalmic image using image registration technology, and perform alignment transformation operation on the current frame ophthalmic image;

[0081] S2223: Calculate the degree of registration fit between the current frame ophthalmic image and the reference frame ophthalmic image based on the registration structure of the current frame ophthalmic image after alignment transformation and the registration structure of the reference frame ophthalmic image.

[0082] In step S2221, image recognition technology is used to extract the registration structure corresponding to the registration structure of the reference frame ophthalmic image in the current frame ophthalmic image. The registration structure includes, for example, blood vessels, well-defined tissue structures and / or stable lesions.

[0083] In step S2222, image registration techniques are used to align and register the current frame ophthalmic image with the reference frame ophthalmic image. Image registration techniques include, but are not limited to, homography registration based on key points and descriptors, pixel offset field estimation, and phase correlation methods; no specific method is limited here. Specifically, image registration techniques are used to estimate the spatial alignment transformation field between the current frame ophthalmic image and the reference frame ophthalmic image, and an alignment transformation operation is performed on the current frame ophthalmic image.

[0084] In step S2223, the registration fit is calculated using the registration structure of the current frame ophthalmic image after alignment transformation and the registration structure of the reference frame ophthalmic image. The method for calculating the registration fit includes, but is not limited to, pixel intersection-over-union ratio and symmetric Hausdorff distance. A higher registration fit indicates a better registration effect, while a lower registration fit indicates a worse registration effect.

[0085] In this embodiment of the disclosure, a current frame ophthalmology image with good registration effect with the registration structure of the reference frame ophthalmology image is selected by pre-setting a registration fit threshold, and current frame ophthalmology images with poor registration effect are discarded.

[0086] In some embodiments, determining the static and dynamic components of the ophthalmic image in the current frame includes: using the registration structure of the ophthalmic image in the current frame after alignment transformation as the static component of the ophthalmic image in the current frame, and using the unregistered structure of the ophthalmic image in the current frame after alignment transformation as the dynamic component of the ophthalmic image in the current frame.

[0087] Specifically, the ophthalmological images in the current frame that meet the registration effect requirements are processed. The registration structure of the ophthalmological image in the current frame after alignment transformation is defined as the static component of the ophthalmological image in the current frame, and the non-registration structure of the ophthalmological image in the current frame after alignment transformation is defined as the dynamic component of the ophthalmological image in the current frame.

[0088] In step S223, steps S221 and S222 are repeated until all ophthalmic images of the acquired ophthalmic video images are traversed, all ophthalmic images that meet the registration effect requirements are filtered, the static and dynamic components in them after alignment transformation are determined, and temporarily stored.

[0089] Figure 6 for Figure 2 The detailed flowchart of step S230 is as follows: Figure 6 As shown, in some embodiments, step 230: generating and storing static and dynamic video images based on the static and dynamic components includes the following steps:

[0090] S231: Generate static video images from the static components of the selected ophthalmic images arranged in chronological order and store them;

[0091] S232: Generate dynamic video images from the dynamic components of the selected ophthalmic images arranged in chronological order and store them.

[0092] In step S231, the static components of the temporarily stored selected ophthalmic images are arranged in chronological order to generate static video images and stored as static video image files.

[0093] In step S232, the dynamic components of the temporarily stored selected ophthalmic images are arranged in chronological order to generate dynamic video images and stored as dynamic video image files.

[0094] Figure 7 for Figure 1 The detailed flowchart of step S300 is as follows: Figure 8 for Figure 1 A schematic diagram of the scenario corresponding to step S300 is shown below. Figure 7 and Figure 8 As shown, step S300: presenting a static video image and / or a dynamic video image corresponding to a specified location in the reference frame ophthalmic image includes the following steps:

[0095] S310: The reference frame ophthalmic image is displayed in the human-computer interaction interface, and the human-computer interaction interface prompts the user that the video image can be viewed;

[0096] Specifically, the human-computer interface is, for example, the display interface of a display device, which presents, for example, a reference frame ophthalmic image, such as a fundus image. The human-computer interface prompts the user, for example, medical personnel, to view video images at any selected location.

[0097] S320: In response to the user selecting a specified location in the reference frame ophthalmic image, a video playback window is presented at the specified location, and the video playback window plays a corresponding static video image and / or dynamic video image of a local area centered on the specified location.

[0098] Specifically, when a user, such as a medical professional, selects a specific location P in the reference frame ophthalmic image by clicking with a mouse, a video playback window appears at location P. This video playback window displays a local area of ​​a predetermined size centered on the selected location. The video playback window can be, for example, rectangular or circular, and it loops through the static and / or dynamic video images corresponding to the local area. Playback can be paused, sped up, etc. The static and / or dynamic video images corresponding to the local area are obtained by cropping the corresponding local area from stored static and / or dynamic video image files. The video playback window can also be zoomed in, zoomed out, or dragged.

[0099] Figure 9 This is a schematic diagram of the module structure of an ophthalmic video image processing apparatus provided in some embodiments of this disclosure, such as... Figure 9 As shown, some embodiments of this disclosure provide an ophthalmic video image processing apparatus 100, which includes an image acquisition unit 10, a screening and processing unit 20, and a presentation unit 30.

[0100] The image acquisition unit 10 is configured to acquire ophthalmic video images at a predetermined frame rate and transmit each frame of the acquired ophthalmic video images; the filtering processing unit 20 is configured to align and register the ophthalmic images based on the registration structure determined in the reference frame ophthalmic image to filter the ophthalmic images, and generate static video images and dynamic video images based on the filtered ophthalmic images; the presentation unit 30 is configured to present the static video image and / or dynamic video image corresponding to the specified position in the reference frame ophthalmic image.

[0101] This disclosure provides a non-transitory computer-readable storage medium storing computer program instructions that, when called and executed by a processor, implement the steps of the ophthalmic video image processing method as described in any of the above embodiments.

[0102] This disclosure provides an ophthalmic video image processing device, including a processor and a memory. The memory stores computer program instructions that can be executed by the processor. When the processor executes the computer program instructions, it implements the method steps of any of the foregoing embodiments.

[0103] Figure 10 Electronic structural diagrams of ophthalmic video image processing apparatus provided in some embodiments of this disclosure, such as... Figure 10 As shown, the ophthalmic video image processing apparatus may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the imaging device. The processing unit 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0104] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, hard disk; and communication devices 1009. The communication device 1009 allows the imaging device to communicate wirelessly or wiredly with other imaging devices to exchange data. Although Figure 10 An ophthalmic video image processing apparatus with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0105] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as processing device software programs. For example, embodiments of this disclosure include a processing device software program product comprising a computer program carried on a readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 1009, or installed from a storage device 1008, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0106] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0107] The aforementioned computer-readable medium may be included in the aforementioned imaging device; or it may exist independently and not assembled into the imaging device.

[0108] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0109] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0110] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0111] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this disclosure, and are not intended to limit them. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure.

Claims

1. A method for processing ophthalmic video images, characterized in that, The method comprises the following steps: S100: collecting ophthalmic video images by using an image collection unit at a predetermined frame frequency, and transmitting each frame of ophthalmic images in the collected ophthalmic video images; S200: screening the ophthalmic images based on the registration structure determined in the reference frame of ophthalmic images by alignment registration, and generating static video images and dynamic video images based on the screened ophthalmic images; and S300: presenting the static video images and / or dynamic video images corresponding to the specified position based on the specified position in the reference frame of ophthalmic images.

2. The method of claim 1, wherein, The method of screening the ophthalmic images based on the registration structure determined in the reference frame of ophthalmic images by alignment registration, and generating static video images and dynamic video images based on the screened ophthalmic images comprises the following steps: S210: selecting a reference frame of ophthalmic images and determining the registration structure in the reference frame of ophthalmic images; S220: screening qualified ophthalmic images from the ophthalmic images by using an alignment registration technology, and marking static components and dynamic components in the qualified ophthalmic images; S230: generating static video images and dynamic video images based on the static components and dynamic components and storing them.

3. The method of claim 2, wherein, The method of selecting a reference frame of ophthalmic images and determining the registration structure in the reference frame of ophthalmic images comprises the following steps: S211: selecting a frame of ophthalmic images in the ophthalmic video images or a previously collected frame of ophthalmic images of the same patient as the reference frame of ophthalmic images; S212: selecting at least a part of the structure with stability in the time dimension in the reference frame of ophthalmic images as the registration structure of the reference frame of ophthalmic images.

4. The method of claim 2, wherein, The method of screening qualified ophthalmic images from the ophthalmic images by using an alignment registration technology, and marking static components and dynamic components in the qualified ophthalmic images comprises the following steps: S221: receiving a current frame of ophthalmic images in the ophthalmic video images; S222: calculating the registration fitting degree of the current frame of ophthalmic images and the reference frame of ophthalmic images, if the fitting degree is lower than a threshold, discarding the current frame of ophthalmic images, if the fitting degree is lower than a threshold, determining the static components and dynamic components in the current frame of ophthalmic images, S223: repeating step S221 and step S222 until all ophthalmic images of the collected ophthalmic video images are traversed.

5. The method of claim 4, wherein, The method of calculating the registration fitting degree of the current frame of ophthalmic images and the reference frame of ophthalmic images comprises: S2221: extracting the registration structure corresponding to the registration structure of the reference frame of ophthalmic images from the current frame of ophthalmic images; S2222: estimating the spatial alignment transformation field of the current frame of ophthalmic images and the reference frame of ophthalmic images by using an image registration technology, and performing an alignment transformation operation on the current frame of ophthalmic images; S2223: calculating the registration fitting degree of the current frame of ophthalmic images and the reference frame of ophthalmic images based on the registration structure of the current frame of ophthalmic images after the alignment transformation and the registration structure of the reference frame of ophthalmic images.

6. The method of claim 5, wherein, The method of determining the static components and dynamic components in the current frame of ophthalmic images comprises: The registration structure of the aligned current frame ophthalmic image is taken as the static component of the current frame ophthalmic image, and the non-registration structure of the aligned current frame ophthalmic image is taken as the dynamic component of the current frame ophthalmic image.

7. The method of claim 2-6, wherein, The generating and storing of the static video image and the dynamic video image based on the static component and the dynamic component include the following steps: S231: arranging the static components of the screened ophthalmic images in time sequence to generate and store a static video image; S232: arranging the dynamic components of the screened ophthalmic images in time sequence to generate and store a dynamic video image.

8. The method of claim 1 to 6, wherein, The presenting of the static video image and / or the dynamic video image corresponding to the specified position based on the specified position in the reference frame ophthalmic image includes the following steps: S310: displaying the reference frame ophthalmic image in a human-computer interaction interface, and prompting the user to view the video image; S320: in response to the user selecting a specified position in the reference frame ophthalmic image, presenting a video playing window at the specified position, and playing the corresponding static video image and / or dynamic video image of the local area centered at the specified position.

9. A processing device for ophthalmic video images, characterized in that, The processing device includes: An image acquisition unit configured to acquire ophthalmic video images at a predetermined frame frequency, and to transmit each frame of the acquired ophthalmic video images; A screening processing unit configured to screen the ophthalmic images based on the registration structure determined in the reference frame ophthalmic image, and to generate a static video image and a dynamic video image based on the screened ophthalmic images; and A presentation unit configured to present the static video image and / or the dynamic video image corresponding to the specified position based on the specified position in the reference frame ophthalmic image.

10. An ophthalmic video image processing device comprising a processor and a memory, characterized in that, The memory stores computer program instructions executable by the processor, and the processor executes the computer program instructions to implement the method steps of any one of claims 1-8.

Images