The invention provides an electronic clinical
medical assessment method and
system for an
ophthalmology diagnosis and treatment scheme, and relates to the technical field of
medical information, and the method comprises the steps: 1, carrying out the multi-scale
edge detection calculation of an input
ophthalmology image-text mixed
medical record image, and obtaining a
medical record image; the method comprises the following steps: extracting a
boundary contour of a text labeling area and a hand-drawn
lesion schematic diagram through adaptive threshold segmentation and morphological closed operation, and establishing a
coordinate mapping table containing text block circumscribed
rectangular coordinates, geometric positions of key anatomical mark points of the
schematic diagram and symbol spacing characteristics; 2, constructing a two-channel attention gating network based on the
coordinate mapping table, fusing the semantic features of the text region and the morphological features of the
schematic diagram through a dynamic
weight distribution strategy, and generating a multi-
modal fusion
feature matrix with a spatial alignment relationship; according to the method, through multi-
modal feature fusion, triangular
verification region confidence regulation and control and three-dimensional topology modeling, analysis and structured output of
ophthalmology image-text medical records are realized, and the spatial alignment of diagnosis and treatment information is improved.