Visualization method of electronic medical record system

Abstract

The invention relates to a visualization method of an electronic medical record system and a visual medical record system. The method comprises the following steps: constructing a system main page; providing entry options, basic information corresponding to the patient, chief complaint information and current medical history information in the navigation bar area; loading and displaying the three-dimensional human body model in the three-dimensional human body model display area; in response to analysis of the electronic medical record information of the patient, automatically identifying and extracting lesion part information described in the medical record information; performing visual labeling on the mapped diseased region on the three-dimensional human body model; setting human body system options in the three-dimensional human body model display area; and in response to the operation that the mouse of the user hovers on the lesion part label on the three-dimensional human body model, displaying an examination result and abnormal index information related to the lesion part. According to the invention, the defects of an existing electronic medical record system in the aspects of information acquisition efficiency, spatial information presentation and information interaction modes can be effectively overcome, and the readability of medical record information and the diagnosis and treatment efficiency of doctors are remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of hospital information system management, and in particular to a visualization method for an electronic medical record system. Background Art

[0002] With the rapid development of information technology and the in-depth promotion of medical informatization, the Electronic Medical Record (EMR) system has become an indispensable core component of modern medical institutions. The EMR system has replaced the traditional paper medical records, realizing the digital storage, management, and sharing of medical record information, greatly improving the management efficiency and convenience of medical information. However, there are still many limitations in the information presentation and interaction methods of existing EMR systems, making it difficult to fully meet the needs of clinicians to quickly and efficiently obtain and understand medical record information. Especially in the face of increasingly complex medical data and clinical diagnosis and treatment scenarios, the deficiencies of traditional EMR systems are becoming increasingly prominent.

[0003] The limitations of existing electronic medical record systems are mainly reflected in the following aspects: (1) The information presentation method is single and inefficient. Currently, the vast majority of electronic medical record systems still adopt a text-based information presentation method. Medical record information is organized in a linear, list or table form, with high information density but insufficient structuring. When doctors review medical records, they need to read a large amount of text information line by line to extract key diagnosis and treatment information, such as medical history, diagnosis, examination results, medication records, etc. This information presentation method has low information acquisition efficiency. Especially when faced with the medical records of patients with a long course of disease and a large amount of information, doctors need to spend a lot of time and effort to comprehensively understand the patient's condition, seriously affecting the efficiency of clinical work. (2) Lack of visual presentation of spatial information on the lesion site. Traditional electronic medical record systems mainly focus on the text description and data recording of medical record information, lacking effective presentation of spatial information on the lesion site. Descriptions of the lesion site in medical records usually exist in text form, such as "nodule in the lower lobe of the left lung", "cyst in the right kidney", etc. Doctors need to construct the anatomical position and spatial distribution of the lesion site in their minds based on the text description, and it is difficult to intuitively and quickly establish the association between the lesion site and the human anatomical structure. The lack of this spatial information, especially when multiple-site lesions are involved and surgical planning or interventional treatment is required, will seriously affect doctors' condition assessment and diagnostic decision-making. Although medical imaging technologies (such as CT, MRI, etc.) can provide imaging information of the lesion site, existing electronic medical record systems usually separate the imaging information from the text medical record information. Doctors need to switch between different systems or interfaces to correlate and analyze the imaging information with the medical record text information, which is cumbersome and inefficient. (3) The information interaction method is limited and the user experience is insufficient. The information interaction method of existing electronic medical record systems is relatively limited, mainly relying on mouse clicks, keyboard input and simple interface operations, lacking intuitive and natural interaction methods. When doctors review medical record information, they usually need to perform cumbersome operations such as menu navigation, page jumping and scroll bar dragging to obtain the required information, with low information interaction efficiency and room for improvement in the user experience. Summary of the Invention

[0004] To solve the above technical problems of the prior art, the present invention provides a visualization method for an electronic medical record system and a visualized medical record system, which can effectively solve the deficiencies of existing electronic medical record systems in terms of information acquisition efficiency, spatial information presentation and information interaction method, and significantly improve the readability of medical record information and the diagnostic and treatment efficiency of doctors.

[0005] A visualization method for an electronic medical record system according to the present invention includes the following steps:

[0006] S1. Build the system main page, which includes: a navigation bar area for accessing the patient's medical record information; a 3D human body model display area for presenting an interactive 3D human body model to visualize the patient's anatomical structure information; and a diagnosis and examination display bar area for presenting supplementary information related to the patient's diagnosis and treatment.

[0007] S2. In the navigation bar area, provide at least three entry options corresponding to the patient's basic information, chief complaint information, and current medical history information respectively. In response to the user's click operation on any entry option, dynamically load and display the corresponding patient medical record information content in the navigation bar area.

[0008] S3. In the 3D human body model display area, load and display a standard 3D human body model, and allow the user to adjust the viewing angle and scaling ratio of the 3D human body model through interactive operations.

[0009] Regarding the above steps S1, S2, and S3, specifically, first, set up a navigation bar area on the system main page and provide at least three function entries in this area, corresponding to the patient's basic information, chief complaint information, and current medical history information respectively. When the user clicks on any entry option, the system will dynamically load and display the corresponding medical record information content in the navigation bar area, realizing quick access to the patient's medical record information. Second, in the 3D human body model display area of the system main page, load and display a standard 3D human body model, and allow the user to freely adjust the viewing angle and scaling ratio of the 3D human body model through interactive operations such as mouse dragging and scroll wheel zooming, so as to observe the human body structure from different angles.

[0010] S4. In response to the parsing of the patient's electronic medical record information, automatically identify and extract the lesion site information described in the medical record information, and map the lesion site information to the corresponding anatomical positions on the 3D human body model.

[0011] S5. On the 3D human body model, visually annotate the mapped lesion sites to intuitively present the patient's lesion positions.

[0012] Regarding the above steps S4 and S5, specifically, it means that the system responds to the parsing of the patient's electronic medical record information, automatically identifies and extracts the lesion site information described in the medical record information, and accurately maps these lesion site information to the corresponding anatomical positions on the 3D human body model. Subsequently, on the 3D human body model, visually annotate the mapped lesion sites, such as by highlighting, color marking, etc., to intuitively present the patient's lesion positions, enabling doctors to quickly locate the lesions.

[0013] S6. In the three-dimensional human body model display area, set human body system options. The human body system options include at least eight major system classifications. In response to the user's selection operation on any human body system option, only the marked lesions belonging to the human body system classification are displayed on the three-dimensional human body model;

[0014] Regarding the above step S6, specifically, it is to support doctors to consult lesion information by system. Human body system options are set in the three-dimensional human body model display area, including at least eight major system classifications such as the nervous system, respiratory system, circulatory system, digestive system, urinary system, reproductive system, endocrine system, and motor system. When the user selects any human body system option, only the marked lesions belonging to the human body system classification are displayed on the three-dimensional human body model, realizing the systematic display of lesion information.

[0015] S7. In response to the user's operation of hovering the mouse over the marked lesion on the three-dimensional human body model, dynamically display the examination results and abnormal index information related to the lesion site;

[0016] Regarding the above step S7, specifically, it is to provide a more convenient way to obtain information. Let the system, in response to the user's operation of hovering the mouse over the marked lesion on the three-dimensional human body model, dynamically display the examination results and abnormal index information related to the lesion site, such as showing key laboratory indexes, imaging examination conclusions, etc. in the form of a floating window.

[0017] S8. In response to the user's click operation on the marked lesion on the three-dimensional human body model, jump or load and display the detailed examination data, pathological results, and treatment plan information related to the lesion site;

[0018] Regarding the above step S8, specifically, when the user clicks on the marked lesion on the three-dimensional human body model, let the system jump or load and display the detailed examination data, pathological results, and treatment plan information related to the lesion site, such as jumping to a page containing a complete imaging report, pathological report, or treatment plan details, or dynamically loading a detailed information window on the current page.

[0019] S9. In the middle three-dimensional human body model display area, real-time display the physiological sign data of the patient's body temperature, respiratory rate, pulse, and blood pressure;

[0020] Regarding the above step S9, specifically, it is to enable doctors to grasp the patient's physiological state in real time. In the three-dimensional human body model display area, real-time display the physiological sign data such as the patient's body temperature, respiratory rate, pulse, and blood pressure, realizing the visual monitoring of physiological parameters.

[0021] S10. In the examination display column area, the detailed auxiliary examination window, the imaging window of the auxiliary examination site, and the relevant diagnosis information window at the time of admission are classified and displayed to supplement and display the diagnosis and treatment information of the patient.

[0022] Regarding the above step S10, specifically, in order to supplement and display the diagnosis and treatment information of the patient, in the examination display column area of the system main page, the detailed auxiliary examination window, the imaging window of the auxiliary examination site, and the relevant diagnosis information window at the time of admission are classified and displayed. For example, the examination item list and the key result summary are displayed in the detailed auxiliary examination window, the thumbnail of the imaging data is displayed in the imaging window, and the admission diagnosis information is displayed in the diagnosis information window, etc.

[0023] A visualization method of an electronic medical record system according to the present invention further includes the following steps:

[0024] A method for constructing an interactive timeline in an electronic medical record visualization system, with time as the axis, to intuitively display the patient's diagnosis and treatment process. This embodiment further includes the following steps: First, extract the patient's diagnosis and treatment event data from the electronic medical record system. These data cover key nodes in the diagnosis and treatment process, such as diagnosis results, surgical operations, drug use, examination items and their results, etc., and include information such as event type, occurrence time, specific description, and related examination results and treatment plans. The extracted data is then arranged in chronological order and constructed into a timeline data structure. The core of this data structure consists of a series of diagnosis and treatment event nodes arranged in chronological order. Each node encapsulates key information such as the type of the event, timestamp, event description, and associated data. Then, on the main page of the system, generate an interactive timeline based on the above timeline data structure. This timeline uses a horizontal or vertical line as the main axis, and time scales are distributed along the axis. There are multiple diagnosis and treatment event nodes distributed on the timeline, and the positions of these nodes correspond to the occurrence time of the events. To enhance visual recognition, each node will be marked with an icon or mark related to the event type and visually distinguished using different color coding. For example, a diagnosis event may use a green icon, a surgical event uses a red icon, a medication event uses a blue icon, an examination event uses a yellow icon, etc. This interactive timeline has a linkage function. When the user clicks on any diagnosis and treatment event node on the timeline, the system automatically locates and highlights the corresponding part or area on the three-dimensional human model related to this event. For example, if the clicked event is "diagnosis of left lung tumor", the left lung area on the three-dimensional human model will be highlighted. At the same time, the system will dynamically display detailed diagnosis and treatment data related to this part, such as imaging examination reports, pathological examination results, etc., so that doctors can quickly view the patient's body part involved in this event and its detailed diagnosis and treatment information. In addition, when the user clicks on a certain event node on the timeline, the system will dynamically display the detailed information of this event on the interface, including but not limited to the diagnosis description of this event, related examination results, treatment plan, and other associated data, so as to provide doctors with comprehensive information about this event. The technical problem that the above solution aims to solve is: how to overcome the limitations of traditional electronic medical record systems in presenting information during the diagnosis and treatment process, and provide a visualization method that can intuitively, dynamically, and interactively display the patient's diagnosis and treatment process with time as the main line, so as to help doctors quickly and comprehensively understand the patient's diagnosis and treatment process, improve the diagnosis and treatment efficiency and decision-making quality. It can be understood that by visualizing the diagnosis and treatment events in the form of a timeline, doctors can clearly understand the patient's diagnosis and treatment process at a glance, clearly see the time distribution, type composition, and evolution order of the diagnosis and treatment events, without having to flip through and sort through the cumbersome text medical records item by item, greatly improving the information acquisition efficiency.In addition, by using different icons and color coding on the timeline nodes to mark different types of diagnosis and treatment events, such as diagnosis, surgery, medication, examination, etc., doctors can quickly distinguish and identify different types of diagnosis and treatment events, and according to the visual guidance of colors and icons, quickly locate the nodes of specific types of diagnosis and treatment events. For example, if a doctor wants to quickly understand a patient's surgical history, he only needs to pay attention to the nodes corresponding to the red surgery icons on the timeline, thus improving the efficiency and pertinence of information retrieval. Moreover, in response to the user's click operation on the timeline event node, the system can automatically locate and highlight the corresponding part or area on the three-dimensional human model related to the event, realizing the spatial association between the diagnosis and treatment event and the patient's body part. When doctors view the diagnosis and treatment events on the timeline, they can intuitively see the body parts involved in the event on the three-dimensional human model at the same time, thus connecting the abstract diagnosis and treatment event information with the specific anatomical location, enhancing the cognition and understanding of the spatial correlation of diagnosis and treatment events. Furthermore, in response to the user's click operation on the timeline event node, the system can dynamically display the detailed information of the event, including diagnosis description, examination results, treatment plan, etc., providing comprehensive diagnosis and treatment context information about the event for doctors. Doctors can directly obtain the detailed information of the event on the timeline interface without jumping to other pages or performing additional operations, which is convenient and fast, and helps doctors to deeply understand the specific content and diagnosis and treatment details of the event. Moreover, the interactive timeline supports users to explore and mine diagnosis and treatment information through interactive operations such as clicking and hovering. Users can click on the event node to view the detailed information, hover the mouse to view the brief description, and drag the timeline to browse the diagnosis and treatment history of a longer time span. This interactive operation method enhances the user's sense of participation and control in the information exploration process, makes the information acquisition process more natural and smooth, and improves the user experience, and encourages doctors to more deeply explore and analyze the diagnosis and treatment information of patients. In summary, the above technical solutions realize functions such as visualization of the diagnosis and treatment process, differentiation of diagnosis and treatment event types, linkage between diagnosis and treatment events and human models, and dynamic display of detailed information of diagnosis and treatment events by constructing an interactive timeline, effectively solving the limitations of traditional electronic medical record systems in presenting information during the diagnosis and treatment process, significantly improving the efficiency, accuracy and comprehensiveness of doctors' access to diagnosis and treatment information, and providing strong support for improving the diagnosis and treatment efficiency and decision-making quality.

[0025] A visualization method for an electronic medical record system according to the present invention further includes the following steps:

[0026] First, construct a system secondary page, which is an extension of the system main page and aims to provide a more in-depth and professional display of diagnosis and treatment information. Secondly, in response to the user's click operation on the lesion annotation on the three-dimensional human body model on the system main page, the system control program routes and jumps to the pre-constructed system secondary page to achieve the page switching from the macroscopic overview to the microscopic details. Subsequently, during the initialization stage of the system secondary page, the system performs a data retrieval operation from the electronic medical record database according to the lesion site information clicked by the user to obtain the diagnosis and examination information data related to the lesion site and its affiliated human body system. This diagnosis and examination information data includes physical examination data, specialist condition data, abnormal index data, etc. Then, construct a diagnosis and examination information window on the system secondary page and display the retrieved physical examination data, specialist condition data, and abnormal index data in a structured form within this window. For numerical index data, further use data visualization techniques, such as chart forms, to present its change trend, so as to facilitate doctors to quickly grasp the dynamic changes of the index. At the same time, construct a detailed image window on the system secondary page to load and display the auxiliary examination image data related to the aforementioned lesion site, such as medical images like CT and MRI. This window integrates image operation functions, such as zooming, panning, window width and window level adjustment, etc., to support users to finely observe the image data. To assist users in understanding the image results, in the adjacent area of the detailed image window, set an image description information display area to display the text description information related to the auxiliary examination image data, such as the diagnosis opinion of the image report, the description of imaging findings, etc. Finally, construct a simulated display area of the lesion site on the system secondary page. The system generates and displays a simulated diagram of the lesion site based on the pathological feature information related to the lesion site extracted from the medical record data, such as the lesion type, size, shape, etc., to visually present the pathological features of the lesion site and assist doctors in making a judgment on the condition. The above solution aims to solve the technical problem of how to efficiently and deeply display the detailed diagnosis and treatment information of a specific lesion site in the electronic medical record visualization system. Specifically, although the system main page provides a macroscopic overview of the condition, there are limitations in the display of detailed information about a specific lesion site. Doctors need to further understand the physical examination results, specialist conditions, imaging features, and pathological simulation information of the lesion site in order to make accurate diagnoses and treatment decisions. Therefore, the technical problem to be solved by claim 5 is how to quickly, comprehensively, and specifically present the detailed diagnosis and treatment information of the lesion site after the user clicks on the lesion annotation on the three-dimensional human body model to meet the needs of doctors for in-depth diagnosis. It can be understood that the construction of the system secondary page realizes the information hierarchical display architecture of the electronic medical record visualization system. The system main page focuses on providing a macroscopic overview of the condition, while the system secondary page focuses on presenting the detailed information of a specific lesion site.This hierarchical display architecture avoids information overload, enabling doctors to flexibly switch between the macro and micro levels according to the diagnosis and treatment needs, improving the efficiency and pertinence of information acquisition. In response to the user's click operation on the lesion site annotation, the system automatically jumps to the system sub-page and accurately retrieves relevant examination data from the electronic medical record database according to the click site information. This mechanism avoids the cumbersome operation of doctors manually retrieving specific site information from a large amount of medical record information, realizing the accurate positioning and rapid acquisition of information. A diagnosis and examination information window is constructed on the system sub-page, and the physical examination data, specialist condition data, and abnormal index data are displayed in a structured form. The structured information presentation method improves the readability and comprehensibility of information, enabling doctors to quickly browse and compare various diagnosis and examination indicators, thereby more efficiently evaluating the condition. At the same time, the visual presentation of numerical index data intuitively shows the change trend of the indicators, assisting doctors in quickly grasping the dynamic condition. A detailed imaging window is constructed to load and display the auxiliary examination imaging data related to the lesion site and provide imaging operation functions. Combined with the display of imaging description information, it provides doctors with a high-quality medical imaging browsing and analysis platform, improves the utilization rate of imaging information, and assists doctors in deeply analyzing the condition from the imaging perspective. In addition, a simulated display area of the lesion site is constructed to generate and display a simulated diagram of the lesion site based on the medical record data. The simulated diagram of the lesion site visually presents the pathological characteristics of the lesion site, transforms the abstract pathological description into intuitive visual information, assists doctors in more deeply understanding the pathological state of the lesion site, and provides a more intuitive reference for accurate diagnosis and treatment plan formulation. In summary, the above technical solution realizes the efficient and in-depth display of detailed diagnosis and treatment information for a specific lesion site through steps such as the construction of the system sub-page, accurate information positioning, structured information presentation, efficient utilization of imaging information, and visualization of pathological characteristics, solves the technical problem of doctors' in-depth diagnosis in the electronic medical record visualization system, significantly improves the efficiency and quality of doctors' acquisition of detailed diagnosis and treatment information, and finally assists doctors in making more accurate diagnoses and more effective treatment decisions.

[0027] According to a visualization method of an electronic medical record system of the present invention, after the step of constructing a detailed imaging window on the system sub-page, the following steps are further included:

[0028] Create an imaging overlay window in the system sub-page. Specifically, on the user interface of the system sub-page, an independent display area is constructed, and this area is defined as the imaging overlay window. This window is designed to provide a platform for users to observe and analyze multi-modal or multi-temporal imaging data side by side. This window is usually adjacent to the detailed imaging window in the user interface layout, so that users can conveniently perform the dragging and overlay operations of imaging data.

[0029] In response to the user's dragging operation on the image data in the detailed image window of the system secondary page, the selected image data is loaded into the image overlay window. Specifically, the system monitors the user's interaction behavior in the detailed image window. When the user selects any image data set (such as CT, MRI, X-ray, etc. image sequences) displayed in the detailed image window through operations such as mouse dragging and drags it to the image overlay window, the system receives the drag instruction and loads the selected image data from the original detailed image window into the image overlay window for caching and preprocessing to prepare for subsequent overlay display.

[0030] Through image processing technology, the loaded image data is overlaid and displayed, enabling different image data to be observed simultaneously in the same window and supporting adjustment of the transparency and display order of each image data layer. Specifically, the system core processing module calls the integrated image processing engine to perform real-time overlay rendering on multiple groups of image data that have been loaded into the image overlay window. The overlay process allows different image data sets to be regarded as independent layers and synthesized and displayed in the same display space. The user can dynamically adjust the transparency of each image layer through controls provided by the user interface, such as a slider or a drop-down menu, thereby controlling the visibility of different images in the overlay result. In addition, the system also allows the user to adjust the display order of the image layers to meet different observation requirements and analysis focuses.

[0031] Provide interactive operation functions that allow the user to perform operations such as zooming in, zooming out, rotating, and moving on the overlaid image data for a more detailed view of the image content. Specifically, to enhance the user's ability to observe the overlaid image in detail, the system integrates a series of interactive operation functions in the image overlay window. The user can perform real-time zooming in, zooming out, rotating, and panning operations on the overlaid image through mouse or touch gestures. These operations enable the user to examine the overlaid image from different scales and angles, deeply analyze the image details, and accurately identify potential lesions or abnormal structures.

[0032] In the image overlay window, through different overlay modes, the system supports users to perform display methods such as transparency overlay, color overlay, or difference overlay on image data, facilitating doctors to analyze the comparison and correlation between images. Specifically, the system further enhances the analysis function of the image overlay window and provides multiple advanced overlay modes for users to choose from. In addition to transparency overlay, the system also supports color overlay mode. For example, different modalities of images can be assigned to different color channels so that the information of different images can be intuitively distinguished by color differences after overlay. Furthermore, the system provides a difference overlay mode. This mode highlights the changes in images over time or in modality by calculating the pixel differences between different images, especially suitable for tracking the development of lesions or evaluating the treatment effect. Users can flexibly select the appropriate overlay mode according to specific clinical needs and analysis objectives to more effectively analyze the comparison and correlation between image data.

[0033] The technical problem to be solved by the solution of this step is how to overcome the limitations of the separated viewing mode of image data in traditional electronic medical record systems and provide a visualization method that can integrate multi-modal or multi-temporal image data into the same view for side-by-side observation and analysis, so as to improve the comprehensive analysis efficiency and diagnostic accuracy of doctors for image information. It can be understood that first, an independent image overlay window is created in the system sub-page, providing a unified platform for the integrated display of multi-image data. This fundamentally changes the traditional separated viewing mode and lays a foundation for subsequent overlay and comparative analysis. By responding to the user's dragging operation in the detailed image window, the convenient loading of image data into the overlay window is achieved. This intuitive interaction method simplifies the operation process and improves the image data loading efficiency, enabling doctors to quickly gather the image data that needs to be compared and analyzed into the overlay window. The core technology lies in using image processing technology to perform overlay display on the loaded image data. This enables image data from different sources or types to be presented side by side in the same window, and doctors can observe and compare the information of different images simultaneously without switching between multiple windows, significantly improving the efficiency and intuitiveness of information acquisition. Support for adjusting the transparency and display order of each image data layer further enhances the flexibility and information recognition of the overlay display effect. Doctors can adjust the layer parameters according to needs to highlight the information of specific images or weaken interfering information, so as to more clearly observe and analyze the overlay images. Provide interactive operation functions such as zoom in, zoom out, rotate, and move, enabling doctors to conduct refined observation of the overlaid images. These operation functions break through the limitations of static image display, allowing doctors to deeply analyze image details from different scales and angles and improve the accuracy of lesion identification and diagnosis. Provide multiple overlay modes such as transparency overlay, color overlay, and difference overlay, greatly expanding the dimension and depth of image analysis. Different overlay modes can highlight the differences and correlations of image data in different aspects. For example, color overlay can distinguish the information of different modal images, and difference overlay can highlight the changes of lesions. These diverse analysis dimensions help doctors understand the condition more comprehensively and deeply, providing stronger support for accurate diagnosis and treatment decision-making.

[0034] Through the organic combination of the above technical features, a powerful and easy-to-operate image overlay analysis platform is constructed, effectively solving the technical problems of the separated viewing mode of image data in traditional electronic medical record systems, realizing the efficient integration, side-by-side observation, and multi-dimensional analysis of multi-image data, and finally significantly improving the comprehensive analysis efficiency and diagnostic accuracy of doctors for image information.

[0035] According to a visualization method of an electronic medical record system of the present invention, after the step of constructing a detailed image window on the system sub-page, the following steps are further included:

[0036] In the system sub-page, a technical solution is provided for visually presenting the inpatient diagnosis and treatment data related to the human body system associated with the current sub-page. The solution first extracts the inpatient diagnosis and treatment data related to the human body system targeted by the current system sub-page from the electronic medical record system. These data include hospitalization records and a sequence of diagnosis and treatment events arranged in chronological order during hospitalization. Each diagnosis and treatment event includes event type, event occurrence time, and event description information.

[0037] Subsequently, an independent hospitalization event timeline is constructed for each hospitalization record. The timeline uses time as the horizontal axis and displays the time scale according to the length of hospitalization. On the timeline, the recording points of each diagnosis and treatment event are marked, and different visual markers, such as different icons or shapes, are used according to the type of diagnosis and treatment event, and color-coded to distinguish different types of events. In addition, the hospitalization event timeline is also divided into different diagnosis and treatment stage areas, and the event recording points of the corresponding stages are displayed in different stage areas, thereby presenting a staged diagnosis and treatment process on the timeline.

[0038] In order to achieve interactive operation, the solution responds to the user's operation of hovering the mouse over the event record point of the hospitalization event timeline. When the user hovers the mouse over a certain event record point, the system will pop up an information prompt box to display a brief description of the corresponding diagnosis and treatment event, such as the name of the event or a summary of key content. Furthermore, in response to the user's mouse clicking on the event record point of the hospitalization event timeline, the system will expand the floating page, load and display the detailed medical record associated with the event record point, such as a complete event report, examination results or treatment plan and other detailed information.

[0039] Finally, the solution also has dynamic update capabilities. The system continuously monitors the patient's treatment progress data, and dynamically updates the diagnosis and treatment events, event description information, and diagnosis and treatment stage divisions displayed on the hospitalization event timeline based on changes in the treatment progress data, thereby ensuring that the information presented on the timeline is always synchronized with the patient's latest treatment progress.

[0040] The main technical problem solved by the above steps is how to present the complex diagnosis and treatment process information of the patient during hospitalization in an intuitive, dynamic and interactive way in the visual interface of the electronic medical record system. It can be understood that by constructing the hospitalization event timeline with time as the horizontal axis and marking the diagnosis and treatment events during hospitalization on the timeline in chronological order, the originally discrete and fragmented hospitalization diagnosis and treatment event information can be integrated into a coherent time clue. Doctors can clearly understand the time sequence and time interval of the patient's diagnosis and treatment events during hospitalization by browsing the timeline, so as to quickly establish a time context cognition of the patient's hospitalization diagnosis and treatment process. The hospitalization event timeline is divided into different diagnosis and treatment stage areas, and different visual markers and color codes are used for different types of diagnosis and treatment events, so that complex diagnosis and treatment process information can be structured and presented in layers. Doctors can quickly identify different types of diagnosis and treatment events through colors and icons, and through the division of diagnosis and treatment stage areas, grasp the diagnosis and treatment focus and diagnosis and treatment goals of different stages in a macro way, and improve the efficiency of information acquisition and understanding. By setting a mouse hover event, when the user moves the mouse to the event recording point, a brief event description information can be popped up immediately, which is convenient for doctors to quickly preview the event content and get a preliminary understanding of the event summary without clicking. Furthermore, by setting a mouse click event, after the user clicks the event recording point, the floating page can be expanded to load and display the detailed medical record associated with the event, realizing a quick jump from summary information to detailed information, meeting the doctor's needs for different information granularity, and improving the efficiency and convenience of information acquisition. The system can continuously monitor the patient's treatment progress data, and dynamically update the diagnosis and treatment events, event description information, and diagnosis and treatment stage divisions displayed on the hospitalization event timeline according to changes in the data, thereby ensuring that the hospitalization diagnosis and treatment information presented on the timeline is always synchronized with the patient's latest treatment status. Doctors can obtain the latest diagnosis and treatment progress in a timely manner, assisting doctors in real-time condition assessment and diagnosis and treatment decisions. To summarize, the technical solution of claim 7, by constructing a visual timeline of hospitalization events and combining the division of treatment stages, visual marking of event types, mouse interaction functions and dynamic update mechanisms, ultimately achieves the technical effect of presenting the patient's hospitalization and treatment process information in an intuitive, dynamic and interactively friendly manner, solves the shortcomings of traditional electronic medical record systems in presenting hospitalization and treatment information, significantly improves doctors' understanding and analysis efficiency of patients' hospitalization and treatment process, and provides strong information support for clinical treatment decisions.

[0041] A visualization method for an electronic medical record system according to the present invention further includes the following steps:

[0042] When the system main page is loaded, it automatically identifies and scans the patient's electronic medical record data, extracts all important diagnosis and treatment history events, genetic disease events, and drug allergy events, and classifies and prioritizes the events using a knowledge base and a priority rule engine. That is to say, when the system main page is loaded, it automatically starts a comprehensive scan of the current patient's electronic medical record data and intelligently extracts the predefined "important diagnosis and treatment information" from it. This information specifically includes, but is not limited to: the patient's major diagnosis and treatment history events (e.g., previous major surgeries, important organ dysfunction, etc.), genetic disease events (e.g., diagnosed genetic diseases, high-risk genetic disease gene carriers, etc.), and drug allergy events (e.g., known drug allergy history, especially severe allergic reaction drugs).

[0043] According to the priority of the events, important diagnosis and treatment information is automatically pushed to the system user interface. The pushed information includes, but is not limited to, the patient's major diagnosis and treatment history events, genetic disease events, and drug allergy information, and is presented in a prominent way to ensure the timely presentation of key information. That is to say, the system has a pre-set "important diagnosis and treatment information knowledge base" and a "priority rule engine". The knowledge base is used to define which diagnosis and treatment events, genetic disease events, and drug allergy events belong to the category of "important", and classifies and structurally stores various important information. The priority rule engine, based on preset rules such as the severity of the events, clinical urgency, etc., prioritizes the extracted important information to ensure that the most critical information can be pushed first. The system automatically pushes the important diagnosis and treatment information to the system user interface according to the sorting result of the priority rule engine. The content of the pushed information focuses on the patient's major diagnosis and treatment history events, genetic disease events, and drug allergy information, and is presented in a prominent visual way, such as highlighting, color coding, etc., to ensure that doctors can quickly notice these key information.

[0044] The display forms of the pushed information include, but are not limited to, pop-up prompts, message center notifications, and top-page display bars, and are classified and visually differentiated according to the event type, using color coding, icon prompts, and animation effects to enhance the prominence and recognizability of the information. That is to say, the system supports multiple display forms of information push, including but not limited to: pop-up prompts (e.g., a prompt box pops up when the main page is loaded), message center notifications (e.g., unread messages are displayed in the system message center), and top-page display bars (e.g., scrolling display in a fixed area at the top of the page). At the same time, the system classifies and visually differentiates according to the event type, for example, using different color coding, icon prompts, and animation effects to enhance the prominence and recognizability of the information.

[0045] When the pushed information is related to the patient's body part, the system can realize the linkage between the pushed information and the three-dimensional human body model. Specifically, the system will automatically display associated marks or highlight corresponding body parts on the three-dimensional human body model to visually present the relevance between the information and the body parts.

[0046] The system supports users to perform interactive operations on the pushed information. For example, by clicking on the pushed information, more detailed historical diagnosis and treatment data, inspection reports, genetic history, or drug allergy records can be viewed. All detailed data are linked to the relevant detailed records in the electronic medical record system, facilitating doctors to conduct in-depth access.

[0047] In this step, by automatically scanning the medical record data and actively pushing important diagnosis and treatment information when the system main page is loaded, doctors can obtain key information immediately without manual retrieval and screening, significantly improving the information acquisition efficiency and shortening the diagnosis and treatment preparation time. The system actively pushes important information and presents it in a prominent visual way, which can effectively prevent doctors from ignoring key information, especially high-risk information such as drug allergy history, in the case of information overload, reducing medical errors and risks. The system provides a key diagnosis and treatment overview of the patient at the initial stage when the doctor opens the medical record, helping the doctor quickly establish a preliminary understanding of the patient's condition and providing timely and effective support for subsequent diagnosis and treatment decisions, improving the efficiency and accuracy of diagnosis and treatment decisions. Through diverse information display forms (pop-up windows, message centers, display bars, etc.) and visual differentiation means (color coding, icons, etc.), as well as the linkage with the three-dimensional human body model, the system can present important information more intuitively and clearly, enhance the relevance between the information and the patient's body parts, and improve the user experience and information understanding efficiency. By providing links to the detailed records in the electronic medical record system, doctors can conveniently click on the pushed information and quickly jump to the relevant detailed medical record records for in-depth access, meeting the doctors' needs for the depth and breadth of information and improving the convenience of information use.

[0048] In summary, the technical solution of Claim 8 effectively solves the deficiencies in the presentation of key information in the existing electronic medical record system through an automatic, proactive, and intelligent information push mechanism, significantly improving the efficiency and accuracy of doctors' access to key information, reducing medical risks, and ultimately enhancing the overall diagnosis and treatment efficiency and quality.

[0049] A visualization method for an electronic medical record system according to the present invention further includes the following steps:

[0050] First, construct a data extraction module which is configured to automatically retrieve and parse multi-source heterogeneous data within the electronic medical record system. The data sources include, but are not limited to: surgical records, pathology reports, structured data fields, and imaging reports. The data extraction module uses technical means such as natural language processing, medical knowledge bases, and database queries to identify and extract key information related to changes in the patient's body structure from the above data sources. This information covers various types of body structure changes such as amputations, organ resections, and tissue resections, and clarifies attribute information such as the location and type of the changes.

[0051] Second, based on the patient's body condition change information extracted by the data extraction module, construct a 3D human body model dynamic adjustment and rendering module. This module receives the output information of the data extraction module and makes real-time and dynamic modifications to the pre-loaded standard 3D human body model in response to this information. Specific model modification operations include: for the amputated part, deleting or hiding the mesh data of the corresponding limb on the 3D human body model; for the organ resection area, removing the mesh data of the corresponding organ on the model; for the tissue resection area, adjusting the shape of the local mesh of the model according to the resection range and degree. Through the above model modification operations, ensure that the 3D human body model can visually and accurately present the patient's current body structure state, reflecting the permanent changes in the patient's body structure.

[0052] Third, on the basis of completing the dynamic adjustment of the 3D human body model, construct a labeling and prompt information overlay module. This module also receives the patient's body condition change information and adds visual labels and prompts to the adjusted 3D human body model based on this information. The labeling content includes text information on the change type (such as "amputation", "resection") and the change location (such as "left lower limb", "appendix"). In addition, this labeling module also has an interactive response function. For example, when the user hovers the mouse over the label, the system can pop up an information prompt box containing more detailed background information and explanations, such as the name of the surgery and the surgery time. Through the overlay of labeling and prompt information, further enhance the readability and information transmission efficiency of the 3D human body model, assisting doctors to quickly understand the changes in the patient's body condition.

[0053] Finally, integrate the above data extraction module, 3D human body model dynamic adjustment and rendering module, and labeling and prompt information overlay module into the electronic medical record system and establish a dynamic update mechanism. This dynamic update mechanism can monitor the change status of the patient's medical record information in real time. Once new or updated medical record information related to changes in the body condition is detected, the system will automatically trigger the update process and re-execute operations such as data extraction, model adjustment, and labeling information update to ensure that the 3D human body model presented in the visualization system is always synchronized with the patient's latest body condition information, providing doctors with timely and accurate visual information on the patient's body structure.

[0054] The technical problem to be solved by the technical solution of this step is: how to provide a visualization method for an electronic medical record system that can intuitively and dynamically present permanent changes in the patient's body structure, improve the doctor's acquisition efficiency and understanding accuracy of the patient's physical condition change information, and thus assist the doctor in more efficient and accurate diagnosis and treatment. It can be understood that by constructing a data extraction module, multi-source heterogeneous data can be automatically retrieved and parsed from the electronic medical record system, and the doctor can quickly obtain the patient's physical condition change information without having to manually read a large amount of medical record text, which significantly improves the efficiency of information acquisition. Construct a 3D human model dynamic adjustment and rendering module to convert abstract physical condition change information into an intuitive three-dimensional visualization model. Doctors can directly observe the actual changes in the patient's body structure without relying on text descriptions for spatial imagination, such as the loss of amputation sites, vacancies after organ removal, etc., which greatly improves the intuitiveness of information presentation. The annotation and prompt information superposition module adds clear annotations and prompt information to the 3D human model, clearly indicates the type and location of the change, and provides detailed background information, which further enhances the readability and comprehensibility of the information, reduces the diagnosis and treatment risks caused by information understanding deviations, and improves the accuracy of information understanding. The dynamic update mechanism ensures that the 3D human body model presented in the visualization system can reflect the patient's latest physical condition information in real time. When the patient's medical record information changes, the system can automatically update the visualization model to ensure that the information obtained by the doctor is always the latest and most accurate, avoiding misjudgment or delayed diagnosis and treatment due to information lag. Through the synergistic effect of the above technical effects, the technical solution of this step can provide doctors with an efficient, intuitive and accurate patient body structure visualization tool. Doctors can use the visualization system to quickly understand the patient's physical condition changes and assist them in making more accurate disease assessments, surgical planning, treatment plan formulation and other diagnosis and treatment decisions, thereby improving the overall diagnosis and treatment efficiency and quality. In summary, this unsophisticated solution effectively solves the deficiencies in the existing technology through the organic combination of technical means such as data extraction, dynamic model adjustment, annotation prompts and dynamic updates, and realizes intuitive, dynamic and real-time visualization of patient body structure changes, significantly improving the doctor's acquisition efficiency, understanding accuracy and diagnosis and treatment decision-making efficiency of patient physical condition changes, and has outstanding substantive characteristics and significant progress.

[0055] Based on the above method, the present invention also provides a visual medical record system, comprising:

[0056] The main page construction module is configured to construct the main page of the system. The main page of the system includes a navigation bar area, a three-dimensional human body model display area, and a diagnosis display bar area. The navigation bar area provides an entrance to access the patient's medical record information. The three-dimensional human body model display area presents an interactive three-dimensional human body model to visualize the patient's anatomical structure information. The diagnosis display bar area presents supplementary information related to the patient's diagnosis and treatment. That is to say, this module is responsible for constructing the core user interface of the system, namely the main page of the system. This main page integrates three key areas: the navigation bar area, which serves as an entrance for doctors to access different information modules of the patient's medical record; the three-dimensional human body model display area, which is used to present an interactive three-dimensional human body model to visually display the patient's anatomical structure information; and the diagnosis display bar area, which is used to supplement and present other important information related to the patient's diagnosis and treatment process, such as auxiliary examination and diagnosis information.

[0057] The navigation information display module is communicatively connected to the main page construction module and is configured to provide at least three entrance options in the navigation bar area. The entrance options respectively correspond to the patient's basic information, chief complaint information, and current medical history information, and in response to the user's click operation on any one of the entrance options, dynamically load and display the corresponding patient medical record information content in the navigation bar area. Specifically, the module works in cooperation with the main page construction module to provide at least three preset entrance options in the navigation bar area. These options respectively correspond to the key information categories in the patient's medical record, including "basic information", "chief complaint information", and "current medical history information". When the user clicks on any one of the entrance options in the navigation bar, the navigation information display module responds to the user's operation and dynamically loads and displays the patient medical record information content corresponding to the selected entrance option in the navigation bar area. For example, when clicking on the "basic information" entrance, the patient's basic demographic information such as name, age, and gender will be expanded or loaded in the navigation bar area.

[0058] The model loading and interaction module is communicatively connected to the main page construction module and is configured to load and display a standard three-dimensional human body model in the three-dimensional human body model display area and allow the user to adjust the viewing angle and zoom ratio of the three-dimensional human body model through interactive operations. Specifically, this module also works in cooperation with the main page construction module. Its function is to load and display a standard three-dimensional human body model in the three-dimensional human body model display area. In addition, this module also gives the user the ability to interact with the three-dimensional human body model. The user can adjust the viewing angle (such as rotation, translation) and zoom ratio of the three-dimensional human body model through input devices such as a mouse and a touch screen, so as to observe the human body model from different angles and scales.

[0059] The lesion site mapping module is configured to automatically identify and extract the lesion site information described in the medical record information in response to the parsing of the patient's electronic medical record information, and map the lesion site information to the corresponding anatomical position on the three-dimensional human body model. Specifically, this module is responsible for parsing the patient's electronic medical record information and automatically identifying and extracting the lesion site information described in the medical record text from it. The extracted lesion site information is then mapped to the three-dimensional human body model, establishing an association with the corresponding anatomical position of the human body model, providing a basis for subsequent visual annotation of the lesion.

[0060] The lesion annotation module is communicatively connected to the lesion site mapping module and the model loading and interaction module, and is configured to perform visual annotation of the mapped lesion sites on the three-dimensional human body model to visually present the lesion locations of the patient. Specifically, this module works in coordination with the lesion site mapping module and the model loading and interaction module. Its core function is to perform visual annotation of the lesion sites mapped by the lesion site mapping module on the three-dimensional human body model. The forms of annotation can be highlighting, color marking, adding three-dimensional models, etc., aiming to visually present the lesion locations of the patient on the three-dimensional human body model, enabling doctors to quickly locate the lesion.

[0061] The system screening module is communicatively connected to the lesion annotation module and the model loading and interaction module, and is configured to provide human system options in the three-dimensional human body model display area. The human system options include at least eight major system classifications, and in response to the user's selection operation of any human system option, it controls only the lesion site annotations belonging to the selected human system classification to be displayed on the three-dimensional human body model. Specifically, this module cooperates with the lesion annotation module and the model loading and interaction module to provide human system options in the three-dimensional human body model display area. These options include at least eight major system classifications, such as the nervous system, respiratory system, circulatory system, etc. When the user selects any human system option, the system screening module responds to the user's selection operation and controls only the lesion site annotations belonging to the selected human system classification to be displayed on the three-dimensional human body model, thereby realizing the systematic screening and display of lesion sites and facilitating doctors to view the condition by system.

[0062] The hover information display module is communicatively connected with the lesion annotation module and the model loading and interaction module, and is configured to dynamically display the inspection results and abnormal indicator information related to the lesion in response to the user hovering the mouse over the lesion annotation on the three-dimensional human body model. Specifically, this module is linked with the lesion annotation module and the model loading and interaction module to enhance the interactivity of the system. When the user hovers the mouse over a lesion annotation on the three-dimensional human body model, the hover information display module responds to the mouse hovering operation and dynamically displays the inspection results and abnormal indicator information related to the lesion, for example, the floating window displays the imaging examination description, key laboratory indicators, etc. of the lesion.

[0063] The detailed information loading module is communicatively connected with the lesion annotation module and the model loading and interaction module, and is configured to jump or load and display detailed examination data, pathological results and treatment plan information related to the lesion in response to the user clicking on the lesion annotation on the three-dimensional human body model. Specifically, this module also cooperates with the lesion annotation module and the model loading and interaction module to further enhance the depth of information acquisition. When the user clicks on the lesion annotation on the three-dimensional human body model, the detailed information loading module responds to the click operation and triggers the system to jump or load and display detailed examination data, pathological results and treatment plan information related to the lesion on the current page, for example, jumping to a detailed information page containing a complete imaging report, pathology report or treatment plan.

[0064] The real-time vital signs display module is connected to the main page construction module and is configured to display the patient's body temperature, respiratory rate, pulse and blood pressure in real time in the central three-dimensional human body model display area. Specifically, this module is connected to the main page construction module, and its function is to display the patient's key physiological signs data, including body temperature, respiratory rate, pulse and blood pressure, in real time in the three-dimensional human body model display area of ​​the main page. These real-time data are displayed on the same screen as the three-dimensional human body model, providing doctors with a more comprehensive overview of the patient's condition.

[0065] The diagnosis information display module is in communication connection with the main page construction module, and is configured to display the auxiliary examination details window, the image window of the auxiliary examination part, and the relevant diagnosis information window at the time of admission in the diagnosis display column area, so as to supplement the patient's diagnosis and treatment information; specifically, this module cooperates with the main page construction module and is responsible for displaying the auxiliary examination details window, the image window of the auxiliary examination part, and the relevant diagnosis information window at the time of admission in the diagnosis display column area of ​​the main page. These windows supplement the patient's diagnosis and treatment information in a structured manner, such as a list of auxiliary examination items, thumbnails of imaging materials, and admission diagnosis conclusions.

[0066] Among them, the navigation information display module, model loading and interaction module, lesion site mapping module, lesion annotation module, system screening module, hover information display module, detailed information loading module, real-time vital sign display module, and diagnosis information display module all work in coordination with the main page construction module to achieve the visual display of medical record information in the visual medical record system.

[0067] In the above visual medical record system, the main page construction module constructs an integrated system main page, reasonably arranges the navigation bar area, three-dimensional human model display area, and diagnosis display bar area, and realizes the centralized display of medical record information. The navigation entrances provided by the navigation information display module enable users to quickly access different categories of medical record information. The diagnosis information display module classifies and displays auxiliary diagnosis information, and the real-time vital sign display module presents physiological data in real time, jointly constructing a multi-dimensional information display framework. Without having to flip through pages in the complex text medical records one by one, doctors can quickly obtain an overview of the patient's condition on the system main page, significantly improving the information acquisition efficiency. The lesion site mapping module and the lesion annotation module work in coordination, automatically parsing the medical record information, and mapping and annotating the lesion site information on the three-dimensional human model loaded by the model loading and interaction module. The three-dimensional human model itself has an intuitive spatial reference. Combined with the visual annotation of the lesion site, doctors can quickly and accurately locate the lesion on the virtual human model, converting the abstract text description into a concrete spatial information, greatly improving the localization efficiency and accuracy of the lesion site. The model interaction function provided by the model loading and interaction module allows doctors to observe the lesion site from different angles and scales, further enhancing the accuracy and convenience of lesion site localization. The human system options provided by the system screening module allow doctors to select a specific human system for viewing according to their diagnosis and treatment ideas. The system responds to the user's selection operation and only displays the lesion site annotations related to the selected system on the three-dimensional human model, filtering out the interference information of other systems, enabling doctors to focus on a specific system for disease analysis, clearly understand the lesion distribution within the system, and analyze the correlation between diseases in different systems, thereby supporting doctors to conduct more in-depth and comprehensive systematic disease analysis. The hover information display module and the detailed information loading module respond to the user's mouse hover and click operations respectively, and dynamically present the examination results, abnormal indicators, and detailed medical record information related to the lesion site. The hover information display module instantaneously displays a summary of key information when the mouse hovers, realizing the quick preview of information; the detailed information loading module loads more comprehensive detailed information after the click operation to meet the doctor's need to understand the condition in depth. This interactive information presentation method realizes the on-demand acquisition of information, avoids information overload, and improves the user experience and information acquisition efficiency.

[0068] In summary, through the collaborative work of each module, the visualization medical record system of the present invention constructs a visualization medical record information display platform centered on a three-dimensional human body model, effectively solving the deficiencies of traditional electronic medical record systems in terms of information acquisition efficiency, lesion site positioning, systematic analysis, and information interactivity, significantly improving the efficiency and intuitiveness of doctors' access to and understanding of medical record information, thereby assisting doctors to perform disease condition assessment and diagnosis and treatment decision-making more quickly and accurately, and ultimately improving the quality and efficiency of medical services.

[0069] A visualization method for an electronic medical record system and a visualized medical record system of the present invention aim to improve the efficiency and intuitiveness of doctors' access to and understanding of electronic medical record information. The core of this method lies in constructing a system main page including a navigation bar area, a three-dimensional human body model display area, and a diagnosis and examination display bar area (step S1). The navigation bar area serves as an entrance to access patient medical record information and is given the function of dynamically loading and displaying specific medical record information content in step S2. Specifically, the navigation bar provides at least three entrance options, corresponding to the patient's basic information, chief complaint information, and current medical history information respectively. When the user clicks on any entrance option, the system will dynamically load and display the corresponding medical record information content within the navigation bar area. For example, when clicking on the "basic information" entrance, the patient's name, age, gender, and other basic information will be expanded or loaded within the navigation bar area. This design enables doctors to quickly locate and access the required medical record information categories. The three-dimensional human body model display area is the core visualization component of this method. In step S3, the system first loads and displays a standard three-dimensional human body model, providing doctors with an intuitive framework of human anatomical structures. Subsequently, steps S4 and S5 describe the visualization process of the lesion site. The system automatically identifies and extracts the lesion site information described in the medical record information in response to the parsing of the patient's electronic medical record information, such as tumor, inflammation site, etc. The extracted lesion site information is then mapped to the corresponding anatomical positions on the three-dimensional human body model and visually marked on the three-dimensional human body model, such as by highlighting, color marking, etc., to intuitively present the patient's lesion location. Step S6 further enhances the function of the three-dimensional human body model display area. By setting human body system options including at least eight major system classifications, users can select a specific human body system, and the system will respond to the user's selection operation and only display the lesion site markings belonging to the selected human body system classification on the three-dimensional human body model, thereby realizing the systematic classification display of lesion sites. Steps S7 and S8 emphasize the interactivity of the three-dimensional human body model. In step S7, when the user hovers the mouse over the lesion site marking on the three-dimensional human body model, the system dynamically displays the examination results and abnormal index information related to this lesion site, such as imaging examination results, abnormal values in laboratory tests, etc. In step S8, when the user clicks on the lesion site marking on the three-dimensional human body model, the system will jump or load and display more detailed diagnosis and treatment information related to this lesion site, including detailed examination data, pathological results, and treatment plan information, realizing a rapid navigation from macroscopic visualization to microscopic detailed information. Step S9 further integrates real-time physiological sign data into the three-dimensional human body model display area. In the middle three-dimensional human body model display area, real-time physiological sign data such as the patient's body temperature, respiratory rate, pulse, and blood pressure are displayed, providing doctors with a more comprehensive overview of the patient's condition.The examination display bar area serves as an auxiliary information display area. In step S10, the system classifies and displays the auxiliary examination details window, the imaging window of the auxiliary examination site, and the relevant diagnosis information window at the time of admission in this area to supplement and display the patient's diagnosis and treatment information. For example, the auxiliary examination details window can display the detailed results of auxiliary examination items such as the patient's blood test and imaging examination. The imaging window of the auxiliary examination site can display the imaging images related to the lesion site. The relevant diagnosis information window at the time of admission can display information such as the patient's preliminary diagnosis and main diagnosis. By constructing the main system page including the navigation bar area, the three-dimensional human model display area, and the examination display bar area, and combining a series of information processing and interaction technologies, the following technical effects can be achieved: 1. Improve the efficiency of obtaining medical record information: Through the entry options and dynamic loading function in the navigation bar area, doctors can quickly locate and access the required medical record information categories without having to search layer by layer in a vast amount of information. The examination display bar area classifies and displays auxiliary examinations, imaging, and diagnosis information, further concentrating and presenting key diagnosis and treatment information, and improving the efficiency of information acquisition; 2. Realize the visual presentation of the lesion site: Through the three-dimensional human model display area, the abstract medical record information is transformed into an intuitive three-dimensional visual form. The lesion site is accurately mapped onto the three-dimensional human model and marked. Doctors can intuitively understand the anatomical location and spatial distribution of the lesion site, effectively making up for the lack of spatial information in traditional electronic medical record systems, and improving the efficiency and accuracy of condition assessment and diagnosis. The setting of the human system option further realizes the systematic classification display of the lesion site, helping doctors view and analyze the condition more systematically; 3. Enhance the interactivity of medical record information: Through interactive functions such as mouse hovering to display examination results and abnormal index information, and clicking to jump or load detailed diagnosis and treatment information, the on-demand acquisition and in-depth mining of information are realized. Doctors can quickly obtain key data and view detailed information in an intuitive and natural interaction manner, improving the efficiency of information acquisition and the user experience; 4. Provide a comprehensive overview of the condition: By displaying the patient's physiological sign data in real time in the three-dimensional human model display area and integrating the real-time physiological data with the three-dimensional human model in one interface, doctors can understand the patient's physiological state in real time while observing the lesion site, obtain a more comprehensive overview of the condition, and provide support for quickly assessing the condition and formulating a preliminary diagnosis and treatment plan. Brief Description of the Drawings

[0070] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the following drawings are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0071] Figure 1It is an overall display diagram of the main page of the system of the present invention (the interactive timeline is not shown);

[0072] Figure 2 It is an overall display diagram of the secondary page of the system of the present invention;

[0073] Figure 3 It is an overall display diagram of the secondary page of the system of the present invention. Specific embodiments

[0076] The embodiments of the present invention will be described in detail below.

[0077] As Figure 1 and Figure 2 shown, a visualization method for an electronic medical record system in this embodiment includes the following steps:

[0078] Step S1, construct the main page of the system.

[0079] The overall layout of the main page of the system is divided into three main areas: the left navigation bar area, the middle three-dimensional human model display area, and the right examination display bar area.

[0080] Navigation bar area: Construct a vertically arranged navigation bar on the left side of the system page, and design it using the user interface (UI) design software Figma. The navigation bar contains three entry options, namely "Basic Information", "Chief Complaint", and "History of Present Illness", and each entry option is presented in the form of a text label and a click event response is set.

[0081] Three-dimensional human model display area: Construct an area that occupies the main display area in the middle of the system page to display the three-dimensional human model. This area uses the Unity3D engine to create a three-dimensional scene and configure the camera and lights to ensure a good visual effect of the three-dimensional model.

[0082] Examination display bar area: Construct a vertically arranged area on the right side of the system page to classify and display examination information. This area is divided into three windows, namely the "Details Window of Auxiliary Examinations", the "Image Window of Auxiliary Examination Sites", and the "Relevant Diagnosis Information Window at the Time of Admission", and the windows are switched in the form of tab pages.

[0083] Step S2, implement the functions of the entry options in the navigation bar area.

[0084] For the three entry options in the navigation bar area, the following functions are respectively implemented:

[0085] "Basic Information" entry option: In response to the user's operation of clicking the "Basic Information" entry option, the system extracts the patient's basic information from the electronic medical record database, including name, gender, age, occupation, marital status, contact information, medical insurance type, etc. The extracted information is dynamically loaded and displayed in a window expanded below the navigation bar area in a structured text form, such as a table or a list.

[0086] "Chief Complaint" entry option: In response to the user's operation of clicking the "Chief Complaint" entry option, the system extracts the patient's chief complaint information from the electronic medical record database. The chief complaint information is usually recorded in natural language text form. The system uses natural language processing (NLP) techniques, such as keyword extraction algorithms, to perform preliminary analysis and refinement on the chief complaint content, extract key information, and dynamically load and display it in a window expanded below the navigation bar area in a concise and clear text form.

[0087] "History of Present Illness" entry option: In response to the user's operation of clicking the "History of Present Illness" entry option, the system extracts the patient's history of present illness information from the electronic medical record database. The history of present illness information is also recorded in natural language text form. The system uses information extraction techniques to extract structured information such as key medical terms, time information, and symptom descriptions from the history of present illness text, organizes it in paragraphs and itemized forms, and dynamically loads and displays it in a window expanded below the navigation bar area.

[0088] Step S3: Implementation of 3D human model loading and interaction functions.

[0089] In the 3D human model display area, the following functions are implemented:

[0090] 3D human model loading: When the system starts, the Unity3D engine preloads a standard 3D male or female human model without any lesion markings (automatically selected according to the patient's gender). The 3D model uses a high-precision model that can clearly display the main anatomical structures of the human body. The initial state of the model is set to a frontal standing pose.

[0091] 3D model interaction function: Using the interaction control functions provided by the Unity3D engine, mouse events are listened for. In response to a mouse drag event, a rotation operation of the 3D model is implemented; in response to a mouse wheel event, a zoom operation of the 3D model is implemented; in response to a mouse pan event, a translation operation of the 3D model is implemented. The user can freely adjust the viewing angle and zoom ratio of the 3D model through mouse operations.

[0092] Step S4: Identification and mapping of lesion site information.

[0093] The system deploys a lesion site information identification and mapping module in the background to implement the following functions:

[0094] Lesion information extraction and analysis: The system uses natural language processing (NLP) technology and medical knowledge base to intelligently analyze text information such as diagnosis reports, examination reports, and medical records in electronic medical records. For example, named entity recognition (NER) technology is used to identify key medical entities such as disease names, anatomical sites, and pathological properties in medical record texts; relationship extraction technology is used to identify the relationship between diseases and sites.

[0095] Part coordinate mapping: The system pre-builds a medical anatomical part database to map various parts of the human body (e.g., lung lobes, kidneys, liver segments, etc.) to the corresponding grid or vertex coordinates on the 3D human body model. After parsing the lesion part information from the medical record text, the system searches for the corresponding 3D model coordinates in the anatomical part database based on the part name.

[0096] Step S5: Visually mark the lesion site.

[0097] On the 3D human body model, the mapped lesion parts are visually annotated. The specific implementation method is as follows:

[0098] Highlighting: Using the material editing and rendering technology of the Unity3D engine, the area on the 3D model corresponding to the coordinates of the lesion is highlighted. For example, red color, flashing effects or contour lines can be used to highlight the lesion so that it is clearly visible on the 3D model.

[0099] 3D model overlay: For solid lesions such as tumors and stones, the system uses 3D model overlay technology to overlay a spherical 3D geometric model representing the lesion on the surface of the human body model and give it a bright red material.

[0100] Step S6: Human body system option function is realized.

[0101] Below the 3D human body model display area, eight buttons are created using the UI components of the Unity3D engine, representing the nervous system, respiratory system, circulatory system, digestive system, urinary system, reproductive system, endocrine system, and motor system.

[0102] System-part association: The system pre-builds a human body system-anatomical part association database, and assigns each anatomical part of the human body to the corresponding system. For example, the lung lobes belong to the respiratory system, the kidneys belong to the urinary system, and the brain tissue belongs to the nervous system.

[0103] System Filtering and Dynamic Display: In response to the user's operation of clicking on a certain system option, the system filters out all the diseased parts belonging to that system according to the human body system - anatomical part association database. Then, using the model display / hide control function of the Unity3D engine, only the highlighted marks of the diseased parts related to the selected system are displayed, while the diseased marks of other systems are hidden. For example, after clicking on the "Urinary System" option, only the diseases related to the urinary system (such as kidney stones, bladder tumors) are displayed on the three - dimensional model, while the diseased marks of other systems such as the respiratory system and digestive system are temporarily hidden.

[0104] Step S7: Mouse hover to display examination results and abnormal index information.

[0105] Add a mouse - hover event listener to each diseased part annotation on the three - dimensional human body model.

[0106] Information Pop - up Window Generation: In response to the mouse - hover event, the system retrieves the examination results and abnormal index data related to the diseased part where the mouse hovers from the electronic medical record database. For example, retrieve the imaging examination reports, laboratory test results, pathological reports, etc. of this part.

[0107] Information Pop - up Window Display: Using the UI components of the Unity3D engine, a dynamic information pop - up window is generated next to the mouse pointer. The key examination results and abnormal indexes related to this diseased part are displayed in the pop - up window in a concise and clear text form. For example, for a tumor part, the size of the tumor, imaging description, pathological diagnosis results, etc. can be displayed in the pop - up window; for an inflammatory part, the values of inflammatory indexes, examination time, etc. can be displayed in the pop - up window.

[0108] Step S8: Click on the diseased part to jump to or load detailed information.

[0109] Add a mouse - click event listener to each diseased part annotation on the three - dimensional human body model.

[0110] Detailed Information Page Jump: In response to the mouse - click event, the system jumps to a new system sub - page according to the clicked diseased part. This sub - page is specifically used to display the detailed medical record information related to this diseased part, such as detailed examination data, pathological results, and treatment plan information.

[0111] Step S9: Real - time display of physiological sign data.

[0112] Below the three - dimensional human body model display area, use the UI components of the Unity3D engine to create text labels for displaying body temperature (T), respiratory rate (R), pulse (P), and blood pressure (BP) data respectively.

[0113] Real-time data interface: The system establishes a data interface with the hospital's physiological monitoring system to obtain real-time vital sign data of patients, such as body temperature, respiratory rate, pulse, blood pressure, etc.

[0114] Data dynamic update: The system binds the real-time obtained vital sign data with text tags to achieve dynamic update and real-time display of the data.

[0115] Step S10: Implement the functions of the diagnosis and examination display area.

[0116] In the diagnosis and examination display area on the right side of the system main page, the following functions are implemented:

[0117] Create an auxiliary examination details window: Under the "Auxiliary Examination Details Window" tab page, display the list of the patient's auxiliary examination items and a summary of key results. For example, list items such as the patient's recent blood tests, urine tests, biochemical tests, electrocardiograms, ultrasound examinations, etc., and display the key indicators and abnormal results of each item.

[0118] Create an image window for the auxiliary examination site: Under the "Image Window for Auxiliary Examination Site" tab page, display thumbnails of the image data related to the auxiliary examination. For example, if the patient has undergone a chest CT examination, this window can display thumbnails of the CT images.

[0119] Create a window for relevant diagnosis information at the time of admission: Under the "Window for Relevant Diagnosis Information at the Time of Admission" tab page, display information such as the patient's preliminary diagnosis, main diagnosis, discharge diagnosis, etc. at the time of the current or previous admission. These diagnosis information are displayed in structured text form.

[0120] Through the above steps, a main page of a visualization electronic medical record system based on the Unity3D engine can be constructed to implement the visualization solution of the electronic medical record system of the present invention.

[0121] In this embodiment, further, the following steps are also included:

[0122] Step S11: Extract diagnosis and treatment event data and construct a timeline data structure.

[0123] The system first needs to extract the diagnosis and treatment event data of a specified patient from the electronic medical record database. This process is achieved by executing Structured Query Language (SQL) query statements. For example, using the patient's unique identifier "medical record number" as the retrieval condition, all diagnosis and treatment event records related to this patient are retrieved from the preset diagnosis and treatment event data table. The query statement needs to set an appropriate time range to ensure the extraction of complete diagnosis and treatment history data. The extracted raw data usually contains various types of diagnosis and treatment event information, such as diagnosis records, surgical records, medication records, examination records, etc., and the data formats may not be unified. Therefore, it is necessary to clean and structure the raw data. In this embodiment, the Python programming language is used, and the data cleaning and structuring operations are carried out with the help of the Pandas data processing library. Specifically, the system uniformly organizes different types of diagnosis and treatment event information into structured data in JSON format. Each event record contains the following key fields:

[0124] Event type (event_type): Specify the category of the event, such as "diagnosis", "surgery", "medication", "examination", etc., represented by predefined enumeration values;

[0125] Event time (event_time): Record the specific time when the event occurred, accurate to the date and time point, such as "2023-10-26 10:30:00", stored in timestamp format;

[0126] Event description (event_description): Contains a detailed text description of the event, such as the specific disease name of the diagnosis "acute appendicitis", the surgical name "laparoscopic appendectomy", the drug name and dosage "amoxicillin 0.5g tid", the examination item and main result "chest X-ray: no obvious abnormality", etc., stored in natural language text format;

[0127] Related part (related_part): If the event is related to a specific part of the body, record the information of the related body part, such as "left lung", "right knee joint", "heart", etc., represented by standard medical terms. If the event does not involve a specific part, this field is empty;

[0128] Detail link (detail_link): A link or index pointing to the detailed information of this event in the electronic medical record system, such as the URL address or database record ID pointing to the detailed pages of the diagnosis report, surgical record, medication order, examination report, etc. in the electronic medical record system.

[0129] After completing the data structuring process, the system sorts the structured diagnosis and treatment event data in ascending order according to the event time field (event_time) and constructs a timeline data model. This data model is stored in a list form, and each element in the list is a diagnosis and treatment event record in JSON format. This timeline data model will be used as the data source for the subsequent timeline visualization component.

[0130] Step S12: Draw interactive timeline interface elements.

[0131] The system uses the JavaScript programming language and combines it with HTML5 Canvas graphics drawing technology to draw the visual elements of the interactive timeline in the bottom area of the system main page. First, use the Canvas API to draw a horizontal line as the main axis of the timeline. According to the time span of the patient's diagnosis and treatment history, for example, from the patient's first visit date to the current date, automatically calculate and generate the time scale marks on the timeline. In this embodiment, years are used as the main scale unit, and the scale density is intelligently adjusted according to the time span. For example, if the time span is ten years, a year scale is drawn every two years; if the time span is one year, a month scale is drawn every month. Add text labels of years or months below the scale marks to clearly show the time scale of the timeline. Then, according to the timeline data model constructed in step 11, traverse each diagnosis and treatment event record and mark the occurrence time point of each diagnosis and treatment event on the timeline. In this embodiment, circular icons are used as the diagnosis and treatment event node marks, and the circular icons are filled with different colors according to the event type. For example:

[0132] Diagnosis event: green circular icon;

[0133] Surgery event: red circular icon;

[0134] Medication event: blue circular icon;

[0135] Examination event: yellow circular icon.

[0136] The horizontal position of the circular icon is calculated according to the proportional position of the event occurrence time on the timeline, and the vertical position is uniformly arranged above the timeline. To enhance the interactivity of the timeline, the system uses the JavaScript event listening mechanism to add interactive functions to the timeline. For example, listen for the mouse drag event. When the user drags the mouse in the timeline area, trigger the horizontal scrolling of the timeline to implement the function of viewing a longer time span of the diagnosis and treatment history. At the same time, listen for the mouse wheel event. When the user scrolls the mouse wheel, trigger the timeline zoom function to implement the function of zooming in or out the display ratio of the timeline.

[0137] Step 13: Link the mouse hover event response and information display.

[0138] The system binds a mouseover event listener to each diagnosis and treatment event node on the timeline. When the mouse pointer hovers over a certain event node, the corresponding event handling function is triggered. When the mouseover event is triggered, the event handling function extracts the detailed information of the event from the timeline data model constructed in step 3.1 according to the currently hovered event node, including the content of the event type (event_type) and event description (event_description) fields. Then, a tooltip is dynamically generated using HTML elements, and the extracted event type and event description information are filled into the tooltip in text form. The tooltip is displayed near the mouse pointer and set to have a certain delay display effect, such as being displayed 0.5 seconds after the mouse hovers. In addition, in the event handling function, the system also needs to control the display of the three-dimensional human model according to the "related part" (related_part) information of the currently hovered event. The system first parses the "related part" information of the event. For example, if the related part is "lungs", the corresponding body part is identified as the lungs. Then, using the model control interface provided by the Three.js 3D rendering engine, the lungs area is highlighted on the three-dimensional human model. In this embodiment, the highlighting is performed by changing the part color and adding a contour line. For example, the color of the lungs area is set to red and a white contour line is added. At the same time, the system automatically adjusts the viewing angle of the three-dimensional human model, focuses the viewing center on the highlighted lungs area, and appropriately enlarges the model to facilitate the doctor to observe more clearly. When the mouse moves on the timeline and hovers over different event nodes, the content of the tooltip and the highlighted part of the three-dimensional human model are updated in real time to dynamically display the relevant information and related parts of the currently hovered event.

[0139] Step S14, Mouse click event response and detailed information jump.

[0140] The system further adds a mouse click event listener to the timeline event node. When the user clicks on a certain event node, the corresponding event handling function is triggered. When the mouse click event is triggered, the event handling function extracts the value of the "detail link" (detail_link) field of the event from the timeline data model constructed in step 3.1 according to the currently clicked event node. The value of this field points to the page URL address of the detailed information of this event in the electronic medical record system. Then, the system uses a page jump function in JavaScript, such as window.open(detail_link, 'blank'), to open a new browser tab or window and load and display the detailed medical record page corresponding to the URL address. The user can view more detailed medical records, examination images, treatment plans and other complete information of this event on the new page.

[0141] In this embodiment, the following steps are further included:

[0142] Step S15: constructing the system sub-page.

[0143] Develop and build a system sub-page in advance. The sub-page adopts a column layout and is divided into a diagnosis information window area, a detailed image window area, and a lesion site simulation display area. The diagnosis information window area is further divided into a physical examination window, a specialist condition window, and an abnormal indicator window, which are used to display the corresponding diagnosis information respectively. The window uses a structured method such as a table or list to organize information, and reserves an embedded position for data visualization components. The detailed image window area reserves a loading area for medical image display components, and an image description information display area is set adjacent to it for synchronously displaying image description text. The lesion site simulation display area reserves a graphic rendering area for presenting a simulated image of the lesion site.

[0144] Step S16, responding to the user's click operation and page jump.

[0145] On the 3D human body model on the main page of the system, an event listener is configured for each lesion mark that can respond to user click operations. When the user clicks on a lesion mark on the 3D human body model using a mouse or touch device, the front-end framework of the system (such as React Router) receives the click event and controls the program to jump to the pre-built system sub-page according to the preset routing rules. At the same time, the identification information of the lesion (such as the lesion ID) is passed as a parameter to the system sub-page for subsequent data retrieval.

[0146] Step S17: Initialization of system sub-page and data retrieval.

[0147] After the system sub-page is loaded, the front-end program parses the received lesion site identification information, builds a data request based on the information, and calls the back-end API interface. After receiving the request, the back-end API interface retrieves the diagnosis information data related to the lesion site and the human body system to which it belongs from the electronic medical record database according to the lesion site identification information, including:

[0148] Physical examination data: such as palpation findings, percussion sounds, auscultation descriptions, etc.;

[0149] Specialty data: such as neurological reflex examination results, respiratory system auscultation results, etc.;

[0150] Abnormal indicator data: such as the values ​​and normal reference ranges of physiological indicators such as blood pressure, heart rate, and blood oxygen saturation;

[0151] Auxiliary examination image data: for example, URL or binary data of medical image files such as CT, MRI, and X-rays;

[0152] Imaging description information: For example, the text description information in an imaging report, including examination time, examination site, examination method, imaging findings, diagnosis opinions, etc.;

[0153] Pathological feature information of the lesion site: For example, lesion type, size, shape, location, involvement of surrounding tissues, etc.

[0154] Moreover, the backend API interface converts the retrieved diagnostic information data into a format, for example, converting numerical data into a data format suitable for chart drawing, converting the imaging data URL into a format that can be directly loaded by the frontend, and encapsulating the data into a structured data format such as JSON or XML, and returns it to the frontend program.

[0155] Step S18: Data filling and visual display in the diagnostic information window.

[0156] After the frontend program of the system sub-page receives the diagnostic information data returned by the backend API interface, it fills the data into each sub-window of the diagnostic information window:

[0157] Physical examination window: Structurally display the physical examination data in the form of a table or list. For example, fill the information such as the palpation site and palpation result into the cells of the table correspondingly.

[0158] Specialist condition window: Structurally display the specialist condition data. For example, display the information such as specialist examination items and examination results correspondingly.

[0159] Abnormal index window: Compare the abnormal index data with the normal reference range and use color coding (for example, red indicates severe abnormality and yellow indicates moderate abnormality) to highlight the abnormal indexes that exceed the normal range. For numerical index data, call a data visualization component (such as a component based on ECharts or Chart.js) to present the change trend of the indexes in the form of a line chart or a bar chart.

[0160] Step S19: Implement the imaging loading and operation functions in the detailed imaging window.

[0161] The frontend program of the system sub-page extracts the auxiliary examination imaging data from the received diagnostic information data and calls a medical imaging display component (such as Cornerstone.js) to load and display the imaging data. The medical imaging display component provides interactive operation functions such as zooming, rotating, translating, window width and window level adjustment, and users can observe the imaging through mouse or touch operations.

[0162] Step S20: Display of imaging description information.

[0163] The front-end program of the system's secondary page displays the received image description information in text form in the image description information display area adjacent to the detailed image window. The text information adopts a clear and readable layout format, such as being presented in paragraphs or lists, and is associated with the image data. For example, when the user selects a certain area on the image, the relevant text description can be highlighted synchronously.

[0164] Step S21: Generation and display of the simulation diagram in the lesion site simulation display area.

[0165] The front-end program of the system's secondary page extracts the pathological feature information of the lesion site from the received examination information data, and based on this information, calls the lesion site simulation diagram generation module. The lesion site simulation diagram generation module can adopt a rule-based simulation method. For example, according to parameters such as lesion type, size, and shape, a set of lesion simulation diagram templates are predefined, and the appropriate template is selected according to the parameters for rendering. Or, a machine learning-based simulation method can be adopted. A lesion simulation diagram generation model is pre-trained, and the pathological feature information of the lesion site is input, and the model automatically generates the corresponding simulation diagram. The generated lesion site simulation diagram is displayed in the lesion site simulation display area of the system's secondary page to visually present the pathological features of the lesion site and assist the doctor in making a judgment on the condition.

[0166] Through the above steps, the system has completed the construction of the system's secondary page, data loading and filling, and display of detailed diagnosis and treatment information, providing the doctor with detailed diagnosis and treatment information of a specific lesion site, and assisting the doctor in making more accurate diagnosis and treatment decisions. It should also be noted that the above embodiments are described in general technical language. Those skilled in the art can, according to the description of the above embodiments and combined with their own technical knowledge, select appropriate programming languages, development frameworks, databases, and third-party libraries to implement the technical solution described in claim 5. For example, the front-end program can be developed using frameworks such as React, Vue.js, or Angular, the back-end API can be developed using frameworks such as Java Spring Boot, Python Flask, or Node.js, the database can be MySQL, PostgreSQL, or MongoDB, etc., the medical image display component can be Cornerstone.js or VTK.js, etc., and the data visualization component can be ECharts or Chart.js, etc., which will not be elaborated here.

[0167] In this embodiment, further, after the step of constructing the detailed image window on the system's secondary page, the following steps are also included:

[0168] Step S22: Interface construction of the image overlay window.

[0169] On the user interface of the system's secondary page, using front-end user interface development technologies (e.g., front-end frameworks such as React or Vue.js), create an independent window area as the image overlay window. This window is designed to be juxtaposed or adjacent to the detailed image window in the interface layout so that users can conveniently drag image data from the detailed image window to the image overlay window.

[0170] The initial state of the image overlay window is blank, only containing the window title and operation prompt information, such as "Please drag the image here for overlay". In the top or sidebar area of the window, set up an operation control area, including:

[0171] Overlay mode selection dropdown menu: Provide multiple overlay modes such as "transparency overlay", "color overlay", "difference overlay" for users to choose. The default mode is set to "transparency overlay";

[0172] Layer control panel: Used to display the list of currently loaded image layers. Each layer entry contains the image name, visibility switch, transparency adjustment slider, and layer order adjustment buttons (e.g., up and down buttons).

[0173] Step S23: Drag and load and display of image data:

[0174] The system continuously monitors the mouse drag events of the user in the detailed image window. When the user selects an image data set (e.g., a thumbnail or list item representing a CT image sequence) in the detailed image window and drags it to the image overlay window area, the system captures this drag event.

[0175] In response to the drag event, the system performs the following operations:

[0176] Image data loading: According to the identification information of the dragged image data set, retrieve and load the corresponding image data from the image database of the electronic medical record system. The image data is usually stored in DICOM format. The system uses a DICOM parsing library (e.g., Cornerstone.js or dcmjs) to parse the DICOM file and convert the image data into an image format that can be processed internally by the system (e.g., WebGL Texture).

[0177] Layer creation and addition: In the image overlay window, create a new image layer for the newly loaded image data. Each layer object contains attributes such as image data, current transparency value (initial value is 1, i.e., completely opaque), and display order index. Add the newly created layer object to the list in the layer control panel and render the image corresponding to this layer in the main display area of the image overlay window.

[0178] Layer control panel update: Update the layer control panel to add loaded image layer entries to the list, display the image name, and provide interactive controls such as visibility switch and transparency adjustment slider.

[0179] Step S24: Overlay display and layer control of image data.

[0180] The main display area of ​​the image overlay window uses WebGL or Canvas and other graphics rendering technologies to overlay images. The system updates the display effect of the overlay image in real time according to the currently selected overlay mode and the settings in the layer control panel.

[0181] Transparency Overlay Mode: When the "Transparency Overlay" mode is selected, the system renders each image layer from bottom to top in the order of the layer list. During the rendering process of each layer, the alpha channel value of the pixel is adjusted according to its transparency value. When the transparency value is 1, the layer is completely opaque; when the transparency value is 0, the layer is completely transparent; when the transparency value is between 0 and 1, the layer is semi-transparent. By adjusting the transparency value of each layer, you can control the visibility of different images in the overlay result.

[0182] Color Overlay Mode: When the "Color Overlay" mode is selected, the system assigns different color channels to different image layers (for example, the first layer is mapped to the red channel, the second layer is mapped to the green channel, and the third layer is mapped to the blue channel). When overlaying rendering, the grayscale value of each layer is mapped to its corresponding color channel, and the color channel values ​​of all layers are synthesized into the final color overlay image. This mode can intuitively distinguish the information of different modal images by color differences.

[0183] Difference Overlay Mode: When the "Difference Overlay" mode is selected, the system first selects a base layer (for example, the first layer in the layer list), and then calculates the pixel value differences between the other layers and the base layer. The difference values ​​are mapped to the grayscale or color image and displayed in the image overlay window. This mode can highlight the changes in pixel values ​​between different images, for example, for comparing the image differences of the same part at different time points.

[0184] Users can adjust the image overlay effect in real time through the interactive controls in the layer control panel. The interactive controls include:

[0185] Visibility switch: Users can click the visibility switch next to each layer entry to control the display or hiding of the layer. When a layer is hidden, the layer will no longer participate in the overlay rendering, and the image overlay window will update the display effect in real time.

[0186] Transparency adjustment slider: Users can drag the transparency adjustment slider next to each layer entry to adjust the transparency value of the layer in real time. The image overlay window will dynamically update the display effect of the overlaid image according to the change of the transparency value.

[0187] Layer order adjustment button: Users can click the up or down button next to the layer entry to adjust the order of the layers in the layer list. The layer order determines the front-to-back stacking relationship of the images during overlay rendering. Adjusting the layer order can change the visual effect of the overlaid image.

[0188] Step S25, Implementation of the interactive operation function.

[0189] In the main display area of the image overlay window, the system integrates the following interactive operation functions to support users in making a refined observation of the overlaid image:

[0190] Zoom in and out: Users can use the mouse wheel to scroll or the pinch / expand gesture to perform real-time zoom in and out on the overlaid image. The system dynamically adjusts the display ratio of the image according to the user's operation and keeps the center position of the image unchanged.

[0191] Rotation: Users can use the mouse drag or the rotation gesture to rotate the overlaid image at any angle. The system updates the rotation angle of the image in real time according to the user's operation and re-renders the overlaid image.

[0192] Translation: Users can use the mouse drag or the drag gesture to pan the overlaid image. The system updates the translation offset of the image in real time according to the user's operation and re-renders the overlaid image.

[0193] The above interactive operation functions enable users to observe the overlaid image from different scales and angles, deeply analyze the image details, and accurately identify potential lesions or abnormal structures.

[0194] Through the above steps, this embodiment details the specific implementation method of the image overlay window in the visualization method of the electronic medical record system. This embodiment utilizes mature front-end user interface development technology, image processing technology, and graphics rendering technology to construct a feature-complete and easy-to-operate image overlay analysis platform, which can effectively improve the doctor's comprehensive analysis ability of multi-modal image data and assist in clinical diagnosis and treatment decision-making.

[0195] In this embodiment, further, after the step of constructing the detailed image window on the system secondary page, the following steps are further included:

[0196] Step S26, Extraction of inpatient diagnosis and treatment data.

[0197] When the doctor clicks on the "Respiratory System" option on the 3D human body model on the system's main page (this embodiment is described by taking the "Respiratory System" as an example), and further clicks on the lesion site annotation related to the respiratory system, the system jumps to the respiratory system sub-page. In the initialization stage of the sub-page, the system's data extraction module extracts the inpatient diagnosis and treatment data related to the current respiratory system sub-page from the electronic medical record system. Specifically, the system first retrieves the inpatient records of the patient. For example, it obtains the inpatient records of the patient due to respiratory diseases (such as pneumonia, acute asthma attack) in the past year. For each inpatient record, the system further extracts the sequence of diagnosis and treatment events during the hospitalization. These events include but are not limited to:

[0198] Admission record: Record information such as admission time, admission diagnosis, chief complaint, and current medical history;

[0199] Inspection and test events: Record inspection and test items such as blood routine, sputum culture, chest X-ray, pulmonary function test, arterial blood gas analysis, inspection time, and description of inspection results;

[0200] Drug treatment events: Record the names, administration times, doses, administration routes, and medication orders of drugs such as antibiotics, bronchodilators, and inhaled corticosteroids;

[0201] Respiratory support treatment events: Record respiratory support treatment methods such as oxygen inhalation, non-invasive ventilator-assisted ventilation, and invasive mechanical ventilation, start and end times, and treatment parameter settings;

[0202] Surgical treatment events (such as thoracentesis, tracheotomy): Record the surgical name, surgical time, description of the surgical process, and postoperative conditions;

[0203] Disease assessment events: Record the assessment records made by doctors on the patient's condition, such as disease progression assessment, treatment effect assessment, prognosis assessment, etc., assessment time, and assessment conclusions;

[0204] Discharge record: Record information such as discharge time, discharge diagnosis, discharge orders, and follow-up plans after discharge;

[0205] For each diagnosis and treatment event, the system extracts its event type (such as "inspection and test", "drug treatment"), event occurrence time (accurate to the date and time point), and event description information (such as "Chest X-ray examination, result shows: consolidation shadow in the lower lobe of the right lung"). The extracted inpatient diagnosis and treatment data are sorted in chronological order to form an inpatient diagnosis and treatment event sequence.

[0206] Step S27: Construct an inpatient event timeline.

[0207] For each extracted hospitalization record, the system constructs an independent time axis of hospitalization events. The time axis is displayed in the lower area of the secondary page in the form of a horizontal straight line, with time as the horizontal axis, and time scales are automatically generated according to the length of hospitalization. For example, the scales are divided in days, and the hospitalization date range is marked. On the time axis, the system marks the recording points of each medical treatment event according to the sequence of medical treatment events.

[0208] Visual markings: Different visual markings are used to distinguish different types of medical treatment events. For example, circular markings are used to represent examination and inspection events, square markings are used to represent drug treatment events, triangular markings are used to represent respiratory support treatment events, and diamond markings are used to represent surgical treatment events. Different types of markings use different color coding. For example, examination and inspection events use blue, drug treatment events use green, respiratory support treatment events use orange, and surgical treatment events use red.

[0209] Division of medical treatment stages: The system divides the time axis of hospitalization events into different medical treatment stage areas according to the medical treatment goals and measures during hospitalization. For example, the hospitalization process can be divided into stages such as "admission assessment stage", "anti-infection treatment stage", "respiratory support treatment stage", "recovery period", etc. Different stage areas are distinguished on the time axis by different background colors or dividing lines, and the event recording points corresponding to the corresponding stages are centrally displayed within the stage areas, thus presenting a phased medical treatment process on the time axis.

[0210] Step S28, implementation of the interaction function, adds an interaction function to the event recording points on the time axis of hospitalization events.

[0211] Mouse hover prompt: When the user hovers the mouse over an event recording point, the system detects the mouse hover event and generates an information prompt box according to the medical treatment event data associated with the event recording point. The prompt box pops up near the mouse pointer and displays the brief description information of the medical treatment event in a concise text form. For example, for an examination and inspection event, the prompt box shows "Chest X-ray examination"; for a drug treatment event, the prompt box shows "Intravenous drip of antibiotic: Ceftriaxone".

[0212] Mouse click to expand detailed information: When the user clicks on an event recording point with the mouse, the system detects the mouse click event and expands the floating page. The floating page loads and displays the detailed medical record associated with the event recording point. For example, for an examination and inspection event, the floating page shows the complete chest X-ray examination report, including image description, diagnosis opinion, and thumbnail of the image; for a drug treatment event, the floating page shows the detailed medication order, including drug name, dosage, administration route, administration frequency, medication time, and medication duration, etc. The floating page shows the detailed medical record in a scrollable manner for the doctor to browse conveniently.

[0213] Step S29: Implement a dynamic update mechanism.

[0214] The system background continuously monitors the treatment progress data of patients. For example, when a doctor updates a patient's medication order, adds a new inspection and test report, or modifies the disease condition assessment record in the electronic medical record system, a data update event of the electronic medical record system is triggered. After receiving the data update event notification, the data update monitoring module of the visual medical record system automatically starts the dynamic update process of the inpatient event timeline. The system extracts the latest inpatient diagnosis and treatment data from the electronic medical record system again, and based on the latest data, dynamically updates the diagnosis and treatment event recording points, event description information, and diagnosis and treatment stage divisions displayed on the inpatient event timeline. The updated inpatient event timeline is refreshed in real time on the system sub-page to ensure that the inpatient diagnosis and treatment information viewed by doctors is always the latest.

[0215] Through the above embodiments, an interactive inpatient event timeline is constructed for the inpatient diagnosis and treatment data of the respiratory system on the system sub-page, realizing the visualization, structuring, and dynamic presentation of the inpatient diagnosis and treatment process, and providing a convenient and efficient tool for doctors to browse and analyze inpatient diagnosis and treatment information.

[0216] In this embodiment, further, the following steps are also included:

[0217] Step S30: Establish a knowledge base of important diagnosis and treatment information and priority rules.

[0218] First, construct a "knowledge base of important diagnosis and treatment information", which is stored using a relational database (such as MySQL). The knowledge base includes the following data tables:

[0219] Information Type Table (InformationType): Define the types of important information, such as:

[0220]

[0221] Priority Rule Table (PriorityRule): Define priority rules for evaluating the priority of important information.

[0222]

[0223]

[0224] Step S31: Medical record data scanning and important information identification.

[0225] When a doctor opens the electronic medical record of a certain patient, the "medical record data scanning module" in the system background is activated. This module obtains the complete medical record data of the patient through the data interface of the electronic medical record system (for example, an API interface based on the HL7 FHIR standard), including medical history records, diagnosis information, medication records, allergy history records, genetic history records, etc.

[0226] The scanning module uses natural language processing (NLP) technology (for example, using the spaCy library in Python) and a medical knowledge base (for example, UMLS) to analyze the medical record text data. For example:

[0227] Identification of major surgery history: Scan the surgical record text, use named entity recognition (NER) technology to identify medical entities such as the name of the surgery and the surgical site, and combine keyword matching (for example, "transplantation", "resection", "reconstruction") to determine whether it is a major surgery.

[0228] Identification of drug allergy events: Scan the allergy history record and medication record, match them with the drug allergy knowledge base, identify known allergic drugs, and analyze the text description of the allergic reaction to determine whether it is a severe allergic reaction (for example, keyword matching "anaphylactic shock", "dyspnea").

[0229] Identification of genetic disease events: Scan the genetic history record and gene test report, match them with the genetic disease knowledge base, and identify the diagnosed genetic diseases or the carrier status of high-risk genetic disease genes.

[0230] For each piece of potentially important information identified, the scanning module performs a priority assessment according to the "priority rule table" defined in step one to determine its priority level (high, medium, low).

[0231] Step S32, Push and Interface Display of Important Information.

[0232] The "important information push module" pushes important diagnosis and treatment information with "high" and "medium" priorities to the system user interface according to the recognition results in step 31. The push form combines a display bar at the top of the page and notifications in the message center.

[0233] Display bar at the top of the page: In the top area of the system main page, set a fixed display bar to carousel and display the summary of important information with "high" priority. The summary information includes the name of the information type and a brief description. For example, the carousel shows: "[Drug Allergy Event] The patient is known to be allergic to penicillin and has had anaphylactic shock."

[0234] Message Center Notification: Set a "Message Center" icon in the upper right corner of the system interface. When there is important information, an unread message count badge is displayed on the icon. Click the icon to expand the Message Center, which displays all the pushed important information in a list form and sorts them by priority. In the message list, different types of information use different color coding and icon hints. For example:

[0235] Drug allergy event: Use a red background and a medicine bottle icon;

[0236] History of major surgery: Use an orange background and a scalpel icon;

[0237] Genetic disease event: Use a yellow background and a gene icon.

[0238] When the pushed information is related to a body part (e.g., a major surgery involves a specific organ), a 3D human model thumbnail is displayed next to the corresponding information entry in the message list, and the associated body part is highlighted on the thumbnail. The user can click on the carousel information in the display bar at the top of the page or the information entry in the Message Center list, and the system will jump to the detailed record page of this information in the electronic medical record system, facilitating doctors to view the complete medical record information.

[0239] Through the above steps, this embodiment details the specific implementation steps of the visualization method for the electronic medical record system. The solution example of this step can effectively push the key diagnosis and treatment information of patients to doctors automatically, improving the diagnosis and treatment efficiency and safety.

[0240] In this embodiment, further, the following steps are also included:

[0241] Step S33: Construct a data extraction module.

[0242] Construct a data extraction module for automatically retrieving and parsing the medical record data of patients from the electronic medical record system to identify information related to changes in the patient's body structure. The specific implementation process is as follows:

[0243] 1. Data source access configuration: The data extraction module is configured to access the data interface of the electronic medical record system, which can provide data such as the patient's surgical records, pathology reports, structured data fields, and imaging reports. For example, by configuring the API interface address, authentication information, etc. of the electronic medical record system, a data connection channel is established.

[0244] 2. Data retrieval and screening: When a doctor opens the electronic medical record of a certain patient, the data extraction module receives the patient identification information and sends a data retrieval request to the electronic medical record system based on this identification information. The target data of the retrieval request includes the patient's surgical record document, pathology report document, structured medical record fields, and imaging report document.

[0245] 3. Surgical Record Parsing: For the retrieved surgical record documents, the data extraction module uses natural language processing (NLP) technology for parsing. For example, by using a pre-trained medical named entity recognition model, key medical terms in the surgical record text are identified, including the surgical name, surgical site, name of the excised or amputated tissue / organ, etc. Meanwhile, in combination with a medical knowledge base (such as a surgical term dictionary, anatomical site database), semantic understanding and standardization of the identified medical terms are carried out. For example, "left lower limb amputation" is standardized as "left lower limb amputation".

[0246] 4. Pathology Report Analysis: For the retrieved pathology report documents, the data extraction module also uses NLP technology for analysis. For example, by using keyword matching and entity recognition technology, information on the excised tissue site and nature described in the pathology report text is identified. For example, it is identified that "appendix removed, pathology report shows chronic appendicitis".

[0247] 5. Structured Data Field Extraction: The data extraction module directly extracts information on changes in the patient's physical condition from the structured data fields of the electronic medical record system. For example, there are preset fields of "amputation history" and "organ excision history" in the electronic medical record system. The data extraction module directly reads the values of these fields through database query operations, such as "amputation history: left lower limb", "organ excision history: appendix".

[0248] 6. Imaging Report Interpretation: For the retrieved imaging report documents (such as CT reports, MRI reports), the data extraction module can use medical imaging analysis algorithms for assisted interpretation. For example, by using image segmentation algorithms and object detection algorithms, auxiliary analysis of the descriptive text in the imaging report is carried out to identify situations such as organ absence or tissue loss found in imaging examinations. For example, by analyzing a chest CT report, it is identified that "postoperative changes after partial resection of the left lung".

[0249] 7. Structured Information Output: The data extraction module structures the information on changes in the physical condition extracted from the above data sources and outputs it in a predefined format. For example, the amputation information is structured into a data record containing fields such as "site: left lower limb", "type: amputation"; the organ excision information is structured into a data record containing fields such as "organ: appendix", "type: excision".

[0250] Step S34. Build a 3D human model dynamic adjustment and rendering module.

[0251] Build a 3D human model dynamic adjustment and rendering module, and based on the information on changes in the physical condition extracted in Step 1, the 3D human model is modified in real time and visually presented. The specific implementation process is as follows:

[0252] 1. Anatomical Site Mapping Configuration: The system is pre-configured with a detailed anatomical site mapping table, which establishes an accurate mapping relationship between the common anatomical site names in the electronic medical record system and the specific mesh or vertex data on the 3D human model. For example, "left lower limb" is mapped to the mesh data of the left lower limb part of the 3D human model, and "appendix" is mapped to the mesh data of the appendix organ of the model.

[0253] 2. Model Loading and Initialization: When the system main page is loaded, the 3D human model dynamic adjustment and rendering module first loads a standard 3D human model without any modification. This model can be a general male or female human model and is automatically selected for loading according to the patient's gender information.

[0254] 3. Model Dynamic Adjustment: The module receives the structured physical condition change information output by the data extraction module in Step 1. For example, after receiving the information "Part: left lower limb", "Type: amputation", the module locates the mesh data corresponding to "left lower limb" on the 3D human model according to the anatomical site mapping table, and calls the mesh editing function provided by the 3D graphics rendering engine to delete or hide the mesh data of this part, so as to present the effect of the missing left lower limb on the 3D model. For organ resection and tissue resection, a similar method is used for dynamic adjustment of the model mesh.

[0255] 4. Model Real-time Rendering: The 3D human model dynamic adjustment and rendering module uses the 3D graphics rendering engine to real-time render the dynamically modified 3D human model. Ensure the smoothness and real-time nature of the model modification, so that users can immediately see the change effect of the model on the operation interface.

[0256] Step S35. Build an annotation and prompt information overlay module.

[0257] Build an annotation and prompt information overlay module, and add annotation and prompt information to the dynamically adjusted 3D human model to assist doctors in quickly identifying the parts with physical condition changes. The specific implementation process is as follows:

[0258] 1. Annotation Information Generation: The annotation and prompt information overlay module receives the structured physical condition change information output by the data extraction module in Step 1 and generates corresponding annotation text according to the information content. For example, for the information "Part: left lower limb", "Type: amputation", the annotation text "Left lower limb amputation" is generated.

[0259] 2. 3D Annotation Element Creation and Positioning: The module uses the 3D text rendering function provided by the 3D graphics rendering engine to create 3D text labels on the 3D human model as annotation elements. According to the anatomical site mapping table, the annotation elements are accurately positioned near the corresponding parts with physical condition changes on the 3D human model. For example, the annotation label of "Left lower limb amputation" is positioned at the stump of the left lower limb amputation.

[0260] 3. Enhanced Visual Cue Effect: To enhance the prominence of the annotation information, the annotation and cue information overlay module adopts visual cue effects such as color differentiation and mouse-hover information expansion. For example, the color of the annotation text is set to red to distinguish it from the colors of other model elements. When the doctor hovers the mouse over the annotation label, the system pops up an information prompt box to display more detailed information about the changes in the patient's physical condition, such as the name of the surgery and the surgery time.

[0261] Step S36. System Integration and Dynamic Update.

[0262] Integrate the three modules constructed in the above steps S33 to S35 into the electronic medical record system and establish a dynamic update mechanism to ensure that the 3D human model can reflect the latest physical condition of the patient in real time. The specific implementation process is as follows:

[0263] 1. Module Integration: Integrate the data extraction module, the 3D human model dynamic adjustment and rendering module, and the annotation and cue information overlay module with the user interface module, data management module, etc. of the electronic medical record system to achieve data sharing and collaborative work among the modules.

[0264] 2. Dynamic Update Trigger Mechanism: Establish an event-driven dynamic update trigger mechanism. When the medical record information of the patient in the electronic medical record system is updated (for example, a new surgery record is added or the pathology report is updated), the electronic medical record system actively pushes an update event message to the visualization system.

[0265] 3. Model Dynamic Update Process: After receiving the update event message, the visualization system automatically triggers the model dynamic update process. The system re-executes the data extraction operation in step one to obtain the latest information about the changes in the patient's physical condition, and then sequentially executes steps two and three to dynamically adjust the 3D human model and update the annotation and cue information.

[0266] 4. Interface Real-time Refresh: After the dynamic update is completed, the front-end interface of the visualization system is refreshed in real time to ensure that the 3D human model and annotation information seen by the user are always dynamically generated based on the latest medical record information of the patient, thereby providing the doctor with a timely and accurate visual view of the patient's physical condition.

[0267] Through the specific implementation of the above steps 33 to 36, the visualization method of the electronic medical record system of the present invention can be realized, providing the doctor with intuitive, dynamic, and real-time visual information about the changes in the patient's body structure, and assisting the doctor in making more efficient and accurate diagnosis and treatment decisions.

[0268] Based on the above method, this embodiment also provides a visualization medical record system, and the structure of the system includes:

[0269] 1. Main Page Construction Module.

[0270] The main page construction module constructs the user interface layout of the system main page based on user interface (UI) design software, such as Figma. The main page is overall divided into three main areas and adopts a vertical column layout:

[0271] Left Navigation Bar Area: Occupying approximately 20% of the width on the left side of the page, it is arranged vertically and is used to accommodate the navigation entry options provided by the navigation information display module. The background color of the navigation bar is set to light gray to form a visual distinction from the main content area.

[0272] Middle 3D Human Model Display Area: Occupying approximately 60% of the width in the middle of the page, it is the core visual area of the main page and is used for the functional presentation of the model loading and interaction module, lesion annotation module, system screening module, hover information display module, detailed information loading module, and real-time vital sign display module. The background color of this area is set to white to ensure the clear display of the 3D human model.

[0273] Right Examination Display Column Area: Occupying approximately 20% of the width on the right side of the page, it is arranged vertically and is used for the examination information display module to classify and display the auxiliary examination details window, imaging window, and diagnostic information window. The background color of this area is set to light gray to form a contrast with the middle area.

[0274] 2. Navigation Information Display Module.

[0275] The navigation information display module creates three vertically arranged button-style entry options within the left navigation bar area, marked as "Basic Information", "Chief Complaint", and "History of Present Illness" respectively, as follows:

[0276] "Basic Information" Entry: When the user clicks the "Basic Information" button, the navigation information display module responds to the click operation and dynamically loads an information window below the navigation bar area. This window displays the patient's basic demographic information in structured text form, such as name, gender, age, occupation, marital status, contact information, medical insurance type, etc. These information are extracted from the electronic medical record database and are arranged and displayed in the preset field order.

[0277] "Chief Complaint" Entry: When the user clicks the "Chief Complaint" button, the navigation information display module responds to the click operation and dynamically loads another information window below the navigation bar area. This window displays the chief complaint information of the patient's current visit. The chief complaint information is presented in natural language text form and is initially analyzed and streamlined using natural language processing (NLP) technology to extract keywords and highlight them. For example, if the chief complaint is "Repeated cough and expectoration for one week", keywords such as "cough" and "expectoration" will be highlighted.

[0278] "History of Present Illness" Entry: When the user clicks the "History of Present Illness" button, the navigation information display module responds to the click operation and dynamically loads another information window below the navigation bar area. This window details the patient's history of present illness information, which is also presented in the form of natural language text. Using information extraction technology, structured information such as key medical terms, time information, and symptom descriptions is extracted from the history of present illness text and presented in a paragraph-by-paragraph and itemized format. For example, information such as the onset time, development process, accompanying symptoms, relief measures, and effects of symptoms are clearly listed item by item.

[0279] 3. Model Loading and Interaction Module.

[0280] The model loading and interaction module loads and displays a general, high-precision 3D human model of male or female (automatically selected according to the patient's gender) in the central 3D human model display area. The 3D human model is constructed using the Three.js 3D graphics rendering engine, and the initial state of the model is a front-standing posture. The model loading and interaction module also implements the following interaction functions:

[0281] Rotation: The user can rotate the 3D human model in the horizontal and vertical directions through mouse dragging operations to observe the human body structure from different angles;

[0282] Zoom: The user can zoom in or out of the 3D human model through mouse wheel or two-finger pinch operations to observe the details or overall structure of the model;

[0283] Translation: The user can pan the position of the 3D human model in the display area by holding down the middle mouse button and dragging, or using two-finger swipe operations on the touch screen.

[0284] 4. Lesion Site Mapping Module and Lesion Annotation Module.

[0285] The lesion site mapping module docks with the data interface of the electronic medical record system to obtain the patient's electronic medical record information in real time, including text information such as diagnosis reports, examination reports, and case records. The module integrates a natural language processing (NLP) engine and a medical knowledge base internally, specifically including:

[0286] Lesion Information Extraction and Analysis: The NLP engine uses named entity recognition (NER) technology to identify key medical entities such as disease names, anatomical locations, and pathological properties in the medical record text. For example, in the diagnosis report "The lung CT shows a nodular shadow about 2 cm in diameter in the upper lobe of the right lung", "the upper lobe of the right lung" is identified as the anatomical location, and "nodular shadow" is identified as the pathological property. Relationship extraction technology identifies the association relationship between the disease and the location. For example, the "located in" relationship between "nodular shadow" and "the upper lobe of the right lung".

[0287] Anatomical Site Coordinate Mapping: The medical knowledge base stores a human anatomical site database, which records the mapping relationships between various human body parts (such as lung lobes, kidneys, liver segments, etc.) and the corresponding mesh or vertex coordinates on the three-dimensional human body model. The lesion site mapping module searches for the corresponding three-dimensional model coordinates in the anatomical site database based on the lesion site name parsed by the NLP engine.

[0288] Lesion Visualization and Annotation: The lesion annotation module uses the material editing and rendering techniques of Three.js to highlight the area on the three-dimensional human body model corresponding to the lesion site coordinates. For example, for a "nodule in the right upper lobe of the lung", the color of the right upper lobe area of the three-dimensional model is set to red and a flashing effect is added to highlight the lesion site. For solid lesions such as tumors and stones, a three-dimensional sphere model representing the lesion can be superimposed on the surface of the human body model and given a highlighter material.

[0289] 5. System Screening Module.

[0290] The system screening module creates eight button-style human system options below the three-dimensional human body model display area, marked as "Nervous System", "Respiratory System", "Circulatory System", "Digestive System", "Urinary System", "Reproductive System", "Endocrine System", and "Musculoskeletal System". The system screening module internally maintains a human system - anatomical site association database, which records the system classification to which each human anatomical site belongs. For example, the "lung" belongs to the "Respiratory System", the "kidney" belongs to the "Urinary System", and the "brain" belongs to the "Nervous System". When the user clicks on a system option, the system screening module filters out all the lesion sites belonging to that system according to the human system - anatomical site association database. Then, using the model display / hide control function of Three.js, only the highlighted marks of the lesion sites related to the selected system are shown, while the lesion marks of other systems are hidden. For example, after clicking on the "Respiratory System" option, only the lesion annotations related to the respiratory system such as the lungs and trachea are shown on the three-dimensional model, while the lesion annotations of other systems are temporarily hidden.

[0291] 6. Hover Information Display Module.

[0292] The hover information display module uses the event listening mechanism of Three.js to listen for the hover event of the mouse on the 3D human body model. When the mouse pointer hovers over a highlighted lesion site, the hover event is triggered. When the hover event is triggered, the hover information display module retrieves the examination results and abnormal index data related to this site from the electronic medical record database according to the lesion site where the mouse hovers. For example, retrieve the imaging examination report, laboratory test results, pathological report, etc. of this site. The hover information display module uses the tooltip component of HTML to dynamically generate an information pop-up window next to the mouse pointer. The key examination results and abnormal indexes related to this lesion site are displayed in a concise and clear manner in the pop-up window. For example, for "nodular shadow in the upper lobe of the right lung", the pop-up window can display "CT examination: nodule in the upper lobe of the right lung, about 2 cm in diameter, with blurred edges, further examination is recommended".

[0293] 7. Detailed information loading module.

[0294] The detailed information loading module uses the event listening mechanism of Three.js to listen for the click event of the mouse on the 3D human body model. When the mouse clicks on a highlighted lesion site, the click event is triggered. When the click event is triggered, the detailed information loading module retrieves the detailed examination data, pathological results and treatment plan information related to this site from the electronic medical record database according to the clicked lesion site. These information may include complete imaging examination reports, detailed laboratory test results, complete pathological reports, previous treatment records, current treatment plans, etc. The detailed information loading module triggers the system to jump to a new page, that is, the system sub-page (the system sub-page constructed in the above-mentioned embodiment of the present invention), and this sub-page is specifically used to display the detailed medical record information related to this lesion site.

[0295] 8. Real-time vital sign display module.

[0296] The real-time vital sign display module establishes a data interface with the hospital's physiological monitoring system to obtain the vital sign data of the patient such as body temperature, respiratory rate, pulse, blood pressure, etc. in real time. The real-time vital sign display module creates four text labels below the central 3D human body model display area, which are marked as "Body temperature T:", "Respiration R:", "Pulse P:", "Blood pressure BP:" respectively. The real-time vital sign display module dynamically updates the real-time obtained vital sign data behind the corresponding text labels to achieve real-time display of the data. For example, it is displayed as "Body temperature T: 37.5°C", "Respiration R: 18 times / minute", "Pulse P: 72 times / minute", "Blood pressure BP: 120 / 80 mmHg".

[0297] 9. Diagnosis information display module.

[0298] The examination information display module creates three window areas within the right examination display bar area and organizes them in the form of tab pages. The tab page titles are "Details of Supplementary Examinations", "Images of Supplementary Examinations", and "Admission Diagnosis" respectively.

[0299] "Details of Supplementary Examinations" window: This window displays the list of supplementary examination items and the summary of key results for the patient. For example, it lists items such as blood tests, urine tests, biochemical tests, electrocardiograms, and ultrasound examinations recently conducted on the patient, and shows the key indicators and abnormal results of each item. Clicking on a certain examination item can expand to view a more detailed examination report (for example, jump to the system secondary page).

[0300] "Images of Supplementary Examinations" window: This window displays thumbnails of image materials related to supplementary examinations. For example, if the patient has undergone a chest CT examination, this window can display thumbnails of the CT images. Clicking on the thumbnail can enlarge to view the complete image (for example, open the image window on the system secondary page).

[0301] "Admission Diagnosis" window: This window displays information such as the preliminary diagnosis, main diagnosis, and discharge diagnosis when the patient was admitted this time or in the past. These diagnosis information are presented in structured text form. For example, admission diagnosis: "Pneumonia", discharge diagnosis: "Community-acquired pneumonia".

[0302] Through the collaborative work of the above-mentioned various modules, this embodiment can construct the main page of a visual electronic medical record system, realizing the intuitive, visual, and interactive display of medical record information, and providing doctors with an efficient and convenient overview of the condition and information entry.

[0303] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A visualization method for an electronic medical record system, characterized in that, Including the following steps: S1. Construct the system main page, which includes: A navigation bar area, serving as an entrance to access patient medical record information; A 3D human body model display area, used to present an interactive 3D human body model to visualize the anatomical structure information of the patient; A diagnosis and examination display bar area, used to present supplementary information related to the patient's diagnosis and treatment; S2. In the navigation bar area, provide at least three entrance options, corresponding to the patient's basic information, chief complaint information, and current medical history information respectively. In response to the user's click operation on any entrance option, dynamically load and display the corresponding patient medical record information content in the navigation bar area; S3. In the 3D human body model display area, load and display the standard 3D human body model, and allow the user to adjust the viewing angle and zoom ratio of the 3D human body model through interactive operations; S4. In response to the parsing of the patient's electronic medical record information, automatically identify and extract the lesion site information described in the medical record information, and map the lesion site information to the corresponding anatomical position on the 3D human body model; S5. On the 3D human body model, visually annotate the mapped lesion sites to intuitively present the patient's lesion locations; S6. In the 3D human body model display area, set up human body system options, which include at least eight major system classifications. In response to the user's selection operation on any human body system option, only display the lesion site annotations belonging to the human body system classification on the 3D human body model; S7. In response to the user's operation of hovering the mouse over the lesion site annotation on the 3D human body model, dynamically display the examination results and abnormal index information related to the lesion site; S8. In response to the user's click operation on the lesion site annotation on the 3D human body model, jump or load and display the detailed examination data, pathological results, and treatment plan information related to the lesion site.

2. The visualization method of the electronic medical record system according to claim 1, wherein It also includes the following steps: S9. In the 3D human body model display area, real-time display the physiological sign data of the patient's body temperature, respiratory rate, pulse, and blood pressure.

3. The visualization method of the electronic medical record system according to claim 1, wherein It also includes the following steps: S10. In the diagnosis and examination display bar area, classify and display the auxiliary examination details window, the imaging window of the auxiliary examination site, and the relevant diagnosis information window at the time of admission to supplement and display the patient's diagnosis and treatment information.

4. The visualization method of the electronic medical record system according to claim 1, characterized in that It also includes the following steps: Extract the patient's diagnosis and treatment event data from the electronic medical record system, including event type, event occurrence time, event description, and relevant examination results and treatment plan information, and sort the diagnosis and treatment events by time; Based on the extracted diagnosis and treatment event data, construct a timeline data structure, where the data structure includes diagnosis and treatment event nodes arranged in chronological order, and each node contains the event type, timestamp, event description, and associated data of the event; Generate an interactive timeline in the system main page, where the timeline includes multiple diagnosis and treatment event nodes arranged in chronological order, each node is marked with an icon or mark related to the event type, and different color coding is used for visual distinction according to the event type; In response to the user clicking on any diagnosis and treatment event node on the timeline, the system automatically locates and highlights the corresponding part or area on the 3D human body model related to the event, so that the doctor can quickly view the patient's body part involved in the event and display the detailed diagnosis and treatment data of the part; In response to the user clicking on an event node on the timeline, the system dynamically displays detailed information of the event on the interface, including but not limited to the diagnosis description of the event, relevant examination results, treatment plan and other related data.

5. The visualization method of the electronic medical record system according to claim 1, wherein The following steps are also included: Build system subpage; In response to the user clicking on the lesion mark on the three-dimensional human body model on the main page of the system, the system jumps to the sub-page of the system; When the system sub-page is initialized, according to the information of the clicked lesion part, the diagnosis information data related to the lesion part and the human body system to which it belongs is retrieved and obtained from the electronic medical record database; Constructing a diagnosis information window on the system sub-page for structured display of the physical examination data, specialist condition data and abnormal index data, and presenting the changing trend of numerical index data in a data visualization manner; Build a detailed image window on the system sub-page to load and display auxiliary examination image data related to the lesion site, and provide image operation functions to support users in observing image data; Next to the detailed image window, image description information related to the auxiliary examination image data is displayed to help users understand the image results; A simulated display area of ​​the lesion site is constructed on the system sub-page. Based on the extracted medical record data related to the lesion site, a simulated image of the lesion site is generated and displayed to visualize the pathological characteristics of the lesion site.

6. The visualization method of the electronic medical record system according to claim 5, wherein After the steps of constructing the detailed image window on the system sub-page, the following steps are also included: Create an image overlay window in the system sub-page; In response to the user's dragging operation on the image data in the detailed image window of the system sub-page, the selected image data is loaded into the image overlay window; Through image processing technology, the loaded image data is superimposed and displayed, so that different image data can be observed simultaneously in the same window, and the transparency and display order of each image data layer can be adjusted; Provide interactive operation functions, allowing users to zoom in, zoom out, rotate and move the superimposed image data to view the image content in more detail; In the image overlay window, different overlay modes are used to support users to display image data in transparency, color or difference overlay modes, so as to facilitate doctors to analyze the comparison and correlation between images.

7. The visualization method of the electronic medical record system according to claim 5, characterized in that After the steps of constructing the detailed image window on the system sub-page, the following steps are also included: Extracting inpatient diagnosis and treatment data related to the human body system targeted by the current system sub-page from the electronic medical record system, the inpatient diagnosis and treatment data including hospitalization records and a sequence of diagnosis and treatment events during hospitalization, the sequence of diagnosis and treatment events being arranged in chronological order and including event type, event occurrence time, and event description information; In the system sub-page, an independent hospitalization event timeline is constructed for each hospitalization record. The hospitalization event timeline uses time as the horizontal axis and displays the time scale according to the length of hospitalization; Mark the recording points of medical treatment events on the hospitalization event timeline, use different visual marks according to the types of medical treatment events, and divide the hospitalization event timeline into different medical treatment stage areas, and display the event recording points of the corresponding stages within different stage areas; In response to the operation of the user's mouse hovering over the event recording point on the hospitalization event timeline, the system pops up an information prompt box to display the brief description information of the corresponding medical treatment event; In response to the operation of the user's mouse clicking on the event recording point on the hospitalization event timeline, the system expands the floating page and loads and displays the detailed medical record associated with the event recording point; Monitor the treatment progress data of the patient, and dynamically update the medical treatment events, event description information, and medical treatment stage division displayed on the hospitalization event timeline according to the changes in the treatment progress data.

8. The visualization method of the electronic medical record system according to claim 1, characterized in that It also includes the following steps: When the system main page is loaded, automatically identify and scan the patient's electronic medical record data, extract all important medical treatment history events, genetic disease events, and drug allergy events, and classify and prioritize the events using a knowledge base and a priority rule engine; According to the priority of the events, automatically push important medical treatment information to the system user interface. The pushed information includes but is not limited to the patient's major medical treatment history events, genetic disease events, and drug allergy information, and is displayed in a prominent manner to ensure the timely presentation of key information; The display forms of the pushed information include but are not limited to pop-up prompts, message center notifications, and display bars at the top of the page, and are classified and visually distinguished according to the event types, and color coding, icon prompts, and animation effects are used to enhance the prominence and recognizability of the information; When the pushed information is related to the patient's body part, the pushed information is linked to the 3D human body model, and an associated mark or highlighting is automatically displayed on the corresponding body part; According to the user's interaction operation, support clicking on the pushed information to view more detailed historical medical treatment data, inspection reports, genetic history, or drug allergy records, etc., and all detailed data are linked to the relevant detailed records in the electronic medical record system.

9. The visualization method of the electronic medical record system according to claim 1, characterized in that It also includes the following steps: Build a data extraction module for extracting information on changes in the patient's physical condition. The data extraction module automatically retrieves and parses data sources from surgical records, pathology reports, structured data fields, and imaging reports in the electronic medical record system to identify information related to changes in the patient's body structure, including but not limited to amputations, organ resections, and tissue resections; Based on the extracted information on changes in the patient's physical condition, build a 3D human body model dynamic adjustment and rendering module, and respond to the extracted information to modify the 3D human body model in real time, including deleting or hiding the mesh of the amputated part, removing the mesh of the organ resection area, or adjusting the local mesh of the tissue resection area according to the specific situation to ensure that the 3D human body model presents the changes in the patient's body structure; After completing the adjustment of the 3D human body model, a module for superimposing annotations and prompt information is constructed. Based on the information on changes in the patient's physical condition, annotations are added to the corresponding positions on the 3D human body model. The annotations include text information on the change type and the changed part, and the annotations can respond to the user's interaction operations, such as mouse hovering, to pop up more detailed background information and explanations. The data extraction module, the 3D human body model dynamic adjustment and rendering module, and the annotation and prompt information superimposing module are integrated into the electronic medical record system, and a dynamic update mechanism is established. When the patient's medical record information is updated, the system is automatically triggered to update, and the 3D human body model is adjusted in real time and the annotation information is updated to ensure that doctors can obtain the latest patient physical condition information.

10. A visualized medical record system, characterized in that, Including: The main page construction module is configured to construct the main page of the system. The main page of the system includes a navigation bar area, a three-dimensional human body model display area, and a diagnosis and examination display bar area. The navigation bar area provides an entrance to access the patient's medical record information. The three-dimensional human body model display area presents an interactive three-dimensional human body model to visualize the patient's anatomical structure information. The diagnosis and examination display bar area presents supplementary information related to the patient's diagnosis and treatment. The navigation information display module is communicatively connected to the main page construction module and is configured to provide at least three entrance options in the navigation bar area. The entrance options respectively correspond to the patient's basic information, chief complaint information, and current medical history information, and in response to the user's click operation on any of the entrance options, the corresponding patient medical record information content is dynamically loaded and displayed in the navigation bar area. The model loading and interaction module is communicatively connected to the main page construction module and is configured to load and display a standard three-dimensional human body model in the three-dimensional human body model display area and allow the user to adjust the viewing angle and zoom ratio of the three-dimensional human body model through interactive operations. The lesion site mapping module is configured to, in response to the parsing of the patient's electronic medical record information, automatically identify and extract the lesion site information described in the medical record information and map the lesion site information to the corresponding anatomical position on the three-dimensional human body model. The lesion annotation module is communicatively connected to the lesion site mapping module and the model loading and interaction module and is configured to visually annotate the mapped lesion sites on the three-dimensional human body model to intuitively present the patient's lesion positions. The system screening module is communicatively connected to the lesion annotation module and the model loading and interaction module and is configured to provide human system options in the three-dimensional human body model display area. The human system options include at least eight major system classifications, and in response to the user's selection operation on any of the human system options, control only the lesion site annotations belonging to the selected human system classification to be displayed on the three-dimensional human body model. The hover information display module is communicatively connected to the lesion annotation module and the model loading and interaction module and is configured to, in response to the user's operation of hovering the mouse over the lesion site annotation on the three-dimensional human body model, dynamically display the examination results and abnormal index information related to the lesion site. A detailed information loading module, communicatively connected to the lesion annotation module and the model loading and interaction module, configured to respond to an operation of a user clicking on a lesion site annotation on the three-dimensional human body model, and jump to or load and display detailed examination data, pathological results, and treatment plan information related to the lesion site; A real-time physical sign display module, communicatively connected to the main page construction module, configured to display physiological sign data of a patient's body temperature, respiratory rate, pulse, and blood pressure in real time in the middle three-dimensional human body model display area; An examination information display module, communicatively connected to the main page construction module, configured to classify and display an auxiliary examination details window, an imaging window of an auxiliary examination site, and a relevant diagnosis information window at the time of admission in the examination display column area to supplement and display the patient's diagnosis and treatment information; Among them, the navigation information display module, the model loading and interaction module, the lesion site mapping module, the lesion annotation module, the system screening module, the hover information display module, the detailed information loading module, the real-time physical sign display module, and the examination information display module all work in coordination with the main page construction module.

Images