Medical image display method, device, equipment and storage medium
By dividing the dual-area display into a hierarchical image directory and a target image frame in the medical image display area, it supports static and dynamic display modes, solving the problem of cumbersome and inefficient auditing process in the prior art, and achieving fast and accurate images Review.
Patent Information
- Application Number
- CN202410011655.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-04
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-01-04
AI Technical Summary
The existing medical image review process is cumbersome and inefficient. It is impossible to modify information in a directional manner, and it is impossible to select image objects in a directional manner, which increases the workload and operation steps of medical staff.
Provides a medical image display method, by dividing it into two sub-regions in the image display area, one for displaying a hierarchical image directory and the other for displaying target image frames, supporting static and dynamic display modes, allowing users to quickly pass operation instructions Directed selection and audit image objects to reduce the manual review process one by one.
It improves the efficiency and streamlines the operation steps of medical image review, reduces the workload, and realizes audits without manual operation through quick browsing of dynamic content, ensuring the accuracy and comprehensiveness of audits.
Smart Images

Figure CN117558417B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of information technology management, and in particular to a medical image display method, device, equipment and storage medium. Background Art
[0002] For the needs of clinical diagnosis, when patients undergo medical imaging examinations, they often collect and examine images of tissues and organs in the same body part using multiple medical imaging devices (such as CT, MRI, ultrasound, etc.), and collect and examine images of different modes using the same medical imaging device (such as ultrasound angiography, tissue diagrams, and cross-sectional images from different angles). During the export process, medical images of each device and each mode need to be manually reviewed first to ensure that the exported content is the image required by medical staff for further diagnosis.
[0003] However, the existing image review is generally performed by medical staff to check the information of each examination, sequence and image frame one by one, sequence by sequence and frame by frame to determine whether the current information is incorrect. Under this clinical demand and operation mode, medical staff are required to check one by one, select pictures one by sequence and frame by frame, and confirm them one by one in the pop-up window. The operation is cumbersome and greatly increases the review time. Moreover, when some information is incorrect, it often cannot be modified immediately. It is necessary to return to the image device to modify it and then re-import the data, which also increases the operation steps.
[0004] In addition, when the acquired images are imported into auxiliary equipment, such as ultrasonic fusion equipment, due to the particularity of the fusion equipment, its fusion data does not require all image data acquired in a certain device or mode. It often only requires data of specified parameters and specified sections for reconstruction and matching fusion. Too many data sources will increase the burden of review and calculation and reduce reconstruction efficiency. Summary of the invention
[0005] Based on this, it is necessary to provide a medical image display method, device, equipment and storage medium to address the technical problems in the prior art such as cumbersome image review operations, low efficiency, inability to modify information in a targeted manner, and inability to select image objects in a targeted manner.
[0006] The first aspect of the present application provides a medical image display method, comprising: in response to an image import instruction, importing at least one image source data, the image source data including image directory data and at least one image data; displaying a hierarchical image directory corresponding to the image directory data in a first sub-area of a preset image display area; in response to a first operation instruction, determining a target object from candidate objects in the hierarchical image directory; in a second sub-area of the image display area, displaying a target image frame corresponding to the image data associated with the target object according to a preset display mode, the preset display mode including a static display mode and a dynamic display mode, the dynamic display mode being a continuous playback of the target image frame.
[0007] In one embodiment, the second sub-area includes a first partition and a second partition. When the preset display mode is a static display mode, the target image frame corresponding to the image data associated with the target object is displayed in the second sub-area of the image display area according to the preset display mode, including: displaying the data information associated with the target object in the first partition of the second sub-area; and displaying the target image frame in the second partition of the second sub-area.
[0008] In one embodiment, when the number of the target image frames is multiple frames, the display of the target image frames in the second partition of the second sub-area includes: continuously playing the multiple frames of the target image frames in the second partition; or, displaying a single frame image frame with a first preset serial number among the multiple frames of the target image frames in the second partition.
[0009] In one embodiment, when the preset display mode is a dynamic display mode, the target image frame corresponding to the image data associated with the target object is displayed in the second sub-area of the image display area according to the preset display mode, and then further includes: in response to a second operation instruction, pausing the continuous playback of the target image frame, wherein the second operation instruction is triggered by a second preset operation, and the second preset operation includes a click operation and a page turning operation; in response to a third operation instruction, continuously playing the target image frame starting from a single frame image frame with a second preset serial number, wherein the third operation instruction is triggered by a third preset operation, and the third preset operation includes a tap operation and a slide operation.
[0010] In one embodiment, the medical image display method further includes: in response to a fourth operation instruction, switching the preset display mode from the static display mode to the dynamic display mode; or, in response to a fourth operation instruction, switching the preset display mode from the dynamic display mode to the static display mode.
[0011] In one embodiment, the step of determining the target object from the candidate objects in the hierarchical image directory in response to the first operation instruction also includes: determining at least one default object in the hierarchical image directory and checking the at least one default object; and displaying the target image frame associated with the at least one default object in the second sub-area according to a preset display mode.
[0012] In one embodiment, the first operation instruction is a check instruction, and determining the target object from the candidate objects in the hierarchical image directory in response to the first operation instruction includes: determining at least one target object in the hierarchical image directory in response to the check instruction; and checking the at least one target object; or, the first operation instruction is a first single-select instruction, and determining the target object from the candidate objects in the hierarchical image directory in response to the first operation instruction includes: determining a target object in the hierarchical image directory in response to the first single-select instruction; and checking the one target object.
[0013] In one embodiment, the first operation instruction is a second single-select instruction, and determining the target object from the candidate objects in the hierarchical image directory in response to the first operation instruction includes: determining the target object from the candidate objects in the hierarchical image directory in response to the second single-select instruction when the hierarchical image directory is in a first state, the first state being used to characterize that at least one default object in the hierarchical image directory is not in a check mark state; determining the object type of the target object; and checking the target object when the object type of the target object is characterized as a default object.
[0014] In one embodiment, the hierarchical image directory includes a parent node and a child node, and the medical image display method further includes: when the child node is checked, determining the parent node of the level where the child node is located as the target parent node; determining that the number of sibling nodes of the target parent node is greater than or equal to a preset value, and checking the target parent node.
[0015] In one embodiment, the step of determining the target object from the candidate objects in the hierarchical image catalog in response to the first operation instruction further includes: configuring the additional attribute information of the target object to be modifiable in response to the fifth operation instruction.
[0016] According to a second aspect of the present application, there is provided an image display device, comprising: an image import module, which imports at least one image source data in response to an image import instruction, wherein the image source data comprises image directory data and at least one image data; a directory display module, which is used to display a hierarchical image directory corresponding to the image directory data in a first sub-area of a preset image display area; an operation instruction response module, which is used to determine a target object from candidate objects in the hierarchical image directory in response to a first operation instruction; and a target image frame display module, which is used to display a target image frame corresponding to the image data associated with the target object in a second sub-area of the image display area according to a preset display mode, wherein the preset display mode comprises a static display mode and a dynamic display mode, wherein the dynamic display mode is to continuously play the target image frame.
[0017] A third aspect of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the medical image display method in the first aspect is implemented.
[0018] A fourth aspect of the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the medical image display method in the first aspect.
[0019] The above-mentioned medical image display method, device, equipment and storage medium import and parse the image source data for visual display, display the hierarchical image directory in the first sub-area, and dynamically and statically display the relevant content of the target confirmed in the hierarchical image directory in the second sub-area, that is, through dual-area display and dynamic and static information display, the review object is selected in the first sub-area, and the dynamic content and static content are quickly reviewed in the second sub-area. The review object is selected according to specific needs, and there is no need for manual review of each image and frame, which reduces the workload caused by a large number of review objects. Dynamic content can be used for rapid review without manual operation, thereby improving review efficiency and streamlining operation steps. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Figure 1 is a schematic flow chart of a medical image display method in one embodiment;
[0021] Figure 2 A schematic diagram of data and display correspondence and mapping in one embodiment;
[0022] Figure 3a-3c A schematic diagram of presenting information of different target objects in one embodiment;
[0023] Figure 4 This is a schematic diagram of the interface layout in an embodiment;
[0024] Figure 5 is a schematic diagram of an interface in a single static display mode in another embodiment;
[0025] Figure 6 It is a schematic diagram of an interface of a dynamic and static combined display mode in another embodiment;
[0026] Figure 7a is a schematic diagram of a page turning operation in one embodiment;
[0027] Figure 7b-7c is a schematic diagram of a page turning operation in another embodiment;
[0028] Figure 7d is a schematic diagram of a click operation in another embodiment;
[0029] Figure 7e is a schematic diagram of drag and click operation in another embodiment;
[0030] Figure 8 A schematic diagram of a preset display mode switching operation in one embodiment;
[0031] Fig. 9 This is a schematic diagram of an interface of a default target object in an embodiment;
[0032] Fig.10a A schematic diagram of a directory item in a single-select mark state in one embodiment;
[0033] Fig.10b A schematic diagram of a directory item in a checked state in one embodiment;
[0034] Fig.11 A schematic diagram of a check mark for a single selection in an embodiment;
[0035] Figure 12a-12b A schematic diagram of check marks on nodes corresponding to different preset values in an embodiment;
[0036] Fig.13 A schematic diagram of a node check mark in another embodiment;
[0037] Fig.14a A schematic diagram of additional attribute information of a target object in one embodiment;
[0038] Fig.14b A schematic diagram of modifying and configuring additional attribute information of a target object in one embodiment;
[0039] Fig.15 is a structural block diagram of an image display device in one embodiment;
[0040] Fig.16 FIG. 4 is a structural block diagram of a computer device in one embodiment. DETAILED DESCRIPTION
[0041] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0042] The terms "comprises," "including," "having," and any variations thereof as used in this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to the steps or units explicitly listed, but may also include other steps or units that are not explicitly listed or inherent to these processes, methods, products, or apparatuses.
[0043] The term "plurality" used in this application means two or more (including two), unless otherwise clearly and specifically defined.
[0044] The terms "first", "second", etc. used in this application are used to distinguish similar objects in terms of naming, but these objects themselves are not limited by these terms and cannot be understood as indicating or implying relative importance or implicitly indicating the number, specific order, or primary and secondary relationship of the indicated technical features. It should be understood that these terms can be interchangeable under appropriate circumstances without departing from the scope of this application. For example, a "first sub-region" can be described as a "second sub-region", and similarly, a "second sub-region" can be described as a "first sub-region".
[0045] The term "and / or" used in this application is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone.
[0046] It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.
[0047] The following terms are used in this article.
[0048] Multi-mode fusion / ultrasound fusion: refers to a technology that combines US and CT / MRI / PET tomographic images and displays them synchronously in real time on the same screen. This technology imports CT / MRI / PET images into the ultrasound system, matches ultrasound and CT / MRI tomographic images through a variety of positioning methods, and uses magnetic field positioning to achieve real-time ultrasound and CT / MRI volumetric image linkage. It can simultaneously have the high resolution of CT / MRI and other imaging with the real-time, easy operation and arbitrary cross-section display characteristics of US, complement various imaging information, and accurately locate lesions.
[0049] US: Ultrasound, referred to as US, is an ultrasound technology. The ultrasound imaging technology is to scan the human body to obtain imaging information. Ultrasound imaging uses ultrasound beams to scan the human body and obtain images of internal organs by receiving and processing reflected signals.
[0050] CT / MRI / PET: CT (computed tomography), MRI (magnetic resonance imaging), and PET (positron emission tomography);
[0051] CT scan is a cross-sectional scan of the body. It is a fully functional disease detection instrument. It is the abbreviation of computed tomography.
[0052] CT mainly uses highly sensitive instruments to measure the human body based on the different absorption and transmittance of X-rays by different tissues of the human body. The data obtained from the measurements are then input into an electronic computer. After the electronic computer processes the data, a cross-sectional or three-dimensional image of the examined part of the human body can be obtained, and small lesions in any part of the body can be found.
[0053] CT is often used to examine the chest and abdomen of cancer patients. Chest CT examination shows clearer structures, and its sensitivity in detecting chest lesions and accuracy in showing lesions are better than conventional chest X-rays. Especially for the diagnosis of early lung cancer, chest CT is of decisive significance. However, CT examination uses X-ray films, so there is a certain amount of radiation to the human body, and the clarity of CT imaging of soft tissues is insufficient;
[0054] MRI is nuclear magnetic resonance imaging. MRI examination mainly distinguishes the corresponding image features by the amount of hydrogen in the human body, and then judges the corresponding organ function and the nature of the lesion through different image features.
[0055] MRI examination is mainly used to diagnose diseases of the brain and nervous system, as well as to determine the corresponding diseases and injuries of soft tissues and ligaments. For example, it can confirm common diseases such as meningioma, glioma, astrocytoma, and cartilage ligament strain.
[0056] PET-CT is a multimodal imaging system that combines positron emission tomography (PET) and computer tomography (CT). It is currently the world's most advanced medical imaging equipment and is also an imaging technology that can perform imaging at the molecular level.
[0057] Fault / section / cut: CT / MRI / PET collects tomographic images of the human body at a fixed angle, using the human body as a reference. The faults are divided into sagittal plane (sag), coronal plane (cor) and transverse plane (tra):
[0058] The sagittal plane divides the human body into left and right parts. The left and right sections are the sagittal planes, and the equal sections on the left and right are called the midsagittal planes. The coronal plane is a section that cuts the human body longitudinally into front and back parts along the left and right directions. The transverse plane refers to the section when the human body is upright, parallel to the horizontal plane and perpendicular to the vertical axis. It is a section that cuts the human body transversely into the front and back parts along the up and down direction.
[0059] T1 / T2 / DWI: Different parameter settings under multiple imaging conditions. Usually, they are adjusted to appropriate parameters according to clinical needs to facilitate doctors to judge relevant lesions or abnormal points. After the imaging output, different parameters will generate different image sequences;
[0060] T1, T2, etc. indicate the MRI sequence type;
[0061] T1-weighted imaging (T1WI), highlighting tissue T1 relaxation (longitudinal relaxation);
[0062] T2-weighted imaging (T2WI), highlighting tissue T2 relaxation (transverse relaxation);
[0063] DWI: Diffusion Weighted Imaging;
[0064] ADC: diffusion coefficient.
[0065] Image source / examination / sequence / single-frame image: Image source is usually constructed based on patients as units. One patient corresponds to one image source. The same patient may undergo multiple examinations. Each examination may have different time periods, whether to add contrast agents and other influencing factors, so they are distinguished by dividing them into different examinations. One examination may have multiple different imaging parameters, different sections, etc. The differences in the above parameters and sections constitute different sequences corresponding to each other. A single sequence is composed of multiple frame images, and their order and number are determined by the time and distance the scanning instrument scans the human body. The frame images in a single sequence generally include image size information and slice thickness. The slice thickness is the interval distance when the machine scans the human body.
[0066] DICOM (Digital Imaging and Communications in Medicine) is a standard for digital medical image transmission, display and storage established by ACR (American College of Radiology) and NEMA (National Electrical Manufacturers Association) in 1985. In simple terms, DICOM is a standard tool used by medical institutions at home and abroad to manage, store and transmit medical imaging data. Examinations such as X-ray, DR, CT, MRI, PET-CT, and coronary angiography can be saved, transmitted, consulted and studied in DICOM format.
[0067] Figure 1 A flow chart of a medical image display method provided in an embodiment of the present disclosure, the method can be executed by an image display device, wherein the device can be implemented by software and / or hardware, and can generally be integrated in an electronic device. The integration method can be that a client is installed in a corresponding electronic device, the client can be an application for reviewing images, or a web client, or a sub-application running in the operating environment of a parent application, the electronic device can be a mobile device such as a mobile phone, a smart watch, a tablet computer, and a personal digital assistant; it can also be other devices such as a desktop computer; further, it can also be various medical devices, such as an ultrasonic fusion device.
[0068] In the following embodiments, each embodiment provides both optional features and examples. The various features recorded in the embodiments can be combined to form multiple optional solutions. Each numbered embodiment should not be regarded as only one technical solution.
[0069] In one embodiment, Figure 1 As shown, a medical image display method is provided, the method comprising the following steps:
[0070] Step S101: In response to an image import instruction, import at least one image source data, wherein the image source data includes image directory data and at least one image data.
[0071] Image source data refers to image directory data represented by an image frame consisting of at least one image data and additional label information of the image frame, wherein a single image data is a collection of multiple pixels, a single image data corresponds to a single image frame, and part or all of the label information in each image data is added to group the image directory, and the part or all of the label information is the image directory data.
[0072] In the disclosed embodiment, the image import instruction may be generated by the user selecting and confirming the image source data on the device side, and then clicking or touching a similar button or action such as import, confirm next step, etc. on the device side, and is not limited here.
[0073] In the disclosed embodiments, the image source data may be data collected on a patient basis and containing images and other information. The images may be CT images or MRI images, which are not limited herein. Specifically, such medical images may be obtained by scanning the abdomen, chest and other areas. For example, when it is necessary to obtain a medical image of the kidneys, the abdominal area may be scanned. The specific settings may be based on actual application conditions and are not limited herein.
[0074] Take the image source data generated by the Dicom protocol as an example. In this protocol, the image source data is composed of frames of images. Each image frame is an image data, which is composed of various pixels. Each image frame carries its own detail label information. The detail label information includes patient name, gender, age, examination items and sequences, section angles, image enhancement parameters and other information. According to specific needs, the system uses the above-mentioned multiple detail label information as grouping units for directory grouping, that is, the detail label information participating in the directory grouping is the image directory data.
[0075] In one implementation scenario, it is possible to communicate with an instrument used to perform medical scanning or with an internal server of a hospital, so as to obtain medical images scanned by the instrument; in another implementation scenario, medical images can also be obtained through flash memory media, email, etc., which is not limited here.
[0076] Step 102: Display a hierarchical image directory corresponding to the image directory data in a first sub-area of a preset image display area.
[0077] Display the hierarchical image directory corresponding to the image directory data, and display the image directory data and image data in the image source data in a partitioned manner, referring to Figure 2 As shown, the image directory data is displayed in the first sub-area in the form of a hierarchical image directory, and the image data is displayed in the second sub-area in the form of an image frame.
[0078] In the embodiment of the present disclosure, after the image source data imported in the previous step is parsed, it is visually displayed on the device display terminal or other interface. In order to provide the user with information on the image source data, the information can be displayed in the form of a management interface, and the first sub-area of the management interface can be set to display the hierarchical image directory after parsing. The hierarchical image directory is composed of various directory items, and can specifically include at least one of the following: a primary directory item for representing a patient (e.g., "patient 1", "patient 2", etc.), a secondary directory item for representing an examination performed on each patient (e.g., "prostate examination", "kidney examination", "kidney examination in time period A", "kidney examination in time period B", "examination after adding contrast agent", etc.), a tertiary directory item for representing a sequence included in the examination (e.g., "cross-sectional examination"). The image frames are displayed in the second sub-area of the management interface, such as "surface sequence", "sagittal sequence", "enhanced sequence", "plain scan sequence", etc.) and four-level directory items (such as "image frame 1", "image frame 2", etc.) for representing each frame of the image included in the sequence. The specific settings can be based on actual application needs and are not limited here. At the same time, in the second sub-area of the management interface, an image frame associated with a default directory item is selected for display. The directory item selected by default can be the directory item that is ranked first, last, middle, or in other order in the hierarchical image directory after parsing. The directory item selected by default can be set by the user according to the user's habits. The image frame is displayed in a static display mode by default. The user can also modify the default display mode according to the operating habits and application requirements, and display the image frame associated with the directory item of the default case in a dynamic display mode. By displaying the tree structure information of the image source data in the first sub-area, the hierarchical image source data can be displayed to the user, so that the user can intuitively and efficiently obtain the overview information of the image source, and when the user selects a certain hierarchical directory, the selected hierarchical directory is used as the target hierarchical directory.
[0079] Step 103: In response to the first operation instruction, determine the target object from the candidate objects in the hierarchical image catalog.
[0080] In the disclosed embodiments, in response to a user's target object selection instruction, a directory item in a hierarchical image directory selected by the user, i.e., a candidate object, may be determined as a target object, thereby determining an associated image frame in response to the user's selection operation to meet the user's film reading needs.
[0081] In another specific implementation scenario, the medical image display method in the embodiment of the present disclosure may be executed by an electronic device, and the electronic device may run a medical image management program, and when the medical image management program is executed by a processor, the medical image display method in the embodiment of the present disclosure may be implemented. Specifically, in response to a user's target object selection instruction, a directory item in the hierarchical image directory selected by the user is determined as a target object.
[0082] Step S104, in the second sub-area of the image display area, display the target image frame corresponding to the image data associated with the target object according to a preset display mode, the preset display mode includes a static display mode and a dynamic display mode, and the dynamic display mode is to continuously play the target image frame.
[0083] In the disclosed embodiment, based on the target object determined in the aforementioned steps, the target image frame associated with the target object is further determined. Specifically, the hierarchical image directory is generated based on the analysis of the image directory data of the image source data, and has a corresponding relationship with the image directory data. Similarly, the image directory data in the image source data has an associated relationship with the image data, and the image data refers to multiple image frames at the data level, that is, the hierarchical image directory has an associated relationship with each image frame. By determining the target object in the hierarchical image directory, the image directory data in the image source data is further confirmed, and then the image data associated with the image directory data is further determined, and the image data is displayed in the second sub-area in the form of image frames. The displayed image frame is the target image frame.
[0084] In one implementation scenario, reference Figure 3a As shown, when the target object in the hierarchical image directory is a first-level directory item, namely, patient A, all target image frames under patient A are determined.
[0085] In another implementation scenario, refer to Figure 3b As shown, when the target object in the hierarchical image catalog is a secondary catalog item, namely, inspection 1, all target image frames under the inspection are determined.
[0086] In another implementation scenario, reference Figure 3c As shown, when the target object in the hierarchical image directory is a fourth-level directory item, namely, image frame 1, the single-frame target image frame corresponding to the image frame is determined.
[0087] In the embodiment of the present disclosure, according to the aforementioned determined image data, visual display is performed in the form of an image frame on the device display terminal or other interface. In order to provide the user with image information of the target image frame, the information can be displayed in the form of a management interface, and the second sub-area of the management interface can be set to display the image information of the target image frame.
[0088] Exemplarily, the dynamic display mode includes dynamically playing images, that is, continuously displaying at least two images with different image frame sequence numbers (when there are more than two image frames). For the target object, it can be understood as dynamically playing the image frames in the target image resource corresponding to the target object; the static display mode includes statically displaying images, that is, fixedly displaying an image with unchanged screen content. For the target image, it can be understood as statically displaying a certain image frame in the target image resource corresponding to the target image. There can be one or more dynamic display modes, and there can also be one or more static display modes.
[0089] Specifically, there are two display modes for displaying the image information of the target image frame, including a dynamic display mode and a static display mode. The dynamic display mode is to dynamically and continuously play back multiple target image frames in a loop or play them once at a certain playback speed. When the determined target image frame is a single-frame image frame, the display interface can be a single-frame freeze-frame display, that is, the target image frame is displayed in a static display mode, or it can be a single-frame continuous dynamic loop or single playback. The display effects presented to the user are basically the same. The static display mode can include a single static display mode and a dynamic and static combined display mode. Specifically, the single static display mode displays the detailed label information of the target object, such as the patient, examination time, examination number, examination category, number of image frames and other information, and selects a single target image frame (when there are multiple target image frames) to be fixed according to the default rules. The fixed static display is in the second sub-area; the dynamic and static combined display mode, that is, displaying the detailed label information of the target image frame, such as the patient, examination time, examination number, examination category, number of image frames and other information, and, according to the dynamic display mode, the determined multiple frames of target image frames are dynamically and continuously looped or played once at a certain playback speed. When the determined target image frame is a single-frame image frame, the display interface can be a single-frame frozen display, or a single-frame continuous dynamic loop or single playback. The display effects presented to the user in both modes are consistent. It can be seen that when the target image frame is determined to be a single-frame image frame, the display content presented to the user by the single static display mode and the dynamic and static combined display mode is basically the same. From the above description, it can be seen that the difference between the dynamic display mode and the static display mode is that their display focuses are respectively the detailed label information and the image frame information.
[0090] In an implementation scenario, taking kidney CT examination as an example, the user selects the kidney CT examination image source data in the operation interface and confirms the import for image review. At this time, the data of the kidney CT examination is parsed and visualized. Specifically, the operation interface is horizontally divided into a first sub-area and a second sub-area from left to right, and the parsed hierarchical image directory is displayed step by step in the first sub-area. The hierarchical image directory includes four levels of directory items, specifically the patient name of the examination, the examination name (kidney), the sequences included in the examination (cross-sectional sequence, sagittal sequence, enhanced sequence, plain scan sequence, etc.), and each single frame image frame included in the sequence (image 1, image 2, etc.). The user clicks on the hierarchical image directory that he wants to review to determine the associated image frames. For example, when the user clicks on the directory item named "patient name", it is determined that the associated image frames are all the image frames under the patient. At this time, the corresponding target image frames can be displayed in the second sub-area according to preset rules, such as the first examination under the patient's name (such as The image frames included in the first sequence under the patient's first examination (if there are multiple examinations) are taken as the target image frames to be displayed, and then all the image frames included in the sequence are played frame by frame continuously at a certain playback rate in a dynamic display manner. After playing a cycle, the playback can be paused on the first frame or the second frame, or all the image frames are played in a continuous loop; in a static display manner, the detailed label information included in the "patient name" hierarchical directory is displayed in the second sub-area, including patient ID, name, age, gender, date of birth, remarks and other information, and at the same time, the first image frame included in the first sequence under the patient's first examination (if there are multiple examinations) is statically displayed, or the image frames included in the first sequence under the patient's first examination (if there are multiple examinations) are played frame by frame continuously at a certain playback rate. After playing a cycle, the playback can be paused on the first frame or the second frame, or all the image frames are played in a continuous loop. Other situations can be deduced by analogy, and no examples are given here.
[0091] The above scheme imports and parses the image source data for visual display, displays a hierarchical image directory in the first sub-area, and dynamically and statically displays the relevant content of the target object confirmed in the hierarchical image directory in the second sub-area. That is, through the dual-area display and dynamic and static information display method, the review object is selected in the first sub-area, and the dynamic content and static content are quickly reviewed in the second sub-area. The review object is selected according to specific needs, and there is no need for manual review one by one, thereby reducing the workload caused by a large number of review objects. Dynamic content can be browsed quickly and without manual operation, thereby improving the review efficiency and streamlining the operation steps. At the same time, in the static display mode, the specific details label information of the review object can be displayed in detail, providing users with a more comprehensive and complete content display, and ensuring the accuracy and comprehensiveness of the review.
[0092] In one embodiment, Figure 4 As shown, the management interface is divided into a first sub-area and a second sub-area, which are arranged horizontally on the left and right sides of the interface respectively. The hierarchical image directory after the image source data is parsed is hierarchically displayed in the first sub-area in a step diagram display manner. Figure 4 It can be seen that there are four levels of directory items, namely, the first level directory item of the patient, the second level directory item for indicating the kidney examination of the patient, the third level directory item for indicating the sequence included in the kidney examination, and the fourth level directory item for indicating each frame image included in the currently selected sequence. Figure 4 It can be seen that at this time the user has selected sequence 201, and the right side of the corresponding interface, that is, the second sub-area adopts a dynamic display mode to display multiple image frames corresponding to the sequence, that is, the image frames included in the sequence are played continuously frame by frame. The playback mode can be dynamic and continuous loop playback or single playback at a certain playback speed, or dynamic and continuous loop playback or single playback at a variable speed. However, no matter which playback mode is used, the content played includes all the image frames contained in the sequence.
[0093] In another embodiment, when the second sub-area displays the image frame in a single static display mode in the static display mode, such as Figure 5 As shown, the second sub-area is vertically divided into a first partition and a second partition, and there is no dividing line between the two partitions. The first partition displays the detailed label information corresponding to the currently selected sequence. Figure 5 It can be seen that at this time, the user selects "Sequence 201", and the relevant information is the basic information of the associated patient, including patient name, ID, gender, age, scanning mode, scanning part, scanning equipment, slice thickness, number of image frames and pixel size; the second partition displays the image frames included in the currently selected sequence, which is composed of Figure 5 It can be further seen that the first image frame included in the sequence is displayed in the lower right corner of the interface. Correspondingly, the middle frame, the last frame or other image frames with sequence numbers of the sequence can also be set to be displayed in the window in combination with the specific inspection type or user habits, that is, the first preset sequence number can be the first frame, the middle frame, the last frame or other sequence numbers. Other situations can be deduced by analogy, and no examples are given here one by one.
[0094] In another embodiment, when the second sub-area displays the image frame in a static display mode combining dynamic and static display modes, such as Figure 6 As shown, the second sub-area is also divided vertically into a first partition and a second partition. The content displayed in the first partition is the detailed label information corresponding to the currently selected sequence. For specific information, please refer to Figure 6 As shown or refer to the relevant content in the aforementioned disclosed embodiment; the second partition displays the image frames included in the currently selected sequence, Figure 6 It can be further seen that at this time, the image frames included in the sequence are played continuously frame by frame in the lower right corner of the interface. The playback mode can be dynamic and continuous loop playback or single playback at a certain playback speed, or dynamic and continuous loop playback or single playback at a variable speed. However, no matter which playback mode is used, the content played includes all the image frames contained in the sequence. Other situations can be deduced by analogy and will not be given examples one by one here.
[0095] In one embodiment, the medical image display method further includes:
[0096] When the preset display mode is a dynamic display mode, in the second sub-area of the image display area, according to the preset display mode, a target image frame corresponding to the image data associated with the target object is displayed, further comprising:
[0097] In response to a second operation instruction, pausing the continuous playback of the target image frame, wherein the second operation instruction is triggered by a second preset operation, and the second preset operation includes a click operation and a page turning operation;
[0098] In response to a third operation instruction, the target image frame is continuously played starting from a single image frame with a second preset sequence number, wherein the third operation instruction is triggered by a third preset operation, and the third preset operation includes a tap operation and a slide operation.
[0099] In the disclosed embodiment, the image frames can be switched back and forth in a variety of ways, for example, by clicking on a page turning arrow, or by performing gestures such as sliding back and forth or up and down on the image display area.
[0100] In the disclosed embodiment, the playback progress can be displayed in a variety of ways, such as by displaying the image frame playback progress in the form of a progress bar, or by directly displaying the image frame playback progress in the form of a progress value. Specifically, the playback progress can be displayed only in the form of a progress bar, or by setting a progress value in the area near the progress bar to assist in displaying the video progress.
[0101] When the progress of the image frame playback is displayed in the form of a progress bar, the progress bar may adopt a variety of styles. For example, a square bar-shaped progress bar style may be adopted, or a columnar bar-shaped progress bar style may be adopted, or a ring-shaped progress bar style may be adopted. In practical applications, other possible progress bar styles may also be adopted, and the embodiments of the present disclosure do not limit this.
[0102] When the user drags on the progress bar, the image display area can display the image frame corresponding to the dragged position as the progress bar is dragged, slid or clicked. The user can judge whether the desired image frame position is reached based on the image frame displayed in the image display area. Specifically, the image frame corresponding to the current position is calculated based on the position to which the user drags on the progress bar, or the distance between the clicked position and the initial position of the progress bar, or the clicked position and the position of the progress bar where the slider of the progress bar was located when the progress bar was clicked, and the corresponding image frame is displayed in the image display area.
[0103] Specifically, when the second sub-region displays the relevant target image frame in a dynamic display mode, such as Figure 7a to Figure 7b As shown, arrows for switching between previous and next frames and a draggable progress bar for displaying the progress of playback are respectively arranged on both sides and the bottom of the image display area. When a page turning operation of the user is detected, such as clicking a page turning arrow, Figure 7a As shown, or sliding forward and backward or up and down on the image display area, such as Figure 7b and Figure 7c As shown, after the image display area switches to the corresponding image frame display according to the operation, the continuous playback of the image frame is stopped. If the user's page turning operation is detected again, the display content is switched to the corresponding image frame according to the page turning operation, and the continuous playback state is continued to be stopped, that is, the image frame is statically displayed.
[0104] In another application scenario, such as Figure 7d As shown, when the second sub-area adopts a dynamic display mode to display the relevant target image frame, a click operation on the image display area, such as a single click, is detected, and the image display area stops continuously playing the image frame. If the click operation on the image display area is detected again, the image display area resumes the continuous playback of the image frame, and starts from the image frame where the playback is stopped, and continuously plays the remaining image frames in sequence. In combination with this application scenario and the aforementioned embodiments, it can be seen that when the image display area stops continuously playing the image frame through a page turning operation, the continuous playback state of the image display area can be restored through a click operation on the image display area.
[0105] In another application scenario, such as Figure 7eAs shown, when the user's dragging and sliding of the progress bar or the tapping operation on the progress bar is detected, the displayed image frame is determined according to the position where the user drags on the progress bar, or the position where the user taps, and the remaining image frames are played in sequence from this image frame; or after the image frame is determined according to the position where the user drags, slides or clicks, according to the preset rules, such as moving forward or backward on the corresponding serial number of the determined image frame, it is used as the resume playback image frame serial number, and based on the resume playback image frame serial number, the corresponding image frame is determined, and at the same time, the remaining image frames are played in sequence from this image frame. The image frame played after the sliding operation, that is, the second preset serial number, can be the serial number of the image frame determined according to the position after sliding, or it can be the serial number of the image frame determined by the preset rules after sliding. Other situations can be deduced by analogy, and examples are not given one by one here.
[0106] Similarly, in another disclosed embodiment, reference Figure 6 When the preset display mode is a static display mode that combines static and dynamic display modes, operations such as those in the above embodiments may be performed for the image display area, and examples are not given one by one here.
[0107] In one embodiment, the medical image display method further includes:
[0108] In response to the fourth operation instruction, the preset display mode is switched from the static display mode to the dynamic display mode; or, in response to the fourth operation instruction, the preset display mode is switched from the dynamic display mode to the static display mode.
[0109] Specifically, Figure 8 As shown, the user switches the current preset display mode of the second sub-area from the "static display mode" to the "dynamic display mode" by clicking the control labeled "Picture Browsing", that is, switching from mainly displaying the detail label information of the target object to only displaying the image frames associated with the target object; correspondingly, the user switches the current preset display mode of the second sub-area from the "dynamic display mode" to the "static display mode" by clicking the control labeled "List View", that is, switching from only displaying the image frames associated with the target object to mainly displaying the detail label information of the target object.
[0110] The medical image display method provided in this embodiment switches from the image frame dynamic display page to the detail page of the associated object through a switching operation, so that the user can browse more content associated with the target object in the target detail page, thereby improving the user experience. In addition, by flexibly and conveniently switching different display focuses, that is, the display focus of image information and text information, the relevant information and content of the target object can be more comprehensively displayed on a limited display interface, thereby further enriching the display content in the display page.
[0111] In one embodiment, the medical image display method further includes:
[0112] In response to the first operation instruction, before determining the target object from the candidate objects in the hierarchical image catalog, the method further includes:
[0113] At least one default object in the hierarchical image directory is determined, and a check mark is given to the at least one default object; in the second sub-area, a target image frame associated with the at least one default object is displayed according to a preset display mode.
[0114] Specifically, after importing the image source data and parsing and visually displaying it, according to the preset recommendation rules, in the hierarchical image directory displayed in the first sub-area, at least one directory item is determined as a default target object, and the default target objects are all checked, and in the second sub-area, one of the default target objects is displayed according to the preset dynamic display mode or static display mode.
[0115] In the disclosed embodiment, the application scenario of an ultrasonic fusion device importing MRI data and performing real-time fusion with subsequent ultrasonic images is taken as an example. At this time, the imported image source data is an MRI image of the prostate. When the prostate MRI data of multiple patients are imported, the default target object can usually be determined for the sequence included in the first examination of the first patient in the order of arrangement, and a check mark can be made. The default target object can also be determined for the sequence included in the first examination of all imported patients, and a check mark can be made. Alternatively, the default target object can be determined for the sequence included in some examinations of some patients or all examinations, and a check mark can be made. Other situations can be deduced by analogy, and examples are not given one by one here.
[0116] Taking the default target object determined in the sequence included in the first examination of the first patient as an example, after the prostate MRI image of the patient is imported, the management interface is horizontally divided into a first sub-area and a second sub-area. At this time, the first sub-area displays the content after the image source data is analyzed and visualized, such as Fig. 9As shown, each graded image directory of the prostate MRI data is displayed step by step according to the ladder level, and from top to bottom are the patient name, the examination code, and the name of the sequence included in the first examination. Since MRI imaging includes slice sequences at multiple angles such as the cross-section and sagittal plane, this examination includes multiple sequences with different slice angles and different imaging parameters at each slice angle. A group of T2 cross-sectional data, a group of T2 sagittal plane data, a group of DWI data, and a group of ADC data are used as default target objects, and are checked, indicating that the checked sequences are used as data for subsequent three-dimensional reconstruction and ultrasound fusion. Correspondingly, in the second sub-area, the first default target object, that is, the T2 cross-sectional sequence, can be used as the target object in order from top to bottom, and its associated target image frame can be displayed in static display mode.
[0117] In other embodiments, in order to facilitate the user to review the target object, when there are multiple patient image data sources or multiple examinations under a single patient, only the sequence images included in the first examination under the first patient are checked as the default target object, so as to reduce the user's operations such as unchecking. The default target object can also be checked for the sequence images included in one or more of the patients or examinations ranked from 1 to n. Other situations can be deduced by analogy, and no examples are given here one by one.
[0118] In one embodiment, the medical image display method further includes:
[0119] The first operation instruction is a check instruction. In response to the first operation instruction, determining the target object in the hierarchical image catalog includes: determining at least one target object in the hierarchical image catalog in response to the check instruction; checking the at least one target object; or,
[0120] The first operation instruction is a first single-select instruction. In response to the first operation instruction, determining a target object in the hierarchical image directory includes: determining a target object in the hierarchical image directory in response to the first single-select instruction; and performing a single-select mark on a target object.
[0121] Specifically, after importing the image source data and parsing and visualizing it, for the hierarchical image directory displayed in the first sub-area, the directory items in the hierarchical image directory can be determined as target objects through single selection or checking operations, and the associated image frames can be displayed in the second sub-area according to a preset display mode, wherein the single selection operation can only select one directory item at a time, that is, at any time, only one directory item can be in a single-selected marked state, and when the target object is determined, the display content of the second sub-area is further determined; in addition to determining the target object, the checking operation further determines the data involved in subsequent three-dimensional reconstruction and ultrasound fusion, and at the same time displays the image frames associated with the target object in the second sub-area, so the checking operation can operate on multiple directory items at the same time, that is, at any time, there can be multiple checked directory items.
[0122] In the embodiments of the present disclosure, reference Figure 10a to Figure 10b As shown, the user can select the specified directory item by clicking the name of each directory item displayed in the first sub-area through the touch screen, and the selected directory item is highlighted with a rectangular frame in the name column, indicating that the directory item is in a single-selection mark state, and the image frame associated with the directory item is displayed in the second sub-area synchronously, refer to Fig.10b As shown, the user can also click the rectangular box on the left side of each directory item name to check the desired directory item. When a directory item is checked, the rectangular box on the left indicates that the directory item is currently checked by ticking or displaying a horizontal bar in the box. At the same time, the directory item name column is highlighted with a rectangular box to remind the user that the image frame currently displayed in the second sub-area is the associated image frame of the directory item.
[0123] The medical image display method provided in this embodiment is used to distinguish different marking states for different directory items through single-select and check operations. It can not only directly display the associated image frames of the directory items determined by the single-select and check operations in the second sub-area, but also determine the associated directory items of the currently displayed image frame and the marking state of each directory item by whether the rectangular box is checked or a horizontal bar is displayed, and whether the directory item name is highlighted, thereby reducing the user's work of judging the state of the target object, and making the display content of the entire first sub-area, especially the various marking states, single, concise and clear.
[0124] In one embodiment, the medical image display method further includes:
[0125] The first operation instruction is a second single-choice instruction. In response to the first operation instruction, determining the target object from the candidate objects in the hierarchical image directory includes: when the hierarchical image directory is in a first state, in response to the second single-choice instruction, determining the target object in the hierarchical image directory, the first state being used to characterize that at least one default object in the hierarchical image directory is not in a check mark state; determining the object type of the target object; and when the object type of the target object is characterized as a default object, checking the target object.
[0126] Specifically, after importing the image source data and parsing and visually displaying it, according to the preset recommendation rules, at least one default target object is determined in the hierarchical image directory displayed in the first sub-area, and the default target objects are all checked. When there is at least one default target object in the current hierarchical image directory that is not in a checked state, by detecting the user's single selection operation on each directory item, when there is a directory item selected by the user that belongs to the default target object but is not in a checked state, the directory item is marked as a checked state.
[0127] In the embodiments of the present disclosure, reference Fig. 9 As shown, taking the image source data as prostate MRI data as an example, after the image source data is imported and parsed and visualized, the various directory items of the prostate MRI data are displayed step by step according to the ladder level. For the image source data, the default target objects determined include: a group of T2 cross-sectional data, a group of T2 sagittal data, a group of DWI data and a group of ADC data, and the above 4 groups of sequences are checked and marked. During the image review process, the user can uncheck the selected sequence by clicking the rectangular check box corresponding to the sequence in this embodiment, thereby canceling the checked state of the sequence. state, that is, the DWI sequence is unchecked. When the user expects to retrieve and check the sequence that was previously manually unchecked, that is, to retrieve and check the default target object, the user applies a single selection operation to each sequence, which is clicking the name of the sequence in this embodiment. When the single-selected sequence does not belong to the default target object, the check mark state of the sequence remains unchanged, that is, if the sequence is in a checked state or an unchecked state before the single selection, the sequence remains in the state before the single selection after the single selection, that is, the checked state or the unchecked state. At this time, the target image frame associated with the sequence is displayed in the second sub-area according to the preset display mode. Fig.11As shown, when the single-selected sequence belongs to the default target object, that is, the user single-selects the DWI sequence, and the sequence is in an unchecked state before the single selection, the sequence state is modified to a checked state, and the target image frame associated with the sequence is displayed in the second sub-area according to the preset display mode. If the sequence is in a checked state before the single selection, the sequence state remains in a checked state, and the target image frame associated with the sequence is displayed in the second sub-area according to the preset display mode.
[0128] The medical image display method provided in this embodiment facilitates users to distinguish default target objects through single-select operations, and at the same time achieves a checking effect through single-select operations, so that the default target objects can be quickly retrieved, effectively solving the problem that users cannot quickly and conveniently retrieve the default target objects after unchecking them due to accidental touch or other reasons during the operation review process, omitting the step of repeatedly importing image source data, and improving the fault tolerance of user operations.
[0129] In one embodiment, the medical image display method further includes: the hierarchical image directory includes a parent node and a child node, and the medical image display method further includes: when the child node is checked, the parent node of the level where the child node is located is determined as the target parent node; when the number of sibling nodes of the target parent node is determined to be greater than or equal to a preset value, the target parent node is checked.
[0130] Specifically, the hierarchical item directory includes nodes that have a parent-child relationship with each other. The node data is presented as the above directory items in the visual interface. When a child node is checked and the parent node has more than one node at the same level, the parent node is adjusted to a checked state.
[0131] In the embodiment of the present disclosure, after the image source data is imported, parsed and visualized, each node of the image source data is displayed step by step according to the ladder level. Fig.12a As shown, the hierarchical image directory includes three levels of nodes, namely, a first-level node representing the patient name, a second-level node representing the examination name, and a third-level node representing the sequence name. At this time, the second-level node has two sibling nodes, examination 1 and examination 2, that is, the number of second-level nodes is equal to the preset value 2, and one of the sequences included in examination 1, that is, sequence 1, is in a checked state. At this time, the corresponding examination 1 is also in a checked state. Further, the parent node of the examination 1 node, that is, the patient A node, has no other sibling nodes, that is, the number of sibling nodes is 1, which is less than the preset value 2. Therefore, the state of the patient A node is not modified and is in an unchecked state; similarly, refer to Figure 12bAs shown, when the secondary node only includes the check 1 node, the number of its peer nodes is less than the preset value 1. When at least one node in the sequence nodes included in check 1 is in an unchecked state, that is, sequences 5, 7, 9-10 are in an unchecked state, then check 1 is in an unchecked state.
[0132] In another disclosed embodiment, Fig.13 As shown, the hierarchical image directory includes three levels of nodes, namely, a first-level node representing the patient name, a second-level node representing the examination name, and a third-level node representing the sequence name. At this time, the first-level node and the second-level node have one node at the same level, patient A and examination 1, that is, the number of nodes of the first-level node and the second-level node are both less than the preset value 2, and the sequences 1-9 included in examination 1 are all in a checked state, and the corresponding examination 1 is also in a checked state. Further, the parent node of the examination 1 node, the patient A node, is also in a checked state because the second-level nodes it includes are all in a checked state. For the first-level node, i.e., the patient node, the user can flexibly set the relevant rules according to the operation needs during the operation. For example, when there are multiple patient nodes and all the second-level examination nodes under a patient node are in a checked state, the patient node can also be in a checked state, or when there is a single patient node, regardless of whether the second-level examination nodes under the patient node are all in a checked state, the patient node is also in a checked state. Other situations can be deduced by analogy, and examples are not given one by one here.
[0133] The check mark state mentioned in the above embodiments may be presented in different forms in nodes at different levels. It may be a filled rectangular box with a check mark, or a filled rectangular box with a columnar horizontal line added, as well as other presentation forms that can be used to distinguish between checked and unchecked states. Examples are not given here one by one.
[0134] The medical image display method provided in the present embodiment can flexibly adjust the check mark state according to the number of sibling nodes of the parent node of the previous level of the checked node. When the parent node of the checked node has multiple sibling nodes, at this time, any child node under the parent node is checked, and the parent node is synchronously adjusted to a checked mark state, so as to remind the user of the parent node to which the currently checked target object belongs, so as to avoid the user's misoperation and confusion of the audited or selected object; further, when the parent node of the checked node has no other sibling nodes, that is, there is only one parent node at this level, then all the child nodes included in the parent node are checked, and the parent node can be adjusted to a checked mark state to remind the user that all the child nodes under the parent node are checked by the user. External users can flexibly set the preset value size of the number of nodes at each level according to specific needs to meet different needs in different scenarios. For example, for the first-level node, the preset value is set to 1, that is, no matter whether the child nodes of the first-level node are partially or completely checked, the first-level node is adjusted to a checked mark state. For the second-level node, since the probability of the node at this level being mistakenly checked is relatively high, the preset value can be set to 2, that is, when the number of nodes at the same level of the parent node is 2 or more, any child node of any parent node is checked, and the parent node is adjusted to a checked mark state accordingly; through the above flexible settings, it can not only remind the parent node to which the currently checked object belongs, but also remind whether all the child nodes under the parent node are checked, thereby meeting the user's needs for various reminders in different scenarios.
[0135] In one embodiment, in response to a first operation instruction, a target object is determined from candidate objects in the hierarchical image catalog, and then the method further includes: in response to a fifth operation instruction, configuring the additional attribute information of the target object to be modifiable.
[0136] Specifically, by parsing the image frames and detail label information associated with the target object, some key label information is extracted and applied in the naming of each corresponding directory item. After the user determines the target object, the associated part of the label information is configured to a modifiable state through operation instructions for further modification and adjustment.
[0137] In the embodiment of the present disclosure, the image source data generated by the Dicom protocol is taken as an example. In the protocol, the image source data is composed of frames of images, each of which is an image data, which is composed of various pixels. Each image frame has its own detailed label information, and the detailed label information includes the patient's name, gender, age, examination items and sequences, section angles, image enhancement parameters and other information. The image enhancement parameters further include parameters such as T1T2, DWI, ADC, etc. In the ultrasound fusion device, corresponding matching fusion algorithms are configured for images with different parameters. After the image source is parsed and visualized, Fig.14aAs shown in the figure, the label information such as the section angle and image enhancement parameters are extracted and reflected in the naming of the corresponding catalog items, so that users can intuitively obtain the key information of each catalog item. When the user finds that the label information of the target catalog item is incorrect through browsing and review, the image enhancement parameters of the target catalog item can be aligned to a modifiable state by clicking the "Manual Adjustment" control, as shown in the figure. Fig.14b As shown, select the correct label information in the pop-up sub-window to modify it.
[0138] The medical image display method provided in this embodiment extracts label information such as section angles and image enhancement parameters and reflects them in the names of corresponding directory items, so that users can intuitively obtain key information of each directory item, and open modification permissions to modify some key information through related controls. This solves the problem that when some information is incorrect, it is often not possible to modify it immediately and it is necessary to return to the image device to modify it and then re-import the data. This simplifies the operation steps and improves the visualization of the data.
[0139] According to one or more embodiments of the present disclosure, Fig.15 As shown, an image display device is provided, comprising:
[0140] An image import module 201 imports at least one image source data in response to an image import instruction, wherein the image source data includes image directory data and at least one image data;
[0141] A directory display module 202, configured to display a hierarchical image directory corresponding to the image directory data in a first sub-area of a preset image display area;
[0142] An operation instruction response module 203, configured to determine a target object from candidate objects in the hierarchical image catalog in response to a first operation instruction;
[0143] The target image frame display module 204 is used to display the target image frame corresponding to the image data associated with the target object in the second sub-area of the image display area according to a preset display mode. The preset display mode includes a static display mode and a dynamic display mode. The dynamic display mode is to continuously play the target image frame.
[0144] The above-mentioned image display device imports at least one image source data in response to an image import instruction, the image source data including image directory data and at least one image data; visually displays the image source data in a preset image display area, the image display area including a first sub-area and a second sub-area, the first sub-area being used to display a hierarchical image directory corresponding to the image directory data; determines a target object from candidate objects in the hierarchical image directory in response to a first operation instruction; and displays a target image frame corresponding to the image data associated with the target object in the second sub-area of the image display area according to a preset display mode, the preset display mode including a static display mode and a dynamic display mode, the dynamic display mode being a continuous playback of the target image frame. The image source data is imported and parsed for visual display, with a hierarchical image directory displayed in the first sub-area, and dynamic and static displays of relevant content of the targets confirmed in the hierarchical image directory in the second sub-area. That is, through dual-area display and dynamic and static information display, the audit object is selected in the first sub-area, and the dynamic and static content are quickly audited in the second sub-area. The audit object is selected according to specific needs, without the need for manual auditing one by one, thus reducing the workload caused by a large number of audit objects. Dynamic content can be used for fast and manual auditing, thereby improving audit efficiency and streamlining operating steps.
[0145] In one embodiment, the second sub-area includes a first partition and a second partition. When the target image frame display module 204 displays the target image frame in a static display mode in a preset display mode, the data information associated with the target object is displayed in the first partition of the second sub-area, and the target image frame is displayed in the second partition of the second sub-area.
[0146] In one embodiment, when the number of target image frames is multiple frames, the target image frame display module 204 continuously plays the multiple target image frames in the second partition, or displays a single image frame with a first preset serial number among the multiple target image frames in the second partition.
[0147] In one embodiment, when the target image frame display module 204 adopts the dynamic display mode in the preset display mode to display the target image frame, in response to the second operation instruction, the continuous playback of the target image frame is paused, wherein the second operation instruction is triggered by the second preset operation, and the second preset operation includes a click operation and a page turning operation; in response to the third operation instruction, the target image frame is continuously played starting from the single frame image frame with the second preset sequence number, wherein the third operation instruction is triggered by the third preset operation, and the third preset operation includes a tap operation or a sliding operation.
[0148] In one embodiment, the target image frame display module 204 switches the preset display mode from the static display mode to the dynamic display mode in response to the fourth operation instruction; or, switches the preset display mode from the dynamic display mode to the static display mode in response to the fourth operation instruction.
[0149] In one embodiment, the directory display module 202 is further used to determine at least one default object in the hierarchical image directory and check the at least one default object; in the second sub-area, the target image frame associated with the at least one default object is displayed according to a preset display mode.
[0150] In one embodiment, when the first operation instruction is a check instruction, the operation instruction response module 203 responds to the check instruction, determines at least one target object in the hierarchical image directory and checks at least one target object; or, when the first operation instruction is a first single-select instruction, the operation instruction response module 203 responds to the first single-select instruction, determines a target object in the hierarchical image directory and single-selects a target object.
[0151] In one embodiment, when the first operation instruction is a second single-select instruction, when the hierarchical image directory is in a first state, the operation instruction response module 203 responds to the second single-select instruction, determines the target object in the hierarchical image directory, and the first state is used to characterize that at least one default object in the hierarchical image directory is not in a check mark state; determines the object type of the target object; and when the object type of the target object is characterized as a default object, checks the target object.
[0152] In one embodiment, the hierarchical image directory includes a parent node and a child node. When a child node is checked, the operation instruction response module 203 determines the parent node of the level where the child node is located as the target parent node, determines that the number of nodes at the same level of the target parent node is greater than or equal to a preset value, and checks the target parent node.
[0153] In one embodiment, the operation instruction response module 203 further includes an additional attribute information configuration unit, which is used to configure the additional attribute information of the target object to a modifiable state in response to the fifth operation instruction.
[0154] For the specific definition of the image display device, please refer to the definition of the medical image display method above, which will not be repeated here. Each module in the above-mentioned image display device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0155] In one embodiment, a computer device is provided. The computer device may be a user terminal, and its internal structure diagram may be as follows: Fig.16 As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor is used to provide computing and control capabilities. The memory includes a non-volatile storage medium and an internal memory, the non-volatile storage medium stores an operating system and a computer program, the internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium, and the computer program is executed by the processor to implement a medical image display method. The communication interface is used to communicate with an external terminal through a network connection. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.
[0156] Those skilled in the art will understand that Fig.16 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0157] In one embodiment, the image display device provided by the present application can be implemented in the form of a computer program. The computer program can be Fig.16 The computer device shown in the figure is run on the computer device. The memory of the computer device can store various program modules constituting the image display device, such as, Fig.15 The computer program composed of each program module enables the processor to execute the steps of the medical image display method of each embodiment of the present application described in this specification. For example, Fig.16 The computer device shown can be Fig.13 The image import module in the image display device shown executes step S101, the directory display module executes step 102, the operation instruction response module executes step 103, and so on.
[0158] Accordingly, in one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the medical image display method provided in any embodiment of the present application is implemented.
[0159] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0160] Accordingly, in one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the medical image display method provided in any embodiment of the present application is implemented.
[0161] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0162] The above-described embodiments only express some implementation methods of the present application, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A medical image display method, characterized in that: include: In response to the image import instruction, import at least one image source data for fusion with the ultrasound image, wherein the image source data includes image directory data and at least one image data; Displaying a hierarchical image catalog corresponding to the image catalog data in a first sub-area of a preset image display area, the hierarchical image catalog at least comprising a primary catalog item for representing a patient, a secondary catalog item for representing an examination, and a tertiary catalog item for representing an image frame; In response to a first operation instruction, determining a target object from candidate objects in the hierarchical image catalog, the target object being an audit object; In the second sub-area of the image display area, a target image frame corresponding to the image data associated with the target object is displayed according to a preset display mode, wherein the preset display mode includes a static display mode and a dynamic display mode, wherein the dynamic display mode is to continuously play the target image frame, and when the target image frame is displayed in the dynamic display mode, it also includes: in response to a second operation instruction, pausing the continuous playing of the target image frame, wherein the second operation instruction is triggered by a second preset operation, and the second preset operation includes a click operation and a page turning operation; in response to a third operation instruction, continuously playing the target image frame from a single image frame of a second preset sequence number, wherein the third operation instruction is triggered by a third preset operation, and the third preset operation includes a tap operation and a slide operation; When the first operation instruction is a check instruction, determining the target object from the candidate objects in the hierarchical image catalog in response to the first operation instruction includes: In response to the check-box instruction, determining at least one target object in the hierarchical image catalog; Checking the at least one target object; When the first operation instruction is a first single-selection instruction, determining the target object from the candidate objects in the hierarchical image catalog in response to the first operation instruction includes: In response to the first single-select instruction, determining a target object in the hierarchical image catalog; Performing a single selection mark on the one target object; When the first operation instruction is a second single-select instruction, determining the target object from the candidate objects in the hierarchical image catalog in response to the first operation instruction includes: determining a target object from candidate objects in the hierarchical image catalog in response to a second single-select instruction when the hierarchical image catalog is in a first state, the first state being used to represent that at least one default object in the hierarchical image catalog is not in a check mark state; determining an object type of the target object; When the object type of the target object is characterized as a default object, the target object is checked.
2. The method according to claim 1, characterized in that The second sub-area includes a first partition and a second partition. When the preset display mode is a static display mode, the target image frame corresponding to the image data associated with the target object is displayed in the second sub-area of the image display area according to the preset display mode, including: Displaying data information associated with the target object in the first partition of the second sub-area; The target image frame is displayed in a second sub-region of the second sub-area.
3. The method according to claim 2, characterized in that When the number of the target image frames is multiple frames, The displaying the target image frame in the second sub-area of the second sub-area includes: Continuously play a plurality of target image frames in the second partition; or display a single image frame with a first preset sequence number among the plurality of target image frames in the second partition.
4. The method according to claim 1, characterized in that: The medical image display method further comprises: In response to a fourth operation instruction, switching the preset display mode from the static display mode to the dynamic display mode; or, In response to a fourth operation instruction, the preset display mode is switched from the dynamic display mode to the static display mode.
5. The method according to claim 1, characterized in that The step of determining the target object from the candidate objects in the hierarchical image catalog in response to the first operation instruction further comprises: determining at least one default object in the hierarchical image catalog and checking the at least one default object; In the second sub-area, the target image frame associated with the at least one default object is displayed according to a preset display mode.
6. The method according to claim 5, characterized in that The hierarchical image directory includes a parent node and a child node, and the medical image display method further includes: When the child node is checked, the parent node of the level where the child node is located is determined as the target parent node; Determine that the number of sibling nodes of the target parent node is greater than or equal to a preset value, The target parent node is checked.
7. The method according to claim 1, characterized in that In response to the first operation instruction, determining the target object from the candidate objects in the hierarchical image catalog, and then further comprising: In response to the fifth operation instruction, the additional attribute information of the target object is configured to be in a modifiable state.
8. An image display device, characterized in that: include: An image import module, in response to an image import instruction, imports at least one image source data for fusion with the ultrasound image, wherein the image source data includes image directory data and at least one image data; A catalog display module, configured to display a hierarchical image catalog corresponding to the image catalog data in a first sub-area of a preset image display area, wherein the hierarchical image catalog includes at least a primary catalog item for representing a patient, a secondary catalog item for representing an examination, and a tertiary catalog item for representing an image frame; The operation instruction response module is used to determine a target object from the candidate objects in the classified image catalog in response to a first operation instruction, wherein the target object is an audit object. When the first operation instruction is a check instruction, the determination of the target object from the candidate objects in the classified image catalog in response to the first operation instruction includes: determining at least one target object in the classified image catalog in response to the check instruction; and checking the at least one target object. When the first operation instruction is a first single-select instruction, the determination of the target object from the candidate objects in the classified image catalog in response to the first operation instruction includes: determining the a target object in a hierarchical image catalog; single-selecting the target object; when the first operation instruction is a second single-selecting instruction, determining the target object from the candidate objects in the hierarchical image catalog in response to the first operation instruction comprises: determining the target object from the candidate objects in the hierarchical image catalog in response to the second single-selecting instruction when the hierarchical image catalog is in a first state, the first state being used to characterize that at least one default object in the hierarchical image catalog is not in a checkmark state; determining the object type of the target object; and, when the object type of the target object is characterized as a default object, checking the target object; A target image frame display module is used to display a target image frame corresponding to the image data associated with the target object in a second sub-area of the image display area according to a preset display mode, wherein the preset display mode includes a static display mode and a dynamic display mode, and the dynamic display mode is to continuously play the target image frame. When the target image frame is displayed in the dynamic display mode, it also includes: responding to a second operation instruction, pausing the continuous playback of the target image frame, wherein the second operation instruction is triggered by a second preset operation, and the second preset operation includes a click operation and a page turning operation; responding to a third operation instruction, continuously playing the target image frame starting from a single frame image frame with a second preset serial number, wherein the third operation instruction is triggered by a third preset operation, and the third preset operation includes a tap operation and a slide operation.
9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
