A dual-screen naked-eye three-dimensional display system for medical images

Abstract

The present invention relates to a dual-screen naked-eye three-dimensional display system for medical images, comprising: a host system, used to obtain image data of a medical image database, implement three-dimensional modeling according to the image data, form a three-dimensional modeling data source, implement naked-eye three-dimensional data reconstruction, form a naked-eye three-dimensional display data source, control the two-dimensional display to perform corresponding display according to the request of the two-dimensional human-computer interaction interface; control the naked-eye three-dimensional display to perform corresponding display according to the request of the naked-eye three-dimensional human-computer interaction interface; the two-dimensional display is used to implement the two-dimensional display of the image under the control of the host system; the naked-eye three-dimensional display is used to implement the naked-eye three-dimensional display of the image under the control of the host system; the two-dimensional human-computer interaction interface is used for human-computer interaction involving two-dimensional display; the naked-eye three-dimensional human-computer interaction interface is used for human-computer interaction involving naked-eye three-dimensional display. The present invention realizes the simultaneous display and operation synchronization of two-dimensional images and three-dimensional models, which greatly facilitates the use.

Description

Technical Field

[0001] The invention relates to a dual-screen naked-eye three-dimensional display system for medical images. Background Art

[0002] At present, with the rapid development of medical imaging technology, medical images are playing an increasingly important role in clinical diagnosis, and have also accelerated the development of clinical medicine to a certain extent. Two-dimensional medical images certainly play a positive role in doctors' diagnosis, but due to the diverse morphology and complex structure of human tissues and organs, the information contained in medical images has not been fully utilized. By reconstructing and visualizing two-dimensional images, the complex three-dimensional organ structure can be intuitively displayed, which will inevitably help doctors to conduct comprehensive and accurate analysis, thereby improving the level of medical diagnosis.

[0003] Three-dimensional reconstruction of medical images is a technology that uses computer technology to process a series of two-dimensional medical images (such as CT, MRI, etc.) to generate a three-dimensional stereo model. It is usually used to generate three-dimensional images of organs or body structures. Three-dimensional images can clearly show the spatial relationship of structures such as bones, blood vessels, and soft tissues. It is particularly important for the diagnosis of complex fractures, tumor positioning, vascular lesions, etc. For example, Chinese patent document CN117671141A discloses a medical image reconstruction, X-ray image processing method, device and computer equipment. The method includes: obtaining a two-dimensional image of the detection object; converting the two-dimensional image to obtain three-dimensional image data of the detection object; inputting the three-dimensional image data into a pre-trained processing model to obtain a target three-dimensional reconstructed image of the detection object, which can solve the problem of blurred implant edges in the reconstructed image caused by the large contrast difference between the implant and the bone body. Chinese patent document CN118691734A discloses a method, system, medium and electronic device for segmentation and reconstruction of three-dimensional medical image data, including the following steps: acquiring three-dimensional medical image data, and dividing the three-dimensional medical image data into medical image data blocks; inputting the medical image data blocks into a segmentation and reconstruction deep learning model for training, so as to realize segmentation and reconstruction of the three-dimensional medical image data based on the trained segmentation and reconstruction deep learning model, and automatically realizing the segmentation and reconstruction of target organs, tissues, etc. in three-dimensional medical images.

[0004] However, currently most medical three-dimensional images / stereo models are displayed on two-dimensional medical monitors. Users can arbitrarily scale, compare, and rotate three-dimensional images on two-dimensional monitors, observe and analyze from different angles, or perform related measurements, helping users to conduct comprehensive and accurate observation and analysis from a three-dimensional perspective. This will undoubtedly greatly improve the medical utilization value of image data. However, due to the limitations of two-dimensional display methods, the full advantages of three-dimensional images cannot be fully utilized.

[0005] On the other hand, naked-eye 3D display technology has been developed and improved. For example, Chinese patent document CN112637580A discloses an automatic calibration naked-eye 3D display system and a control method thereof, wherein the automatic calibration naked-eye 3D display system comprises a calibration plate mobile device, a naked-eye 3D display device and a calibration main control device; the calibration plate mobile device comprises a calibration plate and a calibration plate moving drive mechanism, the calibration plate moving drive mechanism is connected to the calibration plate and can drive the calibration plate to move; the naked-eye 3D display device is a naked-eye 3D display device to be calibrated, and the mapping relationship between the display grating parameters and the spatial position is determined according to the calibration algorithm and the system; the calibration main control device is connected to the naked-eye 3D display device, controls the naked-eye 3D display device to change the grating parameters, and searches for the optimal grating parameters that match the depth of the calibration plate, so as to ensure the accuracy of the grating visual area position calibration and meet the requirements of the naked-eye 3D display. Chinese patent document CN114938447A provides a naked-eye 3D instant messaging device and system, wherein the naked-eye 3D instant messaging device comprises: a naked-eye 3D display and a video module, an audio module and a communication model connected to the naked-eye 3D display; the naked-eye 3D display is provided with a controller for controlling the operation of the naked-eye 3D instant messaging device, and the video module, the audio module and the communication module are all connected to the controller; the naked-eye 3D instant messaging device establishes a communication connection with at least one instant messaging object via the communication module, so as to transmit the video data collected by the video module and the audio data collected by the audio module to at least one instant messaging object in real time through the communication connection, thereby realizing naked-eye 3D instant messaging with the at least one instant messaging object, effectively making the pictures seen and displayed by the user object have a three-dimensional sense, and being able to realize real-time naked-eye 3D display and interaction of two or more people. Summary of the invention

[0006] In order to overcome the above-mentioned defects of the prior art, the present invention provides a dual-screen naked-eye three-dimensional display system for medical images, which displays two-dimensional images and three-dimensional models at the same time for easy use.

[0007] The technical solution of the present invention is: a dual-screen naked-eye three-dimensional display system for medical images, comprising: The host system is used to obtain image data from a medical image database, implement three-dimensional modeling based on the image data to form a three-dimensional (stereoscopic) modeling data source, implement naked-eye three-dimensional data reconstruction to form a naked-eye three-dimensional display data source, and control the two-dimensional display to display accordingly based on the request of the two-dimensional human-computer interaction interface; and control the naked-eye three-dimensional display to display accordingly based on the request of the naked-eye three-dimensional human-computer interaction interface; A two-dimensional display, used for implementing two-dimensional display of images under the control of a host system (based on data from the host system); A naked-eye three-dimensional display, used for implementing naked-eye three-dimensional display of images under the control of a host system (based on data from the host system); 2D human-computer interaction interface, used for human-computer interaction involving 2D display; The naked-eye 3D human-computer interaction interface is used for human-computer interaction involving naked-eye 3D display.

[0008] Furthermore, the human-computer interaction may include any suitable operations such as consulting, retrieving, measuring, marking and storing.

[0009] Preferably, the two-dimensional display is used to display cross-sectional, coronal and sagittal images in medical images, as well as three-dimensionally reconstructed surface rendering and volume rendering model images, wherein the three-dimensionally reconstructed surface rendering and volume rendering model images can be displayed in the naked-eye three-dimensional display in the form of naked-eye three-dimensional images, and have a one-to-one correspondence with the spatial relationship of the image displayed in the two-dimensional display, and information such as size and area in the image can be displayed quantitatively, thereby realizing comprehensive diagnosis by comparing the naked-eye three-dimensional image and the image information in the two-dimensional display.

[0010] Preferably, according to a preset program or the output of a related human-computer interaction interface, all or part of the display operations (operations for controlling the display) implemented through the two-dimensional human-computer interaction interface are synchronized with the three-dimensional human-computer interaction interface to implement synchronized operations on the naked-eye three-dimensional display.

[0011] Preferably, all or part of the display operations implemented through the naked-eye three-dimensional human-computer interaction interface are synchronized with the two-dimensional human-computer interaction interface to implement synchronized operations on the two-dimensional display.

[0012] Preferably, the image editing / editing results implemented in the two-dimensional human-machine interaction interface are synchronized to the naked-eye three-dimensional image display according to a preset program or an instruction of any human-machine interaction interface.

[0013] Preferably, the image editing / editing results implemented by the naked-eye three-dimensional human-computer interaction interface are synchronized to the two-dimensional image display according to a preset program or an instruction of any human-computer interaction interface.

[0014] Preferably, the edits performed via the two-dimensional human-computer interaction interface are saved in the medical image database according to the instructions of the two-dimensional human-computer interaction interface.

[0015] Preferably, the data saved in the medical image database via the two-dimensional human-computer interaction interface instruction carries a source record and a timestamp.

[0016] Preferably, the editing performed by the naked-eye 3D human-computer interaction interface is saved in the medical image database according to the instruction of the naked-eye 3D human-computer interaction interface.

[0017] Preferably, the data saved in the medical image database via the naked-eye three-dimensional human-computer interaction interface instruction carries a source record and a timestamp.

[0018] The hardware architecture for implementing the present invention may be constructed in the following manner: a host system is provided, the host system being connected to a two-dimensional display for implementing two-dimensional image display and a naked-eye three-dimensional display for implementing naked-eye three-dimensional image display.

[0019] Preferably, the host system is provided with a medical image database.

[0020] Preferably, the host system includes a local host, a cloud server and a cloud storage, and the local host is provided with or without a local storage.

[0021] Preferably, the local host is provided with a network communication module.

[0022] Preferably, the host system is provided with a unified input device, and the unified input device is connected to the local host.

[0023] Preferably, the unified input device comprises a keyboard.

[0024] Preferably, the unified input device comprises a mouse.

[0025] Preferably, the unified input device comprises a voice input device.

[0026] Preferably, the host system is provided with a unified audio output device, and the unified audio output device is connected to the local host Preferably, the unified audio output device of the host system includes a speaker.

[0027] The beneficial effects of the present invention are as follows: the present invention adds naked-eye three-dimensional image display on the basis of the original three-dimensional model displayed on a two-dimensional display, and converts the original medical image information into a stereoscopic image data source for naked-eye three-dimensional display through image processing software, and matches the naked-eye 3D display display, which can assist users to perform three-dimensional observation in a more three-dimensional, intuitive and convenient way, and combine the existing two-dimensional display analysis and operation to more accurately diagnose and evaluate the disease, plan the surgical plan, evaluate the postoperative treatment effect, etc.; because the host system realizes automatic synchronization of related operations, it is convenient to use. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic diagram of a data processing flow of naked-eye three-dimensional display according to the present invention; Figure 2 It is a schematic diagram of the system architecture of the present invention. DETAILED DESCRIPTION

[0029] See also Figure 1 and Figure 2 The present invention adds naked-eye three-dimensional image display on the basis of the original three-dimensional model display. Through image processing software, the original medical image information is converted into a stereoscopic image data source for naked-eye three-dimensional display, and matched with the naked-eye 3D display.

[0030] Based on the medical image 3D reconstruction technology, with the support of corresponding software / algorithms, a series of 2D medical images (such as CT, MRI, etc.) from the medical image database are processed, 3D modeling (traditional medical stereo modeling) is implemented, a 3D modeling data source is formed, naked eye 3D data reconstruction is implemented, a naked eye 3D display data source is formed, and based on the same computer system (computer host), the 3D modeling data is sent to the 2D display for 2D display under the 3D model (traditional 3D model display), and the naked eye 3D display data is sent to the naked eye 3D display for display. Users can operate the 2D display through the 2D human-computer interaction interface according to the existing operation mode, control the display content and display mode of the 2D display, and perform operations such as viewing, retrieval, measurement, annotation and storage, and can operate the naked eye 3D display according to the naked eye 3D human-computer interaction interface, control the display content and display mode of the naked eye 3D display, and perform operations such as viewing, retrieval, measurement, annotation and storage.

[0031] Based on the user's choice, all or part of the display operations (operations for controlling the display) implemented in the two-dimensional human-computer interaction interface can be synchronized with the three-dimensional human-computer interaction interface to implement synchronized operations on the naked-eye three-dimensional display. All or part of the display operations implemented in the naked-eye three-dimensional human-computer interaction interface can be synchronized with the two-dimensional human-computer interaction interface to implement synchronized operations on the two-dimensional display.

[0032] The image editing / editing results (eg, annotations, etc.) implemented in the two-dimensional human-computer interaction interface can be synchronized to the naked-eye three-dimensional image display, and the corresponding editing results (and editing process, if necessary) can be displayed in the naked-eye three-dimensional image.

[0033] The image editing / editing results (eg, annotations, etc.) implemented by the naked-eye 3D human-computer interaction interface can be synchronized to the 2D image display, and the corresponding editing results (and editing process, if necessary) can be displayed in the 2D image.

[0034] The data saved through the two-dimensional human-computer interaction interface and the data saved through the naked-eye three-dimensional human-computer interface are stored in the medical imaging database. The source (data saved through the two-dimensional human-computer interaction interface and the naked-eye three-dimensional human-computer interface, etc.) and time can be recorded in the saved data so that these data source information can be obtained in subsequent reference and display.

[0035] Each human-machine interface can be realized through human-machine interaction equipment with the support of corresponding software. Except for devices such as monitors dedicated to two-dimensional display or naked-eye three-dimensional display, the two human-machine interaction interfaces can share the same set of human-machine interaction equipment.

[0036] The present invention has the following characteristics: 1) Medical imaging 2D images and 3D images are displayed on two ultra-high-definition medical monitors respectively, which improves image resolution and image display effects, helping doctors to diagnose and evaluate the disease more accurately.

[0037] 2) The 3D image display method is naked-eye 3D, which adds naked-eye 3D display on the basis of traditional 3D image display to assist clinical diagnosis and treatment analysis. It can present medical images with a sense of depth and space, allowing doctors to more clearly observe the morphology, position, size of the lesion and its relationship with surrounding tissues.

[0038] Unless otherwise specified or when one preferred or optional technical means is a further limitation of another technical means, the preferred and optional technical means disclosed in the present invention can be arbitrarily combined to form several different specific implementation methods.

Claims

1. A dual-screen naked-eye three-dimensional display system for medical images, comprising: The host system is used to obtain image data from a medical image database, implement three-dimensional modeling based on the image data to form a three-dimensional modeling data source, implement naked-eye three-dimensional data reconstruction to form a naked-eye three-dimensional display data source, and control the two-dimensional display to perform corresponding display based on the request of the two-dimensional human-computer interaction interface; According to the request of the naked-eye 3D human-computer interaction interface, the naked-eye 3D display is controlled to perform corresponding display; A two-dimensional display, used for implementing two-dimensional display of images under the control of a host system; A naked-eye 3D display, used for implementing naked-eye 3D display of images under the control of a host system; 2D human-computer interaction interface, used for human-computer interaction involving 2D display; The naked-eye 3D human-computer interaction interface is used for human-computer interaction involving naked-eye 3D display.

2. The medical image dual-screen naked eye three-dimensional display system according to claim 1, characterized in that The two-dimensional display is used to display cross-sectional, coronal, and sagittal images in medical images, as well as three-dimensionally reconstructed surface rendering and volume rendering model images, wherein the three-dimensionally reconstructed surface rendering and volume rendering model images can be displayed in the naked-eye three-dimensional display in the form of naked-eye three-dimensional images, and have a one-to-one correspondence with the spatial relationship of the image displayed in the two-dimensional display, and information such as size and area in the image can be quantified and displayed, thereby realizing comprehensive diagnosis by comparing the naked-eye three-dimensional image and the image information in the two-dimensional display.

3. The medical image dual-screen naked-eye three-dimensional display system according to claim 1, characterized in that According to the preset program or the output of the relevant human-computer interaction interface, all or part of the display operations realized through the two-dimensional human-computer interaction interface are synchronized with the three-dimensional human-computer interaction interface to implement the synchronous operation of the naked-eye three-dimensional display.

4. The medical image dual-screen naked-eye three-dimensional display system according to claim 1, characterized in that All or part of the display operations realized through the naked-eye three-dimensional human-computer interaction interface are synchronized with the two-dimensional human-computer interaction interface to implement synchronized operations on the two-dimensional display.

5. The medical image dual-screen naked-eye three-dimensional display system according to claim 1, characterized in that According to the preset program or the instruction of any human-computer interaction interface, the image editing / editing results implemented in the two-dimensional human-computer interaction interface are synchronized to the naked-eye three-dimensional image display.

6. The medical image dual-screen naked-eye 3D display system according to claim 1, characterized in that According to the preset program or the instruction of any human-computer interaction interface, the image editing / editing results implemented by the naked-eye 3D human-computer interaction interface are synchronized to the 2D image display.

7. The medical image dual-screen naked-eye three-dimensional display system according to any one of claims 1 to 6, characterized in that According to the instructions of the two-dimensional human-computer interaction interface, the edits implemented by the two-dimensional human-computer interaction interface are saved in the medical image database.

8. The medical image dual-screen naked-eye three-dimensional display system according to claim 8, characterized in that The data saved in the medical imaging database through the two-dimensional human-computer interaction interface command carries the source record and time stamp.

9. The medical image dual-screen naked-eye three-dimensional display system according to any one of claims 1 to 6, characterized in that According to the instructions of the naked-eye three-dimensional human-computer interaction interface, the edits implemented by the naked-eye three-dimensional human-computer interaction interface are saved in the medical image database.

10. The medical image dual-screen naked-eye three-dimensional display system according to claim 9, characterized in that The data saved in the medical imaging database through the naked-eye three-dimensional human-computer interaction interface command carries the source record and time stamp.

Images