Doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code

Abstract

The invention relates to the technical field of medical information, and discloses a doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on an encrypted two-dimensional code. According to the invention, by introducing the technical architecture of combining the encrypted two-dimensional code and WebGL lightweight rendering, the inherent defects of the traditional three-dimensional image system in the aspects of mobility, interactivity and security are effectively overcome. Specifically, the system utilizes an encrypted two-dimensional code to realize accurate binding and safe distribution of patient information and a three-dimensional model, ensures medical data privacy through a simple identity verification mechanism, and meanwhile, by means of lightweight processing and WebGL technology, doctors and patients do not need to install special software, so that the medical data privacy is ensured. According to the method, the two-dimensional code is scanned only through intelligent equipment, all-dimensional interaction operation such as rotation, zooming, hiding and perspective can be conducted on the same three-dimensional model in a browser, therefore, the time and space limitation of three-dimensional image use is broken through, a safe, efficient and convenient doctor-patient collaborative diagnosis and treatment platform is constructed, and the communication efficiency and diagnosis and treatment experience are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of medical information technology, in particular to a medical patient three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code. BACKGROUND

[0002] In the fields of orthopedics, neurosurgery, oral and maxillofacial surgery, etc., precise diagnosis and treatment, surgical planning and doctor-patient communication, three-dimensional medical models reconstructed based on CT, MRI and other image data play a crucial role. It can stereoscopically and intuitively display the spatial relationship between the lesion and the surrounding tissue, and is a key tool for achieving precision medicine.

[0003] However, the current diagnosis and treatment process based on three-dimensional medical models has the following problems: Poor data mobility and sharing. The three-dimensional model data generated by professional three-dimensional reconstruction software (such as Mimics) has a huge data volume, which can reach hundreds of megabytes or even gigabytes. This type of data traditionally relies on high-performance graphics workstations within the hospital for viewing and operation, and cannot be transmitted and loaded in a regular mobile network environment. This limits the flexibility of its clinical application, as doctors cannot easily access the model in different scenarios such as operating rooms, clinics, and conference rooms.

[0004] Low efficiency of doctor-patient communication. For patients, it is difficult to understand two-dimensional medical films and static three-dimensional screenshots, which creates an information gap between doctors and patients. Doctors have difficulty explaining complex conditions and surgical plans to patients through abstract descriptions, and patients cannot establish accurate knowledge based on non-intuitive image data, which directly affects patient informed consent and treatment cooperation, and becomes a major obstacle to doctor-patient communication.

[0005] Existing mobile solutions are single-function and lack interactivity. Currently, although technologies such as "cloud film" attempt to achieve mobile sharing of medical images, their essence is still to browse two-dimensional DICOM image sequences through the network, or only provide static, pre-rendered three-dimensional effect maps. These solutions lack the ability to interact with three-dimensional models in depth (such as real-time rotation, scaling, sectioning, and transparency), and cannot meet the professional needs of clinicians to observe and analyze three-dimensional anatomical structures from multiple angles and levels. They also cannot support collaborative discussions between doctors and patients based on the same dynamic model.

[0006] Data security issues are prominent. Three-dimensional medical models contain high-precision patient anatomical information, which is sensitive personal medical privacy. Simple link sharing methods have a high risk of leakage, and traditional hospital intranet access modes cannot meet the security access needs of remote and mobile scenarios. How to achieve convenient cross-terminal and cross-regional sharing while ensuring data security is a difficult problem that current technology has not effectively solved.

[0007] Therefore, the field needs a solution that can achieve the lightweight, mobile, interactive and secure sharing of three-dimensional medical models, thereby realizing the time and space restrictions and building an efficient and intuitive collaborative diagnosis and treatment bridge between doctors and patients. Therefore, a doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on an encrypted two-dimensional code is proposed. SUMMARY

[0008] In view of the deficiencies of the prior art, the present application provides a doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on an encrypted two-dimensional code to solve the problems in the background art.

[0009] To achieve the above-mentioned purpose, the present application provides the following technical solutions: In a first aspect, a doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on an encrypted two-dimensional code includes: A Web management background configured to receive and store three-dimensional medical model data, and associate the three-dimensional medical model data with corresponding patient identity information; A cloud server in communication connection with the Web management background, the cloud server including: An encrypted two-dimensional code generation module configured to generate a unique encrypted two-dimensional code for each associated three-dimensional medical model, the encrypted two-dimensional code encoding an access link pointing to the three-dimensional medical model data; An identity verification module configured to verify the legitimacy of an access request; A doctor terminal and a patient terminal, respectively configured to scan the encrypted two-dimensional code through a two-dimensional code scanning tool built-in the intelligent terminal, to initiate an access request to the cloud server and submit verification information; Wherein, after receiving the access request, the identity verification module verifies whether the verification information matches the pre-stored patient identity information, and after verification, the cloud server sends the three-dimensional medical model data to the terminal that passes the verification; The doctor terminal and the patient terminal both have a built-in or called rendering engine based on WebGL to render the three-dimensional medical model in the browser environment, and provide an interactive interface for rotating, scaling, hiding / displaying and adjusting the transparency of the three-dimensional medical model.

[0010] Preferably, the identity verification module is configured to: Receive the patient name information submitted by the terminal, and compare the patient name information with the name in the pre-stored patient identity information, and if the comparison is consistent, the verification is passed.

[0011] Preferably, the identity verification module is further configured to support identity verification based on at least one of dynamic verification code, password or biometric information.

[0012] Preferably, the Web management background is further configured to provide functional modules of patient information management, three-dimensional model uploading and format conversion, model access permission setting, and system operation log recording.

[0013] Preferably, the encrypted two-dimensional code has access time limitation and / or access frequency limitation.

[0014] Preferably, the cloud server performs lightweight processing on the three-dimensional medical model data before sending the data to the terminal, and the processed data is in one of OBJ, GLTF, or GLB format.

[0015] Preferably, the doctor terminal and the patient terminal only have viewing and interactive operation permissions for the three-dimensional medical model, and do not have the permission to modify the original model data or download the model.

[0016] In a second aspect, a medical three-dimensional image collaborative diagnosis and treatment service method based on an encrypted two-dimensional code is provided, which adopts the system of the first aspect, and the method comprises the following steps: S1, three-dimensional model uploading and association step: receiving three-dimensional medical model data through the Web management background, and storing the data and corresponding patient identity information in the Web management background database, and synchronizing the model access index to the cloud server; S2, encrypted two-dimensional code generation step: generating an encrypted two-dimensional code for the three-dimensional medical model data by the cloud server; S3, code scanning verification step: the doctor terminal or the patient terminal scans the encrypted two-dimensional code and submits verification information to the cloud server; S4, identity verification and authorization step: the cloud server verifies the verification information, and if the verification is passed, the terminal is authorized to access the corresponding three-dimensional medical model data; S5, model rendering and collaborative interaction step: loading and rendering the three-dimensional medical model through the browser of the terminal, and the doctor and the patient operate the model through the provided interactive interface to realize collaborative diagnosis and treatment.

[0017] Preferably, in the collaborative interaction step, the system supports establishing a synchronous session between the terminals of the doctor and the patient, so that the operation of one party on the three-dimensional model can be displayed in real time on the terminal interface of the other party.

[0018] Compared with the prior art, the present application has the following beneficial effects: 1. The present application introduces the mature "encrypted access" concept in the consumer Internet into the medical field. Through the simple and effective way of "inputting the patient's name", it is ensured that only authorized personnel can access sensitive three-dimensional medical data, greatly protecting the patient's privacy and meeting the medical data security specifications.

[0019] 2.The application realizes "one code for two purposes", doctors and patients can access and operate the same three-dimensional model at different times and different places by scanning the same two-dimensional code, which completely breaks the time and space and equipment restrictions, establishes a new "common language" for doctor-patient communication, and significantly improves communication efficiency and diagnosis and treatment experience.

[0020] 3.In use, the user end does not need to install any additional application programs, and can scan the code for use by using popular software, which greatly reduces the use threshold and facilitates rapid popularization in hospitals at all levels, especially in primary hospitals.

[0021] 4.The application provides interactive operation functions (rotation, scaling, hiding, perspective) of professional workstations, which fully meet the precise observation requirements of three-dimensional images in clinical practice and enable precise diagnosis and treatment.

[0022] Other features and advantages of the present application will be set forth in the following description, and in part will become apparent to those skilled in the art from the description, or can be learned by practice of the present application. The objects and other advantages of the present application can be achieved and obtained by the structures indicated in the specification, claims and drawings. BRIEF DESCRIPTION OF DRAWINGS

[0023] Figure 1 is a system overall architecture diagram of the present application; Figure 2 is an encryption two-dimensional code generation and verification flowchart of the present application; Figure 3 is an identity verification and permission control flowchart of the present application; Figure 4 is a doctor / patient terminal interaction interface schematic diagram of the present application; Figure 5 is a real-time synchronous collaborative session flowchart of the present application; Figure 6 is a model lightweight processing flowchart schematic diagram of the present application. DETAILED DESCRIPTION

[0024] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0025] Please refer to Figures 1-5 , a doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on an encrypted two-dimensional code.

[0026] 1. System architecture and deployment environment The physical architecture of the system mainly includes four parts: Web management background, cloud server, doctor terminal and patient terminal.

[0027] Web management background: usually deployed in the security area of the hospital intranet, using one or more high-performance servers running Linux operating system, and equipped with Tomcat or Nginx as Web service container. The background is connected with the existing hospital information system (HIS) and picture archiving and communication system (PACS) through standardized RESTful API or HL7 interface to obtain the basic information and image data index of patients.

[0028] Cloud server: to protect patient data privacy, the cloud server is preferably deployed on the private cloud infrastructure of the hospital. The server needs to have strong graphics computing power and is recommended to be equipped with professional level GPU to efficiently perform the lightweight processing task of three-dimensional model. The server is logically isolated from the internal and external network through the hospital firewall to ensure network security.

[0029] Doctor terminal and patient terminal: for popular mobile smart devices such as smartphones or tablets. Its operating system can be iOS or Android. The key is that these terminals need to have two-dimensional code scanning function, which can be accessed through the built-in browser or any application with scanning function. The kernel of the terminal browser needs to support WebGL 1.0 and above standard.

[0030] 2. Specific implementation of system core module 2.1. Web management background module The module is B / S architecture, and medical staff access its management interface through browser. The core sub-module implementation is as follows: Patient information management: provides a graphical interface for medical staff to manually enter or automatically synchronize patient information from HIS system, including but not limited to patient name, hospital number, gender, age and examination site. These information are stored in the MySQL or PostgreSQL relational database of the background in a structured way.

[0031] Three-dimensional model uploading and format conversion: After medical technicians complete reconstruction in professional three-dimensional reconstruction software (such as Mimics, 3D Slicer), they submit the original high-precision three-dimensional model file (such as STL format) through the uploading interface provided by the background. After receiving the file, the background automatically calls the three-dimensional model lightweight processing module. This module uses an EdgeCollapse-based mesh simplification algorithm to reduce the number of model patches by 85%-95% while ensuring that the visual accuracy loss is controllable. After this processing, an original model file of several GB can be compressed to within several tens of MB, which is very suitable for mobile network transmission. Then, the simplified model is converted to the GLB format (or GLTF format) which is more suitable for Web transmission and rendering. This format packages the geometry, material, and texture information of the model into a single file, which is more efficient than the OBJ format while maintaining compatibility. After conversion, the system establishes a unique association record between the GLB model file and the corresponding patient information in the database.

[0032] System management and log: System administrators can assign roles and permissions to different users (such as radiologists and orthopedic surgeons) in this module. The system automatically records all key operation logs, such as model upload time, uploader, associated patient ID, and subsequent each time the encrypted two-dimensional code access time, source IP, etc., to meet the audit requirements.

[0033] 2.2. Cloud server module This module is the core of the business logic and can be developed using Java Spring Boot or Python Django framework, and its main functional modules are as follows: Encrypted two-dimensional code generation module: When the Web management background successfully associates a three-dimensional model, this module is triggered. The module first generates a globally unique UUID and constructs a URL like https: / / [hospital domain name] / viewer?model_id= <uuid>The server encrypts the generated UUID or the entire access link using the AES-128 encryption algorithm or generates a digital signature for security purposes, and appends the encrypted string or signature as a token parameter to the access link (e.g., https: / / [hospital domain] / viewer?token=<encrypted string>). Then, using a library such as qrcode.js, an encrypted string is generated into a QR code image. To achieve fine access control, the system sets access policies for the two-dimensional code, such as being valid for 30 days from the date of generation and having a cumulative scanning access limit of 100 times, and if either limit is exceeded, the access link is automatically invalidated.

[0034] Identity verification module: This module is responsible for intercepting and processing all access requests initiated through the two-dimensional code.

[0035] Basic verification: After the terminal scans the two-dimensional code, the request is directed to a verification page. The page requires the visitor to input the patient's name. After submission, the verification module performs an exact string match between the input name and the pre-stored name in the database, and if they match, the verification is passed.

[0036] Enhanced verification: For highly private cases, the system can enable multi-factor verification. After the basic verification is passed, the system sends a 6-digit dynamic verification code to the patient's mobile phone number reserved in the hospital's archives, and requires the visitor to input it again. It can also integrate a biometric interface that supports the FIDO standard to achieve face recognition verification.

[0037] In addition, all data communication between the cloud server and all terminals is encrypted and transmitted through the HTTPS (TLS 1.2 and above) protocol, ensuring the security of data during transmission.

[0038] 2.3. Terminal rendering and interaction module Doctors and patient terminals do not need to pre-install any special application, all functions are completed in the browser environment built-in terminal.

[0039] Model rendering: After identity verification, the browser loads a dedicated model viewer page. This page embeds a rendering engine based on Three.js (a widely used WebGL graphics library). The cloud server streams lightweight GLB model files to the terminal. The Three.js engine calls the GPU of the terminal device for hardware-accelerated rendering, presenting high-quality, real-time interactive three-dimensional models in the browser; to adapt to low network bandwidth environments, the system supports chunked loading and progressive rendering of model data, prioritizing the loading of critical structures to improve user experience.

[0040] Interoperation: The viewer provides intuitive touch gestures and graphical buttons. Users can rotate the model by single-finger drag, zoom by two-finger pinch, hide or show specific parts by checking the list of skeletal structures in the sidebar, and adjust the transparency of certain tissues (e.g. skin, muscle) by sliding the bar to achieve a see-through effect to observe the underlying structures.

[0041] 3. System workflow and collaborative diagnosis mode The core method flow of the present application is as follows: S1: Three-dimensional model uploading and association: After a medical technician completes three-dimensional reconstruction of the pelvis CT for a patient user A, the model is uploaded through the Web management background. The background performs lightweight and format conversion, and establishes strong association between the generated GLB file and the identity information of the patient user A in the database.

[0042] S2: Encryption two-dimensional code generation: The cloud server generates an encrypted two-dimensional code with a 30-day validity period and a 50-time access limit for this association record. The two-dimensional code can be printed on the patient's diagnosis report or sent to the patient by the doctor through social software.

[0043] S3 & S4: Code scanning and verification: Scenario one (single access): The doctor user B scans the two-dimensional code using his personal mobile phone during the preparation gap, and inputs the name of the patient user A on the verification page. The system verifies and passes.

[0044] Scenario two (doctor-patient collaboration): During outpatient communication, the doctor user B and the patient user A (or his family member) scan the same two-dimensional code using their respective mobile phones, and respectively input the patient's name to complete identity verification.

[0045] S5: Model rendering and collaborative interaction: Mode one, asynchronous collaboration: After the above scenario two, both the doctor and the patient obtain independent access sessions of the same three-dimensional model on their respective mobile phones. The doctor can operate the model on his own mobile phone to explain the lesion to the patient; the patient can also freely rotate and zoom on his own mobile phone to observe from his own understanding. The operations of both parties are independent and do not affect each other, which is a kind of asynchronous collaboration based on "the same data source".

[0046] Mode two, real-time synchronous collaboration: To achieve more efficient and guided communication, the system provides real-time synchronization function. When any user (usually the doctor) clicks the "initiate synchronization" button in the viewer interface, the system backend establishes a full-duplex, low-latency communication channel between the doctor user B and the patient user A's terminal through the WebSocket protocol. After that, any interactive operation of the doctor user B on his terminal (such as rotating angle α, scaling ratio β, hiding parts γ), his operation instruction data (this is a very small amount of control command, usually only contains operation type and parameter, not the huge model data itself) will be sent to the patient user A's terminal in real time through the WebSocket connection. The Three.js rendering engine on the patient user A's terminal receives these instructions and immediately performs the same transformation in the local three-dimensional scene. The pose, perspective of the model on the patient user A's screen is completely consistent with that on the doctor user B's screen, achieving an immersive collaborative diagnosis experience of "pointing to see", improving the accuracy and efficiency of communication.

[0047] The synchronization session is relayed and managed by the cloud server. When one party initiates synchronization, the server creates a unique session ID and invites the other party to join. The session has a time limit and will automatically disband when either party closes the browser or actively exits, to ensure data security.

[0048] The system has error handling mechanism: if the model fails to load (such as network timeout), the terminal will display a prompt and support retry; if the identity verification fails, the system will record the failed attempts and limit the number of consecutive accesses to prevent brute force attacks.< / uuid>

Claims

1. A doctor-patient three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional codes, characterized in that, The system comprises: a web management background configured to receive and store three-dimensional medical model data and associate the three-dimensional medical model data with corresponding patient identity information; a cloud server in communication connection with the web management background, the cloud server comprising: an encrypted two-dimensional code generation module configured to generate a unique encrypted two-dimensional code for each associated three-dimensional medical model, the encrypted two-dimensional code encoding an access link pointing to the three-dimensional medical model data; an identity verification module configured to verify the legitimacy of an access request; a doctor terminal and a patient terminal, respectively configured to scan the encrypted two-dimensional code through a two-dimensional code scanning tool built-in the smart terminal to initiate an access request to the cloud server and submit verification information; wherein, after receiving the access request, the identity verification module verifies whether the verification information matches the pre-stored patient identity information, and if the verification is passed, the cloud server sends the three-dimensional medical model data to the terminal that passes the verification; the doctor terminal and the patient terminal both have a rendering engine based on WebGL built-in or called to render the three-dimensional medical model in a browser environment and provide an interactive interface for rotating, scaling, hiding / displaying, and adjusting the transparency of the three-dimensional medical model. 2.The medical three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code according to claim 1, characterized in that, The identity verification module is configured to: receive patient name information submitted by the terminal and compare the patient name information with the name in the pre-stored patient identity information, and if the comparison is consistent, the verification is passed. 3.The medical three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code of claim 2, characterized in that, The identity verification module is further configured to support identity verification based on at least one of dynamic verification code, password, or biometric information.

4. The medical three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code of claim 1, characterized in that, The web management background is further configured to provide functional modules of patient information management, three-dimensional model uploading and format conversion, model access permission setting, and system operation log recording.

5. The medical three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code of claim 1, characterized in that, The encrypted two-dimensional code has access time limit and / or access limit. 6.The medical three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code of claim 1, wherein, The cloud server performs lightweight processing on the three-dimensional medical model data before sending it to the terminal, and the processed data format is one of OBJ, GLTF, or GLB format. 7.The medical three-dimensional image collaborative diagnosis and treatment service system based on encrypted two-dimensional code of claim 1, wherein, The doctor terminal and the patient terminal only have viewing and interactive operation permissions for the three-dimensional medical model and do not have the permission to modify the original model data and download the model.

8. A medical staff three-dimensional image collaborative diagnosis and treatment service method based on an encrypted two-dimensional code, characterized in that, The method comprises the following steps: S1, three-dimensional model uploading and association step: receiving three-dimensional medical model data through the web management background and storing it in association with the corresponding patient identity information through the web management background built-in database, and synchronizing the model access index to the cloud server; S2, encrypted two-dimensional code generation step: generating an encrypted two-dimensional code for the three-dimensional medical model data by the cloud server; S3, code scanning verification step: the doctor terminal or the patient terminal scans the encrypted two-dimensional code and submits verification information to the cloud server; S4, identity verification and authorization step: the cloud server verifies the verification information, and if the verification is passed, the terminal is authorized to access the corresponding three-dimensional medical model data. S5, model rendering and collaborative interaction step: loading and rendering the three-dimensional medical model through the browser of the terminal, and the doctor and the patient operate the model through the provided interaction interface to realize collaborative diagnosis and treatment. 9.The medical three-dimensional image collaborative diagnosis and treatment service method based on encrypted two-dimensional code according to claim 8, characterized in that, In the collaborative interaction step, the system supports establishing a synchronous session between the terminals of the doctor and the patient, so that the operation of one party on the three-dimensional model can be displayed in real time on the terminal interface of the other party.

Images