Heart electrophysiology simulation interaction method based on VR and electronic equipment

Abstract

The invention discloses a heart electrophysiology simulation interaction method based on VR and electronic equipment, and belongs to the technical field of heart electrophysiology models.The method comprises the steps that a corresponding heart three-dimensional data model is exported based on NIFTI data of the heart; importing the heart three-dimensional data model into Unity, and aligning a heart model origin corresponding to the heart three-dimensional data model with a VR world origin; calibrating each collision point through ray projection of VR equipment, and determining VR space coordinates of each collision point; converting the VR space coordinates into stimulation point matrix coordinates corresponding to a heart model matrix; expanding the stimulation point matrix coordinates to obtain a spherical region matrix coordinate set; and correcting the spherical region matrix coordinate set to obtain a stimulation range dot matrix. According to the method and the device, the accurate conversion among the coordinate systems is realized, the accuracy of the position information of the stimulation point is ensured, the simulation efficiency and accuracy are improved, and the technical effect that the simulation process is relatively intuitive is achieved.

Description

Technical Field

[0001] The present application belongs to the technical field of cardiac electrophysiological models, and in particular to a VR-based cardiac electrophysiological simulation interaction method and electronic equipment. Background Art

[0002] Cardiac electrophysiology simulation is a relatively mature technology for calculating cardiac electrophysiological activities. In the simulation, electrical stimulation needs to be applied to the myocardial tissue to simulate the electrophysiological response of the heart.

[0003] In the existing technology, the simulation of cardiac electrophysiology experiments mainly has the following problems: 1) In the current cardiac electrophysiology experiments, the selection and positioning of stimulation points mainly rely on two-dimensional images or simple three-dimensional models, lacking intuitive spatial perception and precise positioning capabilities; it is difficult for simulation technicians and doctors to accurately judge the spatial position relationship of the stimulation points, which easily leads to positioning deviations. 2) The traditional cardiac modeling and stimulation point annotation methods have poor interactivity and are not intuitive enough to operate. Users need to switch between multiple software platforms and cannot adjust and verify the stimulation scheme in real time, which reduces the efficiency of the experiment. 3) The simulation model is not integrated enough, and the virtual annotation system and the physical simulation system are often separated, lacking an effective data flow mechanism; this separation leads to cumbersome workflows and increases the risk of errors in the data transmission link. 4) The visualization effect is poor. Traditional cardiac model visualization methods are often limited to static displays or simple animations and lack real-time interactive capabilities. This makes it difficult for doctors to intuitively understand the spatial relationship between the cardiac structure and the stimulation points.

[0004] In order to solve the above problems, it is necessary to propose a cardiac electrophysiological simulation interaction method and electronic device based on VR (Virtual Reality) of the present application. Summary of the invention

[0005] In order to solve the deficiencies of the prior art, the present application provides a VR-based cardiac electrophysiology simulation interaction method and electronic device, which can solve the problems of inaccurate stimulation point positioning, low simulation efficiency, high simulation error rate and poor visualization effect in the cardiac electrophysiology experiment simulation process in the prior art.

[0006] The technical effects to be achieved by this application are achieved through the following solutions: In a first aspect, the present application provides a VR-based cardiac electrophysiological simulation interaction method, the method comprising: Based on the NIFTI data of the heart, a corresponding three-dimensional data model of the heart is derived through a three-dimensional reconstruction algorithm, wherein the three-dimensional data model of the heart is in an Obj format; Importing the three-dimensional heart data model into Unity, and aligning the heart model origin corresponding to the three-dimensional heart data model with the VR world origin; Calibrate each collision point by ray projection of the VR device, and determine the VR space coordinates of each collision point; Converting the VR space coordinates into stimulation point matrix coordinates corresponding to the heart model matrix; Expanding the stimulus point matrix coordinates to obtain a spherical region matrix coordinate set; The spherical region matrix coordinate set is modified to obtain a stimulation range dot matrix.

[0007] In some embodiments, calibrating each collision point by ray projection of a VR device to determine the VR space coordinates of each collision point includes: Projecting a ray of the VR device onto an observation area of ​​the three-dimensional heart data model; Whether the ray intersects with the observation area is detected in real time. If so, collision point information corresponding to each collision point is recorded in the Log data, wherein the collision point information includes the VR space coordinates of each collision point.

[0008] In some embodiments, before calibrating each collision point through ray projection of the VR device, the method further includes: Constructing a camera viewing angle and an operating handle assembly, wherein the operating handle assembly includes a left-hand handle assembly and a right-hand handle assembly; Control the left-hand handle assembly and the right-hand handle assembly by a ray controller, so that the left-hand handle assembly and the right-hand handle assembly emit rays; The VR space coordinates of the collision point are detected by using the right-hand handle component, and the right-hand handle component detects ray collision in real time and returns the VR space coordinates of the corresponding collision point.

[0009] In some embodiments, converting the VR space coordinates into stimulation point matrix coordinates corresponding to the heart model matrix includes: For each collision point, the relative distance of the collision point to the origin of the heart model is calculated according to the following formula: Relative distance = VR space coordinates - heart model origin coordinates; Based on the relative distance, the stimulation point matrix coordinates corresponding to the heart model matrix are determined using the following formula: Stimulation point matrix coordinates = (relative distance / heart model size) * matrix size; The heart model size represents the size of the three-dimensional data model of the heart in the VR world, and the matrix size represents the size of the matrix constructed by the NIFTI data of the heart.

[0010] In some embodiments, the step of expanding the stimulation point matrix coordinates to obtain a spherical region matrix coordinate set includes: The stimulation area is expanded by adding or subtracting N from the stimulation point matrix coordinates to obtain a spherical area matrix coordinate set, wherein N is a positive integer.

[0011] In some embodiments, the spherical region matrix coordinate set is modified to obtain a stimulation range dot matrix, including: Deleting the stimulation points in the spherical region matrix coordinate set that are beyond the matrix constructed by the NIFTI data of the heart, to obtain a target spherical region matrix coordinate set; Get the coordinates corresponding to the epicardial cells; The stimulation points located at the coordinates corresponding to non-epicardial cells in the target spherical region matrix coordinate set are deleted to obtain a stimulation range dot matrix.

[0012] In all embodiments, the coordinates of the epicardial cells are obtained from NIFTI data of the heart.

[0013] In some embodiments, the value of N is a variable input by the user, for example, it may be 3.

[0014] In a second aspect, the present application provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any one of the methods described above when executing the computer program.

[0015] In a third aspect, the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any of the methods described above.

[0016] Through the VR-based cardiac electrophysiological simulation interaction method and electronic equipment provided by the present application, a multi-layer matrix coordinate transformation algorithm is designed. By establishing a mapping relationship between the VR space coordinate system, the local cardiac coordinate system and the physical simulation coordinate system, accurate conversion between the coordinate systems is achieved, ensuring the accuracy of the position information of the determined stimulation point, improving the efficiency and accuracy of the simulation, and achieving a more intuitive technical effect of the simulation process. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the existing technical solutions, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1This is a flow chart of a VR-based cardiac electrophysiology simulation interaction method in one embodiment of the present application; Figure 2 A schematic diagram of the data collection and conversion process of a VR-based cardiac electrophysiological simulation interactive method in one embodiment of the present application; Figure 3 It is a schematic block diagram of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0020] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in one or more embodiments of the present application should be understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in one or more embodiments of the present application do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0021] This application proposes a VR-based cardiac electrophysiology experiment annotation and simulation system. The system solves the deficiencies of the prior art through the following overall technical solutions: VR interactive calibration technology is used to construct a high-precision three-dimensional heart model, and an immersive virtual reality environment is used to provide an intuitive spatial perception experience, allowing the operator to accurately grasp the heart's anatomical structure and spatial position relationship.

[0022] This application innovatively designs a set of multi-layer matrix coordinate transformation algorithms. By establishing a mapping relationship between the VR space coordinate system, the local heart coordinate system and the physical simulation coordinate system, it realizes the precise conversion between the coordinate systems and ensures the accurate transmission of the annotation point position information.

[0023] This application has developed a set of ray-projection interactive annotation methods, in which the operator can accurately mark the location of the experimental stimulation points through intuitive ray operations in a VR environment. This method not only ensures the convenience of operation, but also improves the accuracy of annotation. A seamless data transmission mechanism from the virtual environment to the physical simulation environment is constructed, and the information of the stimulation points marked in the VR environment is automatically converted and imported into the physical simulation model, realizing the organic integration of the annotation system and the simulation system. A set of visual verification mechanisms is designed, so that the operator can pre-verify the feasibility and expected effect of the stimulation scheme through a physical simulation model before conducting actual experiments, thereby reducing experimental risks and improving experimental efficiency.

[0024] Various non-limiting implementations of the present application are described in detail below in conjunction with the accompanying drawings.

[0025] First, refer to Figure 1 , the VR-based cardiac electrophysiological simulation interaction method of the present application is described in detail. The present application provides a VR-based cardiac electrophysiological simulation interaction method, the method comprising: S1: Based on the NIFTI data of the heart, a corresponding three-dimensional data model of the heart is derived through a three-dimensional reconstruction algorithm, wherein the three-dimensional data model of the heart is in an Obj format; S2: Importing the three-dimensional heart data model into Unity, and aligning the heart model origin corresponding to the three-dimensional heart data model with the VR world origin; S3: calibrating each collision point through ray projection of the VR device, and determining the VR space coordinates of each collision point; S4: converting the VR space coordinates into stimulation point matrix coordinates corresponding to the heart model matrix; S5: Expanding the stimulus point matrix coordinates to obtain a spherical region matrix coordinate set; S6: Modify the spherical region matrix coordinate set to obtain a stimulation range dot matrix.

[0026] The VR-based cardiac electrophysiology simulation interaction method provided in this application designs a set of multi-layer matrix coordinate transformation algorithms. By establishing a mapping relationship between the VR space coordinate system, the local cardiac coordinate system and the physical simulation coordinate system, accurate conversion between the coordinate systems is achieved, ensuring the accuracy of the position information of the determined stimulation point, improving the efficiency and accuracy of the simulation, and achieving a more intuitive technical effect in the simulation process.

[0027] For VR scene construction, this application selects Unity (Unity is a real-time 3D interactive content creation and operation platform) as the basic engine; specifically: Based on the basic scene, this application will first construct the camera perspective and the operating handle component. Assign the action control script to the operating handle so that it can perform basic three-dimensional movements. Assign the ray controller to the left-hand handle component and the right-hand handle component to enable the left-hand handle component and the right-hand handle component to continuously emit rays. Assign the collision point coordinate detection script to the right-hand operating handle to realize real-time detection of ray collisions emitted by the right hand, and return the world coordinates of the collision point when pointing to the specified model.

[0028] In some embodiments, before calibrating each collision point through ray projection of the VR device, the method further includes: Constructing a camera viewing angle and an operating handle assembly, wherein the operating handle assembly includes a left-hand handle assembly and a right-hand handle assembly; Control the left-hand handle assembly and the right-hand handle assembly by a ray controller, so that the left-hand handle assembly and the right-hand handle assembly emit rays; The VR space coordinates of the collision point are detected by using the right-hand handle component, and the right-hand handle component detects ray collision in real time and returns the VR space coordinates of the corresponding collision point.

[0029] For example, before data collection, data preparation is required, including: exporting the NIFTI (Neuroimaging Informatics Technology Initiative) data of the heart into a three-dimensional data model of the heart in Obj format through existing software (such as Slicer, etc.).

[0030] Import the heart 3D data model into the Unity engine as basic data.

[0031] Exemplarily, the XYZ minimum point of the heart can be set as the origin of the heart model, and the origin of the heart model can be aligned with the origin of the VR world. For example, the origin of VR initialization is (0,0,0). This application makes the origin of the three-dimensional model coincide with the origin of the VR world to facilitate subsequent calculations.

[0032] In some embodiments, after the data preparation node, data collection is continued, and the data collection may include: Start the VR device and enter the constructed virtual world. Use the handle component to project the ray to the desired observation area, and the VR device will record the collision point corresponding to the observation area in the background. When the background program detects the writing of the collision point, it will run a multi-layer matrix transformation algorithm to obtain the stimulation point matrix coordinates corresponding to the corresponding heart model matrix, and automatically convert the stimulation point matrix coordinates into coordinate data that can be read by the simulation model.

[0033] Specifically, see Figure 2,This figure shows the whole process of data acquisition and conversion. First, the three-dimensional data model of the heart is obtained based on the NIFTI data of the heart. Then the three-dimensional data model of the heart is imported into VR, and the VR space coordinates of the collision point are determined in VR. The VR space coordinates of the collision point are converted into the stimulation point matrix coordinates corresponding to the heart model matrix. The spherical area matrix coordinate set is determined based on the stimulation point matrix coordinates, and the stimulation range dot matrix is ​​finally determined based on the spherical area matrix coordinate set.

[0034] In some embodiments, calibrating each collision point by ray projection of a VR device to determine the VR space coordinates of each collision point includes: Projecting a ray of the VR device onto an observation area of ​​the three-dimensional heart data model; Whether the ray intersects with the observation area is detected in real time. If so, collision point information corresponding to each collision point is recorded in the Log data, wherein the collision point information includes the VR space coordinates of each collision point.

[0035] In some embodiments, converting the VR space coordinates into stimulation point matrix coordinates corresponding to the heart model matrix includes: For each collision point, the relative distance of the collision point to the origin of the heart model is calculated according to the following formula: Relative distance = VR space coordinates - heart model origin coordinates; It can also be in the following form: relativePosition=worldPosition–modelOrigin; Among them, relativePosition represents the relative distance, worldPosition represents the VR space coordinates, and modelOrigin represents the origin coordinates of the heart model; Based on the relative distance, the stimulation point matrix coordinates corresponding to the heart model matrix are determined using the following formula: Stimulation point matrix coordinates = (relative distance / heart model size) * matrix size; It can also be in the following form: Index=(relativePosition / modelSize)*matrixSize; Among them, Index represents the matrix coordinates of the stimulation point, relativePosition represents the relative distance, modelSize represents the size of the heart model, and matrixSize represents the matrix size.

[0036] The heart model size represents the size of the three-dimensional data model of the heart in the VR world, and the matrix size represents the size of the matrix constructed by the NIFTI data of the heart.

[0037] Exemplarily, the VR space coordinates are (113, 116, 51), and their relative distance to the origin coordinates of the heart model (0, 0, 0) is (113, 116, 51). Assuming that the size of the heart model is 191×191×191 and the matrix size is 198×198×198, the converted stimulation point matrix coordinates are (117, 120, 53). For the values ​​after the decimal point, this application uses rounding to obtain integer calculation results.

[0038] Specifically, the matrix in VR corresponding to the three-dimensional data model of the heart in the VR world is constructed based on the relevant numerical values ​​corresponding to the matrix constructed by the NIFTI data, that is, each cell point of the actual heart can be represented as an integer coordinate in the matrix in VR.

[0039] In some embodiments, the step of expanding the stimulation point matrix coordinates to obtain a spherical region matrix coordinate set includes: The stimulation area is expanded by adding or subtracting N from the stimulation point matrix coordinates to obtain a spherical area matrix coordinate set, where N is a positive integer; in some embodiments, the value of N is a variable input by the user, such as 3; this is exemplary, and those skilled in the art can determine the value of N according to actual circumstances.

[0040] Considering that the stimulation of the heart is often performed on a spherical area rather than a precise cell point, the cell points within the range of XYZ plus or minus N of the acquired matrix coordinate index can be counted as the proposed stimulation area, where N is a variable that can be set according to actual conditions.

[0041] For the case where the stimulus point matrix coordinates in the above example are (117, 120, 53), for example, when N=3, multiple extended stimulus point matrix coordinates can be obtained, such as (115, 119, 52), (118, 121, 54), (115, 1119, 51), etc., which are not enumerated here, and any value that satisfies N is acceptable.

[0042] In some embodiments, the spherical region matrix coordinate set is modified to obtain a stimulation range dot matrix, including: Deleting the stimulation points in the spherical region matrix coordinate set that are beyond the matrix constructed by the NIFTI data of the heart, to obtain a target spherical region matrix coordinate set; Get the coordinates corresponding to the epicardial cells; The stimulation points located at the coordinates corresponding to non-epicardial cells in the target spherical region matrix coordinate set are deleted to obtain a stimulation range dot matrix.

[0043] Specifically, the NIFTI data of the heart includes segmented TXT data, which contains labels set for epicardial cells; all coordinates can be extracted using regular expressions and the coordinates can be checked.

[0044] Exemplarily, the stimulation points that exceed the matrix size boundary are first excluded, and the matrix refers to the matrix constructed by the NIFTI data of the heart. The points that do not conform to the epicardium label are searched and removed from the remaining stimulation points and the corresponding TXT data to obtain the final dot matrix of the stimulation range.

[0045] In all embodiments, the coordinates of the epicardial cells are obtained from NIFTI data of the heart.

[0046] This application uses a VR immersive environment to provide real spatial perception, which can achieve the following practical effects: 1. VR technology provides an immersive three-dimensional visual experience and real-time dynamic display of the spatial position information of the annotation points, enabling the operator to accurately grasp the three-dimensional structure and spatial position relationship of the heart.

[0047] 2. Intuitive VR gesture interaction replaces traditional mouse and keyboard operation, realizing seamless connection between the annotation system and the simulation system. The automated coordinate conversion process reduces manual operation steps, greatly improving operation efficiency, greatly shortening annotation time, and significantly simplifying the operation process.

[0048] 3. This method establishes a complete data format conversion mechanism, designs a data integrity verification process, and has anomaly detection and automatic error correction functions. The matrix conversion algorithm can ensure that the ray annotation points fall accurately on the surface of the heart model. The multi-layer matrix transformation algorithm reduces the error accumulation during the coordinate conversion process. The reliability of data transmission is improved. Ensure that the annotation information is accurately and losslessly converted to the physical simulation environment.

[0049] 4. The interactive mode conforms to the principles of ergonomics and can provide an intuitive visual interface. The operation process conforms to the usage habits, the operation learning cost is low, and new users can quickly master the system operation methods.

[0050] 5. This method adopts a mature VR hardware platform, has a reasonable software architecture design, and has a complete exception handling mechanism, which reduces maintenance costs, has high system stability, and has a low failure rate.

[0051] It should be noted that the method of one or more embodiments of the present application can be performed by a single device, such as a computer or server. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of one or more embodiments of the present application, and the multiple devices will interact with each other to complete the described method.

[0052] It should be noted that the above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0053] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present application also discloses an electronic device; Specifically, Figure 3 The hardware structure diagram of an electronic device for a VR-based cardiac electrophysiological simulation interactive method provided in this embodiment is shown, and the device may include: a processor 410, a memory 420, an input / output interface 430, a communication interface 440, and a bus 450. The processor 410, the memory 420, the input / output interface 430, and the communication interface 440 are connected to each other in communication within the device through the bus 450.

[0054] The processor 410 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application.

[0055] The memory 420 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 420 may store an operating system and other application programs. When the technical solution provided in the embodiment of the present application is implemented by software or firmware, the relevant program code is stored in the memory 420 and is called and executed by the processor 410.

[0056] The input / output interface 430 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0057] The communication interface 440 is used to connect a communication module (not shown in the figure) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired manner (for example, USB, network cable, etc.) or a wireless manner (for example, mobile network, Wi-Fi, Bluetooth, etc.).

[0058] The bus 450 includes a path that transmits information between the various components of the device (eg, the processor 410 , the memory 420 , the input / output interface 430 , and the communication interface 440 ).

[0059] It should be noted that, although the above device only shows the processor 410, the memory 420, the input / output interface 430, the communication interface 440 and the bus 450, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiment of the present application, and does not necessarily include all the components shown in the figure.

[0060] The electronic device of the above-mentioned embodiment is used to implement the corresponding VR-based cardiac electrophysiological simulation interaction method in any of the above-mentioned embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0061] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, one or more embodiments of the present application also provide a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the VR-based cardiac electrophysiological simulation interaction method as described in any of the above embodiments.

[0062] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0063] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the VR-based cardiac electrophysiological simulation interaction method as described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0064] A person skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of one or more embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0065] In addition, to simplify the description and discussion, and in order not to make one or more embodiments of the present application difficult to understand, the well-known power / ground connections to the integrated circuit (IC) chip and other components may or may not be shown in the provided figures. In addition, the device may be shown in the form of a block diagram to avoid making one or more embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which one or more embodiments of the present application will be implemented (that is, these details should be fully within the scope of understanding of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that one or more embodiments of the present application can be implemented without these specific details or with changes in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0066] Although the present application has been described in conjunction with specific embodiments of the present application, many alternatives, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the discussed embodiments.

[0067] One or more embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present application should be included in the scope of protection of the present application.

Claims

1. A VR-based cardiac electrophysiology simulation interactive method, characterized in that: The method comprises: Based on the NIFTI data of the heart, a corresponding three-dimensional data model of the heart is derived through a three-dimensional reconstruction algorithm, wherein the three-dimensional data model of the heart is in an Obj format; Importing the three-dimensional heart data model into Unity, and aligning the heart model origin corresponding to the three-dimensional heart data model with the VR world origin; Calibrate each collision point by ray projection of the VR device, and determine the VR space coordinates of each collision point; Converting the VR space coordinates into stimulation point matrix coordinates corresponding to the heart model matrix; Expanding the stimulus point matrix coordinates to obtain a spherical region matrix coordinate set; The spherical region matrix coordinate set is modified to obtain a stimulation range dot matrix.

2. The VR-based cardiac electrophysiological simulation interactive method according to claim 1, characterized in that: The calibrating each collision point by ray projection of the VR device and determining the VR space coordinates of each collision point includes: Projecting a ray of the VR device onto an observation area of ​​the three-dimensional heart data model; Whether the ray intersects with the observation area is detected in real time. If so, collision point information corresponding to each collision point is recorded in the Log data, wherein the collision point information includes the VR space coordinates of each collision point.

3. The VR-based cardiac electrophysiological simulation interactive method according to claim 2, characterized in that: Before calibrating each collision point through raycasting of the VR device, it also includes: Constructing a camera viewing angle and an operating handle assembly, wherein the operating handle assembly includes a left-hand handle assembly and a right-hand handle assembly; Control the left-hand handle assembly and the right-hand handle assembly by a ray controller, so that the left-hand handle assembly and the right-hand handle assembly emit rays; The VR space coordinates of the collision point are detected by using the right-hand handle component, and the right-hand handle component detects ray collision in real time and returns the VR space coordinates of the corresponding collision point.

4. The VR-based cardiac electrophysiological simulation interactive method according to claim 2, characterized in that: The step of converting the VR space coordinates into the stimulation point matrix coordinates corresponding to the heart model matrix includes: For each collision point, the relative distance of the collision point to the origin of the heart model is calculated according to the following formula: Relative distance = VR space coordinates - heart model origin coordinates; Based on the relative distance, the stimulation point matrix coordinates corresponding to the heart model matrix are determined using the following formula: Stimulation point matrix coordinates = (relative distance / heart model size) * matrix size; The heart model size represents the size of the three-dimensional data model of the heart in the VR world, and the matrix size represents the size of the matrix constructed by the NIFTI data of the heart.

5. The VR-based cardiac electrophysiological simulation interactive method according to claim 4, characterized in that: The step of expanding the stimulus point matrix coordinates to obtain a spherical region matrix coordinate set includes: The stimulation area is expanded by adding or subtracting N from the stimulation point matrix coordinates to obtain a spherical area matrix coordinate set, wherein N is a positive integer.

6. The VR-based cardiac electrophysiological simulation interactive method according to claim 5, characterized in that: The spherical region matrix coordinate set is modified to obtain a stimulation range dot matrix, including: Deleting the stimulation points in the spherical region matrix coordinate set that are beyond the matrix constructed by the NIFTI data of the heart, to obtain a target spherical region matrix coordinate set; Get the coordinates corresponding to the epicardial cells; The stimulation points located at the coordinates corresponding to non-epicardial cells in the target spherical region matrix coordinate set are deleted to obtain a stimulation range dot matrix.

7. The VR-based cardiac electrophysiological simulation interactive method according to claim 6, characterized in that: The coordinates of the epicardial cells were obtained from the NIFTI data of the heart.

8. The VR-based cardiac electrophysiological simulation interactive method according to claim 6, characterized in that: The value of N is a variable entered by the user.

9. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the VR-based cardiac electrophysiological simulation interaction method as described in any one of claims 1 to 8 when executing the computer program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the VR-based cardiac electrophysiological simulation interaction method as described in any one of claims 1 to 8.

Images