Voice Control Method and Device Applied to Three-Dimensional Cardiac Electrophysiology System

Abstract

The present application relates to the technical field of speech processing in three-dimensional cardiac electrophysiology in healthcare, and provides a speech control method and device applied to a three-dimensional cardiac electrophysiology system, which can reduce the communication between the operator and the technical specialist and lower the communication cost. The present application translates the speech of the operator during the operation to obtain a translation result; determines a target intraoperative operation standard instruction matching the translation result in a general instruction library; determines the model identification of the three-dimensional cardiac electrophysiology system used in the intraoperative scenario; determines a target program statement associated with the model identification among a number of program statements of the target intraoperative operation standard instruction stored in the general instruction library; and triggers the three-dimensional cardiac electrophysiology system to execute the corresponding operation based on the target program statement of the target intraoperative operation standard instruction.

Description

Technical Field

[0001] The present application relates to the technical field of speech processing in three-dimensional cardiac electrophysiology in healthcare, and particularly to a voice control method, device, three-dimensional cardiac electrophysiology voice command system, storage medium, and computer program product applied to a three-dimensional cardiac electrophysiology system. Background Art

[0002] Arrhythmia is a common type of cardiovascular disease, and electrophysiological surgery represented by catheter ablation is currently the only way to radically cure arrhythmia. Mapping and ablation are the key links in cardiac electrophysiological surgery. The three-dimensional cardiac electrophysiology system overcomes the disadvantages of the two-dimensional system that uses traditional X-ray assisted positioning, where the structure of the heart and the position of the catheter are shown on a planar image, unable to provide a clear three-dimensional picture of the heart structure for doctors, and both doctors and patients need to be exposed to X-rays for a long time. It has basically replaced the two-dimensional system.

[0003] However, the three-dimensional cardiac electrophysiology system is complex to use and requires an electrophysiology technical specialist to operate the three-dimensional cardiac electrophysiology system to assist the operator in performing tasks such as three-dimensional modeling of the heart cavity, mapping point collection, ablation point collection, pacing stimulation, atrial septal sheath imaging, catheter flushing, and ablation catheter power setting. Therefore, during cardiac electrophysiological surgery, the operator needs to frequently give instructions to the technical specialist, which has problems such as distracting the operator's attention, misunderstanding the operator's instructions, and lack of operation skills of the technical specialist, affecting the quality and efficiency of the surgery. Summary of the Invention

[0004] Based on this, it is necessary to provide a voice control method, device, three-dimensional cardiac electrophysiology voice command system, storage medium, and computer program product applied to a three-dimensional cardiac electrophysiology system for the above technical problems.

[0005] The present application provides a voice control method applied to a three-dimensional cardiac electrophysiology system, the method comprising:

[0006] Translating the intraoperative voice of the operator to obtain a translation result;

[0007] Determining a target intraoperative operation standard instruction matching the translation result in a general instruction library;

[0008] Determining the model identification of the three-dimensional cardiac electrophysiology system used in the intraoperative scenario;

[0009] Determining a target program statement associated with the model identification among several program statements of the target intraoperative operation standard instruction stored in the general instruction library;

[0010] Triggering the three-dimensional cardiac electrophysiology system to perform corresponding operations based on the target program statement of the target intraoperative operation standard instruction.

[0011] In one embodiment, before translating the surgeon's intraoperative voice, the method further includes:

[0012] Collect the sound of the intraoperative scene;

[0013] Perform timbre recognition on the sound to obtain the surgeon's intraoperative voice.

[0014] In one embodiment, performing timbre recognition on the sound to obtain the surgeon's intraoperative voice includes:

[0015] Obtain a timbre recognition model pre-trained for the surgeon;

[0016] Input the sound into the timbre recognition model to obtain the surgeon's intraoperative voice.

[0017] In one embodiment, based on the target program statement of the target intraoperative operation standard instruction, triggering the cardiac three-dimensional electrophysiology system to perform corresponding operations includes:

[0018] If the target intraoperative operation standard instruction belongs to an instruction that should carry a parameter value, and if the translation result does not include the parameter value, obtain the common parameter value of the surgeon for the target disease type;

[0019] Set the default parameter value in the target program statement to the common parameter value;

[0020] Based on the target program statement with the parameter value set, trigger the cardiac three-dimensional electrophysiology system to perform corresponding operations.

[0021] In one embodiment, obtaining the common parameter value of the surgeon for the target disease type includes:

[0022] In several instruction parameter value documents, determine the target instruction parameter value document associated with the surgeon;

[0023] Based on the target instruction parameter value document, obtain the common parameter value of the surgeon for the target disease type.

[0024] In one embodiment, the method further includes:

[0025] When a certain cardiac three-dimensional electrophysiology system is upgraded, according to the upgrade information, determine whether there is a change in the program statement of each intraoperative operation standard instruction in this cardiac three-dimensional electrophysiology system;

[0026] If there is no change in the program statement of a certain intraoperative operation standard instruction in this cardiac three-dimensional electrophysiology system, among the several program statements of this intraoperative operation standard instruction, determine the program statement associated with the pre-upgrade model identification of this cardiac three-dimensional electrophysiology system;

[0027] Associate the program statements associated with the upgraded model identifier with those of the pre-upgraded model identifier.

[0028] This application provides a voice control device for a cardiac three-dimensional electrophysiology system, and the device includes:

[0029] A voice translation module for translating the voice of the operator during the operation to obtain a translation result;

[0030] An instruction matching module for determining a target intraoperative operation standard instruction that matches the translation result in a general instruction library;

[0031] A model determination module for determining the model identifier of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario;

[0032] A statement determination module for determining a target program statement associated with the model identifier from several program statements of the target intraoperative operation standard instruction stored in the general instruction library;

[0033] A statement output module for triggering the cardiac three-dimensional electrophysiology system to perform corresponding operations based on the target program statement of the target intraoperative operation standard instruction.

[0034] This application provides a cardiac three-dimensional electrophysiology voice instruction system, including a memory and a processor, where the memory stores a computer program, and the processor executes the above method.

[0035] This application provides a computer-readable storage medium with a computer program stored thereon, and the computer program is executed by the processor to perform the above method.

[0036] This application provides a computer program product with a computer program stored thereon, and the computer program is executed by the processor to perform the above method.

[0037] The above-mentioned voice control method, device, cardiac three-dimensional electrophysiology voice instruction system, storage medium and computer program product applied to the cardiac three-dimensional electrophysiology system translate the voice of the operator during the operation to obtain a translation result; in the general instruction library, determine the target intraoperative operation standard instruction that matches the translation result, and then trigger the cardiac three-dimensional electrophysiology system to execute the corresponding operation, changing the intraoperative communication mode of the cardiac electrophysiology surgery, which can reduce the communication between the operator and the technical specialist, reduce the communication cost, is expected to improve the quality and efficiency of the cardiac electrophysiology surgery, and reduce the operation time and personnel allocation; moreover, after obtaining the target intraoperative operation standard instruction, determine the model identification of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario, and among the several program statements of the target intraoperative operation standard instruction stored in the general instruction library, determine the target program statement associated with the model identification. Since the target program statement is the program statement of the target intraoperative operation standard instruction inside the cardiac three-dimensional electrophysiology system, the cardiac three-dimensional electrophysiology system can recognize the target program statement and then execute the corresponding operation, avoiding the situation of execution failure due to unrecognizability. In addition, compared with the processing method of directly sending the target intraoperative operation standard instruction to the cardiac three-dimensional electrophysiology system, the present application sends the target program statement recognizable by the cardiac three-dimensional electrophysiology system to the cardiac three-dimensional electrophysiology system, without modifying the program code of the cardiac three-dimensional electrophysiology system and without adding the program code for recognizing the target intraoperative operation standard instruction, reducing the invasiveness to the cardiac three-dimensional electrophysiology system and providing a technical basis for the present application to be applicable to various cardiac three-dimensional electrophysiology systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0039] Figure 1 It is a schematic flowchart of a voice control method applied to a cardiac three-dimensional electrophysiology system in an embodiment;

[0040] Figure 2 It is a schematic flowchart of tone recognition in an embodiment;

[0041] Figure 3 It is a schematic flowchart of a voice control method applied to a cardiac three-dimensional electrophysiology system in another embodiment;

[0042] Figure 4 It is a structural block diagram of a voice control device applied to a cardiac three-dimensional electrophysiology system in an embodiment;

[0043] Figure 5 Internal structure diagram of a three-dimensional electrophysiological voice command system for the heart in an embodiment. Detailed implementation manners

[0044] To make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] When "embodiment" is mentioned in the present application, it means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The phrase appears in various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described in the present application may be combined with other embodiments.

[0046] The voice control method applied to the three-dimensional electrophysiological system of the heart provided by the present application can be executed by a three-dimensional electrophysiological voice command system for the heart, including the steps as Figure 1 shown:

[0047] Step S101: Translate the intraoperative voice of the operator to obtain a translation result.

[0048] During a three-dimensional electrophysiological surgery of the heart, when the operator wants to control the three-dimensional electrophysiological system of the heart to perform certain operations, corresponding voice will be emitted, and this voice can be called the intraoperative voice of the operator. After obtaining the intraoperative voice of the operator in this step, the intraoperative voice of the operator is translated to translate the intraoperative voice of the operator into text to obtain a translation result in text form.

[0049] Step S102: Determine the target intraoperative operation standard instruction that matches the translation result in the general instruction library.

[0050] The general instruction library can be pre-constructed. Specifically, the intraoperative operation instructions for the three-dimensional electrophysiological system of the heart involved in the three-dimensional electrophysiological surgery of the heart can be collected. After several intraoperative operation instructions are collected, a unified text expression of the intraoperative operation standard instruction is set for each intraoperative operation instruction, such as "start flushing the catheter", "stop flushing the catheter", "position the marking point" and "set the ablation power", etc. Store several intraoperative operation standard instructions in a database, and this database can be called the general instruction library.

[0051] After obtaining the above translation result in text form through step S102, the translation result can be matched with the intraoperative operation standard instructions stored in the general instruction library, and the intraoperative operation standard instruction that matches the translation result is called the target intraoperative operation standard instruction.

[0052] Step S103: Determine the model identification of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario.

[0053] The cardiac three-dimensional electrophysiology system used in cardiac three-dimensional electrophysiology surgery has a corresponding model identification. The cardiac three-dimensional electrophysiology voice command system can send a model request to the cardiac three-dimensional electrophysiology system, and after receiving the model request, the cardiac three-dimensional electrophysiology system feeds back its own model identification to the cardiac three-dimensional electrophysiology voice command system.

[0054] Step S104: Among several program statements of the target intraoperative operation standard instructions stored in the general instruction library, determine the target program statement associated with the model identification.

[0055] Each intraoperative operation standard instruction in the general instruction library is presented in text form, such as "Start flushing the catheter", "Stop flushing the catheter", "Locate the marking point", and "Set the ablation power", etc.

[0056] The program statements of the same intraoperative operation standard instruction vary among the internal programs of different cardiac three-dimensional electrophysiology systems. For example, in cardiac three-dimensional electrophysiology system A, the program statement for "Start flushing the catheter" is "Start flushing the catheter". After receiving this program statement, cardiac three-dimensional electrophysiology system A performs the action of flushing the catheter. Another example is that in cardiac three-dimensional electrophysiology system B, the program statement for "Start flushing the catheter" is "Flush the catheter". After receiving this program statement, cardiac three-dimensional electrophysiology system B performs the action of flushing the catheter.

[0057] Therefore, this application also collects the program statements of intraoperative operation standard instructions in various cardiac three-dimensional electrophysiology systems, obtains several program statements of the same intraoperative operation standard instruction, and can associate each intraoperative operation standard instruction with the corresponding program statement. In addition, each program statement can be associated with the model identification of the corresponding cardiac three-dimensional electrophysiology system, and after the association process is completed, it is stored in the general instruction library.

[0058] After obtaining the target intraoperative operation standard instruction, in the general instruction library, determine several program statements associated with the target intraoperative operation standard instruction; among the several program statements, determine the program statement associated with the model identification of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario, and call this program statement the target program statement.

[0059] Step S105: Based on the target program statement of the target intraoperative operation standard instruction, trigger the cardiac three-dimensional electrophysiology system to perform the corresponding operation.

[0060] After obtaining the target program statement, the target program statement can be sent to the cardiac three-dimensional electrophysiology system to perform corresponding operations, realizing functions such as three-dimensional modeling / model modification of the heart cavity, mapping point collection, catheter flushing, ablation power setting, ablation point collection, pacing stimulation, and atrial septal sheath imaging controlled by the operator's voice.

[0061] In the above voice control method applied to the cardiac three-dimensional electrophysiology system, the intraoperative voice of the operator is translated to obtain a translation result; in the general instruction library, the target intraoperative operation standard instruction matching the translation result is determined, and then the cardiac three-dimensional electrophysiology system is triggered to perform corresponding operations, changing the intraoperative communication mode of cardiac electrophysiology surgery, which can reduce the communication between the operator and the technical specialist, reduce the communication cost, is expected to improve the quality and efficiency of cardiac electrophysiology surgery, reduce the operation time and personnel allocation; and, after obtaining the target intraoperative operation standard instruction, the model identification of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario is determined, and among several program statements of the target intraoperative operation standard instruction stored in the general instruction library, the target program statement associated with the model identification is determined. Since the target program statement is the internal expression of the target intraoperative operation standard instruction in this cardiac three-dimensional electrophysiology system, the cardiac three-dimensional electrophysiology system can recognize the target program statement and then perform corresponding operations, avoiding the situation of execution failure due to unrecognizability. In addition, compared with the processing method of directly sending the target intraoperative operation standard instruction to the cardiac three-dimensional electrophysiology system, in this application, the target program statement recognizable by the cardiac three-dimensional electrophysiology system is sent to the cardiac three-dimensional electrophysiology system, without modifying the program code of the cardiac three-dimensional electrophysiology system and without adding program code for identifying the target intraoperative operation standard instruction, reducing the invasiveness to the cardiac three-dimensional electrophysiology system and providing a technical basis for this application to be applicable to various cardiac three-dimensional electrophysiology systems.

[0062] In one embodiment, before translating the intraoperative voice of the operator, the method provided in this application further includes Figure 2 The steps shown: Step S201, collecting the sound of the intraoperative scenario; Step S202, performing timbre recognition on the sound to obtain the intraoperative voice of the operator.

[0063] A microphone can be placed in the operating room, and with the help of the microphone, the sound of the intraoperative scenario of cardiac three-dimensional electrophysiology can be collected. Considering that there are multiple people in the operating room, in order to determine the voice emitted by the operator, timbre recognition can be performed on the sound, and the voice matching the timbre of the operator is used as the intraoperative voice of the operator, so as to avoid misprocessing the voices of other people.

[0064] Further, performing timbre recognition on the sound to obtain the intraoperative voice of the operator can specifically include: obtaining a timbre recognition model pre-trained for the operator; inputting the sound into the timbre recognition model to obtain the intraoperative voice of the operator.

[0065] For each operator performing a three-dimensional cardiac electrophysiological surgery, a corresponding voice recognition model can be constructed in advance for each operator; after the surgery starts, among a number of voice recognition models, the voice recognition model of the operator for the current surgery can be determined, and the sound of the intraoperative scene collected by the pickup is input into the voice recognition model, and the intraoperative voice of the operator can be obtained according to the result output by the voice recognition model.

[0066] Based on the voice recognition model pre-trained for the operator, this embodiment recognizes the intraoperative voice of the operator from the sound of the intraoperative scene, improving the recognition accuracy.

[0067] In one embodiment, based on the target program statement of the target intraoperative operation standard instruction, triggering the cardiac three-dimensional electrophysiological system to perform the corresponding operation includes: when the target intraoperative operation standard instruction belongs to an instruction that should carry a parameter value, if the translation result does not include the parameter value, obtaining the common parameter value of the operator for the target disease type; setting the default parameter value in the target program statement to the common parameter value; based on the target program statement with the parameter value set, triggering the cardiac three-dimensional electrophysiological system to perform the corresponding operation.

[0068] Exemplarily, the intraoperative operation standard instruction of "setting ablation power" belongs to an instruction that should carry a parameter value, and the specific magnitude of the ablation power should be specified.

[0069] When the target intraoperative operation standard instruction is "setting ablation power", it can first be determined whether the translation result includes the ablation power value (the ablation power value belongs to the parameter value).

[0070] If the translation result includes the ablation power value, it indicates the specific magnitude of the ablation power given by the operator. At this time, the default parameter value in the target program statement of "setting ablation power" can be set to the ablation power value carried by the translation result; for example, the target program statement of "setting ablation power" is "set Ablation power = 15W", in this target program statement, the default ablation power value (belonging to the default parameter value) is 15W, if the ablation power value carried by the transfer result is 20W, then "set Ablation power = 15W" can be changed to "set Ablation power = 20W".

[0071] If the translation result does not include the ablation power value, it indicates that the operator has not specified the specific magnitude of the ablation power. In this case, the commonly used ablation power value (which belongs to the commonly used parameter values) for the target disease type by the operator can be obtained, where the target disease type is the disease type corresponding to the current surgery, such as atrial fibrillation. Then, set the default ablation power value in the target program statement of "Set Ablation Power" to the commonly used ablation power value. For example, if the target program statement of "Set Ablation Power" is "set Ablationpower = 15W", in this target program statement, the default ablation power value is 15W. If the transfer result does not carry the ablation power value, the commonly used ablation power value of the operator for the target disease type can be determined. If the commonly used ablation power value is 25W, then "set Ablation power = 15W" can be changed to "set Ablation power = 25W".

[0072] Send the target program statement with the parameter values set to the cardiac three-dimensional electrophysiology system to trigger the cardiac three-dimensional electrophysiology system to perform the corresponding operations.

[0073] In this embodiment, when the target intraoperative operation standard instruction belongs to the instruction that should carry parameter values, in the case where the translation result does not include the parameter values, set the default parameter values in the target program statement to the commonly used parameter values of the operator for the target disease type, so as to achieve personalized control of the cardiac three-dimensional electrophysiology system.

[0074] Furthermore, obtaining the commonly used parameter values of the operator for the target disease type can specifically include: determining the target instruction parameter value document associated with the operator among several instruction parameter value documents; and obtaining the commonly used parameter values of the operator for the target disease type based on the target instruction parameter value document.

[0075] Instruction parameter value templates can be provided for each operator. Each operator can write their respective commonly used parameter values for various intraoperative operation standard instructions in the corresponding disease types in the instruction parameter value template, so as to form their respective instruction parameter value documents. Among several instruction parameter value documents, determine the instruction parameter value document associated with the current operator, and refer to this instruction parameter value document as the target instruction parameter value document. In the target instruction parameter value document, determine the commonly used parameter values of the operator for the target intraoperative operation standard instruction in the target disease type, where the target disease type is the disease type corresponding to the current surgery.

[0076] In one embodiment, the method provided by this application further includes: when a certain three-dimensional cardiac electrophysiology system is upgraded, according to the upgrade information, determining whether there are changes in the program statements of each intraoperative operation standard instruction in the three-dimensional cardiac electrophysiology system; if there are no changes in the program statements of a certain intraoperative operation standard instruction in the three-dimensional cardiac electrophysiology system, then among the several program statements of this intraoperative operation standard instruction, determining the program statements associated with the model identification before the upgrade of the three-dimensional cardiac electrophysiology system; associating the program statements associated with the model identification after the upgrade with the program statements associated with the model identification before the upgrade.

[0077] Some three-dimensional cardiac electrophysiology systems will undergo upgrade iterations. In this case, the program statements of certain intraoperative operation standard instructions in the system may change. If the upgraded three-dimensional cardiac electrophysiology system is triggered by the old program statements, the three-dimensional cardiac electrophysiology system may not be able to recognize them, resulting in the failure of the operator's voice control of the three-dimensional cardiac electrophysiology system.

[0078] Therefore, in the above-mentioned embodiment provided by this application, when a certain three-dimensional cardiac electrophysiology system is upgraded, according to the upgrade information, determining whether there are changes in the program statements of each intraoperative operation standard instruction in the three-dimensional cardiac electrophysiology system; if there are changes, then adding new program statements to the program statements of this intraoperative operation standard instruction, and associating the new program statements with the model identification after the upgrade, and storing them in the general instruction library; if there are no changes in the program statements of this intraoperative operation standard instruction in the three-dimensional cardiac electrophysiology system, then among the several program statements of this intraoperative operation standard instruction, determining the program statements associated with the model identification before the upgrade of the three-dimensional cardiac electrophysiology system; associating the program statements associated with the model identification after the upgrade with the program statements associated with the model identification before the upgrade.

[0079] To better understand the above method, the following details an application example of the voice control method of this application applied to a three-dimensional cardiac electrophysiology system. This application example includes Figure 3 the steps shown.

[0080] Step S301, collecting the sounds of the intraoperative scene;

[0081] Step S302, performing timbre recognition on the sounds to obtain the intraoperative voice of the operator;

[0082] Step S302 may specifically include: using a personalized timbre recognition model to perform timbre recognition on the sounds to obtain the intraoperative voice of the operator;

[0083] Step S303, translating the intraoperative voice of the operator to obtain a translation result;

[0084] Step S304, determining the target intraoperative operation standard instruction that matches the translation result in the general instruction library;

[0085] Step S305: Determine the target program statement among several program statements of the target intraoperative operation standard instruction.

[0086] Specifically, step S305 may include: determining the model identification of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario, and determining the target program statement associated with the model identification among several program statements of the target intraoperative operation standard instruction stored in the general instruction library.

[0087] If the target intraoperative operation standard instruction belongs to an instruction that should carry parameter values and the translation result does not include parameter values, enter step S306 to adjust the default parameter values of the target program statement.

[0088] Specifically, step S306 may include: obtaining the common parameter values of the operator for the target disease type, and setting the default parameter values in the target program statement as the common parameter values.

[0089] Step S307: Based on the target program statement with parameter values set, trigger the cardiac three-dimensional electrophysiology system to perform the corresponding operation.

[0090] In the embodiment of this application, the intraoperative voice of the operator is translated to obtain a translation result; in the general instruction library, the target intraoperative operation standard instruction matching the translation result is determined, and then the cardiac three-dimensional electrophysiology system is triggered to perform the corresponding operation, changing the intraoperative communication mode of cardiac electrophysiology surgery, which can reduce the communication between the operator and the technical specialist, reduce the communication cost, and is expected to improve the quality and efficiency of cardiac electrophysiology surgery, reduce the operation time and personnel allocation; moreover, after obtaining the target intraoperative operation standard instruction, the model identification of the cardiac three-dimensional electrophysiology system used in the intraoperative scenario is determined, and the target program statement associated with the model identification is determined among several program statements of the target intraoperative operation standard instruction stored in the general instruction library. Since this target program statement is the internal expression of the target intraoperative operation standard instruction in this cardiac three-dimensional electrophysiology system, the cardiac three-dimensional electrophysiology system can recognize this target program statement and then perform the corresponding operation, avoiding the situation of execution failure due to unrecognizability. In addition, compared with the processing method of directly sending the target intraoperative operation standard instruction to the cardiac three-dimensional electrophysiology system, this application sends the target program statement recognizable by the cardiac three-dimensional electrophysiology system to the cardiac three-dimensional electrophysiology system, without modifying the program code of the cardiac three-dimensional electrophysiology system and without adding program code for identifying the target intraoperative operation standard instruction, reducing the invasiveness to the cardiac three-dimensional electrophysiology system and providing a technical basis for this application to be applicable to various cardiac three-dimensional electrophysiology systems.

[0091] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown in the direction of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0092] Based on the same inventive concept, an embodiment of the present application further provides a voice control device for a cardiac three-dimensional electrophysiological system, which is used to implement the above-mentioned voice control method applied to a cardiac three-dimensional electrophysiological system. The implementation solutions provided by this device to solve problems are similar to the implementation solutions described in the above method. Therefore, the specific limitations in one or more embodiments of the voice control device for a cardiac three-dimensional electrophysiological system provided below can refer to the limitations on the voice control method applied to a cardiac three-dimensional electrophysiological system in the above text, and will not be repeated here.

[0093] In one embodiment, as Figure 4 shown, a voice control device for a cardiac three-dimensional electrophysiological system is provided, including:

[0094] A voice translation module 401, configured to translate the voice of the operator during the operation to obtain a translation result;

[0095] An instruction matching module 402, configured to determine a target intraoperative operation standard instruction that matches the translation result in a general instruction library;

[0096] A model determination module 403, configured to determine the model identifier of the cardiac three-dimensional electrophysiological system used in the intraoperative scenario;

[0097] A statement determination module 404, configured to determine a target program statement associated with the model identifier from several program statements of the target intraoperative operation standard instruction stored in the general instruction library;

[0098] A statement output module 405, configured to trigger the cardiac three-dimensional electrophysiological system to execute corresponding operations based on the target program statement of the target intraoperative operation standard instruction.

[0099] In one embodiment, the device further includes a sound acquisition module and a timbre recognition module; the sound acquisition module is used to acquire the sound of the intraoperative scene; the timbre recognition module is used to perform timbre recognition on the sound to obtain the intraoperative voice of the surgeon.

[0100] In one embodiment, the timbre recognition module is further used to: obtain a timbre recognition model pre-trained for the surgeon; input the sound into the timbre recognition model to obtain the intraoperative voice of the surgeon.

[0101] In one embodiment, the statement output module 405 is further used to: if the target intraoperative operation standard instruction belongs to an instruction that should carry a parameter value, and if the translation result does not include the parameter value, obtain the common parameter value of the surgeon for the target disease type; set the default parameter value in the target program statement to the common parameter value; based on the target program statement with the parameter value set, trigger the cardiac three-dimensional electrophysiological system to perform the corresponding operation.

[0102] In one embodiment, the statement output module 405 is further used to: determine the target instruction parameter value document associated with the surgeon from several instruction parameter value documents; obtain the common parameter value of the surgeon for the target disease type based on the target instruction parameter value document.

[0103] In one embodiment, the device further includes an association processing module, which is used to: when a certain cardiac three-dimensional electrophysiological system is upgraded, according to the upgrade information, judge whether there is a change in the program statement of each intraoperative operation standard instruction in this cardiac three-dimensional electrophysiological system; if the program statement of a certain intraoperative operation standard instruction does not change in this cardiac three-dimensional electrophysiological system, then among the several program statements of this intraoperative operation standard instruction, determine the program statement associated with the pre-upgrade model identifier of this cardiac three-dimensional electrophysiological system; associate the post-upgrade model identifier with the program statement associated with the pre-upgrade model identifier.

[0104] Each module in the above voice control device applied to the cardiac three-dimensional electrophysiological system can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the cardiac three-dimensional electrophysiological voice instruction system in hardware form or be independent of it, or can be stored in the memory of the cardiac three-dimensional electrophysiological voice instruction system in software form, so as to facilitate the processor to call and execute the operations corresponding to the above each module.

[0105] In an exemplary embodiment, a cardiac three-dimensional electrophysiological voice instruction system is provided, and its internal structure diagram can be as Figure 5As shown in the figure. The three-dimensional electrophysiological voice command system for the heart includes a processor, a memory, an input / output interface (Input / Output, abbreviated as I / O), and a communication interface. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the three-dimensional electrophysiological voice command system for the heart is used to provide computing and control capabilities. The memory of the three-dimensional electrophysiological voice command system for the heart includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the three-dimensional electrophysiological voice command system for the heart is used to store the data involved in the above method. The input / output interface of the three-dimensional electrophysiological voice command system for the heart is used to exchange information between the processor and external devices. The communication interface of the three-dimensional electrophysiological voice command system for the heart is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it realizes a voice control method applied to a three-dimensional electrophysiological system for the heart.

[0106] Those skilled in the art can understand that Figure 5 the structure shown in the figure is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the three-dimensional electrophysiological voice command system for the heart to which the solution of the present application is applied. The specific three-dimensional electrophysiological voice command system for the heart may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0107] In one embodiment, a three-dimensional electrophysiological voice command system for the heart is provided, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it realizes the steps in each of the above method embodiments.

[0108] Among them, the three-dimensional electrophysiological voice command system for the heart may be provided with a unified port to adapt to different three-dimensional electrophysiological systems for the heart.

[0109] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by the processor, it realizes the steps in each of the above method embodiments.

[0110] In one embodiment, a computer program product is provided, on which a computer program is stored, and the computer program executes the steps in each of the above method embodiments by the processor.

[0111] Those of ordinary skill in the art can understand that all or part of the processes in the above-described embodiment methods can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the above-described method embodiments. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.

[0112] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0113] The above-described embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A cardiac three-dimensional electrophysiological voice command system, characterized in that: The cardiac three-dimensional electrophysiological voice instruction system performs the following steps: Translate the operator's speech during the operation and obtain the translation result; Determining, in a general instruction library, a target intraoperative standard instruction that matches the translation result; Sending a model acquisition request to the cardiac three-dimensional electrophysiological system used in the intraoperative scene to obtain the model identification of the cardiac three-dimensional electrophysiological system fed back by the system; Determine a target program statement associated with the model identifier among a plurality of program statements of the target intraoperative standard instructions stored in the general instruction library; Based on the target program statement of the target intraoperative operation standard instruction, the cardiac three-dimensional electrophysiology system is triggered to perform a corresponding operation, including: if the target intraoperative operation standard instruction is an instruction that should carry a parameter value, if the translation result does not include a parameter value, then in a number of instruction parameter value documents, a target instruction parameter value document associated with the operator is determined; based on the target instruction parameter value document, the operator's commonly used parameter values ​​for the target disease type are obtained; the default parameter values ​​in the target program statement are set to the commonly used parameter values; based on the target program statement after the parameter values ​​are set, the cardiac three-dimensional electrophysiology system is triggered to perform a corresponding operation; the instruction parameter value document is formed by the operator writing his own commonly used parameter values ​​for various intraoperative operation standard instructions for corresponding disease types in the instruction parameter value template.

2. The system according to claim 1, characterized in that Before translating the operator's voice during the operation, the cardiac three-dimensional electrophysiological voice instruction system further performs the following steps: Collect the sounds of the intraoperative scenes; The sound is subjected to timbre recognition to obtain the operator's voice during the operation.

3. The system according to claim 2, characterized in that Collect sounds of intraoperative scenes, including: The sound of the intraoperative scene is collected through the microphone placed in the operating room.

4. The system according to claim 2, characterized in that Performing timbre recognition on the sound to obtain the operator's voice during the operation includes: Obtain a pre-trained timbre recognition model for the operator; The sound is input into the timbre recognition model to obtain the operator's voice during the operation.

5. The system according to any one of claims 1 to 4, characterized in that: The cardiac three-dimensional electrophysiological voice instruction system further performs the following steps: When a certain cardiac three-dimensional electrophysiological system is upgraded, judging whether there is a change in the program statement of each intraoperative standard operation instruction in the cardiac three-dimensional electrophysiological system according to the upgrade information; If there is no change in the program statement of a certain intraoperative operation standard instruction in the cardiac three-dimensional electrophysiology system, then determining the program statement associated with the model identification of the cardiac three-dimensional electrophysiology system before the upgrade from among the several program statements of the intraoperative operation standard instruction; The program statements associated with the model identifier after the upgrade and the model identifier before the upgrade are associated.

6. A voice control device applied to a cardiac three-dimensional electrophysiological system, characterized in that: Applicable to a cardiac three-dimensional electrophysiological voice command system, the device comprises: The speech translation module is used to translate the operator's speech during the operation and obtain the translation result; An instruction matching module, used to determine, in a general instruction library, a target intraoperative standard instruction that matches the translation result; A model determination module is used to send a model acquisition request to the cardiac three-dimensional electrophysiological system used in the intraoperative scene to obtain the model identification of the cardiac three-dimensional electrophysiological system fed back by the system; A statement determination module, used to determine a target program statement associated with the model identifier among a plurality of program statements of the target intraoperative operation standard instructions stored in the general instruction library; A statement output module is used to trigger the cardiac three-dimensional electrophysiology system to perform a corresponding operation based on a target program statement of the target intraoperative operation standard instruction, including: if the target intraoperative operation standard instruction is an instruction that should carry a parameter value, if the translation result does not include a parameter value, then determine a target instruction parameter value document associated with the operator in a number of instruction parameter value documents; based on the target instruction parameter value document, obtain the operator's commonly used parameter value for the target disease type; set the default parameter value in the target program statement to the commonly used parameter value; based on the target program statement with the parameter value set, trigger the cardiac three-dimensional electrophysiology system to perform a corresponding operation; the instruction parameter value document is formed by the operator writing his own commonly used parameter values ​​for various intraoperative operation standard instructions in the corresponding disease type in the instruction parameter value template.

7. The device according to claim 6, characterized in that The device also includes: Sound collection module, used to collect sounds during surgery; The timbre recognition module is used to perform timbre recognition on the sound to obtain the operator's voice during the operation.

8. The device according to claim 7, characterized in that The sound collection module is also used for: The sound of the intraoperative scene is collected through the microphone placed in the operating room.

9. The device according to claim 7, characterized in that The timbre recognition module is also used for: A timbre recognition model pre-trained for the operator is obtained; the sound is input into the timbre recognition model to obtain the operator's intraoperative speech.

10. The device according to any one of claims 6 to 9, characterized in that The device also includes an association processing module, which is used to: When a certain cardiac three-dimensional electrophysiological system is upgraded, judging whether there is a change in the program statement of each intraoperative standard operation instruction in the cardiac three-dimensional electrophysiological system according to the upgrade information; If there is no change in the program statement of a certain intraoperative operation standard instruction in the cardiac three-dimensional electrophysiology system, then determining the program statement associated with the model identification of the cardiac three-dimensional electrophysiology system before the upgrade from among the several program statements of the intraoperative operation standard instruction; The program statements associated with the model identifier after the upgrade and the model identifier before the upgrade are associated.

Images