Voice-assisted remote medical equipment control method, device and system

Abstract

The invention provides a control method, device and system for voice-assisted remote medical equipment, and the method comprises the steps: carrying out the semantic recognition of a voice control instruction in response to a received voice control instruction, and obtaining a corresponding semantic text; a text data set is searched for target text data corresponding to the semantic text, and one piece of text data corresponds to one operation instruction; and querying an operation instruction corresponding to the target text data from the text data set, and sending the operation instruction to an execution end, so that the execution end executes a corresponding operation according to the operation instruction. Compared with the prior art, the control end assists the remote execution of the execution end through the voice control instruction, the steps of controlling the execution end can be simplified, and the overall inspection efficiency is improved.

Description

Control method, device and system for voice-assisted telemedicine equipment Technical Field

[0001] The present disclosure relates to the field of intelligent voice technology, and in particular to a control method, device, and system for voice-assisted telemedicine equipment. Background Art

[0002] Telemedicine refers to the integration of communication, multimedia, and internet technologies with medical technologies to provide medical services across space, meeting the healthcare needs of the general public while accelerating diagnosis and treatment, reducing costs, and improving treatment quality. Teleultrasound technology is supported by three key technologies: telecommunications, informatics, and ultrasound medicine. Traditional teleultrasound technology involves setting up a consultation terminal and a remote terminal, transmitting images from the remote terminal to the consultation terminal via a network. Consulting experts then provide diagnosis and decision-making analysis based on the uploaded images.

[0003] The advent of 5G technology has spurred rapid development in remote ultrasound robots. These robots consist of a doctor-side and a patient-side connected via a 5G network. The patient-side, located at the patient's location, serves as the execution end. The robot's end, equipped with an ultrasound probe, scans specific areas of the patient. The doctor-side, located at the specialist's location, serves as the control end. The specialist controls the robot to scan the patient, while the doctor's end reads the ultrasound image and makes a diagnosis. These robots integrate advanced internet information transmission and security encryption technologies, high-precision master-slave control of the robotic arm, user-friendly human-machine interaction, and comprehensive ultrasonic medical diagnostic technology. These technologies enable doctors to remotely control the robotic arm, perform ultrasound scans, and provide diagnoses in real time, enabling remote consultations with patients.

[0004] However, in related technologies, remote ultrasound robots rely on manual remote control by doctors, such as through touchscreen control or operation of ultrasound keyboards and contour probes. This manual control by doctors results in low examination efficiency when performing remote ultrasound robot examinations.

[0005] Summary of the Invention

[0006] The present disclosure provides a method, device, and system for controlling voice-assisted remote medical equipment, the main purpose of which is to solve the problem that manual control by doctors leads to low inspection efficiency during remote medical equipment inspections.

[0007] According to a first aspect of the present disclosure, a method for controlling a voice-assisted telemedicine device is provided, wherein the method is applied to a control terminal and includes:

[0008] In response to the received voice control instruction, performing semantic recognition on the voice control instruction to obtain corresponding semantic text;

[0009] Searching for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction;

[0010] An operation instruction corresponding to the target text data is searched from the text data set, and the operation instruction is sent to an execution end so that the execution end performs a corresponding operation according to the operation instruction.

[0011] Optionally, the querying of the target text data set for an operation instruction corresponding to the target text data includes:

[0012] Determining the category to which the target text data belongs, wherein the text data set includes at least one of text data of a control category and text data of a prompt category;

[0013] According to the result of the determination of the category to which the target text data belongs, the text data set is searched for an operation instruction of a control category or an operation instruction of a prompt category corresponding to the target text data.

[0014] Optionally, before searching the text data set for target text data corresponding to the semantic text, the method further includes:

[0015] Customizing the operation instructions and voice files corresponding to the text data of the control category; wherein the voice files are used to be sent to the execution end synchronously with the operation instructions, so that the execution end performs voice broadcast according to the voice files;

[0016] Customize the operation instructions and voice files corresponding to the text data of the prompt category;

[0017] Allocate unique identification information to each custom configured text data of the control category and the prompt category;

[0018] A mapping relationship is constructed between the identification information, the operation instruction, and the voice file.

[0019] Optionally, a method for controlling a voice-assisted telemedicine device, wherein the method is applied to a control terminal, further comprising:

[0020] When it is determined that the category to which the target text data belongs is the control category, performing abnormality judgment on the content of the semantic text according to a preset abnormality strategy;

[0021] If it is determined that the content of the semantic text is abnormal, a prompt message indicating the abnormality is output and the sending of the operation instruction is terminated.

[0022] Optionally, after sending the operation instruction to the execution end, the following steps are included:

[0023] Receive a normal / abnormal execution result corresponding to the operation instruction sent by the execution end.

[0024] Optionally, performing semantic recognition on the voice control instruction to obtain a corresponding semantic text includes:

[0025] Recognizing the voice control instruction as corresponding voice text;

[0026] Perform semantic recognition on the speech text to obtain the corresponding semantic text.

[0027] According to a second aspect of the present disclosure, a method for controlling a voice-assisted telemedicine device is provided, wherein the method is applied to an execution end and includes:

[0028] Receive an operation instruction sent by a control terminal, wherein the operation instruction is a response of the control terminal to a received voice control instruction, perform semantic recognition on the voice control instruction, and obtain a corresponding semantic text; search for target text data corresponding to the semantic text from a text data set; search the text data set for an operation instruction corresponding to the target text data, and send the operation instruction corresponding to the target text data to an execution terminal;

[0029] Execute the operation instruction.

[0030] Optionally, executing the operation instruction includes:

[0031] Parsing the operation instruction to determine the category to which the operation instruction belongs, wherein the operation instruction includes an operation instruction of a control category or an operation instruction of a prompt category;

[0032] When confirming that the operation instruction belongs to the control category, executing the operation instruction to complete the corresponding instruction action;

[0033] When it is confirmed that the operation instruction belongs to the prompt category, a first voice file corresponding to the operation instruction of the prompt category is obtained, and voice broadcast is performed according to the first voice file, wherein the control end synchronously sends the voice file and the operation instruction.

[0034] Optionally, executing the operation instruction when confirming that the operation instruction belongs to the control category includes:

[0035] Obtain a second voice file corresponding to the operation instruction of the control category, perform voice broadcast according to the second voice file; and execute the operation instruction.

[0036] Optionally, before executing the operation instruction, the method further includes:

[0037] Performing abnormality judgment on the operation instruction according to a preset abnormality strategy;

[0038] If it is determined that the operation instruction is abnormal, a prompt message indicating that the operation instruction is abnormal is sent to the control terminal.

[0039] Optionally, after executing the operation instruction, the method further includes:

[0040] Sending the normal / abnormal execution result corresponding to the operation instruction to the control end.

[0041] According to a third aspect of the present disclosure, a control device for a voice-assisted telemedicine device is provided, wherein the device is applied to a control terminal and includes:

[0042] a recognition unit, configured to perform semantic recognition on the received voice control instruction in response to the received voice control instruction to obtain a corresponding semantic text;

[0043] A first search unit is used to search for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction;

[0044] A second search unit, configured to search the text data set for an operation instruction corresponding to the target text data;

[0045] The sending unit is used to send the operation instruction to the execution end, so that the execution end performs the corresponding operation according to the operation instruction.

[0046] Optionally, the second searching unit further includes:

[0047] a determination module, configured to determine the category to which the target text data belongs, wherein the text data set includes at least one of text data of a control category and text data of a prompt category;

[0048] The query module is used to query the text data set for the control category operation instruction or prompt category operation instruction corresponding to the target text data according to the determination result of the category to which the target text data belongs.

[0049] Optionally, the device further includes:

[0050] a first configuration unit configured to customize the operation instructions and voice files corresponding to the text data of the control category before the first search unit searches for target text data corresponding to the semantic text from the text data set; wherein the voice files are sent to the execution end synchronously with the operation instructions so that the execution end performs voice broadcasting according to the voice files;

[0051] A second configuration unit is used to customize the operation instructions and voice files corresponding to the text data of the prompt category;

[0052] an allocating unit, configured to allocate unique identification information to each of the text data of the control category and the text data of the prompt category after the custom configuration;

[0053] A construction unit is used to construct a mapping relationship between the identification information and the operation instruction and the voice file respectively.

[0054] Optionally, the device further includes:

[0055] a judgment unit configured to, when determining that the category of the target text data is the control category, perform an abnormality judgment on the content of the semantic text according to a preset abnormality strategy;

[0056] an output unit, configured to output a prompt message indicating the presence of an anomaly if it is determined that the content of the semantic text is anomaly;

[0057] The terminating unit is configured to terminate the sending of the operation instruction if it is determined that the content of the semantic text is abnormal.

[0058] Optionally, the device further includes:

[0059] The receiving unit is configured to receive a normal / abnormal execution result corresponding to the operation instruction sent by the execution end after the sending unit sends the operation instruction to the execution end.

[0060] Optionally, the identification unit further includes:

[0061] A first recognition module, configured to recognize the voice control instruction as corresponding voice text;

[0062] The second recognition module is used to perform semantic recognition on the speech text to obtain the corresponding semantic text.

[0063] According to a fourth aspect of the present disclosure, a control device for a voice-assisted telemedicine device is provided, wherein the device is applied to an execution end and includes:

[0064] A receiving unit is configured to receive an operation instruction sent by a control terminal, wherein the operation instruction is a response of the control terminal to a received voice control instruction, perform semantic recognition on the voice control instruction, and obtain a corresponding semantic text; search for target text data corresponding to the semantic text from a text data set; search the text data set for an operation instruction corresponding to the target text data, and send the operation instruction corresponding to the target text data to an execution terminal;

[0065] An execution unit is used to execute the operation instruction.

[0066] Optionally, the execution unit includes:

[0067] a parsing module, configured to parse the operation instruction and determine the category to which the operation instruction belongs, wherein the operation instruction includes an operation instruction of a control category or an operation instruction of a prompt category;

[0068] an execution module, configured to execute the operation instruction to complete a corresponding instruction action when confirming that the operation instruction belongs to the control category;

[0069] A first acquisition module is configured to, when confirming that the operation instruction belongs to the prompt category, acquire a first voice file corresponding to the operation instruction of the prompt category;

[0070] The first playing module is used to perform voice broadcast according to the first voice file.

[0071] Optionally, the execution unit further includes:

[0072] A second acquisition module is used to acquire a second voice file corresponding to the operation instruction of the control category;

[0073] The second playing module performs voice broadcasting according to the second voice file.

[0074] Optionally, the device further includes:

[0075] a judgment unit, configured to perform an abnormality judgment on the operation instruction according to a preset abnormality strategy before the execution unit executes the operation instruction;

[0076] The first sending unit is configured to send a prompt message indicating that the operation instruction is abnormal to the control terminal when it is determined that the operation instruction is abnormal.

[0077] Optionally, the device further includes:

[0078] The second sending unit is used to send a normal / abnormal execution result corresponding to the operation instruction to the control end after the execution unit executes the operation instruction.

[0079] According to the fifth aspect of the present disclosure, a control system for a voice-assisted telemedical device is provided, wherein the system includes a control device for the voice-assisted telemedical device as described in the third aspect of the present disclosure, and an execution device for the voice-assisted telemedical device as described in the fourth aspect of the present disclosure.

[0080] According to a sixth aspect of the present disclosure, there is provided an electronic device, including:

[0081] at least one processor; and

[0082] a memory communicatively connected to the at least one processor; wherein,

[0083] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the first aspect or the method described in the second aspect.

[0084] According to a seventh aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the first aspect or the method described in the second aspect.

[0085] According to an eighth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the computer program implements the method described in the first aspect or the method described in the second aspect.

[0086] The present disclosure provides a control method, device, and system for voice-assisted telemedicine equipment. In response to a received voice control instruction, the control method performs semantic recognition on the voice control instruction to obtain a corresponding semantic text; searches for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; queries the text data set for the operation instruction corresponding to the target text data, and sends the operation instruction to the execution end so that the execution end performs the corresponding operation according to the operation instruction. Compared with related technologies, the control end assists the execution end in remote execution through voice control instructions, which can simplify the steps of operating the execution end and thereby improve the overall inspection efficiency.

[0087] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0088] The accompanying drawings are provided to facilitate a better understanding of the present invention and do not constitute a limitation of the present disclosure.

[0089] FIG1 is a flow chart of a method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure;

[0090] FIG2 is a flow chart of another method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure;

[0091] FIG3 is a flow chart of another method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure;

[0092] FIG4 is a flow chart of another method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure;

[0093] FIG5 is a schematic diagram of a custom configuration in a voice control instruction interface provided by an embodiment of the present disclosure;

[0094] FIG6 is a flow chart of another method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure;

[0095] FIG7 is a flow chart of another method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure;

[0096] FIG8 is a flow chart of a control system of a voice-assisted telemedicine device provided by an embodiment of the present disclosure;

[0097] FIG9 is a schematic structural diagram of a control device for voice-assisted telemedicine equipment provided by an embodiment of the present disclosure;

[0098] FIG10 is a schematic structural diagram of another control device for voice-assisted telemedicine equipment provided by an embodiment of the present disclosure;

[0099] FIG11 is a schematic structural diagram of another control device for voice-assisted telemedicine equipment provided by an embodiment of the present disclosure;

[0100] FIG12 is a schematic structural diagram of another control device for voice-assisted telemedicine equipment provided by an embodiment of the present disclosure;

[0101] FIG13 is a block diagram of a control system of a voice-assisted telemedicine device provided by an embodiment of the present disclosure;

[0102] FIG14 is a schematic block diagram of an exemplary electronic device 1400 provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0103] The following description of exemplary embodiments of the present disclosure is made in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding. These details should be considered as merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0104] The following describes the control method, device, and system of the voice-assisted telemedicine device according to the embodiments of the present disclosure with reference to the accompanying drawings.

[0105] FIG1 is a flow chart of a method for controlling a voice-assisted telemedicine device according to an embodiment of the present disclosure, wherein the method is applied to a control terminal.

[0106] As shown in Figure 1, the method includes the following steps:

[0107] Step 101: In response to a received voice control instruction, semantic recognition is performed on the voice control instruction to obtain a corresponding semantic text.

[0108] The embodiments of the present disclosure can be applied to the process in which a doctor's control end remotely controls an ultrasonic robot or other types of execution ends, wherein the control end is the doctor's end of the remote ultrasonic robot and the execution end is the patient's end of the remote ultrasonic robot.

[0109] After receiving the voice control instruction at the control end, it first recognizes the voice control instruction as voice text, with the purpose of converting the voice into voice text that can be recognized by the machine side, and then recognizes the voice text as semantic text. The semantic text described in the embodiment of the present disclosure may include but is not limited to at least one of the text of the control category, the text of the prompt category and the custom-entered text.

[0110] For the specific algorithms of speech recognition and semantic recognition, please refer to any algorithm in the relevant technology, so they will not be described in detail here.

[0111] Step 102: searching for target text data corresponding to the semantic text from the text data set, wherein one text data corresponds to one operation instruction.

[0112] In the embodiment of the present disclosure, the text data set records the mapping relationship between the text data of the control category, the text data of the prompt category and the custom-entered text and the operation instructions respectively, and the text data and the operation instructions correspond one to one.

[0113] After the semantic text is identified in step 101, the target text data corresponding to the semantic text is searched in the text data set. That is, the text data with the same semantics as the semantic text is searched in the text data set. As one possible implementation of the present embodiment, the corresponding target text data can be searched sequentially. As another possible implementation of the present embodiment, the corresponding target text data can be searched using a keyword search. Specifically, the present embodiment does not limit this.

[0114] Optionally, in order to facilitate the management of the text data set, unique identification information (Identity document, ID) may be allocated to each text data in the text data set.

[0115] To facilitate a better understanding of the text data set, in an embodiment of the present disclosure, the operation instructions corresponding to the text data of the control category are control instructions preset by the control end software, wherein the control category text data is exemplarily given as follows:

[0116] Please shut down (ID: 10001)

[0117] Please restart (ID: 10002)

[0118] Please increase the strength of the robotic arm (ID: 10003)

[0119] Please reduce the strength of the robot arm (ID: 10004)

[0120] Please start the robotic arm (ID: 10005)

[0121] Please pause the robot arm (ID: 10006)

[0122] Please reset the robot arm (ID: 10007)

[0123] Please restart the robot arm (ID: 10008)

[0124] Please close the robot arm (ID: 10009)

[0125] Please keep your current location unchanged (ID: 10010)

[0126] Please maintain your current posture (ID: 10011)

[0127] Please return to zero (ID: 10012)

[0128] Please execute the package (ID: 10013)

[0129] Please rotate N degrees (1 <= N <= 360) (ID: 10014)

[0130] Please move up N centimeters (1<=N<=100) (ID: 10015)

[0131] Please move down N centimeters (1<=N<=100) (ID: 10016)

[0132] Please move left N centimeters (1 <= N <= 100) (ID: 10017)

[0133] Please move right N centimeters (1 <= N <= 100) (ID: 10018)

[0134] Emergency stop (ID: 10019)

[0135] Stop, stop, stop (ID: 10020)

[0136] Please jump to the main interface (ID: 10021)

[0137] Please jump to the report editing interface (ID: 10022)

[0138] Please jump to the settings interface (ID: 10023)

[0139] Please jump to the checklist interface (ID: 10024)

[0140] Please start checking (ID: 10025)

[0141] Please suspend inspection (ID: 10026)

[0142] Please end the inspection (ID: 10027)

[0143] …

[0144] The above description is merely an example, and the specific embodiments of the present disclosure are not limited thereto.

[0145] In the embodiment of the present disclosure, the operation instruction corresponding to the text data of the prompt category is a preset guiding inspection term or input text data, wherein exemplary text data of the prompt category is:

[0146] Please breathe in (ID: 20001)

[0147] Please Relax (ID: 20002)

[0148] Please take a deep breath and hold it (ID: 20003)

[0149] Please puff up your belly and hold it for three seconds (ID: 20004)

[0150] Please turn to the left (ID: 20005)

[0151] Please turn right (ID: 20006)

[0152] Please Lie Up (ID: 20007)

[0153] Please move down (ID: 20008)

[0154] Please turn your head to the left (ID: 20009)

[0155] Please turn your head to the right (ID: 20010)

[0156] Please pull up your clothes slightly (ID: 20011)

[0157] Please pull your pants down a little bit (ID: 20012)

[0158] Please put your hands on your head (ID: 20013)

[0159] Please raise your hands above your head (ID: 20014)

[0160] Please put your hands on your head (ID: 20015)

[0161] Please look up (ID: 20016)

[0162] Please pull up your clothes to expose your armpits (ID: 20017)

[0163] Does it hurt here? (ID: 20018)

[0164] Do you feel any lumps here? (ID: 20019)

[0165] …

[0166] The above are just some examples, and the specific embodiments of the present disclosure are not limited thereto.

[0167] Step 103 : searching the text data set for an operation instruction corresponding to the target text data, and sending the operation instruction to an execution end so that the execution end performs a corresponding operation according to the operation instruction.

[0168] After the target text data is matched in the text data set, the operation instruction corresponding to the target text data is obtained, and the operation instruction is used for the remote tutoring execution terminal (such as an ultrasonic robot) to perform the corresponding operation action.

[0169] After determining that a communication connection is established between the control end and the execution end, the acquired operation instructions are sent to the execution end based on the communication connection, and the execution end performs the corresponding operation according to the operation instructions. The communication connection method includes but is not limited to wired connection, wireless connection, connection through a base station, etc.

[0170] The present disclosure provides a method for controlling a voice-assisted telemedicine device. In response to a received voice control instruction, the method performs semantic recognition on the voice control instruction to obtain a corresponding semantic text; searches for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; queries the text data set for the operation instruction corresponding to the target text data, and sends the operation instruction to an execution terminal so that the execution terminal performs the corresponding operation according to the operation instruction. Compared with related technologies, the control terminal assists the execution terminal in remote execution through voice control instructions, which can simplify the steps of operating the execution terminal and thereby improve overall inspection efficiency.

[0171] FIG2 is a flow chart of a method for controlling a voice-assisted telemedicine device provided by an embodiment of the present disclosure, wherein the method is applied to an execution end.

[0172] As shown in FIG2 , the method includes the following steps:

[0173] Step 201: The execution end receives an operation instruction sent by the control end.

[0174] Among them, the operation instruction is that the control end responds to the received voice control instruction, performs semantic recognition on the voice control instruction, and obtains the corresponding semantic text; searches for target text data corresponding to the semantic text from the text data set; queries the operation instruction corresponding to the target text data from the text data set, and sends the operation instruction corresponding to the target text data to the execution end.

[0175] After determining that the control end and the execution end have established a communication connection, the operation instruction sent by the control end based on the established communication connection is received. For relevant operation instructions, please refer to the relevant detailed description in Figure 1, so they will not be described one by one here.

[0176] Step 202: The execution end executes the operation instruction.

[0177] As a refinement of the above-mentioned step 202, when the execution end executes the operation instruction, the method can also adopt but is not limited to the following implementation method: parsing the operation instruction and confirming the category to which the operation instruction belongs, wherein the operation instruction includes an operation instruction of the control category or an operation instruction of the prompt category; when it is confirmed that the operation instruction belongs to the control category, executing the operation instruction to complete the corresponding instruction action, and the execution end needs to perform an action when executing the control instruction; when it is confirmed that the operation instruction belongs to the prompt category, obtaining the first voice file corresponding to the operation instruction of the prompt category, and performing voice broadcast according to the first voice file, wherein the control end synchronously sends the voice file and the operation instruction.

[0178] In one possible implementation of the disclosed embodiment, upon confirming that the operation instruction belongs to the control category, executing the operation instruction further includes obtaining a second voice file corresponding to the operation instruction of the control category, performing voice broadcasting according to the second voice file, and executing the operation instruction. When the execution end executes the action corresponding to the control category operation instruction, the execution end broadcasts the currently executed action using the second voice file corresponding to the control category operation instruction.

[0179] The present disclosure provides a method for controlling a voice-assisted telemedicine device. In response to a received voice control instruction, the method performs semantic recognition on the voice control instruction to obtain a corresponding semantic text; searches for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; queries the text data set for the operation instruction corresponding to the target text data, and sends the operation instruction to an execution terminal so that the execution terminal performs the corresponding operation according to the operation instruction. Compared with related technologies, the control terminal assists the execution terminal in remote execution through voice control instructions, which can simplify the steps of operating the execution terminal and thereby improve overall inspection efficiency.

[0180] In one possible implementation of the embodiment of the present disclosure, it can be seen from the above embodiment that the text data set includes text data of the control category and text data of the prompt category. There are differences in the operation instructions corresponding to the text data of different categories. The operation instructions corresponding to the text data of the control category are instructions that need to be executed by the execution end, while the operation instructions corresponding to the text data of the prompt category are instructions that need to be voice broadcast by the execution end. Therefore, the embodiment of the present disclosure provides a method for querying the operation instructions corresponding to the target text data from the text data set, as shown in Figure 3, including:

[0181] Step 301: Determine the category to which the target text data belongs.

[0182] The text data set includes at least one of text data of the control category and text data of the prompt category, and the category of the target text data is determined to be text data of the control category or text data of the prompt category according to the semantic recognition result.

[0183] Step 302 : Based on the result of determining the category of the target text data, query the text data set for an operation instruction of a control category or an operation instruction of a prompt category corresponding to the target text data.

[0184] When the target text data is text data of the control category, the corresponding control category operation instructions are queried from the text data set; when the target text data is text data of the prompt category, the corresponding prompt category operation instructions are queried from the text data set.

[0185] In one possible implementation of the embodiment of the present disclosure, the execution of the execution end depends on the operation instructions in the text data set. When the operation instructions in the text data set are not customized, the control end cannot query the corresponding operation instructions through voice control instructions, thereby making it impossible for the control end to assist the execution end in remotely executing actions through voice control instructions. Therefore, before searching the text data set for the target text data corresponding to the semantic text, the text data set needs to be customized. The customization process of the text data set is shown in FIG4 and includes:

[0186] Step 401 : Customize the operation instructions and voice files corresponding to the text data of the control category.

[0187] The voice file is used to be sent to the execution end synchronously with the operation instruction, so that the execution end performs voice broadcast according to the voice file.

[0188] It should be noted here that the operation instructions and voice files corresponding to the text data of the custom configuration control category refer to custom configuration of the voice control instructions of the control instructions preset by the control end software, and generation of the voice files of the voice control instructions.

[0189] In order to facilitate a better understanding of the customized configuration of operation instructions and voice files, the embodiment of the present disclosure provides a schematic diagram of customized configuration in the voice control instruction interface, as shown in Figure 5. In the voice control instruction interface, voice control instructions are added by entering text in the voice text field. At the same time, instructions are added in the description field to facilitate different users to understand the intention or function of the operation instruction corresponding to the voice text. That is, when customizing the text data of the control category, a new voice control instruction can be created, the voice text corresponding to the instruction can be entered in the voice text field, and the explanation or purpose of the instruction can be entered in the description field. When customizing the text data of the prompt category, a new guidance and inspection term can be created, the guidance term text can be entered in the newly created voice text field, and the explanation or purpose of the guidance term can be entered in the description field.

[0190] It's important to note that all voice texts for voice control commands and guidance inspection phrases must be unique. Two or more voice control commands or guidance inspection phrases cannot be the same. In other words, a single voice command can only be recognized as one voice text, without ambiguity. However, different voice texts can execute the same operation command or play the same guidance inspection phrase. The text entered in the voice text field is the text we want to recognize, while the description field provides an explanation of the voice text. The description field does not undergo speech synthesis or recognition, while the text in the voice text field does.

[0191] After entering the customized voice control instructions, the voice files corresponding to the control category operation instructions and the voice files corresponding to the prompt category operation instructions are synthesized through voice synthesis respectively. After saving, the mapping relationship between the identification information and the operation instructions and the voice files is automatically constructed.

[0192] In the embodiment of the present disclosure, the naming format of the voice file can be but is not limited to the ID.wav format corresponding to the file, for example: 10001.wav, 10002.wav, etc. The above are just some examples. The specific embodiment of the present disclosure does not limit the naming format of the voice file.

[0193] Step 402: Customize the operation instructions and voice files corresponding to the text data of the prompt category.

[0194] Among them, the operation instructions and voice files corresponding to the text data of the custom configuration prompt category refer to the custom configuration of the voice control instructions of the preset guidance and inspection terms, or the self-entry of text data to generate guidance and inspection terms, and the generation of voice files of the guidance and inspection terms.

[0195] The process of customizing the configuration of the operation instructions and voice files corresponding to the text data of the prompt category is consistent with the description in the above step 401 .

[0196] Step 403: assign unique identification information to each of the text data of the control category and the text data of the prompt category after the custom configuration.

[0197] Among them, each text data must have corresponding unique identification information (Identity document, ID).

[0198] Step 404: Construct mapping relationships between the identification information, the operation instruction, and the voice file.

[0199] In one implementation of the disclosed embodiment, after the control terminal recognizes the semantic text corresponding to the voice control instruction, it first performs an exception judgment, and determines whether to continue to execute subsequent steps or terminate the execution of the current voice control instruction based on the exception judgment result to ensure the accuracy of the execution. To this end, the embodiment of the present application provides an exception monitoring method, as shown in Figure 6, including:

[0200] Step 601 : When it is determined that the category of the target text data is the control category, an abnormality judgment is performed on the content of the semantic text according to a preset abnormality strategy.

[0201] In the embodiment of the present disclosure, it is necessary to determine that the target text data is of the control category. When the target text data belongs to the prompt category, the execution end performs a voice broadcast according to the voice file corresponding to the text data of the prompt category, does not perform an action, and the control end does not need to perform an abnormality judgment on the text data of the prompt category. When the target text data belongs to the control category, the execution end executes the operation instruction corresponding to the text data of the control category, the execution end needs to perform an action, and the control end needs to perform an abnormality judgment on the text data of the control category.

[0202] In actual applications, when performing abnormal judgment, it relies on a pre-set preset abnormal strategy. The preset abnormal strategy is a strategy that the execution end cannot execute normally or will produce adverse results after execution. For example, the adverse results include but are not limited to injuries to the inspected personnel, damage to the equipment, etc. The specific embodiments of the present disclosure do not limit this.

[0203] To facilitate a better understanding of the semantic text content anomaly described in the embodiments of the present disclosure, the present disclosure provides a scenario-based illustration. For example, the semantic text content requires an upward movement of 200 cm, while the maximum upward movement distance of the execution terminal is only 100 cm. The control terminal determines that the voice text content is anomaly, outputs this anomaly information, and terminates the operation instruction, preventing the execution terminal from continuing to operate. The specific embodiments of the present disclosure are not limited to this.

[0204] In step 602, if it is determined that the content of the semantic text is abnormal, a prompt message indicating the abnormality is output, and the transmission of the operation instruction is terminated. Furthermore, in one implementation of the embodiment of the present disclosure, the control end further includes receiving a normal / abnormal execution result corresponding to the operation instruction sent by the execution end, that is, when the execution end executes the operation instruction normally, normal execution information is sent to the control end, and the control end receives the normal execution information. When the execution end executes the operation instruction abnormally, abnormal execution information of the control instruction is sent to the control end, and the control end receives the abnormal execution information.

[0205] In one implementation of the disclosed embodiment, after receiving an operation instruction, the execution end first performs an exception judgment, and determines whether to continue to execute subsequent steps or terminate the execution of the operation instruction based on the exception judgment result, and sends a prompt message to the control end indicating that the operation instruction has an exception to ensure the accuracy of the execution. To this end, the embodiment of the present application provides another exception monitoring method, as shown in Figure 7, including:

[0206] Step 701: Perform an abnormality determination on the operation instruction according to a preset abnormality strategy.

[0207] For details about the preset exception policy, please refer to the relevant detailed description of FIG6 , and will not be detailed here. The preset exception policy described in the embodiment of the present disclosure is not consistent with the preset exception policy described in FIG6 . Specifically, the embodiment of the present disclosure does not limit the content of the preset exception policy.

[0208] To facilitate better understanding, the disclosed embodiments provide a scenario-based illustration. For example, the operation instruction is to move upward by 20 centimeters. The control terminal presents no abnormality in the operation instruction. However, the execution terminal has already moved upward to the maximum distance of 100 centimeters and cannot move further. The execution terminal then determines that the operation instruction is abnormal and sends a prompt message indicating the abnormality to the control terminal to prevent damage to the execution terminal. The disclosed embodiments are not limited to this.

[0209] Step 702: If it is determined that the operation instruction is abnormal, a prompt message indicating that the operation instruction is abnormal is sent to the control terminal.

[0210] Furthermore, in an implementation manner of the embodiment of the present disclosure, the execution end further includes sending a normal / abnormal execution result corresponding to the operation instruction to the control end.

[0211] To facilitate understanding of the interaction process between the control end and the execution end in the embodiment of the present application, please refer to FIG8 , which is a flow chart of another method for controlling a voice-assisted telemedicine device provided in the embodiment of the present application, as shown in FIG8 , including:

[0212] Step 801: In response to a received voice control instruction, the control terminal performs semantic recognition on the voice control instruction to obtain a corresponding semantic text.

[0213] In step 802, the control end customizes the operation instructions and voice files corresponding to the text data of the control category; wherein the voice files are used to be sent to the execution end synchronously with the operation instructions so that the execution end performs voice broadcast according to the voice files.

[0214] Step 803: The control terminal customizes the operation instructions and voice files corresponding to the text data of the prompt category.

[0215] Step 804: The control end allocates unique identification information to each of the text data of the control category and the text data of the prompt category after the custom configuration.

[0216] Step 805: The control end constructs mapping relationships between the identification information and the operation instructions and the voice file.

[0217] Step 806: The control end searches the text data set for target text data corresponding to the semantic text.

[0218] Step 807: The control end searches the text data set for an operation instruction corresponding to the target text data.

[0219] Step 808: When it is determined that the category of the target text data is the control category, the control end performs an abnormality judgment on the content of the semantic text according to a preset abnormality strategy.

[0220] Step 809: If it is determined that the content of the semantic text is abnormal, the control terminal outputs a prompt message indicating the abnormality and terminates the sending of the operation instruction.

[0221] Step 810: If it is determined that there is no abnormality in the content of the semantic text, the control end sends the operation instruction corresponding to the semantic text to the execution end.

[0222] Step 811: The execution end receives the operation instruction sent by the control end.

[0223] In step 812, the execution end performs an exception judgment on the operation instruction according to a preset exception strategy.

[0224] Step 813: If it is determined that the operation instruction is abnormal, the execution end sends a prompt message indicating that the operation instruction is abnormal to the control end.

[0225] Step 814: If it is determined that there is no abnormality in the operation instruction, the execution end executes the operation instruction.

[0226] Step 815: The execution end sends the normal execution result corresponding to the operation instruction to the control end.

[0227] Step 816: The control end receives the normal / abnormal execution result corresponding to the operation instruction sent by the execution end.

[0228] The present disclosure provides a method for controlling a voice-assisted telemedicine device. In response to a received voice control instruction, the method performs semantic recognition on the voice control instruction to obtain a corresponding semantic text; searches for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; queries the text data set for the operation instruction corresponding to the target text data, and sends the operation instruction to an execution terminal so that the execution terminal performs the corresponding operation according to the operation instruction. Compared with related technologies, the control terminal assists the execution terminal in remote execution through voice control instructions, which can simplify the steps of operating the execution terminal and thereby improve overall inspection efficiency.

[0229] Corresponding to the aforementioned method for controlling a voice-assisted telemedical device, which is applied to a control terminal, and the aforementioned method for controlling a voice-assisted telemedical device, which is applied to an execution terminal, the present invention further provides a control device for a voice-assisted telemedical device, which is applied to a control terminal, and a control device for a voice-assisted telemedical device, which is applied to an execution terminal. Since the device embodiments of the present invention correspond to the aforementioned method embodiments, details not disclosed in the device embodiments may be referred to the aforementioned method embodiments and will not be further described in this invention.

[0230] FIG9 is a schematic diagram of the structure of a control device for voice-assisted telemedicine equipment provided by an embodiment of the present disclosure. The device is applied to a control terminal, as shown in FIG9 , and includes:

[0231] The recognition unit 901 is configured to perform semantic recognition on the received voice control instruction in response to the received voice control instruction to obtain a corresponding semantic text;

[0232] A first search unit 902 is configured to search for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction;

[0233] A second search unit 903 is configured to search the text data set for an operation instruction corresponding to the target text data;

[0234] The sending unit 904 is configured to send the operation instruction to the execution end so that the execution end performs the corresponding operation according to the operation instruction.

[0235] The present disclosure provides a control method, device, and system for voice-assisted telemedicine equipment. In response to a received voice control instruction, the control method performs semantic recognition on the voice control instruction to obtain a corresponding semantic text; searches for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; queries the text data set for the operation instruction corresponding to the target text data, and sends the operation instruction to the execution end so that the execution end performs the corresponding operation according to the operation instruction. Compared with related technologies, the control end assists the execution end in remote execution through voice control instructions, which can simplify the steps of operating the execution end and thereby improve the overall inspection efficiency.

[0236] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG10 , the second search unit 903 includes:

[0237] A determination module 9031 is configured to determine the category to which the target text data belongs, wherein the text data set includes at least one of text data of a control category and text data of a prompt category;

[0238] The query module 9032 is configured to query the text data set for an operation instruction of a control category or an operation instruction of a prompt category corresponding to the target text data according to the result of determining the category to which the target text data belongs.

[0239] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG10 , the apparatus further includes:

[0240] A first configuration unit 905 is configured to, before the first search unit searches for target text data corresponding to the semantic text from the text data set, customize the operation instructions and voice files corresponding to the text data of the control category; wherein the voice files are sent to the execution end synchronously with the operation instructions so that the execution end performs voice broadcasting according to the voice files;

[0241] The second configuration unit 906 is used to customize the operation instructions and voice files corresponding to the text data of the prompt category;

[0242] An allocating unit 907 is configured to allocate unique identification information to each of the control-category text data and the prompt-category text data after custom configuration;

[0243] The construction unit 908 is configured to construct a mapping relationship between the identification information and the operation instruction and the voice file.

[0244] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG10 , the apparatus further includes:

[0245] A judgment unit 909 is configured to, when determining that the target text data belongs to the control category, perform an abnormality judgment on the content of the semantic text according to a preset abnormality strategy;

[0246] The output unit 910 is configured to output a prompt indicating that the content of the semantic text is abnormal if it is determined that the content of the semantic text is abnormal.

[0247] The terminating unit 911 is configured to terminate the sending of the operation instruction if it is determined that the content of the semantic text is abnormal.

[0248] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG10 , the apparatus further includes:

[0249] The receiving unit 912 is configured to receive a normal / abnormal execution result corresponding to the operation instruction sent by the execution end after the sending unit sends the operation instruction to the execution end.

[0250] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG10 , the identification unit 901 includes:

[0251] A first recognition module 9011 is configured to recognize the voice control instruction as corresponding voice text;

[0252] The second recognition module 9012 is configured to perform semantic recognition on the speech text to obtain the corresponding semantic text.

[0253] FIG11 is a schematic diagram of the structure of a control device for voice-assisted telemedicine equipment provided by an embodiment of the present disclosure. The device is applied to an execution end, as shown in FIG11 , and includes:

[0254] The receiving unit 1101 is configured to receive an operation instruction sent by a control terminal, wherein the operation instruction is a response of the control terminal to a received voice control instruction, perform semantic recognition on the voice control instruction, and obtain a corresponding semantic text; search for target text data corresponding to the semantic text from a text data set; search the text data set for an operation instruction corresponding to the target text data, and send the operation instruction corresponding to the target text data to an execution terminal;

[0255] The execution unit 1102 is configured to execute the operation instruction.

[0256] The present disclosure provides a control method, device, and system for voice-assisted telemedicine equipment. In response to a received voice control instruction, the control method performs semantic recognition on the voice control instruction to obtain a corresponding semantic text; searches for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; queries the text data set for the operation instruction corresponding to the target text data, and sends the operation instruction to the execution end so that the execution end performs the corresponding operation according to the operation instruction. Compared with related technologies, the control end assists the execution end in remote execution through voice control instructions, which can simplify the steps of operating the execution end and thereby improve the overall inspection efficiency.

[0257] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG12 , the execution unit 1102 includes:

[0258] The parsing module 11021 is used to parse the operation instruction and determine the category to which the operation instruction belongs, wherein the operation instruction includes an operation instruction of the control category or an operation instruction of the prompt category;

[0259] An execution module 11022 is configured to execute the operation instruction to complete a corresponding instruction action when confirming that the operation instruction belongs to the control category;

[0260] A first acquisition module 11023 is configured to, upon confirming that the operation instruction belongs to the prompt category, acquire a first voice file corresponding to the operation instruction of the prompt category;

[0261] The first playing module 11024 is used to perform voice broadcast according to the first voice file.

[0262] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG12 , the execution unit 1102 further includes:

[0263] The second acquisition module 11025 is used to acquire a second voice file corresponding to the operation instruction of the control category;

[0264] The second playing module 11026 performs voice broadcasting according to the second voice file.

[0265] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG12 , the apparatus further includes:

[0266] The judgment unit 1103 is configured to judge an abnormality of the operation instruction according to a preset abnormality strategy before the execution unit executes the operation instruction;

[0267] The first sending unit 1104 is configured to send a prompt message indicating that the operation instruction is abnormal to the control terminal when it is determined that the operation instruction is abnormal.

[0268] Furthermore, in a possible implementation of the embodiment of the present disclosure, as shown in FIG12 , the apparatus further includes:

[0269] The second sending unit 1105 is configured to send a normal / abnormal execution result corresponding to the operation instruction to the control end after the execution unit executes the operation instruction.

[0270] FIG13 is a control system of a voice-assisted telemedicine device provided by an embodiment of the present disclosure, as shown in FIG13 , including:

[0271] The control device 1301 of the voice-assisted telemedicine device and the execution device 1302 of the voice-assisted telemedicine device are shown in FIG. The control device 1301 of the voice-assisted telemedicine device is a control device configured at the control end, and the execution device 1302 of the voice-assisted telemedicine device is a control device configured at the execution end.

[0272] It should be noted that the above explanation of the method embodiment is also applicable to the device of the embodiment of the present disclosure, and the principles are the same, which is no longer limited in the embodiment of the present disclosure.

[0273] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0274] FIG14 shows a schematic block diagram of an example electronic device 1400 that can be used to implement an embodiment of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0275] As shown in FIG14 , device 1400 includes a computing unit 1401 that can perform various appropriate actions and processes based on a computer program stored in a ROM (Read-Only Memory) 1402 or a computer program loaded from a storage unit 1408 into a RAM (Random Access Memory) 1403. Various programs and data required for the operation of device 1400 may also be stored in RAM 1403. Computing unit 1401, ROM 1402, and RAM 1403 are interconnected via a bus 1404. An I / O (Input / Output) interface 1405 is also connected to bus 1404.

[0276] Various components in device 1400 are connected to I / O interface 1405, including: an input unit 1406, such as a keyboard, mouse, etc.; an output unit 1407, such as various types of displays, speakers, etc.; a storage unit 1408, such as a magnetic disk, optical disk, etc.; and a communication unit 1409, such as a network card, modem, wireless communication transceiver, etc. Communication unit 1409 allows device 1400 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0277] The computing unit 1401 can be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the computing unit 1401 include, but are not limited to, a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), various specialized AI (Artificial Intelligence) computing chips, various computing units that run machine learning model algorithms, a DSP (Digital Signal Processor), and any suitable processor, controller, microcontroller, etc. The computing unit 1401 performs the various methods and processes described above, such as the method for controlling a voice-assisted telemedicine device. For example, in some embodiments, the method for controlling a voice-assisted telemedicine device can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 1408. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 1400 via the ROM 1402 and / or the communication unit 1409. When the computer program is loaded into the RAM 1403 and executed by the computing unit 1401, one or more steps of the method described above can be performed. Alternatively, in other embodiments, the computing unit 1401 may be configured to execute the aforementioned control method of the voice-assisted telemedicine device in any other appropriate manner (for example, by means of firmware).

[0278] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application-Specific Standard Products), SOCs (System on Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0279] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0280] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include an electrical connection based on one or more wires, a portable computer disk, a hard disk, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory) or flash memory, optical fiber, CD-ROM (Compact Disc Read-Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0281] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0282] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network), WAN (Wide Area Network), the Internet, and blockchain networks.

[0283] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact via a communication network. This client-server relationship is established by computer programs running on the respective computers, establishing a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host, a host product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosts and VPS services ("Virtual Private Servers" or simply "VPS"). The server may also be a server in a distributed system or a server integrated with blockchain.

[0284] It's important to note that artificial intelligence (AI) is the study of how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, and planning). This encompasses both hardware and software technologies. AI hardware technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, and big data processing. AI software technologies primarily encompass computer vision, speech recognition, natural language processing, machine learning / deep learning, big data processing, and knowledge graphs.

[0285] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved. This is not limited herein.

[0286] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. A method for controlling a voice-assisted telemedicine device, characterized in that: The method is applied to a control end and includes: In response to the received voice control instruction, performing semantic recognition on the voice control instruction to obtain a corresponding semantic text; Searching for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to at least one operation instruction; The operation instruction corresponding to the target text data is searched from the text data set, and the operation instruction is sent to the execution end so that the execution end performs the corresponding operation according to the operation instruction.

2. The method according to claim 1, characterized in that The operation instruction corresponding to the target text data in the text data set includes: Determining the category to which the target text data belongs, wherein the text data set includes at least one of text data of a control category and text data of a prompt category; According to the determination result of the category to which the target text data belongs, the control category operation instruction or the prompt category operation instruction corresponding to the target text data is searched from the text data set.

3. The method according to claim 2, characterized in that Before searching the text data set for target text data corresponding to the semantic text, the method further comprises: Customizing and configuring the operation instructions and voice files corresponding to the text data of the control category; wherein the voice files are used to be sent to the execution end synchronously with the operation instructions, so that the execution end performs voice broadcast according to the voice files; Customizing the operation instructions and voice files corresponding to the text data of the prompt category; Allocate unique identification information to each custom configured text data of the control category and the text data of the prompt category; A mapping relationship between the identification information and the operation instruction and the voice file is constructed.

4. The method according to claim 1, characterized in that: The method further comprises: When it is determined that the category to which the target text data belongs is the control category, performing abnormality judgment on the content of the semantic text according to a preset abnormality strategy; If it is determined that the content of the semantic text is abnormal, a prompt message indicating the abnormality is output and the sending of the operation instruction is terminated.

5. A method for controlling a voice-assisted telemedicine device, characterized in that: The method is applied to the execution end, and includes: Receive an operation instruction sent by the control terminal, wherein the operation instruction is a command sent by the control terminal in response to receiving The speech control instruction is semantically recognized to obtain a corresponding semantic text; the target text data corresponding to the semantic text is searched from the text data set; the operation instruction corresponding to the target text data is searched from the text data set, and the operation instruction corresponding to the target text data is sent to the execution end; Execute the operation instruction.

6. The method according to claim 5, characterized in that The executing the operation instruction comprises: Parsing the operation instruction to confirm the category to which the operation instruction belongs, wherein the operation instruction includes an operation instruction of a control category or an operation instruction of a prompt category; When confirming that the operation instruction belongs to the control category, executing the operation instruction to complete the corresponding instruction action; When it is confirmed that the operation instruction belongs to the prompt category, a first voice file corresponding to the operation instruction of the prompt category is obtained, and voice broadcast is performed according to the first voice file, wherein the control end synchronously sends the voice file and the operation instruction.

7. The method according to claim 6, characterized in that The step of executing the operation instruction when confirming that the operation instruction belongs to the control category includes: A second voice file corresponding to the operation instruction of the control category is obtained, voice broadcast is performed according to the second voice file, and the operation instruction is executed.

8. A control device for voice-assisted telemedicine equipment, characterized in that: The device is applied to a control end and includes: A recognition unit, configured to perform semantic recognition on the received voice control instruction in response to the received voice control instruction to obtain a corresponding semantic text; A first search unit, used to search for target text data corresponding to the semantic text from a text data set, wherein one text data corresponds to one operation instruction; A second search unit, used for searching the text data set for an operation instruction corresponding to the target text data; The sending unit is used to send the operation instruction to the execution end, so that the execution end performs the corresponding operation according to the operation instruction.

9. A control device for voice-assisted telemedicine equipment, characterized in that: The device is applied to an execution end and includes: A receiving unit is used to receive an operation instruction sent by a control terminal, wherein the operation instruction is a response of the control terminal to a received voice control instruction, and semantic recognition is performed on the voice control instruction to obtain a corresponding semantic text; search for target text data corresponding to the semantic text from a text data set; search for an operation instruction corresponding to the target text data from the text data set, and send the operation instruction corresponding to the target text data to an execution terminal; An execution unit is used to execute the operation instruction.

10. A control system for voice-assisted telemedicine equipment, characterized in that: The system includes a control device for the voice-assisted telemedicine device as claimed in claim 8 and an execution device for the voice-assisted telemedicine device as claimed in claim 9.

11. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1-4 or the method according to any one of claims 5-7.

12. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-4 or the method according to any one of claims 5-7.

Images