Medical equipment control method and medical equipment

Abstract

The invention is suitable for the technical field of medical treatment, and provides a control method of medical equipment and the medical equipment. The control method of the medical equipment comprises the following steps: in response to first voice data input by a user, determining to-be-taught medical equipment operation corresponding to the first voice data and the classification of the medical equipment operation, and according to the classification of the medical equipment operation, obtaining teaching information of the medical equipment operation and a data output mode of the teaching information, and teaching information is output according to the data output mode. According to the embodiment of the invention, the method can achieve the teaching of the operation of the medical equipment in a corresponding mode according to the voice intention of the user and the classification of the operation of the to-be-teaching medical equipment, and reduces the operation difficulty of the medical equipment.

Description

Technical Field

[0001] The present application belongs to the field of medical technology, and in particular, relates to a control method of medical equipment and medical equipment. Background Art

[0002] Medical equipment is a device that can be used on the human body alone or in combination. Common medical equipment may include computed tomography (CT) equipment, magnetic resonance (MR) equipment, single photon emission computed tomography (SPECT) equipment, etc.

[0003] Existing medical devices require manual operation by users, which places high demands on the users' professional level. The standardization and accuracy of user operations on medical devices rely on manual training and paper / electronic documents. For inexperienced users, the equipment operation is extremely difficult. Summary of the invention

[0004] The embodiments of the present application provide a control method for a medical device and a medical device, which can reduce the difficulty of operating the medical device.

[0005] A first aspect of an embodiment of the present application provides a method for controlling a medical device, comprising: in response to first voice data input by a user, determining a medical device operation to be taught corresponding to the first voice data, and a classification of the medical device operation; according to the classification of the medical device operation, obtaining teaching information of the medical device operation and a data output method of the teaching information; and outputting the teaching information according to the data output method.

[0006] In some embodiments of the first aspect, the medical device includes a scanning room and an operating room, and the obtaining of teaching information of the medical device operation according to the classification of the medical device operation includes: if the medical device operation is an operation related to the scanning room, detecting whether the scanning room meets the operating conditions of the medical device operation; if the scanning room meets the operating conditions, obtaining the teaching information of the rack control component in the scanning room.

[0007] In some embodiments of the first aspect, if the scanning room meets the operating conditions, the control method further includes: obtaining real-time operation information of the user on the rack control component; performing accuracy verification on the real-time operation information; if the accuracy verification fails, obtaining correction information for the real-time operation information; and outputting the correction information.

[0008] In some embodiments of the first aspect, the medical device includes a scanning room and an operating room, and the obtaining of teaching information of the medical device operation based on the classification of the medical device operation includes: if the medical device operation is an operation related to the operating room, determining a display screen operation interface associated with the medical device operation in the operating room; and obtaining the teaching information of each control in the display screen operation interface.

[0009] In some embodiments of the first aspect, in the process of outputting the teaching information according to the data output mode, the control method also includes: acquiring second voice data input by a user; determining a target control from various controls of the display screen operation interface according to the second voice data, and determining content to be interpreted in the teaching information of the target control; and outputting interpretation information of the content to be interpreted.

[0010] In some embodiments of the first aspect, in response to first voice data input by a user, the control method further includes: obtaining patient information and historical scanning information of the patient, and determining a scanning protocol corresponding to the first voice data based on the patient information and the historical scanning information; and / or obtaining device status parameters and operations to be performed in the medical device corresponding to the first voice data, wherein the operations to be performed are obtained based on the device status parameters.

[0011] In some embodiments of the first aspect, if the data output mode is demonstration data, the data type of the teaching information is demonstration data; outputting the teaching information according to the data output mode includes: controlling the display screen of the medical device to demonstrate the demonstration data; if the data output mode is video playback, the data type of the teaching information is a video file; outputting the teaching information according to the data output mode includes: controlling the display screen and voice output module of the medical device to play the video file; if the data output mode is voice broadcast, the data type of the teaching information is voice text; outputting the teaching information according to the data output mode includes: controlling the voice output module of the medical device to broadcast the voice text.

[0012] In some embodiments of the first aspect, obtaining the data output method includes: extracting output method keywords from the first voice data; if the output method keywords exist, determining the data output method based on the output method keywords; if the output method keywords do not exist, obtaining a preset output method of the teaching information, and using the preset output method as the data output method.

[0013] In some embodiments of the first aspect, the medical device is a SPECT device, a CT device, an MR device or a PET-CT device.

[0014] A control device for a medical device provided in the second aspect of an embodiment of the present application includes: a voice processing unit, used to determine, in response to first voice data input by a user, a medical device operation to be taught corresponding to the first voice data, and a classification of the medical device operation; an acquisition unit, used to acquire teaching information of the medical device operation and a data output method of the teaching information according to the classification of the medical device operation; and an output unit, used to output the teaching information according to the data output method.

[0015] A third aspect of an embodiment of the present application provides a medical device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the control method for the medical device as described in any one of the first aspects are implemented.

[0016] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the control method of the above-mentioned medical device are implemented.

[0017] A fifth aspect of an embodiment of the present application provides a computer program product, which, when executed on a medical device, enables the medical device to execute the steps of the above-mentioned control method for the medical device.

[0018] In the implementation of the present application, in response to the first voice data input by the user, by determining the medical device operation to be taught corresponding to the first voice data and the classification of the medical device operation, the teaching information of the medical device operation and the data output mode of the teaching information are obtained according to the classification of the medical device operation, and the teaching information is output according to the data output mode. The medical device operation can be taught in a corresponding manner according to the user's voice intention and the classification of the medical device operation to be taught, helping the user to quickly acquire the knowledge of the medical device operation, reducing the learning time, and effectively reducing the difficulty of operating the medical device. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0020] Figure 1It is a schematic diagram of the implementation flow of the control method of the medical device provided in the embodiment of the present application;

[0021] Figure 2 This is a schematic diagram of a first specific implementation process of obtaining teaching information provided in an embodiment of the present application;

[0022] Figure 3 It is a schematic diagram of a second specific implementation process of obtaining teaching information provided in an embodiment of the present application;

[0023] Figure 4 is a flow chart of the output scanning protocol provided in the embodiment of the present application;

[0024] Figure 5 It is a flowchart of output system status parameters and operations to be performed provided by an embodiment of the present application;

[0025] Figure 6 This is a functional schematic diagram of the intelligent voice assistant provided in an embodiment of the present application;

[0026] Figure 7 is a schematic diagram of the structure of a control device of a medical device provided in an embodiment of the present application;

[0027] Figure 8 It is a schematic diagram of the structure of the medical device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work are protected by the present application.

[0029] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0030] In the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and should not be understood as indicating or implying relative importance.

[0031] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0032] Existing medical devices require manual operation by users, which places high demands on the users' professional level. The standardization and accuracy of user operations on medical devices rely on manual training and paper / electronic documents. For inexperienced users, the equipment operation is extremely difficult.

[0033] In view of this, the present application proposes a control method for medical equipment, which can identify the user's voice intention through intelligent voice interaction, and teach the medical equipment operation in a corresponding manner according to the user's voice intention and the classification of the medical equipment operation to be taught, thereby reducing the difficulty of operating the medical equipment and being more friendly to users with insufficient professional level.

[0034] In order to illustrate the technical solution of the present application, a specific embodiment is provided below for illustration.

[0035] Please refer to Figure 1 , Figure 1 A schematic diagram of the implementation flow of a control method for a medical device provided in an embodiment of the present application is shown. The method can be applied to a medical device, which can be a CT device, a SPECT device, a positron emission tomography-computed tomography (PET-CT) device, an MR device, or other types of medical devices, which are not limited by the present application.

[0036] Specifically, the control method of the medical device may include the following steps S101 to S103.

[0037] Step S101, in response to first voice data input by a user, determining the medical device operation to be taught corresponding to the first voice data, and the classification of the medical device operation.

[0038] In the implementation of the present application, the first voice data may be voice data collected by the medical device, for example, collected by a built-in microphone of the medical device; the first voice data may also be voice data sent by an external device, wherein the external device may be a mobile phone, a pager, or other device capable of receiving user voices, for example, the medical device may be connected to a user's handheld mobile terminal through a cloud platform, and then obtain the first voice data remotely sent by the user through the mobile terminal. This application does not impose any restrictions on this.

[0039] In some embodiments of the present application, the medical device can monitor voice data in real time and perform wake-up word recognition on the voice data. If the wake-up word is recognized, a prompt message indicating that the first voice data is ready to be received can be output, and the first voice data can be collected.

[0040] The wake-up word can be set according to actual needs. For example, when the medical device is a CT device, the medical staff says "Hello, CT assistant". The CT device captures the voice signal through the built-in microphone and recognizes the wake-up word "Hello, CT assistant". Then, the CT device outputs a prompt message in the form of voice output and / or screen display, indicating that it is ready to receive the first voice data.

[0041] In an embodiment of the present application, in response to first voice data input by a user, the medical device can obtain the medical device operation to be taught, as well as the classification of the medical device operation.

[0042] Specifically, the medical device may pre-classify each operation supported by the medical device, and the basis for classification may include but is not limited to: the location of the user when performing the operation, the function of the operation, and the operation object. In some embodiments of the present application, operation keywords may be extracted based on the first voice data to determine the medical device operation that the user needs to learn, and the classification of the medical device operation is obtained according to the pre-classified classification.

[0043] Step S102, obtaining teaching information of the operation of the medical device and a data output method of the teaching information according to the classification of the operation of the medical device.

[0044] In the implementation of the present application, the teaching information is used to guide the user to operate the medical device. The medical device can obtain the teaching information according to the classification of the medical device operation, so that the process of providing operation suggestions and guidance to the user complies with the process standardization.

[0045] The data output mode refers to the mode of outputting the teaching information, which can be configured according to the output components supported by the medical device. In the implementation of the present application, the data output mode includes but is not limited to: voice broadcast, video playback, demonstration data, and light indicator light. For the teaching information of the operation of the medical device, the medical device can select its corresponding data output mode.

[0046] Step S103, output teaching information according to the data output method.

[0047] In some embodiments of the present application, when outputting teaching information according to the data output mode, the output configuration information corresponding to the data output mode can be output. The output configuration information can be a default value pre-stored in the medical device or a user-defined value. Taking voice broadcast as an example, the output configuration information can include voice response time, voice style, language, etc. Taking video playback as an example, the output configuration information can include video resolution, playback speed, brightness, etc.

[0048] In the implementation of the present application, in response to the first voice data input by the user, by determining the medical device operation to be taught corresponding to the first voice data and the classification of the medical device operation, the teaching information of the medical device operation and the data output mode of the teaching information are obtained according to the classification of the medical device operation, and the teaching information is output according to the data output mode. The medical device operation can be taught in a corresponding manner according to the user's voice intention and the classification of the medical device operation to be taught, helping the user to quickly acquire the knowledge of the medical device operation, reducing the learning time, and effectively reducing the difficulty of operating the medical device.

[0049] In some embodiments of the present application, the medical device may perform voice recognition on the first voice data, extract data keywords, and determine the target data to be output based on the data keywords.

[0050] Among them, speech recognition can be achieved through deep neural networks (DNN), recurrent neural networks (RNN), Transformer models or other speech recognition models, or through spectrum analysis or other speech recognition methods. In particular, in order to adapt to different user needs, the above-mentioned speech recognition methods can support recognition of multiple dialects and accents. For example, the above-mentioned speech recognition model can be trained with samples of different dialects and accents to adapt to a diverse user group.

[0051] The target data may include at least one of device status information of the medical device, teaching information of the operation of the medical device, and a scanning protocol. The device status information may be used to characterize the current status of the medical device. The scanning protocol is a protocol used by the medical device when performing a radiographic scan on a patient.

[0052] In some implementations of the present application, obtaining the data output mode may specifically include: extracting output mode keywords from the first voice data, wherein the extraction mode may be implemented by the aforementioned voice recognition.

[0053] If there is an output method keyword, the data output method is determined according to the output method keyword. For example, when the first voice data input by the user is "show how to register a new patient", the medical device can determine that the data output method is demonstration data according to the output method keyword "show", and determine that the teaching information is teaching information of "registering a patient" according to the data keyword "how to register a new patient".

[0054] If there is no output method keyword, the preset output method of the teaching information is obtained, and the preset output method is used as the data output method. For example, when the first voice data input by the user is "How to register a new patient", the medical device does not extract the output method keyword, but according to the data keyword "How to register a new patient", it can be determined that the teaching information is the teaching information of "registering a patient". At this time, the medical device can obtain the preset output method of the teaching information of "registering a patient". For example, the default setting of the teaching information of "registering a patient" in the medical device is to play a video, and the data output method is to play a video.

[0055] In the implementation manner of the present application, the medical device can achieve different functions by outputting different target data.

[0056] Function 1: Medical equipment can support providing operation guidance and training for users.

[0057] If the target data to be output is teaching information, the medical device can determine the medical device operation to be taught corresponding to the first voice data, as well as the classification of the medical device operation, obtain the teaching information of the medical device operation and the data output method of the teaching information according to the classification of the medical device operation, and output the teaching information according to the data output method.

[0058] Specifically, medical equipment includes a scanning room and an operating room. The scanning room is equipped with scanning components (including but not limited to: a rack, a scanning bed, and a display screen in the scanning room) for performing radiological scans on patients. The operating room is used for users to perform operations such as parameter setting. The operator can input information and control the scanning components in the scanning room by operating the control components in the control room. Generally speaking, the scanning room and the operating room are separated from each other to avoid radiation hazards to users caused by the rays in the scanning room.

[0059] In some embodiments of the present application, various operations supported by the medical device may be classified in advance into operations related to the scanning room and operations related to the operating room. Operations related to the scanning room may be used to control the scanning components in the scanning room, and may include but are not limited to: movement operations of the scanning bed, line scanning operations of the scanning components, phantom placement operations, and rack control panel button operations. Operations related to the operating room may be used to control the operation control components in the operating room, and may include but are not limited to: patient registration operations, information input operations, image reconstruction operations, image browsing operations, and protocol creation operations of the operation control components.

[0060] In some embodiments of the present application, Figure 2 As shown, according to the classification of medical device operations, obtaining teaching information of medical device operations may include: step S201 to step S202.

[0061] Step S201: if the medical device operation is an operation related to a scanning room of the medical device, then detecting whether the scanning room meets the operation conditions of the medical device operation.

[0062] That is, if the medical device operation is an operation related to a scanning room of the medical device, the medical device may determine whether the current scanning room satisfies the execution prerequisite of the medical device operation.

[0063] In some embodiments of the present application, the medical device may obtain sensor information collected by sensors in the scanning room, and detect whether the scanning room meets the operating conditions for the operation of the medical device based on the sensor information.

[0064] Specifically, in some embodiments of the present application, the medical device can obtain images captured by a camera in the scanning room, and detect whether the scanning room meets the operating conditions for the operation of the medical device based on the image content. The camera can be set on the rack or the ceiling of the scanning room, which is not limited by the present application. In other embodiments of the present application, the medical device can obtain data collected by the gravity sensor of the rack and the posture sensor of the scanning bed, and detect whether the scanning room meets the operating conditions for the operation of the medical device based on these data.

[0065] In conjunction with specific medical device operations, in some embodiments of the present application, when the medical device is operated as a radiographic scanning operation, the medical device can detect whether the current position of the patient or phantom on the scanning bed is accurate based on sensor information. If the current position of the patient or phantom is accurate, the scanning room meets the operating conditions of the radiographic scanning operation. If the current position of the patient or phantom is inaccurate, the scanning room does not meet the operating conditions of the radiographic scanning operation.

[0066] In other embodiments of the present application, when the medical device is operated as a scanning bed movement operation, the medical device can detect the states of the moving wheels, lifting mechanism, and rotating mechanism of the scanning bed based on the sensor information. If the moving wheels, lifting mechanism, and rotating mechanism are in a movable state, the scanning room meets the operation conditions for the scanning bed movement operation. If the moving wheels, lifting mechanism, and rotating mechanism are in a locked state, the scanning room does not meet the operation conditions for the scanning bed movement operation.

[0067] It is understandable that other operations supported by the medical device can also determine whether the operating conditions are met through sensor information, and this application does not impose any restrictions on this.

[0068] Step S202: if the scanning room meets the operating conditions, the teaching information of the rack control component in the scanning room is obtained.

[0069] The rack control component may refer to a physical button on the rack or a virtual control on a display screen in a scanning room for controlling the rack. The teaching information of the rack control component may refer to the functional interpretation information of the rack control component.

[0070] Among them, the output method of the teaching information of the rack control component includes but is not limited to: voice broadcasting of the first teaching information of the physical button, displaying the first teaching information of the rack control component on the display screen, displaying a three-dimensional model of the rack on the display screen, and displaying the model mark corresponding to the physical button on the three-dimensional model.

[0071] In this way, the medical device can monitor the situation in the scanning room, and acquire and output teaching information when the operating conditions are met in the scanning room, so as to facilitate the demonstration of the scanning process during output and enhance the safety and standardization of operations.

[0072] In some embodiments of the present application, if the scanning room meets the operating conditions, the control method may further include: obtaining real-time operation information of the user on the rack control component, and performing accuracy verification on the real-time operation information. If the accuracy verification fails, obtaining correction information for the real-time operation information, and outputting the correction information.

[0073] Among them, accuracy verification is used to verify whether the real-time operation information complies with the operating specifications of the medical equipment.

[0074] Specifically, the accuracy check of the real-time operation information may include: determining the input value of the medical device parameter according to the real-time operation information, if the input value is within a preset reference range, the accuracy check is successful, otherwise, the accuracy check fails. The accuracy check of the real-time operation information may also include: obtaining historical operation information, and determining the current operation process of the medical device operation according to the historical operation information and the real-time operation information, comparing the current operation process with the reference operation process of the medical device operation, if the current operation process is consistent with the reference operation process, the accuracy check is successful, otherwise, the accuracy check fails.

[0075] If the accuracy verification is successful, the medical device can continue to monitor the user's real-time operation information.

[0076] If the accuracy check fails, the medical device can determine the correction information based on the real-time operation information. For example, when the input value is outside the reference range, the adjustment value can be determined based on the input value and the reference range, and the adjustment value can be used as the correction information. For another example, when the current operation process is inconsistent with the reference operation process, the next operation information corresponding to the historical operation information can be determined based on the reference operation process, and the next operation information can be used as the correction information.

[0077] In this way, the medical device can analyze whether the user's operation is accurate during the user's real-time operation, and correct the user's erroneous operation to ensure the accuracy and compliance of the medical device operation.

[0078] In other embodiments of the present application, Figure 3 As shown, according to the classification of medical device operations, obtaining teaching information of medical device operations may include: step S301 to step S302.

[0079] Step S301: If the operation of the medical device is an operation related to the operation room of the medical device, then determine the display screen operation interface associated with the operation of the medical device in the operation room.

[0080] The display screen operation interface is a display interface on the display screen of the operation room. The display screen operation interface displays controls, and users can trigger corresponding control operations through the controls.

[0081] Step S302, obtaining teaching information of each control in the display screen operation interface.

[0082] In the implementation of the present application, the teaching information of each control may refer to the functional interpretation information of the control. The medical device may display the teaching information of each control in the display screen operation interface, or output it through voice.

[0083] In the process of outputting demonstration information, the control method may also include: obtaining second voice data input by the user, determining a target control from various controls of the display screen operation interface based on the second voice data, determining the content to be interpreted in the teaching information of the target control, and outputting interpretation information of the content to be interpreted.

[0084] Among them, the second voice data is the voice data input by the user for the second time. The acquisition method can refer to the description of the first voice data in the previous article, and this application will not elaborate on this.

[0085] For example, when the second voice data input by the user is "What is the format of patient ID input", the keyword "patient ID" can determine that the target control is "patient identification number input control", and the teaching information of "patient identification number input control" is "Fill in patient ID", then the pre-stored interpretation information "Patient ID is an 8-digit number" of the interpretation content "Patient ID" can be output.

[0086] In this way, more detailed and intelligent guidance can be provided to users through multiple voice interactions, improving operational convenience.

[0087] Function 2: Medical devices can support scanning protocol recommendations.

[0088] Specifically, if the target data to be output is a scanning protocol, the medical device may also output the scanning protocol.

[0089] In some embodiments of the present application, in response to first voice data input by a user, the control method further includes: acquiring patient information and historical scanning information of the patient, and determining a scanning protocol corresponding to the first voice data based on the patient information and historical scanning information.

[0090] In the implementation of the present application, the medical device can perform a radiographic scanning operation, which refers to the operation of releasing radiation to scan a patient or a phantom on a scanning bed. The scanning protocol is used to describe the type, scanning sequence, and orientation of the radiographic scanning operation. The patient information may include, but is not limited to, the patient's age, height, weight, disease type, and scanning site. The historical scanning information may refer to the scanning protocol, scanning results, etc. used by the patient's past radiographic scanning operations.

[0091] like Figure 4 As shown, the medical device can read the scan list that records the scanned patients to determine whether the patient is the first scanned patient. If the patient is the first scanned patient, the patient information can be read, and the scan protocol can be determined based on the patient information. If the patient is not the first scanned patient, the historical scan information can be read, and the scan protocol can be determined based on the historical scan information, for example, the unscanned position can be determined based on the historical scan information, and the scan protocol can be generated based on the unscanned position.

[0092] Correspondingly, the medical device can obtain the data output mode of the scanning protocol and output the scanning protocol according to the data output mode of the scanning protocol. The method of obtaining the data output mode of the scanning protocol can refer to the method of obtaining the data output mode of the teaching information, which is not described in detail in this application.

[0093] After completing the radiographic scanning operation, the medical device can also output the patient's preliminary diagnosis results based on the scanning results for reference by the patient and doctor.

[0094] In the implementation manner of the present application, the medical device can proactively provide preliminary scanning suggestions to help users quickly obtain recommended scanning protocols, shorten the time for protocol preparation and selection, and help improve medical efficiency and quality.

[0095] Function three: Medical equipment can broadcast equipment status information.

[0096] Specifically, if the target data to be output is device status information, the medical device may also output the device status information.

[0097] In some embodiments of the present application, in response to the first voice data input by the user, the control method further includes: obtaining device state parameters and pending operations corresponding to the first voice data in the medical device. The device state parameters and pending operations can be output as device state information.

[0098] Among them, the device status parameters of the medical device can characterize the working status of the medical device, including but not limited to: temperature, humidity, count rate, quality control (QC) results. The operation to be performed can be obtained according to the device status parameters. Based on the device status parameters, the medical device can determine whether a specific operation or test item needs to be performed at present, such as air calibration, QC, etc.

[0099] Correspondingly, the medical device can obtain the data output method of the device status information, and output the device status parameters and the operation to be performed according to the data output method of the device status information. Among them, the method of obtaining the data output method of the device status information can refer to the method of obtaining the data output method of the teaching information, and this application will not elaborate on this.

[0100] In other embodiments, the medical device may also broadcast device status parameters and operations to be performed of the medical device when it detects that a user is approaching the medical device or when a fault is detected.

[0101] Specifically, the medical device can monitor whether the user is close to the medical device through the voice acquisition module and the camera. For example, when the pixel proportion of the user gradually increases in the image sequence captured by the camera, or the depth of the user gradually decreases, it can be confirmed that the user is close to the medical device. Figure 5 As shown, in some embodiments of the present application, the medical device can also confirm whether the approaching user is the target user through voice recognition and face recognition of the camera image. The target user can refer to a user with operation authority or a user in a pre-stored face library. If the approaching user is the target user, the device status parameters and the operations to be performed of the medical device are actively broadcast.

[0102] In some embodiments of the present application, when a user is monitored approaching a medical device, it can also be determined whether the current time point is within the first work time period of the day. If the current time point is within the first work time period of the day, the device status parameters and operations to be performed of the medical device are broadcast; otherwise, no broadcast is performed.

[0103] In addition, when a medical device detects a fault during scanning or standby, it can actively broadcast the device status parameters and pending operations of the medical device. Specifically, the medical device can also determine the fault type based on the device status parameters, and obtain maintenance method information related to the fault type from the pre-stored fault knowledge base information, and then output the component type, fault type and maintenance method information of each component of the medical device to assist maintenance personnel in diagnosis and spare parts.

[0104] In this way, medical equipment can actively broadcast system status parameters and the operations and tests that should be performed. By outputting equipment status information, it can timely remind the equipment status to avoid affecting the patient's scanning process due to equipment problems, and timely remind users to perform system detection items related to the equipment status.

[0105] Function 4: Medical equipment can play music and regulate emotions according to patient needs.

[0106] In some embodiments of the present application, the medical device can output an inquiry voice, such as "How do you feel now? Do you need to listen to some relaxing music?" to obtain the voice data input by the user and determine the music to be output based on the voice data.

[0107] In other embodiments of the present application, the medical device may also monitor changes in the patient's emotions and dynamically adjust the playlist according to the changes in emotions.

[0108] During the music playing process, the medical device can also adjust the instructions according to the user's voice to control the music playback, such as "increase the volume", "switch to the next song", etc.

[0109] In addition, the medical device can also determine the medical device operation to be performed according to the first voice data, and perform the medical device operation. The medical device operation may include but is not limited to: power on, power off, restart, perform line scanning operation, and set parameters.

[0110] For example, the medical staff issues voice commands, such as "start whole body scan", "set the count rate to 10kcps", etc. The voice control system recognizes and interprets the command, and the command execution module interacts with the medical device control interface to perform the corresponding operation. The execution result is fed back to the medical staff in the form of voice, such as "whole body scan has started", "the count rate has been set to 10kcps".

[0111] In the implementation manner of the present application, the output method of the teaching information can be selected according to actual conditions.

[0112] Specifically, outputting teaching information can be done in the following three ways:

[0113] Mode 1: If the data output mode is demonstration data, the data type of the teaching information is demonstration data. According to the data output mode, outputting the teaching information may include: controlling the display screen of the medical device to demonstrate the demonstration data.

[0114] Demonstration refers to simulating the user's operation process on the display screen and explaining the relevant controls and operation methods during the operation.

[0115] As an example, if the operation of the medical device is a line-release scanning operation, it is detected whether the scanning room meets the operating conditions of the medical device operation. If the scanning room meets the operating conditions, the demonstration data of the rack control component in the scanning room is obtained, and the demonstration data is demonstrated. It should be noted that when demonstrating the demonstration data of the rack control component in the scanning room, the scanning bed, scanning components and other devices in the scanning room can perform corresponding operations according to the demonstration data. For example, when demonstrating the teaching information of the line-release scanning operation, the scanning component can perform the line-release scanning operation; when demonstrating the teaching information of the moving operation of the scanning bed, the scanning bed can perform the moving operation. This can then enable users to have a clearer understanding of the operation of the medical device.

[0116] As another example, if the medical device operation is an operation related to the operating room of the medical device, the display screen operation interface associated with the medical device operation in the operating room is determined, and demonstration data of each control in the display screen operation interface is obtained to demonstrate the demonstration data.

[0117] Mode 2: If the data output mode is video playback, the data type of the teaching information is a video file. Outputting the teaching information according to the data output mode may include: controlling the display screen and the voice output module of the medical device to play the video file.

[0118] Specifically, the medical device can display a list of teaching videos, and extract video keywords corresponding to the operation of the medical device based on the first voice data or the third voice data input by the user, and then determine the target teaching video corresponding to the operation of the medical device from multiple teaching videos based on the video keywords.

[0119] In this way, when the user wants to learn how to operate the device, he can directly issue voice commands to the medical device, and the medical device can display a list of built-in teaching videos for the user to choose from. According to the user's learning needs, the medical device can automatically play relevant videos for the user to learn.

[0120] Mode 3: If the data output mode is voice broadcast, the data type of the teaching information is voice text. According to the data output mode, outputting the teaching information may include: controlling the voice output module of the medical device to broadcast the voice text.

[0121] Specifically, the voice text can be converted into natural and fluent voice broadcast content through Text To Speech (TTS) technology.

[0122] It is understandable that the data output method of the scanning protocol, device status information and other target data can refer to the output method of the teaching information, and this application will not elaborate on this.

[0123] Please refer to Figure 6 In some embodiments of the present application, the medical device may be configured with an intelligent voice assistant, which is a software function module within the medical device and can be used to implement Figures 1 to 4 The method. The medical device processes the voice data input by the user through the intelligent voice assistant, and combines the sensor information of the sensor in the scanning room to realize the teaching video playback, the teaching demonstration of the operation interface, the output of the teaching information and correction information of the rack control component, the scanning protocol recommendation and demonstration, etc.

[0124] Among them, the intelligent voice assistant can be used as an independent software module in the medical device and integrated with the main control module and various functional modules of the medical device. The integration methods may include but are not limited to: 1. Hardware interface integration: through the serial data communication interface RS-232, Universal Serial Bus (USB), Ethernet interface and other physical interfaces or other hardware interfaces, bidirectional communication with the main control module and various functional modules. 2. Software interface integration: using the application programming interface (API) or software development kit (SDK), integrated into the operating system or software of the medical device. 3. Wireless communication integration: remote access and control through Wi-Fi, Bluetooth and other methods.

[0125] It should be noted that in other embodiments of the present application, the medical device may also support other interaction modes. In response to data input by the user through other interaction modes, the corresponding target data and data output mode are obtained.

[0126] Among them, data input by other interaction methods may refer to gesture interaction data and eye movement data.

[0127] Taking gesture interaction data as an example, through gesture recognition, the recognized gesture can be matched with the built-in gesture, and the data and output method bound to the successfully matched gesture can be used as the target data and data output method.

[0128] Taking eye movement data as an example, through gaze tracking, the control that the user is looking at can be identified, and the data and output method related to the control can be used as the target data and data output method.

[0129] For the method of acquiring and outputting the target data, reference may be made to the processing process of the voice data, which will not be elaborated in this application.

[0130] In some embodiments of the present application, the medical device can obtain data corresponding to the interaction mode selected by the user, thereby providing the user with a wider range of control options. For example, when the user selects the voice interaction mode, the medical device can obtain the first voice data input by the user. When the user selects the gesture control mode, the medical device can collect the user image based on the camera, and recognize the user gesture from the user image to obtain gesture data.

[0131] It should be noted that, for the sake of simplicity of description, the aforementioned method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the described order of actions, because according to the present application, certain steps can be performed in other orders.

[0132] like Figure 7 Shown is a schematic structural diagram of a control device 700 for a medical device provided in an embodiment of the present application, wherein the control device 700 for the medical device is configured on the medical device.

[0133] Specifically, the control device 700 of the medical device may include:

[0134] A voice processing unit 701, configured to determine, in response to first voice data input by a user, a medical device operation to be taught corresponding to the first voice data, and a classification of the medical device operation;

[0135] An acquisition unit 702, configured to acquire the teaching information of the medical device operation and a data output mode of the teaching information according to the classification of the medical device operation;

[0136] The output unit 703 is used to output the teaching information according to the data output method.

[0137] In some embodiments of the present application, the medical device includes a scanning room and an operating room, and the acquisition unit 702 can be specifically used to: if the operation of the medical device is an operation related to the scanning room of the medical device, then detect whether the scanning room meets the operating conditions of the medical device operation; if the scanning room meets the operating conditions, then acquire the teaching information of the rack control component in the scanning room.

[0138] In some embodiments of the present application, the acquisition unit 702 can be specifically used to: obtain real-time operation information of the user on the rack control component; perform accuracy verification on the real-time operation information; if the accuracy verification fails, obtain correction information for the real-time operation information; and output the correction information.

[0139] In some embodiments of the present application, the medical device includes a scanning room and an operating room, and the acquisition unit 702 can be specifically used to: if the operation of the medical device is an operation related to the operating room of the medical device, determine the display screen operation interface associated with the medical device operation in the operating room; and obtain the teaching information of each control in the display screen operation interface.

[0140] In some embodiments of the present application, the acquisition unit 702 can be specifically used to: acquire second voice data input by a user; determine a target control from various controls of the display screen operation interface based on the second voice data, and determine the content to be interpreted in the teaching information of the target control; and output interpretation information of the content to be interpreted.

[0141] In some embodiments of the present application, the voice processing unit 701 can also be specifically used to: obtain the patient information and historical scanning information of the patient, and determine the scanning protocol corresponding to the first voice data based on the patient information and the historical scanning information; and / or obtain the device status parameters and operations to be performed in the medical device corresponding to the first voice data, wherein the operations to be performed are obtained based on the device status parameters.

[0142] In some embodiments of the present application, if the data output mode is demonstration data, the data type of the teaching information is demonstration data; the output unit 703 can be specifically used to: control the display screen of the medical device to demonstrate the demonstration data; if the data output mode is video playback, the data type of the teaching information is a video file; if the data output mode is demonstration data, the data type of the teaching information is video playback; the output unit 703 can be specifically used to: control the display screen and voice output module of the medical device to play the video file; if the data output mode is voice broadcast, the data type of the teaching information is demonstration data; the output unit 703 can be specifically used to: control the voice output module of the medical device to broadcast the voice text.

[0143] In some embodiments of the present application, the voice processing unit 701 can also be used to: extract output mode keywords from the first voice data; if the output mode keywords exist, determine the data output mode according to the output mode keywords; if the output mode keywords do not exist, obtain the preset output mode of the teaching information, and use the preset output mode as the data output mode.

[0144] It should be noted that, for the convenience and simplicity of description, the specific working process of the control device 700 of the above medical device can be referred to Figures 1 to 6 The corresponding process of the method will not be repeated here.

[0145] like Figure 8 FIG. 8 is a schematic diagram of a medical device 8 provided in an embodiment of the present application. Specifically, the medical device 8 may include: a processor 80, a memory 81, and a computer program 82 stored in the memory 81 and executable on the processor 80, such as a control program for the medical device. When the processor 80 executes the computer program 82, the steps in the control method embodiments of the above-mentioned medical device are implemented, such as Figure 1 Alternatively, when the processor 80 executes the computer program 82, the functions of each module / unit in the above-mentioned device embodiments are realized, for example, Figure 7 The functions of the speech processing unit 701, the acquisition unit 702 and the output unit 703 are shown.

[0146] In some embodiments of the present application, the medical device is a SPECT device, a CT device, an MR device or a PET-CT device.

[0147] The computer program may be divided into one or more modules / units, which are stored in the memory 81 and executed by the processor 80 to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the medical device 8.

[0148] For example, the computer program can be divided into: a voice processing unit, an acquisition unit, and an output unit. The specific functions of each unit are as follows: the voice processing unit is used to respond to the first voice data input by the user, determine the medical device operation to be taught corresponding to the first voice data, and the classification of the medical device operation; the acquisition unit is used to acquire the teaching information of the medical device operation and the data output method of the teaching information according to the classification of the medical device operation; the output unit is used to output the teaching information according to the data output method.

[0149] The medical device 8 may include, but is not limited to, a processor 80 and a memory 81. Those skilled in the art will appreciate that Figure 8 It is only an example of the medical device 8 and does not constitute a limitation of the medical device 8. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the medical device 8 may also include input and output devices, network access devices, buses, etc.

[0150] The processor 80 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0151] The memory 81 may be an internal storage unit of the medical device 8, such as a hard disk or memory of the medical device 8. The memory 81 may also be an external storage device of the medical device 8, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the medical device 8. Further, the memory 81 may also include both an internal storage unit and an external storage device of the medical device 8. The memory 81 is used to store the computer program and other programs and data required by the medical device 8. The memory 81 may also be used to temporarily store data that has been output or is to be output.

[0152] It should be noted that, for the convenience and brevity of description, the structure of the above-mentioned medical device 8 can also refer to the specific description of the structure in the method embodiment, which will not be repeated here.

[0153] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0154] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0155] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0156] In the embodiments provided in the present application, it should be understood that the disclosed devices / equipment and methods can be implemented in other ways. For example, the device / equipment embodiments described above are merely schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0157] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0158] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0159] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0160] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A control method for medical equipment, It is characterized in that include: In response to first voice data input by a user, determining a medical device operation to be taught corresponding to the first voice data, and a classification of the medical device operation; According to the classification of the medical device operation, obtaining the teaching information of the medical device operation and the data output method of the teaching information; The teaching information is output according to the data output method.

2. The method for controlling a medical device according to claim 1, It is characterized in that The medical device includes a scanning room and an operating room; and according to the classification of the medical device operation, obtaining teaching information of the medical device operation includes: If the medical device operation is an operation related to the scanning room, detecting whether the scanning room meets the operation conditions of the medical device operation; If the scanning room meets the operating condition, the teaching information of the rack control component in the scanning room is obtained.

3. The control method of the medical device according to claim 2, It is characterized in that If the scanning room satisfies the operating condition, the control method further includes: Acquiring real-time operation information of the user on the rack control component; Performing accuracy verification on the real-time operation information; If the accuracy check fails, obtaining correction information for the real-time operation information; The correction information is output.

4. The method for controlling a medical device according to claim 1, It is characterized in that The medical device includes a scanning room and an operating room; and according to the classification of the medical device operation, obtaining teaching information of the medical device operation includes: If the medical device operation is an operation related to the operating room, determining a display screen operation interface in the operating room that is associated with the medical device operation; The teaching information of each control in the display screen operation interface is obtained.

5. The method for controlling a medical device according to claim 4, It is characterized in that If the medical device operation is an operation related to the operation room, in the process of outputting the teaching information according to the data output mode, the control method further includes: Acquire second voice data input by the user; According to the second voice data, a target control is determined from various controls of the display screen operation interface, and content to be explained is determined in the teaching information of the target control; Output the interpretation information of the content to be interpreted.

6. The method for controlling a medical device according to claim 1, It is characterized in that In response to first voice data input by a user, the control method further includes: Acquire patient information and historical scanning information of the patient, and determine a scanning protocol corresponding to the first voice data according to the patient information and the historical scanning information; And / or, obtaining device status parameters and operations to be performed in the medical device corresponding to the first voice data, wherein the operations to be performed are obtained based on the device status parameters.

7. The control method of the medical device according to any one of claims 1 to 6, It is characterized in that If the data output mode is demonstration data, the data type of the teaching information is demonstration data; outputting the teaching information according to the data output mode includes: controlling the display screen of the medical device to demonstrate the demonstration data; If the data output mode is video playback, the data type of the teaching information is a video file; outputting the teaching information according to the data output mode includes: controlling the display screen and the voice output module of the medical device to play the video file; If the data output mode is voice broadcast, the data type of the teaching information is voice text; outputting the teaching information according to the data output mode includes: controlling the voice output module of the medical device to broadcast the voice text.

8. The method for controlling a medical device according to any one of claims 1 to 6, It is characterized in that The data output mode is obtained, including: Extracting output mode keywords from the first voice data; If the output mode keyword exists, determining the data output mode according to the output mode keyword; If the output method keyword does not exist, the preset output method of the teaching information is obtained, and the preset output method is used as the data output method.

9. The method for controlling a medical device according to any one of claims 1 to 6, It is characterized in that The medical device is a SPECT device, a CT device, an MR device or a PET-CT device.

10. A medical device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, It is characterized in that When the processor executes the computer program, the steps of the method for controlling the medical device according to any one of claims 1 to 9 are implemented.

Images