Human-computer interaction method and device of medical system, medical system and storage medium

Abstract

The invention relates to a human-computer interaction method and device of a medical system, the medical system and a storage medium, and is applied to the technical field of medical system control. The method comprises the following steps: displaying a preset identifier in an information display interface; acquiring a current breathing parameter; and controlling the preset identifier to move in the information display interface based on the breathing parameters. The preset identifier is displayed in the information display interface, and then the preset identifier is controlled to move in the information display interface according to the obtained current breathing parameter, so that the current breathing state of the patient is displayed in a visual manner, personalized visual interaction with the patient is performed, the experience of the patient in medical equipment is improved, and the medical equipment experience is improved. The psychological pressure of the patient in the medical treatment process is relieved, so that the medical treatment effect is improved.

Description

Technical Field

[0001] The present application relates to the field of medical system control technology, and in particular to a human-computer interaction method, device, medical system and storage medium for a medical system. Background Art

[0002] In large medical equipment such as MRI (Magnetic Resonance Imaging) equipment, CT (Computed Tomography) equipment, PET-CT (Positron Emission Tomography-Computed Tomography) equipment, RT (Radiation Therapy) equipment, etc., there are certain requirements for the patient's respiratory movement, so as to reduce or eliminate image artifacts caused by the patient's respiratory movement during medical imaging, or reduce the irradiation deviation caused by respiratory movement during medical treatment, so as to improve the accuracy and efficacy of treatment. In traditional technology, breathing training is performed on patients before treatment to enable them to maintain good breathing habits to improve the treatment effect. However, due to the structure of medical equipment, patients will still have certain psychological pressure (such as anxiety, discomfort and claustrophobia) during the medical treatment process, which leads to poor medical results. Summary of the invention

[0003] Based on this, it is necessary to provide a human-computer interaction method, device, medical system and storage medium for a medical system that can improve medical effects in response to the above technical problems.

[0004] In a first aspect, the present application provides a human-computer interaction method for a medical system, wherein the method comprises: displaying a preset mark in an information display interface; acquiring current respiratory parameters; and controlling the preset mark to move in the information display interface based on the respiratory parameters.

[0005] In some embodiments, the method further includes: displaying breathing instructions in the information display interface; wherein the breathing instructions include: at least one of preset breathing instructions, preset breathing limits, and preset breath holding instructions, the preset breathing instructions include a moving path of the preset identifier, the preset breathing limits include an indication of a moving range of the preset identifier, and the preset breath holding instructions include a breath holding start instruction and / or a breath holding end instruction.

[0006] In some embodiments, the method further includes: acquiring breathing training parameters and / or medical project parameters; and determining the breathing guidance based on the breathing training parameters and / or the medical project parameters.

[0007] In some of the embodiments, the method further includes: determining a breathing curve based on the breathing parameters; and controlling a working state of a medical device based on the breathing curve.

[0008] In some of the embodiments, the method further includes: displaying a background display interface in response to a background priority instruction; wherein the background display interface is stacked with the information display interface; and displaying a background image in the background display interface.

[0009] In some embodiments, the step of displaying a background image in a background display interface includes: obtaining voice description data in response to a background selection instruction; performing voice recognition on the voice description data to obtain text description data; inputting the text description data into a trained text image generation model to obtain a selected image; performing an image review on the selected image based on review criteria, and displaying the selected image that has passed the image review in the background display interface.

[0010] In some embodiments, the method further includes: displaying an interactive display interface in response to an interactive priority instruction; wherein the information display interface, the background display interface and the interactive display interface are stacked; and displaying interactive information in the interactive display interface.

[0011] In a second aspect, the present application also provides a human-computer interaction device for a medical system. The device includes: a preset mark display module, used to display a preset mark in an information display interface; a breathing parameter acquisition module, used to acquire current breathing parameters; and a movement control module, used to control the movement of the preset mark in the information display interface based on the breathing parameters.

[0012] In a third aspect, the present application further provides a medical system, which includes: a medical device and a display device, and further includes a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the method described in the first aspect are implemented.

[0013] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the method described in the embodiment of the first aspect are implemented.

[0014] The human-computer interaction method, device, medical system and storage medium of the above-mentioned medical system display a preset mark in the information display interface, and then control the movement of the preset mark in the information display interface according to the current respiratory parameters obtained, thereby displaying the patient's current respiratory status in a visual manner, and conducting personalized visual interaction with the patient, thereby improving the patient's experience in the medical device, relieving the patient's psychological pressure during the medical process, and thus improving the medical effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A schematic diagram of a flow chart of a human-computer interaction method of a medical system in some embodiments;

[0016] Figure 2 A schematic diagram showing a preset logo in some embodiments;

[0017] Figure 3 A schematic diagram showing preset breathing instructions in some embodiments;

[0018] Figure 4 is a schematic diagram showing a preset breathing limit in some embodiments;

[0019] Figure 5 A schematic diagram showing preset breath-holding instructions in some embodiments;

[0020] Figure 6 for Figure 5 A schematic diagram of a preset mark being located within a preset breath-holding guide in an embodiment;

[0021] Figure 7 for Figure 5 A schematic diagram of an embodiment in which the preset mark is not located within the preset breath-holding guide;

[0022] Figure 8 A schematic diagram showing preset breathing guidelines and preset breathing limits in some embodiments;

[0023] Fig. 9 A schematic diagram of a flow chart for controlling the working state of a medical device in some embodiments;

[0024] Fig.10 A schematic diagram of a process of displaying a background image in some embodiments;

[0025] Fig.11 A schematic diagram of a process for determining a background image in some embodiments;

[0026] Fig.12 A schematic diagram of a process for displaying interactive information in some embodiments;

[0027] Fig.13 is a schematic diagram of a display interface in some embodiments;

[0028] Fig.14 Schematic diagram of a module of a human-computer interaction device of a medical system in some embodiments. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0030] The human-computer interaction method of the medical system provided in the embodiment of the present application can be applied to the medical system. The medical system includes: medical equipment and display equipment. The medical equipment can be medical imaging equipment such as MRI equipment, CT equipment, PET-CT equipment, or medical treatment equipment such as RT equipment, all of which have certain requirements for the patient's respiratory movement. The display device can be a VR (Virtual Reality) device worn on the patient's head, or a projection device that projects on the inner wall of the aperture of the medical device, both of which can interact visually with the patient.

[0031] In some embodiments, Figure 1 As shown, a human-computer interaction method for a medical system is provided, and the method is applied to a medical system as an example for explanation, and includes the following steps:

[0032] Step S110: displaying a preset logo in the information display interface.

[0033] Specifically, during the operation of the medical system, the medical system controls the display device to display a preset logo in the information display interface. The information display interface may be a portion or all of the display interface of the display device. The preset logo may be a default logo that cannot be changed, such as a light spot; or a personalized logo whose style can be changed, such as a balloon, a star, a flying bird, etc. In the case where the style of the preset logo can be changed, the user can select the style of the preset logo through the user interaction interface, and then display it in the information display interface after the selection.

[0034] Step S120, obtaining current breathing parameters.

[0035] Specifically, during the operation of the medical system, the medical system will also obtain the patient's current respiratory parameters in real time. The medical system can monitor the patient's current respiratory movement through VSM (Vital Signs Monitor) equipment, respiratory straps, millimeter wave radar and other equipment to obtain the current respiratory parameters. By obtaining the respiratory parameters over a period of time, the patient's exhalation curve can be determined. The respiratory parameters can be lung capacity or intrapulmonary air pressure, etc., which are used to indicate the patient's current exhalation state.

[0036] Step S130, controlling the preset mark to move in the information display interface based on the breathing parameter.

[0037] Specifically, after the medical system obtains the current breathing parameters, it controls the movement of the preset mark in the information display interface according to the current breathing parameters. In some embodiments, the preset mark can only move on the midline of the information display interface to avoid movement of the patient's head. In this case, when it is determined according to the breathing parameters that the patient is exhaling, the preset mark moves downward along the midline; when it is determined according to the breathing parameters that the patient is inhaling, the preset mark moves upward along the midline; when it is determined according to the breathing parameters that the patient is holding his breath, the preset mark is fixed. It can be understood that the distance moved by the preset mark is proportional to the breathing amplitude. The larger the breathing amplitude, the larger the movement range of the preset mark on the midline. In some other embodiments, the preset mark can also move from one end of the information display interface to the other end over time, and move cyclically in this way.

[0038] The human-computer interaction method of the above-mentioned medical system displays a preset logo in the information display interface, and then controls the movement of the preset logo in the information display interface according to the current respiratory parameters obtained, thereby displaying the patient's current respiratory status in a visual manner, and conducting personalized visual interaction with the patient, thereby improving the patient's experience in the medical device, alleviating the patient's psychological pressure during the medical process, reducing the patient's movement in the medical device, and thus improving the medical effect.

[0039] Specific examples, such as Figure 2 As shown, it is a schematic diagram of the movement of the preset mark in the information display interface in some embodiments. The preset mark in this embodiment is set as a circular light spot, and the preset mark is also accompanied by a gradually fading historical movement trajectory. Through this setting, the patient can intuitively understand the breathing curve in the previous few seconds. At the same time, the patient's attention can be reduced through the gradually fading setting. The preset mark can only move on the midline of the information display interface to avoid movement of the patient's head. At the same time, the information display interface also displays the preset mark prompt text: "The middle mark point represents your breathing state. When you exhale, the mark point drops, and when you inhale, the mark point rises" to remind the patient of the meaning of the preset mark when it moves, so that the patient can view the current breathing state more intuitively and more experientially, and relieve psychological pressure.

[0040] In some embodiments, the human-computer interaction method of the medical system further includes: displaying breathing instructions in the information display interface, the breathing instructions including: at least one of preset breathing instructions, preset breathing limits, and preset breath holding instructions, the preset breathing instructions including the movement path of the preset mark, the preset breathing limits including the movement range indicating the preset mark, and the preset breath holding instructions including breath holding start instructions and / or breath holding end instructions. By setting different breathing instructions, the patient's current breathing state can be guided intuitively in a visual manner.

[0041] In some embodiments, Figure 3 As shown, the breathing instructions displayed in the information display interface only include preset breathing instructions, and the preset breathing instructions include the moving path of the preset mark. The preset breathing instructions are preset breathing trajectories, and their trajectories are similar to breathing curves. The preset breathing instructions have specific breathing frequencies and breathing amplitudes, which are used to intuitively guide the patient's current breathing state. During the breathing process, the patient needs to maintain the preset mark in the preset breathing instructions and move, so as to adjust the patient's current breathing state to a specific preset breathing state. In some embodiments, when the information display interface displays the preset breathing instructions, it also synchronously displays the preset breathing instructions prompt text: "Please follow the breathing frequency channel guidance" to prompt the patient to breathe according to the guidance of the preset breathing instructions. In some other embodiments, the preset breathing instructions can also use other display methods to complete the guidance of the patient's breathing state. For example, the preset mark is set to a flower bud, and the action of the flower blooming or contracting is used to indicate the patient's inhalation or exhalation action. The amplitude of the flower blooming or contracting is used to indicate the amplitude of the patient's inhalation or exhalation. Correspondingly, the preset breathing instructions can also perform the same action. The patient can complete the corresponding breathing instructions by controlling the action of the preset mark to follow the action of the preset breathing instructions.

[0042] In some embodiments, due to differences in breathing abilities of different patients, the patient may not be able to reach a preset breathing guideline set by default. In this case, when determining the preset breathing guideline, the breathing training parameters are first obtained, and then the preset breathing guideline is determined based on the breathing training parameters. The breathing training parameters are breathing limit parameters measured by the patient in the free breathing state during breathing training, such as the maximum exhalation amplitude, the maximum inhalation amplitude, the maximum breath holding time, etc. By adjusting the displayed preset breathing guideline according to the breathing training parameters, the preset breathing guideline can be made more suitable for the current patient's breathing ability.

[0043] In some embodiments, during the process of medical treatment of patients by medical equipment, there may be mandatory breathing state requirements. In this case, when determining the preset breathing guidelines, the medical project parameters are first obtained, and then the preset breathing guidelines are determined based on the medical project parameters. The medical project parameters are used to indicate the medical projects that the patient currently needs to undergo, such as imaging examinations or radiotherapy of organs such as the lungs, liver, breasts, and abdominal cavity. Each medical project corresponds to a breathing trajectory, and multiple medical projects can also correspond to one breathing trajectory. By determining the preset breathing guidelines to be displayed based on the medical project parameters, the preset breathing guidelines can be more adapted to the needs of the current medical project.

[0044] In some embodiments, when determining the preset breathing guidelines, the preset breathing guidelines can also be determined in combination with the breathing training parameters and the medical project parameters. First, the breathing training parameters and the medical project parameters are obtained, and then the preset breathing guidelines are determined based on the breathing training parameters and the medical project parameters. In the present embodiment, different medical projects correspond to different breathing trajectories, but a certain adjustment range is set for each breathing trajectory, and the breathing trajectory adjusted within this adjustment range can meet the needs of the current medical project. When adjusting the breathing trajectory, based on the acquired breathing training parameters, the breathing trajectory is adjusted within the preset adjustment range, so that the adjusted breathing trajectory is adapted to the patient's breathing ability as much as possible, so that the preset breathing guidelines finally determined take into account the needs of the medical project and the patient's breathing ability.

[0045] In some embodiments, Figure 4As shown, the breathing guidance only includes preset breathing limits, and the preset breathing limits are used to indicate the moving range of the preset mark. The preset breathing limits are pre-set breathing limits. Depending on the usage scenario, the preset breathing limits have an upper breathing limit and / or a lower breathing limit. The preset breathing limits are only used to limit the breathing amplitude, so as to intuitively assist the patient to control the current breathing amplitude. During the breathing process, the patient needs to maintain the preset mark within the preset breathing limit, so as to adjust the patient's current breathing state to a specific preset breathing state. In some embodiments, when the information display interface displays the preset breathing limit, it also synchronously displays the preset breathing limit prompt text: "Please control your breathing so that the mark point does not exceed the boundary" to prompt the patient to breathe according to the requirements of the preset breathing limit. In some embodiments, the information display interface will also synchronously display the progress bar of the current breathing action. As time goes on, the progress bar gradually moves, thereby prompting the patient the remaining time of the current breathing action. In some other embodiments, the preset breathing limit can also use other display methods to limit the patient's breathing amplitude. For example, the preset mark is set to a flower bud, and the action of the flower blooming or contracting is used to represent the patient's inhalation or exhalation action, and the amplitude of the flower blooming or contracting is used to represent the patient's inhalation or exhalation amplitude. At this time, the preset breathing limit can be set to a circle with the flower bud as the center to limit the patient's breathing amplitude.

[0046] In some embodiments, since the breathing abilities of different patients are different, different preset breathing limits need to be determined for different patients. When determining the preset breathing limits, the breathing training parameters are first obtained, and then the preset breathing limits are determined based on the breathing training parameters. The breathing training parameters are breathing limit parameters measured by the patient in the free breathing state during breathing training, such as the maximum exhalation amplitude, the maximum inhalation amplitude, the maximum breath holding time, etc. By adjusting the displayed preset breathing limits according to the breathing training parameters, the preset breathing limits can be made more suitable for the current patient's breathing ability.

[0047] In some embodiments, during the process of medical treatment of patients by medical equipment, there may be mandatory breathing amplitude requirements. In this case, when determining the preset breathing limit, the medical project parameters are first obtained, and then the preset breathing limit is determined based on the medical project parameters. The medical project parameters are used to indicate the medical project that the patient currently needs to undergo, such as imaging examinations or radiotherapy of organs such as the lungs, liver, breasts, and abdominal cavity. Each medical project corresponds to a breathing limit, and multiple medical projects can also correspond to a breathing limit. By determining the displayed preset breathing limit based on the medical project parameters, the preset breathing limit can be more adapted to the needs of the current medical project.

[0048] In some embodiments, when determining the preset breathing limit, the preset breathing limit can also be determined in combination with the breathing training parameters and the medical project parameters. First, the breathing training parameters and the medical project parameters are obtained, and then the preset breathing limit is determined based on the breathing training parameters and the medical project parameters. In the present embodiment, different medical projects correspond to different breathing limits, but a certain adjustment range is set for each breathing limit, and the breathing limit adjusted within this adjustment range can meet the needs of the current medical project. When adjusting the breathing limit, based on the acquired breathing training parameters, the breathing limit is adjusted within the preset adjustment range, so that the adjusted breathing limit is adapted to the patient's breathing ability as much as possible, so that the preset breathing limit finally determined takes into account the needs of the medical project and the patient's breathing ability.

[0049] In some embodiments, Figure 5 As shown, the breathing instructions only include preset breath-holding instructions, which are used to indicate the breath-holding time at a preset breathing amplitude, and the preset breath-holding instructions include breath-holding start instructions and / or breath-holding end instructions. The preset breath-holding instructions are preset breath-holding trajectories, which are used to indicate the breathing amplitude and breath-holding time during breath-holding, so as to intuitively assist the patient in controlling the current breath-holding action. During the breath-holding process, the patient needs to maintain the preset mark within the preset breath-holding instructions, so as to adjust the patient's current breathing state to a specific preset breath-holding state. In some embodiments, when the information display interface displays the preset breath-holding instructions, it also simultaneously displays the preset breath-holding instructions start prompt text: "Prepare to hold your breath", to prompt the patient to start preparing for breath-holding. As shown in FIG. Figure 6 As shown, when the patient adjusts the preset mark to the breath holding track and moves to the breath holding start guide, the patient starts to hold his breath until the preset mark passes the breath holding end guide, and then ends the breath holding. In some embodiments, during the breath holding process, the information display interface also synchronously displays the preset breath holding guide maintenance prompt text: "Please maintain the breath holding state" to prompt the patient to continue holding his breath. In some embodiments, as Figure 7 As shown, when the patient is unable to maintain the preset mark within the preset breath-holding guideline during the breath-holding process, the information display interface will also synchronously display the preset breath-holding guideline deviation prompt text: "Please return to the breath-holding threshold", to prompt the patient to continue to hold his breath in accordance with the preset breath-holding guideline. In some other embodiments, the preset breath-holding guideline can also be displayed in other ways to guide the patient to hold his breath. For example, the preset mark is set to a flower bud, and the action of the flower blooming or contracting is used to indicate the patient's inhalation or exhalation action. The amplitude of the flower blooming or contracting is used to indicate the amplitude of the patient's inhalation or exhalation. At this time, the preset breath-holding guideline can be set to a circle with the flower bud as the center. When holding the breath is required, the circle changes color or fluctuates to indicate that the patient needs to hold his breath. After the breath-holding ends, the circle returns to its previous state, thereby indicating that the breath-holding ends.

[0050] In some embodiments, due to differences in breathing abilities of different patients, the breathing amplitude and breath-holding time of different patients when holding their breath are also different. When determining the preset breath-holding instructions, first obtain the breathing training parameters, and then determine the preset breath-holding instructions based on the breathing training parameters. The breathing training parameters are the breathing limit parameters measured by the patient in the free breathing state during breathing training, such as the maximum exhalation amplitude, the maximum inhalation amplitude, the maximum breath-holding time, etc. By adjusting the displayed preset breath-holding instructions according to the breathing training parameters, the preset breath-holding instructions can be made more suitable for the current patient's breathing ability.

[0051] In some embodiments, when the medical device is treating the patient, there may be mandatory requirements for the breathing amplitude and breath-holding time during breath-holding. In this case, when determining the preset breath-holding instructions, the medical project parameters are first obtained, and then the preset breath-holding instructions are determined based on the medical project parameters. The medical project parameters are used to indicate the medical projects that the patient currently needs to undergo, such as imaging examinations or radiotherapy of organs such as the lungs, liver, breast, and abdomen. Each medical project corresponds to a breath-holding trajectory, and multiple medical projects can also correspond to a breath-holding trajectory. By determining the preset breath-holding instructions to be displayed based on the medical project parameters, the preset breath-holding instructions can be made more adapted to the needs of the current medical project.

[0052] In some embodiments, when determining the preset breath-holding guidance, the preset breath-holding guidance can also be determined in combination with the breathing training parameters and the medical project parameters. First, the breathing training parameters and the medical project parameters are obtained, and then the preset breath-holding guidance is determined based on the breathing training parameters and the medical project parameters. In this embodiment, different medical projects correspond to different breath-holding trajectories, but a certain adjustment range is set for each breath-holding trajectory, and the breath-holding trajectory adjusted within this adjustment range can meet the needs of the current medical project. When adjusting the breath-holding trajectory, based on the acquired breathing training parameters, the breath-holding trajectory is adjusted within the preset adjustment range, so that the adjusted breath-holding trajectory is adapted to the patient's breathing ability as much as possible, so that the preset breath-holding guidance finally determined takes into account the needs of the medical project and the patient's breath-holding ability.

[0053] In some embodiments, Figure 8As shown, the breathing instructions include: preset breathing instructions and preset breathing limits, and the preset breathing instructions and the preset breathing limits are displayed simultaneously in the information display interface. When the patient cannot follow the preset breathing instructions to breathe, the patient is instructed not to exceed the preset breathing limits. In some embodiments, the breathing instructions include: preset breathing instructions and preset breath holding instructions, which are transformed into preset breath holding instructions at the end of the preset breathing instructions to instruct the patient to hold his breath immediately after the breathing ends. In some embodiments, the breathing instructions include: preset breathing limits and preset breath holding instructions, and the preset breathing limits and preset breath holding instructions are displayed simultaneously in the information display interface. When the patient cannot follow the preset breath holding instructions to hold his breath, the patient is instructed not to exceed the preset breathing limits. In some embodiments, the breathing instructions include: preset breathing instructions, preset breathing limits and preset breath holding instructions, and the preset breathing instructions, preset breathing limits and preset breath holding instructions are displayed simultaneously in the information display interface. At the end of the preset breathing instructions, the preset breath holding instructions are transformed into preset breath holding instructions to instruct the patient to hold his breath immediately after the breathing ends, and when the patient cannot follow the preset breathing instructions or the preset breath holding instructions, the patient is instructed not to exceed the preset breathing limits.

[0054] In some embodiments, Fig. 9 As shown, the human-computer interaction method of the medical system also includes:

[0055] Step S210, determining a breathing curve based on breathing parameters;

[0056] Step S220, controlling the working state of the medical device based on the breathing curve.

[0057] Specifically, in this embodiment, the medical system controls the working state of the medical device according to the patient's breathing curve determined by the breathing parameters. In some embodiments, when the breathing curve reaches near the maximum amplitude, the medical device is controlled to work. In some embodiments, when the breathing curve reaches near the minimum amplitude, the medical device is controlled to stop working.

[0058] For example, when the medical device is an RT device, the RT device needs to control the beam release of the RT device in combination with the patient's chest rise and fall, that is, perform respiratory gating. At this time, the patient's respiratory curve will be generated according to the patient's respiratory parameters. If it is judged that the patient's respiratory amplitude is about to reach the preset amplitude, the RT device will execute the beam release action; if it is judged that the patient's respiratory amplitude is about to not meet the preset amplitude, it means that the patient's current chest rise and fall does not meet the beam release conditions. In order to avoid causing damage to the patient's healthy tissue, the beam release action of the RT device is directly stopped.

[0059] In some embodiments, Fig.10 As shown, the human-computer interaction method of the medical system also includes:

[0060] Step S310 , responding to the background priority instruction to display the background display interface.

[0061] Specifically, in this embodiment, the display device of the medical system also includes a background display interface for displaying a background image, and the background display interface is stacked with the information display interface. When the medical system obtains the background priority instruction, it will determine the display priority of the background display interface. Generally, the priority of the background display interface is lower than that of the information display interface. In some embodiments, when the information display interface needs to display a preset logo, the dynamic background image in the background display interface will be paused or displayed as a solid color background. The medical system can also determine the background image according to the obtained background selection instruction, and the background image can be a static image or a dynamic image (video). The background image is generally a soothing content such as a landscape with a slow rhythm and will not cause strong emotional fluctuations in the patient. In some embodiments, after the medical system obtains the background selection instruction, it will display multiple preset optional images on the information display interface. After the patient selects through the user interaction interface, the selected image can be used as the background image to be displayed. In some embodiments, the background selection instruction is bound to the medical project, and different medical projects correspond to different background images.

[0062] Step S320: displaying a background image in the background display interface.

[0063] Specifically, after the medical system determines the display priority of the background display interface, the background image can be displayed in the background display interface of the display device. Generally, the background display interface is the display interface at the bottom layer, and the background image displayed therein is used as the background. The content displayed in the information display interface will be overlaid on the background image displayed on the background display interface, and the background image displayed in the background display interface will run through the entire medical process of the medical system. By displaying the background image in the background display interface, it can meet the needs of different scenarios and improve the patient's experience.

[0064] In some embodiments, Fig.11 As shown, in step 320, the step of displaying the background image in the background display interface includes:

[0065] Step S311, acquiring voice description data in response to a background selection instruction.

[0066] Specifically, in this embodiment, when the user needs to select a background image, he first inputs a background selection instruction to the medical system through the user interaction interface. After the medical system obtains the background selection instruction, it turns on the microphone to collect the user's voice description data about the background image content.

[0067] Step S312, performing speech recognition on the speech description data to obtain text description data.

[0068] Specifically, after the medical system obtains the user's voice description data, it performs voice recognition on the voice description data, thereby converting the voice type data into text type text description data. In some embodiments, after voice recognition is performed on the voice description data, text data is obtained. At this time, the text data can also be filtered to filter out text that cannot be recognized and is not suitable for generating images, thereby obtaining the final text description data.

[0069] Step S313, input the text description data into the trained text image generation model to obtain the image to be selected.

[0070] Specifically, after obtaining the text description data, the medical system inputs the text description data into the trained text image generation model to obtain a candidate image, which can be a static or dynamic image. The text image generation model will perform semantic understanding on the text description data to generate a candidate image related to the user's voice description data.

[0071] Step S314: perform image review on the selected images based on the review criteria, and display the selected images that have passed the image review in the background display interface.

[0072] Specifically, after the medical system obtains the selected images, it will also conduct an image review on the selected images based on the preset review standards, thereby filtering out images that are not suitable for display as backgrounds, and using the selected images that have passed the image review as background images, and displaying them in the background display interface. In some embodiments, the review standards may be: filtering out images that may cause visual discomfort to patients (such as large lens movements, focusing or defocusing, etc.); filtering out images whose content is not suitable for patients to watch; filtering out images in which strangers appear, preferably soothing natural and animal images. The method of generating background images based on voice description data in this embodiment can generate customized visual content in real time based on the patient's voice description, which can provide patients with a highly personalized visual experience and further reduce patients' anxiety.

[0073] In some embodiments, Fig.12 As shown, the human-computer interaction method of the medical system also includes:

[0074] Step S410, responding to the interaction priority instruction to display an interaction display interface.

[0075] Specifically, the display device of the medical system in this embodiment also includes an interactive display interface for displaying interactive information, and the information display interface, the background display interface and the interactive display interface are stacked. When the medical system obtains the interactive priority instruction, it will determine the display priority of the interactive display interface. Fig.13As shown, the interactive display interface has the highest priority and the background display interface has the lowest priority. In some embodiments, when the interactive display interface needs to display interactive information, the dynamic background image in the background display interface will be paused, and the preset logo and breathing instructions displayed in the information display interface will be weakened. In some embodiments, only the interactive information displayed by the interactive display interface can be displayed on the top layer, and the content displayed by the background display interface and the information display interface will not be processed. The medical system can also determine the interactive information based on the obtained technician interaction instructions. The interactive information is some text information sent from the technician end, such as technician instructions, technician voice subtitles, etc. The technician can select or enter the corresponding information from the user operation interface of the technician end, and the medical system can determine the corresponding interactive information.

[0076] Step S420: display the interaction information in the interaction display interface.

[0077] Specifically, after the medical system determines the priority of the interactive display interface, it will control the display device to display the interactive information in a visual manner in the interactive display interface. The interactive information is generally simple, clear, and easy to understand, which can avoid increasing the patient's anxiety. By displaying the interactive information in a visual manner in the interactive display interface, the patient's cooperation can be improved (especially patients with poor hearing).

[0078] In some embodiments, the human-computer interaction method of the medical system further includes: obtaining ambient light information, and adjusting the brightness of the display device based on the ambient light information. Specifically, in this embodiment, the display device is a projection device, which is easily affected by ambient light. Therefore, the medical system obtains ambient light information at the medical device through a light sensor, and then adjusts the brightness of the display device according to different ambient light information, thereby completing adaptive changes in brightness according to different lighting environments, so that the display effect of the display device is better.

[0079] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0080] Based on the same inventive concept, the embodiment of the present application also provides a medical system human-computer interaction device for implementing the medical system human-computer interaction method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of one or more medical system human-computer interaction devices provided below can refer to the limitations of the medical system human-computer interaction method above, and will not be repeated here.

[0081] In some embodiments, Fig.14 As shown, a human-computer interaction device of a medical system is provided, comprising: a preset identification display module, a respiratory parameter acquisition module and a movement control module, wherein:

[0082] A preset logo display module, used to display a preset logo in the information display interface;

[0083] A breathing parameter acquisition module is used to obtain current breathing parameters;

[0084] The movement control module is used to control the movement of the preset mark in the information display interface based on the breathing parameters.

[0085] In some embodiments, the human-computer interaction device of the medical system further includes: a guidance mark display module, which is used to display breathing guidelines in the information display interface; wherein the breathing guidelines include: at least one of preset breathing guidelines, preset breathing limits, and preset breath-holding guidelines, the preset breathing guidelines include the moving path of the preset mark, the preset breathing limits include indicating the moving range of the preset mark, and the preset breath-holding guidelines include breath-holding start guidelines and / or breath-holding end guidelines.

[0086] In some embodiments, the human-computer interaction device of the medical system further includes: a guidance mark determination module, which is used to obtain breathing training parameters and / or medical project parameters; and determine breathing guidance based on the breathing training parameters and / or medical project parameters.

[0087] In some embodiments, the human-computer interaction device of the medical system further includes: a medical equipment control module, which is used to determine a breathing curve based on breathing parameters; and control a working state of the medical equipment based on the breathing curve.

[0088] In some embodiments, the human-computer interaction device of the medical system further includes: a background image display module for displaying a background display interface in response to a background priority instruction; wherein the background display interface and the information display interface are stacked; and the background image is displayed in the background display interface.

[0089] In some embodiments, the background image display module is also used to obtain voice description data in response to a background selection instruction; perform voice recognition on the voice description data to obtain text description data; input the text description data into a trained text video generation model to obtain a candidate image; perform image review on the candidate image based on the review criteria, and display the candidate image that has passed the image review in the background display interface.

[0090] In some embodiments, the human-computer interaction device of the medical system further includes: an interactive information display module for displaying an interactive display interface in response to an interactive priority instruction; wherein the information display interface, the background display interface and the interactive display interface are stacked; and the interactive information is displayed in the interactive display interface.

[0091] Each module in the human-computer interaction device of the above medical system can be implemented in whole or in part by software, hardware and a combination thereof. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.

[0092] In some embodiments, a medical system is provided, the medical system comprising: a medical device and a display device, the medical system further comprising a memory and a processor, the memory storing a computer program, and the processor implementing the steps in the above-mentioned method embodiments when executing the computer program.

[0093] In some embodiments, a computer-readable storage medium is provided, on which a computer program is stored, and when the processor executes the computer program, the steps in the above-mentioned method embodiments are implemented.

[0094] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0095] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0096] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A human-computer interaction method for a medical system, characterized in that: The method comprises: Displaying a preset logo in the information display interface; Get the current breathing parameters; The preset mark is controlled to move in the information display interface based on the breathing parameter.

2. The human-computer interaction method of a medical system according to claim 1, characterized in that: The method further comprises: Breathing instructions are displayed in the information display interface; wherein the breathing instructions include: at least one of preset breathing instructions, preset breathing limits, and preset breath holding instructions, the preset breathing instructions include a moving path of the preset mark, the preset breathing limits include an indication of a moving range of the preset mark, and the preset breath holding instructions include a breath holding start instruction and / or a breath holding end instruction.

3. The human-computer interaction method for a medical system according to claim 2, characterized in that: The method further comprises: Obtaining respiratory training parameters and / or medical program parameters; The breathing guidance is determined based on the breathing training parameters and / or the medical procedure parameters.

4. The human-computer interaction method for a medical system according to claim 1, characterized in that: The method further comprises: determining a breathing curve based on the breathing parameters; The working state of the medical device is controlled based on the breathing curve.

5. The human-computer interaction method for a medical system according to any one of claims 1 to 4, characterized in that: The method further comprises: Responding to the background priority instruction to display a background display interface; wherein the background display interface is stacked with the information display interface; Display the background image in the background display interface.

6. The human-computer interaction method for a medical system according to claim 5, characterized in that: The step of displaying the background image in the background display interface includes: acquiring voice description data in response to a context selection instruction; Performing speech recognition on the speech description data to obtain text description data; Inputting the text description data into a trained text image generation model to obtain a candidate image; The image to be selected is subject to image review based on review criteria, and the image to be selected that has passed the image review is displayed in the background display interface.

7. The human-computer interaction method for a medical system according to claim 5, characterized in that: The method further comprises: Responding to the interaction priority instruction to display an interactive display interface; wherein the information display interface, the background display interface and the interactive display interface are stacked; The interactive information is displayed in the interactive display interface.

8. A human-computer interaction device for a medical system, characterized in that: The device comprises: A preset logo display module, used to display a preset logo in the information display interface; A breathing parameter acquisition module is used to obtain current breathing parameters; A movement control module is used to control the movement of the preset mark in the information display interface based on the breathing parameter.

9. A medical system, characterized in that: The medical system comprises: a medical device and a display device. The medical system further comprises a memory and a processor. The memory stores a computer program. When the processor executes the computer program, the steps of the method described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images