Human-computer interaction method and apparatus for medical system, and medical system and storage medium

Abstract

The present application relates to a human-computer interaction method and apparatus for a medical system, and a medical system and a storage medium, which are applied to the technical field of medical system control. The method comprises: displaying a preset identifier in an information display interface; acquiring a current respiratory parameter; and on the basis of the respiratory parameter, controlling the preset identifier to move in the information display interface.

Description

Human-computer interaction methods, devices, medical systems, and storage media for medical systems

[0001] Related applications

[0002] This application claims priority to Chinese patent application filed on November 27, 2024, application number 202411721077.8, entitled "Human-computer interaction method, apparatus, medical system and storage medium for medical systems", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of medical system control technology, and in particular to a human-computer interaction method, device, medical system, and storage medium for a medical system. Background Technology

[0004] Large medical devices such as MRI (Magnetic Resonance Imaging), CT (Computed Tomography), PET-CT (Positron Emission Tomography-Computed Tomography), and RT (Radiation Therapy) devices all have specific requirements for patients' respiratory movements. These requirements aim to reduce or eliminate image artifacts caused by respiratory movements during medical imaging, or to minimize radiation deviations due to respiratory movements during treatment, thereby improving the accuracy and efficacy of the treatment. Traditional techniques involve pre-treatment breathing training to help patients maintain good breathing habits and improve treatment outcomes. However, due to the structural limitations of medical devices, patients may still experience psychological stress (such as anxiety, discomfort, and claustrophobia) during treatment, leading to less than ideal results. Summary of the Invention

[0005] This application provides a human-computer interaction method, apparatus, medical system, and storage medium for a medical system.

[0006] In a first aspect, this application provides a human-computer interaction method for a medical system. The method includes: displaying a preset identifier in an information display interface; acquiring current respiratory parameters; and controlling the preset identifier to move within the information display interface based on the respiratory parameters.

[0007] In some embodiments, the method further includes: displaying breathing regulation guidance in the information display interface; wherein the breathing regulation guidance includes at least one of: preset breathing guidance, preset breathing limit, and preset breath-holding guidance, the preset breathing guidance includes a movement path of the preset indicator, the preset breathing limit includes a movement range indicating the preset indicator, and the preset breath-holding guidance includes at least one of breath-holding start guidance and breath-holding end guidance.

[0008] In some embodiments, the method further includes: acquiring at least one of breathing training parameters and medical procedure parameters; and determining the breathing regulation guidance based on at least one of the breathing training parameters and the medical procedure parameters.

[0009] In some embodiments, the breathing training parameters include at least one of maximum expiratory amplitude, maximum inspiratory amplitude, and maximum breath-holding time.

[0010] In some embodiments, the method further includes: determining a respiratory curve based on the respiratory parameters; and controlling the operating state of the medical device based on the respiratory curve.

[0011] In some embodiments, the method further includes: displaying a background display interface in response to a background priority instruction; wherein the background display interface is stacked with the information display interface; and displaying a background image in the background display interface.

[0012] In some embodiments, the step of displaying a background image in the background display interface includes: obtaining speech description data in response to a background selection instruction; performing speech recognition on the speech description data to obtain text description data; inputting the text description data into a trained text image generation model to obtain candidate images; performing image review on the candidate images based on review criteria, and displaying the candidate images that have passed the image review in the background display interface.

[0013] In some embodiments, the method further includes: displaying an interactive display interface in response to an interaction priority instruction; wherein the information display interface, the background display interface, and the interactive display interface are stacked; and interactive information is displayed in the interactive display interface.

[0014] In some embodiments, respiratory parameters include at least one of lung volume and intrapulmonary pressure.

[0015] In some embodiments, controlling the movement of a preset identifier in the information display interface based on respiratory parameters includes: determining the current respiratory state of the target object based on respiratory parameters; and controlling the movement of the preset identifier in the information display interface based on the respiratory state.

[0016] In some embodiments, the breathing state includes an exhalation state, an inhalation state, and a breath-holding state.

[0017] In some embodiments, controlling the movement of a preset icon in the information display interface based on the breathing state includes: when the breathing state is exhalation, controlling the preset icon to move along a first direction; when the breathing state is inhalation, controlling the preset icon to move along a second direction; the first direction is opposite to the second direction; and when the breathing state is breath-holding, controlling the preset icon to remain stationary.

[0018] Secondly, this application also provides a human-computer interaction device for a medical system. The device includes: a preset identifier display module for displaying a preset identifier in an information display interface; a respiratory parameter acquisition module for acquiring current respiratory parameters; and a movement control module for controlling the preset identifier to move within the information display interface based on the respiratory parameters.

[0019] Thirdly, this application also provides a medical system. The medical system includes a medical device and a display device, and further includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the steps of the method described in the first aspect embodiment.

[0020] Fourthly, this application also provides a medical system, comprising:

[0021] Medical devices are configured to image or treat patients;

[0022] The display device is configured to display at least one of breathing guidance information and interactive information, as well as background information, within the patient's field of vision;

[0023] The background information is located at the bottom layer of the display hierarchy.

[0024] In some embodiments, the breathing guidance information includes preset identifiers and breathing regulation guidelines.

[0025] In some embodiments, when the breathing guidance information and the interaction information are displayed simultaneously, the interaction information is located at the top level of the display hierarchy.

[0026] In some embodiments, when the breathing guidance information and the interaction information are displayed simultaneously, the breathing guidance information and the interaction information are both located at the top level of the display hierarchy.

[0027] Fifthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the steps of the method described in the first aspect of the embodiments. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of this application or the conventional technology, the drawings used in the description of the embodiments or the conventional technology will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the disclosed drawings without creative effort.

[0029] Figure 1 is a flowchart illustrating the human-computer interaction method of a medical system in some embodiments of this application;

[0030] Figure 2 is a schematic diagram showing preset identifiers in some embodiments of this application;

[0031] Figure 3 is a schematic diagram showing preset breathing guidance in some embodiments of this application;

[0032] Figure 4 is a schematic diagram showing the preset breathing limit in some embodiments of this application;

[0033] Figure 5 is a schematic diagram showing a preset breath-holding guide in some embodiments of this application;

[0034] Figure 6 is a schematic diagram of the preset identifier located within the preset breath-holding guide in the embodiment of Figure 5;

[0035] Figure 7 is a schematic diagram showing that the preset identifier is not located within the preset breath-holding guide in the embodiment of Figure 5;

[0036] Figure 8 is a schematic diagram showing preset breathing guidelines and preset breathing limits in some embodiments of this application;

[0037] Figure 9 is a flowchart illustrating the control of the working state of a medical device in some embodiments of this application;

[0038] Figure 10 is a flowchart illustrating the display of background images in some embodiments of this application;

[0039] Figure 11 is a flowchart illustrating the process of determining a background image in some embodiments of this application;

[0040] Figure 12 is a flowchart illustrating the display of interactive information in some embodiments of this application;

[0041] Figure 13(a) is a schematic diagram of the display interface in some embodiments of this application;

[0042] Figure 13(b) is a schematic diagram of the display hierarchy when the display device displays different information in some embodiments of this application;

[0043] Figure 14 is a schematic diagram of the human-computer interaction device of a medical system in some embodiments of this application. Detailed Implementation

[0044] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0045] The human-computer interaction method for a medical system provided in this application embodiment can be applied to a medical system. The medical system includes medical equipment and a display device. The medical equipment can be medical imaging equipment such as MRI (Magnetic Resonance Imaging), CT (Computed Tomography), or PET-CT (Positron Emission Tomography-Computed Tomography), or medical treatment equipment such as RT (Radiation Therapy), all of which require certain respiratory movements from the patient. The display device can be a VR (Virtual Reality) device worn on the patient's head, AR (Augmented Reality) glasses, a display screen placed next to the medical equipment or in the examination room, or a projection device that projects onto the inner wall of the aperture of the medical equipment; all of these can enable visual interaction with the patient.

[0046] In some embodiments, as shown in Figure 1, a human-computer interaction method for a medical system is provided. Taking the application of this method to a medical system as an example, the method includes the following steps:

[0047] Step S110: Display the preset identifier in the information display interface.

[0048] Specifically, during the operation of the medical system, the medical system controls the display device to display preset icons on the information display interface. The information display interface can be part or all of the display device's interface. Specifically, if the display device is a VR device, the information display interface can be part or all of the VR headset's display screen area; if the display device is AR glasses, the information display interface can be part or all of the virtual interactive area superimposed on the patient's real field of vision by the AR glasses; if the display device is a display screen, the information display interface can be part or all of the display screen's physical display area; if the display device is a projection device, the information display interface is part or all of the visible area covered after the projection device projects the content onto the inner wall of the medical device's aperture. Preset icons can be default, unchangeable icons, such as a light spot; or personalized icons whose style can be changed, such as balloons, stars, or birds. Preset icons can also be pre-set icons whose style can be changed; for example, users can select the style of the preset icons through a user interface before displaying them on the information display interface.

[0049] Step S120: Obtain the current respiratory parameters.

[0050] Specifically, during the operation of the medical system, it also acquires the patient's current respiratory parameters in real time. The medical system can monitor the patient's current respiratory movements using devices such as VSM (Vital Signs Monitor), breathing straps, and millimeter-wave radar to obtain the current respiratory parameters. By acquiring respiratory parameters over a period of time, a respiratory curve can be determined for the patient. A respiratory curve is a graphical tool used to visually present the human respiratory state and characteristics; its horizontal axis represents time, and its vertical axis represents respiratory-related indicators such as respiratory rate and respiratory amplitude. The medical system can collect the patient's respiratory parameters in real time using monitoring devices such as chest and abdominal pressure sensors, optical motion capture devices, and pulmonary function monitors. These respiratory parameters can include at least one of the following: respiratory amplitude, respiratory cycle, inspiratory duration, expiratory rate, chest and abdominal displacement, lung volume, and intrapulmonary pressure. Based on these respiratory parameters, the system determines the patient's current respiratory state. The respiratory state can be a phased description reflecting the patient's real-time respiratory status; the patient's current respiratory state can include at least one of expiratory state, inspiratory state, and breath-holding state.

[0051] Step S130: Based on respiratory parameters, control the preset marker to move in the information display interface.

[0052] Specifically, after acquiring the current respiratory parameters, the medical system controls the movement of a preset marker on the information display interface based on these parameters. The movement of the preset marker includes, but is not limited to, linear positional changes (such as vertical or horizontal movement) and dynamic changes in its blooming form (such as the opening and closing of a flower, or the diffusion and narrowing of a starburst). The preset marker moves within the information display interface, specifically within the central area of ​​the patient's field of vision. The patient's field of vision, as described in this application, refers to the visible area on the effective display surface of the display device that can be covered by the patient's line of sight when the patient is in a preset position (such as lying down) with both eyes looking straight ahead. The central area of ​​the patient's field of vision refers to the core sub-region formed by extending outwards from the midpoint of the line connecting the patient's lines of sight to the effective display surface of the display device, which has the highest visual recognition priority and can be clearly perceived without shifting the eyeballs.

[0053] In some embodiments, the preset marker can move up and down within the information display interface. For example, it can move upwards in conjunction with the patient's inhalation and downwards in conjunction with the patient's exhalation to simulate organ movement during human respiration and form a corresponding movement path on the information display interface. For instance, the preset marker can move up and down relative to a horizontal line to form a sinusoidal path.

[0054] In some embodiments, a preset marker moves up and down along a vertical baseline of the information display interface to prevent movement of the patient's head. Correspondingly, the movement path formed on the information display interface can be moved relative to the preset marker to keep it positioned on the vertical baseline. The vertical baseline can be set in the central area of ​​the patient's field of vision to ensure that the preset marker moves within the central area of ​​the patient's field of vision. In some examples, the vertical baseline can be specifically set as the center line of the information display interface.

[0055] In some embodiments, controlling the movement of a preset marker in the information display interface based on respiratory parameters includes: determining the current respiratory state of the target object based on the respiratory parameters; and controlling the movement of the preset marker in the information display interface based on the respiratory state. Specifically, the target object may include a patient, and the current respiratory state may include at least one of exhalation, inhalation, and breath-holding. For example, in response to obtaining that the current respiratory state is inhalation, the preset marker can be controlled to move upward; in response to obtaining that the current respiratory state is exhalation, the preset marker can be controlled to move downward. In some examples, the respiratory state may also include peak inhalation and end-expiratory breath-holding. In response to obtaining that the current respiratory state is peak inhalation, the preset marker can be controlled to stop moving upward and prepare to move downward; in response to obtaining that the current respiratory state is end-expiratory breath-holding, the preset marker can be controlled to stop moving downward and prepare to move upward. Furthermore, the movement position and speed of the preset marker can be controlled in conjunction with the control of respiratory parameters. For example, the chest and abdominal displacement value or lung volume percentage can be proportionally converted into the movement position of the preset marker on the vertical baseline of the information display interface, and the movement speed of the preset marker can be dynamically adjusted according to the real-time changes in the patient's respiratory rhythm.

[0056] In some embodiments, controlling the movement of a preset indicator in the information display interface based on the breathing state includes: controlling the preset indicator to move along a first direction when the breathing state is exhalation; controlling the preset indicator to move along a second direction when the breathing state is inhalation; the first direction being opposite to the second direction; and controlling the preset indicator to remain stationary when the breathing state is breath-holding. Specifically, the first direction may include a downward direction along a vertical baseline in the information display interface; the second direction may include an upward direction along a vertical baseline in the information display interface.

[0057] In some examples, when the respiratory parameters determine that the patient is exhaling, the preset indicator moves downward along the vertical baseline; when the respiratory parameters determine that the patient is inhaling, the preset indicator moves upward along the vertical baseline; and when the respiratory parameters determine that the patient is holding their breath, the preset indicator remains stationary. It is understood that the distance the preset indicator moves is proportional to the respiratory amplitude; the greater the respiratory amplitude, the greater the range of movement of the preset indicator along the vertical baseline. In other embodiments, the preset indicator may also move from one end of the information display interface to the other over time, and cyclically in this manner.

[0058] The human-computer interaction method of the above-mentioned medical system displays a preset icon on the information display interface, and then controls the preset icon to move on the information display interface according to the current respiratory parameters. This displays the patient's current respiratory status in a visual animation, enabling personalized visual interaction with the patient, improving the patient's experience in the medical device, relieving the patient's psychological stress during the medical process, reducing the patient's movement in the medical device, and thus improving the medical effect.

[0059] As shown in Figure 2, a specific example illustrates the movement of a preset marker within the information display interface in some embodiments. In this embodiment, the preset marker is a circular light dot, accompanied by a gradually fading historical trajectory. That is, it only displays the breathing curve within a preset time range from the current moment, and the breathing curve exhibits a gradual change attribute. This setting allows the patient to intuitively understand the breathing curve of the previous few seconds. Simultaneously, the gradual fading reduces patient distraction. For example, the gradual change attribute of the breathing curve can be a change in color from light to dark, a change in grayscale from low to high, or a change in line thickness from thin to thick, etc. The preset marker moves within the central area of ​​the patient's field of vision. For example, the preset marker can move upwards within the central area in conjunction with the patient's inhalation and downwards within the central area in conjunction with the patient's exhalation. For example, the preset marker moves along the vertical baseline of the information display interface, thereby preventing head movement. In some examples, the vertical baseline can be specifically set as the center line of the information display interface. Meanwhile, the information display interface also displays a preset indicator prompt text: "The middle indicator point represents your breathing status. When exhaling, the indicator point descends, and when inhaling, the indicator point rises," to remind patients of the meaning represented by the preset indicator movement, so that patients can view their current breathing status more intuitively and with a more experiential feel, relieving psychological stress.

[0060] In some embodiments, the human-computer interaction method of the medical system further includes: displaying breathing regulation guidance in an information display interface. The breathing regulation guidance includes at least one of: preset breathing guidance, preset breathing limits, and preset breath-holding guidance. The preset breathing guidance includes a movement path of a preset indicator, the preset breathing limits include a movement range indicating the preset indicator, and the preset breath-holding guidance includes at least one of breath-holding start guidance and breath-holding end guidance. By setting different breathing regulation guidelines, the patient's current breathing state can be guided intuitively and visually.

[0061] In some embodiments, as shown in FIG3, the breathing regulation guidance displayed in the information display interface includes a preset breathing guide, which includes a movement path of a preset indicator. To ensure that the preset indicator always moves within the information display interface, the preset indicator can be set to move up and down within the central area of ​​the information display interface, or specifically, the preset indicator can move up and down along the vertical baseline of the information display interface. Correspondingly, the movement path formed by the preset indicator can move unidirectionally in the horizontal direction and fade out at the boundary of the information display interface to ensure that the patient's line of sight to the preset indicator does not shift left or right. Those skilled in the art should understand that the two movement path curves shown in FIG3 represent the movement of the preset indicator between the two movement path curves, but this does not limit the scope of protection of the present invention. For example, the preset breathing guide can be one or more movement path curves, or it can be in a form other than curves, as long as it can guide the change process of breathing. The preset breathing guide is a pre-set breathing trajectory, which is similar to the breathing curve. The preset breathing guide has a specific breathing frequency and breathing amplitude, which is used to intuitively guide the patient's current breathing state. During breathing, the patient needs to keep the preset indicator moving within the preset breathing guide, thereby adjusting the patient's current breathing state to a specific preset breathing state. In some embodiments, when displaying the preset breathing guidance, the information display interface also simultaneously displays the preset breathing guidance prompt text: "Please follow the breathing rate channel guidance," to prompt the patient to breathe according to the preset breathing guidance. In some other embodiments, the preset breathing guidance can also use other display methods to guide the patient's breathing state. For example, the preset icon can be set as a flower bud, with the flower opening or closing to represent the patient's inhalation or exhalation, and the amplitude of the flower opening or closing to represent the amplitude of the patient's inhalation or exhalation. Correspondingly, the preset breathing guidance can also perform the same actions. By controlling the actions of the preset icon to follow the actions of the preset breathing guidance, the patient can complete the corresponding breathing regulation guidance.

[0062] In some embodiments, due to differences in respiratory capacity among patients, a patient may not be able to achieve a preset breathing guideline. In this case, when determining the preset breathing guideline, breathing training parameters are first obtained, and then the preset breathing guideline is determined based on these parameters. Breathing training parameters are the respiratory limit parameters measured during the patient's free breathing state during breathing training, such as maximum expiratory amplitude, maximum inspiratory amplitude, and maximum breath-holding time. By adjusting the displayed preset breathing guideline according to the breathing training parameters, the preset breathing guideline can be better adapted to the current patient's respiratory capacity.

[0063] In some embodiments, medical devices may have mandatory breathing requirements during patient treatment. In such cases, when determining preset breathing guidelines, medical procedure parameters are first obtained, and then the preset breathing guidelines are determined based on these parameters. Medical procedure parameters indicate the medical procedure the patient currently needs to undergo, such as imaging examinations or radiotherapy of organs like the lungs, liver, breast, or abdominal cavity. Each medical procedure corresponds to a breathing trajectory, and multiple medical procedures can also correspond to a single breathing trajectory. By determining the displayed preset breathing guidelines based on medical procedure parameters, the preset breathing guidelines can be more tailored to the needs of the current medical procedure.

[0064] In some embodiments, when determining the preset breathing guidelines, breathing training parameters and medical project parameters can also be combined. First, breathing training parameters and medical project parameters are acquired, and then the preset breathing guidelines are determined based on these parameters. It should be noted that the breathing trajectory can refer to the dynamic breathing standards that a medical project pre-sets for patients to follow in order to achieve precise diagnosis and treatment. In this embodiment, different medical projects pre-set different breathing trajectories, and for each breathing trajectory, an adjustment range that meets the needs of that medical project is pre-set. That is, the breathing trajectory adjusted within this adjustment range can meet the needs of the current medical project. When adjusting the breathing trajectory, based on the acquired breathing training parameters, the initially preset breathing trajectory is adaptively adjusted within the preset adjustment range. The breathing training parameters can be obtained through breathing training for the patient, so that the adjusted breathing trajectory is adapted to the patient's breathing capacity as much as possible while meeting the needs of the medical project. Furthermore, based on the adjusted breathing trajectory, the dynamic breathing standards that the patient needs to follow can be transformed into perceptible and executable guidance content for the patient, such as visual animations, text prompts, etc. The final determined preset breathing guidelines take into account both the needs of the medical project and the patient's breathing capacity.

[0065] In some embodiments, as shown in Figure 4, the breathing regulation guidance includes preset breathing limits, which are used to indicate the movement range of a preset marker. The preset breathing limits are pre-set breathing limits, and depending on the usage scenario, they may have at least one upper or lower breathing limit. The preset breathing limits are used to limit the respiratory amplitude to intuitively assist the patient in controlling the current respiratory amplitude. During breathing, the patient needs to keep the preset marker within the preset breathing limits to adjust the patient's current breathing state to a specific preset breathing state. In some embodiments, when displaying the preset breathing limits, the information display interface also simultaneously displays the preset breathing limit prompt text: "Please control your breathing and keep the marker from going beyond the boundary," to prompt the patient to breathe according to the requirements of the preset breathing limits. In some embodiments, the information display interface also simultaneously displays a progress bar for the current breathing action. As time progresses, the progress bar gradually moves, thereby indicating the remaining time of the current breathing action to the patient. In some other embodiments, the preset breathing limit can also be displayed in other ways to limit the patient's breathing range. For example, the preset icon can be set as a flower bud, and the action of the flower opening or closing can be used to represent the patient's inhalation or exhalation. The amplitude of the flower opening or closing can be used to represent the amplitude of the patient's inhalation or exhalation. In this case, the preset breathing limit can be set as a circle with the flower bud as the center to limit the patient's breathing range.

[0066] In some embodiments, due to differences in respiratory capacity among patients, different preset respiratory limits need to be determined for different patients. When determining the preset respiratory limits, respiratory training parameters are first acquired, and then the preset respiratory limits are determined based on these parameters. The respiratory training parameters are the respiratory limit parameters measured during the patient's free breathing state during respiratory training, such as maximum expiratory amplitude, maximum inspiratory amplitude, and maximum breath-holding time. By adjusting the displayed preset respiratory limits according to the respiratory training parameters, the preset respiratory limits can be made more suitable for the current patient's respiratory capacity.

[0067] In some embodiments, medical devices may have mandatory respiratory amplitude requirements during patient treatment. In such cases, when determining the preset respiratory limit, medical procedure parameters are first obtained, and then the preset respiratory limit is determined based on these parameters. Medical procedure parameters indicate the medical procedure the patient currently needs to undergo, such as imaging examinations or radiotherapy of organs like the lungs, liver, breast, or abdominal cavity. Each medical procedure corresponds to a respiratory limit, and multiple medical procedures can also correspond to a single respiratory limit. By determining the displayed preset respiratory limit based on the medical procedure parameters, the preset respiratory limit can be more closely adapted to the needs of the current medical procedure.

[0068] In some embodiments, the preset respiratory limit can be determined by combining respiratory training parameters and medical procedure parameters. First, respiratory training parameters and medical procedure parameters are acquired, and then the preset respiratory limit is determined based on these parameters. In this embodiment, different medical procedures correspond to different respiratory limits, but each respiratory limit has a certain adjustment range. The respiratory limits adjusted within this range can meet the needs of the current medical procedure. When adjusting the respiratory limit, it is adjusted within the preset adjustment range based on the acquired respiratory training parameters, thereby ensuring that the adjusted respiratory limit is as suitable as possible for the patient's breathing capacity, and that the finally determined preset respiratory limit balances the needs of the medical procedure and the patient's breathing capacity.

[0069] In some embodiments, as shown in Figure 5, the breathing regulation guidance includes a preset breath-holding guide. The preset breath-holding guide indicates the breath-holding time at a preset respiratory amplitude. The preset breath-holding guide includes at least one of a breath-holding start guide and a breath-holding end guide. The preset breath-holding guide is a pre-set breath-holding trajectory, used to indicate the respiratory amplitude and breath-holding time during breath-holding, to intuitively assist the patient in controlling the current breath-holding action. During breath-holding, the patient needs to maintain the preset marker within the preset breath-holding guide, thereby adjusting the patient's current breathing state to a specific preset breath-holding state.

[0070] In some embodiments, when displaying the preset breath-holding guidance, the information display interface also simultaneously displays the preset breath-holding guidance start prompt text: "Prepare to hold your breath," to prompt the patient to begin preparing to hold their breath. As shown in Figure 6, when the patient adjusts the preset marker to the breath-holding trajectory, and when the preset marker moves to the breath-holding start guide, the patient begins to hold their breath until the preset marker passes the breath-holding end guide, at which point the breath-holding ends.

[0071] In some embodiments, the information display interface also displays a preset breath-holding guidance prompt text: "Please keep holding your breath" during the breath-holding process, to remind the patient to continue holding their breath.

[0072] In some embodiments, as shown in Figure 7, the preset marker moves within the preset breath-holding guide on the information display interface. When the patient is unable to keep the preset marker within the preset breath-holding guide during breath-holding, the information display interface will also simultaneously display a preset breath-holding guide deviation prompt text: "Please return to the breath-holding threshold" to prompt the patient to continue holding their breath with the preset breath-holding guide.

[0073] In some other embodiments, the preset breath-holding guidance can also use other display methods to guide the patient to hold their breath. For example, the preset icon can be set as a flower bud, and the action of the flower opening or closing is used to indicate the patient's inhalation or exhalation. The amplitude of the flower opening or closing is used to indicate the amplitude of the patient's inhalation or exhalation. In this case, the preset breath-holding guidance can be set as a circle with the flower bud as the center. When breath-holding is required, the circle indicates that the patient needs to hold their breath by changing its color or fluctuating. After the breath-holding is completed, the circle returns to the initial transparent state or no prompt state, thereby indicating that the breath-holding is over.

[0074] In some embodiments, due to differences in respiratory capacity among patients, the amplitude and duration of breath-holding also vary. When determining the preset breath-holding guideline, respiratory training parameters are first acquired, and then the preset breath-holding guideline is determined based on these parameters. The respiratory training parameters are the respiratory limit parameters measured during the patient's free breathing state during respiratory training; for example, they may include at least one of maximum expiratory amplitude, maximum inspiratory amplitude, and maximum breath-holding time. By adjusting the displayed preset breath-holding guideline according to the respiratory training parameters, the preset breath-holding guideline can be better adapted to the current patient's respiratory capacity.

[0075] In some embodiments, during medical procedures, medical devices may impose mandatory requirements on the breathing amplitude and duration during breath-holding. In such cases, when determining the preset breath-holding guidance, medical procedure parameters are first obtained, and then the preset breath-holding guidance is determined based on these parameters. Medical procedure parameters include those indicating the medical procedure the patient currently needs to undergo, such as imaging examinations or radiotherapy of organs like the lungs, liver, breast, or abdominal cavity. Each medical procedure corresponds to a breath-holding trajectory, and multiple medical procedures can also correspond to a single breath-holding trajectory. By determining the displayed preset breath-holding guidance based on the medical procedure parameters, the preset breath-holding guidance can be more tailored to the needs of the current medical procedure.

[0076] In some embodiments, when determining the preset breath-holding guideline, breathing training parameters and medical procedure parameters can also be combined. First, breathing training parameters and medical procedure parameters are acquired, and then the preset breath-holding guideline is determined based on these parameters. In this embodiment, different medical procedures correspond to different breath-holding trajectories, but each breath-holding trajectory has a certain adjustment range. Breath-holding trajectories adjusted within this range can meet the needs of the current medical procedure. When adjusting the breath-holding trajectory, it is adjusted within the preset adjustment range based on the acquired breathing training parameters, so that the adjusted breath-holding trajectory is as suitable as possible for the patient's breathing capacity, ensuring that the final determined preset breath-holding guideline balances the needs of the medical procedure and the patient's breath-holding ability.

[0077] In some embodiments, as shown in Figure 8, the breathing regulation guidance includes: a preset breathing guide and a preset breathing limit. The preset breathing guide and the preset breathing limit are displayed simultaneously in the information display interface. When the patient is unable to follow the preset breathing guide, the patient is instructed to follow the preset breathing guide, for example, "Please follow the breathing rate channel guidance"; when the patient exceeds the breathing limit, the patient is instructed not to exceed the preset breathing limit.

[0078] In some embodiments, the breathing regulation guidance includes a preset breathing guidance and a preset breath-holding guidance, which transitions to a preset breath-holding guidance at the end of the preset breathing guidance to instruct the patient to hold their breath immediately after breathing.

[0079] In some embodiments, the breathing regulation guidance includes: a preset breathing limit and a preset breath-holding guidance. The information display interface simultaneously displays the preset breathing limit and the preset breath-holding guidance. When the patient is unable to hold their breath following the preset breath-holding guidance, the patient is instructed to breathe according to the preset breathing guidance. When the patient exceeds the breathing limit, the patient is instructed not to exceed the preset breathing limit. In some embodiments, the breathing regulation guidance includes: a preset breathing guidance, a preset breathing limit, and a preset breath-holding guidance. The information display interface simultaneously displays the preset breathing guidance, the preset breathing limit, and the preset breath-holding guidance. At the end of the preset breathing guidance, it transitions to the preset breath-holding guidance to instruct the patient to hold their breath immediately after breathing. Furthermore, when the patient is unable to follow either the preset breathing guidance or the preset breath-holding guidance, the patient is instructed not to exceed the preset breathing limit.

[0080] In some embodiments, as shown in FIG9, the human-computer interaction method of the medical system further includes:

[0081] Step S210: Determine the respiratory curve based on respiratory parameters;

[0082] Step S220: Control the working status of the medical device based on the respiratory curve.

[0083] Specifically, in this embodiment, the medical system controls the operating state of the medical device based on the patient's respiratory curve determined by respiratory parameters. When the patient's current respiratory parameters meet the conditions, the medical device is controlled to perform imaging scans or treatments. For example, the medical device can be controlled to output radiation when the respiratory curve reaches its peak or trough. In some embodiments, the medical device is controlled to operate when the respiratory curve reaches its maximum amplitude. In some embodiments, the medical device is controlled to stop operating when the respiratory curve reaches its minimum amplitude.

[0084] For a specific example, when the medical device is a RT (radiofrequency ablation) device, the RT device needs to control the beam release based on the patient's chest rise and fall, i.e., respiratory gating. At this time, a respiratory curve is generated based on the patient's respiratory parameters. If it is determined that the patient's respiratory amplitude is about to reach a preset amplitude, the RT device will perform the beam release action; if it is determined that the patient's respiratory amplitude is about to fall short of the preset amplitude, it means that the patient's current chest rise and fall do not meet the beam release conditions. To avoid damage to the patient's healthy tissue, the RT device's beam release action is directly stopped.

[0085] In some embodiments, as shown in FIG10, the human-computer interaction method of the medical system further includes:

[0086] Step S310: In response to the background priority instruction, display the background display interface.

[0087] Specifically, in this embodiment, the display device of the medical system is configured to also display a background display interface, which is used to present a background image. The background display interface and the information display interface are stacked. Upon receiving a background priority instruction, the medical system determines the display priority of the background display interface. Generally, the background display interface has a lower priority than the information display interface. The overall display interface can be divided into multiple sub-regions, and the priorities of the background display interface and the information display interface can be set separately for different sub-regions. In some embodiments, in core areas where a preset identifier needs to be highlighted (such as the patient's visual focus area, i.e., the area closer to the visual center of the patient's field of vision), the information display interface is prioritized for display; for example, the information display interface can cover the background display interface in this area. In non-focus areas, the priority can be adjusted according to the needs of the scenario; for example, when it is necessary to soothe the patient's emotions, the priority of the background display interface in this area can be temporarily increased, for example, the background display interface can cover the information display interface in this area. Based on this, the preset icons and other content displayed on the information display interface can be placed closer to the patient's visual center compared to the background image displayed on the background display interface. This helps patients quickly and accurately obtain key information such as breathing guidance and medical instructions, avoids micro-head movements caused by searching for edge information, thereby reducing image artifacts, ensuring treatment accuracy, and lowering eye fatigue and cooperation threshold. Furthermore, while conveying medical functional information at the visual center, the background image can create a soothing atmosphere, which helps improve the operational accuracy of medical equipment.

[0088] In some embodiments, when the information display interface needs to display a preset identifier, the dynamic background image in the background display interface will pause or display a solid color background. The medical system can also determine the background image based on the acquired background selection instruction. The background image can be a static image or a dynamic image (video). Background images are generally slow-paced, soothing content such as landscapes that will not cause strong emotional fluctuations in the patient. In some embodiments, after acquiring the background selection instruction, the medical system will display multiple preset optional images on the information display interface. The patient can then select the desired image as the background image through the user interface. In some embodiments, the background selection instruction is bound to a medical item, with different medical items corresponding to different background images.

[0089] Step S320: Display the background image in the background display interface.

[0090] Specifically, once the medical system determines the display priority of the background display interface, it can then display the background image on the display device's background display interface. Generally, the background display interface is the lowest-level display interface, and its background image serves as the background. The content displayed on the information display interface will overlay the background image displayed on the background display interface, and the background image displayed on the background display interface will be present throughout the entire medical process. By displaying a background image on the background display interface, it is possible to adapt to the needs of different scenarios and improve the patient's user experience.

[0091] In some embodiments, as shown in FIG11, step 320, the step of displaying a background image in the background display interface includes:

[0092] Step S311: In response to the background selection instruction, obtain voice description data.

[0093] Specifically, in this embodiment, when a user needs to select a background image, the user first inputs a background selection command to the medical system through the user interface. After the medical system receives the background selection command, it turns on the microphone to collect the user's voice description data about the content of the background image.

[0094] Step S312: Perform speech recognition on the speech description data to obtain text description data.

[0095] Specifically, after obtaining the user's voice description data, the medical system performs speech recognition on the voice description data, thereby converting the voice data into text description data. In some embodiments, after performing speech recognition on the voice description data to obtain text data, the text data can be further filtered to remove unrecognizable text and text unsuitable for generating images, thus obtaining the final text description data.

[0096] Step S313: Input the text description data into the trained text image generation model to obtain the candidate image.

[0097] Specifically, after receiving the text description data, the medical system inputs it into a trained text-image generation model to obtain candidate images, which can be static or dynamic. The text-image generation model then performs semantic understanding on the text description data to generate candidate images related to the user's voice description data.

[0098] Step S314: Based on the review criteria, the candidate images are reviewed, and the candidate images that pass the review are displayed in the background display interface.

[0099] Specifically, after receiving candidate images, the medical system will review them based on pre-set review criteria, filtering out images unsuitable for use as backgrounds. Images that pass the review will then be used as background images and displayed on the background display interface. In some embodiments, the review criteria may include: filtering out images that may cause visual discomfort to the patient (such as large camera movements, focusing, or defocusing); filtering out images whose content is unsuitable for the patient to view; and filtering out images featuring unfamiliar figures, preferably soothing natural or animal images. This embodiment's method of generating background images based on voice description data can generate customized visual content in real time according to the patient's voice description, providing a highly personalized visual experience and further reducing the patient's anxiety.

[0100] In some embodiments, as shown in FIG12, the human-computer interaction method of the medical system further includes:

[0101] Step S410: In response to the interaction priority instruction, display the interactive display interface.

[0102] Specifically, in this embodiment, the display device of the medical system also includes an interactive display interface for displaying interactive information, with the information display interface, background display interface, and interactive display interface stacked on top of each other. Upon receiving an interaction priority instruction, the medical system determines the display priority of the interactive display interface. As shown in Figure 13(a), the interactive display interface has the highest priority, and the background display interface has the lowest priority. In some embodiments, when the interactive display interface needs to display interactive information, the dynamic background image in the background display interface is paused, and the preset icons and breathing regulation guidelines displayed in the information display interface are weakened. In some embodiments, the interactive information displayed on the interactive display interface can also be displayed on the top layer, without processing the content displayed on the background display interface and the information display interface. The medical system can also determine the interactive information based on the obtained technician interaction instructions. The interactive information is some text information sent from the technician's end, such as technician instructions, technician voice subtitles, etc. The technician can select or input corresponding information from the user interface on the technician's end, and the medical system can then determine the corresponding interactive information.

[0103] Step S420: Display interactive information in the interactive display interface.

[0104] Specifically, once the medical system determines the priority of the interactive display interface, it controls the display device to show interactive information in a visual manner. The interactive information is generally simple, clear, and easy to understand, which can avoid increasing patient anxiety. Displaying interactive information visually can improve patient cooperation (especially for patients with hearing impairments).

[0105] In some embodiments, the human-computer interaction method of the medical system further includes: acquiring ambient light information and adjusting the brightness of the display device based on the ambient light information. Specifically, in this embodiment, the display device is a projection device. Projection devices are easily affected by ambient light. Therefore, the medical system acquires ambient light information at the medical device through a light sensor, and then adjusts the brightness of the display device according to different ambient light information, thereby achieving adaptive brightness changes according to different lighting environments and improving the display effect of the display device.

[0106] Furthermore, in some embodiments, the medical system also includes a technician display control terminal, which is configured to synchronously display an information interface. The technician can monitor and control the patient in real time based on the projected content within the patient's field of vision. For example, the technician can use this control terminal to view the patient's compliance with breathing guidance, the display status of preset indicators, etc., and then promptly adjust the operating parameters of the medical equipment or send interactive commands to the display device to display interactive information on the information display interface.

[0107] In some embodiments, a human-computer interaction method for a medical system is provided. Taking the application of this method to a medical system as an example, the medical system includes a medical device and a display device, the medical device being configured to image or treat a patient. The method includes:

[0108] The control display device displays at least one of breathing guidance information and interactive information, as well as background information, within the patient's field of vision; wherein the background information is located at the bottom layer of the display hierarchy.

[0109] Specifically, as shown in Figure 13(b), when respiratory guidance information and background information are displayed simultaneously, the background information can be located at the bottom of the display hierarchy. For example, the respiratory guidance information can be overlaid on top of the background information. The respiratory guidance information can be set in the central area of ​​the patient's field of vision, so that in the central area of ​​the field of vision, the respiratory guidance information has a higher priority than the background information. The size of the central area can be adapted to the patient's field of vision focusing characteristics (e.g., occupying 60%-80% of the overall display interface), and the overlay state can be flexibly configured, such as opaque overlay or semi-transparent overlay. Since the respiratory guidance information can be set in the central area of ​​the overall display interface, the unobstructed background information is displayed in the edge areas of the overall display interface.

[0110] Specifically, when interactive information and background information are displayed simultaneously, the background information can be located at the bottom of the display hierarchy; for example, interactive information can be overlaid on top of the background information. Interactive information can be positioned in the central area of ​​the patient's field of vision, giving it higher priority than background information in that area. Alternatively, interactive information can be positioned in the central area of ​​the overall display interface, while the unobstructed background information is displayed at the edges of the overall display interface.

[0111] In some embodiments, breathing guidance information can be displayed on an information display interface. The specific limitations of the information display interface can be found in the relevant descriptions of steps S110 to S130 above. Background information can be displayed on a background display interface. The specific limitations of the background display interface can be found in the relevant descriptions of steps S310 to S320 above. Interactive information can be displayed on an interactive display interface. The specific limitations of the interactive display interface can be found in the relevant descriptions of steps S410 to S420 above, and will not be repeated here.

[0112] In some embodiments, the breathing guidance information includes at least a preset identifier. Furthermore, the breathing guidance information may also include breathing regulation guidance.

[0113] In some embodiments, when the breathing guidance information and the interaction information are displayed simultaneously, the interaction information is located at the top level of the display hierarchy.

[0114] Specifically, as shown in Figure 13(b), when respiratory guidance information and interactive information are displayed simultaneously, the interactive information can be located at the top of the display hierarchy. For example, the interactive information can be overlaid on top of the respiratory guidance information, and the respiratory guidance information can be overlaid on top of the background information. The interactive information can be set in the central area of ​​the patient's field of vision, so that in the central area of ​​the field of vision, the priority of the interactive information is higher than that of the respiratory guidance information. The interactive information can be set in the central area of ​​the overall display interface, and correspondingly, the edge areas of the overall display interface display the unobstructed interactive information and background information.

[0115] In some embodiments, when the breathing guidance information and the interaction information are displayed simultaneously, the breathing guidance information and the interaction information are both located at the top level of the display hierarchy.

[0116] Specifically, when respiratory guidance information and interactive information are displayed simultaneously, both can be located at the top of the display hierarchy. For example, they can be displayed side-by-side and overlaid on top of the background information. The interactive information can be positioned in the central area of ​​the patient's field of vision, giving it higher priority than the respiratory guidance information in that area.

[0117] In some embodiments, a medical system is provided, comprising:

[0118] Medical devices, configured to image or treat patients; and

[0119] The display device is configured to display at least one of breathing guidance information and interactive information, as well as background information, within the patient's field of vision;

[0120] The background information is located at the bottom layer of the display hierarchy.

[0121] In some embodiments, the breathing guidance information includes preset identifiers and breathing regulation guidelines.

[0122] In some embodiments, when the breathing guidance information and the interaction information are displayed simultaneously, the interaction information is located at the top level of the display hierarchy.

[0123] In some embodiments, when the breathing guidance information and the interaction information are displayed simultaneously, the breathing guidance information and the interaction information are both located at the top level of the display hierarchy.

[0124] The solution to the problem provided by the above-mentioned medical system is similar to the solution described in the human-computer interaction method of the above-mentioned medical system. Therefore, the specific limitations of one or more medical systems provided can be found in the limitations of the human-computer interaction method of the medical system above, and will not be repeated here.

[0125] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0126] Based on the same inventive concept, this application also provides a human-computer interaction device for implementing the human-computer interaction method of the medical system described above. The solution provided by this device is similar to the implementation scheme described in the above method. Therefore, the specific limitations of one or more embodiments of the human-computer interaction device for the medical system provided below can be found in the limitations of the human-computer interaction method for the medical system described above, and will not be repeated here.

[0127] In some embodiments, as shown in FIG14, a human-computer interaction device for a medical system is provided, including: a preset identification display module 510, a respiratory parameter acquisition module 520, and a motion control module 530. Each module of the human-computer interaction device for the medical system can be implemented on a processor.

[0128] The preset label display module 510 is used to display preset labels in the information display interface. Specifically, the preset label display module 510 is implemented by the processor calling the display driver to output the image data of the preset labels (such as breathing guidance animation, threshold lines) to the display device.

[0129] The respiratory parameter acquisition module 520 is used to acquire current respiratory parameters. The respiratory parameter acquisition module 520 can communicate with devices such as VSM devices, breathing straps, and millimeter-wave radar via a data interface (such as USB or Bluetooth) through a processor to acquire respiratory parameters and store them in memory.

[0130] The movement control module 530 is used to control the movement of a preset marker on the information display interface based on respiratory parameters. Specifically, the movement control module 530 is implemented by a processor running a computer program to control the movement of the preset marker.

[0131] In some embodiments, the human-computer interaction device of the medical system further includes: a guidance and identification display module, used to display breathing regulation guidance in an information display interface; wherein the breathing regulation guidance includes at least one of: preset breathing guidance, preset breathing limits, and preset breath-holding guidance, the preset breathing guidance includes a movement path of a preset identifier, the preset breathing limits include an indication of the movement range of the preset identifier, and the preset breath-holding guidance includes at least one of breath-holding start guidance and breath-holding end guidance. Specifically, the guidance and identification display module is implemented by the processor calling a display driver to output the breathing regulation guidance in memory to the display device.

[0132] In some embodiments, the human-computer interaction device of the medical system further includes: a guidance identifier determination module, configured to acquire at least one of respiratory training parameters and medical procedure parameters; and determine respiratory regulation guidance based on at least one of the respiratory training parameters and medical procedure parameters. Specifically, the guidance identifier determination module is implemented by a processor acquiring at least one of the respiratory training parameters and medical procedure parameters through a data interface and running a computer program to determine the respiratory regulation guidance.

[0133] In some embodiments, the human-computer interaction device of the medical system further includes: a medical device control module, used to determine a respiratory curve based on respiratory parameters; and to control the operating state of the medical device based on the respiratory curve. Specifically, the medical device control module is implemented by calling respiratory parameters stored in memory, running a computer program to determine the respiratory curve obtained by processing the respiratory parameters, and controlling the operating state of the medical device.

[0134] In some embodiments, the human-computer interaction device of the medical system further includes: a background image display module, used to display a background display interface in response to a background priority instruction; wherein the background display interface and the information display interface are stacked; and a background image is displayed in the background display interface. Specifically, the background image display module obtains a background priority instruction through a data interface and executes a corresponding calculator program in response to receiving the background priority instruction.

[0135] In some embodiments, the background image display module is further configured to: obtain speech description data in response to a background selection instruction; perform speech recognition on the speech description data to obtain text description data; input the text description data into a trained text image generation model to obtain candidate images; perform image review on the candidate images based on review criteria; and display the candidate images that have passed the image review in the background display interface.

[0136] In some embodiments, the human-computer interaction device of the medical system further includes: an interactive information display module, used to display an interactive display interface in response to an interaction priority instruction; wherein, the information display interface, the background display interface, and the interactive display interface are stacked; interactive information is displayed in the interactive display interface. Specifically, the interactive information display module obtains the interaction priority instruction through a data interface and executes the corresponding calculator program in response to receiving the interaction priority instruction.

[0137] In some embodiments, the movement control module 530 is also used to determine the current breathing state of the target object based on breathing parameters; and based on the breathing state, control the preset identifier to move in the information display interface.

[0138] In some embodiments, the movement control module 530 is further configured to control a preset identifier to move along a first direction when the breathing state is exhalation; control the preset identifier to move along a second direction when the breathing state is inhalation; the first direction is opposite to the second direction; and control the preset identifier to remain stationary when the breathing state is breath-holding.

[0139] The modules in the human-computer interaction device of the aforementioned medical system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0140] As used herein, the terms “component,” “module,” and “system,” etc., are intended to refer to a computer-related entity. It can be hardware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, executable code, a thread of execution, a program, and / or a computer. For illustration, an application running on a server and the server itself can both be components. One or more components may reside in a process and / or a thread of execution, and components may be located within a single computer and / or distributed across two or more computers.

[0141] In some embodiments, a medical system is provided, comprising: a medical device and a display device; the medical system further comprising a memory and a processor; the memory storing a computer program; and the processor executing the computer program to implement the steps in the human-computer interaction method embodiment of the medical system, including:

[0142] The information display interface displays preset icons;

[0143] Obtain the current respiratory parameters;

[0144] The preset marker is moved on the information display interface based on the respiratory parameters.

[0145] In some embodiments, when the processor executes a computer program, it implements: displaying breathing regulation guidance in the information display interface; wherein the breathing regulation guidance includes at least one of: preset breathing guidance, preset breathing limit, and preset breath-holding guidance, the preset breathing guidance includes a movement path of the preset identifier, the preset breathing limit includes a movement range indicating the preset identifier, and the preset breath-holding guidance includes at least one of breath-holding start guidance and breath-holding end guidance.

[0146] In some embodiments, the processor executes a computer program to: acquire at least one of breathing training parameters and medical procedure parameters; and determine the breathing regulation guidance based on at least one of the breathing training parameters and the medical procedure parameters.

[0147] In some embodiments, the processor executes a computer program to: determine a respiratory curve based on the respiratory parameters; and control the operating state of the medical device based on the respiratory curve.

[0148] In some embodiments, when the processor executes a computer program, it performs the following: responding to a background priority instruction to display a background display interface; wherein the background display interface is stacked with the information display interface; and displaying a background image in the background display interface.

[0149] In some embodiments, when the processor executes a computer program, it performs the following: in response to a background selection instruction, it acquires speech description data; performs speech recognition on the speech description data to obtain text description data; inputs the text description data into a trained text image generation model to obtain candidate images; performs image review on the candidate images based on review criteria, and displays the candidate images that have passed the image review in the background display interface.

[0150] In some embodiments, when the processor executes a computer program, it performs the following: responding to an interaction priority instruction to display an interactive display interface; wherein the information display interface, the background display interface, and the interactive display interface are stacked; and interactive information is displayed in the interactive display interface.

[0151] In some embodiments, when the processor executes a computer program, it performs the following: determining the current breathing state of the target object based on breathing parameters; and controlling a preset identifier to move in the information display interface based on the breathing state.

[0152] In some embodiments, when the processor executes a computer program, it controls a preset identifier to move along a first direction when the breathing state is exhalation; controls the preset identifier to move along a second direction when the breathing state is inhalation; the first direction is opposite to the second direction; and controls the preset identifier to remain stationary when the breathing state is breath-holding.

[0153] In some embodiments, a computer-readable storage medium is provided having a computer program stored thereon, wherein a processor executes the computer program to implement the steps in the human-computer interaction method embodiment of the medical system, including:

[0154] The information display interface displays preset icons;

[0155] Obtain the current respiratory parameters;

[0156] The preset marker is moved on the information display interface based on the respiratory parameters.

[0157] In some embodiments, when the processor executes a computer program, it implements: displaying breathing regulation guidance in the information display interface; wherein the breathing regulation guidance includes at least one of: preset breathing guidance, preset breathing limit, and preset breath-holding guidance, the preset breathing guidance includes a movement path of the preset identifier, the preset breathing limit includes a movement range indicating the preset identifier, and the preset breath-holding guidance includes at least one of breath-holding start guidance and breath-holding end guidance.

[0158] In some embodiments, the processor executes a computer program to: acquire at least one of breathing training parameters and medical procedure parameters; and determine the breathing regulation guidance based on at least one of the breathing training parameters and the medical procedure parameters.

[0159] In some embodiments, the processor executes a computer program to: determine a respiratory curve based on the respiratory parameters; and control the operating state of the medical device based on the respiratory curve.

[0160] In some embodiments, when the processor executes a computer program, it performs the following: responding to a background priority instruction to display a background display interface; wherein the background display interface is stacked with the information display interface; and displaying a background image in the background display interface.

[0161] In some embodiments, when the processor executes a computer program, it performs the following: in response to a background selection instruction, it acquires speech description data; performs speech recognition on the speech description data to obtain text description data; inputs the text description data into a trained text image generation model to obtain candidate images; performs image review on the candidate images based on review criteria, and displays the candidate images that have passed the image review in the background display interface.

[0162] In some embodiments, when the processor executes a computer program, it performs the following: responding to an interaction priority instruction to display an interactive display interface; wherein the information display interface, the background display interface, and the interactive display interface are stacked; and interactive information is displayed in the interactive display interface.

[0163] In some embodiments, when the processor executes a computer program, it performs the following: determining the current breathing state of the target object based on breathing parameters; and controlling a preset identifier to move in the information display interface based on the breathing state.

[0164] In some embodiments, when the processor executes a computer program, it controls a preset identifier to move along a first direction when the breathing state is exhalation; controls the preset identifier to move along a second direction when the breathing state is inhalation; the first direction is opposite to the second direction; and controls the preset identifier to remain stationary when the breathing state is breath-holding.

[0165] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0166] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0167] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A human-computer interaction method for a medical system, the method comprising: Display preset icons on the information display interface; Obtain the current respiratory parameters; The preset marker is moved on the information display interface based on the respiratory parameters.

2. The human-computer interaction method for a medical system according to claim 1, wherein, The method further includes: The information display interface displays breathing regulation guidance; the breathing regulation guidance includes at least one of: preset breathing guidance, preset breathing limit, and preset breath-holding guidance, the preset breathing guidance includes the movement path of the preset indicator, the preset breathing limit includes the movement range indicating the preset indicator, and the preset breath-holding guidance includes at least one of breath-holding start guidance and breath-holding end guidance.

3. The method according to claim 2, wherein, The method further includes: Obtain at least one of the following: breathing training parameters and medical procedure parameters; The breathing regulation guidelines are determined based on at least one of the breathing training parameters and the medical procedure parameters.

4. The method according to claim 3, wherein, The breathing training parameters include at least one of the following: maximum expiratory amplitude, maximum inspiratory amplitude, and maximum breath-holding time.

5. The method according to any one of claims 1 to 4, wherein, The method further includes: A respiratory curve is determined based on the respiratory parameters; The operating status of the medical device is controlled based on the respiratory curve.

6. The method according to any one of claims 1 to 5, wherein, The method further includes: A background display interface is displayed in response to a background priority instruction; wherein the background display interface and the information display interface are stacked. Display a background image in the background display interface.

7. The method according to claim 6, wherein, The step of displaying a background image in the background display interface includes: Responding to a background selection command to obtain speech description data; The speech description data is subjected to speech recognition to obtain text description data; The text description data is input into the trained text image generation model to obtain candidate images; The candidate images are reviewed based on the review criteria, and the candidate images that pass the review are displayed on the background display interface.

8. The method according to any one of claims 6 to 7, wherein, The method further includes: The interactive display interface is displayed in response to an interaction priority instruction; wherein the information display interface, the background display interface, and the interactive display interface are stacked. Display interactive information in the interactive display interface.

9. The method according to any one of claims 1 to 8, wherein, The respiratory parameters include at least one of lung volume and intrapulmonary pressure.

10. The method according to any one of claims 1 to 9, wherein, Controlling the movement of the preset marker in the information display interface based on the respiratory parameters includes: The current respiratory state of the target object is determined based on the respiratory parameters; Based on the breathing state, the preset icon is controlled to move on the information display interface.

11. The method according to claim 10, wherein, The respiratory states include exhalation, inhalation, and breath-holding.

12. The method according to claim 11, wherein, The step of controlling the movement of the preset identifier in the information display interface based on the breathing state includes: When the breathing state is exhalation, the preset identifier is controlled to move along the first direction; When the breathing state is inhalation, the preset indicator is controlled to move along the second direction; the first direction is opposite to the second direction. When the breathing state is a breath-holding state, the preset flag is kept stationary.

13. A human-computer interaction device for a medical system, the device comprising: The preset identifier display module is used to display preset identifiers in the information display interface; The respiratory parameter acquisition module is used to acquire the current respiratory parameters; A movement control module is used to control the movement of the preset identifier in the information display interface based on the breathing parameters.

14. A medical system, the medical system comprising: The medical device and display device, the medical system further comprising a memory and a processor, the memory storing a computer program, the processor executing the computer program to implement the steps of the method according to any one of claims 1 to 12.

15. A medical system comprising: Medical devices are configured to image or treat patients; The display device is configured to display at least one of breathing guidance information and interactive information, as well as background information, within the patient's field of vision; The background information is located at the bottom layer of the display hierarchy.

16. The medical system according to claim 15, wherein, The breathing guidance information includes preset icons and breathing regulation guidelines.

17. The medical system according to claim 15, wherein, When the breathing guidance information and the interactive information are displayed simultaneously, the interactive information is located at the top level of the display hierarchy.

18. The medical system according to claim 15, wherein, When the breathing guidance information and the interaction information are displayed simultaneously, the breathing guidance information and the interaction information are both located at the top level of the display hierarchy.

19. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 12.

Images