Display method and device for voice triggering of medical equipment, electronic equipment and product
By obtaining patient information and displaying preset content of voice triggers in medical imaging equipment, the problem of inconvenience of operators and patients is solved, reducing the communication burden and improving work efficiency.
Patent Information
- Application Number
- CN202411564737.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-04
- Publication Date
- 2025-03-07
AI Technical Summary
In medical imaging examination, since the operator and the patient are not in the same room, the convenience of communication is low, which increases the communication burden of the operator and affects work efficiency.
By obtaining the patient's patient information, determining the target voice set and corresponding display strategies, displaying multiple touch areas of preset voice content in the voice control window, and broadcasting the corresponding preset voice content in response to the touch operation.
It reduces the time and times the operator speaks, reduces the communication burden, improves work efficiency, and automatically selects the appropriate display method according to the actual scene during the patient's examination.
Smart Images

Figure CN119580988A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of medical technology, and in particular, relates to a display method, device, electronic equipment and product of medical equipment triggered by voice. Background Art
[0002] In medical imaging examinations, the medical equipment used is usually radioactive. Therefore, in order to ensure the safety of the operator, the patient is usually located in the scanning room, while the operator is located in a control room with radiation protection capabilities. At this time, since the operator and the patient are not in the same room, the operator and the patient are less convenient to communicate.
[0003] At present, voice interaction equipment is usually installed in the control room for operators to communicate with patients. However, operators need to face a large number of patients every day. At this time, if the operator communicates with each patient, the communication burden of the operator will be increased to a certain extent. In turn, the work efficiency of the operator will be affected. Summary of the invention
[0004] The embodiments of the present application provide a voice-triggered display method, device, electronic device, and product for medical equipment, which can solve the problems of heavy communication burden and reduced work efficiency for operators.
[0005] In a first aspect, an embodiment of the present application provides a method for displaying a medical device triggered by voice, the method comprising:
[0006] obtain patient information from patients;
[0007] Determine a target speech set based on patient information;
[0008] Determine, according to the patient information and the target voice set, a target strategy for configuring and displaying a plurality of preset voice contents in the target voice set;
[0009] Based on the target strategy, in at least one voice control window, touch areas corresponding to a plurality of preset voice contents are displayed; the touch areas are used to broadcast the corresponding preset voice contents in response to the touch operation.
[0010] In a second aspect, an embodiment of the present application provides a voice-triggered display device for medical equipment, the device comprising:
[0011] A first acquisition module is used to acquire patient information of a patient;
[0012] A first determination module, used to determine a target speech set according to patient information;
[0013] A second determination module is used to determine a target strategy for configuring and displaying a plurality of preset voice contents in the target voice set according to the patient information and the target voice set;
[0014] The display module is used to display touch areas corresponding to multiple preset voice contents in at least one voice control window based on the target strategy; the touch areas are used to broadcast the corresponding preset voice contents in response to the touch operation.
[0015] In a third aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method of the first aspect described above when executing the computer program.
[0016] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method of the first aspect described above is implemented.
[0017] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute the method of the first aspect.
[0018] Compared with the prior art, the embodiment of the present application has the following beneficial effects: in order to reduce the time and number of times the operator speaks as much as possible, the electronic device can obtain the patient information of the patient, so as to determine the target voice set that the operator needs to use during this examination based on the patient information. Among them, because the target voice set contains multiple preset voice contents that the operator may need to communicate with the patient during this examination. Therefore, when the touch area corresponding to the preset voice content is displayed in the voice control window, the electronic device can broadcast the corresponding preset voice content based on the touch operation on the touch area to reduce the number and time of the operator speaking and reduce the communication burden of the operator. In addition, the electronic device can also configure and display multiple preset voice contents in the voice control window based on the target strategy determined by the patient information. Furthermore, the electronic device can automatically select a suitable display mode to display the touch areas corresponding to multiple preset voice contents according to the actual scene during the patient examination, increase the convenience of the operator when using, and improve the work efficiency of the operator. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0020] Figure 1 This is a flow chart of an implementation method of a voice-triggered display method of a medical device provided in one embodiment of the present application;
[0021] Figure 2 This is a schematic diagram of an application scenario for configuring preset voice content in a voice-triggered display method of a medical device provided in an embodiment of the present application;
[0022] Figure 3 This is a schematic diagram of an application scenario of displaying a touch area in a voice-triggered display method of a medical device provided in an embodiment of the present application;
[0023] Figure 4 It is a structural schematic diagram of a voice-triggered display device for medical equipment provided in one embodiment of the present application;
[0024] Figure 5 It is a structural schematic diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0025] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.
[0026] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.
[0027] It should be noted that the information collection process (such as patient information collection process, physiological information collection process, etc.) / feature extraction process involved in this application is performed with the user's knowledge and permission, that is, the information collection process / feature extraction process complies with the requirements of laws and regulations and does not constitute an act that harms the public interest.
[0028] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.
[0029] In medical imaging examinations, the medical equipment used is usually radioactive. Therefore, in order to ensure the safety of the operator, the patient is usually located in the scanning room, while the operator is located in a control room with radiation protection capabilities. At this time, since the operator and the patient are not in the same room, the operator and the patient are less convenient to communicate.
[0030] Among them, the communication between operators and patients mainly involves patient positioning guidance, examination guidance, patient safety confirmation, etc., which are not online.
[0031] At present, voice interaction equipment is usually installed in the control room for operators to communicate with patients. However, operators need to face a large number of patients every day. At this time, if the operator communicates with each patient, the communication burden of the operator will be increased to a certain extent. In turn, the work efficiency of the operator will be affected.
[0032] Furthermore, the examination items provided by a medical examination device are usually fixed, so the guidance content when the operator communicates with the patient is usually similar. Furthermore, it can be considered that when facing a large number of patients who need to be examined, the operator needs to often describe the same content to the patient, which also increases the communication burden of the operator.
[0033] Based on this, in order to reduce the communication burden of operators and improve their work efficiency, an embodiment of the present application provides a voice-triggered display method for medical equipment. The method can be applied to electronic devices such as tablet computers and ultra-mobile personal computers (UMPCs). The embodiment of the present application does not impose any restrictions on the specific type of electronic equipment.
[0034] See also Figure 1 , Figure 1 A flowchart of a method for displaying a medical device triggered by voice provided in an embodiment of the present application is shown. The method comprises the following steps:
[0035] S101. Obtain patient information of a patient.
[0036] In one embodiment, the above patient information includes, but is not limited to, the patient's first physiological information and information on examination items that the patient needs to examine, and is not limited to this.
[0037] Exemplarily, the first physiological information includes but is not limited to the patient's age, heart rate, blood pressure, respiration, body temperature, etc. The examination item information includes but is not limited to the medical equipment to be used for the examination, the examination area, the examination duration, the chief complaint, the diagnosis information, the purpose of the examination, precautions, etc., which are not limited to this.
[0038] For example, medical equipment: ultrasound examination equipment; examination area: left lung; chief complaint: chest tightness for 3 days (the patient reports where he feels uncomfortable); diagnosis: space-occupying space in the left lung (possibly a malignant tumor); purpose of examination: to clarify the nature of the space-occupying space; precautions: whether there is a history of various allergies in the past, whether to carry an infusion device during the examination, etc.
[0039] Before a patient needs to undergo an examination, a doctor usually needs to issue an examination list and enter it into the hospital's medical system. At this time, the examination list and the medical system usually record the patient's information. The electronic device can obtain the above patient information based on the examination list and / or the medical system.
[0040] In another embodiment, the operator may also enter the patient information in real time in the electronic device through communication with the patient. In this embodiment, the method of obtaining the patient information is not limited.
[0041] S102, determining a target speech set according to the patient information;
[0042] S103: Determine a target strategy for configuring and displaying multiple preset voice contents in the target voice set according to the patient information and the target voice set.
[0043] In one embodiment, the electronic device may be pre-set with multiple voice sets, each of which corresponds to one or more examination items. Each voice set may be set with multiple preset voice contents, and during the examination process, when the operator needs to speak, he can communicate with the patient by playing the preset voice contents.
[0044] The operator can log in to the interactive system through an electronic device and perform configuration operations such as inputting, viewing, deleting and modifying the preset voice content for each inspection item. In another embodiment, the operator can also pre-set the language (Mandarin, dialect), language (Chinese, English, etc.), volume, speech speed and other information when the preset voice content is played, without limitation.
[0045] For example, refer to Figure 2 , Figure 2 1 is a schematic diagram of an application scenario for configuring preset voice content in a voice-triggered display method of a medical device provided in an embodiment of the present application. Figure 2 As can be seen in the figure, the operator can add a voice containing preset voice content, and set the language, content, volume, speaking speed and name of the voice. Among them, the name can be considered as a label of the newly added preset voice content, which is used to briefly express the meaning of the preset voice content.
[0046] Among them, after adding a preset voice content, the operator can also view, delete and modify the existing multiple preset voice contents, and change the order of multiple preset voice contents, without limitation.
[0047] Based on the above description, it can be considered that the electronic device can determine the target voice set according to the inspection item information. Alternatively, the electronic device can determine the target voice set in response to the voice set selection operation of the operator.
[0048] In one embodiment, the target strategy is a strategy for configuring and displaying touch areas corresponding to a plurality of preset voice contents in a voice control window of an electronic device.
[0049] It is understandable that if multiple preset voice contents are displayed randomly, it may take a long time for the operator to search when selecting the preset voice content to be broadcast.
[0050] Alternatively, if multiple preset voice contents are displayed in a preset fixed arrangement order, unimportant or infrequently used preset voice contents may be displayed in a prominent area of the voice control window (e.g., a top area or a front area of the voice control window), and important or frequently used preset voice contents may be displayed in other areas of the voice control window (e.g., an area that can only be seen by sliding or turning pages). In this case, the operator will still waste time selecting the corresponding preset voice content for broadcasting.
[0051] Also, important preset voice content (e.g., the voice content of "Are you OK? Can you hold on?" to ask whether the patient is safe) and commonly used preset voice content (e.g., the voice content of "Please stay still") may not be the same preset voice content. In this case, if only the important preset voice content is fixedly displayed in a prominent area, the operator needs to spend time searching for the commonly used preset voice content.
[0052] Based on this, it can be considered that reasonably selecting a target strategy for configuring and displaying multiple preset voice contents can improve the communication efficiency of operators to a certain extent.
[0053] In one embodiment, a plurality of strategies may be pre-set in the electronic device to configure and display the preset voice content, and the target strategy is the strategy currently in the inspection process among the plurality of strategies.
[0054] Exemplarily, the above strategies include but are not limited to a first preset strategy in which, in the voice control window, the touch area of the preset voice content corresponding to the danger tag is displayed before the touch area of the preset voice content corresponding to the safety tag; a second preset strategy in which, in the voice control window, the touch area of the preset voice content corresponding to the danger tag is displayed after the touch area of the preset voice content corresponding to the safety tag; and a third preset strategy in which, in the voice control window, the touch area corresponding to the preset voice content with high usage frequency is displayed before the touch area corresponding to the preset voice content with low usage frequency.
[0055] Among them, the preset voice content corresponding to the above-mentioned danger labels includes but is not limited to preset voice content reminding patients "Please take a deep breath, don't be nervous" or "Please breathe calmly" when the patient's heart rate is too high or breathing is too fast; when the medical equipment collides with the patient's infusion device during the examination, the preset voice content reminds the patient "Please stay still, don't be nervous, the operator will come to deal with it soon", and there is no limitation on this.
[0056] Furthermore, the preset voice content corresponding to the above-mentioned safety label can be considered as: the preset voice content other than the preset voice content corresponding to the danger label, which will not be described in detail.
[0057] In one embodiment, the above-mentioned multiple strategies are only an example of this embodiment. In other embodiments, strategies for displaying multiple preset voice contents according to the usage habits of operators may also be included. In this embodiment, the number and specific rules of the strategies are not limited.
[0058] In one embodiment, the electronic device may determine a target strategy corresponding to the target voice set based on the first physiological information and / or the examination item information.
[0059] As an example, the electronic device may pre-store a first association relationship between the first physiological information and the strategy, and a second association relationship between the examination item information and the strategy. Then, the first strategy and the second strategy are determined based on the first association relationship and the second association relationship, respectively. Finally, the electronic device may respond to the strategy selection operation of the operator and determine the target strategy from the first strategy and the second strategy.
[0060] When a policy is determined based only on the first physiological information or the examination item information, the policy is the target policy. That is, the electronic device can determine the target policy based only on the first physiological information, or only on the examination item information.
[0061] In another embodiment, the electronic device may determine the target risk level of the patient during the examination based on the first physiological information and / or the examination item information, and then determine the target strategy according to the target risk level.
[0062] The first physiological information and the examination item information have been explained in S101 above, and will not be described again. Also, the danger level can be set in advance according to the actual situation, for example, including no danger, slight danger, severe danger and other levels, which are not limited. In this embodiment, two levels of no danger and severe danger are used as examples.
[0063] In one embodiment, the method of representing the degree of danger may be represented by the above-mentioned text, or may be represented by numbers such as level 0 (no danger), level 1 (mild danger), level 2 (severe danger), or may be represented by colors such as green (no danger), yellow (mild danger), red (severe danger). In this embodiment, the method of representing the degree of danger is not limited.
[0064] As an example, the electronic device can determine the patient's own risk level when performing the examination item information based on the first physiological information, and then determine the patient's own risk level and / or the maximum risk level among the preset risk levels corresponding to the examination item information as the target risk level.
[0065] Among them, the preset risk level corresponding to the inspection item information can be determined based on the medical equipment inspected in the inspection item information.
[0066] For example, medical equipment such as Single-Photon Emission Computed Tomography (SPECT), Radiotherapy (RT), and Digital Subtraction Angiography (DSA) have high radiation levels during the examination process, so the corresponding preset risk level can be severe.
[0067] Also, for medical equipment such as Computed Tomography (CT), Positron Emission Tomography (PET), Magnetic Resonance (MR), Digital Radiography (DR), and ultrasound, since the radiation during the inspection is low, the corresponding preset risk level can be no risk or mild risk. In other words, the preset risk level can be used to characterize the degree of danger to the patient caused by the radiation of the medical equipment during the inspection process. The higher the radiation, the greater the corresponding preset risk level. And, the lower the radiation, the smaller the corresponding preset risk level.
[0068] Also, regarding the degree of danger to oneself, the electronic device can determine that the degree of danger to oneself is severe when it detects that the age is not within the preset age range, or the heart rate is not within the preset heart rate range, or the blood pressure is not within the preset blood pressure range, or the breathing rate is not within the preset frequency range, or the body temperature is not within the preset body temperature range.
[0069] Otherwise, when it is detected that the age is within the preset age range, the heart rate is within the preset heart rate range, the blood pressure is within the preset blood pressure range, the breathing rate is within the preset frequency range, and the body temperature is within the preset body temperature range, it can be determined that the level of danger is not dangerous.
[0070] Specifically, the preset age range may be [14, 59]; the preset heart rate range may be [60, 100], unit: times / minute; the blood pressure range may be [90, 139], unit: mmHg; the preset frequency range may be [16, 20], unit: times / minute; the preset body temperature range may be [36.3, 37.2], unit: °C. That is, the degree of self-danger may be used to characterize the patient's physical state. When the physical state is a healthy state, the degree of self-danger is no danger; when the physical state is a sub-healthy state, the degree of self-danger is a mild danger; and when the physical state is a disease state, the degree of self-danger is a severe danger. The physical state may be determined according to the above example description.
[0071] It should be noted that a device for monitoring the patient's physiological information may be provided on the patient's body surface and wirelessly connected to the electronic device, so that the electronic device can monitor the patient's first physiological information in real time.
[0072] It is understandable that when there is only the own danger level or the preset danger level, only the own danger level or the preset danger level can be determined as the above-mentioned target danger level. However, when the own danger level and the preset danger level are determined at the same time, the maximum danger level of the two should be determined as the target danger level, so as to make the final target strategy as much as possible to enable the operator to quickly query and broadcast the preset voice content corresponding to the danger label to ensure the safety of the patient.
[0073] For example, when the own danger level is no danger and the preset danger level is severe danger, the corresponding target danger level is severe danger. Also, when the own danger level is severe danger and the preset danger level is mild danger, the corresponding target danger level is also severe danger. Also, only when the own danger level is no danger and the preset danger level is no danger, the corresponding target danger level is no danger.
[0074] It is understandable that the preset risk level corresponding to the above-mentioned examination item information can be considered as the objective risk existing during this examination. And the own risk level can be considered as the subjective risk determined based on the patient's own physiological state. By combining the preset risk level corresponding to the objective risk and the own risk level corresponding to the subjective risk, the above-mentioned target risk level is determined, which can ensure that the target strategy determined based on the target risk level is more in line with the actual scenario.
[0075] It is understandable that when the target risk level is greater than or equal to the preset level, it can be considered that the patient's physiological state during the examination may be poor, or that there is strong radiation during the examination process, which poses a certain risk to the patient.
[0076] Therefore, in this scenario, the target strategy should be a strategy that facilitates operators to promptly broadcast preset voice content that is helpful to patient safety.
[0077] For example, if the target danger level is greater than or equal to the preset level, the electronic device can determine the first preset strategy as the target strategy. Furthermore, when multiple preset voice contents are displayed based on the first preset strategy, it is convenient for operators to quickly query and broadcast the preset voice contents corresponding to the danger tags.
[0078] The preset degree can be set according to actual conditions and is not limited thereto. For example, the preset degree can be severe danger.
[0079] Furthermore, when the target risk level is less than the preset level, it can be considered that the patient's physiological state during the examination is good, and the radiation during this examination is weak or contains no radiation, and will not pose a danger to the patient.
[0080] Therefore, in this scenario, the target strategy should be a strategy that facilitates operators to promptly broadcast preset voice content that is not related to the hazard label.
[0081] For example, if the target danger level is less than the preset level, the electronic device can determine the second preset policy as the target policy. Further, when displaying multiple preset voice contents based on the second preset policy, it is convenient for operators to quickly query and broadcast the preset voice contents corresponding to the safety tags.
[0082] In another embodiment, the electronic device can also directly determine the third preset strategy as the target strategy. Among them, sorting according to the frequency of use can make the distribution of each preset voice content more universal. Furthermore, when examining a large number of patients, the examination efficiency is still high.
[0083] It should be added that after adopting the above-mentioned first preset strategy or second preset strategy as the target strategy and displaying the preset voice content, the electronic device can also adopt the third preset strategy to sort and display the preset voice content corresponding to the safety label and the preset voice content corresponding to the danger label.
[0084] For example, for the first preset strategy, on the basis that the touch area of the preset voice content corresponding to the dangerous tag is displayed before the touch area of the preset voice content corresponding to the safe tag in the voice control window, the electronic device can sort the preset voice content corresponding to the dangerous tag according to the usage frequency of the preset voice content corresponding to the dangerous tag. And, according to the usage frequency of the preset voice content corresponding to the safe tag, the preset voice content corresponding to the safe tag is sorted.
[0085] At this time, among the preset voice contents sorted based on usage frequency, the touch area of the preset voice content corresponding to the danger label is still displayed before the touch area of the preset voice content corresponding to the safety label. The only difference is that among all the preset voice contents corresponding to the danger label, the preset voice content with a high usage frequency is displayed before the touch area corresponding to the preset voice content with a low usage frequency. Similarly, among all the preset voice contents corresponding to the safety label, the preset voice content with a high usage frequency is also displayed before the touch area corresponding to the preset voice content with a low usage frequency.
[0086] Similar to the above-mentioned first preset strategy combined with the third preset strategy to display the preset voice content, the electronic device can also display the preset voice content in combination with the second preset strategy and the third preset strategy, which will not be described in detail.
[0087] S104: Based on the target strategy, display touch areas corresponding to a plurality of preset voice contents in at least one voice control window.
[0088] In one embodiment, the touch area is used to respond to a touch operation and broadcast the corresponding preset voice content. The operation object of the touch area includes but is not limited to an operator's hand, a robotic arm, a stylus, and other objects, which are not limited to this. For example, when the operator clicks the touch area, the electronic device can respond to the touch operation and broadcast the preset voice content corresponding to the touch area.
[0089] In one embodiment, the voice control window is a window for displaying the touch area. The number of the voice control windows may be one or more, and there is no limitation on this. For example, when there are more than one voice control window, each voice control window may display the above-mentioned multiple preset voice contents based on the target strategy.
[0090] For example, when there are two voice control windows, the preset voice content corresponding to the safety label and the preset voice content corresponding to the danger label can be displayed respectively. Moreover, the preset voice content displayed in each voice control window can also be sorted and displayed according to the third preset strategy.
[0091] In another embodiment, the touch area may be a virtual area with a certain range. In this case, in order to assist the operator to understand the preset voice content corresponding to the touch area, the electronic device may also display a label corresponding to the touch area in or around the touch area.
[0092] For example, for the preset voice content corresponding to "Please take a deep breath, don't be nervous", its label can be "deep breath"; for the preset voice content corresponding to "Please breathe calmly", its label can be "steady breathing"; for the preset voice content of "Please keep still", its label can be "Don't move", and there is no limitation on this.
[0093] Based on the above description, when a large number of touch areas are displayed in the voice control window, the touch areas are marked with the above labels, which can quickly assist the operator to accurately broadcast the corresponding preset voice content.
[0094] For example, refer to Figure 3 , Figure 3 It is a schematic diagram of an application scenario for displaying a touch area in a voice-triggered display method of a medical device provided in an embodiment of the present application. Figure 3 There are two touch areas, and their corresponding labels are "Don't move" and "Position". The corresponding preset voice content can be "Please keep still" and the details of how to position are not explained in detail.
[0095] In another embodiment, for different preset voice contents, the corresponding voice broadcast duration can also be displayed in the touch area to assist the operator in understanding the broadcast progress.
[0096] In this embodiment, in order to reduce the time and number of times the operator speaks as much as possible, the electronic device can obtain the patient information of the patient to determine the target voice set that the operator needs to use during this examination based on the patient information. Among them, because the target voice set contains multiple preset voice contents that the operator may need to communicate with the patient during this examination. Therefore, when the touch area corresponding to the preset voice content is displayed in the voice control window, the electronic device can broadcast the corresponding preset voice content based on the touch operation of the touch area to reduce the number and time of the operator speaking and reduce the communication burden of the operator. In addition, the electronic device can also configure and display multiple preset voice contents in the voice control window based on the target strategy determined by the patient information. Furthermore, the electronic device can automatically select a suitable display mode to display the touch areas corresponding to multiple preset voice contents according to the actual scene during the patient examination, increase the convenience of the operator when using, and improve the work efficiency of the operator.
[0097] In another embodiment, in order to improve the interactive experience between the electronic device and the patient so that the patient can fully understand the preset voice content of the broadcast, before conducting a medical device examination, the electronic device can also obtain the voice information of the patient when speaking, and adjust the broadcast configuration information of the preset voice content based on the voice information.
[0098] The above-mentioned voice information includes, but is not limited to, the patient's language (Mandarin, dialect), language (Chinese, English, etc.), volume, speech speed, etc. The voice information can be obtained by analyzing the patient's voice after collecting the patient's voice by a voice collection device, or can be set by an operator, or can be preset voice information, which is not limited.
[0099] As an example, the electronic device may automatically broadcast instructions for the patient to speak along with the broadcast content. For example, the instruction "Please speak along with the broadcast content". Then, the electronic device may broadcast a sentence or a preset voice and collect the patient's follow-up voice. Finally, the follow-up voice is analyzed based on the existing feature analysis software or model to obtain the above voice information.
[0100] In one embodiment, the above-mentioned adjustment of the broadcast configuration information can be the same as the broadcast configuration information for adjusting the preset voice content and the voice information. That is, when the preset voice content needs to be broadcast, the broadcast configuration information such as the broadcast language, language, volume, and speech speed is the same as at least one voice information when the patient speaks. Furthermore, by broadcasting the preset voice content with the same broadcast configuration information as the voice information when the patient speaks, the patient can hear the preset voice content more clearly, thereby improving the patient's interactive experience.
[0101] In another embodiment, there may be a variety of emergency scenarios, such as the medical device pressing down on the patient's clothing, or the patient swinging greatly, or because the medical device may need to be moved during the examination process, colliding with the patient's infusion device (the patient may be receiving an infusion), etc. At this time, the operator may not be able to discover the emergency scenario in time and immediately broadcast the corresponding preset voice content to guide or comfort the patient.
[0102] Based on this, in order to guide or comfort the patient in a timely manner, the electronic device can obtain the patient's examination information during the examination process and broadcast the corresponding preset voice content based on the examination information.
[0103] The examination information may include at least one of the patient's movement amplitude, second physiological information, and collision results with the medical device.
[0104] In one embodiment, a camera device may be provided in the scanning room to collect images containing the patient. At this time, the electronic device may obtain two adjacent frames of images from the camera device and perform position analysis on the images to determine the patient's motion amplitude. The electronic device may be pre-set with an analysis model to process the images to obtain the above motion amplitude.
[0105] In one embodiment, the second physiological information is the physiological information that needs to be detected during the examination of the patient; the first physiological information is the physiological information that needs to be detected before the examination of the patient. The second physiological information may be the same as the first physiological information. For example, both detect the same physiological information of the patient, such as heart rate, blood pressure, respiration, body temperature, etc. In addition, the second physiological information may be different from the first physiological information. For example, the second physiological information may not need to detect the age of the patient.
[0106] And, the collision result can be generated based on the collision sensor in the medical device. Exemplarily, when the collision sensor detects a collision, it can generate a collision signal and send it to the electronic device. At this time, when the electronic device detects the collision signal, it can generate a collision result as a result of a collision. Otherwise, when the electronic device does not detect the collision signal, it generates a collision result as a result of no collision.
[0107] Among them, when it is determined that the movement amplitude is greater than the preset amplitude level, the electronic device may consider that the quality of this inspection is low, which will affect the inspection results. Based on this, the electronic device can automatically broadcast the corresponding preset voice content according to the movement amplitude. For example, when the movement amplitude is a mild movement amplitude, the preset voice content of "Please keep still" is broadcast, and when the movement amplitude is a moderate or severe movement amplitude, the preset voice content of "Are you okay? Can you still hold on?" is automatically broadcast, and there is no limitation on this.
[0108] Also, when the second physiological information does not meet the preset requirements, for example, when it does not meet the multiple ranges corresponding to the above-mentioned first physiological information, the preset voice contents such as "Please take a deep breath, don't be nervous" and "Please breathe calmly" are broadcast respectively, and no detailed explanation is given for this.
[0109] Also, when the collision result is a collision, it will usually cause the scanning to be interrupted. At this time, the electronic device can automatically broadcast the preset voice content "Please stay still, don't be nervous, the staff will come to deal with it soon."
[0110] In another embodiment, the electronic device may also automatically broadcast preset voice content such as "The scan is complete, you cooperated very well, please pick up the report in xx hours" when detecting that the examination is complete.
[0111] Based on the above description, in this embodiment, when faced with the above-mentioned various emergency scenarios, the electronic device can also immediately broadcast the corresponding preset voice content to guide and comfort the patient and ensure the smooth progress of the examination as much as possible.
[0112] See also Figure 4 , Figure 4 1 is a block diagram of a display device for medical equipment triggered by voice provided in an embodiment of the present application. The display device for medical equipment triggered by voice in this embodiment includes modules for executing Figures 1 to 3 For details, please refer to the steps in the corresponding embodiment. Figures 1 to 3 as well as Figures 1 to 3 For the convenience of explanation, only the parts related to this embodiment are shown. Figure 4 , the display device 400 triggered by voice of medical equipment may include: a first acquisition module 410, a first determination module 420, a second determination module 430 and a display module 440, wherein:
[0113] The first acquisition module 410 is used to acquire patient information of a patient.
[0114] The first determination module 420 is used to determine a target speech set according to the patient information.
[0115] The second determination module 430 is used to determine a target strategy for configuring and displaying a plurality of preset voice contents in the target voice set according to the patient information and the target voice set.
[0116] The display module 440 is used to display touch areas corresponding to multiple preset voice contents in at least one voice control window based on the target strategy; the touch areas are used to broadcast the corresponding preset voice contents in response to the touch operation.
[0117] In one embodiment, the patient information includes the first physiological information and the examination item information that the patient needs to examine; the first determination module 420 is further used to:
[0118] The target speech set is determined according to the inspection item information.
[0119] The second determining module 430 is further configured to:
[0120] Based on the first physiological information and / or the examination item information, a target strategy corresponding to the target speech set is determined.
[0121] In one embodiment, the second determining module 430 is further configured to:
[0122] Based on the first physiological information and / or the examination item information, a target risk level of the patient during the examination is determined; and a target strategy is determined according to the target risk level.
[0123] In one embodiment, the second determining module 430 is further configured to:
[0124] If the target danger level is greater than or equal to the preset level, the first preset strategy is determined as the target strategy; the first preset strategy includes in the voice control window, the touch area of the preset voice content corresponding to the danger label is displayed before the touch area of the preset voice content corresponding to the safety label; if the target danger level is less than the preset level, the second preset strategy is determined as the target strategy; the second preset strategy includes in the voice control window, the touch area of the preset voice content corresponding to the danger label is displayed after the touch area of the preset voice content corresponding to the safety label.
[0125] In one embodiment, the medical device voice-triggered display device 400 further includes:
[0126] The third determination module is used to determine the third preset strategy as the target strategy; the third preset strategy includes that in the voice control window, the touch area corresponding to the preset voice content with high usage frequency is displayed before the touch area corresponding to the preset voice content with low usage frequency.
[0127] In one embodiment, the medical device voice-triggered display device 400 further includes:
[0128] The second acquisition module is used to acquire the voice information of the patient when speaking.
[0129] The adjustment module is used to adjust the broadcast configuration information of the preset voice content when it is broadcast based on the voice information.
[0130] In one embodiment, the voice information includes at least one of the patient's speaking speed, language, and volume; the adjustment module is further configured to:
[0131] The configuration information for adjusting the preset voice content is the same as the voice information.
[0132] When it is understood that Figure 4 In the structural block diagram of the medical device voice-triggered display device shown, each module is used to execute Figures 1 to 3 The steps in the corresponding embodiments, and for Figures 1 to 3 Each step in the corresponding embodiment has been explained in detail in the above embodiment. Figures 1 to 3 as well as Figures 1 to 3 The relevant descriptions in the corresponding embodiments are not repeated here.
[0133] Figure 5 1 is a structural block diagram of an electronic device provided by an embodiment of the present application. Figure 5 As shown, the electronic device 500 of this embodiment includes: a processor 510, a memory 520, and a computer program 530 stored in the memory 520 and executable on the processor 510, such as a program of a display method for voice triggering of a medical device. When the processor 510 executes the computer program 530, the steps of each embodiment of the display method for voice triggering of a medical device are implemented, such as Figure 1 Alternatively, the processor 510 implements the above when executing the computer program 530 Figure 4 The functions of each module in the corresponding embodiment are, for example, Figure 4 For details on the functions of each module shown, please refer to Figure 4 Related description in the corresponding embodiment.
[0134] Exemplarily, the computer program 530 can be divided into one or more modules, one or more modules are stored in the memory 520, and are executed by the processor 510 to implement the medical device voice-triggered display method provided in the embodiment of the present application. One or more modules can be a series of computer program instruction segments that can perform specific functions, and the instruction segments are used to describe the execution process of the computer program 530 in the electronic device 500. For example, the computer program 530 can implement the medical device voice-triggered display method provided in the embodiment of the present application.
[0135] The electronic device 500 may include, but is not limited to, a processor 510 and a memory 520. Those skilled in the art will appreciate that Figure 5 It is only an example of the electronic device 500 and does not constitute a limitation of the electronic device 500. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the electronic device may also include input and output devices, network access devices, buses, etc.
[0136] The processor 510 may be a central processing unit, or other general-purpose processors, digital signal processors, application-specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0137] The memory 520 may be an internal storage unit of the electronic device 500, such as a hard disk or memory of the electronic device 500. The memory 520 may also be an external storage device of the electronic device 500, such as a plug-in hard disk, a smart memory card, a flash memory card, etc. equipped on the electronic device 500. Furthermore, the memory 520 may also include both an internal storage unit of the electronic device 500 and an external storage device.
[0138] An embodiment of the present application provides a computer-readable storage medium, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a voice-triggered display method of a medical device as in the above-mentioned embodiments is implemented.
[0139] An embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the voice-triggered display method of the medical device in the above-mentioned embodiments.
[0140] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.
Claims
1. A voice-triggered display method for medical equipment, characterized in that: The method comprises: obtain patient information from patients; Determine a target speech set according to the patient information; Determining, according to the patient information and the target voice set, a target strategy for configuring and displaying a plurality of preset voice contents in the target voice set; Based on the target strategy, in at least one voice control window, touch areas corresponding to a plurality of the preset voice contents are displayed; the touch areas are used to broadcast the corresponding preset voice contents in response to a touch operation.
2. The method according to claim 1, characterized in that The patient information includes first physiological information and examination item information; and determining a target voice set according to the patient information includes: Determine the target speech set according to the inspection item information; The step of determining, based on the patient information and the target voice set, a target strategy for configuring and displaying a plurality of preset voice contents in the target voice set includes: The target strategy corresponding to the target speech set is determined based on the first physiological information and / or the examination item information.
3. The method according to claim 2, characterized in that The determining, based on the first physiological information and / or the examination item information, the target strategy corresponding to the target speech set includes: Determining a target risk level of the patient when undergoing an examination based on the first physiological information and / or the examination item information; The target strategy is determined according to the target risk level.
4. The method according to claim 3, characterized in that Determining the target strategy according to the target risk level includes: If the target danger level is greater than or equal to the preset level, a first preset strategy is determined as the target strategy; the first preset strategy includes that in the voice control window, the touch area of the preset voice content corresponding to the danger label is displayed before the touch area of the preset voice content corresponding to the safety label; If the target danger level is less than the preset level, the second preset strategy is determined as the target strategy; the second preset strategy includes in the voice control window, the touch area of the preset voice content corresponding to the danger label is displayed after the touch area of the preset voice content corresponding to the safety label.
5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: A third preset strategy is determined as the target strategy; the third preset strategy includes, in the voice control window, displaying the touch area corresponding to the preset voice content with high usage frequency before the touch area corresponding to the preset voice content with low usage frequency.
6. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquiring voice information of the patient when speaking; Adjust the broadcast configuration information of the preset voice content when broadcasting based on the voice information.
7. The method according to claim 6, characterized in that The voice information includes at least one of the speech speed, language and volume of the patient when speaking; the configuration information of adjusting the preset voice content when broadcasting based on the voice information includes: The broadcast configuration information for adjusting the preset voice content is the same as the voice information.
8. A voice-triggered display device for medical equipment, characterized in that: The device comprises: A first acquisition module is used to acquire patient information of a patient; A first determination module, configured to determine a target speech set according to the patient information; A second determination module is used to determine a target strategy for configuring and displaying a plurality of preset voice contents in the target voice set according to the patient information and the target voice set; The display module is used to display, based on the target strategy, in at least one voice control window, a plurality of touch areas corresponding to the preset voice contents; the touch areas are used to broadcast the corresponding preset voice contents in response to a touch operation.
9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.
10. A computer program product, characterized in that When the computer program product is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 7.