Ultrasonic inspection method and device and computer equipment

Abstract

The invention relates to an ultrasonic inspection method and device and computer equipment. The method comprises the following steps: responding to an ultrasonic examination demand of an examination object; displaying a prompt message sent by the target ultrasonic equipment to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasonic inspection process of the inspection object and is used for guiding the inspection object to execute corresponding actions according to the prompt message. By adopting the method, the ultrasonic inspection efficiency can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of ultrasonic inspection, and in particular to an ultrasonic inspection method, device and computer equipment. Background Art

[0002] Ultrasound examination is a non-invasive examination method without radiation damage and is widely used in clinical practice.

[0003] In the related art, the doctor mainly guides the examinee to enter the corresponding examination room by calling the number, reminds the examinee of the matters that need to be paid attention to during the examination by means of verbal prompts, and prompts the examinee to adjust the posture during the ultrasound examination by means of verbal prompts.

[0004] However, the related art approach makes the efficiency of ultrasound examination low. Summary of the invention

[0005] Based on this, it is necessary to provide an ultrasonic inspection method, device and computer equipment to improve the efficiency of ultrasonic inspection in response to the above technical problems.

[0006] In a first aspect, the present application provides an ultrasonic inspection method, which is applied to a head-mounted device, wherein the head-mounted device communicates with a target ultrasonic device, including:

[0007] Responding to a subject's request for an ultrasound examination;

[0008] The prompt message sent by the target ultrasound device is displayed to the subject of the inspection; the prompt message is generated based on the current state of the subject of the inspection and the ultrasound inspection process of the subject of the inspection, and is used to guide the subject of the inspection to perform corresponding actions according to the prompt message.

[0009] In one embodiment, the prompt message includes a path guidance message, a posture guidance message, and an ultrasound examination message; and the prompt message sent by the target ultrasound device is displayed to the subject of the examination, including:

[0010] When the subject under examination is not within the preset range around the target ultrasound device, a path guidance message sent by the target ultrasound device is displayed to the subject under examination; the path guidance message is used to guide the subject under examination to move within the preset range of the target ultrasound device;

[0011] When the subject is within the preset range of the target ultrasound device, a posture guidance message sent by the target ultrasound device is displayed to the subject; the posture guidance message is used to guide the subject to position according to the target posture;

[0012] When the posture of the inspection object is the target posture, the ultrasound inspection message sent by the target ultrasound device is displayed to the inspection object.

[0013] In one of the embodiments, presenting a path guidance message sent by a target ultrasound device to a subject under examination includes:

[0014] Sending the surrounding environment information and location information of the inspection object to the target ultrasound device;

[0015] A moving path of the inspection object sent by the target ultrasound device is received; the moving path is generated based on the surrounding environment information, the position information of the inspection object and the position information of the target ultrasound device.

[0016] In one of the embodiments, the posture guidance message includes an animated guidance video;

[0017] The posture guidance message sent by the target ultrasound device is displayed to the examinee, including:

[0018] Receiving an animation guidance video sent by a target ultrasound device; the animation guidance video is a video matching a current inspection process; the current inspection process is determined based on the ultrasound inspection process and the current state of the inspection object;

[0019] Play an animated guidance video to the subject being examined.

[0020] In one of the embodiments, at least one of the current examination process animation, examination site, examination method, remaining steps and estimated examination time of the target ultrasound device is displayed to the examination subject.

[0021] In a second aspect, the present application also provides an ultrasonic inspection method, which is applied to a target ultrasonic device, where the target ultrasonic device communicates with a head-mounted device, and the method includes:

[0022] In response to the ultrasonic examination requirements of the subject, a prompt message corresponding to the ultrasonic examination process is generated according to the current state of the subject and the ultrasonic examination process; the prompt message is used to guide the subject to perform corresponding actions according to the prompt message;

[0023] Send a prompt message to the headset.

[0024] In one embodiment, the prompt message includes multiple animation guidance videos, and the construction process of the multiple animation guidance videos includes:

[0025] Divide the ultrasound examination process into multiple examination steps;

[0026] Get the inspection notes corresponding to each inspection step;

[0027] The actions corresponding to each inspection precaution are simulated to obtain multiple animation guidance videos corresponding to the ultrasound inspection process.

[0028] In a third aspect, the present application also provides an ultrasonic inspection device, comprising:

[0029] A response module, used for responding to the ultrasonic examination demand of the examination object;

[0030] The display module is used to display the prompt message sent by the target ultrasound device to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasound inspection process of the inspection object, and is used to guide the inspection object to perform corresponding actions according to the prompt message.

[0031] In a fourth aspect, the present application also provides an ultrasonic inspection device, comprising:

[0032] A generation module, which is used to respond to the ultrasonic examination requirements of the examination object and generate a prompt message corresponding to the ultrasonic examination process according to the current state of the examination object and the ultrasonic examination process; the prompt message is used to guide the examination object to perform corresponding actions according to the prompt message;

[0033] The sending module is used to send a prompt message to the head mounted device.

[0034] In a fifth aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the content of any one embodiment of the ultrasonic inspection method in the first aspect mentioned above is implemented.

[0035] In a sixth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the content of any one embodiment of the ultrasonic inspection method in the first aspect above.

[0036] In a seventh aspect, the present application further provides a computer program product, comprising a computer program, which, when executed by a processor, implements the content of any one embodiment of the ultrasonic inspection method in the first aspect above.

[0037] The above-mentioned ultrasonic examination method, device and computer equipment respond to the ultrasonic examination needs of the inspection object; display the prompt message sent by the target ultrasonic device to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasonic examination process of the inspection object, and is used to guide the inspection object to perform corresponding actions according to the prompt message. The head-mounted device in this method can be bound to the target ultrasonic device. The head-mounted device receives the prompt information sent by the target ultrasonic device and displays the prompt message to the user. The user can perform corresponding actions based on the prompt message, which reduces the interaction time between the doctor and the inspection object and improves the efficiency of the ultrasonic examination. At the same time, the prompt message is generated by the target ultrasonic device based on the current state of the inspection object and the ultrasonic examination process of the inspection object, that is, the data processing process is completed on the target ultrasonic device without the participation of the head-mounted device, which reduces the hardware requirements of the head-mounted device, thereby reducing the size of the head-mounted device and improving the convenience of using the head-mounted device. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0039] FIG1 is a diagram of an application environment of an ultrasonic inspection method according to an embodiment;

[0040] FIG2 is a schematic diagram of a scenario of an ultrasonic inspection method in one embodiment;

[0041] FIG3 is a schematic diagram of a flow chart of an ultrasonic inspection method in one embodiment;

[0042] FIG4 is a schematic diagram of a screen seen by an inspection subject in one embodiment;

[0043] FIG5 is a schematic diagram of a process flow of an ultrasonic inspection method in one embodiment;

[0044] FIG6 is a basic scanning configuration interface of an ultrasound examination process in one embodiment;

[0045] FIG7 is a schematic diagram of a process flow of an ultrasonic inspection method in one embodiment;

[0046] FIG8 is a schematic diagram of a process flow of an ultrasonic inspection method in one embodiment;

[0047] FIG9 is a schematic diagram of a posture guidance message in one embodiment;

[0048] FIG10 is a schematic flow chart of an ultrasonic inspection method in one embodiment;

[0049] FIG11 is a schematic flow chart of an ultrasonic inspection method in one embodiment;

[0050] FIG12 is a schematic flow chart of an ultrasonic inspection method in one embodiment;

[0051] FIG13 is a block diagram of an ultrasonic inspection device in one embodiment;

[0052] FIG. 14 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0054] Before introducing the technical solution of the present application in detail, a brief introduction to the background technology of the present application is first given.

[0055] Ultrasonic equipment usually consists of an ultrasonic signal transmitting device, an ultrasonic signal receiving device, an ultrasonic imaging device, a display device, and an ultrasonic signal processing device. Before ultrasonic scanning, the user can input parameter configuration information through the physical operation panel and touch screen on the display device. During the ultrasonic scanning process, the display screen can show the user relevant information about the ultrasonic process.

[0056] When a doctor uses an ultrasound device to scan the subject, he or she holds the probe of the ultrasound device with one hand to scan the relevant parts of the subject, and uses the other hand to operate the ultrasound device. At the same time, the doctor's eyes also need to view the real-time image through the display screen of the ultrasound device. That is, the operation position of the doctor's hands is different from the observation position of the eyes, and there may be operation errors. When the subject needs to adjust the posture to obtain a higher quality image, the doctor can often only interact with the subject through verbal prompts. If the subject cannot understand the doctor's instructions well, multiple communications and adjustments will be required, resulting in a poor medical experience for the subject and affecting the doctor's scanning efficiency.

[0057] For the subject being examined, in addition to the ears being able to receive information, the eyes can also receive help and instructions from the doctor. Based on this, the present application provides an ultrasonic examination method, apparatus, and computer equipment. By having the subject being examined wear a head-mounted device, the information that needs to be adjusted can be displayed to the subject in the form of text or animation. In this way, the interaction time between the doctor and the subject being examined can be reduced, and the scanning efficiency can be improved. At the same time, it can also promote the cooperation between the doctor and the subject being examined, and improve the subject's medical experience. Of course, the technical solution provided in the embodiments of the present application is not limited to solving only the above-mentioned problems, and there are other technical effects. For details, please refer to the following embodiment description. The technical solution of the present application is described in detail below.

[0058] The ultrasonic inspection method provided in the embodiment of the present application can be applied in the application environment as shown in Figure 1. The application environment includes a head-mounted device 101 and multiple ultrasonic devices 102, and the head-mounted device 101 can communicate with any one of the multiple ultrasonic devices 102. Taking the communication between the target ultrasonic device among the multiple ultrasonic devices 102 and the head-mounted device 101 as an example, the head-mounted device 101 can respond to the ultrasonic inspection needs of the inspection object; display the prompt message sent by the target ultrasonic device to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasonic inspection process of the inspection object, and is used to guide the inspection object to perform corresponding actions according to the prompt message. Exemplarily, Figure 2 shows a scene schematic diagram of the ultrasonic inspection method, where the head-mounted device is worn on the head of the inspection object, and the head-mounted device and the target ultrasonic device communicate with each other through a wireless access point.

[0059] In an exemplary embodiment, as shown in FIG3 , an ultrasonic inspection method is provided, which is described by taking the method applied to the head mounted device in FIG1 as an example, and includes the following steps 201 to 202. Among them:

[0060] S201, responding to an ultrasonic examination requirement of an examination subject.

[0061] In an embodiment of the present application, the head-mounted device communicates with the target ultrasound device, and the head-mounted device can receive ultrasound examination requirements sent by the target ultrasound device. The ultrasound examination requirements can be examination requirements generated by the doctor based on the physiological characteristics of the examination object, and the examination requirements are synchronized to the target ultrasound device manually or by the doctor's examination system. Alternatively, the head-mounted device can also communicate with the doctor's examination system, and the doctor's examination system can also directly synchronize the ultrasound examination requirements of the examination object to the head-mounted device.

[0062] Among them, the head-mounted device is mainly worn on the head of the inspected object, and the inspected object can observe the display interface displayed by the head-mounted device through the eyes. The display interface is a translucent user interface (UI) layer, and the real scene can be seen through the display interface. In other words, the head-mounted device can not only display the content that needs to be displayed for the inspected object, but also collect images of the real scene. In this way, the picture seen by the eyes of the inspected object is the content superimposed on the display interface and the real scene, which can facilitate the inspected object to obtain help and prompt information anytime and anywhere without restriction. Figure 4 is a schematic diagram of the picture seen by the inspected object. From the figure, it can be seen that the content displayed on the display interface (similar to the arrow indicating the path) and the real scene (the actual scene where the inspected object is located). The head-mounted device has image output and image acquisition functions, and needs to meet the characteristics of comfortable wearing, simple and light, and can be put on and taken off at any time. For example, it can be worn by the inspected object in the shape of glasses. At the same time, the head-mounted device has an internal battery that can power the device. In addition, the head-mounted device also has a wireless network communication function, which can send and receive data wirelessly.

[0063] S202, showing the inspection subject a prompt message sent by the target ultrasound device; the prompt message is generated based on the inspection subject's current state and the inspection subject's ultrasound inspection process, and is used to guide the inspection subject to perform corresponding actions according to the prompt message.

[0064] Among them, the prompt message may include a prompt message before the ultrasound examination and a prompt message during the ultrasound examination. For example, the prompt message before the ultrasound examination may be to guide the subject to approach the target ultrasound device, and to guide the subject to lie flat on the examination bed corresponding to the target ultrasound device according to the examination requirements. The prompt message during the ultrasound examination may be posture adjustment, related information during the ultrasound examination, etc.

[0065] In the embodiment of the present application, whether it is the preparation process before the ultrasound examination or the ultrasound examination process, the target ultrasound device can obtain the current state of the examination object in real time through interaction with the head-mounted device. For example, the current state of the examination object can be looking for the target examination room, lying flat on the scanning bed waiting for examination, going through the Nth examination step, etc.

[0066] The target ultrasound device can match the current state of the inspection object with the ultrasound inspection process, and predict the prompt screen required by the inspection object in the current state or in the next state according to the matching result. The prompt screen can be a text message or an animation message, etc.

[0067] After the head-mounted device receives the prompt message sent by the target ultrasound device, it uses the image acquisition function on the head-mounted device to collect the scene image of the inspection object and transmits it to the target ultrasound device through the wireless network. The target ultrasound device uses the internal logic processor and storage device to process the scene image. Using intelligent algorithms such as pattern recognition and deep learning, the scene image is mapped to the internal map data, the scene image and the prompt image are fused and rendered, and the prompt message for the current scene is generated. The prompt message for the current scene is sent to the head-mounted device.

[0068] In the above-mentioned ultrasound examination method, in response to the ultrasound examination needs of the subject being examined; the prompt message sent by the target ultrasound device is displayed to the subject being examined; the prompt message is generated based on the current state of the subject being examined and the ultrasound examination process of the subject being examined, and is used to guide the subject being examined to perform corresponding actions according to the prompt message. The head-mounted device in this method can be bound to the target ultrasound device. The head-mounted device receives the prompt information sent by the target ultrasound device and displays the prompt message to the user. The user can then perform corresponding actions based on the prompt message, thereby reducing the interaction time between the doctor and the subject being examined and improving the efficiency of the ultrasound examination. At the same time, the prompt message is generated by the target ultrasound device based on the current state of the subject being examined and the ultrasound examination process of the subject being examined, that is, the data processing process is all completed on the target ultrasound device without the participation of the head-mounted device, which reduces the hardware requirements of the head-mounted device, thereby being able to reduce the size of the head-mounted device and improve the ease of use of the head-mounted device.

[0069] Optionally, if the hardware requirements of the head-mounted device do not need to be considered, a controller can also be set on the head-mounted device to complete the data processing process directly in the head-mounted device.

[0070] The guidance process for the user may include guidance before the ultrasound examination and guidance during the ultrasound examination. Correspondingly, the prompt message includes a path guidance message, a posture guidance message, and an ultrasound examination message. In one embodiment, as shown in FIG5 , the prompt message sent by the target ultrasound device is displayed to the subject of the examination, including:

[0071] S301, when the inspection object is not within a preset range around the target ultrasound device, displaying a path guidance message sent by the target ultrasound device to the inspection object; the path guidance message is used to guide the inspection object to move within the preset range of the target ultrasound device.

[0072] Ultrasound equipment has many advantages such as no radiation, real-time scanning, easy operation, high safety factor, fast test results and good cost performance. It is installed in large quantities in terminal medical institutions. In other words, a hospital has multiple ultrasound equipment, and each ultrasound equipment is set in an ultrasound examination room. Therefore, before the ultrasound examination, the subject needs to find the target examination room from multiple ultrasound examination rooms.

[0073] The ultrasonic calling machine can determine the target ultrasonic device and head-mounted device of the inspection object based on the information of the inspection object (for example, ID information). At this time, the target ultrasonic device and the head-mounted device are bound to each other. After the inspection object wears the head-mounted device, the target ultrasonic device can generate a path guidance message for the inspection object based on its own position information and the position information of the head-mounted device to guide the inspection object to the target inspection room corresponding to the target ultrasonic device. As shown in FIG4, the path guidance message can be an arrow indicating the direction to be walked.

[0074] S302, when the subject to be examined is within a preset range of the target ultrasound device, a posture guidance message sent by the target ultrasound device is displayed to the subject to be examined; the posture guidance message is used to guide the subject to be examined to position according to the target posture.

[0075] When the subject is within the preset range around the target ultrasound device, the subject needs to be guided to lie flat on the scanning bed and position according to the preset posture. Based on this, the head-mounted device can receive the posture guidance message sent by the target ultrasound device and display the posture guidance message to the user. After the user sees the posture guidance message, he can move to the scanning bed based on the posture guidance message and position according to the posture in the prompt message.

[0076] FIG. 6 shows a basic scanning configuration interface of an ultrasonic examination process, which includes switching between different examination parts, switching between different prompt messages, and switching between different examination modes.

[0077] S303: When the posture of the inspection object is the target posture, display the ultrasound inspection message sent by the target ultrasound device to the inspection object.

[0078] For a simple ultrasound examination, the examinee can often see or feel what the doctor is doing. However, in some special ultrasound examination scenarios, the examinee cannot see it intuitively. For example, the ultrasound examination process is interventional ultrasound, and the examinee often does not know what will happen, and feels nervous and afraid, which makes the examinee unable to actively cooperate with the ultrasound doctor's work. In response to this situation, we can use a head-mounted device to display the upcoming scanning operation in the form of 2D or 3D animation during the ultrasound examination. In this way, the examinee can see the matters that need to be paid attention to and the steps that need to be coordinated during the ultrasound examination. These steps can be decomposed, that is, the examinee can synchronously know what is happening and what needs to be done.

[0079] In an embodiment of the present application, when the subject is already on the scanning bed and has been positioned according to the target posture, the head-mounted device can receive the ultrasound examination message sent by the target ultrasound device and display the ultrasound examination message sent by the target ultrasound device to the subject.

[0080] In one embodiment, the above-mentioned displaying the specific content of the ultrasound examination message sent by the target ultrasound device to the examination subject includes: displaying at least one of the current examination process animation, examination part, examination method, remaining steps and estimated examination time of the target ultrasound device to the examination subject.

[0081] In the above-mentioned ultrasound examination method, when the object of examination is not within the preset range around the target ultrasound device, the path guidance message sent by the target ultrasound device is displayed to the object of examination; the path guidance message is used to guide the object of examination to move to the preset range of the target ultrasound device; when the object of examination is within the preset range of the target ultrasound device, the posture guidance message sent by the target ultrasound device is displayed to the object of examination; the posture guidance message is used to guide the object of examination to position according to the target posture; when the posture of the object of examination is the target posture, the ultrasound examination message sent by the target ultrasound device is displayed to the object of examination. Based on the ultrasound examination process, this method divides the prompt messages into prompt messages corresponding to three different stages, and displays the corresponding prompt messages to the user through the head-mounted device at different stages to remind the user to prepare before the ultrasound examination, and displays the ultrasound examination message to the user during the ultrasound examination, thereby reducing the interaction between the doctor and the object of examination and improving the efficiency of the ultrasound examination.

[0082] Next, the display path guidance message and the posture guidance message are introduced respectively. First, the display path guidance message is introduced through an embodiment, as shown in FIG7 , the above-mentioned display path guidance message sent by the target ultrasound device to the inspection object includes:

[0083] S401, sending surrounding environment information and position information of the inspection object to a target ultrasound device.

[0084] The surrounding environment information of the inspection object refers to the environment information in which the head mounted device is located.

[0085] In the embodiment of the present application, the head-mounted device can determine its position information under the physical space map based on its own positioning device, and send the position information to the target ultrasound device. At the same time, the head-mounted device can also use its own camera to capture the surrounding environment information, and send the captured environment information to the target ultrasound device.

[0086] S402, receiving a moving path of the inspection object sent by the target ultrasound device; the moving path is generated based on surrounding environment information, position information of the inspection object and position information of the target ultrasound device.

[0087] In an embodiment of the present application, after the target ultrasound device receives the surrounding environment information and the position information of the inspection object, it calculates the position difference between the position information of the target ultrasound device itself and the position information of the inspection object. And based on the position difference and the surrounding environment information, a moving path for the inspection object is generated, and the moving path is sent to the head-mounted device. After the head-mounted device receives the moving path, it guides the user to approach the target ultrasound device based on the moving path. For example, the moving path is to go straight along the corridor to the door of the 402 inspection room, and then move to the right front after entering the inspection room to the vicinity of the target ultrasound device. Then, the user can follow the moving path until it moves to the vicinity of the target ultrasound device.

[0088] In the above-mentioned ultrasonic inspection method, the surrounding environment information and position information of the inspection object are sent to the target ultrasonic device; the moving path of the inspection object sent by the target ultrasonic device is received; the moving path is generated based on the surrounding environment information, the position information of the inspection object and the position information of the target ultrasonic device. By showing the user the moving path generated by the target ultrasonic device based on the surrounding environment information, the position information of the inspection object and the position information of the target ultrasonic device, the method can efficiently guide the user to the corresponding inspection room, thereby reducing the time the user spends searching for the inspection room.

[0089] Next, the display process of the posture guidance message is introduced through an embodiment. As shown in FIG8 , the posture guidance message includes an animation guidance video. The specific content of the posture guidance message sent by the target ultrasound device is displayed to the inspection object, including the following steps:

[0090] S501, receiving an animation guidance video sent by a target ultrasound device; the animation guidance video is a video matching a current inspection process; the current inspection process is determined based on the ultrasound inspection process and the current state of the inspection object.

[0091] The posture guidance message can be presented in the form of two-dimensional or three-dimensional animation, assisted by text and sound prompts, and the animation will be attached to the scene screen. Figure 9 shows a schematic diagram of the posture guidance message. When the subject is required to lie flat on the scanning bed, the subject can see the position of the scanning bed through the head-mounted device, as well as the 3D man rendered on the transparent UI layer on the display interface, lying flat on the scanning bed. The posture reminder message will be played repeatedly until the subject lies flat on the scanning bed. The animated prompts can enable the subject to execute the doctor's instructions without obstacles, including some elderly people with hearing impairments or poor language comprehension. This can reduce the tension of the subject during the ultrasound examination and improve the efficiency of the ultrasound examination.

[0092] In an embodiment of the present application, the target ultrasound device can search for a video that matches the current inspection process from multiple preset animation videos, and send the found animation guidance video to the head-mounted device.

[0093] S502: Play an animation guidance video to the inspection object.

[0094] In an embodiment of the present application, after receiving the animation guidance video, the head-mounted device displays the animation guidance video to the user. The animation guidance video can be played a preset number of times, for example, the preset number of times is 3 times. Alternatively, the head-mounted device can also repeatedly play the animation guidance video, obtain the current state of the inspection object during the playback process, and send the current state of the inspection object to the target ultrasound device. The target ultrasound device can determine whether the inspection object has completed the corresponding action based on the current state of the inspection object, and if so, send a pause playback instruction to the head-mounted device.

[0095] In the above-mentioned ultrasound inspection method, an animation guidance video sent by a target ultrasound device is received; the animation guidance video is a video matching the current inspection process; the current inspection process is determined based on the ultrasound inspection process and the current state of the inspection object; and the animation guidance video is played to the inspection object. The target ultrasound device matches the current inspection process with multiple animation guidance videos, searches for an animation guidance video suitable for the current inspection process from the multiple animation guidance videos, and then displays the animation guidance video to the user through a head-mounted device, which can provide targeted guidance during the ultrasound inspection process.

[0096] In an exemplary embodiment, as shown in FIG10 , an ultrasonic inspection method is provided, which is described by taking the method applied to the target ultrasonic device in FIG1 as an example, and includes the following steps 601 to 602. Among them:

[0097] S601, in response to the ultrasonic examination demand of the examination subject, a prompt message corresponding to the ultrasonic examination process is generated according to the current state of the examination subject and the ultrasonic examination process; the prompt message is used to guide the examination subject to perform corresponding actions according to the prompt message.

[0098] In the embodiment of the present application, each ultrasonic inspection process has at least one corresponding prompt message, for example, the preparation process before the ultrasonic inspection corresponds to the path guidance message and the posture guidance message; the ultrasonic inspection process corresponds to the ultrasonic inspection message. Based on this, the target ultrasonic device can receive the current state of the inspection object, match the current state of the inspection object with the ultrasonic inspection process, and determine the process corresponding to the current state of the inspection object. And obtain the prompt message corresponding to the process corresponding to the current state.

[0099] Furthermore, in each inspection process, the target ultrasound device can also obtain the current status of the inspection object and generate a prompt message corresponding to the current status. For example, the inspection object has been lying flat on the scanning bed according to the requirements of the inspection process, but the inspection object's posture is wrong. At this time, it is necessary to generate a relevant prompt message for the inspection object to change its posture.

[0100] S602: Send a prompt message to the head mounted device.

[0101] In the embodiment of the present application, after generating a prompt message corresponding to the ultrasound examination process, the target ultrasound device can send the prompt message to the head-mounted device. After receiving the prompt message, the head-mounted device displays the prompt message to the user through a display interface.

[0102] In the above-mentioned ultrasound examination method, in response to the ultrasound examination demand of the inspection object, a prompt message corresponding to the ultrasound examination process is generated according to the current state of the inspection object and the ultrasound examination process; the prompt message is used to guide the inspection object to perform corresponding actions according to the prompt message; and the prompt message is sent to the head-mounted device. The target ultrasound device in this method is bound to the head-mounted device, and the target ultrasound device can accurately generate a prompt message corresponding to the ultrasound examination process based on the current state of the inspection object and the ultrasound examination process, that is, the data processing process is completed on the target ultrasound device without the participation of the head-mounted device, which reduces the hardware requirements of the head-mounted device, thereby reducing the size of the head-mounted device and improving the convenience of using the head-mounted device. In addition, the target ultrasound device sends the prompt message to the head-mounted device, and the head-mounted device can display the prompt message to the user, and the user can perform corresponding actions based on the prompt message, which reduces the interaction time between the doctor and the inspection object and improves the efficiency of the ultrasound examination.

[0103] Assuming that the prompt message includes multiple animation guidance videos, then, in one embodiment, as shown in FIG. 11 , the construction process of the multiple animation guidance videos includes:

[0104] S701, dividing the ultrasonic inspection process into multiple inspection steps.

[0105] In the embodiment of the present application, the target ultrasound device can divide the ultrasound inspection process according to the guidance process to obtain multiple inspection steps. For example, the multiple inspection steps in the ultrasound inspection process include: path guidance, posture guidance, and ultrasound inspection guidance.

[0106] S702, obtaining inspection precautions corresponding to each inspection step.

[0107] Among them, inspection precautions refer to matters that need to be noted when the ultrasound inspection equipment performs each inspection step. For example, for the overall ultrasound process of flat-bed stress ultrasound, it is necessary to first perform an ultrasound examination in the left lateral position, then do treadmill exercises, lie down quickly after the exercise (<60s) to perform the second ultrasound examination; after a period of recovery, perform the third ultrasound examination.

[0108] In the embodiment of the present application, different inspection steps have corresponding inspection precautions, and the inspection precautions corresponding to each inspection step are stored in the memory. The target ultrasound device can obtain the inspection precautions corresponding to each inspection step from the memory.

[0109] S703, simulating the actions corresponding to the various inspection precautions to obtain multiple animation guidance videos corresponding to the ultrasound inspection process.

[0110] In the embodiment of the present application, for any inspection step, the target ultrasound device can obtain the action corresponding to the inspection precautions of the inspection step, and use simulation software to simulate the action to obtain the animation guidance video corresponding to the inspection step. In this way, the animation guidance video corresponding to each inspection step in the ultrasound inspection process can be obtained.

[0111] In the above-mentioned ultrasonic inspection method, the ultrasonic inspection process is divided into multiple inspection steps; the inspection precautions corresponding to each inspection step are obtained; the actions corresponding to each inspection precaution are simulated to obtain multiple animation guidance videos corresponding to the ultrasonic inspection process. By dividing the ultrasonic inspection process, this method can start from smaller inspection steps, simulate the corresponding actions based on the inspection precautions of the inspection step, and generate multiple animation guidance videos corresponding to the ultrasonic inspection process, so as to provide a more comprehensive guidance video for the inspection object.

[0112] FIG12 is a flow chart of an ultrasonic inspection method, which includes: S801, the target ultrasonic device identifies the current scanning step; S802: the target ultrasonic device pairs the animation guidance message of the corresponding scanning step; S803: the target ultrasonic device renders the animation guidance message, and sends the rendered animation guidance message to the head-mounted device; S804: after the head-mounted device receives the animation guidance message, it displays it to the user. It should be noted that the rendering process may have been completed during the construction of multiple animation guidance videos, or it may be rendered after the construction of multiple animation guidance videos is completed and before they need to be sent to the head-mounted device. The embodiments of the present application do not limit this.

[0113] Taking the ultrasound examination process as an example, the flat-plate stress ultrasound overall ultrasound process includes three ultrasound examinations, namely, the rest period examination, the peak period examination after exercise, and the recovery period examination. The entire examination requires the subject to cooperate with the doctor to respond quickly in order to obtain an image of the heart under exercise load conditions and provide accurate diagnosis results.

[0114] Specifically, the examination process includes the following steps: (1) The doctor calls the examination subject through the worklist function of the target ultrasound device. The calling system assigns the examination subject and the corresponding head-mounted device. The examination subject wears the head-mounted device, which can be an augmented reality (AR) terminal. (2) The head-mounted device obtains the environment and location of the examination subject through the internal camera, and sends the environment and location information of the examination subject to the target ultrasound device. The target ultrasound device receives the information and maps the scene to the internal map data by using intelligent algorithms such as pattern recognition and deep learning. (3) The target ultrasound device generates the guidance and prompt information that the examination subject needs to see in the current scene by matching the map data information, and comes to the corresponding ultrasound scanning room. (4) After entering the ultrasound scanning room, the target ultrasound device prepares the current flat-panel stress ultrasound process summary for the examination subject before the doctor prepares for the scan. The examination subject can browse the summary on the head-mounted device and complete the first step through the animation guidance, which is to lie on the left side on the examination bed. (5) After the examination subject lies down as required, the doctor starts the first ultrasound examination of the heart. The examinee can view the current scanning process animation through the head-mounted device, and know the scanning area and method, as well as the remaining steps and estimated time of the scanning. (6) After storing the first ultrasound examination image, the doctor sends a command to the head-mounted device through the target ultrasound device, causing the head-mounted device to play the standing animation, guiding the examinee to walk to the flat treadmill, and start flat exercise on the treadmill. (7) After the flat exercise ends, the head-mounted device immediately reminds the examinee to quickly return to the left side position on the examination bed, perform a second ultrasound examination, and store the corresponding images. (8) After the second ultrasound examination, the head-mounted device prompts the user to breathe steadily and recover slowly for 3-5 minutes. (9) The doctor performs the third ultrasound examination and stores the corresponding images. (10) The stress ultrasound test is completed. The doctor ends the examination, and the head-mounted device prompts the user to get out of bed and walk out of the clinic to wait for the ultrasound examination results.

[0115] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0116] Based on the same inventive concept, the embodiment of the present application also provides an ultrasonic inspection device for implementing the ultrasonic inspection method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more ultrasonic inspection device embodiments provided below can refer to the limitations on the ultrasonic inspection method above, and will not be repeated here.

[0117] In an exemplary embodiment, as shown in FIG13 , an ultrasonic inspection device is provided, comprising: a response module 11 and a display module 12, wherein:

[0118] A response module 11 is used to respond to the ultrasonic examination requirement of the examination object;

[0119] The display module 12 is used to display the prompt message sent by the target ultrasound device to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasound inspection process of the inspection object, and is used to guide the inspection object to perform corresponding actions according to the prompt message.

[0120] In one embodiment, the display module comprises: a first display unit, a second display unit and a third display unit, wherein:

[0121] The first display unit is used to display the path guidance message sent by the target ultrasound device to the inspection object when the inspection object is not within the preset range around the target ultrasound device; the path guidance message is used to guide the inspection object to move to the preset range of the target ultrasound device;

[0122] The second display unit is used to display the posture guidance message sent by the target ultrasound device to the inspection object when the inspection object is within the preset range of the target ultrasound device; the posture guidance message is used to guide the inspection object to position according to the target posture;

[0123] The third display unit is used to display the ultrasound examination message sent by the target ultrasound device to the examination subject when the examination subject is in the target posture.

[0124] In one embodiment, the above-mentioned first display unit is also used to send the surrounding environment information and position information of the inspection object to the target ultrasound device; receive the moving path of the inspection object sent by the target ultrasound device; the moving path is generated based on the surrounding environment information, the position information of the inspection object and the position information of the target ultrasound device.

[0125] In one embodiment, the second display unit is also used to receive an animation guidance video sent by the target ultrasound device; the animation guidance video is a video that matches the current inspection process; the current inspection process is determined based on the ultrasound inspection process and the current state of the inspection object; and the animation guidance video is played to the inspection object.

[0126] In one embodiment, the third display unit is further used to display at least one of the current inspection process animation, inspection site, inspection method, remaining steps and estimated inspection time of the target ultrasound device to the inspection subject.

[0127] In an exemplary embodiment, an ultrasonic inspection device is provided, comprising: a generating module and a sending module, wherein:

[0128] A generation module, which is used to respond to the ultrasonic examination requirements of the examination object and generate a prompt message corresponding to the ultrasonic examination process according to the current state of the examination object and the ultrasonic examination process; the prompt message is used to guide the examination object to perform corresponding actions according to the prompt message;

[0129] The sending module is used to send a prompt message to the head mounted device.

[0130] In one embodiment, the ultrasonic inspection device further includes: a division module, an event acquisition module and a simulation module, wherein:

[0131] A division module, used for dividing the ultrasound inspection process into multiple inspection steps;

[0132] The item acquisition module is used to obtain the inspection notes corresponding to each inspection step;

[0133] The simulation module is used to simulate the actions corresponding to each inspection precaution and obtain multiple animation guidance videos corresponding to the ultrasonic inspection process.

[0134] Each module in the above-mentioned ultrasonic inspection device can be implemented in whole or in part by software, hardware or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0135] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG14. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data during ultrasonic inspection. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an ultrasonic inspection method is implemented.

[0136] Those skilled in the art will understand that the structure shown in FIG. 14 is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0137] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the content of any one embodiment of the above-mentioned ultrasonic inspection method is implemented.

[0138] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the content of any one embodiment of the above-mentioned ultrasonic inspection method is implemented.

[0139] In one embodiment, a computer program product is provided, including a computer program, which implements the content of any one of the embodiments of the above-mentioned ultrasound inspection method when executed by a processor.

[0140] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0141] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0142] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0143] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. An ultrasonic inspection method, characterized in that: Applied to a head mounted device, the head mounted device communicates with a target ultrasound device, and the method comprises: Responding to the examination subject's request for ultrasound examination; The prompt message sent by the target ultrasound device is displayed to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasound inspection process of the inspection object, and is used to guide the inspection object to perform corresponding actions according to the prompt message.

2. The method according to claim 1, characterized in that The prompt message includes a path guidance message, a posture guidance message and an ultrasound inspection message; and the prompt message sent by the target ultrasound device is displayed to the inspection object, including: In the case where the inspection object is not within the preset range around the target ultrasound device, displaying a path guidance message sent by the target ultrasound device to the inspection object; the path guidance message is used to guide the inspection object to move within the preset range of the target ultrasound device; When the inspection object is within the preset range of the target ultrasound device, displaying a posture guidance message sent by the target ultrasound device to the inspection object; the posture guidance message is used to guide the inspection object to position according to the target posture; When the posture of the inspection object is the target posture, the ultrasound inspection message sent by the target ultrasound device is displayed to the inspection object.

3. The method according to claim 2, characterized in that The presenting the path guidance message sent by the target ultrasound device to the inspection object includes: Sending the surrounding environment information and location information of the inspection object to the target ultrasound device; A moving path of the inspection object sent by the target ultrasound device is received; the moving path is generated based on the surrounding environment information, the position information of the inspection object and the position information of the target ultrasound device.

4. The method according to claim 2, characterized in that The posture guidance message includes an animation guidance video; The step of displaying the posture guidance message sent by the target ultrasound device to the subject under examination includes: Receiving an animation guidance video sent by the target ultrasound device; the animation guidance video is a video matching a current inspection process; the current inspection process is determined based on the ultrasound inspection process and a current state of the inspection object; The animation guidance video is played to the inspection object.

5. The method according to claim 2, characterized in that: The step of displaying the ultrasound examination message sent by the target ultrasound device to the examination subject comprises: At least one of the current inspection process animation, inspection part, inspection method, remaining steps and estimated inspection time of the target ultrasound device is displayed to the inspection subject.

6. An ultrasonic inspection method, characterized in that: Applied to a target ultrasound device, the target ultrasound device communicates with a head-mounted device, and the method includes: In response to the ultrasonic examination requirement of the examination object, a prompt message corresponding to the ultrasonic examination process is generated according to the current state of the examination object and the ultrasonic examination process; the prompt message is used to guide the examination object to perform corresponding actions according to the prompt message; Send the prompt message to the head mounted device.

7. The method according to claim 6, characterized in that The prompt message includes a plurality of animation guidance videos, and the construction process of the plurality of animation guidance videos includes: Dividing the ultrasonic inspection process into a plurality of inspection steps; Get the inspection notes corresponding to each inspection step; The actions corresponding to the inspection precautions are simulated to obtain multiple animation guidance videos corresponding to the ultrasonic inspection process.

8. An ultrasonic inspection device, characterized in that: The device comprises: A response module, used for responding to the ultrasonic examination demand of the examination object; A display module is used to display the prompt message sent by the target ultrasound device to the inspection object; the prompt message is generated based on the current state of the inspection object and the ultrasound inspection process of the inspection object, and is used to guide the inspection object to perform corresponding actions according to the prompt message.

9. An ultrasonic inspection device, characterized in that: The device comprises: A generating module, configured to respond to an ultrasonic examination requirement of an examination subject and generate a prompt message corresponding to the ultrasonic examination process according to a current state of the examination subject and the ultrasonic examination process; the prompt message is used to guide the examination subject to perform a corresponding action according to the prompt message; A sending module is used to send the prompt message to the head mounted device.

10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

Images