Ultrasonic inspection apparatus and program

Abstract

To perform more uniform inspections in inspections conducted under different conditions.SOLUTION: An ultrasonic inspection apparatus according to an embodiment is an ultrasonic inspection apparatus for inspecting the inside of a subject using an ultrasonic probe, and includes a generation unit, an acquisition unit, and a projection unit. The generation unit, during a first inspection, generates at least one of model data relating to a physique or posture of the subject and information relating to actual data of the subject. The acquisition unit acquires setting information at the time of the first inspection including the model data or the actual data and position information of the ultrasonic probe with an arbitrary point on a space as a reference. The projection unit, during a second inspection conducted after the first inspection, projects the model data and the position information of the ultrasonic probe onto a virtual space on the basis of the setting information.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] Embodiments of the present invention relate to an ultrasonic inspection apparatus and a program.

Background Art

[0002] Conventionally, in order to assist medical personnel, a three-dimensional bone model based on an image taken before surgery is superimposed and displayed in the surgeon's field of view, or in an examination using an ultrasonic probe, an ultrasonic image and a reference image are simultaneously displayed and navigation information is provided. However, in recent years, home medical care and the like have been increasing year by year, and there are cases where medical personnel who always search using the same device or have high expertise regarding examinations using the device cannot perform examinations at the patient's home. Therefore, in examinations performed in different situations, uniform examination accuracy may not be obtained.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Patent Document 4

Patent Document 5

Patent Document 6

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the present invention is to perform a more uniform examination in examinations performed in different situations.

Means for Solving the Problems

[0005] The ultrasonic inspection apparatus according to the embodiment is an ultrasonic inspection apparatus that inspects the inside of a subject using an ultrasonic probe, and includes a generation unit, an acquisition unit, and a projection unit. The generation unit generates at least one of model data regarding the physique or posture of the subject and information regarding the actual data of the subject at the time of the first inspection. The acquisition unit acquires the model data or the actual data and the setting information at the time of the first inspection including position information based on an arbitrary point in space between the model data or the actual data and the ultrasonic probe. The projection unit projects the model data and the position information of the ultrasonic probe onto a virtual space based on the setting information at the time of the second inspection performed after the first inspection.

Brief Description of the Drawings

[0006]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Embodiments for Carrying Out the Invention

[0007] Hereinafter, an ultrasonic inspection apparatus and a program according to an embodiment will be described with reference to the drawings.

[0008] (First Embodiment) FIG. 1 is a diagram showing an example of an ultrasonic inspection apparatus 10A according to the first embodiment. The ultrasonic inspection apparatus 10A includes an ultrasonic probe 100A, a display device 150A, and an ultrasonic processing device 200A. The ultrasonic probe 100A and the display device 150A may be configured to be detachable from the ultrasonic processing device 200A. The ultrasonic probe 100A and the display device 150A may be connected to the ultrasonic processing device 200A by wire or wirelessly.

[0009] The ultrasonic probe 100A includes, for example, an ultrasonic sensor 111, a position sensor 112, an orientation sensor 113, an inclination sensor 114, and a pressure sensor 115. The ultrasonic sensor 111 transmits a predetermined ultrasonic wave from the contact surface of the ultrasonic probe 100A in contact with a subject such as a patient toward the inside of the subject (inside the body), and receives the reflected wave signal.

[0010] The position sensor 112 detects the position information of the ultrasonic probe 100A during the examination. For example, the position sensor 112 includes, for example, a six-axis sensor and detects the current position of the ultrasonic probe 100A based on the three-axis acceleration. Further, the position sensor 112 may detect the relative position and relative device with respect to the subject. In this case, the position sensor 112 includes a camera that photographs the subject, and detects the relative position of the ultrasonic probe 100A with respect to the subject or the distance from the subject by an optical differential identification process using the image photographed by the camera. Further, the position sensor 112 may detect the position on the three-dimensional coordinates based on a predetermined position as a reference.

[0011] The orientation sensor 113 detects the orientation of the ultrasonic probe 100A main body (for example, the direction in which ultrasonic waves are transmitted). Further, the orientation sensor 113 may detect the scanning direction of the ultrasonic probe 100A during inspection. The inclination sensor 114 detects the inclination of the ultrasonic probe 100A main body with respect to the reference position. For example, the orientation sensor 113 and the inclination sensor 114 may detect the orientation, inclination, etc. using the six-axis sensor provided in the position sensor 112. In this case, the orientation sensor 113 and the inclination sensor 114 calculate the difference between the current position (three-dimensional coordinate position) of the ultrasonic probe 100A and a predetermined reference position (three-dimensional position) by the six-axis sensor, thereby detecting the orientation, scanning direction, and inclination of the ultrasonic probe 100A. Further, the orientation sensor 113 may detect the scanning speed of the ultrasonic probe 100A based on the change rate of the scanning direction of the ultrasonic probe 100A. Further, the inclination sensor 114 may detect the rotation direction of the ultrasonic probe 100A based on the three-axis angular velocity by the six-axis sensor. In this case, the inclination sensor 114 calculates the difference between the current angle of the ultrasonic probe 100A and a predetermined reference angle, thereby calculating the rotation direction of the ultrasonic probe 100A. Further, the inclination sensor 114 may detect the rotation speed of the ultrasonic probe 100A based on the change rate of the rotation direction of the ultrasonic probe 100A.

[0012] The pressure sensor 115 detects the pressure on the contact surface between the ultrasonic probe 100A and the subject. For example, the pressure sensor 115 is composed of a conductive film having a piezoelectric layer inside the contact surface. The pressure sensor 115 includes, for example, two outer external electrodes and an internal electrode sandwiched between the two external electrodes. When pressure is applied between the two outer electrodes, the current value of the current flowing between the electrodes is measured, and based on the measured current value, the pressure (pressing force or stress) applied to the contact surface is detected. For example, the pressure sensor 115 may be a sensor capable of detecting the pressure distribution on the contact surface with the subject, or may be a sensor capable of detecting the depth distribution of strain. The information (probe information) detected by each sensor of the ultrasonic probe 100A is transmitted to the ultrasonic processing device 200A.

[0013] The display device 150A is a wearable device worn by a user (e.g., a medical professional) who uses the ultrasonic inspection device 10A, for example. The wearable device includes, for example, a head-mounted display, goggles, a headset, smart glasses, etc. The wearable device may be, for example, a device using VR (Virtual Reality) technology, or may be a device using other technologies such as AR (Augmented Reality), MR (Mixed Reality), and projection mapping. The display device 150A displays virtual objects, character information, image information, etc. on a virtual space or a real space for the wearing user. For example, the display device 150A causes an image generated by the ultrasonic processing device 200A to be displayed on a virtual space, or when an image is superimposed on the front scenery (real space) via a lens or the like, the display device 150A displays the image so that it can be visually recognized by the user, or projects an image onto the surface of an object in the real space and allows the user to visually recognize the image.

[0014] Also, the display device 150A includes, for example, a camera 152. The camera 152 is a digital camera using a solid-state imaging device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The camera 152 repeatedly photographs a space including the front direction of the user wearing the display device 150A at a predetermined period. The photographed image (camera image) is output to the ultrasonic processing device 200A.

[0015] The ultrasonic processing device 200A includes, for example, a communication interface 210, an input interface 220, a display 230, a processing circuit 240, and a memory 250. The communication interface 210 includes, for example, a communication interface such as a NIC (Network Interface Card). The communication interface 210 communicates with the ultrasonic probe 100A and the display device 150A. Also, the communication interface 210 communicates with other external devices (such as a management device) via a communication network and receives various information transmitted from the management device. The communication interface 210 outputs the received information to the processing circuit 240. Also, the communication interface 210 may transmit information to other devices connected via the communication network under the control of the processing circuit 240. Other devices are, for example, a management device that manages information, a terminal device that can be used by an image reader such as a doctor or a nurse.

[0016] The input interface 220 receives various input operations from the user, converts the received input operations into electrical signals, and outputs them to the processing circuit 240. For example, the input interface 220 is realized by a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, etc. Also, the input interface 220 may be realized by a user interface that receives voice input such as a microphone. When the input interface 220 is a touch panel, the display 230 may be formed integrally with the input interface 220.

[0017] The display 230 displays various types of information. For example, the display 230 displays an image or the like indicating data acquired from the ultrasonic treatment device 200A or other external devices and the content processed by the processing circuit 240, or displays a GUI (Graphical User Interface) or the like for receiving various input operations from the user. For example, the display 230 is an LCD (Liquid Crystal Display), a CRT (Cathode Ray Tube) display, an organic EL (Electro Luminescence) display, or the like.

[0018] The processing circuit 240 includes, for example, an acquisition function 241, a data generation function 242, a projection function 243, an image generation function 244, and a display control function 245. The acquisition function 241 is an example of an "acquisition unit". The data generation function 242 is an example of a "generation unit". The projection function 243 is an example of a "projection unit". The processing circuit 240 realizes these functions, for example, by a hardware processor executing a program stored in a memory (storage device, storage circuit) 250.

[0019] A hardware processor refers to circuitry such as, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an Application Specific Integrated Circuit (ASIC), a Programmable Logic Device (e.g., a Simple Programmable Logic Device (SPLD) or a Complex Programmable Logic Device (CPLD), a Field Programmable Gate Array (FPGA)). Instead of storing a program in the memory 250, it may be configured to directly incorporate the program into the circuitry of the hardware processor. In this case, the hardware processor realizes its functions by reading and executing the program incorporated into the circuitry. The above program may be stored in the memory 250 in advance, or stored in a non-transitory storage medium such as a DVD or a CD-ROM, and may be installed from the non-transitory storage medium into the memory 250 when the non-transitory storage medium is mounted on a drive device (not shown) of the ultrasonic processing apparatus 200A. The hardware processor is not limited to being configured as a single circuit, and may be configured as one hardware processor by combining a plurality of independent circuits to realize each function. Also, a plurality of components may be integrated into one hardware processor to realize each function.

[0020] Each component included in the processing circuit 240 may be realized by being decentralized and implemented by a plurality of hardware. The processing circuit 240 may be realized not by a configuration included in the ultrasonic processing apparatus 200A, but by a processing device that can communicate with the ultrasonic processing apparatus 200A. The processing device is, for example, a workstation connected to one ultrasonic processing apparatus 200A, or a device (e.g., a cloud server) connected to a plurality of ultrasonic processing apparatuses 200A and collectively executing processing equivalent to the processing circuit 240 described below.

[0021] The acquisition function 241 acquires information from the ultrasonic probe 100A and the display device 150A. For example, the acquisition function 241 acquires information regarding the settings in the first inspection and probe information from the ultrasonic probe 100A. The probe information includes, for example, at least one of the position of the ultrasonic probe main body (for example, position information based on an arbitrary point in space with respect to the ultrasonic probe 100A), orientation, inclination, pressure on the surface in contact with the subject, and the detection result of the ultrasonic sensor 111 (for example, ultrasonic image information obtained by the ultrasonic probe 100A). Further, the acquisition function 241 acquires a camera image captured by the camera 152 provided in the display device 150A. The acquisition function 241 may store the acquired information in the memory 250.

[0022] When the ultrasonic inspection apparatus 10A is used as the first inspection (during the first inspection), the data generation function 242 generates at least one of subject-specific model data regarding the physique or posture of the subject and information regarding the actual data of the subject. The first inspection is, for example, an inspection performed at a core hospital equipped with a high-performance inspection apparatus, and is an inspection performed by medical staff with high expertise for using the inspection apparatus. The model data is, for example, a target (landmark) that specifies the physique, posture, position, etc. of the subject during the inspection, and is, for example, three-dimensional model data corresponding to the inspection target site (for example, the upper body, etc.). The actual data may be, for example, camera image data of the subject captured by the camera 152 of the display device 150A, or may be subject contour data obtained by analyzing the camera image with existing image analysis processing. Further, the actual data may include information on an object in space associated with the posture of the subject. The objects in space associated with the posture of the subject include, for example, a bed (cot) on which the subject lies during the inspection and a chair on which the subject sits. The data generation function 242 may store the generated various information in the memory 250.

[0023] The projection function 243 projects (displays) information such as model data and information related to the information set at the time of the first inspection (first inspection setting information) onto the virtual space during the second inspection carried out after the first inspection. The second inspection is, for example, an inspection carried out under a situation different from that of the first inspection. Different situations include, for example, situations where the user using the ultrasonic inspection device 10A is different, situations where the inspection location is different, situations where the inspection equipment (ultrasonic inspection device) is different, and situations combining them. For example, the projection function 243 uses AR technology to generate (reconstruct) an image of the model data (model image) and an image based on the first inspection setting information on the same coordinates visible through the display device 150A, and projects it onto the virtual space. Thereby, the user can visually recognize the model image and the image based on the first inspection setting information as virtual objects on the real space visible through the display device 150A. Further, the projection function 243 may virtually display an image of the model data and an image based on the first inspection setting information on the display device 150A using VR technology, projection mapping, or the like.

[0024] The image generation function 244 generates an image based on the detection result of the ultrasonic sensor 111, and an image provided to the user through the display device 150A during the first inspection and the second inspection. For example, the image generation function 244 generates an ultrasonic image (internal cross-sectional image) based on the reflected wave signal detected according to the ultrasonic wave transmitted by the ultrasonic sensor 111 into the body of the subject. Further, the image generation function 244 generates a model image for visually recognizing the model data selected by the user during the first inspection through the display device 150A, an image for adjusting the width, height, depth, etc. of the three-dimensional model, a model image adjusted (deformed) according to the adjustment content, and the like. Further, the image generation function 244 may generate a model image and an image showing the first inspection setting information for visually recognizing by the user through the display device 150A during the second inspection. Further, the image generation function 244 may generate an image corresponding to the actual data of the subject instead of (or in addition to) generating the above-described model image.

[0025] The display control function 245 performs control for causing the display 230 to display various images and the like generated by the image generation function 244. Further, the display control function 245 may store images and the like generated by the projection function 243 or the image generation function 244 in the memory 250, or cause them to be transmitted to an external device via the communication interface 210. Further, the display control function 245 may cause the display 230 to display information acquired from an external device via the communication interface 210 or store it in the memory 250.

[0026] The memory 250 is realized, for example, by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, a hard disk, an optical disk, or the like. These non-transitory storage media may be realized by other storage devices connected via a communication network such as a NAS (Network Attached Storage) or an external storage server device. Further, the memory 250 may include a transitory storage medium such as a ROM (Read Only Memory) or a register. The memory 250 stores, for example, template information 251, first inspection setting information 252, probe information 253, programs, and various other information. The template information 251 stores one or more different model data. The first inspection setting information 252 stores various setting information set by the user during the first inspection using the ultrasonic probe 100A. The probe information 253 stores, for example, information obtained by the ultrasonic probe 100A in the first inspection and the second inspection.

[0027] Next, the processing during the first inspection and the second inspection by the ultrasonic inspection apparatus 10A according to the first embodiment will be described. Hereinafter, it is assumed that the subject is a patient. FIG. 2 is a diagram for explaining the outline of the processing during the first inspection. In the example of FIG. 2, the patient P is lying on the bed B1 in a general hospital or the like. The display device 150A is a head-up display worn by the user (for example, medical staff) U1. The user U1 acquires an ultrasonic image inside the patient P while applying the ultrasonic probe 100A to the patient P at a predetermined position, orientation, inclination (angle), and pressure according to the inspection content.

[0028] During the first inspection as shown in FIG. 2, the user U1 sets model data for the patient P. FIG. 3 is a diagram showing an example of the model image IM10 visible to the user U1 from the display device 150A. The user U1 wearing the display device 150A can visually recognize a three-dimensional model image IM10 as shown in FIG. 3 through a lens or the like. For example, when the image generation function 244 receives a display request for model data from the user U1 through the input interface 220 or the like, it displays the model data so that it can be visually recognized through the display device 150A. The model image IM10 may, for example, have a predetermined color assigned within the model area, or may consist only of lines and points indicating the contour shape. When a color is assigned, the model image IM10 is displayed with a predetermined transmittance.

[0029] For example, during the first inspection, the user U1 refers to the template information 251 stored in the memory 250 in advance and selects a three-dimensional model corresponding to the inspection target of the patient P (the part of the patient P where the ultrasonic probe is applied) from among a plurality of three-dimensional models (templates). When the image generation function 244 receives an instruction from the user U1 to select one of the three-dimensional models, it displays an image showing one or more three-dimensional models stored in the template information 251 so that the user U1 can visually recognize it through the display device 150A.

[0030] FIG. 4 is a diagram showing an example of the template information 251. As shown in FIG. 4, one or more different three-dimensional models are stored in the template information 251. The three-dimensional models include, for example, polyhedrons such as hexahedrons and tetrahedrons, and cylinders, cones, spheres, etc. The image generation function 244 generates an image showing each model (models MD001, MD002, MD003, etc.) included in the template information 251, and displays the generated images in a visible manner to the user U1 simultaneously or in a predetermined order. The user U1 selects one of the displayed model images according to the shape of the upper body or a predetermined part (for example, the foot) of the patient P to be examined.

[0031] When the image generation function 244 receives the selection of any model from the user U1, it generates a model image corresponding to the received model and displays it as shown in FIG. 3. Further, the image generation function 244 may generate an adjustment image for adjusting the width, height, depth, etc. of the model image IM10 as viewed by the user U1, and display it at a predetermined position where the user U1 can view it via the display device 150A.

[0032] FIG. 5 is a diagram showing an example of an adjustment image for adjusting the shape of the model image IM10. As an adjustment image for the displayed model image IM10, the image generation function 244 generates a switch image SW1 for adjusting the width (a part set in advance as the width direction of the three-dimensional model), a switch image SW2 for adjusting the height (a part set in advance as the height direction of the three-dimensional model), a switch image SW3 for adjusting the depth (a part set in advance as the depth direction of the three-dimensional model), etc., and displays the generated images in a visible manner. The switch images SW1 to SW3 are, for example, GUI switches. In the example of FIG. 5, they are rotary switches, but instead, switches that increase or decrease numerical values to be adjusted by plus and minus buttons, etc. may be used, or slide lever switches that are slid in the horizontal or vertical direction may be used. Further, the image generation function 244 is not limited to the width, height, and depth, and may generate and display switch images for adjusting the rotation direction when rotating the model image IM10 based on each axis of three-dimensional (XYZ), or the magnification or reduction rate of the model image IM10.

[0033] When adjusting the shape, size, orientation, etc. of the model image IM10 using these switch images SW, for example, the user U1 may input using the input interface 220, for example, or obtain from a camera image captured by the camera 152 of the position and gesture of the user U1's hand, etc. through a predetermined image analysis process, and perform adjustments such as shape based on the obtained hand position and gesture. In the case of adjustment by gesture operation, for example, among the plurality of displayed switches, the adjustment target associated with the switch closest to the hand position is adjusted, and the switch image SW is operated in response to the gesture operation (for example, the user U1 rotates the palm to the right direction) to generate and display a model image in which the value of the adjustment target (for example, the width of the three-dimensional model) is increased or decreased. Also, the image generation function 244 may enlarge or reduce the model image IM10 according to gestures such as the user's pinch-in or pinch-out.

[0034] FIG. 6 is a diagram for explaining the state of adjusting the shape, etc. of the model image IM10 to an arbitrary shape. The user U1 operates switch images SW1 to SW3, etc. to adjust the shape, size, orientation, etc. so as to match the physique or posture unique to the patient while overlapping the model image IM10 of the three-dimensional model selected from the model data included in the template information 251 with the inspection target position of the patient P.

[0035] Note that the adjustment of the shape of the model image IM10 described above may be executed only when the switch image SW is displayed in the virtual space. Thereby, when the gesture operation of the user U1 is detected, it is possible to prevent the shape, etc. of the model image IM10 from always being adjusted contrary to the intention of the user U1. Note that instead of (or in addition to) the switch image SW, the adjustment of the shape, etc. may be performed using a physical switch provided in the display device 150A or the ultrasonic processing device 200A.

[0036] The data generation function 242 generates first examination setting information 252 by associating the model type, adjustment information, etc. selected by the user U1 with the patient P, and stores the generated first examination setting information 252 in the memory 250. FIG. 7 is a diagram for explaining the content of the first examination setting information 252. The first examination setting information 252 is information in which a model type corresponding to the model image IM10 and adjustment information are associated with a patient ID which is identification information for identifying a patient. The adjustment information is adjustment information such as the shape, size, orientation, etc. of the model image IM10 set by the above-described user U1 using a switch image SW or the like.

[0037] Note that the data generation function 242 may generate actual data regarding the physique or posture of the patient P based on the analysis result of the camera image captured by the camera 152, instead of (or in addition to) the above-described model type and adjustment information, and store it in the first examination setting information 252 in association with the patient ID. For example, the data generation function 242 extracts a portion corresponding to the contour of the patient P by performing edge processing or object extraction processing using luminance information for each pixel or the like, and generates an image obtained by extracting the extracted contour portion as actual data. Further, the data generation function 242 may generate, as actual data, the shape of a contour portion analyzable from a camera image of an object (for example, the bed B1) associated with the posture of the patient P instead of (or in addition to) the actual data of the patient P. The image of the ultrasonic probe 100A is used, for example, for assisting the user during the second examination. Thereby, during the second examination, information on a fixed object related to the posture of the patient P can be used to bring the patient P closer to the same posture as during the first examination, and the reproducibility during the examination can be improved. Further, the data generation function 242 may extract the image area of the ultrasonic probe 100A used in the first examination from the analysis result of the camera image and store it in the actual data information.

[0038] Next, with the model image IM10 positioned at a predetermined position (upper body) of the patient P, the user U1 moves the ultrasonic probe 100A to perform an ultrasonic examination (first examination). At this time, the ultrasonic sensor 111, the position sensor 112, the orientation sensor 113, the inclination sensor 114, and the pressure sensor 115 output their respective detection results at the time of the examination to the ultrasonic processing device 200A at timing such as a predetermined cycle. Also, the display device 150A captures the position of the patient P and the movement of the ultrasonic probe 100A during the first examination with the camera 152, and transmits the captured camera image to the ultrasonic processing device 200A. The acquisition function 241 stores the information output from the ultrasonic probe 100A and the display device 150A in the memory 250 as probe information 253.

[0039] FIG. 8 is a diagram for explaining the content of the probe information 253. The probe information 253 is information in which, for example, patient ID, probe ID which is identification information for identifying the ultrasonic probe 100A, position information, orientation / inclination information, pressure information, and ultrasonic image information are associated. The position information is information indicating the position of the ultrasonic probe 100A at the time of the examination based on the detection result of the position sensor 112. The position information is, for example, a position with respect to an arbitrary point in space. For example, the position information is position information in a three-dimensional coordinate system with a certain reference point (for example, the center or any one of a plurality of corners) of the displayed model image IM10 as the origin. The orientation / inclination information is information indicating the orientation, inclination (angle), etc. of the ultrasonic probe 100A at the time of the examination based on the detection results of the orientation sensor 113 and the inclination sensor 114. For example, the orientation / inclination information is information regarding the orientation and inclination in a three-dimensional coordinate system with the display position of the model image IM10 as a reference. The pressure information is information regarding the pressure on the contact surface between the ultrasonic probe 100A and the patient P at the time of the examination based on the detection result of the pressure sensor 115. The ultrasonic image information is ultrasonic image information generated by the image generation function 244 based on the detection result of the ultrasonic sensor 111.

[0040] Note that the position information, orientation / slant information may be obtained based on the image analysis result of the camera image captured by the camera 152 of the display device 150A instead of (or in addition to) the detection results of the position sensor 112, the orientation sensor 113, and the slant sensor 114. In this case, the data generation function 242 identifies the position, orientation, and slant of the ultrasonic probe 100A included in the camera image by performing predetermined image analysis processing (object extraction processing) on the camera image, and the identified information is stored in the probe information 253.

[0041] Next, the processing during the second examination will be described with reference to the drawings. FIG. 9 is a diagram for explaining the state of the second examination. In the example of FIG. 9, the second examination is performed, for example, at the home of the patient P or the like, and the user U2 who performs the examination and the bed B2 on which the patient P lies are different from those at the time of the first examination. Also, in the second examination, it is assumed that an ultrasonic examination device 10B including an ultrasonic probe 100B, a display device 150B, and an ultrasonic processing device 200B is used. The ultrasonic examination device 10B may have the same functional configuration as the ultrasonic examination device 10A used at the time of the first examination, or may have a different functional configuration. In the first embodiment, it will be described as having the same functional configuration.

[0042] During the second examination, with the patient P lying on the bed B2, the user U2 requests the ultrasonic processing device 200B to display the first examination setting information. When the image generation function 244 of the ultrasonic processing device 200B receives the above request, it refers to the first examination setting information 252 stored in the memory 250, generates a model image IM10 corresponding to the model type of the referred first examination setting information 252, and further generates a model image IM10 adjusted according to the content of the adjustment information. Next, the projection function 243 projects the generated model image IM10 onto the virtual space and displays it so that the user U2 can view it via the display device 150B. Note that when actual data is stored in the first examination setting information 252, the projection function 243 may project an image related to the actual data onto the virtual space.

[0043] Here, at the time of the second examination, the projection function 243 causes the model image IM10 (or actual data) to be visibly displayed while maintaining the coordinate system (three-dimensional coordinate system) acquired at the time of the first examination. This coordinate system may be, for example, a coordinate system in the width direction, height direction, and depth direction based on a reference point (such as the center or a corner) of the shape (three-dimensional model shape) of the model image IM10, or may be a three-dimensional coordinate system based on an object in space associated with the posture of the patient P (for example, a specific position of the bed B1 on which the patient P was placed in the first examination).

[0044] The user U2 adjusts the relative position between the user U2 himself / herself and the patient P so that the examination target (for example, the upper body) of the patient P is associated with the model image IM10 visibly displayed by the display device 150A. In this case, the user U2 may move, or the patient P may move. The model image IM10 is adjusted according to the shape of the examination target of the patient P and the like. Therefore, by moving the model image IM10 to be positioned at a predetermined part (for example, the upper body) of the patient P, the side to be examined (user U2) and the side being examined (patient P) can perform the examination in the same positional relationship as at the time of the first examination. Therefore, the search can be performed in the same state as at the time of the first examination.

[0045] Then, as shown in FIG. 9, when the area where the model image IM10 is displayed is positioned at the upper body of the patient P, or when there is a request from the user U2, the image generation function 244 generates an image (hereinafter referred to as the "assistance image") for assisting the user U2 to operate the ultrasonic probe 100B used in the second examination in the same manner as at the time of the first examination (user U1), projects the generated assistance image at a position associated with the projection position of the model image IM10, and causes it to be displayed so that the user U2 can visually recognize it from the display device 150B.

[0046] FIG. 10 is a diagram showing an example of a support image provided to user U2 at the time of the second examination. In the example of FIG. 10, a model image IM10 and a first support image IM20 are shown. The first support image IM20 may be an image imitating the actual ultrasonic probe 100A acquired according to the type (probe ID) of the ultrasonic probe 100A at the time of the first examination, or may be an image extracted from a camera image captured by the camera 152. The first support image IM20 is displayed at a position and orientation corresponding to the position information, orientation, and tilt information stored by the first examination setting information 252. Thereby, the user U2 can visually recognize, for example, the content projected onto the virtual space using the AR technology in superposition with the real space, so that the difference in the positional relationship (distance, orientation, and tilt) between the actual position of the ultrasonic probe 100B at the time of the second examination and the ultrasonic probe 100A at the time of the first examination becomes clear. Therefore, in the second examination, the ultrasonic probe 100B can be positioned at a position and orientation close to those at the time of the first examination with respect to the patient P and the examination can be performed.

[0047] Further, instead of (or in addition to) the first support image IM20, the image generation function 244 may display at least one of a second support image IM22 and a third support image IM24 so that the user U2 can visually recognize it via the display device 150B. The second support image IM22 is, for example, an image indicating the direction in which the first support image IM20 is displayed from the current position of the ultrasonic probe 100B. For example, the image generation function 244 analyzes a camera image captured by the camera 152 at the time of the second examination and acquires the current position (three-dimensional coordinate position based on the model image IM10) of the ultrasonic probe 100B. Then, the image generation function 244 generates a second support image IM22 indicating the direction from the current position of the ultrasonic probe 100B to the position where the first support image IM20 is displayed, and displays the generated second support image IM22 between or near the current position of the ultrasonic probe 100B and the position where the first support image IM20 is displayed. In the example of FIG. 10, an image of an arrow mark is displayed as the second support image IM22, but it is not limited thereto, and it may be a character image such as "a little more to the left".

[0048] In addition, the image generation function 244 may generate a third assist image IM24 indicating the absolute value of the error (difference) between the current position of the ultrasonic probe 100B and the position where the first assist image IM20 is displayed, and display the generated third assist image IM24. Note that the image generation function 244 may display the third assist image IM24 in a color or font size corresponding to the error (difference). By displaying the error or the like, the user U2 can clearly understand the degree of error. The user U2 can reduce the position error from the first inspection by moving the ultrasonic probe 100B in the direction in which the error becomes smaller. Thus, by displaying the second assist image IM22 and the third assist image IM24, even a user U2 with less inspection experience and knowledge for handling the apparatus than the user U1 can more reliably position the ultrasonic probe 100B at the same position as in the first inspection and perform the inspection.

[0049] In addition to (or instead of) the first to third support images IM20 to IM24 described above, the image generation function 244 may generate a support image using an ultrasonic image (cross-sectional image), and perform error display or the like using the generated support image. FIG. 11 is a diagram for explaining error display using an ultrasonic image. In the example of FIG. 11, a fourth support image IM30 and a fifth support image IM40 are shown. The fourth support image IM30 is an ultrasonic image obtained using the ultrasonic probe 100A at the time of the first examination. The fifth support image IM40 is an ultrasonic image obtained from the position and orientation of the ultrasonic probe 100B at the time of the second examination. Note that the ultrasonic image may be an image showing only the outline of the imaging range. For example, when the positions and orientations of the ultrasonic probes 100A and 100B are different between the first examination and the second examination, as shown in FIG. 11, the display positions of the fourth support image IM30 and the fifth support image IM40 are different. Therefore, the user U2 can be clearly made aware that the position and orientation of the ultrasonic probe 100B do not match. The user U2 can perform alignment similar to that at the time of the first examination by moving the ultrasonic probe 100B so that the fourth support image IM30 and the fifth support image IM40 overlap, and can perform the examination with the same accuracy as at the time of the first examination even at the time of the second examination.

[0050] Further, the image generation function 244 may detect an error between the pressure information (detection result of the pressure sensor 115) when the ultrasonic probe 100A is pressed against the patient P at the time of the first examination and the pressure information when the ultrasonic probe 100B is pressed against the patient P at the time of the second examination, generate a support image for the error, and display it to the user U2.

[0051] FIG. 12 is a diagram for explaining the provision of a support image regarding pressure information. In the example of FIG. 12, the above-described fourth support image IM30 and a sixth support image IM50 showing a pressure distribution are shown. The pressure distribution is the detection result of the pressure sensor 115 at the first inspection. The pressure distribution may be a depth distribution of strain. In this case, the sixth support image IM50 is displayed with the detection result of the pressure sensor 115 color-mapped with luminance information corresponding to the pressure. Further, the sixth support image IM50 may be a color mapping of the absolute value of the error (difference) between the pressure information at the first inspection with the ultrasonic probe 100A and the pressure information obtained from the current ultrasonic probe 100B. Thus, by displaying the pressing (pressure) information to the patient P as a distribution image, it is possible to make it easier for the user U2 to grasp with what force the ultrasonic probe 100B is pressed against the patient P. Therefore, the reproducibility of the first inspection can be improved, and more uniform inspection accuracy can be obtained.

[0052] Note that the sixth support image IM50 may be displayed at a timing when the fourth support image IM30 and the fifth support image IM40 shown in FIG. 11 match (including a predetermined error tolerance range). Thereby, when the sixth support image IM50 is displayed, it is possible to notify the user U2 that the position and orientation of the ultrasonic probe 100B are the same as those at the first inspection, and it is possible to make it easier for the user U2 to grasp that only adjustment of the pressing is necessary thereafter. Note that, instead of (or in addition to) superimposing and displaying the sixth support image IM50 on the ultrasonic cross-sectional image IM30, the image generation function 244 may generate and display a sixth support image IM52 on the contact surface of the ultrasonic probe 100B with the patient P or in a region associated with the contact surface. Thereby, it is possible to make it easier for the user U2 to more accurately grasp at which position of the contact surface there is an error of what degree, and it is possible to cause the ultrasonic inspection to be performed with the same pressing as at the first inspection.

[0053] [Modification of the First Embodiment] At the time of the second examination of the first embodiment, the model image IM10 is fixedly displayed with the information adjusted by the adjustment information. However, after the model image IM10 is positioned at the examination target of the patient P, if the relative positions of the patient P and the user U2 are different, the image generation function 244 may deform the model image IM10 based on the amount of change such as the relative distance between the patient P and the user U2.

[0054] FIG. 13 is a diagram for explaining the state of deformation of the model image at the time of the second examination. For example, at the time of the second examination, the model image IM10 generated in the first examination is displayed at a position separated from the position of the user U2 (the position of the display device 150B) by a distance D1. This position is the position in the state where the coordinate system acquired at the time of the first examination is maintained. The user U2 positions the examination target position (for example, the upper body) of the patient P at the display position of the model image IM10. Then, it is assumed that the relative distance changes to D2 for reasons such as the user U2 moving to a position where the examination work is easy. In this case, the projection function 243 deforms the model image IM10 at an enlargement rate or a reduction rate corresponding to the amount of change ΔD (ΔD = D1 - D2) in the relative distance between the user U2 and the patient P and projects it onto the virtual space. The relative distance is derived based on, for example, the analysis result of a camera provided in the display device 150B.

[0055] In the example of FIG. 13, since the relative distance is far, the projection function 243 generates a model image IM10# obtained by reducing the model image IM10 at a reduction rate corresponding to the amount of change ΔD in the relative distance. Conversely, when the relative distance approaches, the projection function 243 generates a model image IM10# obtained by enlarging the model image IM10 at an enlargement rate corresponding to the amount of change ΔD. Note that, instead of (or in addition to) adjusting the size of the model image IM10, the projection function 243 may adjust the size of the image of the actual data projected onto the virtual space. Thereby, since the support image can be deformed and displayed according to the current relative position, the second inspection can be performed with the same accuracy as in the first inspection. Also, even when performing an ultrasonic inspection by operations at different locations or by different users, the same inspection accuracy results as in the first inspection can be obtained. Note that the deformation of the model image IM10 or the image of the actual data described above may be executed, for example, when there is an instruction from the user U2 via the input interface 220. Thereby, it is possible to suppress the adjustment of the model image IM10 or the image of the actual data every time the relative distance changes.

[0056] [Processing Flow] Next, the processing executed by the ultrasonic result device in the first embodiment will be described. In the following example, the first inspection process at the time of the first inspection and the second inspection process at the time of the second inspection will be described separately.

[0057] (First Inspection Process) FIG. 14 is a flowchart showing an example of the first inspection process executed by the ultrasonic inspection device in the first embodiment. In the first inspection process, the data generation function 242 receives the selection of model data by the user U1 from among one or more pieces of model data stored as template information (step S100), and generates a model image corresponding to the received model data and displays it on the display device 150A (step S110). Next, the data generation function 242 adjusts the shape, size, orientation, etc. of the model image based on a user operation on the switch image SW or the like (step S120).

[0058] Next, the data generation function 242 generates setting information (first inspection setting information) regarding the model data at the time of the first inspection (step S130). Next, the data generation function 242 generates probe information based on the information from the ultrasonic probe 100A (step S140), and stores the generated information in the memory 250 (step S150). Thereby, the processing of this flowchart ends.

[0059] (Second inspection process) FIG. 15 is a flowchart showing an example of the second inspection process executed by the ultrasonic inspection apparatus according to the first embodiment. In the second inspection process, the acquisition function 241 acquires the first inspection setting information 252 (step S200). In the process of step S200, the probe information 253 may also be acquired. Next, the image generation function 244 generates a model image based on the model type of the first inspection setting information 252 and displays it so that it can be visually recognized by the user U2 (step S210). Next, the acquisition function 241 acquires the current position information etc. of the ultrasonic probe 100A (step S220). The position information here may include information such as position, orientation, inclination, etc. Next, the image generation function 244 generates and displays a support image (for example, the above-described first to sixth support images) based on the probe information 253 and the current position information etc. of the ultrasonic probe 100A (step S230). Next, the data generation function 242 generates probe information from the information acquired by the ultrasonic probe 100B (step S240), and stores the generated information in the memory 250 (step S250). Thereby, the processing of this flowchart ends.

[0060] According to the first embodiment described above, there is provided an ultrasonic inspection apparatus 10A that inspects the inside of a patient P using an ultrasonic probe 100A. During a first inspection, a data generation function 242 that generates at least one of model data regarding the build or posture of the patient P and information regarding the actual data of the subject, and an acquisition function 241 that acquires setting information at the time of the first inspection including position information based on an arbitrary point in space between the model data or the actual data and the ultrasonic probe. During a second inspection performed after the first inspection, a projection function 243 that projects an image showing the model data and an image showing the position information of the probe onto a virtual space based on the setting information is provided. Thus, in inspections performed under different situations, a more uniform inspection can be performed.

[0061] For example, ultrasonic inspections at home are often carried out by less experienced examiners (users) compared to when they are performed at major hospitals or university hospitals with excellent personnel, and it is more difficult to perform the inspection in the same manner as at major hospitals or university hospitals. Therefore, according to the first embodiment, information (such as model data and first inspection setting information) that can faithfully reproduce the conditions obtained by the user who performed the first inspection is acquired, and by using the acquired information to have another user perform the inspection during the second inspection, ultrasonic images and the like can be acquired with good reproducibility even during inspections performed in different environments. Further, according to the first embodiment, it is possible to reduce the anxiety of the user performing the second inspection regarding the inspection.

[0062] (Second Embodiment) Next, an ultrasonic inspection apparatus according to the second embodiment will be described. In the second embodiment, a part of the functional configuration of the ultrasonic inspection apparatus 10A used during the first inspection is different from that of the ultrasonic inspection apparatus 10B used during the second inspection, as compared with the first embodiment. In this case, the ultrasonic inspection apparatus 10B performs correction processing on the first inspection setting information in the first inspection.

[0063] FIG. 16 is a configuration diagram of the ultrasonic inspection apparatus 10B at the second inspection used in the second embodiment. The ultrasonic inspection apparatus 10B shown in FIG. 16 includes an ultrasonic probe 100B, a display device 150B, and an ultrasonic processing device 200B. The same display device 150A as that at the first inspection is used. The ultrasonic probe 100B includes, for example, an ultrasonic sensor 111, a position sensor 112, an orientation sensor 113, and an inclination sensor 114. The ultrasonic probe 100B is configured not to have a pressure sensor 115 as compared with the ultrasonic probe 100A.

[0064] The ultrasonic processing device 200B includes, for example, a communication interface 210, an input interface 220, a display 230, a processing circuit 240B, and a memory 250B. The ultrasonic processing device 200B includes a processing circuit 240B and a memory 250B instead of the processing circuit 240 and the memory 250 as compared with the ultrasonic processing device 200A. The processing circuit 240B differs in that it further has a correction function 246 in addition to the functions of the processing circuit 240, and the memory 250B has correction information 254 in addition to the information stored in the memory 250. Therefore, the following mainly focuses on the differences.

[0065] In the second embodiment, the first inspection setting information 252 and the probe information 253 stored in the memory 250B are information generated by another ultrasonic inspection device (more specifically, another model). Therefore, in the second embodiment, the acquisition function 241 acquires the model data or actual data generated by another ultrasonic inspection device and the first inspection setting information 252. Then, based on the first inspection setting information 252 acquired from another ultrasonic inspection device, the projection function 243 projects an image showing the model data and an image showing the position information of the ultrasonic probe 100A (first support image) onto the virtual space. Note that the first inspection setting information 252 and the probe information 253 may be acquired from another ultrasonic inspection device communicated via the communication interface 210, for example. In this case, the acquisition function 241 acquires information regarding the type of another ultrasonic inspection device. The type may be, for example, model information, a product model number (type), product information, or version information.

[0066] The correction information 254 is information for correcting the content of the first inspection setting information based on, for example, differences in devices (models) and functions between the ultrasonic inspection device 10A and the ultrasonic inspection device 10B. The correction information 254 stores information associated with the types of the ultrasonic inspection device 10A and the ultrasonic inspection device 10B, respectively. The correction information 254 may be acquired from an external device communicated via the communication interface 210, for example.

[0067] The correction function 246 acquires the types (model information) of the ultrasonic inspection device 10A used in the first inspection and the ultrasonic inspection device 10B used in the second inspection, and when the types are different, refers to the correction information 254 stored in the memory 250B to acquire the correction information associated with each type. Further, the correction function 246 corrects the content of the first inspection setting information based on the acquired correction information. The image generation function 244 generates a model image and various support images based on the corrected setting information and displays them on the virtual space.

[0068] Further, the correction function 246 may compare not only the entire ultrasonic inspection apparatus but also the types of the ultrasonic probes 100A and 100B, the display devices 150A and 150B, and the ultrasonic processing devices 200A and 200B, and determine whether the types are individually different. In this case, correction contents corresponding to the individual types are stored in the correction information 254, and corrections corresponding to different devices are performed.

[0069] For example, in the second embodiment, the ultrasonic probe 100B is not provided with a pressure sensor. Therefore, the correction function 246 may perform corrections such as not displaying the sixth support images IM50 and IM52 as shown in FIG. 12.

[0070] Further, instead of determining different devices based on the above-described device types, the correction function 246 may determine whether a device different from the first inspection is used based on a difference in inspection results. For example, when the shape of the fourth support image IM30 generated based on the ultrasonic image obtained in the first inspection and the shape of the fifth support image IM40 generated for alignment during the second inspection are different by a predetermined amount or more, the correction function 246 determines that the ultrasonic probe 100B is different from that at the time of the first inspection. In this case, the correction function 246 may notify the user U2 who performs the second inspection of the difference.

[0071] Further, when the correction function 246 performs correction due to a difference in devices, the correction function 246 may generate and display a first support image IM20 switched to the shape of the ultrasonic probe 100B used at the time of the second inspection from the first support image IM20 imitating the ultrasonic probe 100A at the time of the first inspection. Thereby, the user U2 can perform alignment without being aware of the difference in the ultrasonic probes.

[0072] [Processing Flow] FIG. 17 is a flowchart showing an example of the processing executed by the ultrasonic inspection apparatus according to the second embodiment. Note that the first inspection processing in the second embodiment is the same as the processing in the first embodiment. Therefore, in the example of FIG. 17, the second inspection processing will be described. The processing in FIG. 17 is different from the processing in the first embodiment in that the processing of steps S250 to S260 is added between the processing of steps S200 and S210. Therefore, hereinafter, the processing of steps S250 to S260 will be mainly described.

[0073] After acquiring the first inspection setting information 252 in the processing of step S200 in FIG. 17, the correction function 246 determines whether the ultrasonic inspection apparatus 10B is a different apparatus from that at the time of the first inspection based on the type information of the apparatus or the like (step S250). If it is determined that the apparatuses are different, the correction function 246 corrects the first inspection setting information based on the correction information (step S260), and executes the processing after step S210. Further, in the processing of step S250, if it is determined that the model is not different from that at the time of the first inspection, the processing after step S210 is executed.

[0074] According to the second embodiment described above, in addition to achieving the same effects as the first embodiment, even in a situation where the ultrasonic inspection apparatus is different between the first inspection and the second inspection, by correcting using the preset correction information, it is possible to display a model image or a support image adapted to the ultrasonic inspection apparatus 10B used by the user U2 at the time of the second inspection. Therefore, it is possible to suppress the model image or the support image from being displayed at a position different from that at the time of the first inspection due to differences between apparatuses and incorrect support from being performed. As a result, even at the time of the second inspection, a more uniform inspection with high reproducibility of the first inspection can be performed.

[0075] (Third Embodiment) Next, a third embodiment will be described. The third embodiment is different from the first and second embodiments in that it includes a management device that communicates with the ultrasonic inspection devices 10A and 10B in the above-described first and second embodiments and manages ultrasonic inspection results. Therefore, hereinafter, the description will mainly focus on the management device.

[0076] FIG. 18 is a configuration diagram of a management system 1 including a management device according to the third embodiment. The management system 1 includes, for example, a management device 300 and a plurality of ultrasonic inspection devices. In FIG. 18, ultrasonic inspection devices 10A and 10B are provided, but other ultrasonic management devices may be provided. The management device 300 and the ultrasonic inspection devices 10A and 10B communicate with each other via, for example, a communication network NW. The communication network NW means an entire information communication network using telecommunication technologies. The communication network NW includes, for example, a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, a telephone communication line network, an optical fiber communication network, a cable communication network, and a satellite communication network.

[0077] The management device 300 includes, for example, a communication interface 310, an input interface 320, a display 330, a processing circuit 340, and a memory 350.

[0078] The communication interface 310 includes, for example, a communication interface such as a NIC. The communication interface 310 communicates with the ultrasonic inspection devices 10A and 10B via the communication network NW. For example, the communication interface 310 communicates with the ultrasonic inspection device 10A used by the user U1 and the ultrasonic inspection device 10B used by the user U2, acquires and manages the first inspection setting information 351, and generates and manages the probe information 352 from the received inspection results. Further, the communication interface 310 transmits information such as information on the ultrasonic inspection device 10A used at the first inspection and correction information 353 to the ultrasonic inspection device 10B used at the second inspection. These information are stored in the memory 350.

[0079] The input interface 320 receives various input operations from an administrator who manages the management system 1 or the management device 300, converts the received input operations into electrical signals, and outputs them to the processing circuit 340. For example, the input interface 320 is realized by a mouse, a keyboard, a trackball, a switch, a button, a joystick, a touch panel, or the like. Also, the input interface 320 may be realized by a user interface that receives voice input such as a microphone, for example. When the input interface 320 is a touch panel, the display 330 may be formed integrally with the input interface 320.

[0080] The display 330 displays various information. For example, the display 330 displays an image or the like indicating data acquired from the ultrasonic inspection device or the content processed by the processing circuit 340, or displays a GUI or the like for receiving various input operations from the user. For example, the display 330 is an LCD, a CRT display, an organic EL display, or the like.

[0081] The processing circuit 340 includes, for example, an acquisition function 341 and a provision function 342. The processing circuit 340 realizes these functions, for example, by a hardware processor executing a program stored in a memory (storage device, storage circuit) 350. The hardware processor means, for example, a circuit such as a CPU, GPU, application-specific integrated circuit, programmable logic device (e.g., simple programmable logic device or complex programmable logic device, field programmable gate array). Instead of storing the program in the memory 350, it may be configured to directly incorporate the program into the circuit of the hardware processor. In this case, the hardware processor realizes its functions by reading and executing the program incorporated into the circuit. The above program may be stored in the memory 350 in advance, or stored in a non-transitory storage medium such as a DVD or CD-ROM, and may be installed from the non-transitory storage medium into the memory 350 when the non-transitory storage medium is mounted on a drive device (not shown) of the management device 300. The hardware processor is not limited to being configured as a single circuit, and may be configured as one hardware processor by combining a plurality of independent circuits to realize each function. Also, a plurality of components may be integrated into one hardware processor to realize each function.

[0082] Each component of the processing circuit 340 may be realized in a decentralized manner by a plurality of hardware. The processing circuit 340 may be realized not by a configuration of the management device 300, but by a processing device that can communicate with the ultrasonic processing device 200A. The processing device is, for example, a workstation connected to one ultrasonic processing device 200A, or a device (e.g., a cloud server) connected to a plurality of management devices 300 and collectively executing processing equivalent to that of the processing circuit 340 described below.

[0083] The acquisition function 341 acquires information transmitted from the ultrasonic diagnostic apparatuses 10A and 10B and information from other external apparatuses that can communicate via the communication network NW. The provision function 342 provides the first inspection setting information 351, the probe information 352, the correction information 353, etc. to the requester in response to requests from the ultrasonic diagnostic apparatuses 10A and 10B. In this case, the provision function 342 acquires a patient ID etc. from the ultrasonic diagnostic apparatus 10B, and based on the acquired patient ID, acquires information associated with the patient ID from the first inspection setting information 351 and the probe information 352 stored in the memory 350 and provides it to the ultrasonic diagnostic apparatus 10B. Further, the provision function 342 acquires the model information of each of the ultrasonic diagnostic apparatuses 10A and 10B used in the first inspection from the ultrasonic diagnostic apparatus 10B, refers to the correction information 353 from the acquired information, extracts the corresponding correction information, and provides it to the ultrasonic diagnostic apparatus 10B.

[0084] As described above, according to the third embodiment, it is not necessary for the ultrasonic diagnostic apparatuses 10A and 10B to store the first inspection setting information 351, the probe information 352, the correction information 353, etc. in their own memories, and the information of the target can be acquired by requesting the management apparatus 300 as needed.

[0085] As described above, according to the third embodiment, information corresponding to a patient ID, model information, etc. can be acquired from the management apparatus 300 when necessary. Further, according to the third embodiment, by centrally managing probe information etc. in the management apparatus 300, it is possible to assist doctors etc. in performing more accurate diagnosis etc. of patients.

[0086] [Modification Example] The ultrasonic inspection apparatuses used in the above-described first to third embodiments are not limited to the above-described ultrasonic inspection apparatuses 10A and 10B. For example, the display devices 150A and 150B may be integrally configured with the ultrasonic processing devices 200A and 200B. Further, when the ultrasonic probes 100A and 100B are provided with the position sensor 112, the orientation sensor 113, and the inclination sensor 114, the display devices 150A and 150B may not be provided with the camera 152. Further, when the position, orientation, and inclination of the ultrasonic probes 100A and 100B are acquired based on the camera images captured by the cameras 152 of the display devices 150A and 150B, the ultrasonic probes 100A and 100B may not be provided with the position sensor 112, the orientation sensor 113, and the inclination sensor 114. Further, in the embodiment, the display devices 150A and 150B are not limited to wearable devices, and may be tablet terminals, smartphones, or the like provided with a camera and a display.

[0087] Although several embodiments have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and its equivalent scope.

Explanation of Reference Numerals

[0088] 1... Management system, 10A, 10B... Ultrasonic inspection apparatus, 100A, 100B... Ultrasonic probe, 150A, 150B... Display device, 200A, 200B... Ultrasonic processing device, 210, 310... Communication interface, 220, 320... Input interface, 230, 330... Display, 240, 240B, 340... Processing circuit, 241, 341... Acquisition function, 242... Data generation function, 243... Projection function, 244... Image generation function, 245... Display control function, 246... Correction function, 250, 250B, 350... Memory, 300... Management device, 342... Provision function

Claims

1. An ultrasonic inspection apparatus for inspecting the inside of a subject using an ultrasonic probe, comprising: a generation unit that generates at least one of model data regarding the physique or posture of the subject and information regarding the actual data of the subject during a first inspection; an acquisition unit that acquires setting information at the time of the first inspection including position information based on an arbitrary point in space between the model data or the actual data and the ultrasonic probe; a projection unit that projects, onto a virtual space, an image showing the model data and an image showing the position information of the ultrasonic probe based on the setting information during a second inspection performed after the first inspection; an ultrasonic inspection apparatus comprising the above.

2. The acquisition unit acquires, during the second inspection, the model data or the actual data generated by another ultrasonic inspection apparatus and the setting information, and the projection unit projects, onto a virtual space, an image showing the model data and an image showing the position information of the ultrasonic probe based on the setting information acquired from the other ultrasonic inspection apparatus. The ultrasonic inspection apparatus according to Claim 1.

3. The actual data includes information on an object in space associated with the posture of the subject. The ultrasonic inspection apparatus according to Claim 1.

4. The model data includes one or more three-dimensional models selectable by a user using the ultrasonic inspection apparatus, and the generation unit generates, as the model data of the subject, a three-dimensional model selected by the user from the one or more three-dimensional models and adjusted to an arbitrary shape. The ultrasonic inspection apparatus according to Claim 1.

5. The projection unit projects the model data or the actual data while maintaining the coordinate system acquired at the time of the first inspection during the second inspection. The ultrasonic inspection apparatus according to Claim 1.

6. The projection unit projects the model data or the actual data while maintaining the coordinate system acquired at the time of the first inspection during the second inspection, and when the relative distance between the subject at the time of the second inspection and the user using the ultrasonic inspection apparatus changes after the projection, adjusts the size of the projected model data or actual data according to an enlargement rate or a reduction rate corresponding to the relative distance. The ultrasonic inspection apparatus according to Claim 1.

7. The probe information obtained by the ultrasonic probe includes at least one of the position, orientation, tilt, pressure on the surface in contact with the subject, and ultrasonic image information obtained by the ultrasonic probe. The ultrasonic inspection apparatus according to claim 1.

8. The projection unit projects a support image based on the probe information to a position associated with the projection position of the model data. The ultrasonic inspection apparatus according to claim 7.

9. The support image includes an image color-mapped based on the value obtained at the time of the first inspection. The ultrasonic inspection apparatus according to claim 8.

10. A computer of an ultrasonic inspection apparatus for inspecting the inside of a subject using an ultrasonic probe, At the time of the first inspection, causes at least one of model data regarding the physique or posture of the subject and information regarding the actual data of the subject to be generated, Obtains setting information at the time of the first inspection including position information based on an arbitrary point in space between the model data or the actual data and the ultrasonic probe, At the time of the second inspection performed after the first inspection, projects the model data and the position information of the ultrasonic probe onto a virtual space based on the setting information. Program.

Images